The Croatian deputy prime minister received the support of 565 MEPs, 64 were against and 64 abstained.
Mimica's appointment now has to be formally approved by the Council of the European Union.
He was heard by the relevant EP committees on June 4 and they recommended a positive opinion on Croatia's first European commissioner.
Mimica will take up office on July 1, when Croatia joins the EU.