The first game in the series, simply called Punch-Out!! was released in Japanese arcades in 1983 and it came to the western world in 1984.
The single player game was produced by Genyo Takeda, who had been working for Nintendo since 1972. In 1975, he made their first ever arcade title, called EVR Race (assuming you don't count Laser Clay Shooting System).