Swisher edged Boston first baseman Kevin Youkilis for the final AL spot. He was also competing against Chicago White Sox first baseman Paul Konerko, Texas third baseman Michael Young and Minnesota outfielder Delmon Young.
Swisher received 9.8 million votes during the four days of Internet balloting and is the eighth Yankees player selected.
Votto earned the 34th and final spot on the National League roster by beating out Washington third baseman Ryan Zimmerman, Colorado outfielder Carlos Gonzalez and Atlanta closer Billy Wagner. Padres reliever Heath Bell was a candidate before being chosen as an injury replacement on the NL squad.