The 68-year-old action star said Ali was his idol and a great motivation, reported ET online.
"I just came here to honor Ali, because I think he was a great motivation for all of us, and he was an idol of mine.
"People ask me, 'Who are some of your idols?' He's one of the five people that I always mention, because of his generosity and because of his great skills," Schwarzenegger said.
The former Governor of California said Ali inspired him not because of his success as an athlete, but because of his philanthropy.
Apart from Schwarzenegger, Billy Crystal, Will Smith, Dave Chappelle and Spike Lee also attended the ceremony at the KFC Yum! Center in Louisville to lay the legend to rest.