Hollywood star Tom Cruise's ex-wife was among guests at the event at businessman Ron Perelman's home in the Hamptons, New York.
The fundraiser was also attended by Billy Joel, Anjelica Huston, Howard Stern, and John McEnroe, reported New York Post.
Holmes, DeGeneres, Jamie Foxx, Ciara, Pharrell Williams, and the Roots joined 'Fly Away' hitmaker Kravitz for a unique performance, which included a snippet of 'Blurred Lines' by Robin Thicke.
"I haven't had such a good time in so long," Holmes later told her friends.
The event reportedly raised more than USD 3 million for education and culture programs at New York's Apollo Theater.