Herzog, 72, shared the news during a Q&A at the Brooklyn Academy of Music, reported Deadline.
"Just ten days ago I acted in a tiny cameo part in a TV show called, uh, 'Parks and Recreation?" Herzog said.
He went on to detail that he plays "an elderly guy who sells his decrepit house to the young couple who are the leading characters."
The director also elaborated on the plot of the episode, stating that his character is selling his home to move to Florida to be closer to Disney World.
'Parks and Recreation' has been a critical favourite throughout its run and will wrap up with a seventh and final season sometime in 2015.