In a statement issued here by its state chief Keshav Prasad Maurya, BJP said Shah had lunch with party worker Girja Prasad Bind and its leaders followed the tradition of staying and having meal at workers' house during travel.
"It has been our tradition and should be seen like this. Giving it a political colour is not logical at all," he said.
It is being seen as part of the saffron party's drive to win over Dalits, who have for the last several years now supported the Mayawati-led BSP and will play an important role in the 2017 assembly election.
Attacking BJP, Yadav said it was doing so with an eye on the UP polls and that the Samajwadi Party does not look at people through the prism of caste.
Hitting back, Maurya said, "Why is he so rattled over our president's meal at a worker's house? Dividing people on religious and caste lines has been the Samajwadi Party's culture. Chief Minister Akhilesh Yadav is making such remarks as he has realised that he is losing power in 2017 and is rattled over it.