Rabb, an Indian Union Muslim League nominee in the UDF cabinet, however, said some quarters were trying to create an unnecessary controversy over the issue.
In a statement, RSS ideologue P Parameswaran, Director of Bhartheeya Vichara Kendram, said there was no justification for changing the name of the official residences in accordance with the personal preference of its temporary occupants.
"More important, Ganga is the eternal symbol of Indian culture," he said.
When his comment was sought on Parameswaran's charge, Rabb told PTI that he was not aware that the name of the house allotted to him was "Ganga".
He said when the Tourism department allotted the residence to him he suggested "Grace" as the name of the house as it is the name of his own home at his native place.
Rabb said it was unfortunate that unnecessary controversies were being generated on issues like this while overlooking the good work he had done in the last one year.
"Nobody wants to know what I have done in the department. Everybody is after controversies," he said.
