This "forgetfulness led to his being threatened with eviction" from his apartment on the upmarket Left Bank of Paris, reported newspaper Le Canard Enchaine.
Thevenoud, who was fired last week for "problems of conformity with his taxes", reportedly failed to pay his rent for three years.
Le Canard said he had confessed to "an administrative phobia" that put him off such tasks. It added that he has now "resolved his debts and changed landlord".
Thevenoud did not respond to requests for comment from AFP.
His two-week tenure in government provided yet another embarrassment to the embattled Socialist government of President Francois Hollande, who faces record-low approval ratings.
Despite pressure, Thevenoud has stated he will not resign from parliament, although he has quit the Socialist Party.