A General Administration Department notice stated that Gupta has been suspended till next order.
Gupta, who was Sub Divisional Officer of Mohania in Rohtas district was held by the Vigilance department on July 12 for allegedly indulging in corruption.
A case was registered against Gupta in the vigilance police station under anti-corruption law.
Papers of some trucks seized in the sub division was found in possession of the IAS officer on complaint lodged by a trucker.
Arrest of the officer had triggered protest from state IAS officers' association.