The four men are among 218 people who escaped from Tanjung Gusta Prison during the riot that left three prisoners and two prison personnel dead.
Malaysia's Special Task Force (Operations and Counter-Terrorism) director Mohamad Fuzi Harun said police and other agencies patrolling the borders were alerted following the escape of the terrorists.
"There is a possibility that these men might slip back into the country through illegal entry points along the coast," he told The Star newspaper.
The terrorists were part of a 16-member gang that robbed an Indonesian branch of CIMB Bank and shot dead a police officer and wounded two security guards in August 2010.
Also Read
"We are monitoring the situation (on the possible entry of the four men into Malaysia) closely and are in contact with our counterparts on the latest developments (in Indonesia)," Harun said.
In a phone interview from Jakarta, Indonesia National Counter-Terrorism Agency head Ansyaad Mbai said one of the terrorists, identified as Fadli, had links with militants in Southeast Asia.
Fadli was a member of the Indonesian Mujahidin Group and was recruited by convicted Indonesian terrorist Toni Togar, who is serving a 20-year prison term in North Sumatra for his role in bombing the J W Marriot Hotel in Jakarta in 2003.