Warning Israelis that the "Islamic State is already here," Rivlin told a conference in Tel Aviv that more support was needed for Arab communities.
A number of Arab Israeli citizens have travelled to fight with IS in neighbouring Syria.
The Israeli government in December agreed in principle to increase financing for Arab-Israeli communities, but the funding has not been finalised.
Rivlin, whose position as president is largely symbolic, said that while radicalism was not unique to Israel, "I am concerned that the more the state avoids taking responsibility, the more the state distances itself, the faster the jihadi Salafists will rush in to fill the vacuum."
Also Read
Arab Israelis say they are discriminated against and face marginalisation in Israeli society.
"If the children are growing up without a dream, without hope and without aspirations, with the feeling that their blood, their lives, are of a lesser value in the state of Israel, then we must think how we can offer them a dream, hope, and faith," he said.
Rivlin called on the government to push the funding through as quickly as possible.
"The plan has many detractors among the Jewish population, and it is clear why. But it is the correct and essential step, for it is a decision that represents a systemic change of direction."
Rivlin has often been at odds with the government of Prime Minister Benjamin Netanyahu, though both come from the rightwing Likud party.