In a study on the 2014 outlook for the country's banking sector, EY underlined the tough environment for what is a cornerstone of the Swiss economy.
"Swiss banks have dealt with the challenges of increasingly difficult conditions such as low interest rates, falling transaction volumes and regulatory pressure," said Patrick Schwaller, a managing partner at EY, formerly known as Ernst & Young.
"They have no choice but to adapt their business models and processes on an ongoing basis," he said in a statement.
But the number planning redundancies within the next twelve months nearly doubled to 20 percent, it said.
Also Read
EY polled 120 banks in December, except for giants UBS and Credit Suisse.
Hit by a US crackdown on tax cheats, EY said that the private banking sector, which caters for the wealthiest clients, was facing the greatest pressure.
"The increasingly unfavourable conditions are currently leading many banks to reassess their business models," said Bruno Patusi, head of wealth and asset management at EY Switzerland.
The crisis has driven the battle against tax-dodging to the top of government agendas, forcing Swiss banks to defend the country's long-held tradition of banking secrecy.
The United States has been at the forefront of the fight, and in August Switzerland struck a deal with Washington over the thorny issue of undeclared money banked by American citizens.