According to industry sources, Google CEO Larry Page is transferring leadership of core Google products to Pichai, who will now oversee products like search, maps, Google+, commerce, advertising and infrastructure.
Also, six executives who previously reported to Page, including heads of research, social media and search, will now report to Pichai, they added.
Google has, however, left out its video sharing service, YouTube, out of the restructuring exercise.
Pichai, who is currently SVP, Android, Chrome & Apps, has been adding key Google businesses under his ambit since joining the company in 2004.
Born in Chennai, the 42-year old has worked at Applied Materials and McKinsey & Co.
An IIT-Kharagpur alumnus, Pichai has also attended the Wharton School at the University of Pennsylvania, Stanford University.