Financial markets are information processing engines. A large number of speculators look at the world, make forecasts about the future, and place bets. They are not armchair forecasters - they put their money where their mouth is. It is interesting to ask: How well does the stock market fare, in consuming information and producing informative prices?
Let's start with the forecastability of prices. In a well-functioning market, all news is impounded into the price, and tomorrow's fluctuation depends on tomorrow's news. Some people think that randomness of price movements proves that markets work badly. However, as tomorrow's news is unpredictable, tomorrow's fluctuation should be unpredictable. Unpredictability in the movement of prices is the hallmark of a market that is working well.
The market does well in this respect. It is very hard to forecast prices by using price data. There are chinks in the armour of market efficiency - but they are small deviations from the ideal state. Only by going into high-frequency data such as one minute or one second do we stand a chance of using price data to forecast prices. These small edges are being competed away as more securities firms gain mastery of algorithmic and high-frequency trading.
What about fundamentals? The market price measures the aggregative opinion of all the speculators. If they are doing a good job of understanding the world, they should have forecasting power. Let's first think about "micro-forecasting", or thinking about one security at a time.
The other dimension of linking prices to reality is "macro-forecasting", or thinking about the overall Indian economy. Let's focus on the P/E ratio of the CMIE Cospi index, which is a broad market index that covers all listed companies that achieve a certain (low) threshold of market liquidity. From 1999 till today, the number of firms in this index has ranged between 900 and 2,800.
If the stock market were a good macro forecaster, periods with a high Cospi P/E ratio would precede a big earnings expansion, and vice versa. But the data does not show a strong pattern of this nature.
The market-wide P/E was above 30 in 1999, but earnings were flat till 2002. The biggest single expansion of earnings in India's history took place from 2002 to 2008 where the net profit went up nine times. The P/E ratio of the overall market didn't anticipate this. During the earnings expansion from 2002 to 2009, the market appears to have slowly caught up with the remarkable developments. As late as 2003, the P/E ratio was below 10, showing a lack of appreciation for what had already begun. The P/E ratio gradually went up after the earnings growth was demonstrated. It peaked at near 30 at the end of this phase of earnings expansion. The market failed to see that things were going to get difficult from there on.
With the benefit of hindsight, we know that there was negligible earnings growth from 2008 till 2015. A period of nine-fold earnings expansion from 2002 till 2008 was followed by a period of flat earnings from 2008 till 2015. The market wide P/E ratio failed to see that. In 2010 the market felt that the Lehman crisis was over and we are back to normal. The market was wrong. From early 2014, the market-wide P/E ratio doubled from 15 to 30. So far this forecast has not proved correct.
The picture thus seems to be in three parts: the market is doing well on utilising price information, with a frontier in high-frequency trading which is pushing the zone of non-forecastability of prices to ever smaller time horizons. The market is doing relatively well in security analysis. A lot of people are studying individual companies. By and large, there is good sense in the differential valuations being awarded to firms. Managers who build for future growth are being rewarded by the market. However, by and large, the market is failing at macro forecasting.
Market-wide earnings growth is arguably the dominant phenomenon which shapes the performance of portfolios - for example, the nine-fold increase in earnings from 2002 to 2008 was the dominant story of portfolio performance of that period. The market does not seem to understand this.
We can conjecture two kinds of explanations. Perhaps macro-forecasting in India is too hard. Indian macroeconomic data is a shabby mess, and very little is known about Indian macroeconomics. While people may try to divine the future, this is a hopeless task.
Alternatively, perhaps macro forecasting is under-resourced. The macro thinking that's being done by financial firms today is overly simplistic. What's needed is paying less attention to the official government statistics and press releases, developing new ways to measure the economy, and forming a view about the future. On the margin, the information processing in finance should favour this.
The writer is a professor at National Institute of Public Finance and Policy, New Delhi