Tuesday, May 14, 2013

The Whole is Greater than the Sum of the Parts

One of the most mind-blowing implications of portfolio theory is that a well conceived portfolio has the potential to be much better, in terms of risk adjusted performance, than what we might expect from the sum of the individual portfolio holdings.

Not incidentally, the name of our blog - GestaltU - relates directly to this concept. Contrary to the dominant framework of reductionism, which decries that the most effective way to understand something is to understand its parts, Gestalt theory asserts that many things can not be understood by understanding the components, because the 'whole' is greater than the sum of the parts.

This is more obvious in some fields than others. For example, can a person intuit the qualities of water from an understanding of the properties of hydrogen and oxygen (without a deep understanding of quantum mechanics)? Can you effectively comprehend the experience of carrot cake from an understanding of the ingredients?

The famous World Wildlife Found logo is an example of a Gestalt because the brain identifies that the conglomeration of irregular black shapes in the image is actually a panda bear. It is not the shapes themselves, but the orientation of the shapes and how they fit together that communicates the salient information contained in the image.


Most investors pay much more attention to the process of identifying the individual characteristics of the assets they want to own than they commit to the process of identifying how well the assets might fit together in a portfolio. But what if the individual characteristics of the assets are less important than the way they work together?

We've been meaning to get a post up on this topic for a while, but a recent paper published by Cass Business School and sponsored by institutional consultant AonHewitt provided the ammunition we've been looking for. Their paper, which is in two parts, is called 'An evaluation of equity indices". Part 1 examines 'Heuristic and optimized weighting schemes' and Part 2. explores 'Fundamental Weighting Schemes'. This framework works beautifully to illustrate the relative importance of portfolio optimization versus fundamental stock selection because it compares the realized excess risk adjusted performance of pure risk-based optimization methods to methods based on traditional fundamental security selection.

Note that the authors used a universe of the top 1000 stocks by market cap in each year from 1968 - 2012. 

In Part 1., the researchers describe a variety of ways to dynamically generate optimal stock portfolios where there is no effort to emphasize individual return characteristics at the security level. Rather, portfolios were assembled purely on the basis of how constituent stocks were expected to contribute to the overall risk of the portfolio, based on observations of the variance/covariance matrix over a trailing 60 month window. The authors then compared the performance of these optimized portfolios to the ubiquitous market capitalization weighted index, and the more competitive equal weight portfolio. 

It is beyond the scope of this article to describe the characteristics of the different optimizations applied by the authors (we highly recommend that you download the paper and read about the various optimizations), but Table 1. summarizes the results.

Table 1. Portfolio optimization results

Source: Cass Business School, 2013

Part 2. explores a variety of fundamental based methods of creating portfolios that emphasize the stocks with attractive fundamental characteristics. The authors create portfolios where stocks are weighted by qualities like dividends, cashflows, book values, and sales to see how these fundamentally weighted portfolios compare to the traditional market cap and equal weight indices. 

Table 2. Fundamental weighting results
Source: Cass Business School, 2013

It is interesting to compare the two methods of portfolio formation. Note that the best portfolio optimization method (in terms of Sharpe ratio), MVP (minimum variance), delivered 10.8% returns with volatility of 11.2% and a maximum drawdown over the full period of -32.5%. On the other hand, the best fundamental weighting method, Sales-weighted (Sharpe was tied with Dividend weighted, so used Sortino to break the tie), delivered returns of 11.4% with a volatility of 16.2% and a maximum drawdown of -52.6%. Note that the Sharpe ratio of the MVP strategy was 0.5 compared with 0.42 for the Sales-Weighted strategy, and the Sortino ratios were 0.59 and 0.53 respectively.

How is it that optimization alone can deliver better risk adjusted performance without any fundamental information about the relative prospects for portfolio constituents? Part of the answer is that optimization tends to indirectly tilt portfolios toward factors that are well known for adding excess returns over time. 

The following table quantifies the annualized difference between the return to the factor exposure of the alternative index relative to the market-cap index. You can see that the optimized portfolio derives meaningful alpha from a small-cap bias relative to the market-cap index. This is unsurprising. What is more surprising is that the optimizations tend to tilt portfolios toward the Fama French Value factor, and away from the momentum factor.

Table 3. The Returns to Factor Exposures
Source: Cass Business School, 2013

Clearly there is an opportunity to combine fundamental stock-picking factors with robust portfolio optimization to deliver better results than either method alone - another Gestalt!

The following table is taken from an S&P Capital IQ presentation published in December 2010. The authors imposed factor tilts on a minimum variance portfolio derived from constituents of the S&P 1500, with the results in Table 4.  Note improved Return/Risk ratios from a combination of FF Value and Earnings Quality tilt portfolios with minimum variance optimization. 

Table 4. Minimum Variance with Factor Tilts
Source: Capital IQ, 2010

Investors should take note of the opportunity for better risk-adjusted returns by considering more holistic methods of stock-picking rather than concentrating so much time and effort on identifying individual stocks with prospective characteristics. The whole really can be better than the sum of the parts.

Tuesday, April 16, 2013

Darwin Investment Strategies Website Update

Come check out our new website:

www.darwinstrategies.ca



Make sure to check out our Strategies page, and especially our whitepaper on Adapative Asset Allocation:



Sunday, April 14, 2013

What the Bull Giveth, the Bear Taketh Away

Those who cannot remember the past are condemned to repeat it. - Santayana

The question of whether to commit new funds to stocks here is nuanced and complex, not least because it isn't obvious that traditional alternatives - bonds or cash - offer any better value. We are very near all-time low interest rates across most developed government bond markets, credit spreads are near all-time tights, and rates are negative out to 5 or more years in real terms. If these options are representative of the complete opportunity set, then one might be justified in apportioning some capital to equities, if only because it is difficult to identify which investment stinks most profoundly.

However, those who do choose to allocate to equities should be aware of where we are relative to other bull-bear cycles throughout history. We have rambled-on about the poor prospects for equity returns over the next 10 - 20 years in many prior articles (see here for a full analysis, and here for a summary of research from other respected firms), but the true authority on stock market valuation is John Hussman. We would strongly encourage readers to investigate Dr. Hussman's Weekly Market Comments for all the gory details.

This article approaches the issue from a completely new direction than our other work and the work of Dr. Hussman. It is mostly constructed as a thought experiment that explores the logic of compounding, but the conclusion is troubling for those currently overweight U.S. equities.

For the purpose of the study below, we examined the S&P 500 price series from Shiller's publicly available database to understand the duration and magnitude of all bull and bear market periods in U.S. stocks since 1871. We defined a bear market as a drop in prices of at least 20% from any peak, and which lasted at least 3 months. Bull markets were then defined as a rise of at least 50% from the bottom of a bear market, over a period lasting at least 6 months.

Chart 1 and Table 1 describe every bull market since 1871 in the S&P, including duration and magnitude information. The lesson from this analysis is uninspiring for equity bulls, as we will see. The core hurdle is that the current bull market has (through end of February) already delivered 105% of gains, against the median 124% bull market run through history (using monthly data). Of course, this means that, should this bull market deliver an average surge, investors can hope for less than 20% more growth from this cycle. Further, given that the median bull market has historically lasted 50 months, and we are currently in our 49th bull month, we are about due for a wipeout.


Chart 1. Bull Markets since 1871
Source: Shiller (2013)

Table 1. Bull Markets since 1871 - Statistics
Source: Shiller (2013)

It's troubling enough that the current bull market has already delivered 85% of the gains, and lasted about as long, as the median historical bull market. More disconcerting still is the fact that, when the bear market comes, as Chart 2. and Table 2. demonstrate, it is likely to wipe out 38% of all prior gains. And this has profound mathematical implications for current equity investors.

Chart 2. Bear Markets since 1871
Source: Shiller (2013)

Table 2. Bear Markets since 1871 - Statistics
Source: Shiller (2013)

Portfolio growth is governed by the mathematics of compounding, which means that, for example, a 100% gain is erased by a 50% loss, and a 50% loss requires a 100% gain to get back to even. Applying the same principles to where we are in the current bull/bear cycle is illuminating.

If we assume that the next bear market will deliver losses in-line with what we have experienced from bear markets through history, then at the bottom of the next bear market investors will have lost 38% of their portfolio value. The question is, how much must current investors expect stocks to gain before peaking to justify owning them here instead of waiting to purchase them in the next bear market?

The most unbiased estimate of the magnitude of the next bear market is the historical median of 38%. Using the math of compounding, we can determine that a 38% loss requires a 61% gain to break-even [1 / (1 - 38%)]. Logically then, and by extension, investors who choose to hold stocks today must expect gains of at least 61% in order to rationalize their investment; otherwise they would eliminate the anxiety of riding the equity roller-coaster and simply invest in cash, waiting to pounce on stocks at equivalent or lower value at some point during the next bear market.


Figure 1. Example of potential equity roller coaster decision


Note that this argument is not meant to justify any sort of typical 'market timing' approach; most of these are rubbish and very difficult to adhere to for a variety of emotional reasons. Rather, it is a compelling argument for investors to seek out truly different sources of returns, such as tactical alpha strategies, CTAs, or diversified risk strategies inclusive of a wide variety of assets.

Thursday, April 11, 2013

Valuation Based Equity Market Forecasts - Q1 2013 Update

We endorse the decisive evidence that markets and economies are complex, dynamic systems which are not reducible to normal cause-effect analysis. However, we are willing to acknowledge the likelihood that the future is likely to rhyme with the past. Thus, we believe there is substantial value in applying simple statistical models to discover average estimates of what the future may hold over meaningful investment horizons (10+ years), while acknowledging the wide range of possibilities that exist around these averages.

To be crystal clear, the commentary below makes no assertions about whether markets will carry on higher from current levels. Expensive markets can get much more expensive in the intermediate term, and investors need look no further back than the late 2000s for just such an example. However, the physics of investing in expensive markets is that, at some point in the future, perhaps years from now, the market has a very high probability of trading back below current prices; perhaps far below. More importantly, investors must recognize that buying stocks at very expensive valuations will necessarily lead to future returns over the subsequent 10 - 20 years that are far below average.

There are several reasons why it may be useful to have a more robust estimate of future expected returns on stocks:
  • People who are approaching retirement need to estimate probable returns in order to budget how much they need to save.
  • A retiree's level of sustainable income is largely dictated by expected returns over the early years of retirement.
  • Investors of all types must make an informed decision about how best to allocate their capital among various investment opportunities.
Many studies have attempted to quantify the relationship between Shiller PE and future stock returns. Shiller PE smoothes away the spikes and troughs in corporate earnings which occur as a result of the business cycle by averaging inflation-adjusted earnings over rolling historical 10-year windows.
This study contributes substantially to research on smoothed earnings and Shiller PE by adding three new valuation indicators: the Q-Ratio, total market capitalization to GNP, and deviations from the long-term price trends. The Q-Ratio measures how expensive stocks are relative to the replacement value of corporate assets. Market capitalization to GNP accounts for the aggregate value of U.S. publicly traded business as a porportion of the size of the economy. In 2001, Warren Buffett wrote an article in Fortune where he states, "The ratio has certain limitations in telling you what you need to know. Still, it is probably the best single measure of where valuations stand at any given moment." Lastly, deviations from the long-term trend of the S&P inflation adjusted price series indicate how 'stretched' values are above or below their long-term averages.
These three measures take on further gravity when we consider that they are derived from four distinct facets of financial markets: Shiller PE focuses on the earnings statement; Q-ratio focuses on the balance sheet; market cap to GNP focuses on corporate value as a proportion of the size of the economy; and deviation from price trend focuses on a technical price series. Taken together, they capture a wide swath of information about markets.
We analyzed the power of each of these 'valuation' measures to explain inflation-adjusted stock returns including reinvested dividends over subsequent multi-year periods. Our analysis provides compelling evidence that future returns will be lower when starting valuations are high, and that returns will be higher in periods where starting valuations are low.
This last point may seem obvious, but I want to emphasize a critical point about traditional wealth management of which most investors are not aware:
Many traditional investment advisors do not account for whether markets are cheap or expensive when determining investors' long-term asset allocation. In our experience, an investor who visited a traditional Investment Advisor at the peak of the technology bubble in early 2000 would, in practice, have been advised to allocate the same proportion of his wealth to stocks as an investor who visited an Advisor near the bottom of the markets in early 2009. This despite the fact that the first investor would have had a valuation-based expected return on his stock portfolio from January 2000 of negative 2% per year, while the second investor would expect inflation-adjusted compound annual returns of 6.5%. For an investor with $1,000,000 to invest, this would represent a difference of more than $1.26 million in cumulative wealth over a decade.
Said differently, traditional wealth advice is rooted in the assumption that the best estimate of future returns is the average long-term return to stocks. No matter where markets are on the continuum from very cheap to very expensive, traditional Advisors will make recommendations on the assumption that investors should expect 6.5% inflation adjusted returns on stocks over all investment horizons.
John Hussman at Hussman funds is careful to qualify the value of this analysis: "Rich valuation is strongly associated with weak subsequent returns, but only reliably so over periods of 7-10 years. In contrast, the present syndrome of overvalued, overbought, overbullish, rising-yield conditions is typically associated with abrupt and often steep losses, but is more commonly resolved over a period of months rather than years." (Hussman, Feb 2013).

Thus, we are not making a forecast of market returns over the next several months; in fact, markets could go substantially higher from here. However, over the next 10 to 15 years, markets are very likely to revert to average valuations, which are much lower than current levels. This study will demonstrate that investors should expect 6.5% returns to stocks only during those very rare occasions when the stock market passes through 'fair value' on its way to becoming very cheap, or very expensive. At all other periods, there is a better estimate of future returns than the long-term average, and this study endeavours to quantify that estimate.
Investors should be aware that, relative to meaningful historical precedents, markets are currently expensive and overbought by all three measures, indicating a strong likelihood of low inflation-adjusted returns going forward over periods as long as 20 years.
This forecast is also supported by evidence from an analysis of corporate profit margins. In a recent article, John Hussman published a long-term chart of U.S. corporate profits, which demonstrated the magnitude of upward distortion endemic in current corporate profits, which we have reproduced in Chart 1 below. Companies have clearly been benefitting from a period of extraordinary profitability.


Source: John Hussman, 2013
The profit margin picture is critically important. Jeremy Grantham recently stated, "Profit margins are probably the most mean-reverting series in finance, and if profit margins do not mean-revert, then something has gone badly wrong with capitalism. If high profits do not attract competition, there is something wrong with the system and it is not functioning properly." On this basis, we can expect profit margins to begin to revert to more normalized ratios over coming months. If so, stocks may face a future where multiples to corporate earnings are contracting at the same time that the growth in earnings is also contracting. This double feedback mechanism may partially explain why our statistical model predicts such low real returns in coming years. Caveat Emptor.

Modeling Across Many Horizons

Many studies have been published on the Shiller PE, and how well (or not) it estimates future returns. Almost all of these studies apply a rolling 10-year window to earnings as advocated by Dr. Shiller. But is there something magical about a 10-year earnings smoothing factor? Further, is there anything magical about a 10-year forecast horizon?
Kitces (2008, PDF format) demonstrated that "the safe withdrawal rate for a 30-year retirement period has shown a 0.91 correlation to the annualized real return of the portfolio over the first 15 years of the time period". So there is clearly merit in studying a 15-year forecast horizon as well. Further, the tables below will demonstrate that statistical models have the greatest explanatory power at the 15-year horizon.
This study will attempt to address the question of 'perfect forecast horizon', perfect valuation factor, and 'perfect earnings smoothing factor', by analyzing the explanatory power of earnings, the Q-Ratio, and regressed historical stock returns, over return horizons from 1 to 30 years. We will also put all of the factors together to construct an optimized model.
Table 1. below provides a snapshot of some of the results from our analysis. The table shows estimated future returns based on a coherent aggregation of several factor models over some important investment horizons.
Table 1. Factor Based Return Forecasts Over Important Investment Horizons
Source: Shiller (2013), DShort.com (2013), Chris Turner (2013), World Exchange Forum (2013), Federal Reserve (2013), Butler|Philbrick|Gordillo & Associates (2013)
You can see from the table that, according to a model that incorporates valuation estimates from 4 distinct domains, and which explains over 80% of historical returns since 1871, stocks are likely to deliver 1% or less in real total returns over the next 5 to 20 years. Yikes.

Process

The purpose of our analysis was to examine several methods of capturing market valuation to determine which methods were more or less efficacious. Furthermore, we were interested in how to best integrate our valuation metrics into a coherent statistical framework that would provide us with the best estimate of future returns.

Our approach relies on a common statistical technique called linear regression, which takes as inputs the valuation metrics we calculate from a variety of sources, and determines how sensitive actual future returns are to contemporaneous observations of each metric. Linear regression creates a linear function, which by definition can be described by a slope value and an intercept value, which we provide below for each metric and each forecast horizon. A further advantage of linear regression is that we can measure how confident we can be in the estimate provided by the analysis. The quantity we use to measure confidence in the estimates is called the R-Squared.

The following matrices show the R-Squared ratio, regression slope, regression intercept, and current  forecast returns based on a regression analysis for each valuation factor. The matrices are heat-mapped so that larger values are reddish, and small or negative values are blue-ish. Click on each image for a large version.

Matrix 1. Explanatory power of valuation/future returns relationships
Source: Shiller (2013), DShort.com (2013), Chris Turner (2013), World Exchange Forum (2013), Federal Reserve (2013), Butler|Philbrick|Gordillo & Associates (2013)

Matrix 1. contains a few important observations. Notably, over periods of 10-20 years, the Q ratio, very long-term smoothed PE ratios, and market capitalization / GNP ratios are equally explanatory, with R-Squared ratios around 55%.  The best estimate (perhaps tautologically given the derivation) is derived from the price residuals, which simply quantify how extended prices are above or below their long-term trend.

The worst estimates are those derived from trailing 12-month PE ratios (PE1 in Matrix 1 above). Many analysts quote 'Trailing 12-Months' or TTM PE ratios for the market as a tool to assess whether markets are cheap or expensive. If you hear an analyst quoting the market's PE ratio, odds are they are referring to this TTM number. Our analysis slightly modifies this measure by averaging the PE over the prior 12 months rather than using trailing cumulative earnings through the current month, but this change does not substantially alter the results.

As it turns out, TTM (or PE1) Price/Earnings ratios offer the least information about subsequent returns relative to all of the other metrics in our sample. As a result, investors should be extremely skeptical of conclusions about market return prospects presented by analysts who justify their forecasts based on trailing 12-month ratios.

Forecasting Expected Returns

We expect you to be skeptical of our unconventional assertions, so below we provide the precise calculations we used to determine our estimates. The following matrices provide the slope and intercept coefficients for each regression. We have provided these in order to illustrate how we calculated the values for the final matrix below of predicted future returns to stocks.
Matrix 2. Slope of regression line for each valuation factor/time horizon pair.
Source: Shiller (2013), DShort.com (2013), Chris Turner (2013), World Exchange Forum (2013), Federal Reserve (2013), Butler|Philbrick|Gordillo & Associates (2013)
Matrix 3. Intercept of regression line for each valuation factor/time horizon pair.
Source: Shiller (2013), DShort.com (2013), Chris Turner (2013), World Exchange Forum (2013), Federal Reserve (2013), Butler|Philbrick|Gordillo & Associates (2013)
Matrix 4. shows forecast future real returns over each time horizon, as calculated from the slopes and intercepts above, by using the most recent values for each valuation metric (through February 2013). 

For statistical reasons which are beyond the scope of this study, when we solve for future returns based on current monthly data, we utilize the rank in the equation for each metric, not the nominal value.

For example, the 15-year return forecast based on the current Q-Ratio can be calculated by multiplying the current ordinal rank of the Q-Ratio (1171) by the slope from Matrix 2. at the intersection of 'Q-Ratio' and '15-Year Rtns' (-0.000086098), and then adding the intercept at the same intersection (0.119607) from Matrix 3. The result is 0.0188, or 1.88%, as you can see in Matrix 4. below at the same intersection (Q-Ratio | 15-Year Rtns).

Matrix 4. Modeled forecast future returns using current valuations.
Source: Shiller (2013), DShort.com (2013), Chris Turner (2013), World Exchange Forum (2013), Federal Reserve (2013), Butler|Philbrick|Gordillo & Associates (2013)
Finally, at the bottom of the above matrix we show the forecast returns over each future horizon based on our best-fit multiple regression from the factors above. From the matrix, note that the best forecast for future real equity returns integrating all available valuation metrics is 1% or less per year over horizons covering the next 5 to 20 yearsWe also provided the R-squared for each multiple regression underneath each forecast; you can see that at the 15-year forecast horizon, our regression explains 80% of total returns to stocks.
Chart 2. below demonstrates how closely the model tracks actual future 15-year returns. The red line tracks the model's forecast annualized real total returns over subsequent 15-year periods using our best fit multiple regression model . The blue line shows the actual annualized real total returns over the same 15-year horizon.

Chart 2. 15-Year Forecast Returns vs. 15-Year Actual Future Returns
Source: Shiller (2011), DShort.com (2011), Chris Turner (2011), World Exchange Forum (2011), Federal Reserve (2011), Butler|Philbrick & Associates (2011)

You can see that 15-year "Regression Forecast" returns are -0.43% per year  using market valuations as of February 28, 2013.

Putting the Predictions to the Test

A model is not very interesting or useful unless it actually does a good job of predicting the future. To that end, we tested the model's predictive capacity at some key turning points in markets over the past century or more to see how well it predicted future inflation-adjusted returns.
Table 2. Comparing Long-term average forecasts with model forecasts

Source: Shiller (2013), DShort.com (2013), Chris Turner (2013), World Exchange Forum (2013), Federal Reserve (2013), Butler|Philbrick|Gordillo & Associates (2013)
You can see we tested against periods during the Great Depression, the 1970s inflationary bear market, the 1982 bottom, and the middle of the 1990s technology bubble in 1995. The table also shows expected 15-year returns given market valuations at the 2009 bottom, and current levels. These are shaded green because we do not have 15-year future returns from these periods yet.

Observe that, at the very bottom of the bear market in 2009, real total return forecasts never edged higher than 7%, which is only slightly above the long-term average return. This suggests that prices just approached fair value at the market's bottom; they were nowhere near the level of cheapness that markets achieved at bottoms in 1932 or 1982. As of the end of February 2013, annualized future returns over the next 15 years are expected to be less than 0 percent.

We compared the forecasts from our model with what would be expected from using just the long-term average real returns of 6.5% as a constant forecast, and demonstrated that always using the long-term average return as the future return estimate resulted in 350% more error than estimations from our multi-factor regression model over 15-year forecast horizons (1.22% annualized return error from our model vs 5.55% using the long-term average). Clearly the model offers substantially more insight into future return expectations than simple long-term averages, especially near valuation extremes.

Conclusions

The 'Regression Forecast' return predictions along the bottom of Matrix 4. are robust predictions for future stock returns, as they account for over 100 different cuts of the data, using 4 distinct valuation techniques, and utilize the most explanatory statistical relationships. The models explain up to 82% of future returns based on R-Squared, and are statistically significant at p~0. Despite the model's robustness over longer horizons, it is critical to note that even this model has very little explanatory power over horizons less than 6 or 7 years, so the model should not be used as a short-term market-timing tool.
Returns in the reddish row labeled "PE1" in Matrix 4 were forecast using just the most recent 12 months of earnings data, and correlate strongly with common "Trailing 12-Month" PE ratios cited in the media. Matrix 1. demonstrates that this trailing 12 month measure is not worth very much as a measure for forecasting future returns over any horizon. However, the more constructive results from this metric probably helps to explain the general consensus among sell-side market strategists that markets will do just fine over coming years.

Just remember that these analysts have no proven ability whatsoever to predict market returns (see herehere, and here). This reality probably has less to do with the analytical ability of most analysts, and more to do with the fact that most clients would choose to avoid investing in stocks altogether if they were told to expect negative real returns over the long-term from high valuations.
Investors would do much better to heed the results of robust statistical analyses of actual market history, and play to the relative odds. This analysis suggests that markets are currently expensive, and asserts a very high probability of low returns to stocks (and possibly other asset classes) in the future. Remember, any returns earned above the average are necessarily earned at someone else's expense, so it will likely be necessary to do something radically different than everyone else to capture excess returns going forward.

Those investors who are determined to achieve long-term financial objectives should be heavily motivated to seek alternatives to traditional investment options given the grim prospects outlined above. Such investors may find solace in some of the approaches related to 'tactical alpha' that we have described in a variety of prior articles.

Wednesday, February 20, 2013

Balanced Portfolios: Keeping it Real

It's important for clients to understand what they're getting themselves into with a typical balanced portfolio.

The following charts show the distribution of real historical returns over 1, 5, and 10 year horizons for a portfolio consisting of 60% stocks and 40% bonds.

Some facts clients might not be aware of:

  • A balanced portfolio can drop as much as 35% in any given year
  • Balanced portfolios have delivered negative real returns over 10 year periods 15% of the time
  • Over all rolling 5 year periods, a balanced portfolio has yielded real returns ranging from -10% through +22% annualized

Chart 1. Probability of negative real returns to a 60/40 U.S. stock/bond portfolio over 1, 5 and 10 year horizons
Source: Shiller, Federal Reserve

Chart 2. Range of real returns to a U.S. 60/40 stock/bond portfolio over 1, 5, and 10 year horizons
Source: Shiller, Federal Reserve

Chart 3. Frequency distribution of real returns to U.S. 60/40 stock/bond portfolio over rolling 12 month periods
Source: Shiller, Federal Reserve

Chart 4. Frequency distribution of real returns to U.S. 60/40 stock/bond portfolio over rolling 5 year (60 month) periods
 Source: Shiller, Federal Reserve

Chart 5. Frequency distribution of real returns to U.S. 60/40 stock/bond portfolio over rolling 10 year (120 month) periods.
 Source: Shiller, Federal Reserve

Thursday, January 31, 2013

Predicting Markets, or Marketing Predictions

Mark Twain suggested that it is better to remain quiet and be thought a fool, than to open your mouth and remove all doubt.

Would that the 'gurus' who populate the investment and economics landscape would heed Twain's advice. Of course, that will never happen.

We know from studies of expert judgement that gurus who make nuanced predictions and hedge their bets attract much less attention than experts who spin dramatic predictions with unswerving confidence. As a result, firms are predisposed to encourage gurus to voice strong opinions and divergent views that stand out from the crowd. Unfortunately, the qualities that make some gurus more marketable than others are likely to render them less accurate: balanced experts tend to be more accurate than loud ideologues, and their opinions tend to be less damaging when they go wrong. 

And even the best experts get it wrong a lot. In fact, they get it wrong more than they get it right. How do we know?

The best and most comprehensive study of expert judgment was performed by Philip Tetlock. In 1985 Tetlock, fascinated by his previous experience serving on political intelligence committees in the early 1980s, set out to discover just how accurate expert forecasters were in their predictions of future events. Over a span of almost 20 years, he interviewed 284 experts about their level of confidence that a certain outcome would come to pass. Forecasts were solicited across a wide variety of domains, including economics, politics, climate, military strategy, financial markets, legal opinions, and other complex domains with uncertain outcomes. In all, Tetlock accumulated an astounding 82,000 forecasts.

This represents an incredible body of evidence about expert judgment, and Tetlock's analysis rendered several astounding conclusions:

  • Expert forecasts were less well calibrated than one would expect from random guesses
  • Aggregated forecasts were better than any individual forecasts, but were still worse than random guesses
  • Experts who appeared in the media most regularly were the least accurate
  • Experts with the most extreme views were also the least accurate
  • Experts exhibited higher forecast calibration outside of their field of expertise
  • Among all 284 experts, not one demonstrated forecast accuracy beyond random guesses
In short, experts would have delivered better forecasts by flipping coins. But there was a silver lining.

Tetlock also tracked some simple, rules based statistical models alongside the experts to see if these models would be competitive in terms of forecast calibration. He found that many simple models performed with substantially better calibration than the experts, and delivered accuracy well beyond random chance. Chock another one up for the quants.

You might be wondering whether there are any similar types of studies conducted specifically in the area of financial markets. You're in luck, as there are have been several.

CXO Advisory has been tracking and publishing gurus' forecasts of market direction since 1998. Recently, CXO published a review of all 6,459 forecasts from all of the market 'gurus' that they tracked from 1998 - 2012. Specifically, the gurus were graded on their ability to call the direction of the market, but were not penalized for missing the magnitude of the move.

Over 14 years, CXO concluded that the average guru's accuracy in calling the direction of the market has been about 47%, or slightly worse than a coin toss. The following chart shows how the accuracy of forecasts has stabilized over time around the 47% mark as the sample size expanded over time. In other words, the experts were less reliable than flipping coins.


Source: CXO Advisory

The evidence does not end there. The following charts, sourced from James Montier's incredibly useful book,  Behavioural Investing (2007), show aggregate forecasts from Wall Street's most famous oracles through time, next to the actual trajectory of the forecast variable. 

Chart 1. Consensus bond yields forecasts 1 year out vs. actual

Chart 2. Consensus S&P500 level 1 year forecasts vs. actual

Chart 3. Consensus S&P500 aggregate earnings 1 year forecasts vs. actual

In all cases the analysts appear to do a noteworthy job of describing what just happened, but appear to have no vision whatsoever about what is about to happen next. This applies to interest rates, the level of stock indices, and aggregate earnings.

Source: Despair.com

Do any experts get it right? What about the experts at the Federal Reserve who are in charge of setting interest rates? Can they predict the magnitude or direction of interest rates just six months hence?

A working paper entitled "History of the Forecasters: An Assessment of the Semi-Annual U.S. Treasury Bond Yield Forecast Survey" (Brooks & Gray, 2003) studied the ability of Federal Reserve economists, including Alan Greenspan, from 1982 - 2002 to discover whether the group of experts that sets interest rates is able to effectively forecast their trajectory through time. 

Chart 3.
Source: (Brooks & Gray, 2003)

Again we see a strong talent for describing what has just happened, but no talent whatsoever for predicting what will happen next. Just how poor was the forecasting ability of Fed economists, including sitting Fed Chairman Alan Greenspan, over the 20 year survey?

Chart 4. 
Source: (Brooks & Gray, 2003)

The scatter plot above shows how Fed forecasts of interest rates just six months out are negatively correlated with actual outcomes. The r-squared of the regression is 7%, which is not statistically significant, so don't bet the farm against the Fed either. The point is, they can't forecast any better than anyone else.

There is ample evidence that strategists and gurus are unlikely to add much value to the investing process - at least where the goal is to grow your portfolio. Our next article will address another ubiquitous observation in wealth management - overconfidence - and discuss solutions for disillusioned investors looking for a new direction with better odds of success.