Some active mutual funds have prospectus benchmarks that understate risk and, thus, overstate relative performance. Larry Swedroe unpacks a study that explores how such funds benefit from that overstatement at investors’ expense.
Evaluating the performance of actively managed mutual funds generally involves comparing a product’s results with some passive benchmark (the SEC requires that funds select a benchmark for comparison purposes) that follows the same investment “style” as the fund’s portfolio (such as the S&P 500 for large-cap stocks, the S&P MidCap 400 for midcap stocks and the S&P SmallCap 600 for small-cap stocks).
This practice can create problems, as funds can choose benchmarks with less exposure than they do to factors that historically have provided premiums (such as market beta, size, value, momentum, profitability and quality). Thus, the benchmarks have lower expected returns.
This misleading practice is important because, as Berk Sensoy’s study, “Performance Evaluation and Self-Designated Benchmark Indexes in the Mutual Fund Industry,” which appeared in the April 2009 issue of the Journal of Financial Economics, shows, “almost one-third of actively managed, diversified U.S. equity mutual funds specify a size and value/growth benchmark index in the fund prospectus that does not match the fund’s actual style.”
Unfortunately, the same research also shows that when allocating capital, individual investors emphasize comparisons relative to the mutual fund’s self-selected benchmark, not its true, risk-adjusted benchmark. It’s clear that fund companies strategically choose a benchmark that will drive fund flows.
Martijn Cremers, Jon Fulkerson and Timothy Riley contribute to the literature on mutual fund performance relative to self-selected benchmarks with their May 2018 study, “Benchmark Discrepancies and Mutual Fund Performance Evaluation.”
They used a holdings-based procedure to determine whether an actively managed fund has a “benchmark discrepancy”; that is, a benchmark other than the prospectus benchmark that better matches a fund’s actual investment strategy.
To accomplish this objective, they identified the benchmark that has the lowest active share with the fund’s holdings. They considered a fund as having a benchmark discrepancy if its benchmark mismatch was at least 60%. Their calculations revealed 26% of funds in their sample had a benchmark discrepancy. The authors’ data covers the period 1991 through 2015.
Following is a summary of their findings:
Cremers, Fulkerson and Riley were able to conclude their results “show that a substantial number of funds have a prospectus benchmark that on average is easier to outperform compared to the benchmark implied by their holdings.”
Thus, the authors explain, “investors in general could considerably improve their capital allocations by avoiding funds where the prospectus benchmark is a poor match for the fund’s portfolio. Put another way, investors could improve their capital allocations by focusing on funds where the prospectus benchmark is a good match.”
Today investors have readily available tools, such as the regression analysis tool at Portfolio Visualizer, to enable them to choose the appropriate benchmark when evaluating the performance of an actively managed fund. Such tools also enable investors to determine if the fund actually has generated alpha after adjusting for exposure to common factors.
Constructing Benchmarks From ETFs
The findings in Cremers, Fulkerson and Riley’s study are consistent with those of an October 2016 study, “Investible Benchmarks for Actively Managed Mutual Funds,” that Riley authored alone. While most of the academic literature compares active funds’ returns to risk-adjusted benchmarks using indexes and/or factor regressions, Riley instead used ETFs to build investable benchmarks for actively managed mutual funds. He did so because, while benchmark index returns don’t include implementation costs, ETF returns do; thus, we have a more real-world comparison.
Riley’s benchmarking process did not make assumptions based on a mutual fund’s stated style or benchmark. Rather, he selected the appropriate benchmark based on a fund’s exposure to common factors (market beta, size, value, momentum, investment and profitability) and return history.
He noted: “The benchmarks can be identified in advance, do not require shorting or leverage, and require only annual rebalancing.” Riley also observed that a similar approach has shown that a portfolio of ETFs can be used to replicate the performance of hedge funds. Given that ETFs are relatively new, and that he needed a sufficient number of ETFs to complete the comparison, his study covered the period 2003 through 2014.
Following is a summary of his findings:
Riley concluded that because the actively managed funds in his sample managed about $2.5 trillion at the end of 2014, underperformance of 1% a year represented an opportunity cost of $25 billion per year for investors selecting active management. That’s the cost of the triumph of hype, hope and marketing over wisdom, experience and the evidence. Even that cost understates the true cost for taxable investors, as it’s often the case that, for such investors, the greatest cost of active management is taxes.
As Cremers, Fulkerson and Riley note in their study: “Risk-adjustment is central to performance evaluation. To facilitate that process, mutual funds are legally required to provide a benchmark to investors in the fund prospectus. Given that funds rarely change their prospectus benchmark and market themselves in a competitive environment to investors that often have limited sophistication, we might expect funds to respond strategically when constructing their portfolios.
While most funds appear to have a risk-appropriate prospectus benchmark, we find that a substantial portion of funds have a prospectus benchmark that understates risk and, consequently, overstates relative performance. Further, we show that funds benefit from that overstatement, as investor flows respond to performance relative to the prospectus benchmark even when a fund has a benchmark discrepancy.”
The annual SPIVA reports—which use appropriate, not prospectus-based, benchmarks—persistently demonstrate that using actively managed funds is a loser’s game, though choosing inappropriate benchmarks can make it seem otherwise.
The research, including Eugene Fama and Kenneth French’s study, “Luck versus Skill in the Cross-Section of Mutual Fund Returns,” which was published in the October 2010 issue of The Journal of Finance, has found that far fewer active managers (about 2%) are able to outperform appropriate risk-adjusted benchmarks than would be expected by chance. That 2% figure is even before considering taxes, which is typically the largest expense for taxable investors. If taxes were taken into account, the figure would be significantly lower. That makes active management a loser’s game—one that is possible to win, but the odds of doing so are so low it is simply not prudent to try.
This commentary originally appeared June 22 on ETF.com
By clicking on any of the links above, you acknowledge that they are solely for your convenience, and do not necessarily imply any affiliations, sponsorships, endorsements or representations whatsoever by us regarding third-party Web sites. We are not responsible for the content, availability or privacy policies of these sites, and shall not be responsible or liable for any information, opinions, advice, products or services available on or through them.
The opinions expressed by featured authors are their own and may not accurately reflect those of the BAM ALLIANCE. This article is for general information only and is not intended to serve as specific financial, accounting or tax advice.
© 2018, The BAM ALLIANCE®