2017-020: Gauging the Uncertainty of the Economic Outlook Using Historical Forecasting Errors: The Federal Reserve’s Approach
David Reifschneider and Peter Tulip | Since November 2007, the Federal Open Market Committee (FOMC) of the U.S. Federal Reserve has regularly published participants’ qualitative assessments of the uncertainty attending their individual forecasts of real activity and inflation, expressed relative to that seen on average in the past. The benchmarks used for these historical comparisons are the average root mean squared forecast errors (RMSEs) made by various private and government forecasters over the past twenty years. This paper documents how these benchmarks are constructed and discusses some of their properties. We draw several conclusions. First, if past performance is a reasonable guide to future accuracy, considerable uncertainty surrounds all macroeconomic projections, including those of FOMC participants. Second, different forecasters have similar accuracy. Third, estimates of uncertainty about future real activity and interest rates are now considerably greater than prior to the financial crisis; in contrast, estimates of inflation accuracy have changed little. Finally, fan charts–constructed as plus-or-minus one RMSE intervals about the median FOMC forecast, under the expectation that future projection errors will be unbiased and symmetrically distributed, and that the intervals cover about 70 percent of possible outcomes–provide a reasonable approximation to future uncertainty, especially when viewed in conjunction with the FOMC’s qualitative assessments. That said, an assumption of symmetry about the interest rate outlook is problematic if the expected path of the federal funds rate is expected to remain low.
David Reifschneider and Peter Tulip | Since November 2007, the Federal Open Market Committee (FOMC) of the U.S. Federal Reserve has regularly published participants’ qualitative assessments of the uncertainty attending their individual forecasts of real activity and inflation, expressed relative to that seen on average in the past. The benchmarks used for these historical comparisons are the average root mean squared forecast errors (RMSEs) made by various private and government forecasters over the past twenty years. This paper documents how these benchmarks are constructed and discusses some of their properties. We draw several conclusions. First, if past performance is a reasonable guide to future accuracy, considerable uncertainty surrounds all macroeconomic projections, including those of FOMC participants. Second, different forecasters have similar accuracy. Third, estimates of uncertainty about future real activity and interest rates are now considerably greater than prior to the financial crisis; in contrast, estimates of inflation accuracy have changed little. Finally, fan charts–constructed as plus-or-minus one RMSE intervals about the median FOMC forecast, under the expectation that future projection errors will be unbiased and symmetrically distributed, and that the intervals cover about 70 percent of possible outcomes–provide a reasonable approximation to future uncertainty, especially when viewed in conjunction with the FOMC’s qualitative assessments. That said, an assumption of symmetry about the interest rate outlook is problematic if the expected path of the federal funds rate is expected to remain low.