Can a simple DSGE model outperform Professional Forecasters?
DSGE models have recently become one of the most frequently used tools in policy analysis. Nevertheless, their forecasting proprieties are still unexplored. In this article we address this problem by examining the quality of forecasts from a small size DSGE model, a trivariate VAR model and the Philadelphia Fed Survey of Professional Forecasters. The forecast performance of these methods is analysed for the key U.S. economic variables: the three month Treasury bill yield, the GDP growth rate and the GDP price index inflation. We evaluate the ex post forecast errors on the basis of the data from the period of 1994-2006. We apply the Philadelphia Fed "Real-Time Data Set for Macroeconomists," described by Croushore and Stark (2001a), to ensure that the information available to the SPF was exactly the same as the data used to estimate the DSGE and VAR models. Overall, the results are mixed. It appears that when comparing the root mean squared errors for some forecast horizons the DSGE model seems to outperform the SPF in forecasting the GDP growth rate. However, this characteristic turned out to be not statistically significant. In principle most forecasts of the GDP price index inflation and the short term interest rate by the SPF are significantly better than those from the DSGE model. The forecast quality of the VAR model turned out to be the worst one.(original abstract)
- Blanchard, O., Kahn, C. (1980), The Solution of Linear Difference Models Under Rational Expectations,"Econometrica", Vol. 48, p. 1305-1311.
- Calvo, G. (1983), Staggered Prices in a Utility Maximizing Framework,"Journal of Monetary Economics", Vol. 12, p. 383-398.
- Christiano, L., Eichenbaum, M., Evans, C. (2005), Nominal Rigidities and the Dynamic Effects of a Shock to Monetary Policy,"Journal of Political Economy", Vol. 113, Iss. 1, p. 1-45.
- Clark, T., McCracken, M. (2006), Forecasting with Small Macroeconomic VARs in the Presence of Instabilities,Working Paper No. 06-09, Federal Reserve Bank of Kansas City.
- Croushore, D. (2006), An Evaluation of Inflation Forecasts From Surveys Using Real-Time Data, Working Paper No. 06-19, Federal Reserve Bank of Philadelphia.
- Croushore, D., Stark, T. (2001a), A Real-Time Data Set for Macroeconomists, " Journal of Econometrics", Vol. 105, p. 111-130.
- Croushore, D., Stark, T. (2001b), Forecasting with a Real-Time Data Set for Macroeconomists,Working Paper No. 01-10, Federal Reserve Bank of Philadelphia.
- Del Negro, M., Schorfheide, F., Smets, F., Wouters, R. (2005), On the Fit and Forecasting Performance of New Keynesian Models, CEPR Discussion Paper Series No. 4848, Centre for Economic Policy Research, London.
- Diebold, F. X., Mariano, R. S. (1995), Comparing Predictive Accuracy,"Journal of Business & Economic Statistics", Vol. 13, No. 3, p. 253-263.
- Dixit, A., Stiglitz, J. (1977), Monopolistic Competition and Optimum Product Diversity," American Economic Review", Vol. 67, p. 297-308.
- Edge, R., Kiley, M., Laforte, J. (2006), A Comparison of Forecast Performance Between Federal Reserve Staff Forecasts, Simple Reduced-Form Models, and a DSGE Model," http://www.eabcn.org/workshops/zurich_2006/documents/Laforte.pdf.
- Harvey, D., Leybourne, S., Newbold, P. (1997), Testing the equality of prediction mean squared errors,"International Journal of Forecasting", Vol. 13, No. 2, p. 281-291.
- Ireland, P. (2004), Technology Shocks in the New Keynesian Model, NBER Working Paper No. 10309, National Bureau of Economic Research, Cambridge.
- Kydland, F., Prescott, C. (1982), Time To Build and Aggregate Fluctuations,"Econometrica", Vol. 50, p. 1345-1370.
- Newey, W. K., West, K. D. (1994), Automatic Lag Selection in Covariance Matrix Estimation,"The Review of Economic Studies", Vol. 61, No. 4, p. 631-653.
- Newey, W. K., West, K. D. (1987), A Simple, Positive Semi-Definite, Heteroskedasticity and Autocorrelation Consistent Covariance Matrix,"Econometrica", Vol. 55, No. 3, p. 703-708.
- Obstfeld, M., Rogoff, K. (1995), Exchange Rate Dynamics Redux,"The Journal of Political Economy", Vol. 103, No. 3, p. 624-660.
- Orphanides, A., Williams, J. (2002), Robust monetary policy rules with unknown natural rates, Brookings Papers on Economic Activity, Vol. 2, p. 63-118.
- Rudebusch, G. (2002), Term structure evidence on interest-rate smoothing and monetary policy inertia,"Journal of Monetary Economics", Vol. 49, p. 1116-1186.
- Sims, Ch. (1980), Macroeconomics and Reality,"Econometrica", Vol. 48, p. 1-48.
- Smets, F., Wouters, R. (2004), Forecasting With a Bayesian DSGE Model: An Application to the Euro Area, Working Paper No. 389, European Central Bank, Frankfurt.
- Smets, F., Wouters, R. (2003), An Estimated Dynamic Stochastic General Equilibrium Model of the Euro Area," Journal of the European Economic Association", Vol. 1, Iss. 5, p. 1123-1175.
- Taylor, J. (1993), Discretion versus policy rules in practice," Carnegie-Rochester Series on Public Policy, Vol. 39, p. 195-214.