'If Nonlinear Models Cannot Forecast, What Use Are They?' - Abstract

If Nonlinear Models Cannot Forecast, What Use Are They?

James B. Ramsey
Department of Economics
New York University


Abstract

This paper begins with a brief review of the recent experience using nonlinear models and ideas of chaos to model economic data and to provide forecasts that are better than linear models. The record of improvement is at best meager. The remainder of the paper examines some of the reasons for this lack of improvement. The concepts of "openness" and "isolation" are introduced, and a case is made that open and nonisolated systems cannot be forecasted; the extent to which economic systems are closed and isolated provides the true pragmatic limits to forecastability. The reasons why local "overfitting," especially with nonparametric models, leads to worse forecasts are discussed. Models and "representations" of data are distinguished and the reliance on minimum mean-square forecast error to choose between models and representations is evaluated.

Bibliography

  • Alogoskoufis, George S., and Thanasis Stengos (1991). "Testing for Nonlinear Dynamics in Historical Unemployment Series." European University Institute Working Paper ECO 91/38, Badia Fiesolana, Italy.
  • Ashley, Richard (1995). "Non-Nested Model Selection/Validation: Making Credible Post-Sample Inference Feasible." Economics Dept. Working Paper E95-07, Blacksburg, Virginia: Virginia Tech.
  • Ashley, Richard A., Douglas A. Patterson, and Melvin J. Hinich (1986). "A Diagnostic Test for Nonlinear Serial Dependence in Time Series Fitting Errors." Journal of Time Series Analysis , 7(3):165-178.
  • Ashley, Richard A., and Douglas M. Patterson (1989). "Linear Versus Nonlinear Macroeconomics: A Statistical Test." International Economic Review , 30(3):685-704.
  • Barnett, William A., A. Ronald Gallant, and Melvin Hinich (1993). "Detection of Nonlinearity and Chaos: Application to Money Stock." In Dept. of Economics Working Paper Series 178, Washington University, St. Louis, Missouri.
  • Bollerslev, T., R. Y. Chou, J. Jayaraman, and K. F. Kroner (1990). "ARCH Modeling in Finance: A Review of the Theory and Empirical Evidence." Journal of Econometrics , 52(1):5-60.
  • Brock, W. A., D. Hsieh, and B. LeBaron (1991). Nonlinear Dynamics, Chaos, and Instability: Statistical Theory and Economic Evidence . Cambridge, Massachusetts: MIT Press.
  • Brock, William A., and Simon M. Potter (1993). "Nonlinear Time Series and Macroeconomics." In G. S. Maddala, C. R. Rao, and H. D. Vinod, eds., Handbook of Statistics , vol. 11. New York: Elsevier Science, pp. 195-229.
  • Casdagli, Martin (1989). "Nonlinear Prediction of Chaotic Time Series." Physica D , 35:335-356.
  • Casdagli, Martin (1992). "A Dynamical Systems Approach to Modeling Input-Output Systems." In Martin Casdagli and Stephen Eubank, eds., Nonlinear Modeling and Forecasting, Diagnostic Testing for Nonlinearity, Chaos, and General Dependence in Time Series Data . Redwood City, California: Addison-Wesley, pp. 265-282.
  • Dacorogna, M. M., et al. (1993). "A Geographical Model for the Daily and Weekly Seasonal Volatility in the Foreign Exchange Market." Journal of International Money and Finance , 12:413-438.
  • Day, Theodore E., and Craig M. Lewis (1988). "Stock Market Volatility and the Information Content of Stock Index Options." Journal of Econometrics , (April/May) 52:267-287.
  • Diebold, Francis X., and Roberto S. Mariano (1994). "Comparing Predictive Accuracy." Technical Working Paper Series 169, Cambridge, Massachusetts: National Bureau of Economic Research.
  • Diebold, Francis X., and James A. Nason (1990). "Nonparametric Exchange Rate Prediction?" Journal International Economics , 28:315-332.
  • Diewert, W. E., and T. J. Wales (1987). "Flexible Functional Forms and Global Curvature Conditions." Econometrica , 55(1):43-68.
  • Engle, Robert F., David F. Hendry, and Jean-Francois Richard (1983). "Exogeneity." Econometrica , 51(2):277-304.
  • Gallant, A. R., and E. H. Golub (1984). "Imposing Curvature Restrictions on Flexible Functional Forms." Journal of Econometrics , 26:295-321.
  • Ghysels, Eric, Alain Guay, and Alastair Hall (1995). "Predictive Tests for Structural Change with Unknown Breakpoint." CIRANO Scientific Series , (March) 95s-20:1-27.
  • Granger, C. W. J., and Timo Teräsvirta (1992). "Experiments in Modeling Nonlinear Relationships Between Time Series." In Martin Casdagli and Stephen Eubank, eds., Nonlinear Modeling and Forecasting, Diagnostic Testing for Nonlinearity, Chaos, and General Dependence in Time Series Data . Redwood City, California: Addison-Wesley, pp. 189-198.
  • Granger, Clive W. J. (1991). "Developments in the Nonlinear Analysis of Economic Series." Scandinavian Journal of Economics , 93(2):263-276.
  • Hastie, Trevor, and Robert Tibshirani (1993). "Varying-Coefficient Models." Journal of the Royal Statistical Soc. Series B , 55(4):757-779.
  • Hornik, K., M. Stinchcombe, and H. White (1989). "Universal Approximation of an Unknown Mapping and Its Derivatives Using Multilayer Feedforward Networks." University of California, San Diego DP 89-34. La Jolla: Economics Dept.
  • Hunter, Norman F., Jr. (1992). "Application of Nonlinear Time Series Models to Driven Systems." In Martin Casdagli and Stephen Eubank, eds., Nonlinear Modeling and Forecasting, Diagnostic Testing for Nonlinearity, Chaos, and General Dependence in Time Series Data . Redwood City, California: Addison-Wesley, pp. 467-492.
  • Jaditz, Ted, and Chera Sayers (1993). "Are Chaotic Attractors Generic in Economic Data?" International Journal of Bifurcation and Chaos , 3:745-755.
  • Lau, L. J. (1978). "Testing and Imposing Monotonicity, Convexity and Quasiconvexity Constraints." In M. Fuss and D. McFadden, eds., Production Economics: A Dual Approach to Theory and Applications , vol. 1. Amsterdam: North Holland, pp. 409-453.
  • LeBaron, Blake (1994). "Chaos and Forecastability in Economics and Finance." Phil. Trans. Royal Society , 348:397-404.
  • Lee, T., H. White, and C. W. J. Granger (1993). "Testing for Neglected Nonlinearity in Time Series Models." Journal of Econometrics , 56:269-290.
  • Lorenz, Hans-Walter (1989). "Nonlinear Dynamical Economics and Chaotic Motion." Lecture Notes in Economics and Mathematical Systems , no. 334. New York: Springer-Verlag.
  • Lorenz, Hans-Walter (1993). "Complexity in Deterministic, Nonlinear Business Cycle Models--Foundations, Empirical Evidence, and Predictability." In F. Gori, L. Geronazzo, and M. Galeotti, eds., Nonlinear Dynamics in Economics and Social Sciences . Berlin: Springer-Verlag, pp. 17-52.
  • Makridakis, Spyros (1986). "The Art and Science of Forecasting: An Assessment and Future Directions." International Journal of Forecasting , 2:15-39.
  • Makridakis, Spyros (1993). "Accuracy Measures: Theoretical and Practical Concerns." International Journal of Forecasting , 9(4):527-530.
  • McCurdy, Thomas H., and Thanasis Stengos (1988). "A Comparison of Risk-Premium Forecasts Implied by Parametric versus Nonparametric Conditional Estimators." Journal of Econometrics , 52:225-244.
  • Meese, Richard A., and Andrew K. Rose (1991). "An Empirical Assessment of Nonlinearities in Models of Exchange Rate Determination." Review of Economic Studies , 58:603-619.
  • Mittnik, Stefan (1991). "State Space Modeling of Nonlinear Time Series." Stony Brook, NY: State University of New York, Dept. of Economics. Economics Working Paper 90-336.
  • Mizrach, Bruce (1992). "Multivariate Nearest Neighbor Forecasts of EMS Exchange Rates." Journal of Applied Econometrics , Supplement 7:S151-S164.
  • Osborn, D. R. (1990). "The Implications of Periodically Varying Coefficients for Seasonal Time-Series Processes." Journal of Econometrics , 48:373-384.
  • Ozaki, Tohru (1981). "Non-linear Threshold Autoregressive Models for Non-linear Random Vibrations." Journal of Applied Prob. , 18:443-451.
  • Ozaki, Tohru (1985). "Non-Linear Time Series Models and Dynamical Systems." In E. J. Hannan, P. R. Krishnaiah, and M. M. Rao, eds., Handbook of Statistics , vol. 5. New York: Elsevier Science, pp. 25-83.
  • Pesaran, M. Hashem, and Simon M. Potter (1993). "A Floor and Ceiling Model of U.S. Output." Los Angeles, California: University of California, Los Angeles, Dept. of Economics, Working Paper 9407.
  • Poole, William (1988). "Monetary Lessons of Recent Inflation and Disinflation." Journal of Economic Perspectives , 2(3):73-100.
  • Prescott, David M., and Thanasis Stengos (1991). "Testing for Forecastable Nonlinear Dependence in Weekly Gold Rates of Return." European University Institute Working Paper Series ECO 91/31, Badia Fiesolana, Italy.
  • Priestley, M. B. (1981). Spectral Analysis and Time Series . New York: Academic Press.
  • Ramsey, James B. (forthcoming). "On the Existence of Macro Variables and of Macro Relationships." Journal of Economic Behavior and Organization .
  • Ramsey, James B. (1992). "Seasonal Economic Data as Approximate Harmonic Oscillators." New York: C. V. Starr Center for Applied Economics, New York University, Working Paper 92-16.
  • Ramsey, James B., and Philip Rothman (forthcoming). "Time Irreversibility and Business Cycle Asymmetry." Journal of Money, Credit, and Banking .
  • Ramsey, James B., and Zhifeng Zhang (1994). "The Application of Wave Form Dictionaries to Stock Market Data." New York: C. V. Starr Center for Applied Economics, New York University, Working Paper series 90-05.
  • Ramsey, James B., Chera L. Sayers, and Philip Rothman (1990). "The Statistical Properties of Dimension Calculations Using Small Data Sets: Some Economic Applications." International Economic Review , 31(4):991-1020.
  • Ramsey, James B., and Zhifeng Zhang (1995). "The Analysis of Foreign Exchange Data Using Waveform Dictionaries." New York: C. V. Starr Center for Applied Economics RR#95-03, New York University.
  • Ramsey, James B., and Hsiao J. Yuan (1989). "Bias and Error Bars in Dimension Calculations and Their Evaluation in Some Simple Models." Physics Letters-A , 134:287-297.
  • Riggs, Douglas S. (1963). The Mathematical Approach to Physiological Problems . Baltimore, Maryland: Williams and Wilkins.
  • Rothman, Philip (1994). "Forecasting Asymmetric Unemployment Data." Working Paper, Greenville, North Carolina: East Carolina University, Dept. of Economics, Working Paper 93-39.
  • Stadler, George W. (1994). "Real Business Cycles." Journal of Economic Literature , XXXII(4):1750-1783.
  • Stock, James H. (1987). "Measuring Business Cycle Time." Journal of Political Economy , 95:1240-1261.
  • Stock, James K., and Mark W. Watson (1988). "Variable Trends in Economic Time Series." Journal of Economic Perspectives , 2(3):147-174.
  • Sugihara, G., B. T. Grenfell, and R. M. May (1990). "Distinguishing Error from Chaos in Ecological Time Series." Philosophical Transactions of the Royal Society, London, Series B , 330:235-251.
  • Swamy, P. A. V. B. (1970). "Efficient Inference in a Random Coefficient Regression Model." Econometrica , 38(2):311-323.
  • Swanson, Norman R., and Halbert White (in press). "A Model Selection Approach to Real-Time Macroeconomic Forecasting Using Linear Models and Artificial Neural Networks." The Review of Economics and Statistics .
  • Van Kampen, N. G. (1981). Stochastic Processes in Physics and Chemistry . Amsterdam: North-Holland.
  • Yao, Q., and H. Tong (1994). "Quantifying the Influence of Initial Values on Non-linear Prediction." Journal of the Royal Statistical Society, Series B , 56(4):701-726.