Describe the difficulties that arise when modelling time series that contain unit roots.
The idea
Unit roots make ordinary regression analysis unreliable. If two independent series each contain a unit root, regressing one on the other typically gives a high R², a large t-statistic and a very low Durbin-Watson statistic, even though there is no relationship. This is a spurious regression. The problem gets worse, not better, as the sample grows, because the t-statistic does not follow its usual distribution. The estimated autoregressive coefficient is also biased downward in finite samples and has a non-standard distribution, so ordinary critical values over-reject. Shocks have permanent effects and there is no mean reversion. The forecast error variance grows without bound as the horizon lengthens. Typical remedies are to difference the series or, if the series share a common stochastic trend, to model their cointegration. The usual mistake is to trust a high R² and a significant t-statistic in levels.
A practice question
Which combination is the classic warning sign of a spurious regression between two series in levels?
- A low R² together with a Durbin-Watson statistic near 2Why not: This is a poor but otherwise unremarkable fit with uncorrelated residuals.
- A high R² together with a Durbin-Watson statistic near 2Why not: This indicates a good fit with uncorrelated residuals, which is not the warning sign.
- A high R² together with a very low Durbin-Watson statistic - correct
- A low R² together with a very low Durbin-Watson statisticWhy not: The spurious pattern is characterised by a high R², not a low one.
Highly persistent residuals push the Durbin-Watson statistic far below 2 while the trending data give a high R². A rule of thumb is that R² above DW signals trouble.
A harder one
Two independent series that each follow a random walk are regressed on each other in levels using 200 observations. The result is R² 0.64, a slope t-statistic of 18 and a Durbin-Watson statistic of 0.09. What is the best interpretation and response?
- The relationship is genuine, because the t-statistic far exceeds 1.96 and the sample is largeWhy not: Trusts the t-statistic although it is not valid when both series have unit roots.
- The relationship is spurious and collecting more data will remove the problemWhy not: The problem is not a small-sample issue; with more data the spurious t-statistic gets larger.
- The relationship is spurious and taking logs of both series and re-estimating in levels will fix itWhy not: Taking logs does not remove a unit root; the stochastic trend remains.
- The relationship is probably spurious; re-estimate in first differences or test for cointegration - correct
The very low Durbin-Watson statistic and high R² are the signature of regressing unit-root series on each other. Differencing removes the stochastic trends; if the series cointegrate, an error-correction model is appropriate.
The hardest tier
A shock of size 3 hits a series at time t. Compared with the effect on the forecast 10 periods later, which pair is correct for a random walk and for a stationary AR(1) with coefficient 0.8?
- Random walk: 0.00; AR(1): 0.32Why not: Assumes that shocks to a random walk die out, which is the stationary behaviour; they are permanent.
- Random walk: 3.00; AR(1): 0.32 - correct
- Random walk: 3.00; AR(1): 2.40Why not: Applies the persistence coefficient once rather than raising it to the power of the horizon.
- Random walk: 3.00; AR(1): 0.11Why not: Forgets to multiply the decay factor by the size of the shock.
For the random walk the effect stays at 3. For the AR(1) it decays as phi^h: 3 x 0.8^10 = 0.32. Persistent shocks are one reason unit roots complicate forecasting.
In the app: 6 practice questions on this outcome, spaced review that brings it back before you forget it.
Start free →More in Non-Stationary Time Series
- Describe time trends that are linear and those that are nonlinear.
- Show how modelling seasonality can be done through regression analysis.
- Outline what a random walk is and what a unit root is.
- Explain how a time series is checked for the presence of a unit root.
- Explain the construction of a point forecast h steps ahead when the series is seasonal.
- Compute the estimated trend value of a time series, and from it construct an interval forecast.