Notes

Augmented Dickey-Fuller (ADF) Test

A time series can look “patterned” simply because it drifts upward over time, not because there’s a stable relationship you can learn from. The Augmented Dickey-Fuller (ADF) test is a common way to check whether a series is genuinely stable in its behavior or is wandering due to a unit root.

What the ADF test is checking

The ADF test is a hypothesis test for stationarity, focused on whether the series has a unit root. Roughly:

  • Null hypothesis (H0): the series has a unit root (it is non-stationary; shocks can have permanent effects).
  • Alternative (H1): the series is stationary (it reverts to a stable mean/trend depending on the version).

“Augmented” means it includes extra lagged differences to soak up autocorrelation in the errors, making the test more reliable than the simpler Dickey-Fuller test.

How to read the output

You’ll typically see an ADF test statistic and a p-value (or critical values). If the p-value is small (commonly < 0.05), you reject H0 and treat the series as stationary. If not, you usually assume non-stationarity and consider transformations like differencing or detrending.

Practical examples

  • House prices: raw prices often fail ADF (trend upward). Price changes (differences) may pass.
  • Sales: weekly sales might be non-stationary due to growth; differencing can stabilize it for modeling.
  • Medical measurements: a patient’s baseline-adjusted readings may be stationary even if raw levels drift.

Why it matters in AI/ML

Many time-series models (e.g., ARIMA) assume stationarity after differencing; failing this can lead to unstable forecasts and misleading “learned” patterns. In ML pipelines, ADF helps decide features (levels vs. differences) and reduces spurious correlations.

Augmented Dickey-Fuller (ADF) Test is a hypothesis test for whether a time series has a unit root, implying non-stationarity. It extends the Dickey-Fuller test by adding lagged differences to control for autocorrelation, improving validity in realistic series. It matters in AI/ML because many forecasting and regression methods assume stationarity; failing this can yield spurious relationships. Example: applying ADF to log-prices to decide whether differencing is needed before ARIMA.

Imagine trying to predict tomorrow’s weather from a thermometer that’s slowly drifting upward because it’s sitting near a heater. The readings change over time, but not in a stable way, so simple patterns can be misleading.

The Augmented Dickey-Fuller (ADF) Test is a common check for this idea in time-based data. It asks: does this time series have a “drift” or wandering behavior (often called a unit root), or does it tend to hover around a steady level and behave more consistently (called stationary)?

In AI and forecasting, this helps decide whether you should transform the data (like taking differences) before modeling.