Autocorrelation measures the linear dependence between an observation and its
own past. We build the autocorrelation and partial autocorrelation functions
for a weakly stationary series from the moving-average weights of its linear
representation, derive Bartlett's asymptotic law for their sample estimators
and the Ljung-Box portmanteau test it justifies, and identify the order of an
ARMA process through the dual truncation of the two functions. We close by
showing that market microstructure imprints autocorrelation on returns for
purely mechanical reasons, with the bid-ask bounce forcing the first-lag
autocorrelation to minus one half and stale prices forcing it to plus one half.
Let {rt} be weakly stationary, so the mean μ=E[rt] and every autocovariance depend on lag alone [1]. Two functions summarise its linear dynamics. The autocorrelation function records dependence at each lag, and the partial autocorrelation function strips out the intervening lags. Their sample versions identify autoregressive moving-average order and drive the diagnostic tests that follow.
By construction γ0=Var(rt), ρ0=1, ∣ρℓ∣≤1, and γ−ℓ=γℓ, hence ρ−ℓ=ρℓ. A white noise series, independent and identically distributed with finite variance, has ρℓ=0 for every ℓ=0. Detecting departures from this benchmark is the object of the analysis, and the natural vehicle is the linear representation that every purely nondeterministic stationary series admits.
Lemma2
Let rt=μ+∑i≥0ψiat−i with ψ0=1, ∑iψi2<∞, and {at} white noise of variance σa2. Then
Because E[at−iat−ℓ−j]=σa2 when i=ℓ+j and zero otherwise, only the diagonal i=ℓ+j survives, giving γℓ=σa2∑j≥0ψj+ℓψj. Dividing by γ0=σa2∑iψi2 yields ρℓ.
The ψ-weights fully determine the autocorrelations, and, as we see next, the asymptotic variance of their estimators.
Definition3
Given r1,…,rT with sample mean rˉ, the lag-ℓ sample autocorrelation is
The vector T(ρ^1−ρ1,…,ρ^m−ρm) is asymptotically normal for any linear process with summable weights and finite fourth moment, and its covariance is fixed by Bartlett's formula [2].
Theorem4
For the linear process of Lemma 2, T(ρ^ℓ−ρℓ) is asymptotically normal with variance wℓℓ, where
wℓℓ=k=1∑∞(ρk+ℓ+ρk−ℓ−2ρℓρk)2,(5)
and Cov(Tρ^i,Tρ^j)→wij with the same summand in the two indices.
The formula is the delta method applied to ρ^ℓ=γ^ℓ/γ^0. The sample autocovariances γ^ℓ are jointly asymptotically normal, and for a linear process their limiting fourth-order terms reduce to products of the γ's; propagating that covariance through the ratio produces Equation (5)[2]. Two special cases carry the rest of the article.
Corollary5
If {rt} is MA(q), so ρj=0 for all j>q, then for every ℓ>q
Var(ρ^ℓ)≈T1(1+2i=1∑qρi2).(6)
Proof
Fix ℓ>q. In each summand of Equation (5), ρk+ℓ=0 since k+ℓ>q, and ρℓ=0 since ℓ>q, leaving wℓℓ=∑k≥1ρk−ℓ2. Reindex by m=k−ℓ. As k runs over 1,2,…, m runs over 1−ℓ,2−ℓ,…, and ρm2 is nonzero only for ∣m∣≤q. Because ℓ>q forces 1−ℓ≤−q, the whole window m=−q,…,q is reached, at k=ℓ−q,…,ℓ+q, each a positive integer. Hence wℓℓ=∑m=−qqρm2=ρ02+2∑m=1qρm2=1+2∑m=1qρm2, and Var(ρ^ℓ)≈wℓℓ/T.
Corollary6
If {rt} is white noise, then for ℓ≥1 the Tρ^ℓ are asymptotically independent standard normals.
Proof
Set ρk=0 for all k=0 in Equation (5). The summand at index pair (i,j) is (ρk+i+ρk−i)(ρk+j+ρk−j), and with i,j≥1 the factor ρk+i+ρk−i is nonzero only at k=i, where it equals ρ0=1. Thus wij=1 if i=j and 0 otherwise, so the limiting covariance is the identity.
The individual test of the null ρℓ=0 against dependence up to lag q refers the studentised statistic ρ^ℓ/(1+2∑i=1ℓ−1ρ^i2)/T to the standard normal, using Equation (6) for the denominator.
The ACF alone cannot separate direct dependence at lag ℓ from dependence relayed through the intervening lags. The partial autocorrelation removes the relay.
Definition7
The lag-ℓ partial autocorrelation ϕℓℓ is the coefficient of rt−ℓ in the linear projection of rt on its ℓ nearest lags,
rt=ϕℓ0+ϕℓ1rt−1+⋯+ϕℓℓrt−ℓ+eℓt.(7)
The projection coefficients solve the order-ℓ Yule-Walker system ∑j=1ℓϕℓjρ∣i−j∣=ρi, i=1,…,ℓ, whose last component is ϕℓℓ. The Durbin-Levinson recursion solves the nested systems in O(ℓ) work per order,
started at ϕ11=ρ1, which gives ϕ22=(ρ2−ρ12)/(1−ρ12) and so on. The two functions are dual order-identification tools. For MA(q) the ACF cuts off, ρℓ=0 for ℓ>q, by Lemma 2 with finitely many ψi. For AR(p) the PACF cuts off, ϕℓℓ=0 for ℓ>p, since the order-p projection is already exact, with sample estimate ϕ^ℓℓ∼N(0,1/T) beyond p. A sharp truncation in one function names the order in the other.
By Corollary 6 the Tρ^ℓ are asymptotically independent standard normals, so Tρ^ℓ2⇒χ12 and T∑ℓ=1mρ^ℓ2⇒χm2, the Box-Pierce statistic. The weight (T+2)/(T−ℓ) replaces the crude scaling T by a factor matching the finite-sample moment E[ρ^ℓ2]≈(T−ℓ)/[T(T+2)], which sharpens the small-sample fit while leaving the limit at χm2[3].
When the ρ^ℓ are the residual autocorrelations of a fitted ARMA(p,q) model, the p+q estimated parameters consume that many degrees of freedom and the reference law becomes χm−p−q2.
Short-lag autocorrelation in returns need not reflect predictable dynamics. Two microstructure mechanisms manufacture it with opposite sign, and both admit an exact MA(1) computation.
Proposition9
Let the efficient price Pt∗ follow a random walk with innovation variance σ2, and let the observed transaction price be Pt=Pt∗+2SQt, where S is the bid-ask spread and Qt∈{−1,+1} is an independent trade-direction indicator with Pr(Qt=±1)=21, independent of {Pt∗}. Then observed price changes are MA(1) with
Since Pr(Qt=±1)=21, we have E[Qt]=0 and E[Qt2]=1. Write ΔPt=ut+2S(Qt−Qt−1) with ut=ΔPt∗, Var(ut)=σ2. Independence of u and Q and Var(Qt−Qt−1)=E[Qt2]+E[Qt−12]=2 give Var(ΔPt)=σ2+4S2⋅2. For the lag-one autocovariance only the shared term Qt−1 contributes,
and γℓ=0 for ℓ≥2 because no innovation is shared. Dividing gives ρ1, which increases in σ2, approaching 0 as σ2→∞ and −21 as σ2→0.
The sign is unambiguously negative and the magnitude identifies the spread, S=2−γ1, so a first-lag autocorrelation can measure trading cost rather than signal. Nonsynchronous trading, where a recorded price is a stale last-trade value, smooths the latent return across periods and reverses the sign.
Proposition10
Let latent returns rt be iid with variance σ2, and let staleness spread each latent return equally over two periods, so the recorded return is ot=21(rt+rt−1). Then ot is MA(1) with
γ0=2σ2,γ1=4σ2,ρ1=+21,(12)
and γℓ=0 for ℓ≥2.
Proof
γ0=Var(21(rt+rt−1))=41(σ2+σ2)=σ2/2. The lag-one term shares only rt−1, so γ1=Cov(21(rt+rt−1),21(rt−1+rt−2))=41Var(rt−1)=σ2/4. No term is shared at lag two or beyond, so γℓ=0 there, and ρ1=(σ2/4)/(σ2/2)=21.
The equal-weight case is the boundary. The general nontrading model of [4], where each security trades with a fixed per-period probability, interpolates ρ1∈(0,21) and induces positive cross-autocorrelation across a portfolio for the same reason.
The ACF and PACF are complementary fingerprints of linear structure, the first truncating at the moving-average order by Lemma 2 and the second at the autoregressive order, and the Ljung-Box statistic turns their sample values into a formal white-noise test through Corollary 6. Because the bid-ask bounce forces ρ1=−21 in the limit and stale prices force ρ1=+21, short-lag autocorrelation in observed returns must be read against these mechanical sources before it is credited to genuine predictability. The Ornstein-Uhlenbeck process supplies the continuous-time AR(1) benchmark, and the same second-moment machinery underpins the cross-correlation structure exploited in statistical arbitrage.
[1]
R. S. Tsay, Analysis of Financial Time Series, 3rd ed. Wiley, 2010.
[2]
P. J. Brockwell and R. A. Davis, Time Series: Theory and Methods, 2nd ed. Springer, 1991.
[3]
G. M. Ljung and G. E. P. Box, “On a measure of lack of fit in time series models,” Biometrika, vol. 65, no. 2, pp. 297–303, 1978.
[4]
A. W. Lo and A. C. MacKinlay, “An econometric analysis of nonsynchronous trading,” Journal of Econometrics, vol. 45, no. 1–2, pp. 181–211, 1990.