Download Full Text

Transcript
The parameters  j , j  0,1,k are called the regression coefficients. Suppose
that nt  k observations are available, and let yi denote the ith observed response
and xij denote the ith observation of the regressor x j . The least squares method can be
used to estimate the regression coefficients of equation (2.10). Two key assumptions
are made that the error term  in (2.10) is normally distributed with mean zero and
variance  2 , and the errors are uncorrelated. Expressing the equation (2.10) in matrix
form gives:
y  Xβ  ε
(2.11)
where y is an nt  1vector of the observations, X is an nt  p matrix of
regressors, β is a p 1 vector of the unknown regression coefficients and ε is an
n 1 vector of random errors . Thus, the least squares estimator β̂ can be found by
minimizing the cost function
n
S (β)    i2  ε T ε  (y  Xβ) T (y  Xβ)  y  Xβ
i 1
2
(2.12)
2
Expanding equation (2.12) results in
S (β)  y T y - β T X T y - y T Xβ  β T X T Xβ
(2.13)
The terms β T XT y and y T Xβ are scalars. Thus equation (2.13) can be rewritten
as
S (β)  y T y - 2β T X T y  β T X T Xβ
Therefore the least-squares estimator must satisfy
12
(2.14)