Download Full Text
Transcript
The parameters j , j 0,1,k are called the regression coefficients. Suppose that nt k observations are available, and let yi denote the ith observed response and xij denote the ith observation of the regressor x j . The least squares method can be used to estimate the regression coefficients of equation (2.10). Two key assumptions are made that the error term in (2.10) is normally distributed with mean zero and variance 2 , and the errors are uncorrelated. Expressing the equation (2.10) in matrix form gives: y Xβ ε (2.11) where y is an nt 1vector of the observations, X is an nt p matrix of regressors, β is a p 1 vector of the unknown regression coefficients and ε is an n 1 vector of random errors . Thus, the least squares estimator β̂ can be found by minimizing the cost function n S (β) i2 ε T ε (y Xβ) T (y Xβ) y Xβ i 1 2 (2.12) 2 Expanding equation (2.12) results in S (β) y T y - β T X T y - y T Xβ β T X T Xβ (2.13) The terms β T XT y and y T Xβ are scalars. Thus equation (2.13) can be rewritten as S (β) y T y - 2β T X T y β T X T Xβ Therefore the least-squares estimator must satisfy 12 (2.14)