Econometric Theory/SLR

$\begin{array}{cc}& Y_i={\beta }_1+{\beta }_2{X}_i+U_i\\ & E(U|X)=0\\ & Var(U|X)=Var(Y|X)={\sigma }^2\\ & Y_i={\beta }_1+{\beta }_2{X}_i+U_i\\ & \widehat{Y_i}=\widehat{{\beta }_1}+\widehat{{\beta }_2}{X}_i\\ & \widehat{U_i}=Y_i-\widehat{Y_i}\\ \end{array}$

Use of ${\beta }_1$ or ${\beta }_0$ to denote the Y-intercept is solely discretionary.

$\begin{array}{cc}& \widehat{{\beta }_2}=\frac{\sum (Y_i-\overline{Y})(X_i-\overline{X})}{\sum (X_i-\overline{X}{)}^2}\\ & \widehat{{\beta }_1}=\overline{Y}-\widehat{{\beta }_2}\overline{X}\\ & Var(\widehat{{\beta }_2})=\frac{{\sigma }^2}{\sum (X_i-\overline{X}{)}^2}\\ & Var(\widehat{{\beta }_1})=\frac{\sum X_i^2*{\sigma }^2}{n*\sum (X_i-\overline{X}{)}^2}\\ & \widehat{{\sigma }^2}=\frac{\sum \widehat{U_i^2}}{n-2}\\ \end{array}$

U and $ϵ$ have both been used to denote the error term.

$\begin{array}{cc}& S_2^2=\widehat{Var(\hat{{\beta }_2})}=\frac{\widehat{{\sigma }^2}}{\sum (X_i-\overline{X}{)}^2}\\ & S_1^2=\widehat{Var(\hat{{\beta }_1})}=\frac{\sum X_i^2*\widehat{{\sigma }^2}}{n*\sum (X_i-\overline{X}{)}^2}\\ & S.E.(\widehat{{\beta }_2})=\sqrt{\widehat{Var(\hat{{\beta }_2})}}\\ & S.E.(\widehat{{\beta }_1})=\sqrt{\widehat{Var(\hat{{\beta }_1})}}\\ \end{array}$

$S^2$ is used to denote a sample variance, S.E. standard error.

$\begin{array}{cc}& TSS=\sum (Y_i-\overline{Y}{)}^2\\ & ESS=\sum (\widehat{Y_i}-\overline{Y}{)}^2\\ & RSS=\sum \widehat{U_i^2}\\ \end{array}$

TSS may also be presented as SST for the Total Sum of Squares, ESS as SSE (error) and RSS as SSR (residuals). Depending on the text, ESS and RSS may become very confusing, as there is great variety in the terminology used.

$R^2=\frac{ESS}{TSS}=1-\frac{RSS}{TSS}$

$\widehat{\log (Y)}=\widehat{{\beta }_1}+\widehat{{\beta }_2}\log (X)$