Title page for ETD etd-08042011-111747

Document Type Master's Dissertation
Author Thiebaut, Nicolene Magrietha
Email nicolene.thiebaut@gmail.com
URN etd-08042011-111747
Document Title Statistical properties of forward selection regression estimators
Degree MSc
Department Statistics
Advisor Name Title
Prof F E Steffens Supervisor
  • regression
  • multiple regression
  • full mode
  • bhat
  • mean-squared error
  • sample size
  • forward selection
  • number of variables
Date 2011-09-09
Availability unrestricted
In practice, when one has many candidate variables as explanatory variables in multiple regression, there is always the possibility that variables that are important determinants of the response variable might be omitted from the model, while unimportant variables might be included. Both types of errors are important, and in this dissertation it is attempted to quantify the probabilities of these errors.

A simulation study is reported in this dissertation. Different numbers of variables, i.e. p= 4 to 20 are assumed, and different sample sizes, i.e. n=0.5p, p, 2p, 4p. For each p the underlying model assumes that roughly half of the independent variables are actually correlated with the dependant variable and the other half not. The noise is ε~ N(0, σ2, where σ2, is set fixed. The data was simulated 10000 times for each combination of n and p using known underlying models and ε randomly selected from of a normal distribution.

For this investigation the full model and forward selection regression are compared. The mean squared error of the estimated coefficient β(p) is determined from the true β of each n and p set. A full discussion, as well as graphs, is presented.

2011 University of Pretoria. All rights reserved. The copyright in this work vests in the University of Pretoria. No part of this work may be reproduced or transmitted in any form or by any means, without the prior written permission of the University of Pretoria.

Please cite as follows:

Thiebaut, NM 2011 Statistical properties of forward selection regression estimators , MSc dissertation, University of Pretoria, Pretoria, viewed yymmdd < http://upetd.up.ac.za/thesis/available/etd-08042011-111747/ >


  Filename       Size       Approximate Download Time (Hours:Minutes:Seconds) 
 28.8 Modem   56K Modem   ISDN (64 Kb)   ISDN (128 Kb)   Higher-speed Access 
  dissertation.pdf 4.66 Mb 00:21:33 00:11:05 00:09:42 00:04:51 00:00:24

Browse All Available ETDs by ( Author | Department )

If you have more questions or technical problems, please Contact UPeTD.