Download Practical Exercises

Transcript
Practical Exercises
8
Practical Class 3: Fitting Bayesian regression models in
WinBUGS
A. Linear Regression: Small Area Estimation of Average Income
This question deals with the example of small area estimation of mean household income in
Swedish municipalities, discussed in Lecture 4 (slides 6 to 16). The data, two sets of initial
values and the basic model code are provided in files income-dat.odc, income-in1.odc,
income-in2.odc and income-model.odc. Note that the data for this example are in the
‘rectangular array’ data format, rather than the ‘list’ format. The 284 rows correspond to
areas, and the columns give each of the three variables (INCOME, AVAGE and RURAL). To
load these data into WinBUGS, highlight the first row containing the column names and click
on Load data at the appropriate stage (just clicking on Load data without highlighting the
first row should also work, provided the data file is the focused window).
1. Open these files and carry out a WinBUGS run for this model. Unlike the WinBUGS
analyses you have run so far (which involved either forward sampling or direct sampling
from the closed-form posterior), for this analysis (and all subsequent practical exercises)
you will need to carry out checks for convergence of the MCMC samples and discard
any burn-in samples before making posterior inference. To do this, you should run 2
(or more) separate chains and use the Gelman-Rubin convergence diagnostic (lecture 3,
slides 18 to 23) as follows:
(a) Check and compile the model as before (see the instructions in section Running
a model in WinBUGS of the hints handout), but remember to set the number of
chains to be 2 (the default is 1) before you click compile (step 9 on the handout),
and to load both sets of initial values (step 12 on the handout).
(b) Set samples monitors on appropriate parameters — e.g. the regression coefficients
and residual error variance. (see section Monitoring parameter values of the
hints handout).
(c) Run 10,000 iterations (updates), then look at history plots and autocorrelation plots
of the sample traces and calculate the Gelman and Rubin convergence diagnostic
(GR diag) for the parameters you have monitored.
• After how many iterations do the simulations look like they have converged?
(See section Checking convergence of the hints handout and lecture 3 slides 18
to 28).
(d) Once you are happy with convergence,
• Discard the burn-in iterations (by setting the beg option in the Inference->samples
dialog box).
• Then produce posterior summary statistics for the variables you have monitored.
• Check the Monte Carlo standard error of each variable to assess the accuracy
of your estimates (See section Obtaining summary statistics of the poste-