Download Microdata User Guide
Transcript
Longitudinal Survey of Immigrants to Canada, Wave 3 – User Guide 13.0 Data Quality and Coverage This chapter provides the user with information about the various factors affecting the quality of the survey data. There are two main types of errors: sampling errors and non-sampling errors. A sampling error is the difference between an estimate derived from a sample and the one that would have been obtained from a census that used the same procedures to collect data from every person in the population. All other types of errors such as frame coverage, response, processing and non-response are non-sampling errors. Many of these errors are difficult to identify and quantify. These are discussed in Section 13.2. 13.1 Sampling Errors The estimates derived from this survey are based on a sample of immigrants and not from a complete enumeration (census) under similar conditions. This difference is the sampling error of the estimates. Statistics Canada’s Standards and Guidelines on the Documentation of Data Quality and Methodology 1 states that external users must be given an indication of the magnitude of the sampling error. It is highly recommended that users analyzing data or producing estimates from the Longitudinal Survey of Immigrants to Canada (LSIC) data files also provide their audience with indicators of the data quality. The basis for measuring sampling error is the standard error of the estimates, estimated from the survey results. However, because of the large variety of estimates that can be produced from a survey, the standard error of an estimate is usually expressed relative to the estimate to which it pertains. This measure, known as the coefficient of variation (CV) of an estimate, is obtained by expressing the standard error of the estimate as a percentage of the estimate. The smaller the CV, the smaller the sampling variability, meaning smaller CVs are more desirable. The CV depends on the size of the sample on which the estimate is based, the population size and on the distribution of the sample, i.e. the sampling fraction of the units of the domains being estimated. The following diagram presents the characteristics of some coefficients of variation and the Statistics Canada guidelines for release. Characteristics 0.0% - 1.0% Excellent 1.0% - 5.0% Very Good 5.0% - 10.0% Good 10.0% - 16.5% Moderate 16.6% - 33.3% 33.4% + 1 Guidelines for Release Reliable enough for most purposes Use with caution! Data not acceptable Statistics Canada. Standards and Guidelines on the Documentation of Data Quality and Methodology, 2002, www.statcan.ca/english/about/policy/infousers.htm. Special Surveys Division 67