[GRAPHIC] \SW4CVR.GIF
     Statistical Policy Working Papers are a series of technical
     documents prepared under the auspices of the Office of Federal
     Statistical Policy and Standards.  These documents are the
     product of working groups or task forces, as noted In the Preface
     to each report.
     These Statistical Policy Working Papers are published for the
     purpose of encouragIng further discussion of the technical Issues
     and to stimulate policy actions which flow from the technical
     findings.  Readers of Statistical Policy Working Papers are
     encouraged to communicate directly with the Office of Federal
     Statistical Policy and Standards with additional views, sugges-
     tions, or technical concerns.
     Office of                          Joseph W. Duncan
     Federal Statistical                Director
     Policy and Standards
Statistical Policy Working Paper 4
Glossary of Nonsampling Error Terms:
An Illustration of a Semantic Problem in Statistics
Prepared by
Richard E. Deighton and James R. Poland, Co-Chairmen, U.S. Postal Service
Joel R. Stubbs, Internal Revenue Service, and
Robert D. Tortora, U.S. Department of Agriculture
Subcommittee on Nonsampling Errors
Federal Committee on Statistical Methodology
U.S. DEPARTMENT OF COMMERCE
Juanita M. Kreps, Secretary
Courtenay M. Slater, Chief Economist
Office of Federal Statistical Policy and Standards
Joseph W. Duncan, Director
Issued:   December 1978
                       Office of Federal Statistical
                           Policy and Standards
Joseph W. Duncan, Director
            George E. Hall, Deputy Director, Social Statistics
          Gaylord E. Worden, Deputy Director, Economic Statistics
  Maria E. Gonzalez, Chair, Federal Committee on Statistical Methodology
                                  Preface
     This working paper was prepared by a, Glossary Task Force comprised of
Richard E. Deighton and James R. Poland of the U.S. Postal Service, Joel R.
Stubbs, Internal Revenue Service, and Robert D. Tortora, U.S. Department of
Agriculture, all of whom are members of the Subcommittee on Nonsampling
Errors, Federal Committee on Statistical Methodology.  The Subcommittee was
chaired by Monroe G. Sirken, National Center for Health Statistics,
Department of Health, Education, and Welfare.  Members of the full
Subcommittee are listed on the following page.
     The Subcommittee decided to prepare this glossary not as an exhaustive
list of definitions of terms related to nonsampling errors, but rather to
demonstrate the semantic problem, that certain terms may be used with
different meanings, creating problems of communication among statisticians.
     It is hoped that this glossary will enhance our awareness of the use
of the same term for different concepts.  The definitions included are
taken mostly from published literature.  The Federal Committee on
Statistical Methodology view this as the first step in developing a more
systematic approach to defining nonsampling error terms.
                                    ii
                     Subcommittee on Nonsampling Error
Monroe Sirken (Chair)              National Center for Health Statistics
Barbara Bailar                     Bureau of the Census
Camilla Brooks                     Bureau of the Census
John Cremeans                      Bureau of Economic Analysis
Tore Dalenius (Consultant)         Brown University and Stockholm
                                   University
Richard Deighton                   U.S. Postal Service
James Duffet                       U.S. Postal Service
Maria Gonzalez (ex officio)        Office of Federal Statistical Policy and
                                   Standards
Tom Herzog                         Social Security Administration
Alexander Korns                    Bureau of Economic Analysis
Lillian Madow                      Bureau of Labor Statistics
D. H. McElbone                     Civil Service Commission
Ron Poland                         U.S. Postal Service
Morton Raff                        Bureau of Labor Statistics
Jack Scharff                       Health Care Finance Administration
Frederick Scheuren                 Social Security Administration
Otto Schwartz                      Internal Revenue Service
Gary Shapiro                       Bureau of the Census
Joel Stubbs                        Internal Revenue Service
Robert Tortora                     U.S. Department of Agriculture
Rolf Wulfsberg                     National Center for Education Statistics
                              Members of the
                           Federal Committee on
                          Statistical Methodology
(September 1977)
Maria Elena Gonzalez (Chair)       Office of Federal Statistical Policy and
                                   Standards (Commerce)
Barbara A. Bailar                  Bureau of the Census (Commerce)
Norman D. Beller                   Economics, Statistics and Cooperatives
                                   Service (Agriculture)
Barbara A. Boyes                   Bureau of Labor Statistics (Labor)
Edwin J. Coleman                   Bureau of Economic Analysis (Commerce)
John E. Cremeans                   Bureau of Economic Analysis (Commerce)
Marie D. Eldridge                  National Center for Education Statistics
                                   (HEW)
Fred Frishman                      Internal Revenue Service (Treasury)
Thomas B. Jabine                   Social Security Administration (HEW)
Charles D. Jones                   Bureau of the Census (Commerce)
Alfred D. McKeon                   Bureau of Labor Statistics (Labor)
Harold Nisselson                   Bureau of the Census (Commerce)
Monroe G. Sirken                   National Center for Health Statistics
                                   (HEW)
Wray Smith                         Office of the Assistant Secretary for
                                   Planning and Evaluation (HEW)
                                    iii
                             Authors' Preface
     The glossary has been prepared for the Federal Committee on
Statistical Methodology by the Subcommittee on Nonsampling Errors.  During
subcommittee meetings it became obvious that the terminology on nonsampling
errors left something to be desired.  Consequently, the subcommittee
decided to develop this glossary.  A search of current literature for
acceptable definitions highlighted the prevailing problem instead of
providing a solution to it.
     Prior to examining the contents of. this glossary, it is important to
understand what the purpose of the glossary is and what it is not.  The
purpose of the glossary is to highlight a semantic problem represented by
the fact that:
     The same term is sometimes used with different meanings; and
     The same phenomenon is sometimes called by more than one term.
     The glossary contributes towards the task of developing a standardized
terminology.  However, it is beyond the scope of the present Subcommittee
on Nonsampling Errors to pursue a task of this magnitude.
     This glossary is not intended to be used as a dictionary for
nonsampling error terms.  The authors did not conduct an exhaustive search
of the literature, nor did they attempt to select or specify a preferred
definition for any term.  The reference to a subcommittee document (01 in
the bibliography) is included solely for the convenience of the reader and
does not exist as a separate document.
     Terms in the glossary are listed alphabetically.  The bibliography at
the end contains the references which are used to obtain definitions for
the terms.  Codes for the references are alpha-numeric (i.e., A1, A2, A3,
etc. designate the first, second, and third references associated with the
first letter of the author's name).  For each term defined in the glossary,
one or more references are given.  For example, on Page 1, the term
"ACCURACY" is found in three references, viz., B2, K1, S1.
     If a definition is taken from a textbook, the page number of the
referenced text is include d at the end of the definition. (See BIAS,
CONSTANT-Reference H2, Page 17.) Quotation marks are used to identify when
a definition was copied verbatim from a reference.  The absence of
quotation marks implies that the definition was paraphrased or that the
definition was taken out of context.  When a definition was taken out of
context, an editors' note was often added to make the reader aware that the
definition can be applied to a more general subject.  The editors' note is
enclosed in brackets [] (e.g., see BOUNDED RECALL).  A "Comment" indicating
similar terms which appear in the glossary has been added at the end of
each relevant term.
     Members of the Glossary Task Force wish to express their sincere
appreciation to Professor Tore Dalenius for the criticism, suggestion, and
reference material which he provided during the preparation of this
glossary.  Also, the members of the task force wish to thank all other
members of the Subcommittee on Nonsampling Errors for their comments and
suggestions on the numerous drafts of the glossary.
                                    iv
                             Table of Contents
Preface . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .ii
Authors' Preface. . . . . . . . . . . . . . . . . . . . . . . . . . . . .iv
List of terms included in the Glossary of Nonsampling Error Terms . . . . 1
     Accuracy . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
     Allocation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
     Audit. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
     Bias . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
     Bias, Constant . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
     Bounded Recall . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
     Bounding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1
     Classification Errors. . . . . . . . . . . . . . . . . . . . . . . . 1
     Classification Error Rate. . . . . . . . . . . . . . . . . . . . . . 2
     Coding . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
     Coding Error . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
     Compiling Error. . . . . . . . . . . . . . . . . . . . . . . . . . . 2
     Complete Coverage. . . . . . . . . . . . . . . . . . . . . . . . . . 2
     Completeness Rate. . . . . . . . . . . . . . . . . . . . . . . . . . 2
     Conditioning Effect. . . . . . . . . . . . . . . . . . . . . . . . . 2
     Content Error. . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
     Correct Value. . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
     Coverage Error . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
     Defined Goal . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2
     Definitional Errors. . . . . . . . . . . . . . . . . . . . . . . . . 2
     Editing. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
     Editing Change . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
     Error. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
     Error Planting . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
     Equal Complete Coverage. . . . . . . . . . . . . . . . . . . . . . . 3
     Expected Value . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
     Follow-up. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3
     Frame. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
     Gross Difference . . . . . . . . . . . . . . . . . . . . . . . . . . 4
     Ideal Goal . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
     Imputation . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 4
     Incomplete average . . . . . . . . . . . . . . . . . . . . . . . . . 4
     Index of Inconsistency . . . . . . . . . . . . . . . . . . . . . . . 4
     Interviewer Bias . . . . . . . . . . . . . . . . . . . . . . . . . . 4
     Interviewer Error. . . . . . . . . . . . . . . . . . . . . . . . . . 4
     Interviewer Variance . . . . . . . . . . . . . . . . . . . . . . . . 4
     Item Nonresponse . . . . . . . . . . . . . . . . . . . . . . . . . . 4
     Limits of Error. . . . . . . . . . . . . . . . . . . . . . . . . . . 4
     Mean Square Error. . . . . . . . . . . . . . . . . . . . . . . . . . 4
     Measurement Error. . . . . . . . . . . . . . . . . . . . . . . . . . 5
     Memory Error . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
     Net Difference . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
     Noncontact . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
     Noncoverage. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
     Noninterview . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
     Noninterview Adjustment. . . . . . . . . . . . . . . . . . . . . . . 5
     Nonobservation Error . . . . . . . . . . . . . . . . . . . . . . . . 5
                                     v
     Nonrespondent. . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
     Nonresponse. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5
     Nonresponse Rate . . . . . . . . . . . . . . . . . . . . . . . . . . 5
     Nonsampling Error. . . . . . . . . . . . . . . . . . . . . . . . . . 6
     Not at Home. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
     Observational Error. . . . . . . . . . . . . . . . . . . . . . . . . 6
     Overcoverage . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
     Post-audit . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
     Precision. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6
     Preferred Technique. . . . . . . . . . . . . . . . . . . . . . . . . 7
     Control. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
     Quality Check. . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
     Quality Control. . . . . . . . . . . . . . . . . . . . . . . . . . . 7
     Recall . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
     Recall Efforts . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
     Recall Losses. . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
     Recall Period. . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
     Record Check . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
     Refusal Rate . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
     Relevance. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7
     Relevance Error. . . . . . . . . . . . . . . . . . . . . . . . . . . 7
     Reliability. . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
     Response Bias. . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
     Response Deviation . . . . . . . . . . . . . . . . . . . . . . . . . 8
     Response Error . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
     Response Rate. . . . . . . . . . . . . . . . . . . . . . . . . . . . 8
     Response Variance. . . . . . . . . . . . . . . . . . . . . . . . . . 8
     Response Variance, Correlated. . . . . . . . . . . . . . . . . . . . 8
     Response Variance, Uncorrelated (Simple) . . . . . . . . . . . . . . 9
     Rotation Bias. . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
     Sample Design. . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
     Sample Verification. . . . . . . . . . . . . . . . . . . . . . . . . 9
     Sampled Population . . . . . . . . . . . . . . . . . . . . . . . . . 9
     Sampling Bias. . . . . . . . . . . . . . . . . . . . . . . . . . . . 9
     Sampling Error (of Estimator). . . . . . . . . . . . . . . . . . . . 9
     Sampling Variance. . . . . . . . . . . . . . . . . . . . . . . . . .10
     Specification. . . . . . . . . . . . . . . . . . . . . . . . . . . .10
     Specification Efforts. . . . . . . . . . . . . . . . . . . . . . . .10
     Standard Error of Estimate . . . . . . . . . . . . . . . . . . . . .10
     Statistical Audit (Control). . . . . . . . . . . . . . . . . . . . .10
     Survey Design. . . . . . . . . . . . . . . . . . . . . . . . . . . .10
     Survey Value . . . . . . . . . . . . . . . . . . . . . . . . . . . .10
     Systematic Error . . . . . . . . . . . . . . . . . . . . . . . . . .10
     Tabulation Efforts . . . . . . . . . . . . . . . . . . . . . . . . .11
     Target Population. . . . . . . . . . . . . . . . . . . . . . . . . .11
     Telescoping. . . . . . . . . . . . . . . . . . . . . . . . . . . . .11
     Temporarily Absent . . . . . . . . . . . . . . . . . . . . . . . . .11
     True Value . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11
     Unbounded Recall . . . . . . . . . . . . . . . . . . . . . . . . . .11
     Undercoverage. . . . . . . . . . . . . . . . . . . . . . . . . . . .11
     Validity . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11
     Variance, Interaction Term . . . . . . . . . . . . . . . . . . . . .11
     Verification, Dependent. . . . . . . . . . . . . . . . . . . . . . .11
     Verification, Independent. . . . . . . . . . . . . . . . . . . . . .12
     Working Technique. . . . . . . . . . . . . . . . . . . . . . . . . .12
Bibliography. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12
                                    vi
                                Glossary of
                          Nonsampling Error Terms
ACCURACY
B2   "The quality of a survey result that is measured by the difference
     between the survey figure and the value being estimated.  The true
     value is seldom known, although it can be approximated in some
     instances." p. 48.
K1   "Accuracy in the general statistical sense denotes the closeness of
     computations or estimates to the exact or true values".  In a more
     specialized sense the word also occurs as meaning (a) in relation to
     an estimator, unbiassedness; (b) in relation to the reciprocal of the
     standard error, the precision (q.v.). Neither usage can be
     recommended."
S1   "Closeness to the true value."
     Comment - See CORRECT VALUE, SURVEY VALUE, and TRUE VALUE.
ALLOCATION
O1   The process of assigning values to units in the nonresponse group of a
     survey according to the characteristics that have been observed for
     the response group or by any other imputation procedure.
AUDIT
O1   The process of applying more extensive methods of measurement to a
     subsample during the scheduled conduct of a survey in order to de-
     termine the effect of nonsampling errors.
     Comment - See POST-AUDIT.
BIAS
B2   "The difference between the expected value of an estimator and the
     value that would be obtained from all the population elements with no
     corresponding errors of measurement being made.  This true value is
     what we are trying to estimate." P. 48.
H2   The difference between the expected value of the estimator and the
     true value being estimated.  Whenever the bias is 0, the estimator is
     said to be unbiased. p. 17.
K1   "Generally, an effect which deprives a statistical result of
     representativeness by systematically distorting it, as distinct from a
     random error which may distort on any one occasion but balances out on
     the average."
     Comment - See SYSTEMATIC ERROR.
BIAS, CONSTANT
C1   That component of the total bias in a survey estimator that affects
     all of the units alike. p.389.
BOUNDED RECALL
D4   "An interview where the respondent is reminded of what he reported in
     an earlier interview and is then asked only to report on any new
     events that occurred subsequent to the bounding interview."
N1   A method of interview that is designed to prevent shifting in time of
     expenditures reported by respondents.
     [Editor's Note-Definition was given for expenditures but may apply to
     other characteristics.]
S2   "Bounded recall procedures involve a series of interviews with the
     same panel of respondents.  At the beginning of the bounded interview,
     which is the second or later interview, the respondent is told about
     the expenditures reported during the previous interview, and is then
     asked about additional expenditures made since then.  The interviewer
     also checks the new expenditures reported with previous expenditures
     to make sure that no duplication has occurred." p. 83.
     [Editor's Note-Definition was given for expenditures but may apply to
     other characteristics.]
BOUNDING
B2   "Prevention of erroneous shifts of the timing of events by having the
     enumerator or respondent supply at the start of the interview (or in a
     mail survey) a record of events reported in the previous interview."
     p. 48.
CLASSIFICATION ERRORS
H2   Errors caused by conceptual problems and misinterpretations in the
     application of classification systems to survey data. p. 84.
CLASSIFICATION ERROR RATE
O1   The proportion of responses that have been incorrectly classified in a
     survey.
CODING
W1   "Coding is a technical procedure for converting verbal information
     into numbers or other symbols which can be more easily counted and
     tabulated." p. 234.
CODING ERROR
B3   Errors that occur during the coding of sample data.
O1   The assignment of an incorrect code to a survey response.
COMPILING ERRORS
H2   Errors introduced in operations on the original observations such as
     editing, coding, punching, tabulating and transcribing. p. 94.
COMPLETE COVERAGE
M2   "A survey (or census) should be called complete if virtually all of
     the units in the population under study are covered." p. 54.
     Comment - COVERAGE ERROR and INCOMPLETE COVERAGE.
COMPLETENESS RATE
B6   The completeness rate is the percentage of interviews in which the
     required information is given by the respondent.  This rate reflects
     in part interviewer effectiveness in the interview.  However, it is
     not independent of the rate.  A low response rate may imply that the
     respondents interviewed am more likely to be cooperative than is the
     case with a high response rate.  In a sense, the interviewer with a
     low response rate can be thought of as disposing of his uncooperative
     sample members at the door and interviewing only the relatively
     cooperative ones, therefore obtaining a higher completeness rate. p.
     13.
CONDITIONING EFFECT
B2   "The effect on responses resulting from the previous collection of
     data from the same respondents in  recurring surveys." p. 48.
CONTENT ERROR
B2   "Errors of observation or objective measurement, of recording, of
     imputation, or of other processing which results in associating a
     wrong value of the characteristic with a specified unit. (Coverage
     errors are excluded from this definition.)" p. 48.
CORRECT VALUE
C1   The value obtained for a unit that is without error. p. 374.
     Comment - See ACCURACY, SURVEY VALUE, and TRUE VALUE.
COVERAGE ERROR
B2   The error in an estimate that results from (1) failure to include in
     the frame all units belonging to the defined population; failure to
     include specified units in the conduct of the many (undercoverage),
     and (2) inclusion of some units erroneously either because of a
     defective frame or because of inclusion of unspecified units or
     inclusion of specified units more than once, in the actual survey
     (overcoverage)." p. 48.
     Comment -  NONCOVERAGE, OVERCOVERAGE and UNDERCOVERAGE.
DEFINED GOAL
B2   "The approximation to the true value that would be obtained if the
     survey were carried out using the specified frame, the method of
     measurement for the specified characteristic and the method of
     summarizing the events as in the survey plan." p. 49.
H4   "Specifications actually set forth for the statistically, if carried
     out precisely and rigorously, would yield the defined goals."
     Comment -  EXPECTED VALUE, IDEAL GOAL and SPECIFICATION.
DEFINITIONAL ERRORS
H2   Errors that occur in surveys whenever the definitions of the
     characteristics for which data are to be collected are not pertinent
     to the Purposes of the survey, or are not clear to the respondents. P.
     83.
                                     2
EDITING
P1   Identifying potential problems is the first objective of the editing
     process.  We also classify as editing, operations performed on the
     recorded information that are designed to conform it to the desired
     format or units.  Filling a blank on the basis of redundant
     information on the form is editing.  Similarly, when a respondent
     indicates that he has reported in pounds whereas reporting in tons was
     requested, we would regard the conversion of his figure to the speci-
     fied unit as an editing correction.  We are also inclined to classify
     as editing the supplying of missing totals where the component detail
     has been reported.
W1   "Editing is a preliminary step in which the responses are inspected,
     corrected and sometimes precoded according to a fixed set of rules."
     p. 234.
     Comment - See EDITING CHANGE and IMPUTATION.
EDITING CHANGE
P1   A code that is inserted on a form as a result of an editing process.
     For example, where a woman is coded as the "wife" of the head of the
     household and the field for marital status is blank, the code for
     "married" may be inserted as an editing change in this case.
     Comment - See EDITING and IMPUTATION.
ERROR
K1   "In general, a mistake or error in the colloquial sense.  There may,
     for example, be a gross error or avoidable mistake; an error of
     reference, when data concerning one phenomenon are attributed to
     another; copying errors; an error of interpretation.
     "In a more limited sense the word effort is used in statistics to
     denote the difference between an occurring value and its "true" or
     "expected" value.  There is here no imputation of mistake on the part
     of a human agent; the deviation is a chance effect.  In this sense we
     have, for example, errors of observation (q.v.), errors in equations
     (q.v.), errors of the first and second kinds (q.v.) in testing
     hypotheses, and the error band (q.v.) surrounding an estimate; and
     also the normal curve of errors itself."
ERROR PLANTING
D1   A method of control where a set of errors is introduced into the
     material being subjected to control.  If the control were perfect, all
     the planted errors would be detected.  In practice, only a fraction is
     detected.  This fraction may obviously be used as a measure of the
     performance of the control operation. p. 153.
EQUAL COMPLETE COVERAGE
D3   "The equal complete coverage is by definition the result that would be
     obtained from investigation of all the sampling units in the frame
     (segments of area, business establishments, accounts, manufactured
     articles) by the same field-workers or inspectors, using the same
     definitions and procedures, and exercising the same care as they
     exercised on the sample, and at about the same period of time.  The
     concept of the equal complete coverage is fundamental to the use of
     samples.  The adjective equal signifies that the same methods must be
     used for the equal complete coverage as for the sample.  Every sample
     is a selected portion of the sampling units in the frame, hence A
     SAMPLE IS A SELECTED PORTION OF RESULTS OF THE EQUAL COMPLETE
     COVERAGE."
     Comment - See COVERAGE ERROR.
EXPECTED VALUE
H4   The hypothetical averages from the conceived replicates of the survey
     all conducted under the same essential conditions.
     Comment - See DEFINED GOAL, IDEAL GOAL, and SPECIFICATION.
FOLLOW-UP
D4   "A procedure whereby those members of a selected sample for whom a
     response is not obtained by one data collection strategy (e.g., tele-
     phone or mail) are contacted by the same or another data collection
     strategy in order to in-
                                     3
     crease response rate.  It can also be used to designate repeated
     surveys among a panel of respondents."
FRAME
C1   A list of the units which make up the population. p. 7.
K2   "Physical lists and procedures that can account for all the sampling
     units without the physical effort of actually listing them." p. 53.
U1   The frame consists of previously available descriptions of the objects
     or material related to the physical field in the form of maps, lists,
     directories, etc., from which sampling units may be constructed and a
     set of sampling units selected; and also information on communica-
     tions, transport, etc., which may be of value in improving the design
     for the choice of sampling units, and in the formation of strata, etc.
     P. 7.
     Comment - See SAMPLED POPULATION and TARGET POPULATION.
GROSS DIFFERENCE
B4   The number of cases that are classified differently in the initial
     survey or census and its replication. p. 2.
IDEAL GOAL
H4   The set of statistics that would have been produced had all of the
     requirements been precisely defined and rigorously met constitutes the
     ideal goal of the statistical survey.
     Comment - See DEFINED GOAL, EXPECTED VALUE, and SPECIFICATION.
IMPUTATION
P1   The Process of developing estimates for missing or inconsistent data
     in a survey.  Data obtained from other units in the survey are usually
     used in developing the estimate.
     Example: An editing test classifies an age as wrong when a man is
     reported as 6 years of age. and also as head of the household, with a
     wife age 35 and a child age 10.  A more rational figure than the 6 is
     supplied by some procedure such as using the same age difference
     between husband and wife as appeared in the preceding household of
     similar type.
     Comment - See EDITING and EDITING CHANGE.
INCOMPLETE COVERAGE
M2   A survey (or census) should be called incomplete if a substantial
     number of the units in the population under study ate arbitrarily
     excluded. p. 54.
     Comment - See COMPLETE COVERAGE and COVERAGE ERROR.
INDEX OF INCONSISTENCY
B1   The proportion of the total variance of a characteristic that is
     accounted for by the response variance.
INTERVIEWER BIAS
K1   Bias in the responses which is the direct result of the action of the
     interviewer.
INTERVIEWER ERROR
O1   Errors in the responses obtained in a survey that are due to actions
     of the interviewer.
INTERVIEWER VARIANCE
B2   "That component of the nonsampling variance which is due to the
     different ways in which different interviewers elicit or record
     responses." p. 48.
ITEM NONRESPONSE
B5   "The type of nonresponse in which some questions, but not all, are
     answered for a particular unit." P. 914.
01   The type of nonresponse in which a question is missed for an
interviewed unit.
LIMITS OF ERROR
D3   The limits of error are the maximum overestimate and the maximum
     underestimate from the combination of the sampling and the nonsampling
     errors.
MEAN SQUARE ERROR
K1   "The second moment of a set of observations about Some arbitrary
     origin. if that origin is the
                                     4
     mean of the observations, the mean-square deviation is equivalent to
     the variance (q.v.)."
S1   "Mean value over trials of the square of the response error.  It may
     be expressed as the sum of variances, covariances and the square of
     the response bias."
O1   The variance of the estimate plus the bias squared.
MEASUREMENT ERROR
B2   "(1) As applied to individual units of analysis, measurement error
     means the difference between the observed or imputed value and the
     true value. (2) As applied to an estimate, measurement error means the
     difference between the estimate and the true value, thus including all
     sampling as well as nonsampling errors." p. 48.
MEMORY ERROR
M2   Errors associated with the recall of answers to questions about the
     past. p. 45.
NET DIFFERENCE
B4   The net difference of a tabulated figure for a given class is the
     difference between the total for the class obtained in the reinterview
     (or appropriate records) and the original survey. p. 3.
NON CONTACT
O1   A type of nonresponse in which the interviewer has not been Able to
     contact the respondent.
NONCOVERAGE
C1   "Failure to locate or to visit some units in the sample." p. 360.
K2   "Refers to the negative error of failure to include elements that
     would properly belong in the sample." p. 529.
     Comment - See COVERAGE ERROR, OVERCOVERAGE, and UNDERCOVERAGE.
NONINTERVIEW
01   The type of nonresponse in which no information is available from
     occupied sample units for such reasons as: not at home, refusals,
     incapacity and lost schedules.
NONINTERVIEW ADJUSTMENT
01   A method of adjusting the weights for interviewed units in a survey to
     the extent needed to account for occupied sample units for which no
     information was obtained.
NONOBSERVATION ERROR
K2   "Failure to obtain data from parts of the survey population which
     results from two sources: noncoverage and nonresponse." p. 527.
NON RESPONDENT
M2   Those persons in a sample from whom information has not been obtained.
     p. 172.
NONRESPONSE
B2   "The failure 10 elicit responses for units of analysis in a population
     or sample because of various reasons such as absence from home,
     failure to return questionnaires. refusals. omission of one or more
     entries in a form, vacant houses, etc." p. 50.
C1   "We shall use the term nonresponse to refer to the failure to measure
     some of the units in the selected sample." p. 355.
K1   "In sample surveys, the failure to obtain information from a
     designated individual for any reason (death, absence, refusal to
     reply) is often called a nonresponse and the proportion of such
     individuals of the sample aimed at is called the nonresponse rate.  It
     would be better, however, to call this a "failure" rate or a "non-
     achievement" rate and to confine "nonresponse" to those cases where
     the individual concerned is contacted but refuses to reply or is
     unable to do so for reasons such as deafness or illness."
K2   "Nonresponse refers to many sources of failure to obtain observations
     (responses, measurements) on some elements selected and designated for
     the sample.,, p. 532.
NONRESPONSE RATE
D4   "The complement of response rate.  The numerator is those eligible
     respondents selected in a sample for whom information is not obtained
     because of refusals, not found at home, unavailable by reason of
     illness, incompetence, lan-
                                     5
     guage difficulty, etc.  The denominator is the total number of
     eligible respondents initially selected for the sample."-p. 46.
NONSAMPLING ERROR
B2   "The error in an estimate arising at any stage in a survey from such
     sources as varying interpretation of questions by enumerators, unwill-
     ingness or inability of respondents to give correct answers,
     nonresponse, improper coverage, and other sources exclusive of
     sampling error.  This definition includes all components of the Mean
     Square Error (MSE) except sampling variance." p. 50.
K1   "An error in sample estimates which cannot be attributed to sampling
     fluctuations.  Such errors may arise from many different sources such
     as defects in the frame, faulty demarcation of sample-units, defects
     in the selection of sample units, mistakes in the collection of data
     (due to personal variations or misunderstandings or bias or negligence
     Or dishonesty on the part of the investigator or of the interviewee),
     mistakes at the stage of the processing of the data, etc.
     "The term "response error" is sometimes used for mistakes in the
     collection of data and would not, strictly speaking, cover errors due
     to nonresponse.  The use of the word "bias" in the place of error,
     e.g. "response bias" is not uncommon.  The term "ascertainment error"
     (Mahalanobis) is preferable as it would include errors due to
     nonresponse and also cases of collection of data by methods other than
     interviewing, e.g. direct physical observation of fields for crop
     estimates."
     Comment - See OBSERVATIONAL ERROR and RESPONSE ERROR.
NOT AT HOME
C1   "Persons who reside at home but are temporarily away from the house."
     p. 360.
OBSERVATIONAL ERROR
K1   "This term ought to mean an error of observation but sometimes occurs
     as meaning a response error."
K2   "Errors which are caused by obtaining and recording observations
     incorrectly." p. 520.
     Comment - See NONSAMPLING ERROR and RESPONSE ERROR.
OVERCOVERAGE
K2   "Positive errors which occur due to the inclusion in the sample of
     elements that do not belong there." p. 529.
     Comment - See COVERAGE ERROR, NONCOVERAGE, and UNDERCOVERAGE.
POST-AUDIT
O1   The process of applying more extensive methods of measurement to a
     subsample after the scheduled conduct of a survey in order to
     determine the effect of nonsampling errors.
     Comment - See AUDIT.
PRECISION
B2   "The quality of a sample result that is measured by the difference
     between the sample result and the result which would be obtained if a
     complete count were taken using the same survey procedures.  Same as
     reliability.  Usually defined by stating the sampling error." p. 50.
C1   Refers to the size of deviations from the mean obtained by repeated
     application of the sampling procedure. p. 16.
K2   "The difference between a sample result and the result of a complete
     count taken under the same conditions ... or the reliability." p. 10.
H3   A measure of how close the set of possible sample estimates for a
     particular sample design may be expected to come to the value being
     estimated. p. 7.
K1   "In exact usage precision is distinguished from accuracy.  The latter
     refers to closeness of an observation to the quantity intended to be
     observed.  Precision is a quality associated with a class of
     measurements and refers to the way in which repeated observations
     conform to themselves; and in a somewhat narrower sense refers to the
     dispersion of the observations, or some measure of it, whether or not
     the mean value around which the dispersion is measured approximates to
     the "true" value.  In general the
                                     6
     precision of in estimator varies with the square root of the number of
     observations upon which it is based."
PREFERRED TECHNIQUE
D3   "Any result, whatever it be, is the result of applying some set of
     operations.  Although there is no true value, we do have the liberty
     to define and to accept a specified set of operations as preferred,
     and the - results thereof as a master standard (so-called by Harold D.
     Dodge).  Thus, there may be, by agreement of the experts in the
     subject-matter for any desired property of the material, a preferred
     survey-technique."
     Comment - See WORKING TECHNIQUE
PROCESS CONTROL
B2   A statistical quality control technique where frequent small samples
     are taken and evaluated to control clerical operations. p. S.
QUALITY CHECK
M2   "An intensive study of a small sample (relative to the size of the
     survey) where every effort is made to attain the highest level of
     accuracy possible." p. 396.
QUALITY CONTROL
B2   "Observation and procedure used.in any operation of a survey in order
     to prevent or reduce the effect of nonsampling errors." p. 50.
K1   "A method of controlling the quality of a manufactured product which
     is produced in large numbers.  It aims at tracing and eliminating
     systematic variations in quality, or reducing them to an acceptable
     level, leaving the remaining variation to chance.  The process is then
     said to be statistically under control."
RECALL
N1   A method of obtaining information by means of an interview in which
     the respondent is required to remember past events.  A common applica-
     tion is the recall of consumer expenditures.
     Comment - See BOUNDED RECALL and UNBOUNDED RECALL.
RECALL ERRORS
H2   "Many questions in surveys refer to happenings or conditions in the
     past, and there is a problem in both remembering the event and of
     associating it with the correct time period." p. 84.
RECALL LOSSES
N1   Omissions of expenditures due to forgetting of items.
     [Editor's Note - Definition was given for expenditures but may apply
     to other characteristics.]
RECALL PERIOD
N1   Refers to the period of time for which the resident's report of
     expenditures is to be utilized.
     [Editor's Note  Definition was given for expenditures but may apply to
     other characteristics.]
RECORD CHECK
B2   "A study in which data on individual units obtained by one method of
     data collection are checked against data for the same units from
     available records obtained by a different method of data collection
     (for example, comparison of ages reported in census with information
     from birth certificates)." p. 50.
REFUSAL RATE
K1   "In the sampling of human populations, the proportions of individuals
     who, though successfully contacted, refuse to give the information
     sought.  The proportion is usually (and preferably) calculated by
     dividing the number of refusals by the total number of the sample
     which it was originally desired to achieve."
RELEVANCE
H4   "Standards of relevance are concerned with the difference between the
     ideal goal of a survey and the statistics called for by the survey
     specifications."
RELEVANCE ERROR
O1   The difference between the ideal goal of a sur-
                                     7
     vey and the statistics called for by the survey specifications.
     Comment - See RELEVANCE.
RELIABILITY
M1   The confidence that can be assigned to a conclusion of a probabilistic
     nature.
     [Editor's Note-Translation taken from Crespo, see Reference.  S1.]
M2   "The extent that repeat measurements made by a scale or test under
     constant conditions will give the same result (assuming no change in
     the basic characteristics - e.g., attitude -  being measured)." p.
     353.
S1   "The degree of confidence in terms of probability associated with
     conclusions based on a random experiment."
     Comment - See VALIDITY.
RESPONSE BIAS
B3   The difference between the average of the averages of the responses
     over a large number of independent repetitions of the census and the
     unknown average that could be measured if the census were accomplished
     under ideal conditions and without error. p. 1.
S1   "Difference between average reported value over trials and true
     values.  It is a combined bias as algebraic sum of all bias terms
     representing diverse source of biases."
RESPONSE DEVIATION
B3   "The difference between the response recorded for a person on a
     particular trial and the average of the responses over all trials for
     the same person." p. 2.
S1   "Difference between individual reported value and the average over
     hypothetical trials under the same general conditions."
RESPONSE ERROR
B2   "That part of the nonsampling error which is due to the failure or the
     respondent to report the correct value (respondent error) or the
     interviewer to record the value correctly (interviewer error).  It
     includes both the consistent response biases and the variable errors
     of response which tend to balance out." p. 50.
S1   "difference between reported and true value."
     Comment - See NONSAMPLING ERROR and OBSERVATIONAL ERROR.
RESPONSE RATE
D4   "The percentage of an eligible sample for whom information is
     obtained.  For an interview survey the numerator of the formula is the
     number of interviews.  The denominator is the total sample size. minus
     non-eligible respondents-, that is, minus those not meeting the cri-
     teria for a potential respondent as defined for that particular
     study."
H6   "The percentage of times an interviewer obtains interviews at sample
     addresses where contacts are made, i.e.,
                            Number of contacts.
                       ____________________________
                           Number of interviews
          Since a contact must be either an interview or a refusal, the
     response rate is also equal to;
                            Number of Refusals
                     1 - _____________________________
                            Number of contacts
     p. 13."
W1   The response rate is the proportion of the eligible respondents in the
     sample who were successfully interviewed.  For example, the
     denominator may be the total number of occupied dwellings, and the
     numerator may be the number of completed interviews. p. 294.
RESPONSE VARIANCE
B2   "That part of the response error which tends to balance out over
     repeated trials or over a large number of interviewers." p. 50.
B3   "The variance among the trial means over a large number of trials." p.
     2.
D4   "The response variance of a survey estimator is the sum of the simple
     response variance and the correlated response variance,"
RESPONSE VARIANCE, CORRELATED
D4   "The correlated response variance is the contribution to the total
     variance arising from nonzero correlations (in the sense of the
     distribution of measurement errors) between the response of sample
     units."
                                     8
H1   The contribution to the total response variance from the correlations
     among response deviations.
RESPONSE VARIANCE, UNCORRELATED (SIMPLE)
D4   "The sample response variance contribution to the total variance
     arises from the variability of each survey response about its own
     expected value. In terms of h simple random sampling design, the
     simple response variance is the population mean of the variances of
     each population unit."
H1   "The variance of the individual response deviations over all possible
     trials."
H5   "The basic trial-to-trial variability in response, averaged over the
     elements in the population." p. 116.
S1   "Variance of the reported value over trials."
ROTATION BIAS
O1   A type of bias that occurs in panel surveys which consist of repeated
     interviews on the same units.  Although these surveys arc designated
     so that the estimates of a characteristic are expected to be nearly
     the same for each panel in the survey, this expectation has not been
     realized.  For example, an estimate from a panel that is in the survey
     for the first time may differ significantly from estimates from the
     panels that have been in the survey longer.
Z1   "The downward tendency in the value of the characteristics reported if
     the observation of the same units is continued over a longer period of
     time.  For example, it was found in expenditure surveys that the
     average expenditure per item per person is usually higher in the first
     week of the survey than in the second or the third." p. 203.
SAMPLE DESIGN
H3   A procedure that consists of a sampling plan and method of
     investigation. p. 7.
K1   "The usage is not uniform as regards the precise meaning of this and
     similar terms like "sample plan," "survey design," "sample plan" or
     "sampling design." These cover one or more parts constituting the
     entire planning of a (sample) survey inclusive of processing, etc.
     The term "sampling plan" may be restricted to mean all steps taken in
     selecting the sample; the term "sample design" may cover in addition
     the method of estimation; and "survey design" may cover also other
     aspects of the survey, e.g. choice and training of interviewers,
     tabulation plans, etc.  "Sample design" is sometimes used in a clearly
     defined sense, with reference to a given frame, as the set of rules or
     specifications for the drawing of a sample in an unequivocal manner."
     Comment - See SURVEY DESIGN.
SAMPLE VERIFICATION
H2   A quality control procedure for keeping certain clerical errors at a
     satisfactory level. p. 618.
SAMPLED POPULATION
C1   "The population to be sampled." p. 6.
     Comment - See FRAME and TARGET POPULATION.
SAMPLING BIAS
B2   "That part of the difference between the expected value of the sample
     estimator and the true value of the characteristic which results from
     the sampling procedure, the estimating procedure, or their
     combination." p. 50.
SAMPLING ERROR (OF ESTIMATOR)
B2   "That part of the error of an estimator which is due to the fact that
     the estimator is obtained from a sample rather than a 100 percent enu-
     meration using the same procedures.  The sampling error has an
     expected frequency distribution for repeated samples, and the sampling
     error is described by stating a multiple of the standard deviation of
     this distribution." p. 50.
K1   "That part of the difference between a population value and an
     estimator thereof, derived from a random sample, which is due to the
     fact that only a sample of values is observed; as distinct from errors
     due to imperfect selection, bias in response or estimation, errors of
     obser-
                                     9
     vation and recording, etc.  The totality of Sampling errors in all
     possible samples of the same size generates the sampling distribution
     of the statistic which is being used to estimate the parent value."
SAMPLING VARIANCE
D4   "The sampling variance is that contribution to the total variance
     arising from the random selection of a sample, rather than a complete
     enumeration, from the population." p. 45.
H1   The component of the total variance of the survey that represents the
     contribution due to sampling.
SPECIFICATION
H4   Detailed description of the collection, compilation and presentation
     of the survey data.
     Comment - See DEFINED GOAL, EXPECTED VALUE and IDEAL GOAL.
SPECIFICATION ERRORS
M3   Errors at the planning stage because (i) data specification is
     inadequate and inconsistent with respect to the objectives of the
     survey, (ii) omission or duplication of units, incomplete units or
     faulty enumeration methods and (iii) inaccurate or inappropriate
     methods of interview. p. 451.
STANDARD ERROR OF ESTIMATE
B2   "This term refers to the sampling error, calculated as the square root
     of the variance of the estimator." p. 50.
K1   "An expression for the standard deviation of the observed values about
     a regression line, i.e. an estimator of the variation likely to be
     encountered in making predictions from the regression equation.  For
     example, in simple linear regression of y on x the standard error of
     estimate of y is given by y (1 - r2)1/2 where y2 is the variance of
     y and r is the correlation between y and x."
STATISTICAL AUDIT (CONTROL)
D2   A procedure to detect the existence of errors that are made in
     carrying out the fieldwork, the interviewing, the coding, the
     computations, and other work. p. 71.
SURVEY DESIGN
H3   "By the survey design will be meant the sample design together with
     the questionnaire and the method of obtaining the information from the
     sample, or, more generally, the method of measurement.  Thus, the
     survey design includes the plans for all the parts of the survey
     except the statement of the objectives.  It includes:
     (a)  The questionnaire,
     (b)  Decision on method of observation or interview,
     (c)  Sample design,
     (d)  Choice and training of interviewers,
     (e)  Assignments of interviewers,
     (f)  Decisions on treatment of noninterviews,
     (g)  Estimation equations,
     (h)  Processing of questionnaires,
     (i)  Preparation of tables,
     (j)  Studies of precision and accuracy of information,
     as well as instructions and methods followed for carrying through
     these operations." p. 8.
     Comment - See SAMPLE DESIGN.
SURVEY VALUE
B5   "A value obtained in a complete survey which is intended to be the
     "true" value, but which may not be the same because the "Me" data
     cannot be collected, the population cannot be defined exactly, or
     there are uncontrollable biases in the process of collecting and
     assembling the data.  For example, age may be poorly reported if
     someone other than the person involved responds; sometimes the person
     himself does not know his age." P. 913.
     Comment - See ACCURACY, CORRECT VALUE and TRUE VALUE.
SYSTEMATIC ERROR
K1   "As opposed to a random error, an error which is in some sense
     biassed, that is to say, has a distribution with mean (or some equally
     acceptable measure of location) not at zero."
     Comment -See BIAS.
                                    10
TABULATION ERRORS
M3   Errors occurring during the tabulation stage of survey procedures. p.
     451.
TARGET POPULATION
C1   "The population about which information is wanted." p. 6.
     Comment -  The FRAME and SAMPLED POPULATION.
TELESCOPING
R1   The tendency of the respondent to allocate an event to a period other
     than the reference period (also called border bias). p. 21 1.
S2   "A telescoping error occurs when the respondent misremembers the
     duration of an event.  While one might imagine that errors would be
     randomly distributed around the true duration, the errors are
     primarily in the direction of remembering an event as having occurred
     more recently than it did.  This is due to the respondent's wish to
     perform the task required of him.  When in doubt, the respondent
     prefers to give too much information rather than too little." p. 69.
TEMPORARILY ABSENT
O1   A sampling unit for which a respondent cannot be contacted during the
     survey period.
TRUE VALUE
B5   "An idealized concept of a quantity which is to be measured; in some
     cases it can be achieved. but in others there is disagreement as to
     the definition of the quantity.  Illustrations are the number of
     persons who are "unemployed," and the dollar value of farm sales. "In
     most surveys an approximation to the "true" value is used, defined in
     such a way that one would expect to be able to measure it provided
     there were sufficient time, money, knowledge of techniques, etc., and
     no errors in the reporting, collection, and processing of the data."
     p. 913.
D2   A population value determined by a specified set of operations that
     one preferred, and the results thereof as a master standard. p. 62.
S1   That result which would be obtained with perfect measuring instruments
     and without committing any error of any type both in collecting the
     primary data and in carrying out mathematical operations.
     Comment - See ACCURACY, CORRECT VALUE and SURVEY VALUE
UNBOUNDED RECALL
N1   "Ordinary type of recall, where respondents are asked for expenditures
     made since a given date and no control is exercised over the possi-
     bility that respondents may erroneously shift some of their
     expenditures reports into or out of the recall period."
     [Editor's Note - Definition was given for expenditures but may apply
     to other characteristics.]
     Comment - See BOUNDED RECALL and RECALL.
UNDERCOVERAGE
B2   "The error in an estimate that results from failure to include in the
     frame all units belonging to the defined population." p. 48.
O1   A type of nonsampling error that results from either failure to
     include all appropriate sampling units in the frame or failure to
     include some of the units that are already on the frame.
     Comment - COVERAGE ERROR, OVERCOVERAGE and NONCOVERAGE.
VALIDITY
D4   "A valid measure is one that measures what it claims to and not
     something else.  Validity is a continuous concept so most measures
     fall between total validity and total nonvalidity.  A totally valid
     measure is one without bias."
VARIANCE, INTERACTION TERM
D4   interaction contribution to the total variance of estimate is that
     component arising from a non-zero covariance between measurement error
     and sampling error:
VERIFICATION DEPENDENT
B6   A method of verifying quality in which
                                    11
     high level clerks review the work of production coders and determine
     whether or not the codes assigned are correct.
VERIFICATION, INDEPENDENT
B6   A method of verifying coding quality in which two or more independent
     codings of items are conducted for an identical sample of persons and
     then the coding results are matched.
WORKING TECHNIQUE
D3   "Unfortunately, it often happens that the preferred technique, usable
     on a laboratory-scale, is too expensive to apply in a full-scale
     survey, or it may be objectionable otherwise.  Experts in the subject-
     matter must then supply also a working technique.  Thus, the preferred
     technique by which to define a person's age might be to compute the
     difference in time between today and the date shown on his birth-
     certificate.  But some people don't have birth certificates at all,
     and few people have them handy.  Moreover, some people would not be
     happy with an interviewer who asked for birth certificates.  The
     Passport Division can ask for birth certificates, but interviewers may
     only ask the person how old be is, and record the result.  This would
     be the working technique by which to measure age."
     Comment - PREFERRED TECHNIQUE.
                               Bibliography
B1.  Bershad, Max A. (1964), The Index of Inconsistency for L-fold
     Classification System, Unpublished Bureau of the Census Memorandum,
     Washington, D.C.
B2.  Bureau of the Census, Course on Nonsampling Errors, Lectures 1-9,
     International Statistics Program Center, Washington, D.C.
B3.  Bureau of the Census (1963), Evaluation and Research Program of the
     U.S. Censuses Of Population and Housing, 1960: Background, Procedures,
     and Forms, Series ER60, No. 1, Washington, D.C.
B4.  Bureau of the Census (1968), The Current Population Survey Reinterview
     Program, January 1961 through December 1966, Technical Paper No. 19,
     Washington, D.C.
B5.  Bureau of the Census (1976), The Statistical Abstract of the United
     States, Washington, D.C.
B6.  Bureau of the Census (1965), United States Census of Population and
     Housing 1960: Quality Control of Preparatory Operations, Microfilming
     and Coding, Washington, D.C.
C1.  Cochran, W. G. (1963), Sampling Techniques, J. Wiley and Sons, Inc.
     New York.
D1.  Dalenjus, Tore (1974), Ends and Means of Total Survey Design,
     University of Stockholm, Stockholm.
D2.  Deming, W. Edwards (1960), Sample Design in Business Research, J.
     Wiley and Sons, Inc., New York.
D3.  Deming, W. Edwards (1960), Uncertainties in Statistical Data, and
     Their Relation to the Design and Management of Statistical Surveys and
     Experiments, Bulletin of the International Statistical Institute,
     Tokyo.
D4.  Department of Health, Education and Welfare (1975), Advances in Health
     Survey Research Methods, Research Proceedings Series, DHEW Publication
     No. (HRS) 77-3154, Washington, D.C.
H1.  Hansen, M. H., Hurwitz, W. N., and Bershad, M. A. (1960), Measurement
     Errors in Censuses and Surveys, Bulletin of the International
     Statistical Institute, Tokyo.
                                    12
H2.  Hansen, M. H., Hurwitz, W. N. and . Madow, W.O. (1953) Sample Survey
     Methods and Theory, Volume I., Methods and Applications, J. Wiley and
     Sons, Inc., New York.
H3.  Hansen, M. H., Hurwitz, W. N., and Madow, W. G. (1953), Sample Survey
     Methods and Theory, Volume II, Theory, J. Wiley and Sons, Inc., New
     York.
H4.  Hansen, M. H., Hurwitz, W. N., and Pritzker, L. (1967),
     Standardization of Procedures for the Evaluation of Data: Measurement
     Errors and Statistical Standards in the Bureau of the Census, Bulletin
     of the International Statistical Institute, Sydney.
H5.  Hansen, M. H., Hurwitz, W. N., and Pritzker, L. (1964), The Estimation
     and Interpretation of Gross Differences and the Simple Response
     Variance, Contributions to Statistics, Statistical Publishing Society,
     Calcutta.
H6.  Hauck, Mathew and Steinkamp, Stanley (1964), Survey Reliability and
     Interviewer Competence, Studies in Consumer Savings, No. 4, Bureau of
     Economic and Business Research, University of Illinois, Urbana.
K1.  Kendall, M. G. and Buckland, W. R. (1960), A Dictionary of Statistical
     Terms, Oliver and Boyd, Edinburgh.
K2.  Kish, Leslie (1965), Survey Sampling, J. Wiley and Sons, Inc., New
     York.
M1.  Morice, E. (1968), Dictionnaire de Statistique, Paris.
M2.  Moser, C. A. and Kalton, G. (1971), Survey Methods in Social
     Investigation, Second Edition, Basic Books, Inc., New York.
M3.  Murthy, M. (1967).  Sampling Theory and Methods, Statistical
     Publishing Society, Calcutta.
N1.  Neter, J. and Waksberg, J. (1965), Response Errors in Collection of
     Expenditures Data by Household Interviews: An Experimental Study,
     Technical Paper No. II, Bureau of the Census, Washington, D.C.
O1.  OMB Subcommittee on Nonsampling Errors (1976), Washington, D.C.
P1.  Pritzker, L., Ogus, J., and Hansen, M. H. (1965), Computer Editing
     Methods - Some Applications and Results, Bulletin of the International
     Statistical Institute, Belgrade.
R1.  Raj, D. ( 1972).  The Design of Sample Surveys, McGraw-Hill Book
     Company, New York.
S1.  Sanchez-Crespo, J. L. (1975), Notes on the Accuracy, Precision and
     Reliability of Statistical Data, Bulletin of the International
     Statistical Institute, Warsaw.
S2.  Sudman, Seymour and Bradburn, Norman (1974), Response Effects in
     Survey, Aldine Publishing Company, Chicago.
U1.  United Nations (1964), Recommendations for the Preparation of Sample
     Survey Reports (Provisional Issue), Series C, No. 1, Rev. 2., New
     York.
W1.  Warwick, Donald P. and Lininger, Charles A. (1975), The Sample Survey:
     Theory and Practice, McGraw-Hill Book Company, New York.
Z1.  Zarkovich, S. S. (1699), Quality of Statistical Data, Food and
     Agriculture organization of the United Nations, Rome.
                                    13
