Skip to secondary navigationSkip to main content

              An official website of the United States government            

              Here’s how you know            

**The .gov means it’s official.**                        Federal government websites often end in .gov or .mil. Before                        sharing sensitive information, make sure you’re on a federal                        government site.                    

**The site is secure.**                        The **https://** ensures that you are connecting to                        the official website and that any information you provide is                        encrypted and transmitted securely.                    

*Federal Committee onStatistical Methodology*

        -  HomeAbout FCSMResourcesEvents and ProceedingsGroups OverviewSearch smallFederal Committee on Statistical Methodology 2018 Research and Policy Conference-  FCSM Research and Policy Conferences 
-  Past FCSM Statistical Policy Seminars 
-  Recordings of CDAC Meetings and Workshops 
-  GASP Presentations 
-  GIG Presentations 

Back
Federal Committee on Statistical Methodology 2018 Research and Policy Conference**CONCURRENT SESSION A-1Advances in Web Scraping for Federal Statistics**
Web-scraping & Similar Tools to Capture Information for BLS Uses  | (PDF)

SABLE: Tools for Web Crawling, Web Scraping, and Text Classification  | (PDF)

Evaluating the Use of Web-Scraped List Frames to Assess Undercoverage in Surveys 

Seizing Opportunities and Preserving Principles  |        (PDF)

Museum Frame Development – A Universe is Comprised of Many Worlds 
**CONCURRENT SESSION A-2:Does Survey Response Change Respondent Behavior?**
Speeders and Sloths: The Effects of Respondent Timing on Web Survey Data Quality 

Response Burden and Bias in the First National Food Acquisition and Purchase Survey (FoodAPS-1): An Empirical Analysis Based on Respondent Feedback Survey |        (PDF)

Changes in Interview Length over a Data Collection Period: Interviewer Learning or Shifting Respondent Characteristics?          

Smart Math Saves Time and Improves Communication        | (PDF)
**CONCURRENT SESSION (A-3:Board)Joanne Hsu (Federal Reserve Board)**
Evaluating Wealth Data in the Redesigned 2014 Survey of Income and Program Participation | (PDF)

Discussant: Howard Iams (Social Security Administration)A-3_Discussant.pdf  | (PDF)
**CONCURRENT SESSION A-4 Non-Probability Sampling and Estimation**
Benchmark Assessment of Respondent Driven Sampling Data for Foreign-Born Korean Americans  | (PDF)

Comparing Alternatives for Estimation from Nonprobability Samples 

Combining Probability and Nonprobability Samples to Form Efficient Hybrid Estimates  | (PDF)

Discussant: Courtney Kennedy (Pew Research Center)A-4KennedyDISCUSSION WEDSession A-4_1000-1145am.pdf  | (PDF)
**CONCURRENT SESSION A-5 Transparent Quality Reporting ifn the Integration of Multiple Data Sources**
Session Chair Introduction  |        (PDF)

Overview of Transparent Quality Reporting | (PDF)

Quality of Input Data  | (PDF)

Quality of Data Processing  | (PDF)

Quality of Output Statistical Products and Services | (PDF)
**CONCURRENT SESSION B–1 Advances in Web Probing**
An Automated Refusal Conversion Strategy for Web Surveys | (PDF)

Using Close-Ended Web Probes to Inform the Redesign of the National Health      | (PDF)

The Roles of Typicality, Specificity, and Set Size in Providing Examples for Survey Questions: Evidence from an Online Study Using Self-Administered Comprehension Probes

Benefits and Drawbacks of Using Crowdsourcing Techniques for Cognitive Testing      | (PDF)

Impact of Dependent Interviewing on Consistency of Answers in the American Housing Survey  | (PDF)
**CONCURRENT SESSION B-2 Topics in Editing and Imputation: Automated Systems, Machine Learning, Hot Deck, Response      Propensities, and Edit Reduction**
      Innovative Approaches to Generating National and Regional Estimates of Crime and Arrest with Incomplete Data    

      Evaluating Hot Deck with Propensity Matching for the Advance Monthly Retail Trade Survey (MARTS)       | (PDF)

      Assessing the Automated Imputation of Missing and Erroneous Survey Data: A Simulation-Based Approach       | (PDF)

      Edit Reduction Research in the U.S. Census Bureau’s Economic Directorate       | (PDF)
**CONCURRENT SESSION B-3 Measuring and Imputing Incomes**
      Household Incomes in Tax Data: Using Addresses to Move from Tax Unit to Household Income Distributions | (PDF)

      Calculating a Supplemental Poverty Measure in the Survey of Income and Program Participation    
**CONCURRENT SESSION B-4 Innovations in Sample Design**
      Sampling Design and Variance Estimation for the National Survey of WIC Participants, Wave 3    

      Implications of Repeated Sampling in a Crime Survey       | (PDF)

      Assessing How Well Students in Economics Experiments Model Decision-Making for Non-Student Populations | (PDF)

      Using Social Media for a Probability Sample: Is It Possible? | (PDF)

      Comparing Random and Nonrandom Samples Using Model-Implied Randomization      Vladislav Beresovsky (National Center for Health Statistics)    
**CONCURRENT SESSION C-1 Contact Strategies**
      Effect of Contact Strategy on Response Mode Selection    

      Adaptive Designs - Tailoring of Contact Materials to Increase Survey Participation

      If We Boost It, Will They Come?: Evaluating Efforts to Promote Web Completion in a Multi-Mode National Establishment Survey    

      Reducing Collection Effort While Maintaining Data Quality in Business Surveys Comparing Random and Nonrandom Samples Using Model-Implied Randomization    
**CONCURRENT SESSION C-2 Applications of Artificial Intelligence and Text Analysis in Federal Statistics**
      Coding Verbatim Responses Using an Auto-coding Program Based on a Two-step Matching Process: National Hospital Ambulatory Medical Care Survey Emergency Department Data, 2015    

      Comparison of Machine Learning Algorithms to Build a Predictive Model for Classification of Survey Write-in Responses

      Using Machine Learning Techniques to Interpret Open-ended Responses in Web Surveys    
**CONCURRENT SESSION C-3    Supplemental Poverty Measures**
      Moving to the Median: The Case for Changing the Range of Expenditures Underlying SPM Thresholds     

      Controlling for Prices before Estimating SPM Thresholds and the Impact on SPM Poverty Statistics    

      Enhancing the Supplemental Poverty Measure to Estimate the Impact of Health Insurance Benefits on Poverty 

      Supplemental Poverty Measure: A Comparison of Geographic Adjustments with Regional Price Parities vs. Median Rents from the American Community Survey: An Update    
**CONCURRENT SESSION C-4 Small Area Estimation: Applications and Practical Demonstrations**
Web-scraping & Benchmarking Options for Model-Based CountyLevel Estimation of Agricultural Cash Rental Rates    

Small Area Estimation in the Annual Survey of Public Employment and Payroll (U.S. Census Bureau)          

County-Level Estimates of Mortality and Natality Indicators from the National Vital Statistics Systema    

Bayesian State-level Estimates of Diabetes Prevalence in the United States, 2006-2015    
**CONCURRENT SESSION C-5 New Methods to Evaluate Response Error**
      Measuring Systematic Income Misreporting Heterogeneity Using a Novel Dataset    

      Respondents' Reporting Accuracy of Social Security Benefits and its Implications in the Health and Retirement Study    

      Using Administrative Records to Evaluate Absolute and Relative Reporting Accuracy in Surveys     

      Understanding Differences in the Disability Prevalence Across Federal Surveys: Why the 2014 Survey of Income and Program Participation Stands Out    
**CONCURRENT SESSION D-1 Hierarchical Bayes Small Area Estimation for Domains Defined by Demography, Geography, or Industry**
Small Domain Estimation Using Probability and Non-Probability Survey Data

On Increasing the Number of County-Level Crop Estimates 

Small Area Estimation for Measures Related to Tobacco Use and Policies Using the Tobacco Use Supplement to the Current Population Survey    

      Small Area Co-Modeling of Point Estimates and Their Variances for Domains in the Current Employment Statistics Survey    

Yulei He (National Center for Health Statistics)    
**CONCURRENT SESSION D-2**
Organizer and Session Chair: Peter Miller (U.S. Census Bureau)

Lessons from Nonresponse Bias Studies Involving Federal Surveys    

      Nonresponse Bias Indicators and Adjustments Employed in Federal Surveys    

      Alternative Indicators of the Risk for Nonresponse Bias    

      Discussant: Roger Tourangeau (Westat)    
**CONCURRENT SESSION D-3 Novel Approaches to Using Federal and Local Data**
      Examining the Utility of Educational Administrative Records for Research and Improving Survey Operations: A Pilot Project at the U.S. Census Bureau    

      Leveraging Access to and Use of Department of Defense (DoD) Data: A Case Study of Unraveling Military Attrition Tohrough New Approaches to DoD Data Integration 

      Measuring Innovation in New Ways using Non-Traditional Data Sources    

      Interdisciplinary Insights for Investigating the Intersection of Race/Color and Social Outcomes among Diverse Hispanics Communities: Implications for Statistical Measurements and Analysis    

      The Role of Opioid Misuse in Child Welfare Caseloads    
**CONCURRENT SESSION D-4 Current Research for Improving Race and Ethnicity: Federal Data Maintenance; Collection; and Presentation**
      Research Examinations within the Federal Statistical System for Improving Federal Race/Ethnicity Data    

      Update on Race and Ethnicity Question Proposals for the 2020 Census    

      Potential Improvements for 2020 Census Race and Ethnicity Conversion and Bridging    

      Discussant: Lauren Musu-Gillette (National Center for Education Statistics)    
**CONCURRENT SESSION D-5      Advancing Disclosure Limitation Methods in Federal Data Releases**
      Towards Developing Synthetic Datasets for the Economic Census          

      Formal Privacy and Synthetic Data for the American Community Survey    

      An Integrated Approach to Providing Access to Confidential Data    

      Challenges and Experiences Adapting Differentially Private Mechanisms to the 2020 Census          
**CONCURRENT SESSION E-1      Cognitive Lab, Usability, and Survey      Development Research**
      Evidence-based Standards and Guidelines for Mobile Survey Instrument Design    

      Usability Testing Methodology for the 2017 Economic Census Web Instrument    

      Defining Bullying: A Split-Ballot Experiment Across Three Federal Agencies    

      Health Insurance in the American Community Survey: Multiple Types of Coverage and Respondent Write-ins    

      Improving the Anchoring Vignette Methodology with Visual Vignettes    
**CONCURRENT SESSION E-2      Combating Nonresponse an Update from the Field**
      Comparing Response Rates Across Surveys    

      Stemming the Rising Tide of Nonresponse    

      Cleaning Out the Gutter: Identifying and Eliminating Deadwood from a Sampling Frame Using Trees     
**CONCURRENT SESSION E-3**
      Pursuing Consent for Record Linkage in an Establishment Survey: Results from a National Survey    

      Assessing Consent Bias in Linkage Studies     

      Challenges to Informed Consent from Administrative Data Linkage and Secondary Usage    
**CONCURRENT SESSION E-4      Estimation Challenges in Complex Surveys**
Incorporating the Finite Population Correction into the Variance Estimation of a National Business Survey     

Finding an Estimator that Minimizes Revisions in a Monthly Indicator Survey     

Effect of Nearest Neighbor Imputation on Variances Calculated by Fay’s Balanced Repeated Replication    

Investigation of the NCHS Data Presentation Standards for Proportions: A Simulation Study    

An Alternative Way of Estimating a Proportional- Odds Model with Complex Survey Data     
**CONCURRENT SESSION E-5      Concurrent Session E-5 Federal Statistics, Multiple Data Sources, and Privacy Protection: Next Steps**
Session Chair: Andrew Zukerberg (National Center for Education Statistics) E-5 Federal Statistics, Multiple Data Sources    
**CONCURRENT SESSION F-1      Question Evaluation and Cognitive      Interviewing**
Cognitive Interviewing Methodology in 2018: Current Trends and Recent Challenges     

Results of a Cognitive Interview Evaluation of the Revised Race Question, with Special Emphasis on the Newly Proposed Middle Eastern/North African Response Option     

Training Cognitive Testing Interviewers in Different Settings and Languages     

Survey Translation and the Place of Expert Review in the Question Evaluation Tool Kit: Development of Best Practices     

Recently Resettled Refugees and their Experience with the Annual Survey of Refugees – Findings from Cognitive and In-Depth Interviews     
**CONCURRENT SESSION F-2      Conducting Randomized Experiments in      Establishment Surveys**
Conducting Experiments in Establishment Surveys: Obstacles and Opportunities    

Obstacles in Planning Establishment Survey Experiments - Census of Agriculture Content Test and Agricultural Resource Management Survey    

Using Email to Solicit Response in an Establishment Survey    

Experimenting with Alternative Question Designs for “Other, Specify” Product Information in Establishment Surveys          
**CONCURRENT SESSION F-3      Extending Research through Access and      Application of Federal Data**
Researching the Psychology Workforce using Federal Statistics  

Examining the Principles of Open Government    
**CONCURRENT SESSION F-4      Improvements in Data Collection      Methodology**
Cost Effective Mail Survey Design    

Integration of Multiple Data Sources to Inform a Responsive Design    

Optimal Sample Size Allocation to Mixed Modes: A Case Study Using the Residential Energy Consumption Survey    

Design Issues for a Longitudinal Employer Health Insurance Survey to Facilitate Analysis of Policy Changes    
**PLENARY SESSION II****CONCURRENT SESSION F-5      Next Steps in Advancing the      Recommendations of the Commission on      Evidence-Based Policy Making****CONCURRENT SESSION G-1      Challenges and Solutions to Collecting      Information on Sexual Violence**
Improving the Measurement of Sexual Victimization Among Children through a Redesign of the National Survey of Children's Exposure to Violence     

Key Issues When Collecting and Publishing General Population Estimates of Rape and Sexual Assault     

Collecting Data on Rape and Sexual Assault in an Institutional Setting     
**CONCURRENT SESSION G-2      Innovations in Measuring and Reducing      Respondent Burden**
Assessing Respondents’ Perceptions of Burden in the American Community Survey     

Estimating Reporting Burden for Statistical        Surveys     

 Exploring Sampling Techniques to Reduce Respondent Burden    

Response Likelihood to an Establishment Survey with a Simple Questionnaire Following an Establishment Survey with a Complex Questionnaire    
**CONCURRENT SESSION G-3      Bayesian Methods for Surveys**
Bayesian Estimation Under Informative Sampling with Unattenuated Dependence       

Scalable Bayes Clustering for Outlier Detection Under Informative Sampling      Terrance Savitsky (Bureau of Labor Statistics)      

Some Exercises in Covariate Selection for a Bayesian Crop Yield Forecasting Model      

        Are We Under-Estimating Food Insecurity? Christian Gregory (Economic Research Service, USDA)      

Discussant: Nathan B. Cruze (USDA National Agricultural Statistics Service)      
**CONCURRENT SESSION G-4      Combining Different Levels of Data      Sources**
 Potential Uses of Individual-level Administrative Records Data in the 2012 Survey of Business Owners      

 Linking USGS Water Use Data to Detailed Industries for Environmental Input-Output Modeling of the U.S. Food System      

Incorporating OSHA Administrative Records in the Survey of Occupational Injuries and Illnesses      

Data Linkage with an Establishment Survey      
**CONCURRENT SESSION G-5**
 Marrying Demand for Statistical Information with Disclosure Control: The Canadian Experience in Developing an Automated Dissemination Tool in an Open-Data World      

 Disclosure Control and Random Tabular Adjustment      

A Note on Multiplicative Noise Perturbation for Privacy Protection      
**CONCURRENT SESSION H-1**
 Linking a Retail Gasoline Price Survey with Commercial Data      

Utility of Open Information Sources to Develop Estimates of Selected Crime and Justice Indicators: Measuring Arrest-Related Deaths      

Evaluation of Vendor School and Teacher Lists for the 2015-16 National Teacher and Principal Survey      
**CONCURRENT SESSION H-2      Innovative Uses of R in Federal Agencies**
FDA's Approach to R Shiny Standardized, Interactive Tools    

 R: Innovating at the Bureau of Labor Statistics    
**CONCURRENT SESSION H-3**
The Effect of the Conservation Reserve Program on Rural Economies: Deriving a Statistical Verdict from a Null Finding    

State-Level Design-Based Estimates for National Surveys    

 Multivariate Small Area Estimation Under Informative Sampling and Nonresponse    

 Semiparametric Panel Data Models Using Neural Networks    

Testing Significance Tests: A Simulation with Cliff’s Delta, t-tests, and Mann-Whitney U    

**CONCURRENT SESSION H-4      Administrative Records for Sampling      Efficiency**

Sampling with Administrative Records in the National Survey of Children's Health    

 The Use of Administrative Records and the American Community Survey to Study the Characteristics of Undercounted Young Children in the 2010 Census    

Logistic Regression with Linked Data    

A Method for Assigning Weight to Variable Matching in Record Linkage    

Application of Jaro-Winkler String Comparator in Enhancing Veterans Administrative Records    
**CONCURRENT SESSION I-1      Re-Engineering and Modernizing the 2017      Economic Census**
 An Overview of the Improved 2017 Economic Census    

 Executing a Multi–Year Multi–Method Electronic Data Collection Re–engineering: Experiences from 2017 Economic Census Development    

2017 Economic Census Contact Strategy: Using Data to Make Decisions    

 From Research to Implementation of Product Estimation in the 2017 Economic Census: Hard, Harder, and Hardest    

Discussant: I-1Safir2018 FCSMEconomicSurveyDiscussionSafir(004).pdf     
**CONCURRENT SESSION I-2      Techniques to Enhance      Criminal Justice and Immigration Statistics**
 Record Linkage of Bureau of Justice (BJS) Federal Criminal Case Processing Data     

Record Linkage Application in DHS USCIS Person Centric System    Damian Kostiuk (U.S. Citizenship and Immigration Services)    

Evaluation of Data Matching in Immigration Enforcement Outcome Tool    
**CONCURRENT SESSION I-3 New Advances in Applications of Geospatial Technology**
 Mapping Geographic and Temporal Variations in Select Mortality and Natality Outcomes with R-INLA in Small Areas    

 Crossing Boundaries: A Case Study on Building Accessible Tools to Combine Public-Use Data    

Evaluation of Two Different Interviewing Protocols to Test a Mobile Mapping Instrument for the June Area Survey    

 The Time Use Data-based Measures of the Wellbeing Effect of Community Development: An Evaluative Approach.    

Sidestepping the Box: Designing a Supplemental Poverty Indicator for School Neighborhoods     
**CONCURRENT SESSION I-4      Analyzing Nonresponse – New Research**
Correlates of Nonresponse in the 2012 and 2014 Medical Expenditure Panel Survey    

Subnational Geography and the Overseas U.S. Citizens Population    

 Investigation into Responses for the Occupational Requirements Survey    

 Understanding Their Apprehension: A Look into the Federal Employee Viewpoint Survey    

Discussant: John S. Dixon (Bureau Labor of Statistics)    
**CONCURRENT SESSION I-5      Advances in Evaluating Labor Force Statistics**
 Creating State Specific Occupational Replacement Rates    

 Employment Transitions in Washington State – An Examination of Job Flows Among Persons Employed in Growing and Declining Industries, 2014-2015    

 Discussant: Michael Wolf (Bureau of Labor Statistics)    
**CONCURRENT SESSION J-1      Progress in Measuring Income Statistics**
 Measuring Trends in the Distribution of Annual Earnings    

 What Does Consumer Heterogeneity Mean for Measuring Changes in the Cost of Living?    

 Discussant:       George Sheldon (U.S. Department of Veterans Affairs    
**CONCURRENT SESSION J-2      Forecasting Methods**
An Assessment of Crime Forecasting Models    

 Jointly Predicting U.S. Recessions and Restaurant Downturns: Integrated Models using the ERS Food Expenditure Series    

Clarifying the Confidence Levels of PPI and CPI Forecasts in the USDA’s Food Price Outlook    
**CONCURRENT SESSION J-3 Ensuring Data Quality and High Response Rates on Federally-Funded Establishment      Data Collections**
 Ensuring Optimal Response Rates on Agency Data Collections Over Time    

 Reasons for Late Response and Nonresponse in Surveys of Government Agencies    

Shifting Data Quality Follow-Up Methods for a Time-Series Collection of Local and State Agencies    
**CONCURRENT SESSION J-4**
 Collecting Electronic Health Record Data for the National Ambulatory Medical Care Survey and the National Hospital Care Survey    

National Health Interview Survey 2019 Content Redesign – Analytic Implications    

J4_Messel_2018FCSM.pdf    

 Balancing Cross-sectional and Longitudinal Design Objectives for the Survey of Doctorate Recipients    
BackReturn to top-  Accessibility 
-  FOIA 
-  Privacy Statement 
Related Federal Websites- Office of Management and Budget, Office of Information and Regulatory Affairs (OMB OIRA)
- Interagency Council on Statistical Policy (ICSP)
- National Science Foundation’s NSF Methodology, Measurement and Statistics (NSF MMS)
- Federal Data Strategy
-  OMB's Statistical Program's Standard
Related Non-Federal Websites- Council of Professional Associations on Federal Statistics (COPAFS)
- Committee on National Statistics (CNSTAT)
- Principles and Practices for a Federal Statistical Agency
- Joint Program in Survey Methodology (JPSM)
- American Statistical Association (ASA)
- American Association for Public Opinion Research (AAPOR)
- Population Association of America (PAA)
- American Economic Association (aeaweb.org)
- Conference on Research in Income and Wealth | NBER
- International Union for the Scientific Study of Population
- Association of Public Data Users
- Washington Statistical Society
General Services AdministrationOffice of Management and BudgetContact Us:
mark.prell@usda.gov

*Last updated on April 03, 2024*

fcsm.gov

            An official website of the General Services Administration
-  About GSAAccessibility supportFOIA requestsNo FEAR Act dataOffice of the Inspector GeneralPerformance reportsPrivacy policy          Looking for U.S. government information and services?        Visit USA.gov