DOI: 10.7910/dvn/frmkmf
title: Survey of Consumer Finances (SCF)

description: &lt;h3 class="post-title entry-title" itemprop="name"&gt; analyze the survey of consumer finances (scf) with r &lt;/h3&gt; the survey of consumer finances (scf) tracks the wealth of american families. every three years, more than five thousand households answer a battery of questions about income, net worth, credit card debt, pensions, mortgages, even the lease on their cars. plenty of surveys collect annual income, only the survey of consumer finances captures such detailed asset data. responses are at
the primary economic unit-level (peu) - the economically dominant, financially interdependent family members within a sampled household.
&lt;a href="http://www.norc.uchicago.edu/"&gt;norc at the university of chicago&lt;/a&gt; administers the data collection, but &lt;a href="http://www.federalreserve.gov/default.htm"&gt;the board of governors of the federal reserve&lt;/a&gt; pay the bills and therefore call the shots.&lt;br /&gt; &lt;br /&gt; if you were so brazen as to open up the microdata and run a simple weighted median, you'd get the wrong answer. the five to six thousand respondents actually gobble up twenty-five to thirty thousand records in the final pub
lic use files. why oh why? well, those tables contain not one, not two, but five records for each peu. wherever missing,
&lt;a href="http://www.federalreserve.gov/econresdata/scf/files/impute98.pdf"&gt;these data are multiply-imputed&lt;/a&gt;, meaning answers to the same question for the same household might vary across implicates. each analysis must account for all that, lest your &lt;a href="http://www.federalreserve.gov/econresdata/scf/scf_faqs.htm#q7"&gt;confidence intervals be too tight&lt;/a&gt;. to calculate the correct statistics, you'll need to break the single file into five, necessarily complicating your life. this can be
accomplished with the `meanit` sas macro buried in &lt;a href="http://www.federalreserve.gov/econresdata/scf/files/codebk2004.txt"&gt;the 2004 scf codebook&lt;/a&gt; (search for `meanit` - you'll need &lt;a href="http://support.sas.com/rnd/app/da/iml.html"&gt;the sas iml add-on&lt;/a&gt;). or you might blow the dust off &lt;a href="http://hec.osu.edu/people/shanna/imput.htm"&gt;this website&lt;/a&gt; referred to in &lt;a href="http://www.federalreserve.gov/econresdata/scf/files/codebk2010.txt"&gt;the 2010 codebook&lt;/a&gt; as the home of an
alternative multiple imputation technique, but all i found were broken links. perhaps it's time for plan c, and by c, i mean free. read the imputation section of
&lt;a href="http://www.federalreserve.gov/econresdata/scf/files/codebk2010.txt"&gt;the latest codebook&lt;/a&gt; (search for `imputation`), then give these scripts a whirl. they've got that new r smell.&lt;br /&gt; &lt;br /&gt; the lion's share of the respondents in the survey of consumer finances get drawn from a pretty standard sample of american dwellings - no nursing homes, no active-duty military. then there's this secondary sample of richer households to even out the statistical noise at the higher end of the i
ncome and assets spectrum. &lt;a href="http://www.federalreserve.gov/econresdata/scf/files/panelwgtdoc.txt"&gt;you can read more if you like&lt;/a&gt;, but at the end of the day the weights just generalize to civilian, non-institutional american households. one last thing before you start your engine: read &lt;a href="http://legacy.ehe.osu.edu/cs/scf/cmacci98.htm"&gt;everything you always wanted to know about the scf&lt;/a&gt;. my favorite part of that title is the word always. this new github repository contains t
hree scripts:&lt;br /&gt; &lt;br /&gt; &lt;br /&gt; &lt;b&gt;1989-2010 download all microdata.R&lt;/b&gt;&lt;br /&gt; &lt;ul&gt; &lt;li&gt;initiate a function to download and import any survey of consumer finances zipped stata file (.dta)&lt;/li&gt; &lt;li&gt;loop through each year specified by the user (starting at &lt;a href="http://www.federalreserve.gov/econresdata/scf/scf_1989.htm"&gt;the 1989 re-vamp&lt;/a&gt;) to download the main, &lt;a href="http://www.federalreserve.gov/econresdata/scf/scf_2010survey.htm#STATADATEX"&gt;extract&lt;/a&gt;, and &lt;a href="http://www.federa
lreserve.gov/econresdata/scf/scf_2010weight.htm"&gt;replicate weight
&lt;/a&gt; files, then &lt;a href="http://www.screenr.com/5gH8"&gt;import each into r&lt;/a&gt;&lt;/li&gt; &lt;li&gt;break the main file into five implicates (each containing one record per peu) and merge the appropriate extract data onto each implicate&lt;/li&gt; &lt;li&gt;save the five implicates and replicate weights to an &lt;a href="http://stat.ethz.ch/R-manual/R-patched/library/base/html/save.html"&gt;r data file&lt;/a&gt; (.rda) for rapid future loading&lt;/li&gt; &lt;/ul&gt; &lt;br /&gt; &lt;b&gt;2010 analysis examples.R&lt;/b&gt;&lt;br /&gt; &lt;ul&gt; &lt;li&gt;prepare two &lt;a href="htt
ps://github.com/ajdamico/usgsd/blob/master/Survey%20of%20Consumer%20Finances/scf.survey.R"&gt;survey of consumer finances-flavored
&lt;/a&gt; multiply-imputed survey analysis functions&lt;/li&gt; &lt;li&gt;load the &lt;a href="http://stat.ethz.ch/R-manual/R-devel/library/base/html/load.html"&gt;r data files&lt;/a&gt; (.rda) necessary to create a &lt;a href="http://faculty.washington.edu/tlumley/survey/svymi.html"&gt;multiply-imputed&lt;/a&gt;, &lt;a href="http://faculty.washington.edu/tlumley/survey/html/svrepdesign.html"&gt;replicate-weighted&lt;/a&gt; survey design&lt;/li&gt; &lt;li&gt;demonstrate &lt;a href="http://www.screenr.com/2Cs8"&gt;how to access the properties&lt;/a&gt; of a multiply-imput
ed survey design object &lt;/li&gt; &lt;li&gt;cook up some descriptive statistics and export examples, calculated with scf-centric variance quirks&lt;/li&gt; &lt;li&gt;run a quick t-test and regression, but only because you asked nicely&lt;/li&gt; &lt;/ul&gt; &lt;br /&gt; &lt;b&gt;replicate FRB SAS output.R&lt;/b&gt;&lt;br /&gt; &lt;ul&gt; &lt;li&gt;reproduce &lt;a href="https://github.com/ajdamico/usgsd/blob/master/Survey%20of%20Consumer%20Finances/SCF%20PUF%20Net%20Worth%20Statistics%20and%20Standard%20Errors%20from%20FRB.pdf?raw=true"&gt;each and every statistic&lt;/a&gt; pr
ovided by the friendly folks at the federal reserve&lt;/li&gt; &lt;li&gt;create a &lt;a href="http://faculty.washington.edu/tlumley/survey/svymi.html"&gt;multiply-imputed&lt;/a&gt;, &lt;a href="http://faculty.washington.edu/tlumley/survey/html/svrepdesign.html"&gt;replicate-weighted&lt;/a&gt; survey design object&lt;/li&gt; &lt;li&gt;re-reproduce (and yes, i said/meant what i meant/said) each of those statistics, now using the multiply-imputed &lt;a href="http://faculty.washington.edu/tlumley/survey/html/svrepdesign.html"&gt;survey design object&lt;/a
&gt; to highlight the statistically-theoretically-irrelevant differences
&lt;/li&gt; &lt;/ul&gt; &lt;br /&gt; &lt;br /&gt; &lt;br /&gt; &lt;a href="https://github.com/ajdamico/usgsd/tree/master/Survey%20of%20Consumer%20Finances"&gt;click here to view these three scripts&lt;/a&gt;&lt;br /&gt; &lt;br /&gt; &lt;br /&gt; &lt;br /&gt; for more detail about the survey of consumer finances (scf), visit:&lt;br /&gt; &lt;br /&gt; &lt;ul&gt; &lt;li&gt;the federal reserve board of governors' &lt;a href="http://www.federalreserve.gov/econresdata/scf/scfindex.htm"&gt;survey of consumer finances homepage &lt;/a&gt;&lt;/li&gt; &lt;li&gt;&lt;a href="http://www.federalreserve.gov/econresdata/scf/fi
les/2010_SCF_Chartbook.pdf"&gt;the latest scf chartbook&lt;/a&gt;, to browse what's possible. (spoiler alert: everything.)&lt;/li&gt; &lt;li&gt;the survey of consumer finances &lt;a href="http://en.wikipedia.org/wiki/Survey_of_Consumer_Finances"&gt;wikipedia entry&lt;/a&gt;&lt;/li&gt; &lt;li&gt;the official &lt;a href="http://www.federalreserve.gov/econresdata/scf/scf_faqs.htm"&gt;frequently asked questions&lt;/a&gt;&lt;/li&gt; &lt;/ul&gt; &lt;br /&gt; notes:&lt;br /&gt; &lt;br /&gt; nationally-representative statistics on the financial health, wealth, and assets of american hous
eholds might not be monopolized by the survey of consumer finances, but there isn't much competition aside from
&lt;a href="http://www.census.gov/sipp/top_mod/2008/quests/2008w4tm.pdf"&gt;the assets topical module&lt;/a&gt; of the &lt;a href="http://www.census.gov/sipp/"&gt;survey of income and program participation (sipp)&lt;/a&gt;. on one hand, the scf &lt;a href="http://www.federalreserve.gov/econresdata/scf/files/2010_scfoutline.pdf"&gt;interview questions&lt;/a&gt; contain more detail than sipp. on the other hand, scf's smaller sample precludes analyses of acute subpopulations. and for any three-handed martians in the audience, ther
e's also &lt;a href="http://lmgtfy.com/?q=scf+sipp+asset"&gt;a few biases&lt;/a&gt; between these two data sources that you ought to consider.&lt;br /&gt; &lt;br /&gt; the survey methodologists at the federal reserve take their job seriously, as evidenced by &lt;a href="http://www.federalreserve.gov/econresdata/scf/scf_workingpapers.htm"&gt;this working paper trail&lt;/a&gt;. write a thank-you in their &lt;a href="http://www.federalreserve.gov/forms/scf_guestbook.aspx"&gt;guestbook&lt;/a&gt;. one can never receive enough of those.&lt;br /&gt; &lt;br
/&gt; &lt;br /&gt; confidential to sas, spss, stata, and sudaan users: the eighties called. they want their statistical languages back. time to transition to r. :D