When Excessive Perturbation Goes Wrong and Why IPUMS-International Relies Instead on Sampling, Suppression, Swapping, and Other Minimally Harmful Methods to Protect Privacy of Census Microdata
- PMID: 28393150
- PMCID: PMC5382996
- DOI: 10.1007/978-3-642-33627-0_14
When Excessive Perturbation Goes Wrong and Why IPUMS-International Relies Instead on Sampling, Suppression, Swapping, and Other Minimally Harmful Methods to Protect Privacy of Census Microdata
Abstract
IPUMS-International disseminates population census microdata at no cost for 69 countries. Currently, a series of 212 samples totaling almost a half billion person records are available to researchers. Registration is required for researchers to gain access to the microdata. Statistics from Google Analytics show that IPUMS-International's lengthy, probing registration form is an effective deterrent for unqualified applicants. To protect data privacy, we rely principally on sampling, suppression of geographic detail, swapping of records across geographic boundaries, and other minimally harmful methods such as top and bottom coding. We do not use excessively perturbative methods. A recent case of perturbation gone wrong- the household samples of the 2000 census of the USA (PUMS), the 2003-2006 American Community Survey, and the 2004-2009 Current Population Survey-, an empirical study of the impact of perturbation on the usability of UK census microdata-the Individual SARs of the 1991 census of the UK-, and a mathematical demonstration in a timely compendium of statistical confidentiality practices confirm the wisdom of IPUMS microdata management protocols and statistical disclosure controls.
Keywords: IPUMS-International; data dissemination; data privacy; microdata samples; population census; statistical disclosure controls.
Figures
References
-
- McCaa R, Ruggles S, Davern M, Swenson T, Mohan Palipudi K. IPUMS-International High Precision Population Census Microdata Samples: Balancing the Privacy-Quality Tradeoff by Means of Restricted Access Extracts. In: Domingo-Ferrer J, Franconi L, editors. Privacy in Statistical Databases. PSD2006 Proceedings, LNCS 4302. Berlin: Springer-Verlag; 2006. pp. 375–382. - PMC - PubMed
-
- McCaa R, Ruggles S, Sobek M. IPUMS-International Statistical Disclosure Controls: 159 Census Microdata Samples In Dissemination, 100+ In Preparation. In: Domingo-Ferrer J, Magkos E, editors. Privacy in Statistical Databases. PSD2010 Proceedings, LNCS 6344. Heidelberg: Springer; 2010. pp. 74–84. - PMC - PubMed
-
- United Nations Economic Commission for Europe. Managing Statistical Confidentiality & Microdata Access: Principles and Guidelines of Good Practice. Geneva: United Nations; 2007. Conference of European Statisticians. See online edition Annex 1.23: http://www.unece.org/fileadmin/DAM/stats/publications/Managing.statistic....
-
- Reiter JP. Statistical Approaches to Protecting Confidentiality for Microdata and Their Effects on the Quality of Statistical Inferences. Public Opinion Quarterly. 2012;76(1):163–181.
-
- Duncan GT, Elliot M, Salazar-González J-J. Statistical Confidentiality: Principles and Practice. Heidelberg: Springer; 2011.
Grants and funding
LinkOut - more resources
Full Text Sources
Miscellaneous