Data Editing in Federal Statistical Agencies.

U.S. federal statistical agencies continually face challenges in obtaining and using administrative records and in providing useful analytic products to support policy analysis and program planning. At each of three decision points—obtaining the administrative data, integrating the data into statistical programs, and releasing useful data products—concerns over privacy and confidentiality determine to a great extent how effectively these data are used. Although there is a long history of relevant research on privacy attitudes and methodologies to protect conconfidentiality in published data, agency decisions to share or publish data are not necessarily informed by known risks. Additional research is proposed to help identify and manage these risks. The paper also proposes government actions to ensure that U.S. federal statistical agencies are meeting the nation's data needs through the appropriate application of survey and administrative data.

Download Full-text

Federal Statistical Confidentiality and Business Data: Twentieth Century Challenges and Continuing Issues

Journal of Privacy and Confidentiality ◽

10.29012/jpc.v1i1.563 ◽

2009 ◽

Vol 1 (1) ◽

Cited By ~ 3

Author(s):

Margo J. Anderson ◽

William Seltzer

Keyword(s):

Executive Branch ◽

Business Community ◽

Modern Concept ◽

Late Nineteenth Century ◽

Statistical System ◽

The Us ◽

Federal Statistical ◽

History Of ◽

Statistical Agencies ◽

Business Data

The roots of the modern concept of statistical confidentiality in the US federal statistical system can be traced directly back to the late nineteenth century efforts of statisticians to ensure full and accurate responses by businesses to statistical inquiries. Officials argued that such confidentiality guarantees were needed to ensure that the providers of enterprise and establishment data could be confident that the statistical agencies could not be forced to share their responses with others, such as regulatory or tax authorities, congressional investigators, prying journalists, and competitors, who might use this information to the detriment of the data provider. Nevertheless, over the years, the principle of statistical confidentiality with respect to information provided by businesses in statistical inquiries has been repeatedly challenged by other executive branch departments, independent regulatory agencies, the courts, Congress, and members of the public, with quite varied results. The paper uses the published record and archival research to examine the history of challenges to statistical confidentiality, and the responses of the statistical agencies, the federal statistical system as a whole, including the office of the chief statistician in OMB (and its predecessors), executive department and independent non-statistical agencies, the courts, and Congress as well as representatives of the business community. Long-term trends and the implications for maintaining and strengthening the confidentiality protections for establishment- and enterprise-level business data provided to federal agencies for statistical purposes are discussed.

Download Full-text