Certify reproducibility with confidential data

12 July 2019 Vol 365, Issue 6449


Policy Forum
Certify reproducibility with confidential data
By Christophe Pérignon, Kamel Gadouche, Christophe Hurlin, Roxane Silberman, Eric Debonnel
Science12 Jul 2019 : 127-128 Restricted Access
A trusted third party certifies that results reproduce
Many government data, such as sensitive information on individuals’ taxes, income, employment, or health, are available only to accredited users within a secure computing environment. Though they can be cumbersome to access, such microdata can allow researchers to pursue questions that could not be addressed with only public data (1). However, researchers using confidential data are inexorably challenged with regard to research reproducibility (2). Empirical results cannot be easily reproduced by peers and journal referees, as access to the underpinning data are restricted. We describe an approach that allows researchers who analyze confidential data to signal the reproducibility of their research. It relies on a certification process conducted by a specialized agency accredited by the confidential-data producers and which can guarantee that the code and the data used by a researcher indeed produce the results reported in a scientific paper.