Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2020 Mar 11;13(1):111-121.
doi: 10.1093/phe/phaa006. eCollection 2020 Apr.

Scraping the Web for Public Health Gains: Ethical Considerations from a 'Big Data' Research Project on HIV and Incarceration

Stuart Rennie  1 , Mara Buchbinder  1 , Eric Juengst  1 , Lauren Brinkley-Rubinstein  2 , Colleen Blue  3 , David L Rosen  3
Affiliations

Scraping the Web for Public Health Gains: Ethical Considerations from a 'Big Data' Research Project on HIV and Incarceration

Stuart Rennie et al. Public Health Ethics. .

Erratum in

Abstract

Web scraping involves using computer programs for automated extraction and organization of data from the Web for the purpose of further data analysis and use. It is frequently used by commercial companies, but also has become a valuable tool in epidemiological research and public health planning. In this paper, we explore ethical issues in a project that "scrapes" public websites of U.S. county jails as part of an effort to develop a comprehensive database (including individual-level jail incarcerations, court records and confidential HIV records) to enhance HIV surveillance and improve continuity of care for incarcerated populations. We argue that the well-known framework of Emanuel et al. (2000) provides only partial ethical guidance for the activities we describe, which lie at a complex intersection of public health research and public health practice. We suggest some ethical considerations from the ethics of public health practice to help fill gaps in this relatively unexplored area.

PubMed Disclaimer

References

    1. Ballantyne A. (2019). Adjusting the Focus: A Public Health Ethics Approach to Data Research. Bioethics, 33, 357–366. - PubMed
    1. Barocas S., Nissenbaum H. (2014). Big Data’s End Run around Anonymity and Consent In Lane J., Stodden V., Bender S., Nissenbaum H. (eds), Privacy, Big Data, and the Public Good. Cambridge: Cambridge University Press, pp. 44–75.
    1. Centers for Disease Control and Prevention (2018). Understanding the HIV Care Continuum, available from: https://www.cdc.gov/hiv/pdf/library/factsheets/cdc-hiv-care-continuum.pdf [accessed 20 February 2020].
    1. Centers for Disease Control and Prevention (n.d.). Data to Care, available from: https://www.cdc.gov/hiv/effective-interventions/respond/data-to-care/ind... [accessed 20 February 2020].
    1. Childress J. F., Faden R. R., Gaare R. D., Gostin L. O., Kahn J., Bonnie R. J., Kass N. E., Mastroianni A. C., Moreno J. D., Nieburg P. (2002). Public Health Ethics: mapping the Terrain. The Journal of Law, Medicine & Ethics : a Journal of the American Society of Law, Medicine & Ethics, 30, 170–178. - PubMed