Guidelines for reinforcement learning in healthcare

Omer Gottesman^#¹, Fredrik Johansson^#², Matthieu Komorowski^{3

4}, Aldo Faisal^{5

6

7

8}, David Sontag², Finale Doshi-Velez¹, Leo Anthony Celi^{9

10

11}

Affiliations

¹ Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA.
² Institute for Medical Engineering and Science, MIT, Cambridge, MA, USA.
³ Laboratory for Computational Physiology, Harvard-MIT Health Sciences & Technology, MIT, Cambridge, MA, USA.
⁴ Department of Surgery and Cancer, Faculty of Medicine, Imperial College London, London, UK.
⁵ Department of Bioengineering, Imperial College London, London, UK.
⁶ Department of Computing, Imperial College London, London, UK.
⁷ Data Science Institute, London, UK.
⁸ MRC London Institute of Clinical Sciences, London, UK.
⁹ Laboratory for Computational Physiology, Harvard-MIT Health Sciences & Technology, MIT, Cambridge, MA, USA. lceli@mit.edu.
¹⁰ Division of Pulmonary, Critical Care and Sleep Medicine, Beth Israel Deaconess Medical Center, Boston, MA, USA. lceli@mit.edu.
¹¹ MIT Critical Data, Cambridge, MA, USA. lceli@mit.edu.

^# Contributed equally.

Free article

Omer Gottesman et al. Nat Med. 2019 Jan.

Free article

. 2019 Jan;25(1):16-18.

doi: 10.1038/s41591-018-0310-5.

Omer Gottesman^#¹, Fredrik Johansson^#², Matthieu Komorowski^{3

4}, Aldo Faisal^{5

6

7

8}, David Sontag², Finale Doshi-Velez¹, Leo Anthony Celi^{9

10

11}

¹ Paulson School of Engineering and Applied Sciences, Harvard University, Cambridge, MA, USA.
² Institute for Medical Engineering and Science, MIT, Cambridge, MA, USA.
³ Laboratory for Computational Physiology, Harvard-MIT Health Sciences & Technology, MIT, Cambridge, MA, USA.
⁴ Department of Surgery and Cancer, Faculty of Medicine, Imperial College London, London, UK.
⁵ Department of Bioengineering, Imperial College London, London, UK.
⁶ Department of Computing, Imperial College London, London, UK.
⁷ Data Science Institute, London, UK.
⁸ MRC London Institute of Clinical Sciences, London, UK.
⁹ Laboratory for Computational Physiology, Harvard-MIT Health Sciences & Technology, MIT, Cambridge, MA, USA. lceli@mit.edu.
¹⁰ Division of Pulmonary, Critical Care and Sleep Medicine, Beth Israel Deaconess Medical Center, Boston, MA, USA. lceli@mit.edu.
¹¹ MIT Critical Data, Cambridge, MA, USA. lceli@mit.edu.

^# Contributed equally.

No abstract available

References

1. Obermeyer, Z. & Emanuel, E. J. N. Engl. J. Med. 375, 1216 (2016). - DOI
1. Parbhoo, S., Bogojeska, J., Zazzi, M., Roth, V. & Doshi-Velez, F. AMIA Summits on Translational Science Proceedings 2017, 239 (2017). - PMC
1. Guez, A., Vincent, R. D., Avoli, M. & Pineau, J. Treatment of epilepsy via batch-mode reinforcement learning. In Proceedings of the Twenty-Third AAAI Conference on Artificial Intelligence 1671–1678 (AAAI, 2008).
1. Komorowski, M., Celi, L. A., Badawi, O., Gordon, A. & Faisal, A. Nat. Med. 24, 1716–1720 (2018).
1. Chakraborty, B., Moodie, E. & Erica, E. M. Statistical Methods for Dynamic Treatment Regimes (Springer, New York, 2013).