This is a preprint.

It has not yet been peer reviewed by a journal.

The National Library of Medicine is running a pilot to include preprints that result from research funded by NIH in PMC and PubMed.

[Preprint]. 2023 Apr 7:2023.01.16.524331.

doi: 10.1101/2023.01.16.524331.

Bridging Big Data: Procedures for Combining Non-equivalent Cognitive Measures from the ENIGMA Consortium

Eamonn Kennedy^{1

2

3}, Shashank Vadlamani¹, Hannah M Lindsey^{1

3}, Pui-Wa Lei⁴, Mary Jo-Pugh^{1

2}, Maheen Adamson^{5

6}, Martin Alda⁷, Silvia Alonso-Lana^{8

9}, Sonia Ambrogi¹⁰, Tim J Anderson^{11

12

13}, Celso Arango¹⁴, Robert F Asarnow^{15

16

17}, Mihai Avram¹⁸, Rosa Ayesa-Arriola^{9

19}, Talin Babikian^{15

20}, Nerisa Banaj¹⁰, Laura J Bird²¹, Stefan Borgwardt^{18

22}, Amy Brodtmann^{23

24}, Katharina Brosch²⁵, Karen Caeyenberghs²⁶, Vince D Calhoun²⁷, Nancy D Chiaravalloti^{28

29}, David X Cifu³⁰, Benedicto Crespo-Facorro^{9

31}, John C Dalrymple-Alford^{11

12

32}, Kristen Dams-O'Connor^{33

34}, Udo Dannlowski³⁵, David Darby^{36

37

38}, Nicholas Davenport^{39

40}, John DeLuca^{29

41}, Covadonga M Diaz-Caneja¹⁴, Seth G Disner^{39

40}, Ekaterina Dobryakova^{29

42}, Stefan Ehrlich^{43

44}, Carrie Esopenko³³, Fabio Ferrarelli⁴⁵, Lea E Frank⁴⁶, Carol Franz^{47

48}, Paola Fuentes-Claramonte^{8

9}, Helen Genova^{29

49}, Christopher C Giza^{20

50

51}, Janik Goltermann³⁵, Dominik Grotegerd³⁵, Marius Gruber^{35

52}, Alfonso Gutierrez-Zotes^{9

53

54}, Minji Ha⁵⁵, Jan Haavik^{56

57}, Charles Hinkin¹⁵, Kristen R Hoskinson^{58

59}, Daniela Hubl⁶⁰, Andrei Irimia^{61

62

63}, Andreas Jansen²⁵, Michael Kaess^{64

65}, Xiaojian Kang⁵, Kimbra Kenney^{66

67}, Barbora Keřková^{1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

32

33

34

35

36

37

38

39

40

41

42

43

44

45

46

47

48

49

50

51

52

53

54

55

56

57

58

59

60

61

62

63

64

65

66

67

68

69

70

71

72

73

74

75

76

77

78

79

80

81

82

83

84

85

86

87

88

89

90

91

92

93

94

95

96

97

98

99

100

101

102

103

104

105

106

107

108

109

110

111

112

113

114

115

116}, Mohamed Salah Khlif²³, Minah Kim^{68

69}, Jochen Kindler⁶⁴, Tilo Kircher²⁵, Karolina Knížková^{70

71}, Knut K Kolskår^{72

73

74}, Denise Krch^{29

42}, William S Kremen^{47

48}, Taylor Kuhn¹⁵, Veena Kumari⁷⁵, Jun Soo Kwon^{55

68

69}, Roberto Langella¹⁰, Sarah Laskowitz⁷⁶, Jungha Lee⁵⁵, Jean Lengenfelder^{29

42}, Spencer W Liebel^{1

3}, Victoria Liou-Johnson⁵, Sara M Lippa^{67

77}, Marianne Løvstad^{73

74}, Astri Lundervold⁷⁸, Cassandra Marotta^{36

37}, Craig A Marquardt^{39

40}, Paulo Mattos⁷⁹, Ahmad Mayeli⁴⁵, Carrie R McDonald^{80

81}, Susanne Meinert^{35

82}, Tracy R Melzer^{11

12

32}, Jessica Merchán-Naranjo¹⁴, Chantal Michel⁶⁴, Rajendra A Morey^{76

83}, Benson Mwangi⁸⁴, Daniel J Myall¹², Igor Nenadić²⁵, Mary R Newsome^{85

86}, Abraham Nunes^{7

87}, Terence O'Brien^{88

89}, Viola Oertel⁹⁰, John Ollinger⁶⁷, Alexander Olsen^{91

92

93}, Victor Ortiz García de la Foz¹⁹, Mustafa Ozmen⁹⁴, Heath Pardoe³⁸, Marise Parent⁹⁵, Fabrizio Piras¹⁰, Federica Piras¹⁰, Edith Pomarol-Clotet⁹, Jonathan Repple^{35

52}, Geneviève Richard⁷², Jonathan Rodriguez⁴⁷, Mabel Rodriguez⁷⁰, Kelly Rootes-Murdy²⁷, Jared Rowland^{96

97

98}, Nicholas P Ryan^{26

99}, Raymond Salvador⁹, Anne-Marthe Sanders^{72

73

74}, Andre Schmidt¹⁰⁰, Jair C Soares⁸⁴, Gianfranco Spalleta¹⁰, Filip Španiel^{70

101}, Alena Stasenko^{47

81}, Frederike Stein²⁵, Benjamin Straube²⁵, April Thames¹⁵, Florian Thomas-Odenthal²⁵, Sophia I Thomopoulos¹⁰², Erin Tone¹⁰³, Ivan Torres^{104

105}, Maya Troyanskaya^{85

86}, Jessica A Turner¹⁰⁶, Kristine M Ulrichsen^{72

73

74}, Guillermo Umpierrez¹⁰⁷, Elisabet Vilella^{9

53

54}, Lucy Vivash^{36

37}, William C Walker^{108

109}, Emilio Werden³⁸, Lars T Westlye^{72

73

110}, Krista Wild¹¹¹, Adrian Wroblewski²⁵, Mon-Ju Wu⁸⁴, Glenn R Wylie^{29

112}, Lakshmi N Yatham¹⁰⁴, Giovana B Zunta-Soares⁸⁴, Paul M Thompson^{102

113}, David F Tate^{1

3}, Frank G Hillary^{114

115

116}, Emily L Dennis^{1

3}, Elisabeth A Wilde^{1

3}

Affiliations

¹ Department of Neurology, University of Utah School of Medicine, Salt Lake City, UT, 84132.
² Division of Epidemiology, University of Utah, Salt Lake City, UT, 84132.
³ George E. Wahlen Veterans Affairs Medical Center, Salt Lake City, UT, 84132.
⁴ Department of Educational Psychology, Counseling, and Special Education, Pennsylvania State University, University Park, PA, 16801.
⁵ WRIISC-WOMEN & Rehabilitation Department, VA Palo Alto, Palo Alto, CA, USA.
⁶ Neurosurgery, Stanford School of Medicine, Stanford, CA, USA.
⁷ Department of Psychiatry, Dalhousie University, Halifax, Canada.
⁸ FIDMAG Research Foundation, Barcelona, Spain.
⁹ Centro Investigación Biomédica en Red Salud Mental (CIBERSAM), Madrid, Spain.
¹⁰ Laboratory of Neuropsychiatry, Santa Lucia Foundation IRCCS, Rome, Italy.
¹¹ Department of Medicine, University of Otago, Christchurch, New Zealand.
¹² New Zealand Brain Research Institute, Christchurch, New Zealand.
¹³ Department of Neurology, Te Whatu Ora - Health New Zealand Waitaha Canterbury, Christchurch, New Zealand.
¹⁴ Department of Child and Adolescent Psychiatry, Institute of Psychiatry and Mental Health, Hospital General Universitario Gregorio Marañón, IiSGM, CIBERSAM, School of Medicine, Universidad Complutense, Madrid, Spain.
¹⁵ Department of Psychiatry and Biobehavioral Sciences, Semel Institute for Neuroscience and Human Behavior, UCLA, Los Angeles, CA, USA.
¹⁶ Brain Research Institute, UCLA, Los Angeles, CA, USA.
¹⁷ Department of Psychology, UCLA, Los Angeles, CA, USA.
¹⁸ Translational Psychiatry, Department of Psychiatry and Psychotherapy, University of Lübeck, Lübeck, Germany.
¹⁹ Department of Psychiatry, Marqués de Valdecilla University Hospital, IDIVAL, School of Medicine, University of Cantabria, Santander, Spain.
²⁰ UCLA Steve Tisch BrainSPORT Program, Los Angeles, CA, USA.
²¹ Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Clayton, Melbourne, VIC, Australia.
²² Center of Brain, Behaviour and Metabolism (CBBM), University of Lübeck, Lübeck, Germany.
²³ Cognitive Health Initiative, Central Clinical School, Monash University, Melbourne, VIC, Australia.
²⁴ Department of Medicine, Royal Melbourne Hospital, Melbourne, VIC, Australia.
²⁵ Department of Psychiatry and Psychotherapy, University of Marburg, Marburg, Germany.
²⁶ Cognitive Neuroscience Unit, School of Psychology, Deakin University, Geelong, Australia.
²⁷ Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, and Emory University University, Atlanta, GA, USA.
²⁸ Centers for Neuropsychology, Neuroscience & Traumatic Brain Injury Research, Kessler Foundation, East Hanover, NJ, USA.
²⁹ Department of Physical Medicine & Rehabilitation, Rutgers, New Jersey Medical School, Newark, NJ, USA.
³⁰ Rehabilitation Medicine Department, National Institutes of Health Clinical Center, Bethesda, MD.
³¹ Department of Psychiatry, Virgen del Rocio University Hospital, School of Medicine, University of Seville, IBIS, Seville, Spain.
³² School of Psychology, Speech and Hearing, University of Canterbury, Christchurch, New Zealand.
³³ Department of Rehabilitation and Human Performance, Icahn School of Medicine at Mount Sinai, New York, NY.
³⁴ Department of Neurology, Icahn School of Medicine at Mount Sinai, New York, NY.
³⁵ Institute for Translational Psychiatry, University of Münster, Germany.
³⁶ Department of Neuroscience, Monash University, Melbourne, Australia.
³⁷ Department of Neurology, Alfred Health, Melbourne, Australia.
³⁸ The Florey Institute of Neuroscience and Mental Health, Melbourne, Australia.
³⁹ Department of Psychiatry and Behavioral Sciences, University of Minnesota Medical School, Minneapolis, MN.
⁴⁰ Minneapolis VA Health Care System, Minneapolis, MN.
⁴¹ Kessler Foundation, East Hanover, NJ, USA.
⁴² Center for Traumatic Brain Injury, Kessler Foundation, East Hanover, NJ.
⁴³ Translational Developmental Neuroscience Section, Division of Psychological and Social Medicine and Developmental Neurosciences, Faculty of Medicine, TU Dresden, Germany.
⁴⁴ Eating Disorders Research and Treatment Center, Department of Child and Adolescent Psychiatry, Faculty of Medicine, TU Dresden, Germany.
⁴⁵ Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA, USA.
⁴⁶ Department of Psychology, University of Oregon, Eugene, OR, USA.
⁴⁷ Department of Psychiatry, University of California, San Diego, La Jolla, CA, USA.
⁴⁸ Center for Behavior Genetics of Aging, University of California, San Diego, La Jolla, CA, USA.
⁴⁹ Center for Autism Research, Kessler Foundation, East Hanover, NJ, USA.
⁵⁰ Department of Pediatrics, Division of Neurology, UCLA Mattel Children's Hospital, Los Angeles, CA, USA.
⁵¹ Department of Neurosurgery, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA.
⁵² Department of Psychiatry, Psychosomatic Medicine and Psychotherapy, University Hospital Frankfurt, Goethe University, Frankfurt, Germany.
⁵³ Hospital Universitari Institut Pere Mata, Tarragona, Spain.
⁵⁴ Institut d'Investiació Sanitària Pere Virgili-CERCA, Universitat Rovira i Virgili, Tarragona, Spain.
⁵⁵ Department of Brain and Cognitive Sciences, Seoul National University College of Natural Sciences, Seoul, South Korea.
⁵⁶ Department of Biomedicine, University of Bergen, Bergen, Norway.
⁵⁷ Division of Psychiatry, Haukeland University Hospital, Bergen, Norway.
⁵⁸ Center for Biobehavioral Health, The Abigail Wexner Research Institute at Nationwide Children's Hospital, Columbus, OH.
⁵⁹ Section of Pediatrics, The Ohio State University College of Medicine, Columbus, Ohio, USA.
⁶⁰ Translational Research Centre, University Hospital of Psychiatry and Psychotherapy, University of Bern, Bern, Switzerland.
⁶¹ Ethel Percy Andrus Gerontology Center, Leonard Davis School of Gerontology, University of Southern California, Los Angeles, CA, USA.
⁶² Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, USA.
⁶³ Department of Quantitative & Computational Biology, Dornsife College of Arts & Sciences, University of Southern California, Los Angeles CA, USA.
⁶⁴ University Hospital of Child and Adolescent Psychiatry and Psychotherapy, University of Bern, Bern, Switzerland.
⁶⁵ Clinic of Child and Adolescent Psychiatry, Centre of Psychosocial Medicine, University of Heidelberg, Heidelberg, Germany.
⁶⁶ Department of Neurology, Uniformed Services University, Bethesda, MD.
⁶⁷ National Intrepid Center of Excellence, Walter Reed National Military Medical Center, Bethesda, MD.
⁶⁸ Department of Neuropsychiatry, Seoul National University Hospital, Seoul, South Korea.
⁶⁹ Department of Psychiatry, Seoul National University College of Medicine, Seoul, South Korea.
⁷⁰ National Institute of Mental Health, Klecany, Czech Republic.
⁷¹ Department of Psychiatry, First Faculty of Medicine, Charles University and General University Hospital, Prague, Czech Republic.
⁷² NORMENT, Division of Mental Health and Addiction, Oslo University Hospital, Oslo, Norway.
⁷³ Department of Psychology, University of Oslo, Oslo, Norway.
⁷⁴ Sunnaas Rehabilitation Hospital, Nesodden, Norway.
⁷⁵ Department of Life Sciences, College of Health, Medicine and Life Sciences, Brunel University London, Uxbridge, United Kingdom.
⁷⁶ Brain Imaging and Analysis Center, Duke University, Durham, NC.
⁷⁷ Department of Neuroscience, Uniformed Services University of the Health Sciences, Bethesda, MD, USA.
⁷⁸ Department of Biological and Medical Psychology, University of Bergen, Bergen, Norway.
⁷⁹ Institute D'Or for Research and Education (IDOR), São Paulo, Brazil.
⁸⁰ Department of Radiation Medicine and Applied Sciences and Psychiatry, UC San Diego, La Jolla, CA, USA.
⁸¹ Center for Multimodal Imaging and Genetics, UC San Diego, San Diego, CA, USA.
⁸² Institute for Translational Neuroscience, University of Münster, Münster, Germany.
⁸³ VISN 6 MIRECC, Durham VA, Durham, NC.
⁸⁴ Center of Excellence on Mood Disorders, Louis A. Faillace, MD, Department of Psychiatry and Behavioral Sciences, McGovern Medical School, The University of Texas Health Science Center at Houston, Houston, TX, USA.
⁸⁵ Michael E. DeBakey Veterans Affairs Medical Center, Houston, TX.
⁸⁶ H. Ben Taub Department of Physical Medicine and Rehabilitation, Baylor College of Medicine, Houston, TX.
⁸⁷ Faculty of Computer Science, Dalhousie University, Halifax, NS, Canada.
⁸⁸ Department of Medicine, The Royal Melbourne Hospital, The University of Melbourne, Parkville, VIC, Australia.
⁸⁹ Department of Neuroscience, The Central Clinical School, Alfred Health, Monash University, Melbourne, VIC, Australia.
⁹⁰ Department of Psychiatry, Psychosomatic Medicine and Psychotherapiey, Frankfurt University, Frankfurt, Germany.
⁹¹ Department of Psychology, Norwegian University of Science and Technology, Trondheim, Norway.
⁹² Department of Physical Medicine and Rehabilitation, St. Olavs Hospital, Trondheim University Hospital, Trondheim, Norway.
⁹³ NorHEAD - Norwegian Centre for Headache Research, Trondheim, Norway.
⁹⁴ Department of Electrical and Electronics Engineering, Antalya Bilim University, Antalya, Turkey.
⁹⁵ Neuroscience Institute & Department of Psychology, Georgia State University, Atlanta, GA, USA.
⁹⁶ W.G. (Bill) Hefner VA Medical Center, Salisbury, NC.
⁹⁷ Department of Neurobiology & Anatomy, Wake Forest School of Medicine, Winston-Salem, NC.
⁹⁸ VA Mid-Atlantic Mental Illness Research Education and Clinical Center (MA-MIRECC), Durham, NC.
⁹⁹ Department of Paediatrics, The University of Melbourne, Parkville, VIC, Australia.
¹⁰⁰ University of Basel, Department of Psychiatry (UPK), Basel, Switzerland.
¹⁰¹ 3rd Faculty of Medicine Charles University, Prague, Czech Republic.
¹⁰² Imaging Genetics Center, Stevens Neuroimaging & Informatics Institute, Keck School of Medicine of USC, Marina del Rey, CA, 90007.
¹⁰³ Department of Psychology, Georgia State University, Atlanta, GA.
¹⁰⁴ Department of Psychiatry, University of British Columbia, Vancouver, BC, Canada.
¹⁰⁵ British Columbia Mental Health and Substance Use Services Research Institute, Vancouver, BC, Canada.
¹⁰⁶ Psychiatry and Behavioral Health, Ohio State Wexner Medical Center, Columbus, OH, USA.
¹⁰⁷ Division of Endocrinology, Emory University School of Medicine, Atlanta, GA, USA.
¹⁰⁸ Department of Physical Medicine and Rehabilitation, Virginia Commonwealth University, Richmond, VA.
¹⁰⁹ Richmond Veterans Affairs (VA) Medical Center, Central Virginia VA Health Care System , Richmond, VA.
¹¹⁰ KG Jebsen Center for Neurodevelopmental Disorders, University of Oslo, Oslo, Norway.
¹¹¹ Department of Psychology, Phoenix VA Health Care System, Phoenix, AZ, USA.
¹¹² Rocco Ortenzio Neuroimaging Center, Kessler Foundation, East Hanover, NJ, USA.
¹¹³ Departments of Neurology, Pediatrics, Psychiatry, Radiology, Engineering, and Ophthalmology, USC, Los Angeles, CA, 90007.
¹¹⁴ Department of Psychology, Penn State University, State College, PA, 16801.
¹¹⁵ Department of Neurology, Hershey Medical Center, State College, PA, 16801.
¹¹⁶ Social Life and Engineering Science Imaging Center, Penn State University, State College, PA, 16801.

PMID: 36712107
PMCID: PMC9882238
DOI: 10.1101/2023.01.16.524331

Bridging Big Data: Procedures for Combining Non-equivalent Cognitive Measures from the ENIGMA Consortium

Eamonn Kennedy et al. bioRxiv. 2023.

[Preprint]. 2023 Apr 7:2023.01.16.524331.

doi: 10.1101/2023.01.16.524331.

Authors

Affiliations

¹ Department of Neurology, University of Utah School of Medicine, Salt Lake City, UT, 84132.
² Division of Epidemiology, University of Utah, Salt Lake City, UT, 84132.
³ George E. Wahlen Veterans Affairs Medical Center, Salt Lake City, UT, 84132.
⁴ Department of Educational Psychology, Counseling, and Special Education, Pennsylvania State University, University Park, PA, 16801.
⁵ WRIISC-WOMEN & Rehabilitation Department, VA Palo Alto, Palo Alto, CA, USA.
⁶ Neurosurgery, Stanford School of Medicine, Stanford, CA, USA.
⁷ Department of Psychiatry, Dalhousie University, Halifax, Canada.
⁸ FIDMAG Research Foundation, Barcelona, Spain.
⁹ Centro Investigación Biomédica en Red Salud Mental (CIBERSAM), Madrid, Spain.
¹⁰ Laboratory of Neuropsychiatry, Santa Lucia Foundation IRCCS, Rome, Italy.
¹¹ Department of Medicine, University of Otago, Christchurch, New Zealand.
¹² New Zealand Brain Research Institute, Christchurch, New Zealand.
¹³ Department of Neurology, Te Whatu Ora - Health New Zealand Waitaha Canterbury, Christchurch, New Zealand.
¹⁴ Department of Child and Adolescent Psychiatry, Institute of Psychiatry and Mental Health, Hospital General Universitario Gregorio Marañón, IiSGM, CIBERSAM, School of Medicine, Universidad Complutense, Madrid, Spain.
¹⁵ Department of Psychiatry and Biobehavioral Sciences, Semel Institute for Neuroscience and Human Behavior, UCLA, Los Angeles, CA, USA.
¹⁶ Brain Research Institute, UCLA, Los Angeles, CA, USA.
¹⁷ Department of Psychology, UCLA, Los Angeles, CA, USA.
¹⁸ Translational Psychiatry, Department of Psychiatry and Psychotherapy, University of Lübeck, Lübeck, Germany.
¹⁹ Department of Psychiatry, Marqués de Valdecilla University Hospital, IDIVAL, School of Medicine, University of Cantabria, Santander, Spain.
²⁰ UCLA Steve Tisch BrainSPORT Program, Los Angeles, CA, USA.
²¹ Turner Institute for Brain and Mental Health, School of Psychological Sciences, Monash University, Clayton, Melbourne, VIC, Australia.
²² Center of Brain, Behaviour and Metabolism (CBBM), University of Lübeck, Lübeck, Germany.
²³ Cognitive Health Initiative, Central Clinical School, Monash University, Melbourne, VIC, Australia.
²⁴ Department of Medicine, Royal Melbourne Hospital, Melbourne, VIC, Australia.
²⁵ Department of Psychiatry and Psychotherapy, University of Marburg, Marburg, Germany.
²⁶ Cognitive Neuroscience Unit, School of Psychology, Deakin University, Geelong, Australia.
²⁷ Tri-institutional Center for Translational Research in Neuroimaging and Data Science (TReNDS), Georgia State University, Georgia Institute of Technology, and Emory University University, Atlanta, GA, USA.
²⁸ Centers for Neuropsychology, Neuroscience & Traumatic Brain Injury Research, Kessler Foundation, East Hanover, NJ, USA.
²⁹ Department of Physical Medicine & Rehabilitation, Rutgers, New Jersey Medical School, Newark, NJ, USA.
³⁰ Rehabilitation Medicine Department, National Institutes of Health Clinical Center, Bethesda, MD.
³¹ Department of Psychiatry, Virgen del Rocio University Hospital, School of Medicine, University of Seville, IBIS, Seville, Spain.
³² School of Psychology, Speech and Hearing, University of Canterbury, Christchurch, New Zealand.
³³ Department of Rehabilitation and Human Performance, Icahn School of Medicine at Mount Sinai, New York, NY.
³⁴ Department of Neurology, Icahn School of Medicine at Mount Sinai, New York, NY.
³⁵ Institute for Translational Psychiatry, University of Münster, Germany.
³⁶ Department of Neuroscience, Monash University, Melbourne, Australia.
³⁷ Department of Neurology, Alfred Health, Melbourne, Australia.
³⁸ The Florey Institute of Neuroscience and Mental Health, Melbourne, Australia.
³⁹ Department of Psychiatry and Behavioral Sciences, University of Minnesota Medical School, Minneapolis, MN.
⁴⁰ Minneapolis VA Health Care System, Minneapolis, MN.
⁴¹ Kessler Foundation, East Hanover, NJ, USA.
⁴² Center for Traumatic Brain Injury, Kessler Foundation, East Hanover, NJ.
⁴³ Translational Developmental Neuroscience Section, Division of Psychological and Social Medicine and Developmental Neurosciences, Faculty of Medicine, TU Dresden, Germany.
⁴⁴ Eating Disorders Research and Treatment Center, Department of Child and Adolescent Psychiatry, Faculty of Medicine, TU Dresden, Germany.
⁴⁵ Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA, USA.
⁴⁶ Department of Psychology, University of Oregon, Eugene, OR, USA.
⁴⁷ Department of Psychiatry, University of California, San Diego, La Jolla, CA, USA.
⁴⁸ Center for Behavior Genetics of Aging, University of California, San Diego, La Jolla, CA, USA.
⁴⁹ Center for Autism Research, Kessler Foundation, East Hanover, NJ, USA.
⁵⁰ Department of Pediatrics, Division of Neurology, UCLA Mattel Children's Hospital, Los Angeles, CA, USA.
⁵¹ Department of Neurosurgery, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA.
⁵² Department of Psychiatry, Psychosomatic Medicine and Psychotherapy, University Hospital Frankfurt, Goethe University, Frankfurt, Germany.
⁵³ Hospital Universitari Institut Pere Mata, Tarragona, Spain.
⁵⁴ Institut d'Investiació Sanitària Pere Virgili-CERCA, Universitat Rovira i Virgili, Tarragona, Spain.
⁵⁵ Department of Brain and Cognitive Sciences, Seoul National University College of Natural Sciences, Seoul, South Korea.
⁵⁶ Department of Biomedicine, University of Bergen, Bergen, Norway.
⁵⁷ Division of Psychiatry, Haukeland University Hospital, Bergen, Norway.
⁵⁸ Center for Biobehavioral Health, The Abigail Wexner Research Institute at Nationwide Children's Hospital, Columbus, OH.
⁵⁹ Section of Pediatrics, The Ohio State University College of Medicine, Columbus, Ohio, USA.
⁶⁰ Translational Research Centre, University Hospital of Psychiatry and Psychotherapy, University of Bern, Bern, Switzerland.
⁶¹ Ethel Percy Andrus Gerontology Center, Leonard Davis School of Gerontology, University of Southern California, Los Angeles, CA, USA.
⁶² Department of Biomedical Engineering, Viterbi School of Engineering, University of Southern California, Los Angeles, CA, USA.
⁶³ Department of Quantitative & Computational Biology, Dornsife College of Arts & Sciences, University of Southern California, Los Angeles CA, USA.
⁶⁴ University Hospital of Child and Adolescent Psychiatry and Psychotherapy, University of Bern, Bern, Switzerland.
⁶⁵ Clinic of Child and Adolescent Psychiatry, Centre of Psychosocial Medicine, University of Heidelberg, Heidelberg, Germany.
⁶⁶ Department of Neurology, Uniformed Services University, Bethesda, MD.
⁶⁷ National Intrepid Center of Excellence, Walter Reed National Military Medical Center, Bethesda, MD.
⁶⁸ Department of Neuropsychiatry, Seoul National University Hospital, Seoul, South Korea.
⁶⁹ Department of Psychiatry, Seoul National University College of Medicine, Seoul, South Korea.
⁷⁰ National Institute of Mental Health, Klecany, Czech Republic.
⁷¹ Department of Psychiatry, First Faculty of Medicine, Charles University and General University Hospital, Prague, Czech Republic.
⁷² NORMENT, Division of Mental Health and Addiction, Oslo University Hospital, Oslo, Norway.
⁷³ Department of Psychology, University of Oslo, Oslo, Norway.
⁷⁴ Sunnaas Rehabilitation Hospital, Nesodden, Norway.
⁷⁵ Department of Life Sciences, College of Health, Medicine and Life Sciences, Brunel University London, Uxbridge, United Kingdom.
⁷⁶ Brain Imaging and Analysis Center, Duke University, Durham, NC.
⁷⁷ Department of Neuroscience, Uniformed Services University of the Health Sciences, Bethesda, MD, USA.
⁷⁸ Department of Biological and Medical Psychology, University of Bergen, Bergen, Norway.
⁷⁹ Institute D'Or for Research and Education (IDOR), São Paulo, Brazil.
⁸⁰ Department of Radiation Medicine and Applied Sciences and Psychiatry, UC San Diego, La Jolla, CA, USA.
⁸¹ Center for Multimodal Imaging and Genetics, UC San Diego, San Diego, CA, USA.
⁸² Institute for Translational Neuroscience, University of Münster, Münster, Germany.
⁸³ VISN 6 MIRECC, Durham VA, Durham, NC.
⁸⁴ Center of Excellence on Mood Disorders, Louis A. Faillace, MD, Department of Psychiatry and Behavioral Sciences, McGovern Medical School, The University of Texas Health Science Center at Houston, Houston, TX, USA.
⁸⁵ Michael E. DeBakey Veterans Affairs Medical Center, Houston, TX.
⁸⁶ H. Ben Taub Department of Physical Medicine and Rehabilitation, Baylor College of Medicine, Houston, TX.
⁸⁷ Faculty of Computer Science, Dalhousie University, Halifax, NS, Canada.
⁸⁸ Department of Medicine, The Royal Melbourne Hospital, The University of Melbourne, Parkville, VIC, Australia.
⁸⁹ Department of Neuroscience, The Central Clinical School, Alfred Health, Monash University, Melbourne, VIC, Australia.
⁹⁰ Department of Psychiatry, Psychosomatic Medicine and Psychotherapiey, Frankfurt University, Frankfurt, Germany.
⁹¹ Department of Psychology, Norwegian University of Science and Technology, Trondheim, Norway.
⁹² Department of Physical Medicine and Rehabilitation, St. Olavs Hospital, Trondheim University Hospital, Trondheim, Norway.
⁹³ NorHEAD - Norwegian Centre for Headache Research, Trondheim, Norway.
⁹⁴ Department of Electrical and Electronics Engineering, Antalya Bilim University, Antalya, Turkey.
⁹⁵ Neuroscience Institute & Department of Psychology, Georgia State University, Atlanta, GA, USA.
⁹⁶ W.G. (Bill) Hefner VA Medical Center, Salisbury, NC.
⁹⁷ Department of Neurobiology & Anatomy, Wake Forest School of Medicine, Winston-Salem, NC.
⁹⁸ VA Mid-Atlantic Mental Illness Research Education and Clinical Center (MA-MIRECC), Durham, NC.
⁹⁹ Department of Paediatrics, The University of Melbourne, Parkville, VIC, Australia.
¹⁰⁰ University of Basel, Department of Psychiatry (UPK), Basel, Switzerland.
¹⁰¹ 3rd Faculty of Medicine Charles University, Prague, Czech Republic.
¹⁰² Imaging Genetics Center, Stevens Neuroimaging & Informatics Institute, Keck School of Medicine of USC, Marina del Rey, CA, 90007.
¹⁰³ Department of Psychology, Georgia State University, Atlanta, GA.
¹⁰⁴ Department of Psychiatry, University of British Columbia, Vancouver, BC, Canada.
¹⁰⁵ British Columbia Mental Health and Substance Use Services Research Institute, Vancouver, BC, Canada.
¹⁰⁶ Psychiatry and Behavioral Health, Ohio State Wexner Medical Center, Columbus, OH, USA.
¹⁰⁷ Division of Endocrinology, Emory University School of Medicine, Atlanta, GA, USA.
¹⁰⁸ Department of Physical Medicine and Rehabilitation, Virginia Commonwealth University, Richmond, VA.
¹⁰⁹ Richmond Veterans Affairs (VA) Medical Center, Central Virginia VA Health Care System , Richmond, VA.
¹¹⁰ KG Jebsen Center for Neurodevelopmental Disorders, University of Oslo, Oslo, Norway.
¹¹¹ Department of Psychology, Phoenix VA Health Care System, Phoenix, AZ, USA.
¹¹² Rocco Ortenzio Neuroimaging Center, Kessler Foundation, East Hanover, NJ, USA.
¹¹³ Departments of Neurology, Pediatrics, Psychiatry, Radiology, Engineering, and Ophthalmology, USC, Los Angeles, CA, 90007.
¹¹⁴ Department of Psychology, Penn State University, State College, PA, 16801.
¹¹⁵ Department of Neurology, Hershey Medical Center, State College, PA, 16801.
¹¹⁶ Social Life and Engineering Science Imaging Center, Penn State University, State College, PA, 16801.

PMID: 36712107
PMCID: PMC9882238
DOI: 10.1101/2023.01.16.524331

Abstract

Investigators in neuroscience have turned to Big Data to address replication and reliability issues by increasing sample sizes, statistical power, and representativeness of data. These efforts unveil new questions about integrating data arising from distinct sources and instruments. We focus on the most frequently assessed cognitive domain - memory testing - and demonstrate a process for reliable data harmonization across three common measures. We aggregated global raw data from 53 studies totaling N = 10,505 individuals. A mega-analysis was conducted using empirical bayes harmonization to remove site effects, followed by linear models adjusting for common covariates. A continuous item response theory (IRT) model estimated each individual's latent verbal learning ability while accounting for item difficulties. Harmonization significantly reduced inter-site variance while preserving covariate effects, and our conversion tool is freely available online. This demonstrates that large-scale data sharing and harmonization initiatives can address reproducibility and integration challenges across the behavioral sciences.

Keywords: Harmonization; Mega analysis; Tools; Verbal learning.

PubMed Disclaimer

Conflict of interest statement

Competing Interest Statement: Dr. Arango has been a consultant to or has received honoraria or grants from Acadia, Angelini, Biogen, Boehringer, Gedeon Richter, Janssen Cilag, Lundbeck, Medscape, Menarini, Minerva, Otsuka, Pfizer, Roche, Sage, Servier, Shire, Schering Plough, Sumitomo Dainippon Pharma, Sunovion and Takeda. Dr. Brodtmann serves on the editorial boards of Neurology and International Journal of Stroke. Dr. Diaz-Caneja has received honoraria from Exeltis and Angelinii. Dr. Giza: consultant for NBA, NFL, NHLPA, Los Angeles Lakers; Advisory Board: Highmark Interactive, Novartis, MLS, NBA, USSF; Medicolegal 1–2 cases annually. Dr. Soares: ALKERMES (Research Grant), ALLERGAN (Research Grant), ASOFARMA (Consultant), ATAI (Stock), BOEHRINGER Ingelheim (Consultant), COMPASS (Research Grant), JOHNSON & JOHNSON (Consultant), LIVANOVA (Consultant), PFIZER (Consultant), PULVINAR NEURO LLC (Consultant), RELMADA (Consultant), SANOFI (Consultant), SUNOVIAN (Consultant). Dr. Thompson received partial research support from Biogen, Inc., for research unrelated to this manuscript. Dr. Yatham has been on speaker or advisory boards for, or has received research grants from, Alkermes, Abbvie, Canadian Institutes of Health Research, Sumitomo Dainippon Pharma, GlaxoSmithKline, Intracellular Therapies, Merck, Sanofi, Sequiris, Servier, and Sunovion, over the past 3 years, all outside this work. The collection of this cohort was partially supported by an investigator-initiated research grant from Biogen (US). Biogen had no role in the analysis or writing of this manuscript. Eisai (JP) and Life Molecular Imaging for research unrelated to this manuscript. Dr. Wylie has received research support from the NJ Commission for brain injury research, from the Dept of Veterans’ Affairs, from Biogen, from Bristol, Myers, Squibb, from Genetech, and has served on advisory boards for the CDMRP and the VA. All of these activities are unrelated to this research. The views expressed in this article are those of the author(s) and do not reflect the official policy of the Department of Army/Navy/Air Force, Department of Defense, or U.S. Government.

Figures

**Figure 1.**
Comparing proportions of memory items recalled before and after harmonization. Mean scores for each site (dots) are shown broken out by instrument (color) and item (Top: Trial 1 immediate free recall, Middle: Total sum of all Trials, Bottom: Long-delay free recall scores).

**Figure 2.**
Visualizing covariate effects on scores across AVLTs. **(a)** Boxplots of scores stratified by group (TBI vs. control) and sex/gender indicated that males and those with history of TBI had significantly lower scores on average for all tests. Age-related declines **(b)** and the beneficial effects of education **(c)** on scores were consistent across all AVLTs.

**Figure 3.. Visualizing and Validating Conversions.**
**(a)** Average raw scores as a function of individual ability are shown approximated as cubic polynomial fits for immediate, short, and long delay trials. Horizontal lines of equivalent ability connect equivalent raw scores across tests, which facilitates the construction of crosswalks. **(b)** Scatter plot and fit of the adjusted raw sum of learning Trial scores for a subset of cases who were administered both the CVLT and RAVLT (n=36). The confidence area of the dually assessed data is shown in blue, and agrees with the derived crosswalk for CVLT->RAVLT (n=9,362, black dotted line).

See this image and copyright information in PMC

References

1. Thompson P. M., Jahanshad N., Ching C. R. K., Salminen L. E., Thomopoulos S. I., Bright J., Baune B. T., Bertolín S., Bralten J., Bruin W. B., Bülow R., Chen J., Chye Y., Dannlowski U., de Kovel C. G. F., Donohoe G., Eyler L. T., Faraone S. V., Favre P., Filippi C. A., Frodl T., Garijo D., Gil Y., Grabe H. J., Grasby K. L., Hajek T., Han L. K. M., Hatton S. N., Hilbert K., Ho T. C., Holleran L., Homuth G., Hosten N., Houenou J., Ivanov I., Jia T., Kelly S., Klein M., Kwon J. S., Laansma M. A., Leerssen J., Lueken U., Nunes A., Neill J. O., Opel N., Piras F., Piras F., Postema M. C., Pozzi E., Shatokhina N., Soriano-Mas C., Spalletta G., Sun D., Teumer A., Tilot A. K., Tozzi L., van der Merwe C., Van Someren E. J. W., van Wingen G. A., Völzke H., Walton E., Wang L., Winkler A. M., Wittfeld K., Wright M. J., Yun J.-Y., Zhang G., Zhang-James Y., Adhikari B. M., Agartz I., Aghajani M., Aleman A., Althoff R. R., Altmann A., Andreassen O. A., Baron D. A., Bartnik-Olson B. L., Marie Bas-Hoogendam J., Baskin-Sommers A. R., Bearden C. E., Berner L. A., Boedhoe P. S. W., Brouwer R. M., Buitelaar J. K., Caeyenberghs K., Cecil C. A. M., Cohen R. A., Cole J. H., Conrod P. J., De Brito S. A., de Zwarte S. M. C., Dennis E. L., Desrivieres S., Dima D., Ehrlich S., Esopenko C., Fairchild G., Fisher S. E., Fouche J.-P., Francks C., Frangou S., Franke B., Garavan H. P., Glahn D. C., Groenewold N. A., Gurholt T. P., Gutman B. A., Hahn T., Harding I. H., Hernaus D., Hibar D. P., Hillary F. G., Hoogman M., Hulshoff Pol H. E., Jalbrzikowski M., Karkashadze G. A., Klapwijk E. T., Knickmeyer R. C., Kochunov P., Koerte I. K., Kong X.-Z., Liew S.-L., Lin A. P., Logue M. W., Luders E., Macciardi F., Mackey S., Mayer A. R., McDonald C. R., McMahon A. B., Medland S. E., Modinos G., Morey R. A., Mueller S. C., Mukherjee P., Namazova-Baranova L., Nir T. M., Olsen A., Paschou P., Pine D. S., Pizzagalli F., Rentería M. E., Rohrer J. D., Sämann P. G., Schmaal L., Schumann G., Shiroishi M. S., Sisodiya S. M., Smit D. J. A., Sønderby I. E., Stein D. J., Stein J. L., Tahmasian M., Tate D. F., Turner J. A., van den Heuvel O. A., van der Wee N. J. A., van der Werf Y. D., van Erp T. G. M., van Haren N. E. M., van Rooij D., van Velzen L. S., Veer I. M., Veltman D. J., Villalon-Reina J. E., Walter H., Whelan C. D., Wilde E. A., Zarei M., Zelman V., ENIGMA Consortium, ENIGMA and global neuroscience: A decade of large-scale studies of the brain in health and disease across more than 40 countries. Transl. Psychiatry. 10, 100 (2020). - PMC - PubMed
1. Nagaraj A., Shears E., de Vaan M., Improving data access democratizes and diversifies science. Proc. Natl. Acad. Sci. U. S. A. 117, 23490–23498 (2020). - PMC - PubMed
1. Rajtmajer S. M., Errington T. M., Hillary F. G., How failure to falsify in high-volume science contributes to the replication crisis. Elife. 11, e78830 (2022). - PMC - PubMed
1. Kennedy E., Dennis E. L., Lindsey H. M., deRoon-Cassini T., Du Plessis S., Fani N., Kaufman M. L., Koen N., Larson C. L., Laskowitz S., Lebois L. A. M., Morey R. A., Newsome M. R., Palermo C., Pastorek N. J., Powers A., Scheibel R., Seedat S., Seligowski A., Stein D., Stevens J., Sun D., Thompson P., Troyanskaya M., van Rooij S. J. H., Watts A., Weis C. N., Williams W., Hillary F. G., Pugh M. J., Wilde E. A., Tate D. F., Harmonizing PTSD Severity Scales Across Instruments and Sites. Neuropsychology. Accepted. - PMC - PubMed
1. Pan F.-F., Huang L., Chen K.-L., Zhao Q.-H., Guo Q.-H., A comparative study on the validations of three cognitive screening tests in identifying subtle cognitive decline. BMC Neurol. 20, 78 (2020). - PMC - PubMed

Save citation to file

Email citation

Add to Collections

Add to My Bibliography

Your saved search

Create a file for external citation management software

Your RSS Feed

This is a preprint.

Bridging Big Data: Procedures for Combining Non-equivalent Cognitive Measures from the ENIGMA Consortium

Affiliations

Bridging Big Data: Procedures for Combining Non-equivalent Cognitive Measures from the ENIGMA Consortium

Authors

Affiliations

Abstract

Conflict of interest statement

Figures

References

Publication types

Grants and funding

LinkOut - more resources

Full Text Sources

Miscellaneous