Abstract

Causal Structure Discovery (CSD) is the problem of identifying causal relationships from large quantities of data through computational methods. With the limited ability of traditional association-based computational methods to discover causal relationships, CSD methodologies are gaining popularity. The goal of the study was to systematically examine whether (i) CSD methods can discover the known causal relationships from observational clinical data and (ii) to offer guidance to accurately discover known causal relationships. We used Alzheimer’s disease (AD), a complex progressive disease, as a model because the well-established evidence provides a “gold-standard” causal graph for evaluation. We evaluated two CSD methods, Fast Causal Inference (FCI) and Fast Greedy Equivalence Search (FGES) in their ability to discover this structure from data collected by the Alzheimer’s Disease Neuroimaging Initiative (ADNI). We used structural equation models (which is not designed for CSD) as control. We applied these methods under three scenarios defined by increasing amounts of background knowledge provided to the methods. The methods were evaluated by comparing the resulting causal relationships with the “gold standard” graph that was constructed from literature. Dedicated CSD methods managed to discover graphs that nearly coincided with the gold standard. For best results, CSD algorithms should be used with longitudinal data providing as much prior knowledge as possible.

Details

Title
Challenges and Opportunities with Causal Discovery Algorithms: Application to Alzheimer’s Pathophysiology
Author
Shen Xinpeng 1   VIAFID ORCID Logo  ; Ma Sisi 1 ; Vemuri Prashanthi 2 ; Simon, Gyorgy 1 ; Weiner, Michael W 3 ; Aisen, Paul 4 ; Petersen, Ronald 2 ; Jack, Clifford R 2 ; Saykin, Andrew J 5 ; Jagust, William 6 ; Trojanowki, John Q 7 ; Toga, Arthur W 4 ; Beckett, Laurel 8 ; Green, Robert C 9 ; Morris, John 10 ; Shaw, Leslie M 7 ; Khachaturian Zaven 11 ; Sorensen, Greg 12 ; Carrillo, Maria 13 ; Kuller Lew 14 ; Raichle, Marc 10 ; Paul, Steven 15 ; Davies, Peter 16 ; Fillit Howard 17 ; Hefti Franz 18 ; Holtzman, David 10 ; Marcel, Mesulam M 19 ; Potter, William 20 ; Snyder, Peter 21 ; Schwartz, Adam 22 ; Montine, Tom 23 ; Thomas, Ronald G 24 ; Donohue, Michael 24 ; Walter, Sarah 24 ; Gessert Devon 24 ; Sather Tamie 24 ; Jiminez Gus 24 ; Balasubramanian, Archana B 24 ; Mason, Jennifer 24 ; Sim, Iris 24 ; Harvey, Danielle 8 ; Bernstein, Matthew 2 ; Fox, Nick 25 ; Thompson, Paul 26 ; Schuff Norbert 3 ; DeCArli, Charles 8 ; Borowski Bret 2 ; Gunter, Jeff 2 ; Senjem Matt 2 ; Jones, David 2 ; Kantarci Kejal 2 ; Ward, Chad 2 ; Koeppe, Robert A 27 ; Foster, Norm 28 ; Reiman, Eric M 29 ; Chen, Kewei 29 ; Mathis, Chet 14 ; Landau, Susan 6 ; Cairns, Nigel J 10 ; Franklin, Erin 10 ; Taylor-Reinwald, Lisa 10 ; Lee, Virginia 7 ; Korecka Magdalena 7 ; Figurski Michal 7 ; Crawford, Karen 4 ; Neu, Scott 4 ; Foroud, Tatiana M 5 ; Potkin, Steven 30 ; Faber, Kelley 5 ; Kim, Sungeun 5 ; Nho Kwangsik 5 ; Thal, Leon 24 ; Buckholtz, Neil 31 ; Albert, Marilyn 32 ; Frank, Richard 33 ; Hsiao, John 31 ; Kaye, Jeffrey 34 ; Quinn, Joseph 34 ; Silbert, Lisa 34 ; Lind, Betty 34 ; Carter, Raina 34 ; Dolen, Sara 34 ; Schneider, Lon S 4 ; Pawluczyk Sonia 4 ; Beccera Mauricio 4 ; Liberty, Teodoro 4 ; Spann, Bryan M 4 ; Brewer, James 24 ; Vanderswag Helen 24 ; Fleisher, Adam 24 ; Heidebrink, Judith L 27 ; Lord, Joanne L 27 ; Mason, Sara S 5 ; Albers, Colleen S 2 ; Knopman, David 2 ; Johnson, Kris 2 ; Doody, Rachelle S 35 ; Villanueva-Meyer, Javier 35 ; Pavlik Valory 35 ; Shibley, Victoria 35 ; Chowdhury Munir 35 ; Rountree, Susan 35 ; Dang, Mimi 35 ; Stern, Yaakov 36 ; Honig, Lawrence S 36 ; Bell, Karen L 36 ; Ances Beau 10 ; Carroll, Maria 10 ; Creech, Mary L 10 ; Mintun Mark A 10 ; Schneider, Stacy 10 ; Oliver, Angela 10 ; Marson, Daniel 37 ; Geldmacher, David 37 ; Love, Marissa Natelson 37 ; Griffith, Randall 37 ; Clark, David 37 ; Brockington, John 37 ; Roberson, Erik 37 ; Grossman, Hillel 38 ; Mitsis Effie 38 ; Shah, Raj C 39 ; deToledo-Morrell Leyla 39 ; Duara Ranjan 40 ; Greig-Custo, Maria T 40 ; Barker, Warren 40 ; Onyike Chiadi 32 ; D’Agostino Daniel 32 ; Kielb, Stephanie 32 ; Sadowski, Martin 41 ; Sheikh, Mohammed O 41 ; Ulysse Anaztasia 41 ; Gaikwad Mrunalini 41 ; Murali, Doraiswamy P 42 ; Petrella, Jeffrey R 42 ; Borges-Neto, Salvador 42 ; Wong, Terence Z 42 ; Coleman, Edward 42 ; Arnold, Steven E 7 ; Karlawish, Jason H 7 ; Wolk, David A 7 ; Clark, Christopher M 7 ; Smith, Charles D 43 ; Jicha, Greg 43 ; Hardy, Peter 43 ; Sinha Partha 43 ; Oates, Elizabeth 43 ; Conrad, Gary 43 ; Lopez, Oscar L 14 ; Oakley, Mary Ann 14 ; Simpson, Donna M 14 ; Porsteinsson, Anton P 44 ; Goldstein, Bonnie S 44 ; Kim, Martin 44 ; Makino, Kelly M 44 ; Saleem, Ismail M 44 ; Brand, Connie 44 ; Preda, Adrian 30 ; Nguyen, Dana 30 ; Womack, Kyle 45 ; Mathews, Dana 45 ; Quiceno, Mary 45 ; Levey, Allan I 46 ; Lah, James J 46 ; Cellar, Janet S 46 ; Burns, Jeffrey M 47 ; Swerdlow, Russell H 47 ; Brooks, William M 47 ; Apostolova Liana 26 ; Tingus Kathleen 26 ; Woo, Ellen 26 ; Silverman, Daniel H, S 26 ; Lu, Po H 26 ; Bartzokis, George 26 ; Graff-Radford, Neill R 48 ; Parfitt, Francine 48 ; Poki-Walker, Kim 48 ; Farlow, Martin R 5 ; Hake, Ann Marie 5 ; Matthews, Brandy R 5 ; Brosch, Jared R 5 ; Herring, Scott 5 ; van Dyck Christopher H 49 ; Carson, Richard E 49 ; MacAvoy, Martha G 49 ; Varma Pradeep 49 ; Chertkow Howard 50 ; Bergman, Howard 50 ; Hosein, Chris 50 ; Black, Sandra 51 ; Stefanovic Bojana 51 ; Caldwell, Curtis 51 ; Hsiung, Ging-Yuek Robin 52 ; Mudge Benita 52 ; Sossi Vesna 52 ; Feldman, Howard 52 ; Assaly Michele 52 ; Finger, Elizabeth 53 ; Pasternack, Stephen 53 ; Rachisky Irina 53 ; Rogers, John 53 ; Trost, Dick 53 ; Kertesz, Andrew 53 ; Bernick, Charles 54 ; Munic Donna 54 ; Rogalski, Emily 19 ; Lipowski Kristine 19 ; Weintraub, Sandra 19 ; Bonakdarpour Borna 19 ; Kerwin, Diana 19 ; Chuang-Kuo, Wu 19 ; Johnson, Nancy 19 ; Sadowsky, Carl 55 ; Villena, Teresa 55 ; Turner, Raymond Scott 56 ; Johnson, Kathleen 56 ; Reynolds, Brigid 56 ; Sperling, Reisa A 9 ; Johnson, Keith A 9 ; Marshall, Gad 9 ; Yesavage Jerome 57 ; Taylor, Joy L 57 ; Lane, Barton 57 ; Rosen, Allyson 57 ; Tinklenberg Jared 57 ; Sabbagh, Marwan N 58 ; Belden, Christine M 58 ; Jacobson, Sandra A 58 ; Sirrel, Sherye A 58 ; Kowall, Neil 59 ; Killiany, Ronald 59 ; Budson, Andrew E 59 ; Norbash, Alexander 59 ; Johnson, Patricia Lynn 59 ; Obisesan, Thomas O 60 ; Wolday Saba 60 ; Allard, Joanne 60 ; Lerner, Alan 61 ; Ogrocki Paula 61 ; Tatsuoka Curtis 61 ; Fatica Parianne 61 ; Fletcher, Evan 8 ; Maillard, Pauline 8 ; Olichney, John 8 ; DeCarli, Charles 8 ; Carmichael, Owen 8 ; Kittur Smita 62 ; Borrie, Michael 63 ; T-Y, Lee 63 ; Bartha, Rob 63 ; Johnson, Sterling 64 ; Asthana Sanjay 64 ; Carlsson, Cynthia M 64 ; Tariot Pierre 65 ; Burke, Anna 65 ; Milliken, Ann Marie 65 ; Trncic Nadira 65 ; Reeder, Stephanie 65 ; Bates Vernice 66 ; Capote Horacio 66 ; Rainka Michelle 66 ; Scharre, Douglas W 67 ; Kataki, Maria 67 ; Kelly, Brendan 67 ; Zimmerman, Earl A 68 ; Celmins Dzintra 68 ; Brown, Alice D 68 ; Pearlson, Godfrey D 69 ; Blank, Karen 69 ; Anderson, Karen 69 ; Flashman, Laura A 70 ; Seltzer, Marc 70 ; Hynes, Mary L 70 ; Santulli, Robert B 70 ; Sink, Kaycee M 71 ; Gordineer Leslie 71 ; Williamson, Jeff D 71 ; Garg Pradeep 71 ; Watkins, Franklin 71 ; Ott, Brian R 72 ; Tremont, Geoffrey 72 ; Daiello, Lori A 72 ; Salloway, Stephen 73 ; Malloy, Paul 73 ; Correia, Stephen 73 ; Rosen, Howard J 3 ; Miller, Bruce L 3 ; Perry, David 3 ; Mintzer Jacobo 74 ; Spicer, Kenneth 74 ; Bachman, David 74 ; Pomara Nunzio 75 ; Hernando Raymundo 75 ; Sarrael Antero 75 ; Schultz, Susan K 76 ; Smith, Karen Ekstam 76 ; Koleva Hristina 76 ; Nam, Ki Won 76 ; Shim Hyungsub 76 ; Relkin, Norman 15 ; Chaing Gloria 15 ; Lin, Michael 15 ; Ravdin, Lisa 15 ; Smith, Amanda 77 ; Ashok, Raj Balebail 77 ; Fargher, Kristin 77 

 Institute for Health Informatics, University of Minnesota, Minneapolis, USA (GRID:grid.17635.36) (ISNI:0000000419368657) 
 Mayo Clinic, Rochester, USA (GRID:grid.66875.3a) (ISNI:0000 0004 0459 167X) 
 University of California, San Francisco, USA (GRID:grid.266102.1) (ISNI:0000 0001 2297 6811) 
 University of Southern California, Los Angeles, USA (GRID:grid.42505.36) (ISNI:0000 0001 2156 6853) 
 Indiana University, Bloomington, USA (GRID:grid.411377.7) (ISNI:0000 0001 0790 959X) 
 University of California, Berkeley, USA (GRID:grid.47840.3f) (ISNI:0000 0001 2181 7878) 
 University of Pennsylvania, Philadelphia, USA (GRID:grid.25879.31) (ISNI:0000 0004 1936 8972) 
 University of California, Davis, USA (GRID:grid.27860.3b) (ISNI:0000 0004 1936 9684) 
 Brigham and Women’s Hospital/Harvard Medical School, Boston, USA (GRID:grid.62560.37) (ISNI:0000 0004 0378 8294) 
10  Washington University St. Louis, St. Louis, USA (GRID:grid.4367.6) (ISNI:0000 0001 2355 7002) 
11  Prevent Alzheimer’s Disease, Rockville, USA (GRID:grid.468171.d) 
12  Siemens, Munich, Germany (GRID:grid.5406.7) (ISNI:000000012178835X) 
13  Alzheimer’s Association, Illinois, USA (GRID:grid.422384.b) (ISNI:0000 0004 0614 7003) 
14  University of Pittsburgh, Pennsylvania, USA (GRID:grid.21925.3d) (ISNI:0000 0004 1936 9000) 
15  Cornell University, New York, USA (GRID:grid.5386.8) (ISNI:000000041936877X) 
16  Albert Einstein College of Medicine of Yeshiva University, New York, USA (GRID:grid.251993.5) (ISNI:0000000121791997) 
17  AD Drug Discovery Foundation, New York, USA (GRID:grid.251993.5) 
18  Acumen Pharmaceuticals, California, USA (GRID:grid.427650.2) 
19  Northwestern University, Illinois, USA (GRID:grid.16753.36) (ISNI:0000 0001 2299 3507) 
20  National Institute of Mental Health, Maryland, USA (GRID:grid.416868.5) (ISNI:0000 0004 0464 0574) 
21  Brown University, Rhode Island, USA (GRID:grid.40263.33) (ISNI:0000 0004 1936 9094) 
22  Eli Lilly, Indiana, USA (GRID:grid.417540.3) (ISNI:0000 0000 2220 2544) 
23  University of Washington, Washington, USA (GRID:grid.34477.33) (ISNI:0000000122986657) 
24  University of California, San Diego, USA (GRID:grid.266100.3) (ISNI:0000 0001 2107 4242) 
25  University of London, London, UK (GRID:grid.4464.2) (ISNI:0000 0001 2161 2573) 
26  University of California, Los Angeles, USA (GRID:grid.19006.3e) (ISNI:0000 0000 9632 6718) 
27  University of Michigan, Michigan, USA (GRID:grid.214458.e) (ISNI:0000000086837370) 
28  University of Utah, Utah, USA (GRID:grid.223827.e) (ISNI:0000 0001 2193 0096) 
29  Banner Alzheimer’s Institute, Arizona, USA (GRID:grid.223827.e) 
30  University of California, Irvine, USA (GRID:grid.266093.8) (ISNI:0000 0001 0668 7243) 
31  National Institute on Aging, Maryland, USA (GRID:grid.419475.a) (ISNI:0000 0000 9372 4913) 
32  Johns Hopkins University, Maryland, USA (GRID:grid.21107.35) (ISNI:0000 0001 2171 9311) 
33  Richard Frank Consulting, New Hampshire, USA (GRID:grid.21107.35) 
34  Oregon Health and Science University, Oregon, USA (GRID:grid.5288.7) (ISNI:0000 0000 9758 5690) 
35  Baylor College of Medicine, Texas, USA (GRID:grid.39382.33) (ISNI:0000 0001 2160 926X) 
36  Columbia University Medical Center, New York, USA (GRID:grid.239585.0) (ISNI:0000 0001 2285 2675) 
37  University of Alabama-, Birmingham, USA (GRID:grid.265892.2) (ISNI:0000000106344187) 
38  Mount Sinai School of Medicine, New York, USA (GRID:grid.59734.3c) (ISNI:0000 0001 0670 2351) 
39  Rush University Medical Center, Rush University, Illinois, USA (GRID:grid.59734.3c) 
40  Wien Center, Florida, USA (GRID:grid.59734.3c) 
41  NewYork University, New York, USA (GRID:grid.21107.35) 
42  Duke University Medical Center, North Carolina, USA (GRID:grid.189509.c) (ISNI:0000000100241216) 
43  University of Kentucky, Kentucky, USA (GRID:grid.266539.d) (ISNI:0000 0004 1936 8438) 
44  University of Rochester Medical Center, New York, USA (GRID:grid.412750.5) (ISNI:0000 0004 1936 9166) 
45  University of Texas Southwestern Medical School, Texas, USA (GRID:grid.267313.2) (ISNI:0000 0000 9482 7121) 
46  Emory University, Georgia, USA (GRID:grid.189967.8) (ISNI:0000 0001 0941 6502) 
47  University of Kansas, Medical Center, Kansas, USA (GRID:grid.412016.0) (ISNI:0000 0001 2177 6375) 
48  Mayo Clinic, Jacksonville, USA (GRID:grid.417467.7) (ISNI:0000 0004 0443 9942) 
49  Yale University School of Medicine, Connecticut, USA (GRID:grid.47100.32) (ISNI:0000000419368710) 
50  McGill University, Montreal-Jewish General Hospital, Quebec, Canada (GRID:grid.14709.3b) (ISNI:0000 0004 1936 8649) 
51  Sunnybrook Health Sciences, Ontario, Canada (GRID:grid.14709.3b) 
52  U.B.C. Clinic for AD & Related Disorders, British Columbia, Canada (GRID:grid.14709.3b) 
53  Cognitive Neurology-St. Joseph’s, Ontario, Canada (GRID:grid.14709.3b) 
54  Cleveland Clinic Lou Ruvo Center for Brain Health, Ohio, USA (GRID:grid.239578.2) (ISNI:0000 0001 0675 4725) 
55  Premiere Research Inst (Palm Beach Neurology), Florida, USA (GRID:grid.16753.36) 
56  Georgetown University Medical Center, Washington, USA (GRID:grid.411667.3) (ISNI:0000 0001 2186 0438) 
57  Stanford University, California, USA (GRID:grid.168010.e) (ISNI:0000000419368956) 
58  Banner Sun Health Research Institute, Arizona, USA (GRID:grid.414208.b) (ISNI:0000 0004 0619 8759) 
59  Boston University, Massachusetts, USA (GRID:grid.189504.1) (ISNI:0000 0004 1936 7558) 
60  Howard University, Washington, USA (GRID:grid.257127.4) (ISNI:0000 0001 0547 4545) 
61  Case Western Reserve University, Ohio, USA (GRID:grid.67105.35) (ISNI:0000 0001 2164 3847) 
62  Neurological Care of CNY, New York, USA (GRID:grid.27860.3b) 
63  Parkwood Hospital, Pennsylvania, USA (GRID:grid.27860.3b) 
64  University of Wisconsin, Wisconsin, USA (GRID:grid.267461.0) (ISNI:0000 0001 0559 7692) 
65  Banner Alzheimer’s Institute, Arizona, USA (GRID:grid.267461.0) 
66  Dent Neurologic Institute, New York, USA (GRID:grid.417854.b) 
67  Ohio State University, Ohio, USA (GRID:grid.261331.4) (ISNI:0000 0001 2285 7943) 
68  Albany Medical College, New York, USA (GRID:grid.413558.e) (ISNI:0000 0001 0427 8745) 
69  Hartford Hospital, Olin Neuropsychiatry Research Center, Connecticut, USA (GRID:grid.277313.3) (ISNI:0000 0001 0626 2712) 
70  Dartmouth-Hitchcock Medical Center, New Hampshire, USA (GRID:grid.413480.a) (ISNI:0000 0004 0440 749X) 
71  Wake Forest University Health Sciences, North Carolina, USA (GRID:grid.412860.9) (ISNI:0000 0004 0459 1231) 
72  Rhode Island Hospital, Rhode Island, USA (GRID:grid.240588.3) (ISNI:0000 0001 0557 9478) 
73  Butler Hospital, Rhode Island, USA (GRID:grid.273271.2) (ISNI:0000 0000 8593 9332) 
74  Medical University South Carolina, Carolina, USA (GRID:grid.259828.c) (ISNI:0000 0001 2189 3475) 
75  Nathan Kline Institute, New York, USA (GRID:grid.250263.0) (ISNI:0000 0001 2189 4777) 
76  University of Iowa College of Medicine, Iowa, USA (GRID:grid.214572.7) (ISNI:0000 0004 1936 8294) 
77  USF Health Byrd Alzheimer’s Institute, University of South Florida, Florida, USA (GRID:grid.170693.a) (ISNI:0000 0001 2353 285X) 
Publication year
2020
Publication date
2020
Publisher
Nature Publishing Group
e-ISSN
20452322
Source type
Scholarly Journal
Language of publication
English
ProQuest document ID
2358546809
Copyright
This work is published under http://creativecommons.org/licenses/by/4.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License.