Reset filters

Search publications


By keyword
By department

No publications found.

 

Numerical uncertainty in analytical pipelines lead to impactful variability in brain networks

Authors: Kiar GChatelain Yde Oliveira Castro PPetit ERokem AVaroquaux GMisic BEvans ACGlatard T


Affiliations

1 Montréal Neurological Institute, McGill University, Montréal, QC, Canada.
2 Department of Computer Science and Software Engineering, Concordia University, Montréal, QC, Canada.
3 Department of Computer Science, Université of Versailles, Versailles, France.
4 Exascale Computing Lab, Intel, Paris, France.
5 Department of Psychology and eScience Institute, University of Washington, Seattle, WA, United States of America.
6 Parietal Project-team, INRIA Saclay-ile de France, Paris, France.

Description

The analysis of brain-imaging data requires complex processing pipelines to support findings on brain function or pathologies. Recent work has shown that variability in analytical decisions, small amounts of noise, or computational environments can lead to substantial differences in the results, endangering the trust in conclusions. We explored the instability of results by instrumenting a structural connectome estimation pipeline with Monte Carlo Arithmetic to introduce random noise throughout. We evaluated the reliability of the connectomes, the robustness of their features, and the eventual impact on analysis. The stability of results was found to range from perfectly stable (i.e. all digits of data significant) to highly unstable (i.e. 0 - 1 significant digits). This paper highlights the potential of leveraging induced variance in estimates of brain connectivity to reduce the bias in networks without compromising reliability, alongside increasing the robustness and potential upper-bound of their applications in the classification of individual differences. We demonstrate that stability evaluations are necessary for understanding error inherent to brain imaging experiments, and how numerical analysis can be applied to typical analytical workflows both in brain imaging and other domains of computational sciences, as the techniques used were data and context agnostic and globally relevant. Overall, while the extreme variability in results due to analytical instabilities could severely hamper our understanding of brain organization, it also affords us the opportunity to increase the robustness of findings.

Links

PubMed: pubmed.ncbi.nlm.nih.gov/34724000/

DOI: 10.1371/journal.pone.0250755