Benjamin J. Griffiths

MetaArXiv · 2025 · preprint

The EEGManyPipelines dataset: Metascientific data on 168 independent analyses of a single EEG dataset

Elena Cesnaite, Andrea Vitale, Annalisa Pascarella & EEGManyPipelines Consortium

download pdfbiorxivdoi

abstract

There is a growing need for large-scale, global studies in response to the replication crisis, which has raised concerns across many scientific fields and prompted efforts to understand the sources of variability in research outcomes. Here we describe the EEGManyPipelines dataset: a many-analyst study aiming to examine how differences in electrophysiology (EEG) data analysis may contribute to differences in the results. We describe data shared and analyzed by 168 analyst teams. The original shared raw data consisted of behavioral data and EEG recordings of 33 participants performing a long-term memory task, together with 8 hypotheses regarding event-related potentials and time-frequency effects. Analyst teams also provided meta-scientific data detailing analysts' approach to hypotheses: processed EEG data, scripts, and answers to questionnaires. We propose this unique dataset for future use to study analytical flexibility, research culture, and scientific decision-making. It offers a valuable tool for meta-scientific, global and multicenter studies, EEG methodology, and reproducibility studies.

cite

Cesnaite, E., Vitale, A., Pascarella, A., & EEGManyPipelines Consortium (2025). The EEGManyPipelines dataset: Metascientific data on 168 independent analyses of a single EEG dataset. MetaArXiv. https://doi.org/10.31222/osf.io/c4xwg_v1

bibtex
@misc{cesnaite_2025_eegmanypipelines,
  title = {{The EEGManyPipelines dataset: Metascientific data on 168 independent analyses of a single EEG dataset}},
  author = {Cesnaite, Elena and Vitale, Andrea and Pascarella, Annalisa and EEGManyPipelines Consortium},
  howpublished = {MetaArXiv},
  year = {2025},
  doi = {10.31222/osf.io/c4xwg_v1}
}

← all papers