ReplicationSuccess

Provides utilities for the design and analysis of replication studies. Features both traditional methods based on statistical significance and more recent methods such as the sceptical p-value. Also provides related methods including the harmonic mean chi-squared test and intrinsic credibility. Contains datasets from four large-scale replication projects.

Installation

CRAN version:

install.packages("ReplicationSuccess")

Development version from github with latest developments:

devtools::install_github(repo = "crsuzh/ReplicationSuccess")

Introduction in vignette

To access the vignette from R use:

library("ReplicationSuccess")
vignette("ReplicationSuccess")

Publications

  • Held, L. (2019). The assessment of intrinsic credibility and a new argument for p < 0.005. Royal Society Open Science, 6(3):181534. https://doi.org/10.1098/rsos.181534

  • Held, L. (2020). A new standard for the analysis and design of replication studies (with discussion). Journal of the Royal Statistical Society: Series A (Statistics in Society). 183(2):431-448. https://doi.org/10.1111/rssa.12493

  • Held, L. (2020). The harmonic mean chi-squared test to substantiate scientific findings. Journal of the Royal Statistical Society: Series C (Applied Statistics). 69(3):697-708. https://doi.org/10.1111/rssc.12410

  • Pawel, S., Held, L. (2020). Probabilistic forecasting of replication studies. PLOS ONE. 15(4):e0231416. https://doi.org/10.1371/journal.pone.0231416

  • Micheloud, C., Held, L. (2021). Power Calculations for Replication Studies. Statistical Science. 37(3):369–379. https://doi.org/10.1214/21-STS828

  • Held, L., Micheloud, C., Pawel, S. (2022). The assessment of replication success based on relative effect size. The Annals of Applied Statistics. 16:706–720. https://doi.org/10.1214/21-AOAS1502

  • Micheloud, C., Balabdaoui, F., Held, L. (2023). Assessing replicability with the sceptical p-value: Type-I error control and sample size planning. Statistica Neerlandica. https://doi.org/10.1111/stan.12312

  • Held, L., Pawel, S., Micheloud, C. (2024). The assessment of replicability using the sum of p-values. Royal Society Open Science. 11(8):11240149. https://doi.org/10.1098/rsos.240149