Open Access Journal

ISSN: 2183-2439

Article | Open Access

Standardized Sampling for Systematic Literature Reviews (STAMP Method): Ensuring Reproducibility and Replicability

Full Text   PDF (free download)
Views: 218 | Downloads: 159

Abstract:  Systematic literature reviews (SLRs) are an effective way of mapping a research field and synthesizing research evidence. However, especially in communication research, SLRs often include diverse theories and methods, which come with a considerable downside in terms of reproducibility and replicability. As a response to this problem, the present article introduces the method of standardized sampling for systematic literature reviews (STAMP). The method is a structured, four-stage approach that is centered around score-based screening decisions. Originating from principles of standardized content analysis, a method common in communication research, and supplementing established guidelines like Cochrane or PRISMA, the STAMP method contributes to more transparent, reproducible, and replicable SLR sampling processes. As we illustrate throughout the article, the method is adaptable to various SLR types. The article also discusses the method’s limitations, such as potential coder effects and comparatively high resource intensity. To facilitate the application of STAMP, we provide a comprehensive guideline via the Open Science Framework that offers a succinct overview for quick reference and includes practical examples for different types of SLRs.

Keywords:  content analysis; replicability; reproducibility; STAMP method; standardized sampling; systematic literature review



© Ayanda Rogge, Luise Anter, Deborah Kunze, Kristin Pomsel, Gregor Willenbrock. This is an open access article distributed under the terms of the Creative Commons Attribution 4.0 license (, which permits any use, distribution, and reproduction of the work without further permission provided the original author(s) and source are credited.