Schweinsberg, Martin, Madan, Nikhil, Vianello, Michelangelo ORCID: 0000-0002-1530-1469, Sommer, S. Amy, Jordan, Jennifer ORCID: 0000-0002-5130-7382, Tierney, Warren, Awtrey, Eli, Zhu, Luke Lei, Diermeier, Daniel, Heinze, Justin E., Srinivasan, Malavika, Tannenbaum, David, Bivolaru, Eliza, Dana, Jason, Davis-Stober, Clintin P., du Plessis, Christilene, Gronau, Quentin F., Hafenbrack, Andrew C., Liao, Eko Yi, Ly, Alexander ORCID: 0000-0003-3925-3833, Marsman, Maarten, Murase, Toshio, Qureshi, Israr, Schaerer, Michael ORCID: 0000-0002-2397-9552, Thornley, Nico, Tworek, Christina M., Wagenmakers, Eric -Jan, Wong, Lynn, Anderson, Tabitha, Bauman, Christopher W., Bedwell, Wendy L., Brescoll, Victoria, Canavan, Andrew, Chandler, Jesse J., Cheries, Erik, Cheryan, Sapna, Cheung, Felix ORCID: 0000-0002-7826-7405, Cimpian, Andrei ORCID: 0000-0002-3553-6097, Clark, Mark A., Cordon, Diana, Cushman, Fiery, Ditto, Peter H., Donahue, Thomas, Frick, Sarah E., Gamez-Djokic, Monica, Grady, Rebecca Hofstein, Graham, Jesse, Gu, Jun, Hahn, Adam ORCID: 0000-0002-2232-4976, Hanson, Brittany E., Hartwich, Nicole J., Hein, Kristie, Inbar, Yoel, Jiang, Lily, Kellogg, Tehlyr, Kennedy, Deanna M., Legate, Nicole ORCID: 0000-0001-8086-9643, Luoma, Timo P., Maibuecher, Heidi, Meindl, Peter, Miles, Jennifer, Mislin, Alexandra, Molden, Daniel C., Motyl, Matt, Newman, George, Packham, Harvey, Ramsay, Philip S., Ray, Jennifer L., Sackett, Aaron M., Sellier, Anne-Laure, Sokolova, Tatiana, Sowden, Walter, Storage, Daniel, Sun, Xiaomin, Van Bavel, Jay J., Washburn, Anthony N., Wei, Cong ORCID: 0000-0002-6804-8508, Wetter, Erik, Wilson, Carlos T., Darroux, Sophie-Charlotte and Uhlmann, Eric Luis (2016). The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline. J. Exp. Soc. Psychol., 66. S. 55 - 68. SAN DIEGO: ACADEMIC PRESS INC ELSEVIER SCIENCE. ISSN 1096-0465

Full text not available from this repository.

Abstract

This crowdsourced project introduces a collaborative approach to improving the reproducibility of scientific research, in which findings are replicated in qualified independent laboratories before (rather than after) they are published. Our goal is to establish a non-adversarial replication process with highly informative final results. To illustrate the Pre-Publication Independent Replication (PPIR) approach, 25 research groups conducted replications of all ten moral judgment effects which the last author and his collaborators had in the pipeline as of August 2014. Six findings replicated according to all replication criteria, one finding replicated but with a significantly smaller effect size than the original, one finding replicated consistently in the original culture but not outside of it, and two findings failed to find support. In total, 40% of the original findings failed at least one major replication criterion. Potential ways to implement and incentivize pre-publication independent replication on a large scale are discussed. (C) 2015 The Authors. Published by Elsevier Inc.

Item Type: Journal Article
Creators:
CreatorsEmailORCIDORCID Put Code
Schweinsberg, MartinUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Madan, NikhilUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Vianello, MichelangeloUNSPECIFIEDorcid.org/0000-0002-1530-1469UNSPECIFIED
Sommer, S. AmyUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Jordan, JenniferUNSPECIFIEDorcid.org/0000-0002-5130-7382UNSPECIFIED
Tierney, WarrenUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Awtrey, EliUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Zhu, Luke LeiUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Diermeier, DanielUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Heinze, Justin E.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Srinivasan, MalavikaUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Tannenbaum, DavidUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Bivolaru, ElizaUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Dana, JasonUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Davis-Stober, Clintin P.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
du Plessis, ChristileneUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Gronau, Quentin F.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Hafenbrack, Andrew C.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Liao, Eko YiUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Ly, AlexanderUNSPECIFIEDorcid.org/0000-0003-3925-3833UNSPECIFIED
Marsman, MaartenUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Murase, ToshioUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Qureshi, IsrarUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Schaerer, MichaelUNSPECIFIEDorcid.org/0000-0002-2397-9552UNSPECIFIED
Thornley, NicoUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Tworek, Christina M.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Wagenmakers, Eric -JanUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Wong, LynnUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Anderson, TabithaUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Bauman, Christopher W.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Bedwell, Wendy L.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Brescoll, VictoriaUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Canavan, AndrewUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Chandler, Jesse J.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Cheries, ErikUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Cheryan, SapnaUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Cheung, FelixUNSPECIFIEDorcid.org/0000-0002-7826-7405UNSPECIFIED
Cimpian, AndreiUNSPECIFIEDorcid.org/0000-0002-3553-6097UNSPECIFIED
Clark, Mark A.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Cordon, DianaUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Cushman, FieryUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Ditto, Peter H.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Donahue, ThomasUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Frick, Sarah E.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Gamez-Djokic, MonicaUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Grady, Rebecca HofsteinUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Graham, JesseUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Gu, JunUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Hahn, AdamUNSPECIFIEDorcid.org/0000-0002-2232-4976UNSPECIFIED
Hanson, Brittany E.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Hartwich, Nicole J.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Hein, KristieUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Inbar, YoelUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Jiang, LilyUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Kellogg, TehlyrUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Kennedy, Deanna M.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Legate, NicoleUNSPECIFIEDorcid.org/0000-0001-8086-9643UNSPECIFIED
Luoma, Timo P.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Maibuecher, HeidiUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Meindl, PeterUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Miles, JenniferUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Mislin, AlexandraUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Molden, Daniel C.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Motyl, MattUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Newman, GeorgeUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Packham, HarveyUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Ramsay, Philip S.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Ray, Jennifer L.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Sackett, Aaron M.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Sellier, Anne-LaureUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Sokolova, TatianaUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Sowden, WalterUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Storage, DanielUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Sun, XiaominUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Van Bavel, Jay J.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Washburn, Anthony N.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Wei, CongUNSPECIFIEDorcid.org/0000-0002-6804-8508UNSPECIFIED
Wetter, ErikUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Wilson, Carlos T.UNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Darroux, Sophie-CharlotteUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
Uhlmann, Eric LuisUNSPECIFIEDUNSPECIFIEDUNSPECIFIED
URN: urn:nbn:de:hbz:38-265701
DOI: 10.1016/j.jesp.2015.10.001
Journal or Publication Title: J. Exp. Soc. Psychol.
Volume: 66
Page Range: S. 55 - 68
Date: 2016
Publisher: ACADEMIC PRESS INC ELSEVIER SCIENCE
Place of Publication: SAN DIEGO
ISSN: 1096-0465
Language: English
Faculty: Unspecified
Divisions: Unspecified
Subjects: no entry
Uncontrolled Keywords:
KeywordsLanguage
PSYCHOLOGY; REPLICABILITY; FLEXIBILITY; CONFIDENCE; ECONOMISTS; RESPONSES; INCREASE; CRISIS; FUTURE; TRUTHMultiple languages
Psychology, SocialMultiple languages
Refereed: Yes
URI: http://kups.ub.uni-koeln.de/id/eprint/26570

Downloads

Downloads per month over past year

Altmetric

Export

Actions (login required)

View Item View Item