Publication:
The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline

Simple item page
dc.contributor.authorTierney, Warren
dc.contributor.authorSchweinsberg, Martín
dc.contributor.authorJordan, Jennifer
dc.contributor.authorKennedy, Deanna
dc.contributor.authorQureshi, Israr
dc.contributor.authorSommer, Amy
dc.contributor.authorThornley, Nico
dc.contributor.authorMadan, Nikhil
dc.contributor.authorVianello, Michelangelo
dc.contributor.authorAwtrey, Eli
dc.contributor.authorZhu, Luke Lei
dc.contributor.authorDiermeier, Daniel
dc.contributor.authorHeinze, Justin
dc.contributor.authorSrinivasan, Malavika
dc.contributor.authorTannenbaum, David
dc.contributor.authorBivolaru, Eliza
dc.contributor.authorDana, Jason
dc.contributor.authorDavis Stober, Clintin
dc.contributor.authorDu Plessis, Christilene
dc.contributor.authorGronau, Quentin
dc.contributor.authorHafenbrack, Andrew
dc.contributor.authorLiao, Eko Yi
dc.contributor.authorLy, Alexander
dc.contributor.authorMarsman, Maarten
dc.contributor.authorMurase, Toshio
dc.contributor.authorSchaerer, Michael
dc.contributor.authorTworek, Christina
dc.contributor.authorWagenmakers, Eric Jan
dc.contributor.authorWong, Lynn
dc.contributor.authorAnderson, Tabitha
dc.contributor.authorBauman, Christopher
dc.contributor.authorBedwell, Wendy
dc.contributor.authorBrescoll, Victoria
dc.contributor.authorCanavan, Andrew
dc.contributor.authorChandler, Jesse
dc.contributor.authorCheries, Erik
dc.contributor.authorCheryan, Sapna
dc.contributor.authorCheung, Felix
dc.contributor.authorCimpian, Andrei
dc.contributor.authorClark, Mark
dc.contributor.authorCordon, Diana
dc.contributor.authorCushman, Fiery
dc.contributor.authorDitto, Peter
dc.contributor.authorAmell, Alice
dc.contributor.authorFrick, Sarah
dc.contributor.authorGamez Djokic, Monica
dc.contributor.authorGrady, Rebecca Hofstein
dc.contributor.authorGraham, Jesse
dc.contributor.authorGu, Jun
dc.contributor.authorHahn, Adam
dc.contributor.authorHanson, Brittany
dc.contributor.authorHartwich, Nicole
dc.contributor.authorHein, Kristie
dc.contributor.authorInbar, Yoel
dc.contributor.authorJiang, Lily
dc.contributor.authorKellogg, Tehlyr
dc.contributor.authorLegate, Nicole
dc.contributor.authorLuoma, Timo
dc.contributor.authorMaibeucher, Heidi
dc.contributor.authorMeindl, Peter
dc.contributor.authorMiles, Jennifer
dc.contributor.authorMislin, Aalexandra
dc.contributor.authorMolden, Daniel
dc.contributor.authorMotyl, Matt
dc.contributor.authorNewman, George
dc.contributor.authorNgo, Hoai Huong
dc.contributor.authorPackham, Harvey
dc.contributor.authorRamsay, Scott
dc.contributor.authorRay, Jennifer
dc.contributor.authorSackett, Aaron
dc.contributor.authorSellier, Anne Laure
dc.contributor.authorSokolova, Tatiana
dc.contributor.authorSowden, Walter
dc.contributor.authorStorage, Daniel
dc.contributor.authorSun, Xiaomin
dc.contributor.authorVan Bavel, Jay
dc.contributor.authorWashburn, Anthony
dc.contributor.authorWei, Cong
dc.contributor.authorWetter, Erick
dc.contributor.authorWilson, Carlos
dc.contributor.authorDarroux, Sophie Charlotte
dc.contributor.authorUhlmann, Eric Luis
dc.contributor.funderInstitut Européen d'Administration des Affaires
dc.date.accessioned2024-07-08T13:14:55Z
dc.date.accessioned2024-09-16T11:20:35Z
dc.date.available2024-07-08T13:14:55Z
dc.date.available2024-09-16T11:20:35Z
dc.date.issued2016
dc.description.abstractThis crowdsourced project introduces a collaborative approach to improving the reproducibility of scientific research,in which findings are replicated in qualified independent laboratories before (rather than after) they are published. Our goal is to establish a non-adversarial replication process with highly informative final results. To illustrate the Pre-Publication Independent Replication (PPIR) approach,25 research groups conducted replications of all ten moral judgment effects which the last author and his collaborators had “in the pipeline” as of August 2014. Six findings replicated according to all replication criteria,one finding replicated but with a significantly smaller effect size than the original,one finding replicated consistently in the original culture but not outside of it,and two findings failed to find support. In total,40% of the original findings failed at least one major replication criterion. Potential ways to implement and incentivize pre-publication independent replication on a large scale are discussed. © 2015 The Authors
dc.description.fundingtypeThe first, second and last authors contributed equally to the project. Eric Luis Uhlmann designed the Pipeline Project and wrote the initial project proposal. Martin Schweinsberg, Nikhil Madan, Michelangelo Vianello, Amy Sommer, Jennifer Jordan, Warren Tierney, Eli Awtrey and Luke (Lei) Zhu served as project coordinators. Daniel Diermeier, Justin E. Heinze, Malavika Srinivasan, David Tannenbaum, Eric Luis Uhlmann and Luke Zhu contributed original studies for replication. Michelangelo Vianello, Jennifer Jordan, Amy Sommer, Eli Awtrey, Eliza Bivolaru, Jason Dana, Clintin P. Davis-Stober, Christilene du Plessis, Quentin F. Gronau, Andrew C. Hafenbrack, Eko Yi Liao, Alexander Ly, Maarten Marsman, Toshio Murase, Israr Qureshi, Michael Schaerer, Nico Thornley, Christina M. Tworek, Eric-Jan Wagenmakers and Lynn Wong helped analyze the data. Eli Awtrey, Jennifer Jordan, Amy Sommer, Tabitha Anderson, Christopher W. Bauman, Wendy L. Bedwell, Victoria Brescoll, Andrew Canavan, Jesse J. Chandler, Erik Cheries, Sapna Cheryan, Felix Cheung, Andrei Cimpian, Mark A. Clark, Diana Cordon, Fiery Cushman, Peter Ditto, Thomas Donahue, Sarah E. Frick, Monica Gamez-Djokic, Rebecca Hofstein Grady, Jesse Graham, Jun Gu, Adam Hahn, Brittany E. Hanson, Nicole J. Hartwich, Kristie Hein, Yoel Inbar, Lily Jiang, Tehlyr Kellogg, Deanna M. Kennedy, Nicole Legate, Timo P. Luoma, Heidi Maibuecher, Peter Meindl, Jennifer Miles, Alexandra Mislin, Daniel Molden, Matt Motyl, George Newman, Hoai Huong Ngo. Harvey Packham, Philip S. Ramsay, Jennifer Lauren Ray, Aaron M. Sackett, Anne-Laure Sellier, Tatiana Sokolova, Walter Sowden, Daniel Storage, Xiaomin Sun, Christina M. Tworek, Jay J. van Bavel, Anthony N. Washburn, Cong Wei, Erik Wetter and Carlos T. Wilson carried out the replications. Adam Hahn, Nicole Hartwich, Timo Luoma, Hoai Huong Ngo and Sophie-Charlotte Darroux translated study materials from English into the local language. Eric Luis Uhlmann and Martin Schweinsberg wrote the first draft of the paper and numerous authors provided feedback, comments and revisions. Correspondence concerning this paper should be addressed to Martin Schweinsberg, Boulevard de Constance, 77305 Fontainebleau, France, martin.schweinsberg@insead.edu or to Eric Luis Uhlmann, INSEAD Organizational Behavior Area, 1 Ayer Rajah Avenue 138676 Singapore eric.uhlmann@insead.edu . The Pipeline Project was generously supported by an R&D grant from INSEAD.
dc.description.keywordCrowdsourcing science
dc.description.keywordMeta-science
dc.description.keywordMethodology
dc.description.keywordReplication
dc.description.keywordReproducibility
dc.description.keywordResearch transparency
dc.formatapplication/pdf
dc.identifier.citationSchweinsberg, M., Madan, N., Vianello, M., Sommer, S. A., Jordan, J., Tierney, W., ... & Uhlmann, E. L. (2016). The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline. Journal of Experimental Social Psychology, 66, 55-67.
dc.identifier.doihttps://doi.org/10.1016/j.jesp.2015.10.001
dc.identifier.issn221031
dc.identifier.officialurlhttps://www.scopus.com/inward/record.uri?eid=2-s2.0-84977144634&doi=10.1016%2fj.jesp.2015.10.001&partnerID=40&md5=e28887ed06920df6925bb47130843163
dc.identifier.urihttps://hdl.handle.net/20.500.14417/3274
dc.journal.titleJournal of Experimental Social Psychology
dc.language.isoeng
dc.page.final67
dc.page.initial55
dc.page.total0
dc.publisherAcademic Press Inc.
dc.relation.departmentEnvironmental Sciences
dc.relation.schoolIE School of Science & Technology
dc.rightsAttribution-NonCommercial-NoDerivatives 4.0 International
dc.rights.accessRightsinfo:eu-repo/semantics/openAccess
dc.rights.urihttps://creativecommons.org/licenses/by-nc-nd/4.0/
dc.subject.othercrowdsourcing
dc.subject.othereffect size
dc.subject.othermorality
dc.subject.otherpipeline
dc.subject.otherpublication
dc.subject.otherreproducibility
dc.titleThe pipeline project: Pre-publication independent replications of a single laboratory's research pipeline
dc.typeinfo:eu-repo/semantics/article
dc.version.typeinfo:eu-repo/semantics/publishedVersion
dc.volume.number66
dspace.entity.typePublication
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
The pipeline project: Pre-publication independent replications of a single laboratory's research pipeline.pdf
Size:
823.19 KB
Format:
Adobe Portable Document Format
Download
Collections
Research Articles