Systems and complexity

Pipeline project aims to improve reproducibility of scientific research

Science is currently facing a reproducibility crisis, where many “facts” established through experiment don’t hold up to repeated investigation.

As we discussed in a recent article, the field of psychology has been prominent in the reproducibility crisis, with a Reproducibility Initiative project successfully replicating only 40% of the 100 psychological experiments repeated in the project.

An article in The Atlantic describes a new initiative called The Pipeline Project, which aims to help address the crisis through the independent replication of research results before they are published in journals.

INSEAD researcher Eric Uhlmann, initiator of The Pipeline Project, has led by example by inviting 25 independent teams to repeat all of his group’s unpublished experiments before he submitted them to academic journals:

Six findings replicated according to all replication criteria, one finding replicated but with a significantly smaller effect size than the original, one finding replicated consistently in the original culture but not outside of it, and two findings failed to find support. In total, 40% of the original findings failed at least one major replication criterion.

Retraction Watch has interviewed Eric Uhlmann and also Martin Schweinsberg, who is first author of The Pipeline Project paper. The interview includes discussion of how the Pre-Publication Independent Replication (PPIR) approach can be implemented and incentivised.


Also published on Medium.

Bruce Boyes

Bruce Boyes (www.bruceboyes.info) is editor, lead writer, and a director of the award-winning RealKM Magazine (www.realkm.com) and currently also teaches in the University of NSW (UNSW) Foundation Studies program in China. He has expertise and experience in a wide range of areas including knowledge management (KM), environmental management, program and project management, writing and editing, stakeholder engagement, communications, and research. Bruce holds a Master of Environmental Management with Distinction and a Certificate of Technology (Electronics). With a demonstrated ability to identify and implement innovative solutions to social and ecological complexity, Bruce's many career highlights include establishing RealKM Magazine as an award-winning resource for knowledge managers, using agile and knowledge management approaches to oversee the implementation of an award-winning $77.4 million river recovery program in western Sydney on time and under budget, leading a knowledge strategy process for Australia's 56 natural resource management (NRM) regional organisations, pioneering collaborative learning and governance approaches to support communities to sustainably manage landscapes and catchments, and initiating and teaching two new knowledge management subjects at Shanxi University in China.

Related Articles

Leave a Reply

Your email address will not be published. Required fields are marked *

This site uses Akismet to reduce spam. Learn how your comment data is processed.

Back to top button