Experimental Design Review—Before Results September 25, 2016Posted by stuffilikenet in Awesome, Brain, Brilliant words, Geek Stuff, Science.
BMC Psychology has taken a novel (actually, a scorched earth) approach to the problem of irreproducible results in psych studies. Peer reviews of submitted studies will be checked for experimental methods only, until the end of the review process. The thinking is, reviewers may be unconsciously biased by seeing results they agree with (or disagree with), rather than the value of the methods by which they were derived.
Given that as many as one-third of psych studies in a recent review (of a thousand studies) could not be reproduced, I think this is an excellent first step to cleaning house of cognitive biases.
Sadly, BMC Psychology is not one of the larger players in this field; it may be that this will enhance their prestige.