Failure journals
One of the biggest problems in science is the positive publication bias. A study that produces a positive result such as “kombucha cures acne” get published, but the hundreds of studies that find that “kombucha has no effect on skin quality” never get published, they remain unpublished in the researcher’s file drawer.
The problem of unpublished negative results has led to various initiatives. One solution is to have journals dedicated solely to publishing failed research – failure journals.
An unpublished study (see the trend here?) in 2023 found 19 journals and projects focusing on publishing null findings, inconclusive or negative results. The vast majority of these Failure Journals failed (74%), only 5 remain active. The Museum of Failure also tried and failed to launch our own Journal of Failure despite interest from publishers and the scientific community. Why do they fail?
The Journal of Trial and Error is a journal that publishes negative and null results as well as research on the scientific process itself. When the founders first pitched their idea for a journal that ‘aims to make public the lessons of the struggles in research’, they were met with enthusiastic responses from all over the scientific community. Not only philosophers of science, but also natural and social scientists applauded the idea. Regardless of who they spoke to, everyone was familiar with the problem of positive publication bias and was glad that something was being done to address it.
However, when the scientists were asked whether they themselves would send something in, the vast majority were hesitant or outright refused. This is the reason “Failure Journals” do not survive.
Researchers are afraid that their reputation will suffer if they published “failed research”, negative or null results. Even though the vast majority of scientists indicate that they think publishing negative results is valuable, they all appear to be afraid to be judged by their peers. Researchers are also reluctant to invest time into writing articles describing null-results research, they prefer to move on to new research that will potentially lead to those coveted positive results.
The first issue of the Journal of Trial and Error was published in 2020. Here are a few examples of published articles:
• Empathic Accuracy, Mindfulness, and Facial Emotion Recognition: An Experimental Study
• No Meaningful Difference in Attentional Bias Between Daily and Non-Daily Smokers
• Alcohol Cues and their Effects on Sexually Aggressive Thoughts
• Smile, You’re on Camera: Investigating the Relationship between Selfie Smiles and Distress
Please consider supporting the journal with a donation.
