Tuesday, May 31, 2022

This provocation argues that up to 50% of the articles that are now being published in many interdisciplinary sustainability and transitions journals may be categorized as "scholarly bullshit"

Bullshit in the Sustainability and Transitions Literature: a Provocation. Julian Kirchherr. Circular Economy and Sustainability, May 20 2022. https://link.springer.com/article/10.1007/s43615-022-00175-9

Abstract: Research on sustainability and transitions is burgeoning. Some of this research is helping to solve humankind’s most pressing problems. However, as this provocation argues, up to 50% of the articles that are now being published in many interdisciplinary sustainability and transitions journals may be categorized as “scholarly bullshit.” These are articles that typically engage with the latest sustainability and transitions buzzword (e.g., circular economy), while contributing little to none to the scholarly body of knowledge on the topic. A typology of “scholarly bullshit” is proposed which includes the following archetypes: boring question scholarship, literature review of literature reviews, recycled research, master thesis madness, and activist rants. Since “scholarly bullshit” articles engage with the latest academic buzzwords, they also tend to accumulate significant citations and are thus welcomed by many journal editors. Citations matter most in the metric-driven logic of the academic system, and this type of scholarship, sadly, is thus unlikely to decrease in the coming years.

On the Root Causes of Scholarly Bullshit

There appears to be a lot of scholarly bullshit out there. A previous version of this manuscript stated that at least 50% of the articles published in sustainability and transitions journals may be categorized as scholarly bullshit. This figure has also been noted in the introduction. Two reviewers of this work asked how this figure has been developed. The author of this provocation has selected ca. 100 articles published recently on CE in well-known journals such as Journal of Cleaner Production, Ecological Economics, and Sustainability. The author could instantly categorize at least 50% of these articles in one of the five archetypes proposed in Table 1 and thus suggests that perhaps up to 50% of the articles that are now being published in many interdisciplinary sustainability and transitions journals could be categorized as “scholarly bullshit.” Admittedly, and at the risk of turning this provocation into a parody, the author notes that further work ought to be undertaken to strengthen this initial estimate. After all, ca. 100 articles are not representative of the vast scholarly CE literature and any set of articles ought to be coded by at least two scholars to ensure reliability.

The author also maintains that many scholars appear to agree that too much inferior quality is published in many sustainability and transitions journals. For instance, one of the reviewers of this paper noted in their review: “Interesting, provocative article […]. The author […] touches a topic that is […] a reality. I must say that I don't disagree with the general comment about the load and quality of papers published.” Meanwhile, the editor-in-chief of one of the most respected sustainability and transitions journal wrote to the author regarding an earlier version of this manuscript upon submission to their journal: “I may meet resistance from my co-editors, but I will defend your paper. This needs to be said.” (Sadly, the co-editors sacked the paper, and it then took a while until this provocation found a home in a respected peer-reviewed journal.)

Additionally, it appears that an increasing number of academicians in the field would agree that the share of scholarly bullshit is unlikely to decrease in the coming years. After all, if one searches journals such as Journal of Cleaner Production and Ecological Economics, one finds that articles containing the latest buzzwords, such as “circular economy,” are among the most cited pieces. Publishing such works has caused the impact factors of many journals to skyrocket. Accordingly, there is a certain fear among the editors of these journals that they will miss the next highly cited article. At the same time, the sheer volume and growth of this sustainability and transitions buzzword scholarship guarantees that almost any article on the topic will garner at least a modest number of citations.

This all also drives more and more authors into publishing on the very latest buzzword, e.g., “circular economy,” which creates a perpetuum mobile respectively vicious circle (depending on your perspective) regarding publications on such topics. Given this dynamic, the author of this work contends that, at this point, it is very difficult not to get a piece entailing the latest sustainability and transitions buzzword published in an at least relatively known peer-reviewed journal. All contributors (journal editors, authors) know they may be producing scholarly bullshit; however, publishing such works is advantageous for everyone involved in this contemporary academic system.

These scholarly bullshit publications, in turn, as also noted by a reviewer of this paper, are driven, from a roots cause perspective, by the need for tenure respectively the aim to secure promotion and funding. Those who seek this are usually required to demonstrate recognition of their work in the scholarly community which is operationalized by having published many highly cited works on a topic that is en vogue. People need permanent jobs and the desire to acquire funding and promotions is also understandable. It may thus not be fair to blame all academicians out there for churning out scholarly bullshit. Rather, the focus may be turned to the elites that have designed an academic system that mistakes publishing many highly cited papers for the advancement of science. In other words: the academic system is so focused on quantitative targets that it may have forgotten what these targets were supposed to measure.

Replacing this system with one that eventually produces less scholarly bullshit is no trivial task. Those running this system have proven significant staying power. However, some scholars in the field of sustainability and transitions literature and beyond still appear to/may be able to care about more than their h-index. The next time these scholars embark on a piece of research, they should ask themselves: “Is this me now merely adding to the pile of scholarly bullshit? Or am I contributing to the advancement of knowledge in my field?” And even those scholars who are driven by the metrics of the academic system may find that true contributions could gather the most recognition in the end.

No comments:

Post a Comment