\u00a0Image: Grace Gay for Research Professional News<\/p>\n
Author of 2023 Nature paper says analysis and conclusions hold despite peers\u2019 critique<\/p>\n
The co-author of a landmark paper on slowing rates of disruption in science has told\u00a0Research Professional News\u00a0he stands by its conclusions, despite criticism from other researchers. Those researchers, meanwhile, have maintained their criticisms despite the authors\u2019 pushback.<\/p>\n
The 2023 paper\u2014titled Papers and patents are becoming less disruptive over time\u2014by Michael Park, Erin Leahey and\u00a0Russell Funk was published in the journal Nature and has been cited hundreds of times. It reports an analysis of citations of millions of research papers and patents, which found such works have become \u201cincreasingly less likely to break with the past in ways that push science and technology in new directions\u201d.\u00a0<\/p>\n
This led Funk and colleagues to conclude there has been \u201ca fundamental shift in the nature of science and technology\u201d.<\/p>\n
Criticism and pushback<\/p>\n
On 12 August, Nature published a criticism of the analysis by five researchers, including corresponding authors Vincent Holst and Vincent Ginis of the Free University of Brussels (VUB).<\/p>\n
In a press release, VUB said the criticism\u00a0\u201cshows that [the original] conclusion was largely based on errors in the underlying data\u201d.<\/p>\n
It quoted Ginis as saying:\u00a0\u201cWhen we correct these errors, almost the entire decline reported in the original study disappears. That does not mean we can now conclude that science is actually becoming more groundbreaking. It does mean, however, that the earlier conclusion does not provide a reliable basis for such a claim.\u201d<\/p>\n
Ginis told Research Professional News that after applying a\u00a0\u201ccorrection\u201d to the analysis, \u201cthe effect sizes are small\u2026and very sensitive to modelling choices\u201d. He added: \u201cWe doubt the original work without the error would have been accepted and have the impact it had over the last years.\u201d<\/p>\n
Nature simultaneously published a response from Funk and colleagues, which says there were\u00a0\u201csevere quality issues\u201d in the data used by Holst, Ginis and colleagues. The response also says Funk and his colleagues conducted additional analyses using the methods of Holst and his colleagues, and produced a finding in line with their original one. Both teams criticised each other over the availability of some of their research materials.<\/p>\n
Speaking to RPN, Funk said:\u00a0\u201cDo I stand by the original work? Yes, absolutely, and even more so than ever before.\u201d\u00a0<\/p>\n
He added:\u00a0\u201cSince our 2023 paper, declining disruptiveness has been documented in nearly 100 independent studies.\u201d<\/p>\n
Nature\u2019s processes<\/p>\n
VUB and Ginis also criticised the approach Nature took to their contribution. They said the Belgian researchers first contacted the journal in early 2023 with their claims but Nature\u2019s response, in the form of a Matters Arising piece, was not published until three years later.<\/p>\n
\u201cIn the meantime, the original study continued to exert influence worldwide,\u201d said the VUB. \u201cWhilst the criticism was under review, Nature itself devoted another editorial and a news article to the original paper.\u201d<\/p>\n
Ginis said: \u201cThe original paper went from submission to cover story in at most 17 months. Our correction of a factual mistake took 32. During that time no notice of any kind appeared on the article, while it grew from 185 to over 1,200 citations and was cited in a US congressional hearing.\u201d<\/p>\n
\u201cIf science is to be self-correcting, substantiated critiques should be handled faster than original research, not twice as slowly, and articles under substantiated critique should carry a visible flag while the exchange is under review.\u201d\u00a0<\/p>\n
Nature response<\/p>\n
A spokesperson for Nature said post-publication commentary plays an \u201cimportant role\u201d in advancing scientific discourse and that Nature\u2019s Matters Arising publications support this.<\/p>\n
They added that Matters Arising articles are sent to the authors of the papers they relate to and that both can then be sent for peer review before publication, which they said was the case here. The length of time this all takes, they said, \u201cvaries depending on the complexity of the issues being considered and the review process required\u201d.<\/p>\n
\u201cIn this case, we published both the Matters Arising article and a reply from the authors of the original paper,\u201d they added. \u201cThe publication of both articles ensures that readers have access to the full scientific exchange and can evaluate the arguments presented.\u201d<\/p>\n","protected":false},"excerpt":{"rendered":"\u00a0Image: Grace Gay for Research Professional News Author of 2023 Nature paper says analysis and conclusions hold despite…\n","protected":false},"author":2,"featured_media":572555,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[7],"tags":[111,139,69,147],"class_list":["post-572554","post","type-post","status-publish","format-standard","has-post-thumbnail","category-science","tag-new-zealand","tag-newzealand","tag-nz","tag-science"],"_links":{"self":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/572554","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/comments?post=572554"}],"version-history":[{"count":0,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/posts\/572554\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media\/572555"}],"wp:attachment":[{"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/media?parent=572554"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/categories?post=572554"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www.newsbeep.com\/nz\/wp-json\/wp\/v2\/tags?post=572554"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}