• Home
  • Development of Heparin and HS Glycotherapeutics
  • Lab
  • People

Ferniglab Blog

The personal blog of Dave Fernig, thoughts on science and unrelated matters

Feeds:
Posts
Comments
« What is that ship?
Policing the police »

The burden of proof

July 28, 2014 by ferniglab


This post has been stimulated by a post on PubPeer entitled “A crisis of trust”
This post should be required reading for all engaged in research and in the management of the institutions involved in research, including funders and journal editors. I made a brief comment, relating to a sentence that is some way down the post:

“This could be done if together we invert the burden of proof. It should be your responsibility as a researcher to convince your peers, not theirs to prove you wrong”.

My comment was that it is tragic that anyone should have to write that sentence. Science can only progress through discussion of data and models that try to capture the meaning of those data. So if there is disagreement, the proposers of the model have to go back to the data. This will often need a “destructive” experiment, rather than a “me too” experiment, to be designed and done to test the validity of the critiques. That should be obvious.
Another useful read is Paul Brookes’ analysis of papers he received while at the helm of the late, lamented Science Fraud website, which he has published at PeerJ, entitled “Internet publicity of data problems in the bioscience literature correlates with enhanced corrective action“.

Paul Brookes’ analysis indicates that it is likely that public exposure increases the amount of corrective action. Though this gives a positive impression, all is not well. Looking over papers that have featured on Pubpeer on subjects where I have some competence, we clearly have evidence of trolling by or on behalf of the authors (see, for example, the gish gallop and trolling on this preprint the criticizes an entire oeuvre on nanoparticles).

The reader can look for themselves under the “featured” articles on Pubpeer, choosing any article with >10 comments to see a good number of gish gallops and trolls, while the authors are often conspicuously absent.

The corrective mechanism proposed in the PubPeer blog is hardly revolutionary: it is simply stating the obvious regarding the framework within which research should be conducted. I already run every paper I think of reading through PubPeer – I use it as a filter, to remove the chaff, on which I should not waste my time. In the future, I will doubtless use the availability of data as a filter too. If there are not publicly available data associated with a paper, I will not read.

It will take a few years though before I put such a filter into effect – the notional time is a couple of years after I manage to fully implement the recommendation for my own papers. This is simply to allow the community to figure out how to put their data in the public domain. It isn’t always easy to do this in a meaningful way and there will, for example, be a fair amount of wrestling with instrument proprietary data formats, etc.

For all who really are engaged in research, it is in our best interests to do so. Putting our data out there will give the reader the assurance that our papers actually mean what they say. In a world where metrics pollute advancement, this will only increase your citations, so win-win and the cheats may become increasingly irrelevant. At that point the statement in the PubPeer blog post could be amended to:

“The burden of proof to convince your peers is your responsibility as a researcher, not theirs to prove you wrong” and we can enjoy a beer together (virtual or otherwise) discussing data.

Advertisement

Share this:

  • Twitter
  • Facebook
  • LinkedIn

Like this:

Like Loading...

Related

Posted in Nanotechnology, Peer review, Post publication peer review, Research integrity, Science process, Science publishing | Tagged Nanoparticle, Nanotechnology, research, Research integrity, science, Science fraud, Science progress | 1 Comment

One Response

  1. on August 10, 2014 at 8:06 pm Mik VanEs

    I like to see the data if it is clear to me that something is very wrong. At that moment I already know that the report of the author cannot be trusted. For that purpose the data will not help much.



Comments are closed.

  • Places of interest

    The one and only PhD comics, the guide to being a graduate and to mentoring.

    Improbable Research and the Ig Nobels

    Retraction Watch provides updates on retractions of articles.

    Office for Research Integrity, their video should be compulsory for all.

    Centre for Alternative Technology

    Lateral Science, has some quite stunning information - well worth a browse.

    Fascinating places that have been closed by lawyers

    Science Fraud, shut down due to legal threats on Jan 3 2013. and Abnormal Science

  • Blogroll

    • WordPress.com
    • WordPress.org
  • Funding agencies

    • Biotechnology and Biological Sciences Research Council
    • Cancer and Polio Research Fund
    • Engineering and Physical Sciences Research Council
    • Liverpool Pancreas NIHR Biomedical Research Unit
    • Medical Research Council
    • North West Cancer Research
  • Seminars

    • Cancer Research UK Centre
  • July 2014
    M T W T F S S
     123456
    78910111213
    14151617181920
    21222324252627
    28293031  
    « Jun   Aug »
  • Archives

    • November 2022
    • July 2022
    • April 2022
    • March 2022
    • May 2021
    • March 2021
    • August 2020
    • June 2020
    • April 2020
    • March 2020
    • December 2019
    • October 2019
    • July 2019
    • May 2019
    • April 2019
    • January 2019
    • September 2018
    • August 2018
    • May 2018
    • April 2018
    • February 2018
    • January 2018
    • December 2017
    • November 2017
    • July 2017
    • June 2017
    • April 2017
    • March 2017
    • January 2017
    • October 2016
    • June 2016
    • May 2016
    • March 2016
    • January 2016
    • December 2015
    • July 2015
    • June 2015
    • May 2015
    • March 2015
    • February 2015
    • January 2015
    • December 2014
    • November 2014
    • October 2014
    • September 2014
    • August 2014
    • July 2014
    • June 2014
    • February 2014
    • January 2014
    • December 2013
    • October 2013
    • September 2013
    • August 2013
    • July 2013
    • June 2013
    • May 2013
    • April 2013
    • March 2013
    • February 2013
    • January 2013
    • December 2012
    • November 2012
    • October 2012
    • September 2012
    • August 2012
    • July 2012
    • June 2012
    • May 2012
    • April 2012
    • March 2012
    • February 2012
    • January 2012
    • November 2011
    • October 2011
    • September 2011
    • August 2011
    • July 2011
    • June 2011
    • May 2011
    • April 2011
    • March 2011
    • February 2011
    • January 2011
    • December 2010
    • November 2010
    • October 2010
    • September 2010
    • August 2010
  • Follow me on Twitter

    My Tweets
  • Cloud

    American Civil War antithrombin III banana Biological imaging biotechnology Brexit Choanoflagellates chocolate chondroitin sulfate coagulation Confederate States covid19 DN Lee Education EU EU referendum Europe extracellular matrix FGF Fibroblast growth factor Food FRET sensors Gish Gallop glycosaminoglycans GMO government Graduate students heparan sulfate heparin history of science imaging Irvine Stephens Bulloch James Bulloch James Dunwoody Bulloch Liverpool microbiology Nanoparticle Nanoparticles Nanotechnology neuroscience nmr Open Access Open Data orange Parliament Peer Review PhD polysaccharide port sunlight Post publication peer review protein chemistry REF research Research Excellence Framework Research integrity Roast SARS-CoV-2 science Science and Technology Committee Science fraud Science Funding Science progress Scientific American Seminars sorbet speaking strawberry sulfation Sulfotransferase synthetic biology Teaching technology transfer Tourism Travel Universities

Blog at WordPress.com.

WPThemes.


Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
To find out more, including how to control cookies, see here: Cookie Policy
  • Follow Following
    • Ferniglab Blog
    • Join 73 other followers
    • Already have a WordPress.com account? Log in now.
    • Ferniglab Blog
    • Customize
    • Follow Following
    • Sign up
    • Log in
    • Copy shortlink
    • Report this content
    • View post in Reader
    • Manage subscriptions
    • Collapse this bar
%d bloggers like this: