• Home
  • Development of Heparin and HS Glycotherapeutics
  • Lab
  • People

Ferniglab Blog

The personal blog of Dave Fernig, thoughts on science and unrelated matters

Feeds:
Posts
Comments
« We are afraid
Not one, but two papers on fibroblast growth factors and glycosaminoglycans »

Can we evaluate ourselves without journals?

March 15, 2016 by ferniglab


This is a question raised at the end of the excellent article by @Amy_Harmon regarding Open Access and preprints is can biomedical scientists evaluate each other without journals?

The short answer is a resounding yes.  Physical scientists and mathematicians have been posting much of their research as preprints on arXiv for a few decades, with no prejudice to their ability to evaluate the quality of work or of individuals.

The counter argument raised by many in biomedical sciences, from scientists to some journal editors can be boiled down quite simply: We are special and cannot possibly do this.

Various arguments are put forward, from competition (=fear of scooping) to intellectual property. These arguments are heard in many biomedical/biology departments, sometimes leading to quite heated discussions. It is also interesting to note that the defenders of the status quo are not necessarily the older members of the community.

There is a simple answer. Yes you are special, but not in the good sense of the word.

Competition. Here, I fear the answers are rather brutal. If you are in a competitive situation, so a race, then the preprint gives you priority. I would add that most arguments that use competition stem from a lack of creativity. Why on earth are you doing the same work as 6 other labs? The natural world is so vast that a little bit of lateral thinking will rapidly provide many alternatives, which will generate novel insights. There are a very large number of of proteins encoded in the human genome with 0-100 papers. No need to be a sheep. Baaaaaaaaaaa.

IP. This is a non-argument. If there is IP and you wish to protect it, then do so. After this task is completed, you can happily submit preprint and manuscript.

So to return to Amy’s question, an answer by way of anecdote. Dinah Birch, Professor of English at Liverpool University had the unenviable task of running the University’s last REF submission. In my opinion (having had a deep involvement in this) she accomplished this brilliantly and through her leadership delivered a fantastic result (in terms of financial return, which is the name of the game) for the Faculty of Health and Life Sciences (I am not competent to judge how the other Faculties performed). How did she do this? Perhaps not surprisingly given her academic background, she insisted we preformed “Reading Exercises”. Yes, we read our colleagues’ papers, 100s of them.  Our reading provided the necessary information for ranking, which was pretty successful. We even read papers we were unsure about in committee, on a giant screen in the IACD boardroom.

In the end, we read. We cannot use a proxy – the cover or a talk. We have to read. This is what we did as graduate students and what we do as professors. Reading nowadays also means re-analysing data (if these are available). Easy in some fields (e.g., structural biology, genomics), becoming easier in others (e.g., mass spectrometry), almost impossible in many others, but that is changing.

If one tries to use a proxy (journal cover, metrics, name, etc.) as a proxy, one makes horrible mistakes, including in hiring. The clear lesson from data manipulation and ethical scandals, past and brewing, is if you hire on the basis of the cover, your institution is much more likely to have a mess to clear up. My own university had a close call on this front with Melendez – happily he didn’t publish while he was here.

Of course one can make mistakes when reading. However, if reading is ‘public’, that is there is a forum for commenting, such as PubPeer, then while individuals may overlook certain issues and questions, collectively most questions are eventually raised.

So we definitely need reading material to understand a piece of research, but the cover is immaterial.

However, from an aesthetic point of view, the cover, typesetting and so on do add to the reading experience. But here we need to be rational. Few papers are of such scientific and literary merit that they deserve the efforts of skilled typesetters and printers, to then be hard bound in leather before they can grace our desks. A more modest typesetting is pretty cheap and very effective. Have a look at PeerJ who in my experience have the best submission and production set up.

Advertisement

Share this:

  • Twitter
  • Facebook
  • LinkedIn

Like this:

Like Loading...

Related

Posted in Science process, Science publishing, Scientific progress | Tagged REF, research, Research Excellence Framework, science, Science progress | 1 Comment

One Response

  1. on March 16, 2016 at 3:26 pm protohedgehog

    Reblogged this on Green Tea and Velociraptors and commented:
    Great post on how academics evaluate research. Time to move beyond poor proxies. Also relevant to this post: http://blog.scienceopen.com/2016/03/collections-as-the-future-of-academic-led-journals/



Comments are closed.

  • Places of interest

    The one and only PhD comics, the guide to being a graduate and to mentoring.

    Improbable Research and the Ig Nobels

    Retraction Watch provides updates on retractions of articles.

    Office for Research Integrity, their video should be compulsory for all.

    Centre for Alternative Technology

    Lateral Science, has some quite stunning information - well worth a browse.

    Fascinating places that have been closed by lawyers

    Science Fraud, shut down due to legal threats on Jan 3 2013. and Abnormal Science

  • Blogroll

    • WordPress.com
    • WordPress.org
  • Funding agencies

    • Biotechnology and Biological Sciences Research Council
    • Cancer and Polio Research Fund
    • Engineering and Physical Sciences Research Council
    • Liverpool Pancreas NIHR Biomedical Research Unit
    • Medical Research Council
    • North West Cancer Research
  • Seminars

    • Cancer Research UK Centre
  • March 2016
    M T W T F S S
     123456
    78910111213
    14151617181920
    21222324252627
    28293031  
    « Jan   May »
  • Archives

    • November 2022
    • July 2022
    • April 2022
    • March 2022
    • May 2021
    • March 2021
    • August 2020
    • June 2020
    • April 2020
    • March 2020
    • December 2019
    • October 2019
    • July 2019
    • May 2019
    • April 2019
    • January 2019
    • September 2018
    • August 2018
    • May 2018
    • April 2018
    • February 2018
    • January 2018
    • December 2017
    • November 2017
    • July 2017
    • June 2017
    • April 2017
    • March 2017
    • January 2017
    • October 2016
    • June 2016
    • May 2016
    • March 2016
    • January 2016
    • December 2015
    • July 2015
    • June 2015
    • May 2015
    • March 2015
    • February 2015
    • January 2015
    • December 2014
    • November 2014
    • October 2014
    • September 2014
    • August 2014
    • July 2014
    • June 2014
    • February 2014
    • January 2014
    • December 2013
    • October 2013
    • September 2013
    • August 2013
    • July 2013
    • June 2013
    • May 2013
    • April 2013
    • March 2013
    • February 2013
    • January 2013
    • December 2012
    • November 2012
    • October 2012
    • September 2012
    • August 2012
    • July 2012
    • June 2012
    • May 2012
    • April 2012
    • March 2012
    • February 2012
    • January 2012
    • November 2011
    • October 2011
    • September 2011
    • August 2011
    • July 2011
    • June 2011
    • May 2011
    • April 2011
    • March 2011
    • February 2011
    • January 2011
    • December 2010
    • November 2010
    • October 2010
    • September 2010
    • August 2010
  • Follow me on Twitter

    My Tweets
  • Cloud

    American Civil War antithrombin III banana Biological imaging biotechnology Brexit Choanoflagellates chocolate chondroitin sulfate coagulation Confederate States covid19 DN Lee Education EU EU referendum Europe extracellular matrix FGF Fibroblast growth factor Food FRET sensors Gish Gallop glycosaminoglycans GMO government Graduate students heparan sulfate heparin history of science imaging Irvine Stephens Bulloch James Bulloch James Dunwoody Bulloch Liverpool microbiology Nanoparticle Nanoparticles Nanotechnology neuroscience nmr Open Access Open Data orange Parliament Peer Review PhD polysaccharide port sunlight Post publication peer review protein chemistry REF research Research Excellence Framework Research integrity Roast SARS-CoV-2 science Science and Technology Committee Science fraud Science Funding Science progress Scientific American Seminars sorbet speaking strawberry sulfation Sulfotransferase synthetic biology Teaching technology transfer Tourism Travel Universities

Create a free website or blog at WordPress.com.

WPThemes.


Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
To find out more, including how to control cookies, see here: Cookie Policy
  • Follow Following
    • Ferniglab Blog
    • Join 73 other followers
    • Already have a WordPress.com account? Log in now.
    • Ferniglab Blog
    • Customize
    • Follow Following
    • Sign up
    • Log in
    • Copy shortlink
    • Report this content
    • View post in Reader
    • Manage subscriptions
    • Collapse this bar
%d bloggers like this: