• Home
  • Development of Heparin and HS Glycotherapeutics
  • Lab
  • People

Ferniglab Blog

The personal blog of Dave Fernig, thoughts on science and unrelated matters

Feeds:
Posts
Comments
« Sphingomyelin-targetted gold nanoparticles
Responding to questions raised on PubPeer »

REF 2014 and all that (III): is RAE/REF a driver or passenger of change?

May 7, 2015 by ferniglab


Reading my colleagues’ papers, a key step in our evaluation of outputs, was very, very useful. I learned many new things and also understand the research across my Institute and indeed large parts of the Faculty much better. The University has yet to use this knowledge accumulated by its REF Wallahs – it would make sense for these people to inform research policy, they have read a lot of papers.

The Faculty Clinical Medicine subpanel meetings were fun – my colleagues on this panel are a great bunch to work with and their injection of humour into proceedings eased the pain.

What about the “pain”? The combination of being REF Wallah and Head of Department came close to killing my research career – 2013 outputs were down to just 2 papers, 2014 is a more reasonable 6, and 2015 will be similar. So REF is destructive at a personal level and consequently at an institutional level.

Is the definitively better research performance of the institute in 2014 compared to the 1990s and 2000s down to RAE/REF ?

I argued in a previous post “In Defence of REF” that RAE/REF have been important in combating nepotism in appointments and ensuring the adoption of a meritocratic agenda in appointments. So one can argue that there is a correlation between the idea of RAE/REF exerting such pressure and those departments that have improved by pursing a meritocratic appointment agenda.

However, this is a correlation

Would that agenda have been pushed anyway, simply due to the normal pressures associated with managing a department in a university? I suspect the answer is at least a partial yes. Looking across the time covered by RAE/REF there are examples, such as ours, of departments that have increased in research power, but also examples where the reverse happened, due in part to poor appointments. So perhaps the value of the pressure exerted by RAE/REF in increasing research activity is overvalued?

I don’t have a clear answer here and I haven’t come across a suitable longitudinal study that might provide data to develop a clear answer. However, from my limited personal view across various departments in the UK where I have some in-depth knowledge, the answer can at most be a qualified yes, and no more.

The other side of the coin is the view that some sort of external pressure is always good, but when it becomes all consuming its value is reduced to zero, and then it becomes a hindrance to progress. RAE/REF looks like it has run its course and may well have entered negative value territory.

However, we need to be answerable to Parliament and hence the taxpayer. So some sort of method is required that provides funding to universities that is not tied to specific PIs, to allow universities to function as such.

There are many alternatives. Given REF 2014 panels that covered large areas of research, then for STEM fields, Dorothy Bishop’s idea of a Departmental h-index seems quite useful – we get a result, it is cheap and staff can get on with research and teaching, rather than sinking without trace in the swamp of REF. Another way forward is to consider what drives research performance down or up. Ultimately it is people and an institution’s ability to foster long-term creativity in staff.

So down drivers include: insularity, nepotism in appointments, discrimination, bullying, and so on.

Up drivers: expansiveness, meritocratic hiring with a 30+ year perspective (=career), diversity and mentoring.

A system proposed by Jenny Martin, provides an alternative set of parameters and these certainly fit the bill for driving research performance up.

So have RAE/REF been useful? On balance, I think not. There are easier ways to distribute funds from government to universities and I cannot see that the assessments have in themselves directly driven an increase in research quality.

Advertisement

Share this:

  • Twitter
  • Facebook
  • LinkedIn

Like this:

Like Loading...

Related

Posted in Science process, Scientific progress | Tagged REF, research, Research Excellence Framework, science, Science progress |

  • Places of interest

    The one and only PhD comics, the guide to being a graduate and to mentoring.

    Improbable Research and the Ig Nobels

    Retraction Watch provides updates on retractions of articles.

    Office for Research Integrity, their video should be compulsory for all.

    Centre for Alternative Technology

    Lateral Science, has some quite stunning information - well worth a browse.

    Fascinating places that have been closed by lawyers

    Science Fraud, shut down due to legal threats on Jan 3 2013. and Abnormal Science

  • Blogroll

    • WordPress.com
    • WordPress.org
  • Funding agencies

    • Biotechnology and Biological Sciences Research Council
    • Cancer and Polio Research Fund
    • Engineering and Physical Sciences Research Council
    • Liverpool Pancreas NIHR Biomedical Research Unit
    • Medical Research Council
    • North West Cancer Research
  • Seminars

    • Cancer Research UK Centre
  • May 2015
    M T W T F S S
     123
    45678910
    11121314151617
    18192021222324
    25262728293031
    « Mar   Jun »
  • Archives

    • November 2022
    • July 2022
    • April 2022
    • March 2022
    • May 2021
    • March 2021
    • August 2020
    • June 2020
    • April 2020
    • March 2020
    • December 2019
    • October 2019
    • July 2019
    • May 2019
    • April 2019
    • January 2019
    • September 2018
    • August 2018
    • May 2018
    • April 2018
    • February 2018
    • January 2018
    • December 2017
    • November 2017
    • July 2017
    • June 2017
    • April 2017
    • March 2017
    • January 2017
    • October 2016
    • June 2016
    • May 2016
    • March 2016
    • January 2016
    • December 2015
    • July 2015
    • June 2015
    • May 2015
    • March 2015
    • February 2015
    • January 2015
    • December 2014
    • November 2014
    • October 2014
    • September 2014
    • August 2014
    • July 2014
    • June 2014
    • February 2014
    • January 2014
    • December 2013
    • October 2013
    • September 2013
    • August 2013
    • July 2013
    • June 2013
    • May 2013
    • April 2013
    • March 2013
    • February 2013
    • January 2013
    • December 2012
    • November 2012
    • October 2012
    • September 2012
    • August 2012
    • July 2012
    • June 2012
    • May 2012
    • April 2012
    • March 2012
    • February 2012
    • January 2012
    • November 2011
    • October 2011
    • September 2011
    • August 2011
    • July 2011
    • June 2011
    • May 2011
    • April 2011
    • March 2011
    • February 2011
    • January 2011
    • December 2010
    • November 2010
    • October 2010
    • September 2010
    • August 2010
  • Follow me on Twitter

    My Tweets
  • Cloud

    American Civil War antithrombin III banana Biological imaging biotechnology Brexit Choanoflagellates chocolate chondroitin sulfate coagulation Confederate States covid19 DN Lee Education EU EU referendum Europe extracellular matrix FGF Fibroblast growth factor Food FRET sensors Gish Gallop glycosaminoglycans GMO government Graduate students heparan sulfate heparin history of science imaging Irvine Stephens Bulloch James Bulloch James Dunwoody Bulloch Liverpool microbiology Nanoparticle Nanoparticles Nanotechnology neuroscience nmr Open Access Open Data orange Parliament Peer Review PhD polysaccharide port sunlight Post publication peer review protein chemistry REF research Research Excellence Framework Research integrity Roast SARS-CoV-2 science Science and Technology Committee Science fraud Science Funding Science progress Scientific American Seminars sorbet speaking strawberry sulfation Sulfotransferase synthetic biology Teaching technology transfer Tourism Travel Universities

Create a free website or blog at WordPress.com.

WPThemes.


Privacy & Cookies: This site uses cookies. By continuing to use this website, you agree to their use.
To find out more, including how to control cookies, see here: Cookie Policy
  • Follow Following
    • Ferniglab Blog
    • Join 73 other followers
    • Already have a WordPress.com account? Log in now.
    • Ferniglab Blog
    • Customize
    • Follow Following
    • Sign up
    • Log in
    • Copy shortlink
    • Report this content
    • View post in Reader
    • Manage subscriptions
    • Collapse this bar
%d bloggers like this: