Withdrawing my labour

I made my first New Year’s resolution on December 31, 2013: to only undertake reviews for open access and learned society journals.  This I have stuck to well, as I noted a year later for the simple reasons that it makes sense and it frees up my time.

Today I had a request to review a manuscript for Nature Publishing Group’s Scientific Reports, and I realised that I need to clarify my position.

I am on strike.

Read Full Post »

Pubpeer & progress

During a quick scan this morning of the “recent” comments on Pubpeer, an activity that I pursue regularly, as part of my reading, there seemed to be a lot more author responses.  So I counted.

70 articles featured with comments.

10 of these had an author response.

This is progress. I have no data, but my impression is that a year ago author comments were far rarer, maybe 1% or thereabouts. Now we are at 14%. Let’s hope this is not an anomaly, but a trend, and maybe in a few years papers without author responses will be in the minority.

Regardless of arguments about anonymity, etc., post publication peer review is growing, which is a sign of health in the scientific enterprise.

Read Full Post »

Groundhog day

Much has been written about the peer review process and its flaws. Richard Smith, a former editor of the British Medical Journal has stated that since peer-review doesn’t work, we shouldn’t do it

I have recently come across another example of the flaws in peer review. I reviewed a manuscript last year and identified what I believed to be technical problems and suggested at least major revision. The other two reviewers agreed; the three of us had homed in independently on the same technical issues.

Move forward a year and the paper is published in another (equally “prestigious”) journal, no changes.

So I will now amend my New Year resolution (still holding firm) from 2014 and 2015.

In addition to only reviewing for open access journals, I will from now on only review for journals where the review is open and published or where I am free to publish the review. That, at least, will avoid the ethical tension between participating in anonymous peer-review and then wanting to publish the critique when nothing has changed in the paper.

Why Groundhog day? This is not the first time I have had this experience.

Read Full Post »

Responding to questions raised on PubPeer

I am a fan of PubPeer, as it provides a forum for discussion between authors and the wider community, something I have discussed in a number of posts (two examples being here and here). Two days ago, My colleague Mike Cross came by my office, having just delivered a pile of exam scripts for second marking (it’s exam and marking season), asking if I had seen a comment on our paper on PubPeer. I had not – too many e-mails and too busy to look at incoming!
So I looked at the question, which relates to panels in two figures being identical in our paper on neuropilin-1 and vascular endothelial growth factor A (VEGFA) – indeed they are labelled as being identical.

Read Full Post »

The real problems of post publication peer review

Discussion surrounding post publication peer review (previous post here seems to be growing and one issue that is frequently raised is anonymity. In a PLOS Medicine editorial Hilda Bastian argues that current post publication peer review is over focussed on what apparently is wrong in papers and that anonymity is a threat to effective post publication peer review.
A PubPeer thread takes issue with these and some other points and I have also joined in (I am Peer2). We should remember that any notion of power has nothing to do with scientific capability – indeed there may even be an inverse relation. So providing those with the least power (so the most disenfranchised) a means to participate in post publication peer review is essential. Though we have no data on PubPeer, PubMed Commons is a venue for the established. There are some critiques, there is also a fair amount of hagiography too. I would hazard a guess that PubPeer is far more diverse in terms of the career stage of participants and in terms of their gender/social group. Certainly my anecdotal evidence suggests as much, and that is all I have to go on.

Read Full Post »

A milestone

Sometime last night this blog received its 50,000th page view. I write this blog because I like to. That others find the content worth reading at times is lovely, thank you.

What has been read the most and the least?

Read Full Post »

Should universities refund grants based on retracted papers?

Leonid Schneider has a guest post on Retraction Watch “What if universities had to agree to refund grants whenever there was a retraction?” that has generated a lot of discussion. My own comment became so long that I am posting it below. For those who are not aware, in the USA, the Office of Research Integrity (ORI) has the power to reclaim from institutions grant funding acquired through fraudulent means, e.g., manipulated or made up data, though there is a time limit and this is only exerted in a fraction of the cases investigated by ORI. No other country has a similar or analogous mechanism.

I like Leonid Schneider’s idea.

Read Full Post »

Science does not exist without post publication peer review

An excellent article on the coming of age of post publication peer review by Emma Stoye is up at Chemistry World
She quotes me (correctly) as stating that “Science does not exist without post publication peer review. If anyone wants to follow the quote up, my own posts can be found here.

Read Full Post »

Why gel splicing is not OK

Gel (see footnote at end for a brief description of gels aimed at non-biologists) splicing is a term that describes the cutting and pasting of images of lanes (where 1 lane = 1 sample) and placing the images of the lanes in a different order or even combining lanes from different gels. A more extreme form is to simply shift the subsection of the lane, corresponding to the probed molecule, from one lane to the next.
This is wrong and it always has been. However, in post publication peer review on PubPeer, it is often defended, particularly for “older” papers, from a decade or more ago. This then raises arguments about what was acceptable then and are we shifting the goalposts of scientific integrity? The matter has even been a “Topic” on PubPeer.

Read Full Post »

Are we there yet?

The question relates to what Langmuir termed “Pathological Science”, simply put “people are tricked into false results … by subjective effects, wishful thinking or threshold interactions“. There is a lot of pathological science and I only use the examples below, because I am most familiar with them; for nanoparticles, I have a personal interest in understanding these materials, since I use them to try to make biological measurements, e.g., here.

Read Full Post »