The Guardian responds

We recently ran two articles that were quite critical of aspects of the Guardian’s coverage of the stolen emails. This is a response from Dr. James Randerson, the editor of the Guardian’s environmental website.

I edit the Guardian’s environment website and was part of the editorial team that produced the 12-part investigation by veteran science journalist Fred Pearce into the hacked East Anglia climate emails. I’m very grateful to RealClimate for giving us the opportunity to respond to the recent posts on the investigation: “The Guardian Disappoints” and “Close Encounters of the Absurd Kind”.

I should say first that we hold RealClimate in very high regard. The site is part of the Guardian Environment Network, a collection of more than 20 hand-picked websites including Grist and Nature’s Climate Feedback blog with whom we have a mutual content sharing agreement. Under the arrangement, the Guardian website republishes RealClimate blogs regularly. We take seriously your criticisms and are considering them carefully. The Guardian has a commitment to accuracy and correcting factual errors.

Such is the public interest in this story that ever since the emails were released in November, there has been a strong demand for an in-depth journalistic account of what they tell us about how climate scientists operate. As RealClimate rightly pointed out, the response from much of the media has been lazy to the point of “pathology”.

No other media organisation has come close to producing such a comprehensive and carefully researched attempt to get to the bottom of the emails affair. The investigation tries to reflect the complexity and historical context of the story, and runs to some 28,000 words – of which around half appeared in the printed newspaper.

Dr. Schmidt did not mince his words though when he said that Fred’s investigation falls, “well below the normal Guardian standards of reporting”, while Dr Ben Santer wrote, “I am taking this opportunity to correct Mr. Pearce’s omissions, to reply to the key allegations, and to supply links to more detailed responses.” Both have also criticised our experimental online exercise to harness the expertise of people with a special knowledge of the emails in order to create a “peer reviewed” account of what they tell us.

More on that later, but it is wrong to suggest that this is a lazy substitute for traditional journalistic standards and that key protagonists were not invited to respond prior to publication. On the contrary, the investigation was subject to rigorous editorial checking and Fred contacted numerous individuals in the course of his research. Many (particularly those at UEA) declined to comment.

The other side of the story

The RealClimate commentary reads like a distorted fairground mirror of the Guardian investigation – one that highlights the uncomfortable bits but blurs the rest. The posts did point out that “Some of the other pieces in this series are fine” but do not reflect the large amount of analysis in the investigation of the way the emails have been misused by those with a political agenda and the extensive context we included to indicate the pressure scientists writing those emails were under from time-consuming requests for data.

In part 2 (How the ‘climategate’ scandal is bogus and based on climate sceptics’ lies), for example, we detail how the “hide the decline” email has been misused by Sarah Palin, Senator James Inhofe and others to create, apparently deliberately, the impression that climate scientists had fiddled the figures.

Almost all the media and political discussion about the hacked climate emails has been based on soundbites publicised by professional sceptics and their blogs. In many cases, these have been taken out of context and twisted to mean something they were never intended to.

In part 1 (Battle over climate data turned into war between scientists and sceptics) and in a separate piece that appeared in the newspaper (Climate scientists have long been targets for sceptics) Fred outlines the tactics and motivations of some on the “sceptic” side of the debate.

All this happened against the backdrop of a long-term assault by politically motivated, and commercially funded, climate-change deniers against the activities of many of the key scientists featuring in the emails.

Similarly in Part 7 (Victory for openness as IPCC climate scientist opens up lab doors) Fred explains how the emails give a special insight into what being on the end of that assault was like.

In the leaked emails, [Ben Santer] is seen sharing those experiences with other victims of hectoring and abuse by the more rabid climate sceptics. Others had their own horror stories, including Mike Mann over his hockey stick graph, Kevin Trenberth over his analysis of hurricanes and warming in the aftermath of Katrina, and later Jones over his escalating data wars. In each case, they argue, legitimate debates about scientific analysis and access to researchers’ data have been turned into vindictive character assassination.

And in the concluding part of the investigation (Part 12: Climate science emails cannot destroy argument that world is warming, and humans are responsible), Fred lays out unequivocally that nothing in the emails casts doubt on the case for climate change being attributable to human actions.

Is the science of climate change fatally flawed by the climategate revelations? Absolutely not. Nothing uncovered in the emails destroys the argument that humans are warming the planet. None of the 1,073 emails plus 3,587 files containing documents, raw data and computer code upsets the 200-year-old science behind the “greenhouse effect” of gases such as carbon dioxide, which traps solar heat and warms the atmosphere. Nothing changes the fact that carbon dioxide is accumulating in the atmosphere thanks to human emissions from burning carbon-based fuels such as coal and oil. Nor the calculations by physicists that for every square metre of the Earth’s surface, 1.6 watts more energy enters the atmosphere than leaves it.

And we know the world is warming as a result. Thousands of thermometers in areas remote from any conceivable local urban influences tell us that. The oceans are warming too. The great majority of the world’s glaciers are retreating, Arctic sea ice is disappearing, sea levels are rising ever faster, trees are climbing up hillsides and permafrost is melting.

These are not statistical artefacts or the result of scientists cherry-picking data.

Looking under every rock

There are few, if any newspapers in the world with a stronger commitment to action on climate change than the Guardian and our sister paper the Observer. We have a team of 6 full-time environment correspondents as well as three editors and a collection of bloggers and columnists.

It was the Guardian that orchestrated a global editorial carried by 56 newspapers in 45 countries on 7th December 2009 to call for action from world leaders at Copenhagen. [RC: Also at RealClimate]

And we have been instrumental in supporting the 10:10 climate change campaign which aims to inspire individuals, organisations and businesses to cut their carbon emissions by 10% in 2010. The UK branch of 10:10 has signed up nearly 60,000 people and over 4000 businesses and organisations.

But only by looking thoroughly under every rock can those of us pressing for action on climate change maintain with confidence that the scientific case remains sound. Fred’s investigation shows that confidence is indeed well placed, but to claim that the emails do not throw up some troubling issues looks like the inward-looking mentality that is sometimes (perhaps understandably) expressed in the emails themselves.

The two posts published so far on RealClimate come to over 8500 words and it has been suggested that a line by line response to each of the points made would not be productive. I say again that we are totally unembarrassed about correcting genuine errors, but many of the points raised at RealClimate are differences of interpretation. There were implications that the investigation omitted some key information which in fact appeared in Fred’s pieces – for example that the data on Chinese weather station locations from the Phil Jones et al 1990 Nature data were eventually released publicly and that the two studies Jones had threatened to keep out of the IPCC AR4 report were in fact cited there.

However, I would like to make four points:

• Dr Phil Jones, the head of the Climatic Research Unit at UEA has said in an interview with Nature that the handling of the records of the Chinese weather station data from his 1990 Nature paper (which Fred wrote about in part 5 of the investigation) was “not acceptable… [it’s] not best practice,” and he acknowledged that that stations “probably did move”. He added that he was considering a correction to Nature. To our knowledge, no other media organisation or blogger had used the emails to shed light on the controversy over the 1990 paper so a correction would not be on the table without the Pearce investigation.
• Dr. Schmidt states that we imply Dr Tom Wigley supported allegations of “fabrication” from climate sceptic Douglas Keenan. We do not make that assertion in the piece. Also, Dr Schmidt does not reproduce the most eye-catching quotes from a May 2009 email from Wigley to Jones in which he raises serious doubts about the quality of Jones’s scientific team and his handling of the Chinese weather station data.The hacked emails do not include a response from Jones if there was one.
• As Dr. Schmidt pointed out, we have made three small corrections to the piece “Controversy behind climate science’s ‘hockey stick’ graph” at the request of Dr Michael Mann, but none changed the main point the article was making, which was that in 1999, Mann’s hockey-stick reconstruction was the subject of intense academic debate amongst climate scientists.
• Neither of the RealClimate blogs dealt with Fred’s piece on FOI requests, but a statement from the UK’s deputy information commissioner Graham Smith has made clear that he believes that FOI legislation was not followed correctly. He wrote, “The emails which are now public reveal that [climate sceptic David] Holland’s requests under the Freedom of Information Act were not dealt with as they should have been under the legislation. Section 77 of the Freedom of Information Act makes it an offence for public authorities to act so as to prevent intentionally the disclosure of requested information.” This is a serious issue worthy of discussion and debate.

Peer-reviewed journalism

I mentioned above our attempt to create a definitive account of the emails by leveraging the expertise of people involved or with a special knowledge of the messages and the issues they discuss. This account will eventually be expanded into a book. In practice, this means us adding annotations from people to the online versions of the articles so that readers can watch a form of living peer-review in progress. Click on the yellow highlights in the pieces themselves to read the annotations.

This represents an extraordinary commitment to transparency that we believe is unique in journalism. What other news organisation would open itself to direct criticism in this way including, for example, annotations that read “this is absolutely false” and “this is really bad”? The respected Columbia Journalism Review has praised the approach. “Regardless of whether you agree with Pearce or Schmidt, the Guardian’s approach appropriately acknowledges that evidence leaves room for some degree of interpretation. It is this kind of detailed, intellectually honest (even technologically innovative) reporting that news outlets like The New York Times should be striving for,” it wrote.

In the same spirit we have showcased diverse critical opinions on the issues and our own coverage of them, including from Dr Myles Allen, Dr Vicky Pope, Dr Mike Hulme and the Guardian’s environment correspondent Dr David Adam. Again few newspapers would have reflected such diverse viewpoints.

The reaction from some to our online annotation exercise has been hostile though. On our letters pages Dr Myles Allen and Dr Ben Santer wrote last week:

Claiming to produce “the definitive” analysis now is a brazen attempt to pre-empt the inquiries’ conclusions…What is wrong with the old-fashioned approach of checking facts before publication? When the final version is published, you will no doubt make much of the fact that “everyone had a chance to comment”, implying that any statement that was not challenged must therefore be true.

Our intention is not to undermine or pre-empt the ongoing inquiries into the CRU emails. Each of those has a very specific remit and none is attempting to produce a detailed account that uses the emails to shed light on recent climate controversies. Nor is this an exercise in blackmailing scientists into fact-checking on the cheap – if it were then it would be a monumental false-economy.

In truth, this is a serious-minded attempt to make sense of a large volume of new information about a complex and highly charged issue. No other newspaper has ever offered its journalism up for very public and exacting scrutiny in this way. We sincerely invite those involved who know the issues most thoroughly to contribute.