Methane emissions are measured accurately by researchers

Claims that methane emissions have been inaccurately measured don’t hold up to scrutiny – Katie Brown, Energy In Depth

Methane – the primary component of natural gas – has been in the news a good bit this week, primarily in the context of the role it is expected to play (or not play?) in helping states comply with new power plant rules issued by the Obama administration and EPA.

By Katie Brown, PhD., Energy In Depth.

But there’s another big methane story that’s making the rounds, one from The New York Times posted on Monday that basically argues everything we know about measuring methane leakage rates is wrong – because, as it turns out, the highly sophisticated equipment we’ve always used to do that apparently doesn’t work.

It’s an interesting and provocative assertion, to be sure, and the fact that the claims are being made by a retired consultant and current volunteer firefighter who lives in North Carolina makes it all the more interesting and provocative. The consultant is a guy named Touché Howard, and his core argument, articulated in a research paper that appeared in the journal Energy Science & Engineering this week, is that since the instruments widely used to detect methane emissions today have the potential to fail, the landmark study released 2013 by researchers at the University of Texas (UT) and the Environmental Defense Fund (EDF) can’t be trusted. Oh, and it’s probably the case that emissions are a lot higher than we think.

If you haven’t been following the methane debate that closely this summer, you might think this is a new story. But truth is, Howard actually already released a similar study earlier this year that brought up exactly the same issues regarding the equipment on which he trains most of his attack: the Bacharach Hi-Flow Sampler (BHFS).

The questions raised in that previous report were fully addressed in a public scientific forum by the UT/EDF researchers.  In a piece published in March 2015 in Environmental Science and Technology, the UT/EDF researchers explained that they used multiple instruments and conducted rigorous testing of the instruments both in the laboratory and in the field before it was used.   They also used infrared video camera scans in conjunction with the instrument to obtain an even more thorough reading of methane emissions.  In other words, these guys really ran this stuff through the wringer.

Of course, we don’t actually expect you to read any of these comments – that’s why you have us around!  So let’s go through quick and highlight some of the relevant and compelling responses Dr. Allen, the lead researcher of the UT/EDF study, and his colleagues have put forth over the past several months to Mr. Howard:

“To assess whether this potential crossover failure impacted measurements in Allen et al., or our earlier work employing the instrument, we conducted laboratory testing, field testing, and additional analyses of field data.

Laboratory Testing: As documented in the Supporting Information for Allen et al., prefield deployment laboratory testing of the sampler used in our work (referred to here as the University of Texas (UT) HiFlow sampler) demonstrated successful crossover between the two measurement modes for methane and a wet gas surrogate (70.5% methane by volume).

Field Testing: The study team participated in a two day field test of several HiFlow samplers. Participants in the field testing included our team, the commenter, a consulting firm, an instrument provider and consulting firm, and a natural gas producer. During this field test, the UT HiFlow sampler successfully crossed-over on sites with methane concentrations in the produced gas ranging from 77%−91%. Over 2 days of testing, the UT HiFlow sampler crossed-over successfully in all but one test; that test occurred at a site with a produced gas containing 91% methane. Subsequent examination of the instrument indicated that it had lost calibration after losing power, then being restarted by personnel not on our study team. The sampling protocol in Allen et al. required a calibration check each time the HiFlow sampler was turned on. Once the calibration protocol was followed, the HiFlow sampler resumed proper operation.

Additional Analysis of Allen et al. Data: Infrared (IR) video camera scans were taken on some sites during field work for Allen et al.,3 including for 118 of the 305 pneumatic controllers (39%) sampled in that work. These infrared camera scans were done immediately upon arrival at the site and thus were not exactly contemporaneous with the UT HiFlow measurements…Overall, the comparison with IR camera data suggests that the UT HiFlow sampler was capturing the emissions from pneumatic controllers in its measurements.”

In the New York Times article, Dr. David Allen explains the process this way:

 “There may be issues with some of these instruments, but we tested our instruments pretty thoroughly and when we went out into the field we had multiple instruments, all of which gave us information,” he said. Alternate measurement methods were used at some sites, he said, and “we didn’t see any evidence that we were missing any large numbers.”

It’s also worth pointing out that while so-called bottom-up studies using direct field measurements of have found low emissions, the most recent studies using flyovers – when emissions are measured by instruments in aircrafts – have also found very low emissions.  One example comes from another EDF-sponsored study, Lyon et al, which takes measurements in aircrafts over the Barnett Shale and finds very low emissions:

 “Barnett Shale O&G wells produced 5.6 Bcf day-1 natural gas and 54.5mbl oil and condensate day-1 in October 2013.  Assuming a constant production rate and weighted average gas composition of 88.5% methane by volume, our O&G emission estimate is equivalent to 1.2% (1.0-1.4%) of gas production. If oil production site emissions (4% of O&G total) are excluded then the natural gas leak rate decreases to 1.1% (1.0% – 1.3%).  (p. 8153; emphasis added)

Researchers from the University of Colorado at Boulder and the National Oceanic and Atmospheric Administration (NOAA) also recently released a report, which uses measurements from flyovers.  It found that methane leakage rates from three major shale developing regions are in line with EPA’s leakage estimate of 1.1 percent (of production).  Specifically, the researchers found emissions in the Haynesville in Louisiana and Texas to be between 1.0 and 2.1 percent; in the Fayetteville in Arkansas to be between 1.0 and 2.8 percent; and in the Marcellus to be between 0.18 and 0.41 percent.  Importantly, the areas collectively represent over half of total U.S. shale production.  From the report:

“The climate impact of CH4 loss from shale gas production depends upon the total leakage from all production regions. The regions investigated in this work represented over half of the U.S. shale gas production in 2013, and we find generally lower loss rates than those reported in earlier studies of regions that made smaller contributions to total production. Hence, the national average CH4 loss rate from shale gas production may be lower than values extrapolated from the earlier studies.” (emphasis added)

As EID has noted on a number of occasions, one of the obvious drawbacks and limitations associated with evaluating methane concentrations from flyovers is that there is often a lot of uncertainty about where exactly the methane is coming from.  Evaluating what percentage of the methane originates from oil and gas production versus other sources, such as agriculture, coal production, or natural seeps, often involves Rube Goldberg-esque modeling exercises and hypothesizing.  Yet, even taking other sources of methane into account, the researchers still found exceedingly low methane leakage rates.

In the end, the only conclusion Howard really comes to in his “new” study is that there’s a possibility that the instrumentation might not work properly if it is not used properly.  That’s it.  In response, UT/EDF researchers have made it abundantly clear that they went above and beyond from a process and methodological standpoint to ensure that the instruments were tested and deployed in the proper manner.

A “new” study that raises already answered questions is essentially a distraction from the only real question that matters here, and that’s this: What’s the actual leakage rate? Good news is, we actually have some pretty good answers to that, thanks in large part to a number of good (if not always perfect) studies that have been released on the topic. Those studies tell us that methane leakage rates are low, and continue to drop. And good thing for that, considering that literally no one supports the imperative of detecting, capturing and ultimately selling more methane than the folks who actually do that work for a living.

This article originally appeared on the Energy In Depth website on August 6, 2015.

1 thought on “Methane emissions are measured accurately by researchers”

  1. Touche' Howard

    Dear Dr. Brown –
    Thanks for taking the time to discuss the paper I published in Energy Science and Engineering. I think it might be helpful if I clarify a few points for you.

    The importance of the latest paper in ESE is that the analysis of Dave Allen’s 2013 data set tells us that the problem with the Bacharach sampler might be much more widespread than originally thought, and it might occur not just at production sites but also in other parts of the natural industry such as processing, transmission, and distribution. It also explains why Dave was mistaken in his statements that you’ve quoted from his ES&T letter. (It might also be helpful for you to know that I am an EDF researcher as well – my instrumentation and techniques were used for the measurements they sponsored in the distribution segment of their research.)

    There are three critical issues that arise from this problem: 1) Greenhouse gas emissions might be underestimated; 2) Health impacts from oil and gas facility air emissions might be miscalculated, and 3) safety could be compromised.

    Although this doesn’t necessarily mean that the natural gas industry isn’t beneficial, the important point is that we don’t yet have the right information to understand all of the implications of the increased production of natural gas.

    But as important as those issues might be, to me, the most critical issue is safety. One of the important uses of the Bacharach sampler is to prioritize which leaks to repair. If a large leak goes unrepaired because the sampler says it’s too small to worry about, that could have tragic consequences.

    You stated that “In the end, the only conclusion Howard really comes to in his “new” study is that there’s a possibility that the instrumentation might not work properly if it is not used properly.“ That’s incorrect. This problem actually occurs when the instrument is used according to manufacturer guidelines, and at this point, 5 out of the 7 instruments I’ve had a chance to test have had problems that caused them to report leaks anywhere from 10 to 50 times too low. However, I’m pleased to tell you that Bacharach has stated that they are going to revise their manuals as a starting point to addressing this problem.

    Although you described me as a volunteer firefighter, I’m actually a professional firefighter (but God bless the volunteer firefighters for all of their hard work and dedication). Maybe my experiences as a firefighter have made me more aware of how serious this problem could be. Dragging dead people out of a fire, with their burnt flesh coming off on your turnout gear, is truly a terrible experience. What’s even worse, however, is trying to help someone that’s been burned but survived. If you had heard their screams, or ever been to a burn ward and saw the agony that those people go through, neither you nor your colleagues would want to trivialize this problem with the sampler that could put people’s lives at risk. Honestly, I wouldn’t think it would take that experience for people to recognize how serious this issue is — I really can’t see how anyone would do anything other than to put all their efforts into making sure that everyone knows there’s a problem, if for no other reason than to protect industry personnel.

    Anyway, I hope this clarifies the issue for you. And, if you’re ever in the Raleigh Durham area, I hope you’ll stop by the fire station and have dinner with us, so that we can continue this discussion. I’m sure protecting people’s lives and health is as important to you as it is to me.



Comments are closed.