[We the authors decided to put this paper up on the EA Forum as we think it is a good addition to the discussion of climate change in effective altruism. It shows that parts of climate change are still neglected even though the field overall receives lots of attention and funding. This gap in extreme climate change research might be a valuable opportunity for people in the EA community with relevant skills to contribute.

This paper is published in Environmental Research Letters in open access (CC-BY)]

Betting on the best case: higher end warming is underrepresented in research

Florian U Jehn¹, Marie Schneider¹, Jason R Wang², Luke Kemp³ and Lutz Breuer^1,4

Abstract

We compare the probability of different warming rates to their mentions in IPCC reports through text mining. We find that there is a substantial mismatch between likely warming rates and research coverage. 1.5 °C and 2 °C scenarios are substantially overrepresented. More likely higher end warming scenarios of 3 °C and above, despite potential catastrophic impacts, are severely neglected.

1. Introduction

Temperature rise of 3 °C above pre-industrial temperature is more likely than not by the end of the century, on most business as usual scenario. One recent estimate projected a rise of 2.0 °C–4.9 °C with a median of 3.2 °C (Raftery et al 2017). This covers likely ranges; however, climate change is heavy-tailed with surprisingly high likelihoods for high levels of warming. GHG concentrations of 700 ppm could produce a 10% chance of exceeding a temperature rise of 6 °C (Wagner and Weitzman 2015). Such concentrations would be passed by 2100 under six of the nine of the CMIP6 SSP-RF baseline and 6.0 W/m² forcing scenarios (Riahi et al 2017, Gidden et al 2019). The most recent estimates of equilibrium climate sensitivity show a similar distribution, narrowing the range of outcomes to exclude rises below 2 °C but not ruling out warming above 4.5 °C (Sherwood et al 2020).

Lower concentrations could still end in higher end warming outcomes due to tipping points and uncertainty over Earth system feedbacks and nonlinearities (Oreskes et al 1994, Booth et al 2012, Bodman et al 2013, Lenton et al 2019). These uncertainties make higher end warming climate change even more dangerous, as they leave the option open for far worse outcomes (Weitzman 2012). While concerning, such probabilistic distributions are not the same as the spread of risk. The impacts of higher temperature ranges are both more uncertain but also likely to be disproportionately more severe (New et al 2011). Given that eventual temperature outcomes also depend on deeply uncertain factors like the amount of global cooperation to mitigate climate change, scientists can support policymakers to craft robust, long-term responses to climate change by exploring a wide range of plausible futures, through approaches like Robust Decision-Making (Lempert et al 2003). This makes understanding the effects and consequences of warming of 3 °C and above imperative.

While there have been some valuable attempts to summarize available research (Wagner and Weitzman 2015, Wallace-Wells 2019), calls for action (Lenton et al 2019) and research projects focused on higher end climate impacts such as the HELIX project, it remains unclear if existing research coverage matches either the probabilistic or risk distribution of climate change. The best synthesis of climate change research are the assessment and special reports of the Intergovernmental Panel on Climate Change (IPCC 2013, 2014a, 2014b, 2018, 2019a, 2019b). They reflect expert consensus and are a reliable proxy for the current state of knowledge. To assess the focus of the IPCC on different warming scenarios in temperatures we text-mine available IPCC reports (IPCC 2013, 2014a, 2014b, 2018, 2019a, 2019b) and count how often the different temperatures are mentioned in comparison to the probability of the temperatures projected for an increase of atmospheric CO₂ concentrations of 550 and 700 ppm based on the research of Wagner and Weitzman (Wagner and Weitzman 2015). We focus on those concentrations as 700 ppm are commonly exceeded end-of-century throughout many of the CMIP6 analytical scenarios, while 550 ppm would be reached if all currently stated climate policies and plans would be implemented (IEA 2020).

2. Results and discussion

Our results show a large mismatch between the amount of research and the probability of warming (figure 1(a)). 3 °C is the peak of probability for 700 ppm, but accounts for less than 3% of mentions. Temperatures of 3 °C or above (figure 1(c)) account for around two-thirds of the probabilistic mass for 700 ppm, but just over 10% of mentions. Similarly, a more dramatic temperature rise of 6 °C and above (figure 1(d)) is a 10% probability and only less than 1% of mentions. The picture is slightly better for 550 ppm, but higher end warming climate changes are underrepresented there as well. In addition, those numbers are likely to be underestimates of the neglectedness of higher end temperature rise, as many of the textual references do not refer to a change in global mean surface temperature. Overall, the percentage of true positive findings that actually relate to a change in global mean air temperature change varies substantially depending on the temperature (between 5 °C and 10 °C), ranging from 0% for 10 °C to 57% for 7 °C. However, even those mostly refer to the temperature change since the last glacial maximum and possible values for the equilibrium climate sensitivity. For example, the AR5 report of working group II (IPCC 2014a) mentions 8 °C only three times, two of which relate to local temperature increases in the arctic and the thermal optimum of salmon.

Figure 1. Comparison of the probability of temperatures rises and occurrences of those temperatures in the IPCC for (a) all AR5 working group reports and all special reports until 2020; (b) all reports of (a) except the Special Report on 1.5 °C warming; (c) the sum of all temperatures of 3 °C and above (based on a)); (d) the sum of all temperatures of 6 °C and above (based on a)). Subfigures (c) and (d) show the cumulative probability (black) of exceeding 3 °C change (c) and 6 °C (d) as substantially higher than the relative occurrence (orange) of those temperatures in the IPCC reports. The probability curves and the cumulative probability are based on the estimates of Wagner and Weitzman (2015).

There is a stark difference between warming probabilities and our knowledge. Over half of the textual references focus on a warming of 1.5 °C. This may be skewed by the 2018 'The Special Report on Global Warming of 1.5 °C (SR15)' (IPCC 2018) which was requested by the Conference of the Parties (COP) to the UNFCCC at the 2015 Paris Climate Summit. When we remove the special report on 1.5 °C warming (IPCC 2018) (figure 1(b)) from our analysis, textual references to 1.5 °C drop, but are still markedly higher than the probability and mentions of scenarios higher than 4 °C. Our text mining results suggest that there is at least some research focused on 4 °C of warming. This is supported by its coverage in well-known grey literature, such as the World Bank's 'Turn Down the Heat' series as well as the 2009 '4 Degrees and Beyond International Climate Conference'.

Our study indicates possible knowledge gaps in higher end warming climate change research. It is not a definitive conclusion, but a useful starting point to discuss the divergence between probability and risk distributions and climate change research focus to date. Our method only delivers a snapshot into the current climate change research and has some limitations. Mentions in IPCC reports do not neatly map onto the exact frequency of research. Furthermore, the frequency of mentions says little about the quality or extent of individual studies. The subject of IPCC special reports are often as reflective of political requests as research needs. Moreover, we use one prominent 2015 estimate of the probabilistic distribution of concentrations and temperatures, but future studies could look to use others (or even a combination of them). There are also other ways to approach our analysis that might result in different numbers (Brown and Caldeira 2017). We searched in Web of Science and Google Scholar for 'Climate Change' and 'X °C', The results have a very similar distribution to our IPCC-based results, but it is difficult to settle on concrete numbers, due to a high, but hard to quantify rate of false positive results, especially at higher temperatures. To address the rate of false positives in our analysis we looked at all temperature mentions in IPCC reports between 5 °C and 10 °C and checked if they were referring to global mean temperature rise or something else. We found no discernible trend in the rate of false positives.

There are multiple reasons to believe that the results presented here are robust. First, given the sheer difference in magnitude of our results, especially for 700 ppm. Second, the gap we highlight in our results is relatively insensitive to the CO₂ concentration used. Even at CO₂ concentrations of 600 ppm there is still a large research gap higher end warming. The research focus and the probability of warming only overlap around 450 ppm if we include all reports or at 550 ppm if we exclude the 1.5 °C special report (figures 1(a), (b) and 2). However, given that currently CO₂ concentrations are already above 410 ppm it seems unlikely that we will be able to limit our greenhouse gas emissions to such levels without radical systemic socioeconomic changes. Higher end temperature rise is neglected while research that is 'betting on the best case' of 1.5 °C or 2 °C proliferates. Third, the IPCC itself has previously noted in the Fifth Assessment Report (AR5) that quantitative estimates of aggregate impacts above 3 °C are rare (IPCC 2014b). This is echoed in summaries of climate science in popular literature, which has to rely on less literature for scenarios above 3 °C and just a few, more speculative geological studies for 6 °C and higher (Lynas 2020). However, it should be noted that the research gap is a larger issue in the impact reports.

Figure 2. Probabilities of warming for CO₂ concentrations from 400 to 1000 ppm (based on Wagner and Weitzman (2015)) and the relative occurrence of this warming in the IPCC reports for all AR5 working groups and all special reports until 2020 (both in %). The probability for the temperatures refer to the shown value ±0.25 °C.

There are several potential reasons for this divergence between probability and risk in relation to actual research. The most obvious is that the research community is simply meeting the demands of policy-makers. The goal of limiting warming to 2 °C first was formally adopted under the 2010 Cancun Accords, before being enshrined in the 2015 Paris Agreement on Climate Change, alongside the aspirational goal of holding warming to 1.5 °C. Both of these temperature goals are significantly overrepresented in existing research according to our study. The divergence may also partially reflect the conservative outcomes of the consensus procedures of the IPCC, and the tendency of climate science to err on the side of 'least drama'. This in turn is likely shaped by a history of climate scientists being accused of alarmism by well-funded misinformation campaigns (Oreskes and Conway 2012).

Regardless of the explanation, the problem of a misalignment between research coverage and probability and risk persists. Why is there a special report for 1.5 °C warming, but none for a warming of 3 °C and above, even though the latter currently seems more probable and would be more impactful? We hope this paper provides a starting point for discussion on how research should coincide with future probabilities and risks. Such a conversation and realignment of priorities is overdue. It is also direly needed given that the heavy-tails of climate change could constitute a threat of global catastrophe or even human extinction (Lynas 2020, Ord 2020).

3. Methods

To count the temperature mentioned in the IPCC reports (IPCC 2013, 2014a, 2014b, 2018, 2019a, 2019b) all text was extracted from the PDFs of the full reports. The text was then mined for the mentions of the temperatures in the format ' X°C'. The warming probability was calculated from the probability density function of figure 3.2 in Climate Shock (Wagner and Weitzman 2015), which was graciously provided by Gernot Wagner. The probability of the temperatures in figure 2 of this paper refers to the probability of the temperature ±0.25 °C. All code and data used can be found at the repository of this paper (Jehn 2021). This also contains lists that show how often the temperatures were found in the individual IPCC reports.

Acknowledgments

LB acknowledges support from the SDGnexus Network (Grant No. 57526248) funded by the German Academic Exchange Service (DAAD) from funds of Federal Ministry for Economic Cooperation (BMZ) in the frame of the program 'exceed—Hochschulexzellenz in der Entwicklungszusammenarbeit'. We would further like to thank Lukas Barth for giving valuable feedback on an earlier draft of this paper, Gernot Wagner for providing us with code and data that allowed us to do this analysis in the first place and the reviewers for their constructive feedback.

Data availability statement

All data, code, and materials (except the IPCC reports) used in the analyses is available in the repository of this paper (Jehn 2021).

The data that support the findings of this study are openly available at the following URL/DOI: 10.5281/zenodo.4311470.

References

Bodman R W, Rayner P J and Karoly D J 2013 Uncertainty in temperature projections reduced using carbon cycle and climate observations Nature Climate Change 3 725–9

Booth B B B, Jones C D, Collins M, Totterdell I J, Cox P M, Sitch S, Huntingford C, Betts R A, Harris G R and Lloyd J 2012 High sensitivity of future global warming to land carbon cycle processes Environ. Res. Lett. 7 024002

Brown P T and Caldeira K 2017 Greater future global warming inferred from Earth’s recent energy budget Nature 552 45–50

Gidden M J, Riahi K, Smith S J, Fujimori S, Luderer G, Kriegler E, van Vuuren D P, van den Berg M, Feng L, Klein D, Calvin K, Doelman J C, Frank S, Fricko O, Harmsen M, Hasegawa T, Havlik P, Hilaire J, Hoesly R, Horing J, Popp A, Stehfest E and Takahashi K 2019 Global emissions pathways under different socioeconomic scenarios for use in CMIP6: a dataset of harmonized emissions trajectories through the end of the century Geosci. Model Dev. 12 1443–75

IEA 2020 Stated Policies Scenario – World Energy Model – Analysis IEA Online: https://www.iea.org/reports/world-energy-model/stated-policies-scenario

IPCC 2013 Climate Change 2013: The Physical Science Basis. Contribution of Working Group I to the Fifth Assessment Report of the Intergovern-mental Panel on Climate Change, [Stocker, T.F., D. Qin, G.-K. Plattner, M. Tignor, S.K. Allen, J. Boschung, A. Nauels, Y. Xia, V. Bex and P.M. Midgley (eds.)] (Cambridge, United Kingdom and New York, NY, USA: Cambridge University Press)

IPCC 2014a Climate Change 2014: Impacts, Adaptation, and Vulnerability, Part A: Global and Sectoral Aspects, Contribution of Working Group II to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change, [Field, C.B., V.R. Barros, D.J. Dokken, K.J. Mach, M.D. Mastrandrea, T.E. Bilir, M. Chatterjee, K.L. Ebi, Y.O. Estrada, R.C. Genova, B. Girma, E.S. Kissel, A.N. Levy, S. MacCracken, P.R. Mastrandrea and L.L. White (eds.)] (Cambridge, United Kingdom and New York, NY, USA: Cambridge University Press)

IPCC 2014b Climate Change 2014: Mitigation of Climate Change. Contribution of Working Group III to the Fifth Assessment Report of the Intergovernmental Panel on Climate Change [Edenhofer, O., R. Pichs-Madruga, Y. Sokona, E. Farahani, S. Kadner, K. Seyboth, A. Adler, I. Baum, S. Brunner, P. Eickemeier, B. Kriemann, J. Savolainen, S. Schlömer, C. von Stechow, T. Zwickel and J.C. Minx (eds.)] (Cambridge, United Kingdom and New York, NY, USA: Cambridge University Press)

IPCC 2019a Climate Change and Land: an IPCC special report on climate change, desertification, land degradation, sustainable land management, food security, and greenhouse gas fluxes in terrestrial ecosystems [P.R. Shukla, J. Skea, E. Calvo Buendia, V. Masson-Delmotte, H.-O. Pörtner, D. C. Roberts, P. Zhai, R. Slade, S. Connors, R. van Diemen, M. Ferrat, E. Haughey, S. Luz, S. Neogi, M. Pathak, J. Petzold, J. Portugal Pereira, P. Vyas, E. Huntley, K. Kissick, M. Belkacemi, J. Malley, (eds.)] (In press)

IPCC 2018 Global Warming of 1.5°C. An IPCC Special Report on the impacts of global warming of 1.5°C above pre-industrial levels and related global greenhouse gas emission pathways, in the context of strengthening the global response to the threat of climate change, sustainable development, and efforts to eradicate poverty [Masson-Delmotte, V., P. Zhai, H.-O. Pörtner, D. Roberts, J. Skea, P.R. Shukla, A. Pirani, W. Moufouma-Okia, C. Péan, R. Pidcock, S. Connors, J.B.R. Matthews, Y. Chen, X. Zhou, M.I. Gomis, E. Lonnoy, T. Maycock, M. Tignor, and T. Waterfield (eds.)] (In press)

IPCC 2019b IPCC Special Report on the Ocean and Cryosphere in a Changing Climate [H.-O. Pörtner, D.C. Roberts, V. Masson-Delmotte, P. Zhai, M. Tignor, E. Poloczanska, K. Mintenbeck, A. Alegría, M. Nicolai, A. Okem, J. Petzold, B. Rama, N.M. Weyer (eds.)] (In press)

Jehn F U 2021 zutn/Extreme-Climate-Change: Publication ready (Zenodo) Online: https://zenodo.org/record/4311470

Lempert R, Popper S and Bankes S 2003 Shaping the Next One Hundred Years: New Methods for Quantitative, Long-Term Policy Analysis (RAND Corporation) Online: https://www.rand.org/pubs/monograph_reports/MR1626.html

Lenton T M, Rockström J, Gaffney O, Rahmstorf S, Richardson K, Steffen W and Schellnhuber H J 2019 Climate tipping points — too risky to bet against Nature 575 592–5

Lynas M 2020 Our Final Warning: Six Degrees of Climate Emergency (Fourth Estate)

New M, Liverman D, Schroder H and Anderson K 2011 Four degrees and beyond: the potential for a global temperature increase of four degrees and its implications Proc. R. Soc. A 369 6–19, doi: 10.1098/rsta.2010.0303

Ord T 2020 Chapter 4: Anthropogenic Risks The Precipice: Existential Risk and the Future of Humanity (New York, US: Hachette Books, 480 pp)

Oreskes N and Conway E M 2012 Merchants of doubt: how a handful of scientists obscured the truth on issues from tobacco smoke to global warming (London: Bloomsbury)

Oreskes N, Shrader-Frechette K and Belitz K 1994 Verification, Validation, and Confirmation of Numerical Models in the Earth Sciences Science 263 641–6

Raftery A E, Zimmer A, Frierson D M W, Startz R and Liu P 2017 Less than 2 °C warming by 2100 unlikely Nature Climate Change 7 637–41

Riahi K, van Vuuren D P, Kriegler E, Edmonds J, O’Neill B C, Fujimori S, Bauer N, Calvin K, Dellink R, Fricko O, Lutz W, Popp A, Cuaresma J C, Kc S, Leimbach M, Jiang L, Kram T, Rao S, Emmerling J, Ebi K, Hasegawa T, Havlik P, Humpenöder F, Da Silva L A, Smith S, Stehfest E, Bosetti V, Eom J, Gernaat D, Masui T, Rogelj J, Strefler J, Drouet L, Krey V, Luderer G, Harmsen M, Takahashi K, Baumstark L, Doelman J C, Kainuma M, Klimont Z, Marangoni G, Lotze-Campen H, Obersteiner M, Tabeau A and Tavoni M 2017 The Shared Socioeconomic Pathways and their energy, land use, and greenhouse gas emissions implications: An overview Global Environmental Change 42 153–68

Sherwood S C, Webb M J, Annan J D, Armour K C, Forster P M, Hargreaves J C, Hegerl G, Klein S A, Marvel K D, Rohling E J, Watanabe M, Andrews T, Braconnot P, Bretherton C S, Foster G L, Hausfather Z, Heydt A S von der, Knutti R, Mauritsen T, Norris J R, Proistosescu C, Rugenstein M, Schmidt G A, Tokarska K B and Zelinka M D 2020 An Assessment of Earth’s Climate Sensitivity Using Multiple Lines of Evidence Reviews of Geophysics 58 Online: https://agupubs.onlinelibrary.wiley.com/doi/abs/10.1029/2019RG000678

Wagner G and Weitzman M L 2015 Climate shock: the economic consequences of a hotter planet (Princeton: Princeton University Press)

Wallace-Wells D 2019 The uninhabitable earth: life after warming

Weitzman M L 2012 GHG Targets as Insurance Against Catastrophic Climate Damages Journal of Public Economic Theory 14 221–44

Author affiliations

¹ Institute for Landscape Ecology and Resources Management (ILR), Research Centre for BioSystems, Land Use and Nutrition (iFZ), Justus Liebig University Giessen, Heinrich-Buff-Ring 26, 35390 Giessen, Germany

² Independent Researcher, Edmonton, Canada

³ Centre for the Study of Existential Risk, University of Cambridge, 14 Mill Lane, Cambridge, United Kingdom

⁴ Centre for International Development and Environmental Research (ZEU), Justus Liebig University Giessen, Senckenbergstrasse 3, 35392 Giessen, Germany