Are heat warning systems effective?
Environmental Health volume 12, Article number: 27 (2013)
Heatwaves are associated with significant health risks particularly among vulnerable groups. To minimize these risks, heat warning systems have been implemented. The question therefore is how effective these systems are in saving lives and reducing heat-related harm. We systematically searched and reviewed 15 studies which examined this. Six studies asserted that fewer people died of excessive heat after the implementation of heat warning systems. Demand for ambulance decreased following the implementation of these systems. One study also estimated the costs of running heat warning systems at US$210,000 compared to the US$468 million benefits of saving 117 lives. The remaining eight studies investigated people’s response to heat warning systems and taking appropriate actions against heat harms. Perceived threat of heat dangers emerged as the main factor related to heeding the warnings and taking proper actions. However, barriers, such as costs of running air-conditioners, were of significant concern, particularly to the poor. The weight of the evidence suggests that heat warning systems are effective in reducing mortality and, potentially, morbidity. However, their effectiveness may be mediated by cognitive, emotive and socio-demographic characteristics. More research is urgently required into the cost-effectiveness of heat warning systems’ measures and improving the utilization of the services.
Heatwaves kill thousands of people around the world each year [1–4]. In addition, more adverse health conditions including heat-related illnesses (e.g., heat stroke, dehydration, acute myocardial infarction) and heat exacerbated illnesses (e.g., renal disease, ischaemic heart disease and mental health disorders) are associated with heatwaves [5–9]. These effects are felt more severely among the vulnerable groups such as the elderly, children, people with pre-existing chronic conditions, as well as Culturally and Linguistically Diverse (CALD) communities, those living in poverty and isolation, homeless, and people with disabilities as they have reduced capacity and/or awareness to respond to temperature increases [6, 10, 11].
With higher frequency of heatwaves projected to occur as a result of climate change , locally tailored action plans are implemented in many affected areas to minimize harm to those most at risk. These plans which may include early alerts and advisories and a variety of emergency measures to mitigate the heat dangers, are called “heat warning systems” (HWS) or “heat health warning systems” (HHWS) [13, 14]. Given the variations in the type and extent of measures implemented as part of an HWS, it is difficult to evaluate the effectiveness of these systems in terms of saving lives and reducing heat-related harms. However, it is important to do so in order to improve decision making in public health responses, to determine cost-benefits, and to determine which mitigation and adaptation strategies are most effective in reducing heat-related morbidity and mortality. Similarly the systems need to consider whether target populations are reached and whether improvements are observed as a result of implementing HWS in knowledge, awareness, service utilization, and heat-health behavior changes.
As part of our study on the evaluation of the effectiveness of heat warning systems, we conducted a structured search in major databases and systematically retrieved and reviewed 15 articles identified using pre-defined selection criteria. This commentary provides an overview of the findings, research limitations and challenges, and formulates recommendations for further research directions.
Effectiveness of HWS
HWS and reduction in adverse health conditions
Six articles asserted that among the populations studied, the number of expected deaths reduced after the HWS implementation compared to before that [15–20]. One study was inconclusive . Due to different population and sub-group characteristics (such as age or disease groups) we were unable to estimate the extent of effectiveness. For instance, one study estimated that nearly 4400 excess deaths were avoided in France as a result of implementing HWS in 2006 , while another calculated a reduction of approximately 1300 ischemic and stroke related deaths among the people aged 65+ following the HWS implementation in Hong Kong . To date, no studies have directly examined the impact of HWS on morbidity. However, one study reported that in Milwaukee, Wisconsin, the dispatch of emergency medical services (as a proxy indicator for morbidity) was reduced by 49%-73% on heatwave days with an alert system in 1999 compared to 1995 without HWS . In terms of cost-benefits of HWS, only one study estimated that the US$210,000 cost of running HWS was highly cost-effective compared to the US$468 million benefits of saving 117 lives .
HWS and human response
Protective measures in response to heatwaves can range from temporary programs such as warnings and advisories, cooling shelters and “buddy” checks, to long term plans such as improving buildings and living environments [22–24]. However, the effectiveness of these, particularly the short term, measures depend on how well they are heeded and adopted by the target groups. We found eight papers addressing these issues. The consistent theme from these studies was that people who perceived themselves personally vulnerable were more likely to protect themselves such as using air conditioners, hydrating, dressing lightly, and avoiding strenuous activities [25–31]. However, a qualitative study of people aged 75+ found that most participants did not consider themselves vulnerable to or threatened by heat  while, interestingly, these participants considered other people of the same age group as vulnerable but not themselves.
The evidence reviewed in this study as well as descriptive and speculative studies [32, 33] suggest that implementing HWS is associated with lower mortality, but more research is needed to assess the impact of implementing HWS on morbidity. Only one study did a cost-benefit analysis and found that the benefits of saving lives far outweighed the costs of running HWS. It is nonetheless important to evaluate the effectiveness of the intervention strategies in order to maximize their benefits to the target vulnerable groups, but none of the previous studies have examined this issue. Consistent with the previous work by Bassil and Cole , our findings further advance the knowledge and debate in this area by drawing attention to the limitations and challenges facing studies of the HWS effectiveness.
In order to estimate the effectiveness of implementing HWS, all the studies need to compare the impacts of at least two similar heatwaves: one with a HWS and another without a HWS. However, these estimates are subject to major methodological and analytical challenges. To accurately estimate the effectiveness of a HWS, an accurate estimate of the net impact of heat on mortality or morbidity is required for both heatwave periods. Such estimates can be complicated as many other factors exacerbate or alleviate the impact of a heat event, such as timing, severity, duration of the heatwave, and night-time temperature, as well as socio-demographic characteristics, population acclimatization, prevalence of chronic disease, urban heat island effect, indoor air quality and potentially ozone and humidity. Additionally events that can occur alongside heatwaves such as power blackouts, transportation failures, drought and fires can also impact on morbidity and mortality [6, 12, 24, 35–37].
Inclusion of all these factors in one analytical model may be impossible due to availability of data and complexity of the analytical techniques. This makes assessing the effectiveness of the adaptation and mitigation strategies in the HWS problematic. The identified studies used different techniques to overcome these problems. Some examined the difference between “expected” and “observed” excess mortality associated with one heatwave compared to the most recent previous heatwave event [18, 20]; two compared the difference between the average number of deaths and ambulance use observed during two heatwave periods [16, 19]; and others used a combination of statistical techniques to estimate the numbers or odds of excess mortality during heatwaves with or without HWS. Only four studies adjusted their analytical models for some of the above-mentioned confounding factors [16–19]. Given the relatively crude techniques used to estimate the excess impacts, the results from the assessment of the effectiveness of HWS relying on these methods should be interpreted cautiously.
In addition to the factors mentioned above, other factors may intervene or confound the findings such as improvements in health care and living conditions including the use of air-conditioners and heat insulating building materials. However, an absence of reduction in mortality in future heatwaves is unlikely to simply indicate ineffectiveness of HWS without careful consideration of the impact of changing population characteristics. For instance, an increase in the number of vulnerable populations (e.g. the elderly, and those with pre-existing medical conditions), or population growth conducive to building density and risk of urban heat island effect, may exacerbate the impact of heat events.
Different studies are often not directly comparable due to different designs, locations and population characteristics. Because of the complexity of the HWS interventions, it is difficult to determine which components are contributing to the HWS effectiveness directly and/or indirectly. Additionally, people naturally change their behavior in summertime, which may give them a sense of preparedness and immunity, hence not feeling the need to take a particular action to heat warnings [26, 27]. Other relevant health campaigns, such as the long-running “Slip Slop Slap Seek Slide” sun protection campaign in Australia , which provides advice on ways of reducing heat exposure during the hotter hours of the day, may also have co-beneficial effects on preparing people to protect themselves against heat stress. Nevertheless, heatwaves affect the vulnerable groups rapidly and severely. Therefore, relying on “common sense” and personal feeling of heat may prevent them from seeking timely assistance.
Benefitting from theoretical frameworks
Use of theoretical frameworks such as the Health Belief Model, Health Service Utilization Model  or Precaution Adoption Process  can enhance our understanding and interpretation of human behavior. On the other hand, lack of a conceptual framework, particularly in quantitative surveys, can lead to the collection of a number of “interesting” information, but miss “crucial” information, further undermining the research. For instance, despite the importance of using air-conditioners in reducing heat impacts, only two studies reported on the cost of running air-conditioning as a concern to a considerable number of the participants [27, 29], and even then it was not clear if the concern was actually associated with using the air-conditioners during heatwaves. In our review, only one study mentioned the application of the Health Belief Model  in guiding their research, and another study  applied a framework of Awareness-Knowledge-Practice that seems to be a modified version of the Knowledge-Attitude-Practice (KAP) model recommended by World Health Organization. Other studies used variables and indicators that resonated with some elements of the mentioned theories, but none clearly based their research on any cohesive conceptual framework.
The existing evidence supports the notion that HWS are effective in reducing heat-related mortality (and potentially morbidity). However, the small number of the studies to date, as well as methodological and theoretical concerns call for further and more robust research to provide a strong evidence-base to allow the evaluation of the effectiveness of HWS in terms of reaching the target populations, changing behaviors and reducing adverse heat impacts. Future studies are required to evaluate the effectiveness of HWS with regards to heat-related and heat-exacerbated morbidity, particularly on conditions such as respiratory, cardiovascular, renal and diabetic conditions [5, 42]. More advanced analytical techniques are needed to control the effects of confounding variables and to provide more accurate estimates. Further research is also needed to establish which measures and programs are more cost-effective in reducing the adverse health impacts. Additionally, more research is urgently required into mechanisms of improving the utilization of services by the vulnerable populations and groups during heatwaves in both the developed and developing societies.
Culturally and Linguistically Diverse
Heat warning systems
Heat health warning systems
Robine J-M, Cheung SLK, Roy SL, Oyen HV, Griffiths C, Michel J-P, Herrmann FR: Death toll exceeded 70,000 in Europe during the summer of 2003. C R Biol. 2008, 331: 171-178. 10.1016/j.crvi.2007.12.001.
Guha-Sapir D, Vos F, Below R, Ponserre S: Annual Disaster Statistical Review 2010: The numbers and trends. 2011, Brussels, Belgium: Université catholique de Louvain,http://www.cred.be/sites/default/files/ADSR_2010.pdf.
Barriopedro D, Fischer EM, Luterbacher J, Trigo RM, García-Herrera R: The hot summer of 2010: redrawing the temperature record map of Europe. Science. 2011, 332: 220-10.1126/science.1201224.
ABS: The exceptional heatwave of January-February 2009 in south-eastern Australia. 2012,http://www.abs.gov.au/AUSSTATS/abs@.nsf/lookup/D9CC49B3D42A8623CA25773700169C27?opendocument.
Wang X-Y, Barnett AG, Yu W, FitzGerald G, Tippett V, Aitken P, Neville G, McRae D, Verrall K, Tong S: The impact of heatwaves on mortality and emergency hospital admissions from non-external causes in Brisbane, Australia. Occup Environ Med. 2012, 69: 163-169. 10.1136/oem.2010.062141.
Martiello MA, Giacchi MV: High temperatures and health outcomes: a review of the literature. Scand J Public Health. 2010, 38: 826-837. 10.1177/1403494810377685.
Williams S, Nitschke M, Weinstein P, Pisaniello DL, Parton KA, Bi P: The impact of summer temperatures and heatwaves on mortality and morbidity in Perth, Australia 1994–2008. Environ Int. 2012, 40: 33-38.
Schaffer A, Muscatello D, Broome R, Corbett S, Smith W: Emergency department visits, ambulance calls, and mortality associated with an exceptional heat wave in Sydney, Australia, 2011: a time-series analysis. Environ Health. 2012, 11: 3-10.1186/1476-069X-11-3.
Basu R, Pearson D, Malig B, Broadwin R, Greena R: The effect of high ambient temperature on emergency room visits. Epidemiology. 2012, 23: 813-820. 10.1097/EDE.0b013e31826b7f97.
Loughnan ME, Nicholls N, Tapper NJ: The effects of summer temperature, age and socioeconomic circumstance on acute myocardial infarction admissions in Melbourne, Australia. Int J Health Geogr. 2010, 9: 41-51. 10.1186/1476-072X-9-41.
Martinez GS, Imai C, Masumo K: Local heat stroke prevention plans in Japan: characteristics and elements for public health adaptation to climate change. Int J Environ Res Public Health. 2011, 8: 4563-4581. 10.3390/ijerph8124563.
IPCC: Managing the Risks of Extreme Events and Disasters to Advance Climate Change Adaptation: Special Report of the Intergovernmental Panel on Climate Change. 2012, New York, NY, USA: Intergovernmental Panel on Climate Change,http://www.ipcc.ch/pdf/special-reports/srex/SREX_Full_Report.pdf.
Lowe D, Ebi KL, Forsberg B: Heatwave early warning systems and adaptation advice to reduce human health consequences of heatwaves. Int J Environ Res Public Health. 2011, 8: 4623-4648. 10.3390/ijerph8124623.
Matthies F, Bickler G, Marín NC, Hales S: Heat Health Action Plans. Regional Office for Europe: World Health Organization. 2008,http://www.euro.who.int/en/what-we-do/health-topics/environment-and-health/Climate-change/publications/pre-2009/heathealth-action-plans.
Palecki MA, Changnon SA, Kunkel KE: The nature and impacts of the July 1999 heat wave in the midwestern United States: learning from the lessons of 1995. Bull Am Meteorol Soc. 2001, 82: 1353-1367. 10.1175/1520-0477(2001)082<1353:TNAIOT>2.3.CO;2.
Weisskopf MG, Anderson HA, Foldy S, Hanrahan LP, Blair K, Török TJ: Heat wave morbidity and mortality, Milwaukee, Wis, 1999 vs, an improved response?. Am J Public Health. 1995, 2002 (29): 830-833.
Chau PH, Chan KC, Woo J: Hot weather warning might help to reduce elderly mortality in Hong Kong. Int J Biometeorol. 2009, 53: 461-468. 10.1007/s00484-009-0232-5.
Ebi KL, Teisberg TJ, Kalkstein LS, Robinson L, Weiher RF: Heat watch/warning systems save lives: estimated costs and benefits for Philadelphia 1995–98. Bull Am Meteorol Soc. 2004, 85: 1067-1073. 10.1175/BAMS-85-8-1067.
Tan J, Zheng Y, Song G, Kalkstein LS, Kalkstein AJ, Tang X: Heat wave impacts on mortality in Shanghai, 1998 and 2003. Int J Biometeorol. 2007, 51: 193-200.
Fouillet A, Rey G, Wagner V, Laaidi K, Empereur-Bissonnet P, Tertre AL, Frayssinet P, Bessemoulin P, Laurent F, Crouy-Chanel PD: Has the impact of heat waves on mortality changed in France since the European heat wave of summer 2003? A study of the 2006 heat wave. Int J Epidemiol. 2008, 37: 309-317. 10.1093/ije/dym253.
Morabito M, Profili F, Crisci A, Francesconi P, Gensini GF, Orlandini S: Heat-related mortality in the Florentine area (Italy) before and after the exceptional 2003 heat wave in Europe: an improved public health response?. Int J Biometeorol. 2012, 56: 801-810. 10.1007/s00484-011-0481-y.
Meusel D, Menne B, Kirch W, Bertollini R: Public health responses to extreme weather and climate events–a brief summary of the WHO meeting on this topic in Bratislava on 9–10 February 2004. Zeitschrift für Gesundheitswissenschaften. 2004, 12: 371-381.
Tan J, Kalkstein LS, Huang J, Lin S, Yin H, Shao D: An operational heat/health warning system in shanghai. Int J Biometeorol. 2004, 48: 157-162. 10.1007/s00484-003-0193-z.
NCCARF: Impacts and adaptation response of infrastructure and communities to heatwaves- the southern Australian experience of 2009. 2010, National Climate Change Adaptation Research Facility,http://www.isr.qut.edu.au/downloads/heatwave_case_study_2010_isr.pdf.
Alberini A, Gans W, Alhassan M: Individual and public-program adaptation: coping with heat waves in five cities in Canada. Int J Environ Res Public Health. 2011, 8: 4679-4701. 10.3390/ijerph8124679.
Kalkstein AJ, Sheridan SC: The social impacts of the heat-health watch/warning system in Phoenix, Arizona: assessing the perceived risk and response of the public. Int J Biometeorol. 2007, 52: 43-55. 10.1007/s00484-006-0073-4.
Sheridan SC: A survey of public perception and response to heat warnings across four North American cities: an evaluation of municipal effectiveness. Int J Biometeorol. 2007, 52: 3-15. 10.1007/s00484-006-0052-9.
Abrahamson V, Wolf J, Lorenzoni I, Fenn B, Kovats S, Wilkinson P, Adger WN, Raine R: Perceptions of heatwave risks to health: interview-based study of older people in London and Norwich, UK. J Public Health. 2008, 31: 119-126. 10.1093/pubmed/fdn102.
Richard L, Kosatsky T, Renouf A: Correlates of hot day air-conditioning use among middle-aged and older adults with chronic heart and lung diseases: the role of health beliefs and cues to action. Health Educ Res. 2011, 26: 77-88. 10.1093/her/cyq072.
Wolf J, Adger WN, Lorenzoni I: Heat waves and cold spells: an analysis of policy response and perceptions of vulnerable populations in the UK. Environ Plan A. 2010, 42: 2721-2734. 10.1068/a42503.
Semenza JC, Wilson DJ, Parra J, Bontempo BD, Hart M, Sailor DJ, George LA: Public perception and behavior change in relationship to hot weather and air pollution. Environ Res. 2008, 107: 401-411. 10.1016/j.envres.2008.03.005.
Kyselý J, Kříž B: Decreased impacts of the 2003 heat waves on mortality in the Czech Republic: an improved response?. Int J Biometeorol. 2008, 52: 733-745. 10.1007/s00484-008-0166-3.
Smoyer KE: A comparative analysis of heat waves and associated mortalit in St. Louise, Missouri - 1980 and 1995. Int J Biometeorol. 1998, 42: 44-50. 10.1007/s004840050082.
Bassil KL, Cole DC: Effectiveness of public health interventions in reducing morbidity and mortality during heat episodes: a structured review. Int J Environ Res Public Health. 2010, 7: 991-1001. 10.3390/ijerph7030991.
Kjellstrom T, Weaver HJ: Climate change and health: impacts, vulnerability, adaptation and mitigation. NSW Public Health Bull. 2009, 20: 5-9. 10.1071/NB08053.
Gasparrini A, Armstrong B: The impact of heat waves on mortality. Epidemiology. 2011, 22: 68-73. 10.1097/EDE.0b013e3181fdcd99.
O’Neill MS, Zanobetti A, Schwartz J: Modifiers of the temperature and mortality association in seven US cities. Am J Epidemiol. 2003, 157: 1074-1082. 10.1093/aje/kwg096.
Cancer Council Australia: Slip Slop Slap Seek Slide. 2012,http://www.cancer.org.au/preventing-cancer/sun-protection/campaigns-and-events/slip-slop-slap-seek-slide.html.
Glanz K, Rimer BK, Viswanath K: Health Behavior and Health Education: Theory, Research and Practice. 2008, San Francisco: Jossey -Bass, 4
Weinstein ND, Rothman AJ, Sutton SR: Stage theories of health behavior: conceptual and methodological issues. Health Psychol. 1998, 17: 290-299.
Ibrahim JE, McInnes JA, Andrianopoulos N, Evans S: Minimising harm from heatwaves: a survey of awareness, knowledge, and practices of health professionals and care providers in Victoria, Australia. Int J Public Health. 2012, 57: 297-304. 10.1007/s00038-011-0243-y.
Schwartz J: Who is sensitive to extremes of temperature?: a case-only analysis. Epidemiology. 2005, 16: 67-72. 10.1097/01.ede.0000147114.25957.71.
This study was funded by an Australian Research Council (ARC) Linkage grant (LP882699) in partnership with the Queensland Department of Environment and Resources Management, Queensland Health and the Environmental Protection Agency. PA was partially supported by a Noel Stevenson Fellowship from the Queensland Emergency Medicine Research Foundation (QEMRF). ST was supported by an NHMRC research fellowship (#553043). The funding agencies played no role in the development, preparation and submission of this paper.
At the time of conducting the study, KV was a Principal Scientist at the Queensland Department of Environment and Resources Management, which partly funded this project. The department has since been restructured and KV is now affiliated with the Queensland Department of Science, Information Technology, Innovation and Arts.
GT and ST contributed to the conception, design, data search and analysis, interpretation, drafting and revising the paper. GF, PA and KV contributed to the conception, analysis and interpretation, and revision of the paper. All authors critically reviewed and approved the manuscript for publication.
About this article
Cite this article
Toloo, G.(., FitzGerald, G., Aitken, P. et al. Are heat warning systems effective?. Environ Health 12, 27 (2013). https://doi.org/10.1186/1476-069X-12-27
- Heat warning system
- Health beliefs
- Health service utilization