- Methodology
- Open access
- Published:
Development and performance evaluation of a GIS-based metric to assess exposure to airborne pollutant emissions from industrial sources
Environmental Health volume 18, Article number: 8 (2019)
Abstract
Background
Dioxins are environmental and persistent organic carcinogens with endocrine disrupting properties. A positive association with several cancers, including risk of breast cancer has been suggested.
Objectives
This study aimed to develop and assess performances of an exposure metric based on a Geographic Information System (GIS) through comparison with a validated dispersion model to estimate historical industrial dioxin exposure for its use in a case-control study nested within a prospective cohort.
Methods
Industrial dioxin sources were inventoried over the whole French territory (n > 2500) and annual average releases were estimated between 1990 and 2008. In three selected areas (rural, urban and urban-costal), dioxin dispersion was modelled using SIRANE, an urban Gaussian model and exposure of the French E3N cohort participants was estimated. The GIS-based metric was developed, calibrated and compared to SIRANE results using a set of parameters (local meteorological data, characteristics of industrial sources, e.g. emission intensity and stack height), by calculating weighted kappa statistics (wκ) and coefficient of determination (R2). Furthermore, as performance evaluation, the final GIS-based metric was tested to assess atmospheric exposure to cadmium.
Results
The concordance between the GIS-based metric and the dispersion model for dioxin exposure estimate was strong (wκ median = 0.78 (1st quintile = 0.72, 3rd quintile =0.82) and R2 median = 0.82 (1st quintile = 0.71, 3rd quintile = 0.87)). We observed similar performance for cadmium.
Conclusions
Our study demonstrated the ability of the GIS-based metric to reliably characterize long-term environmental dioxin and cadmium exposures as well as the pertinence of using dispersion modelling to construct and calibrate the GIS-based metric.
Background
Outdoor air pollution has been consistently linked to a range of adverse health effects, including cancer and has been estimated responsible for 3.1 million premature annual deaths worldwide [1]. Outdoor air pollution is a mixture of multiple pollutants originating from a large variety of sources, including various carcinogens classified as carcinogenic (Group 1) or probably carcinogenic (Group 2A) to humans by the International Agency for Research on Cancer (IARC) in 2013 [2]. Several recent epidemiological studies investigated the association between outdoor air pollution and breast cancer risk but results remain inconsistent. For traffic-related air pollutants (nitrogen oxides, particulate matters and polycyclic aromatic hydrocarbons), case-control studies highlighted positive associations [3,4,5,6,7,8] while prospective cohort studies did not report significant associations [6, 9,10,11,12]. Only few studies investigated the effect of airborne exposure to dioxins and cadmium (Cd) on breast cancer risk and overall results are inconclusive and need to be further investigated [6, 13, 14]. Finally, inconsistency across results of studies on xenoestrogen exposure in ambient air and breast cancer risk from the literature could be explained by methodological limitations, including lack of historical measurements and insufficient statistical power [15,16,17,18]. The multiplicity of exposure sources and the latency between exposure and cancer occurrence represent major challenges and require to precisely characterize the spatial-temporal variability of exposures over large areas and long time-periods. In numerous studies, the lack of past residential history and historical air pollutant exposure assessment at a fine spatial and temporal scales may have resulted in exposure misclassification, hence likely to have contributed to imprecise risk estimates [13, 15, 19]. Also, exposure to dioxins in the general population occurs through emissions in the atmosphere of particles with a large size range leading to exposure through direct inhalation, in particular in earlier years, but also from consumption of contaminated fat-rich food or dermal contact via the wet and dry deposition of particle and the contamination of the food chain [20]. While numerous facilities, including metal industries and cement kilns are likely to emit dioxins [17, 20, 21], the majority of published studies restricted exposure assessment to incinerators [15, 22, 23]. Moreover, information on the evolution of the facility technologies and activity over time is needed to precisely assess long-term dioxin exposure [24].
Furthermore, to overcome the lack of measurement data, previous studies investigating the impact of dioxin exposure on linear distance or presence/absence of the source as a measure of exposure [15, 17, 25, 26]. Yet, the use of these kinds of proxies has been shown to be subject to substantial misclassification [15]. Therefore, dispersion modelling, is considered more reliable to accurately assess exposure with a high spatial resolution [15].
While the spatial coverage of ambient air quality monitoring networks has steadily increased in recent years, different approaches have been developed to adequately represent the spatial variation of pollutants and reconstruct retrospective exposure for earlier periods, including atmospheric dispersion modeling [27], land use regression (LUR) models [28,29,30] and Geographical Information Systems (GIS). In the case of dioxins, the lack of monitoring data in France as input source and the sharp decrease in emissions over the past 30 years [31] limit the use of LUR modelling to assess dioxin exposure over the French territory. Furthermore, the use of atmospheric dispersion models has to face several difficulties due the fact that the pollutant sources and receptors are distributed over wide areas (the whole France). Performing simulations in domains of these sizes requires significant computational resources. The applicability of these methods (LUR and deterministic models) to assess dioxin and cadmium exposure, for which the number of measurements is extremely limited in time and space and for which there is no comprehensive historical emission inventory. Consequently, the use of GIS opens up a perspective for the characterization of atmospheric exposures to these pollutants in epidemiological studies.
GIS are being increasingly used in environmental epidemiological studies and are based on the residential proximity to distinct types of environmental exposure sources (e.g. industrial facilities and traffic roads) considered as an exposure surrogate. Moreover, GIS allows integrating meteorological and topographical parameters influencing pollutant dispersion, into a GIS-based exposure metric [32,33,34,35]. The positional accuracy of subjects’ residences is a key requisite to avoid exposure misclassification [36, 37].
The objective of this study was to develop and calibrate, through a comparison with a Gaussian dispersion model, a GIS-based metric assessing long-term airborne dioxin exposure of participants in a case-control study nested in the French E3N cohort (Etude Epidémiologique auprès de femmes de la Mutuelle Générale de l’Education Nationale) in order to investigate the association with breast cancer risk.
Methods
Study population
The E3N study is an ongoing prospective cohort involving 98,995 French female volunteers, born between 1925 and 1950, and members of a national teachers’ health insurance plan, and aimed to identify female cancer risk factors [38]. Since 1990, participants completed self-administered questionnaires, mailed every 2–3 years, on health status, medical history and main cancer risk factors (hormonal, reproductive, dietary and lifestyle-related factors). The E3N cohort is the French component of the European Prospective Investigation into Cancer and nutrition (EPIC) study [39, 40].
For this nested case-control study, 5455 incident invasive breast cancer cases (confirmed by pathology report) and 5455 matched controls were selected from the E3N cohort. Participants were included if they had filled in their home address at baseline, lived in the metropolitan French territory between 1990 and 2008, and had not reported cancer at baseline. According to an incidence density sampling, one control per case was randomly selected and matched to cases for age, department of residence, menopausal status, date of recruitment or blood draw and existence of a biological sample.
Preliminary steps to the GIS-based metric
The GIS-based assessment of industrial airborne exposure to dioxins was based on a national inventory of dioxin sources and estimation of the annual dioxin emissions, the geocoding of dioxin sources and of the residential history of study participants over the study period.
Dioxin industrial sources: Inventory and characterization
A detailed retrospective inventory of industrial sources likely to emit or to have emitted dioxins between 1990 and 2008 over the whole France was carried out, taking into account waste incineration, medical waste incineration, metal production, heat and power generation, production of mineral products, chemicals and consumer goods, and crematoria. Dioxin sources were identified through institutional and national databases, namely GEREP (annual emission reporting on pollutant and greenhouse gas releases), IREP (French National Registry of Pollutant Emissions) and ICPE (Inventory of French classified facilities). Industrial unions, nationally recognized associations and whistleblowers were contacted to identify additional facilities, in particular for earlier years and a structured questionnaire was sent to these identify facilities in order to collect additional information on technical characteristics. From 1990 to 2008, a total of 2626 dioxin sources were inventoried over the French territory.
Dioxin releases mostly depend on the combustion process and conditions, the type of material burned and the flue gas treatment. Along with the inventory, technical characteristics were collected, including geographic location of the facilities (geographic coordinates and addresses), operation periods and rates, stack height, process characteristics and flue gas cleaning technologies for the different periods. Using the technical characteristics of dioxin sources, intensity of dioxin emissions were estimated using the Standardized Toolkit for Identification and Quantification of Dioxin and Furan Releases developed by the United Nation Environmental Program [41]. The Toolkit allowed for a classification of dioxin emissions according to activity sectors and operating characteristics. The industrial sources inventoried were classified into Toolkit categories and a dioxin emission factor (in g-TEQ/t) was assigned. For each distinct operation periods, annual dioxin emission intensity (in g-TEQ/year) was estimated by multiplying the emission factor by the operation rate. A general decrease was observed in the dioxin source annual average emissions (Table 1) due to the improvement of gas cleaning technologies.
Geocoding of the residential history and sources
As this current work is a part of a GIS-based metric assessing long-term airborne dioxin exposure of the participants of the whole cohort-nested case-control study, location of facilities and geocoding of the participants’ residential history was performed for the whole France, using ArcGIS software (ArcGIS Locator, ESRI, Redlands, CA, USA), BD Adresse for ArcGIS and its reference street network database, BD Adresse® (National Geographic Institute, IGN, Saint Mandé, France) that includes 26 million addresses. The choice of the geocoding method was based on the accuracy of positioning to limit exposure misclassification and has been described in detail elsewhere [36]. Overall 28,511 residential addresses in metropolitan France, collected from the questionnaires sent between 1990 and 2005, were geocoded; 78.1% of the subject’s residences were geocoded to the address, 26% required manual checking and among them 17.4% were corrected.
Facilities identified through the inventory were located based on their geographic coordinates when available, or geocoded using the addresses collected. All automatically geocoded locations were manually checked and repositioned at the stack using current and historical aerial photography from IGN. Facilities for which the stack was not visible on current or past aerial images, were located as accurately as possible in descending order according to positional accuracy, i.e. at the centroid of the building; at the centroid of the parcel; or at the town hall of the municipality. Among the 2626 sources inventoried in France between 1990 and 2008, 82% were positioned at the stack, 13% at the centroid of the building and 5% at the parcel.
Development of the GIS-based metric
Identification of relevant parameters
Based on the review of relevant publications in the literature [17, 32, 34, 35, 42,43,44] and previous work on dioxin and cadmium modelling [31], the following parameters were included in the GIS-based metric to characterize exposure and classify study subjects according to their airborne dioxin exposure from industrial sources (Table 2): subject’s residence-to-source distance, wind direction and speed, exhaust smoke velocity and stack height. For all parameters, a setting sample was tested to identify the relevant combination of parameters (Table 2). The selected parameters were combined with the sources and subject locations, the sources’ annual emission intensity (in g-TEQ/year) and the exposure duration (in years).
Integration of the selected parameters
Proximity to dioxin sources is a key parameter to assess individual dioxin exposure [15]. Based on the literature, three different buffer sizes were tested in the calibration step, corresponding to a circular buffer around each dioxin source of respectively 3 km, 5 km and 10 km [17, 42,43,44]. A matrix of residence-to-source distance was calculated using the Point-to-Point function in ArcGIS software. Subjects residing outside the buffer were considered as non-exposed [44]. Inside the buffer, the decrease in dioxin concentrations was calculated testing different residence-to-source distance decline patterns (Table 2).
Pollutant atmospheric dispersion depends on meteorological conditions, in particular wind direction and speed. We included wind parameters in the GIS-based metric using data from the French national meteorological service, METEO France, based on 727 areas of homogeneous weather pattern (AHWP) in metropolitan France. To take into account continuity of meteorological monitoring over the study period (1990–2008), the 727 AHWP were grouped, in collaboration with METEO France, into 223 meteorological areas according to the proximity to the reference station, homogeneity of weather pattern and type of area (plain, mountain, hillside and valley). The measurement stations provided information on wind direction and speed between 1990 and 2008 on an hourly basis with an average completeness of data around 90% for the whole study period. Each inventoried industrial source was assigned to a reference meteorological station representative of the local weather conditions. For a given year, if the completeness was below 75%, data from the nearest meteorological station were used.
To integrate wind directions into the GIS, a GIS data layer named contributing area for dioxin dispersion (CADD), was created for each dioxin source, based on equal segments of the wind rose and proportion of annual wind blow and speed at each segment (Fig. 1). In the calibration step, we tested CADDs of 10°, 30° and 90°. Furthermore, for CADDs of 10°, weighted contribution (50% and 25%) of adjacent segments was assessed [44]. To take into account the wind speed, we reported the average annual wind speed for each segment and adjusted the decrease in dioxin concentration according to this average wind speed. For a given subject, exposure was estimated based on the CADD in which the subject’s residence was located. The process was managed with ArcMap 10.1.
GIS-based metric calibration
Specific areas and periods selected for metric calibration
We restricted the calibration of the GIS-based metric to three French geographical areas presenting typical topographical and meteorological patterns and distinct numbers and types of dioxin sources (Fig. 3), representative of the living environment of the majority of the E3N subjects: Lyon (a non-mountainous highly urban area), Le Bugey (a rural area) and Le Havre (a costal medium-size urban area). We further selected three distinct years over the study period with a 6-years gap (1996, 2002 and 2008) presenting, for each area, different emission intensities and meteorological parameters.
In the Lyon area, addresses were collected from the E3N questionnaires sent in 1997, 2002 and 2005 (respectively for 1996, 2002 and 2008 scenarios). Due to residential mobility, loss to follow-up and, exclusion of case-control pairs following breast cancer diagnosis, the number of subjects decreased over the study period (312 subjects in 1996, 173 in 2002 and 68 in 2008). In this area, 80.8% of the study subjects were located at the address level and 16.9% at the street address. The number of E3N subjects residing in Le Bugey and Le Havre was lower (n < 30). In order to obtain a relevant number of subjects residences for the present calibration study, 150 simulated subjects’ residences were randomly located in each of these two areas. The accuracy of the participant residential addresses geocoded was similar with the one observed in the whole France (see 2.2.).
Overall, 40 dioxin sources were identified and located in Lyon, 9 in Le Havre and 1 in Le Bugey. All the 50 sources were located at the stack. In Lyon and Le Havre, the number of sources inventoried was sufficient to perform a comparison between the Gaussian model and the GIS-based metric (Table 1). As only a single industrial source was inventoried for the Bugey, we added three virtual sources with differing parameters (stack height, smoke exit velocity, emission intensity, etc.) and annually varying dioxin emissions. The choice of technical parameters and emissions of these three virtual sources were based on average values observed during the inventory step, for three emission domains: heat and power generation, metal production and crematoria.
Annual average dioxin emission estimates for each area and year are described in Table 1. Similarly to that at the national level, a decrease is observed, from 1996 to 2008, for each of the selected areas. These changes in emissions were due to new emission policies, applied at the end of the 90’s [24]. The observed decrease is sharper for Le Havre (from 4.13 g/year in 2002 to 0.05 g/year in 2008) than for the two other sites, and is mainly due to the closing of a major industrial source after 2002.
Modelling of airborne dioxin exposure
Modelling of dioxin atmospheric dispersion was performed in Lyon, Le Bugey and Le Havre, for the three distinct periods (1996, 2002, and 2008) using the SIRANE atmospheric dispersion model. SIRANE is an urban dispersion model that integrates a specific module to simulate pollutant dispersion within a built environment [45, 46], considering local meteorological conditions and geometry of the streets. The SIRANE model has been validated by means of wind tunnel experiments [47, 48] and open field measurement data [45, 49]. Note that a detailed validation of the model, based on NO2 concentration levels, was performed over the whole Lyon urban agglomeration for the year 2008, i.e. one of the three domains considered in this study. Details on SIRANE dioxin modelling results are available in Additional file 1.
Average annual dioxin concentrations (in fg-TEQ/m3) were calculated at each E3N subject’s residence location for each year and categorized into quintiles according to the average dioxin concentration. Modelled dioxin concentrations served as reference for the calibration and validation of the GIS-based metric. Modelled dioxin concentrations for 2008 in Lyon, were compared to weekly average concentrations provided by a monitoring station located in the city center of Lyon since 2007 [31].
Performance evaluation
Once selected the parameters to be integrated in the GIS-based metric and best-performing parameter combination, two evaluations were completed to assess the performance of the GIS-based metric.
For the first performance evaluation, 150 new virtual subjects were randomly distributed in each of the three areas. The periods (1996, 2002 and 2008), source locations and emissions remained unchanged. Given the size of the Lyon area (34 km × 30 km), and the variation of population density over the area, the distribution was weighted according to population density in the Lyon area.
The second performance evaluation was achieved to assess the performance of the GIS-based metric to assess exposure to pollutants other than dioxins. For this purpose, we applied the GIS-based metric to assess cadmium exposure. Cadmium industrial sources were inventoried through institutional and public databases, industrial unions and nationally recognized associations. Using emission factors provided by the OMINEA database (Organization and Methods of the National Inventories of the Atmospheric Releases in France), from the Inter-professional Technical Centre for studies of Air Pollution (CITEPA), and technical parameters collected through similar steps as for dioxins, annual cadmium emissions were estimated for each industrial source. A total of 2686 cadmium emitting sources were inventoried over the French national territory from 1990 to 2008. At the national level, annual cadmium average emissions decreased from 24.4 kg/year to 9.5 kg/year between 1996 and 2008 (Table 1). More details are provided in a previous publication [31]. In the three selected areas, cadmium emission estimates showed similar levels and trends to those observed at the national level (Table 1).
As for dioxins, the GIS-based metric was applied in Lyon, Le Bugey and Le Havre for 1996, 2002 and 2008 and modelling of cadmium atmospheric dispersion was performed using SIRANE for the same years and areas. Details on SIRANE cadmium modelling results are available in Additional file 2.
Statistical analyses
The GIS-based metric was defined through comparison with annual dioxin concentrations estimated by SIRANE, for each scenario, which allowed selecting the most relevant parameters and their combination to be included in the GIS-based metric.
For the development of the GIS-based metric and its performance evaluation, we compared the categorical dioxin exposure classification (based on quintiles) of study subjects between the GIS-based metric and the SIRANE dispersion modelling for the three locations (Lyon, Le Bugey, Le Havre) and the three different years (1996, 2002 and 2008),
Agreement between quintiles of dioxin concentrations from modelling and quintiles of the GIS-based metric estimates was calculated using weighted kappa coefficients (wκ) and their 95% confidence intervals (95% CI). Weighted kappa coefficients assign less importance to discrepancies between adjacent quintiles and higher weight to larger discrepancies [15]. The determination coefficient R2 was also computed for each scenario. Analyses were performed using SAS software version 9.4 (SAS Institute Inc., Cary,NC).
Results
Calibration of the GIS-based metric
We observed higher wκ for a buffer size of 10 km (wκ ranging from 0.42 to 0.71 depending on the parameter combinations) compared to buffers of 3 km and 5 km (wκ ranging from 0.31 to 0.42 and from 0.34 to 0.60 for 3 km and 5 km, respectively). Taking into account wind direction, using CADDs, increased the metric performance, in particular for CADDs with 10° wind rose segments (Table 3 for Lyon area; see Additional file 3 for Le Havre area). The highest agreement was obtained for an inverse subject’s residence-to-source square distance weighting. The addition of wind speed parameters decreased the agreement: wκ (95% CI) ranging from 0.71 (0.67, 0.76) to 0.81 (0.79, 0.88) without wind speed and from 0.58 (0.49, 0.66) to 0.71 (0.70, 0.82) after integration of wind speed in the Lyon scenario (see Additional file 4).
The integration of the source technical parameters (exhaust smoke velocity and stack height) did not further improve agreement between the categorical dioxin exposure classification by the two methods (see Additional files 5 and 6), except for Le Havre in 2008 where the integration of the stack height of the major industrial source (240 m) led to considerable improvement in the agreement between the GIS-based metric and the dispersion modelling (wκ (95% CI) from 0.64 (0.59, 0.71) and 0.78 (0.72, 0.84) without and with integration of stack height respectively). Given the absence of impact of the stack height on the weighted kappa coefficients in all other scenarios and the low completeness of data for stack height at the national level (36%), it was decided to integrate into the GIS-based metric only stack heights above 90 m, corresponding to 3 times the median stack height of the 2626 sources over the whole France. Data were available for all sources with stack height above 90 m.
Based on the performance of the nearly 80 different parameter combinations in the nine calibration scenarios (3 areas over 3 years, see Figs. 2 and 3), we retained the following formula for the GIS-based metric:
a if hi is greater than 90 m
where j is the place of residence (j = 1,…,J), i is the industrial source (i = 1,…,I), EIi is the annual dioxin emission intensity (in g-TEQ/year), tj is the exposure duration (in year), dij is the residence-to-source distance (in m), Fi is the percentage of time with the wind on the CADD of the subject location, hi is the stack height (in m) and hmedian is the median value of the other sources’ stack height (in m) in a 10 km buffer.
Using the formula (i), the nine calibration scenarios, yielded wκ (95% CI) ranging from 0.71 (0.67, 0.76) to 0.84 (0.79, 0.88), corresponding to a “substantial” to “almost perfect” agreement between the categorical dioxin exposure classification into quintiles by the GIS-based metric, and the SIRANE dispersion modelling (Fig. 3). The R2 ranged from 0.68 to 0.90 for the same scenarios (Table 4). The scatterplots (Fig. 2) illustrates the ability of the GIS-based metric to provide robust estimates of the subject’s exposure in comparison to modelling results.
Performance evaluation of the GIS-based metric
Once established, the final GIS-based metric (i) was applied to the new samples of virtual subjects randomly located in Lyon, Le Bugey and Le Havre for 1996, 2002 and 2008. The calibration scenarios yielded wκ (95% CI) ranging from 0.58 (0.49, 0.66) to 0.86 (0.81, 0.91) (Table 4). Weighted kappa were below 0.6 (0.58) for one scenario (Lyon, 2008). The determination coefficients ranged from 0.30 to 0.94 for these nine scenarios (Table 4) with one scenario under 0.5 (Havre, 1996; R2: 0.3) and 4 scenarios above 0.85.
The GIS-based metric (i) was further applied to estimate airborne cadmium exposure (Table 4). We observed a “substantial” to “almost perfect” agreement for categorical dioxin exposure classification (quintiles) between the GIS-based metric and the SIRANE modelling with wκ (95% CI) ranging from 0.69 (0.64, 0.73) to 0.86 (0.82, 0.91). The wκ remained consistent across sites, periods, emission intensities and number of sources. The R2 for these nine scenarios ranged from 0.66 to 0.86.
Discussion
GIS are being increasingly used in epidemiological studies to compute exposure surrogates based on distance between study population and exposure sources or using more advanced methods integrating meteorological and topographical data, residential history as well as characteristics of industrial sources [17, 34, 42,43,44]. We developed a GIS-based metric in this way, filling methodological gaps of the existing literature to improve accuracy of airborne dioxin exposure estimates. To our knowledge, this is the first study calibrating a GIS-based metric evaluating its performance to estimate dioxin or more largely, air pollutant exposure, from industrial sources, to be used in an epidemiological study, through comparison to the SIRANE model [49].
The combination of parameters demonstrated consistently reliable estimates for the two performance evaluations with differing number of sources, subjects, meteorological and topographical conditions. Weighted kappa coefficients indicated “substantial” to “almost perfect” [50] agreement with the modelled estimates, except for one scenario (Lyon, 2008; first performance evaluation set). The relative poor performance in this scenario (wκ (95% CI): 0.58 (0.49, 0.66)) may be explained by the situation for Lyon in 2008 involving a high density of sources (n = 33) with very low and homogenous source emissions increasing the difficulty to differentially classify study subjects into quintiles [51]. Note that in this scenario, we obtained a high determination coefficient (R2: 0.88).
Likewise, the values of the coefficient of determination (R2) demonstrated reliable estimates by the GIS-based metric with median values of 0.80. Only one scenario (Le Havre, 1996, first performance evaluation set) showed a poor performance. This observation can be explained by two outliers (out of the 150 virtual subjects for this area) that were 10 times more exposed than all other subjects and underestimated by the GIS-based metric. The value of R2 increased from 0.30 to 0.95 after the exclusion of these two subjects, which were randomly located. It is worth noting that for this same situation, a substantial agreement was obtained for the categorical exposure classification (wκ (95% CI): 0.71(0.64, 0.78)). Regarding the large range of R2 obtained, it should be noted that the determination coefficient can be highly influenced by a few subjects with extreme values.
Pronk et al. studied dioxin exposure using a GIS but did not perform calibration or validation [17]. The performance observed in our study for parameter combinations such as used by Pronk et al. 2013 (inverse distances squared-weighted emission, winds not taken into account and buffer limiter to 5 km), was much lower, with wκ ranging from 0.31 to 0.45.
Overall, the level of performance of our metric is comparable to other studies conducted in Europe on more frequently studied pollutants [15, 32, 34, 42]. Unlike dioxins and cadmium, numerous measurement are available for NO2 [42], PM10 [15, 32] and black smoke [34], and facilitates calibration and validation. Cordioli et al. (2013), using PM10 as a tracer for incinerator pollutant emissions, evaluated the agreement of categorical exposure classifications of subjects between PM10 concentration maps and different exposure methods, including a simple indicator based on distance between exact address location and incinerator. Using this simple indicator, the authors obtained a wκ of 0.61. We observed similar results when our GIS-based metric was only based on source-subject distance (wκ (95% CI) ranging from 0.61 (0. 59, 0.96) to 0.78 (0.73, 0.84)). Three studies conducted a calibration using measurements [32, 34, 42] and two of them completed a performance evaluation. Gulliver and Briggs (2011) obtained a good agreement between ambient air measurements and metric estimates (R2: 0.67–0.77) for annual PM10 concentrations in London [32]. These results were comparable to performance realised by a Gaussian model (R2: 0.71–0.77). Vienneau et al. (2009), yielded a determination coefficient of 0.60, using a GIS-based moving window approach, in comparison with NO2 measurements across Europe but provided an estimation with limited accuracy (1x1 km2) [42].
The estimates observed for cadmium demonstrated the ability of the GIS-based metric to assess, as for dioxins, pollutant exposures from industrial sources with behaviours similar to dioxins, i.e. pollutants with particle size around 1 to 10 μm and absence of chemical reaction in the atmosphere. Note that, the SIRANE model for both pollutants used a similar setting (pollutant modelled as a passive scalar with an average diameter of 1 μm) but with different average densities (dioxins: 321.9 g/mol; cadmium: 112.4 g/mol) [31].
Strengths of our study included the use of a GIS and its application on a large area [34, 42], over a long and retrospective time-period, at the individual subject’s address and considering the residential history over the study period [13, 15]. Moreover, they suggest that GIS-based metrics provide a robust alternative to LUR models in case studies with few measured data (limiting the use of LUR models) or wide domains with large number of sources (requiring high computational resources for the use of atmospheric dispersion models). These results show that besides the application for epidemiological purpose, this tool can be use in numerous contexts especially in environmental impact assessment studies where it will be less complex and faster to apply than deterministic or statistical models.
Our GIS-based metric required a retrospective inventory of industrial sources, the estimation of their emission intensity, the geocoding of the participants’ residential history and of the industrial sources, and the computation of local meteorological data and source technical parameters in the GIS. The highest agreement of the parameters combination with the dispersion model was reported for the inversed square residence-to-source distance, as observed in three other studies [17, 34, 42]. The buffer size around sources was set at 10 km, which is consistent with the literature, with buffer sizes ranging from 3 to 10 km for industrial sources [17, 42, 44]. As the exposure due to traffic was not included in the GIS-based metric, smaller buffer sizes were not retained for the current study. Furthermore, while the parameters integrated in our GIS-based metric are consistent with several studies from the literature [15, 32, 35, 43], the inclusion of the wind speed in the parameters’ combination of the GIS-based metric, did not further improve the agreement statistics despites wind speed being known to impact pollutant dispersion, and this may constitute a possible source of error. While other studies integrated wind direction [44] or both wind direction and wind speed in their metric [32, 42, 43], no other study evaluated the impact of wind speed on the metric performance. Similarly, we did not identify studies that evaluated the impact of stack height or other industrial sources technical parameters on the metric performance. Integration of additional parameters, such as pluviometry or outdoor temperature, as well as regional background concentrations [34], may further improve the performance of the GIS-based metric by taking account wet and dry dioxin deposition.
Our study was based on a multi-source approach, considering multiple emission sectors (waste incineration, metal production, cement industries, etc.) and the evolution over time of the facilities’ technical characteristics. In the absence of dioxin monitoring data, emission intensity of the industrial sources was estimated using a standardized tool (http://toolkit.pops.int/). Pronk et al. also used a historical dioxin emission inventory (1987–2000) and a multi-source approach, limited however to few activity sectors [17]. The accuracy of our emission estimates were directly linked to the quality of the information collected from industrial facilities on technical characteristics of the sources. Previous studies often used emission inventories conducted for other purposes [17, 42].
The accuracy of address location may have important implications on misclassification of individual exposure, depending on the spatial concentration gradient of the exposure. Although the residential addresses of the study subjects were not recorded initially to be geocoded and used for the assessment of environmental exposure, their accuracy can be considered precise enough to limit misclassification bias, in particular for urban subjects in the present study [15, 33, 36].
In the case of dioxins, domestic activities are known to poorly contribute to airborne dioxin exposure compared to industrial sources for earlier years [52]. Some non-industrial sources have however become non negligible for more recent periods and may lead to the underestimation of the exposure and to a non-differential misclassification bias. Other punctual and non-industrial sources can emit relatively high amounts of dioxins and cadmium [31, 53], locally and in a short time scale, such as biomass fires, manufactured good burnings, cable burning, outdoor burning and illegal landfills in the early 1990s. These sources could not be considered in this GIS-based metric due to the difficulty of their retrospective inventory, their geolocalization and the estimation of their dioxin emissions. To reconstruct the subjects’ historical dioxin exposure, in an epidemiological context, it seems essential to considered these others types of emissions and the others routes of exposure such as diet due to dioxin wet and dry disposition [54].
The GIS-based metric contributes to improve exposure assessment methodologies. The possibility of taking into account chronic exposures is relevant for the study of a large number of biological pathologies and mechanisms [55]. Moreover, several recent studies have shown the need to study exposures accurately over short periods and specific exposure windows [56]. Ren et al. (2017). have recently shown for PM (whose behaviour in the atmosphere is similar to dioxins in particulate form) that exposure, one month before and after pregnancy increases the risk of birth defects [57]. In addition to long-term exposure assessment, this GIS indicator, thanks to the finesse of the meteorological information collected, is able to estimate exposure at a daily temporal scale over the entire French territory between 1990 and 2008 and thus minimizes potential classification bias of future epidemiological studies.
Conclusion
In this study, a GIS-based metric has been developed and evaluated in order to estimate the retrospective airborne dioxin exposure of participants of a cohort-nested case-control study. The final metric combined residential distance to facilities, wind direction and proportion of the year blown and technical parameters of the facilities. This combination of parameters showed reliable estimates in comparison to an atmospheric dispersion model [49] across different scenarios. The GIS-based metric also provided reliable estimates for cadmium exposure from industrial sources and might be able to assess exposure to other air pollutants with similar properties and behaviour than dioxins and cadmium (i.e. heavy metals, PM10 etc.), in particular when monitoring data are lacking. In addition to its use in epidemiology studies, the GIS-based metric may provide a useful tool for environmental impact assessment.
References
WHO. Review of evidence on health aspects of air pollution – REVIHAAP project: final technical report. 2013 [cited 2017 Aug 29]; Available from: http://www.euro.who.int/__data/assets/pdf_file/0004/193108/REVIHAAP-Final-technical-report-final-version.pdf?ua=1.
Loomis D, Grosse Y, Lauby-Secretan B, El Ghissassi F, Bouvard V, Benbrahim-Tallaa L, et al. The carcinogenicity of outdoor air pollution. Lancet Oncol. 2013;14:1262–3.
Bonner MR, Han DW, Nie L, Rogerson P, Vena JE, Muti P, et al. Breast cancer risk and exposure in early life to polycyclic aromatic hydrocarbons using total suspended particulates as a proxy measure. Cancer Epidemiol Biomark Prev. 2005;14:53–60.
Crouse DL, Goldberg MS, Ross NA, Chen H, Labrèche F. Postmenopausal breast cancer is associated with exposure to traffic-related air pollution in Montreal, Canada: a case-control study. Environ Health Perspect. 2010;118:1578–83.
Hystad P, Villeneuve PJ, Goldberg MS, Crouse DL, Johnson K. Exposure to traffic-related air pollution and the risk of developing breast cancer among women in eight Canadian provinces: a case–control study. Environ Int. 2015;74:240–8.
Liu R, Nelson DO, Hurley S, Hertz A, Reynolds P. Residential exposure to estrogen disrupting hazardous air pollutants and breast cancer risk: the California teachers study. Epidemiol Camb Mass. 2015;26:365–73.
Mordukhovich I, Beyea J, Herring AH, Hatch M, Stellman SD, Teitelbaum SL, et al. Vehicular traffic-related polycyclic aromatic hydrocarbon exposure and breast Cancer incidence: the Long Island breast Cancer study project (LIBCSP). Environ Health Perspect. 2016;124:30–8.
Nie J, Beyea J, Bonner MR, Han D, Vena JE, Rogerson P, et al. Exposure to traffic emissions throughout life and risk of breast cancer: the Western New York exposures and breast Cancer (WEB) study. Cancer Causes Control. 2007;18:947–55.
Andersen ZJ, Ravnskjær L, Andersen KK, Loft S, Brandt J, Becker T, et al. Long-term exposure to fine particulate matter and breast Cancer incidence in the Danish nurse cohort study. Cancer Epidemiol Biomark Prev Publ Am Assoc Cancer Res Cosponsored Am Soc Prev Oncol. 2017;26:428–30.
Hart JE, Bertrand KA, DuPre N, James P, Vieira VM, Tamimi RM, et al. Long-term particulate matter exposures during adulthood and risk of breast Cancer incidence in the nurses’ health study II prospective cohort. Cancer Epidemiol Biomark Prev Publ Am Assoc Cancer Res Cosponsored Am Soc Prev Oncol. 2016;25:1274–6.
Raaschou-Nielsen O, Andersen ZJ, Hvidberg M, Jensen SS, Ketzel M, Sorensen M, et al. Air pollution from traffic and cancer incidence: a Danish cohort study. Environ Health. 2011;10:67.
Reding KW, Young MT, Szpiro AA, Han CJ, DeRoo LA, Weinberg C, et al. Breast Cancer risk in relation to ambient air pollution exposure at residences in the sister study cohort. Cancer Epidemiol Biomark Prev Publ Am Assoc Cancer Res Cosponsored Am Soc Prev Oncol. 2015;24:1907–9.
Brody JG, Moysich KB, Humblet O, Attfield KR, Beehler GP, Rudel RA. Environmental pollutants and breast cancer - epidemiologic studies. Cancer. 2007;109:2667–711.
Xu J, Ye Y, Huang F, Chen H, Wu H, Huang J, et al. Association between dioxin and cancer incidence and mortality: a meta-analysis. Sci Rep [Internet]. 2016 [cited 2017 Aug 3];6. Available from: http://www.nature.com/articles/srep38012.
Cordioli M, Ranzi A, de Leo GA, Lauriola P. A Review of Exposure Assessment Methods in Epidemiological Studies on Incinerators. J Environ Public Health [Internet]. 2013 [cited 2017 Aug 29]; Available from: https://www.hindawi.com/journals/jeph/2013/129470/.
Huang YL, Batterman S. Residence location as a measure of environmental exposure: a review of air pollution epidemiology studies. J Expo Anal Environ Epidemiol. 2000;10:66–85.
Pronk A, Nuckols JR, De Roos AJ, Airola M, Colt JS, Cerhan JR, et al. Residential proximity to industrial combustion facilities and risk of non-Hodgkin lymphoma: a case-control study. Environ Health. 2013;12:20.
Viel J-F, Clement M-C, Hagi M, Grandjean S, Challier B, Danzon A. Dioxin emissions from a municipal solid waste incinerator and risk of invasive breast cancer: a population-based case-control study with GIS-derived exposure. Int J Health Geogr. 2008;7:4.
Basagana X, Aguilera I, Rivera M, Agis D, Foraster M, Marrugat J, et al. Measurement error in epidemiologic studies of air pollution based on land-use regression models. Am J Epidemiol. 2013;178:1342–6.
Lohmann R, Jones KC. Dioxins and furans in air and deposition: a review of levels, behaviour and processes. Sci Total Environ. 1998;219:53–81.
Pacyna EG, Pacyna JM, Pirrone N. European emissions of atmospheric mercury from anthropogenic sources in 1995. Atmos Environ. 2001;35:2987–96.
Ashworth DC, Fuller GW, Toledano MB, Font A, Elliott P, Hansell AL, et al. Comparative assessment of particulate air pollution exposure from municipal solid waste incinerator emissions. J Environ Public Health 2013;2013:560342.
Fabre P, Goria S, de Crouy-Chanel P, Empereur-Bissonnet P. Étude d’incidence des cancers à proximité des usines d’incinération d’ordures ménagères. Synthèse St-Maurice InVS [Internet]. 2008 [cited 2016 Oct 18]; Available from: http://opac.invs.sante.fr/doc_num.php?explnum_id=3306.
Nzihou A, Themelis NJ, Kemiha M, Benhamou Y. Dioxin emissions from municipal solid waste incinerators (MSWIs) in France. Waste Manag. 2012;32:2273–7.
Langlois PH, Brender JD, Suarez L, Zhan FB, Mistry JH, Scheuerle A, et al. Maternal residential proximity to waste sites and industrial facilities and conotruncal heart defects in offspring. Paediatr Perinat Epidemiol. 2009;23:321–31.
Zambon P, Ricci P, Bovo E, Casula A, Gattolin M, Fiore AR, et al. Sarcoma risk and dioxin emissions from incinerators and industrial plants: a population-based case-control study (Italy). Environ Health. 2007;6:19.
de Hoogh K, Korek M, Vienneau D, Keuken M, Kukkonen J, Nieuwenhuijsen MJ, et al. Comparing land use regression and dispersion modelling to assess residential exposure to ambient air pollution for epidemiological studies. Environ Int. 2014;73:382–92.
Eeftens M, Beelen R, de Hoogh K, Bellander T, Cesaroni G, Cirach M, et al. Development of land use regression models for PM2.5, PM2.5 absorbance, PM10 and PMcoarse in 20 European study areas; results of the ESCAPE project. Environ Sci Technol. 2012;46:11195–205.
Gulliver J, de Hoogh K, Hansell A, Vienneau D. Development and Back-extrapolation of NO2 land use regression models for historic exposure assessment in Great Britain. Environ Sci Technol. 2013;47:7804–11.
Hoek G, Beelen R, de Hoogh K, Vienneau D, Gulliver J, Fischer P, et al. A review of land-use regression models to assess spatial variation of outdoor air pollution. Atmos Environ. 2008;42:7561–78.
Coudon T, Hourani H, Nguyen C, Faure E, Mancini FR, Fervers B, et al. Assessment of long-term exposure to airborne dioxin and cadmium concentrations in the Lyon metropolitan area (France). Environment International. 2018;111:177–190. https://doi.org/10.1016/j.envint.2017.11.027.
Gulliver J, Briggs D. STEMS-air: a simple GIS-based air pollution dispersion model for city-wide exposure assessment. Sci Total Environ. 2011;409:2419–29.
Han D, Bonner MR, Nie J, Freudenheim JL. Assessing bias associated with geocoding of historical residence in epidemiology research. Geospat Health. 2013;7:369–74.
Hoek G, Fischer P, Van den Brandt P, Goldbohm S, Brunekreef B. Estimation of long-term average exposure to outdoor air pollution for a cohort study on mortality. J Expo Anal Environ Epidemiol. 2001;11:459–69.
Zou B, Wilson JG, Zhan FB, Zeng Y. Air pollution exposure assessment methods utilized in epidemiological studies. J Environ Monit. 2009;11:475–90.
Faure E, Danjou AMN, Clavel-Chapelon F, Boutron-Ruault M-C, Dossus L, Fervers B. Accuracy of two geocoding methods for geographic information system-based exposure assessment in epidemiological studies. Environ Health. 2017;16:15.
Jacquemin B, Johanna L, Anne B, Valerie S. Environmental health perspectives – impact of geocoding methods on associations between long-term exposure to urban air pollution and lung function. Environ Health Perspect. 2013:1054–60.
Clavel-Chapelon F. Cohort profile: the French E3N cohort study. Int J Epidemiol. 2015;44:801–9.
Riboli E. Nutrition and Cancer - background and rationale of the European prospective investigation into Cancer and nutrition (epic). Ann Oncol. 1992;3:783–91.
Riboli E, Hunt KJ, Slimani N, Ferrari P, Norat T, Fahey M, et al. European prospective investigation into cancer and nutrition (EPIC): study populations and data collection. Public Health Nutr. 2002;5:1113–24.
UNEP. United Nations Environment Programme | Toolkit for Indentification and Quantification of Releases of Dioxins, Furans and Other Unintentional POPs [Internet]. 2013 [cited 2016 Aug 22]. Available from: http://toolkit.pops.int/Publish/Main/01_Index.html.
Vienneau D, de Hoogh K, Briggs D. A GIS-based method for modelling air pollution exposures across Europe. Sci Total Environ. 2009;408:255–66.
White N, Water T, Naude J, van der Walt A, Ravenscroft G, Roberts W, Ehrlich R. Meteorologically estimated exposure but not distance predicts asthma symptoms in schoolchildren in the environs of a petrochemical refinery: a cross-sectional study. Environ Health. 2009;8:45.
Yu C-L, Wang S-F, Pan P-C, Wu M-T, Ho C-K, Smith TJ, et al. Residential exposure to petrochemicals and the risk of leukemia: using geographic information system tools to estimate individual-level residential exposure. Am J Epidemiol. 2006;164:200–7.
Soulhac L, Salizzoni P, Mejean P, Didier D, Rios I. The model SIRANE for atmospheric urban pollutant dispersion; PART II, validation of the model on a real case study. Atmos Environ. 2012;49:320–37.
Soulhac L, Salizzoni P, Cierco F-X, Perkins R. The model SIRANE for atmospheric urban pollutant dispersion; part I, presentation of the model. Atmos Environ. 2011;45:7379–95.
Ben Salem N, Garbero V, Salizzoni P, Lamaison G, Soulhac L. Modelling pollutant dispersion in a street network. Bound-Layer Meteorol. 2015;155:157–87.
Carpentieri M, Salizzoni P, Robins A, Soulhac L. Evaluation of a neighbourhood scale, street network dispersion model through comparison with wind tunnel data. Environ Model Softw. 2012;37:110–24.
Soulhac L, Nguyen CV, Volta P, Salizzoni P. The model SIRANE for atmospheric urban pollutant dispersion. PART III: validation against NO2 yearly concentration measurements in a large urban agglomeration. Atmos Environ. 2017;167:377–88.
Viera AJ, Garrett JM. Others. Understanding interobserver agreement: the kappa statistic. Fam Med. 2005;37:360–3.
Gulliver J, de Hoogh K, Fecht D, Vienneau D, Briggs D. Comparative assessment of GIS-based methods and metrics for estimating long-term exposures to air pollution. Atmos Environ. 2011;45:7072–80.
Quass U, Fermann M, Broker G. The European dioxin air emission inventory project - final results. Chemosphere. 2004;54:1319–27.
Lee RGM, Green NJL, Lohmann R, Jones KC. Seasonal, anthropogenic, air mass, and meteorological influences on the atmospheric concentrations of polychlorinated Dibenzo-p-dioxins and dibenzofurans (PCDD/fs): evidence for the importance of diffuse combustion sources. Environ Sci Technol. 1999;33:2864–71.
Danjou AM, Fervers B, Boutron-Ruault M-C, Philip T, Clavel-Chapelon F, Dossus L. Estimated dietary dioxin exposure and breast cancer risk among women from the French E3N prospective cohort. Breast Cancer Res. 2015;17:39.
Ying Z, Xu X, Bai Y, Zhong J, Chen M, Liang Y, et al. Long-term exposure to concentrated ambient PM2.5 increases mouse blood pressure through abnormal activation of the sympathetic nervous system: a role for hypothalamic inflammation. Environ Health Perspect. 2014;122:79–86.
Martens DS, Gouveia S, Madhloum N, Janssen BG, Plusquin M, Vanpoucke C, et al. Neonatal cord blood Oxylipins and exposure to particulate matter in the early-life environment: an ENVIRONAGE birth cohort study. Environ Health Perspect. 2017;125:691–8.
Ren S, Haynes E, Hall E, Hossain M, Chen A, Muglia L, et al. Periconception Exposure to Air Pollution and Risk of Congenital Malformations. J Pediatr [Internet]. 2017 [cited 2018 Jan 11]; Available from: http://www.sciencedirect.com/science/article/pii/S0022347617313306.
Acknowledgments
We gratefully acknowledge Meteo France for providing meteorological data and the E3N cohort participants for providing data. We thank Camille Denis, Guillaume Harel and Hassan Hourani for their work on the dioxin and cadmium sources inventory and characterization. We also thank Charlotte Carretero and Maxime Guilou for geocoding. We thank the CRIANN (Centre Régional Informatique et d'Application Numerique de Normandie) for allowing us to use their resoucres to perform our numerical simulations.
Funding
This work was supported by public funding from the French Environment and Energy Management Agency (ADEME, Grant N° 1306C0031), the Cancéropôle Lyon Auvergne Rhône-Alpes (CLARA), the Regional Committee of the French League against Cancer of the Saone et Loire Region, and was carried out in partnership with the ARC Foundations for Cancer Research. The E3N study is financially supported by the French League against Cancer, the Mutuelle Générale de l’Education Nationale, the Institut Gustave Roussy, the Institut National de la Santé et de la Recherche Médicale. Thomas Coudon and Aurélie Danjou were supported by a doctoral fellowship of University Lyon 1. Delphine Praud was supported by a post-doctoral fellowship of the French League against Cancer.
Availability of data and materials
The datasets generated or analysed during the current study are available from the corresponding author on reasonable request.
Author information
Authors and Affiliations
Contributions
TC and EF have made contribution to the data acquisition. TC performed the modeling of atmospheric exposure. EF and TC geocoded the addresses and performed the GIS analyses. AMND and DP performed the statistical analyses. TC drafted the manuscript. TC, EF, AMND, DP and BF have interpreted the results. EF, AMND, DP, BF, PS, GS and FRM have made contribution to the revision of the manuscript. All authors have read and approved the submitted manuscript.
Corresponding authors
Ethics declarations
Ethics approval and consent to participate
The E3N cohort study received ethical approval from the French National Commission for Computerized Data and Individual Freedom (Commission Nationale de l’Informatique et des Libertés, CNIL), and all women in the study provided signed informed consent for participation into the study. This approval covers all questionnaires designed within the framework of the cohort, and no new approval is needed for individual projects.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Additional files
Additional file 1:
Boxplot of the average dioxin concentrations (fg-TEQ/m3), modeled at the E3N location in Lyon, Le Havre and Le Bugey for 1996, 2002 and 2008 with the SIRANE model. This figure shows the reparation of subjects’ exposure to dioxin, obtained with the SIRANE model, for 3 years (1996, 2002 and 2008) for the 3 areas (Le Havre, le Bugey, Lyon). (DOCX 582 kb)
Additional file 2:
Boxplot of the average cadmium concentrations (ng/m3), modeled at the E3N location in Lyon, Le Havre and Le Bugey for 1996, 2002 and 2008 with the SIRANE model. This figure shows the reparation of subjects’ exposure to cadmium, obtained with the SIRANE model, for 3 years (1996, 2002 and 2008) for the 3 areas (Le Havre, le Bugey, Lyon). (DOCX 737 kb)
Additional file 3:
Weighted kappa coefficients and CI95% with different CADD and distance decline patterns in the Le Bugey scenarios. This table shows the variation of the concordance between the two classifications according to the combination of the setting of different parameters (winds direction and distance decline) in Le Bugey scenario. (DOCX 14 kb)
Additional file 4:
Weighted kappa coefficients and CI95% in Lyon and Le Bugey with and without taking into account wind speed. This table shows that taking into account winds speed, decrease performance of the GIS metric. (DOCX 12 kb)
Additional file 5:
Weighted kappa coefficients and CI95% in Lyon, Le Bugey and Le Havre with different source technical parameter settings. This table shows the variation of the concordance between the two classifications according to the combination of the setting of sources technical parameters (stack height and smoke velocity) in Lyon, Le Bugey and Le Havre scenarios. (DOCX 13 kb)
Additional file 6:
Weighted kappa coefficients and CI95% in Lyon, Le Bugey and Le Havre with and without technical parameters. This table shows the variation of the concordance between the two classifications across the 3 areas (Le Havre, Lyon and Le Bugey) with and without taking account sources technical parameters (stack height and smoke velocity). (DOCX 14 kb)
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Cite this article
Coudon, T., Danjou, A.M.N., Faure, E. et al. Development and performance evaluation of a GIS-based metric to assess exposure to airborne pollutant emissions from industrial sources. Environ Health 18, 8 (2019). https://doi.org/10.1186/s12940-019-0446-x
Received:
Accepted:
Published:
DOI: https://doi.org/10.1186/s12940-019-0446-x