- Open Access
- Open Peer Review
Efficiency of two-phase methods with focus on a planned population-based case-control study on air pollution and stroke
Environmental Healthvolume 6, Article number: 34 (2007)
We plan to conduct a case-control study to investigate whether exposure to nitrogen dioxide (NO2) increases the risk of stroke. In case-control studies, selective participation can lead to bias and loss of efficiency. A two-phase design can reduce bias and improve efficiency by combining information on the non-participating subjects with information from the participating subjects. In our planned study, we will have access to individual disease status and data on NO2 exposure on group (area) level for a large population sample of Scania, southern Sweden. A smaller sub-sample will be selected to the second phase for individual-level assessment on exposure and covariables. In this paper, we simulate a case-control study based on our planned study. We develop a two-phase method for this study and compare the performance of our method with the performance of other two-phase methods.
A two-phase case-control study was simulated with a varying number of first- and second-phase subjects. Estimation methods: Method 1: Effect estimation with second-phase data only. Method 2: Effect estimation by adjusting the first-phase estimate with the difference between the adjusted and unadjusted second-phase estimate. The first-phase estimate is based on individual disease status and residential address for all study subjects that are linked to register data on NO2-exposure for each geographical area. Method 3: Effect estimation by using the expectation-maximization (EM) algorithm without taking area-level register data on exposure into account. Method 4: Effect estimation by using the EM algorithm and incorporating group-level register data on NO2-exposure.
The simulated scenarios were such that, unbiased or marginally biased (< 7%) odds ratio (OR) estimates were obtained with all methods. The efficiencies of method 4, are generally higher than those of methods 1 and 2. The standard errors in method 4 decreased further when the case/control ratio is above one in the second phase. For all methods, the standard errors do not become substantially reduced when the number of first-phase controls is increased.
In the setting described here, method 4 had the best performance in order to improve efficiency, while adjusting for varying participation rates across areas.
We consider a planned study on possible long-term effects of exposure to air pollution on the incidence of stroke in Scania, a region in the southernmost part of Sweden. There have been several previous studies investigating the association between exposure to air pollution and the risk of developing stroke, with both positive and negative findings [1–4]. Early studies reported adverse health effects of high levels of air pollution .
Exposure to nitrogen dioxide (NO2) has documented momentary and chronic health effects . There have been several time-series studies using peak values or daily mean concentrations of NO2 as indicator of exposure, where short-term associations with stroke admissions to hospitals have been shown [3, 7, 8]. Proximity to roads has been used as an indicator of air pollution in general, revealing an association with long-term incidence of stroke .
Increased cardio-respiratory mortality has been reported as an effect of chronic exposure to outdoor air pollution but without specific reports on stroke [10–12]. Maheswaran et al.  showed an association between levels of air pollution and incidence of stroke in a area-level geographical study, where potential confounders such as smoking and socio-economic status were adjusted for at the area-level. However, adjusting for confounding on group/area-level cannot generally replace adjustments on the individual-level .
We have access to area-level concentrations of air pollution from dispersion modelling , and access to individual-level data on stroke occurrence together with age, sex, and current residential area for the entire population in Scania. For about half of the population, we also have access to the geographical coordinates of each persons' past residences from 1984 and onwards. Furthermore, we will have access to individual data on exposure to air pollution as well as on potential confounding factors such as smoking for a subsample. Our data make it possible to investigate long-term effect of air pollution and possible synergistic effects of age, sex, and smoking.
A two-phase design is a design where some variables, here called first-phase variables, are determined for all study subjects, for example from registers, while a sub-sample of subjects, here called second-phase subjects, is selected for additional data collection . Missing-data methods can be applied to estimate the values on exposure and covariables in the subjects not selected into the second phase . We provide a more detailed description of the two-phase concept and a brief history of the development of two-phase methods in the additional file 1.
In this paper, we simulate data from a two-phase design that resemble our planned case-control study on the long-term effects of air pollution on stroke risk. Available data in the first-phase are individual disease status and residential address for all study subjects that are linked to register data on NO2-exposure for each geographical area. The register data are formulated as probabilities of low, medium, and high exposure. Supplementary individual-level data on exposure and confounders are assessed for a sub-sample in the second phase. Strömberg and Björk  have considered a similar setting and we now extend their work in two important ways:
we allow for a trichotomous exposure (with straightforward generalizations to multiple exposure categories) on the individual level;
we allow for collection of data on confounders, together with individual-level exposure data, in the second phase.
We also compare the efficiency of the effect estimates of typical two-phase methods, calculated relative to the ideal (but unrealistic) situation with second-phase data on all study subjects being available. In particular, we want to compare the efficiency of two-phase methods using and not using register area-level exposure data available for the first-phase subjects.
General study scenario
In our planned study, we use exposure to NO2 as a marker of air pollution. The first-phase data on residential addresses of the study subjects that can be linked to a Geographical Information Systems (GIS) that provides exposure data on the area level . The area-level exposure distribution in our setting is characterized through probabilities of exposure at low, medium, and high level rather than through area-level mean values. Each study subject is therefore assigned three exposure probabilities that sum up to one based on the residential address – to resemble empirical data obtained with GIS technique (table 2). In the second phase, the individual level of NO2 (low, medium, or high) is assessed using interview information, for example questions about time spent out of doors, location, and the usual route to and from work. We assume confounding but no effect modification by smoking. No external information about smoking is available, but is obtained individually in the second-phase interviews together with additional data collection used to assess the exposure to NO2.
A logistic, and thus multiplicative, model is used on the individual level:
logit(p) = (β 0 + β 1·x 1 + β 2·x 2 + β 3·x 3)
where p denotes probability of being a case. Two binary indicator variables characterize the NO2-exposure at three different levels: x 1 = 1 if medium exposure and x 2 = 1 if high exposure. Smoking status is binary and indicated by x 3(x 3 = 1 if smoker). The baseline risk is denoted by β 0, β 0, β 1 and β 2, are the effects of exposure and β 3 is the effect of smoking.
We assume 12 different geographical areas (k = 1, 2, ..., 12). At the ecological level, the exposure category distribution in each area is characterized by three exposure probabilities, viz. the proportion of subjects classified in the low (X 0k ), medium (X 1k ) and high (X 2k ) categories, respectively, where X 0k = 1 - X 1k - X 2k . Individual disease status and residential area are known for all study, whereas smoking status is unknown. We assume a linear odds model for the ecological association across the geographical areas , where each area is characterized by (X 1k ) and (X 2k ):
Θk = e α·(1 + λ 1·X 1k + λ 2·X 2k )
where Θk is the expected disease odds for a subject living in area k, e αis the baseline disease odds (i.e., when the probabilities of medium and high exposure both are zero), 1 + λ1 is disease odds ratio (OR) for medium vs. low exposure to NO2, and 1 + λ1 is disease OR for high vs. low exposure to NO2. Note that we expect that exp(β 1) = 1 + λ1 and exp(β 2) = 1 + λ2 only when there is no confounding from smoking on the ecological association and no other ecological bias is present.
In practice, data can be expected to be spatially correlated within geographical areas and, therefore, a random effect model is often applied . The individual-level model (equation 1) can be extended to include random effects by replacing the fixed baseline risk β 0 with a random area-dependent baseline risk β 0k . Here, for simplicity, no such spatial correlation is assumed.
We designed the simulation scenarios with consideration being to our planned case-control study in Scania, Sweden. Stroke is a relatively rare disease with an incidence of approximately 2 cases per 1,000 person-years in the total population . The planned recruitment period for this study is one year, with inclusion of all incident cases in the 12 largest municipalities (areas) in Scania (total population of approximately 800,000), and we can expect approximately 1,600 new cases in the region during that year. The first-phase controls are sampled among people who are disease-free at the beginning of the recruitment period .
We assume that no selection bias arises from the recruitment of the first-phase cases and controls. Due to the register-based recruitment in this study and the quality of the population registers available in Sweden, this assumption is not hazardous.
Three true ORs were assumed: 1.5 (medium vs. low level of NO2 exposure), 3 (high vs. low level of NO2 exposure) and 2 (smoker vs. non-smoker), corresponding to β 1 = log(1.5), β 2 = log(3) and β 3 = log(2) in equation 1.
In the three scenarios in table 3, the number of second-phase cases and controls are fixed (at 300 each), whereas the number of first-phase subjects varies. In table 4, the number of first-phase cases and controls are held fixed (at 1,200 each). The total number of second-phase subjects in table 4 is 600 for all three scenarios, but the distributions of cases and controls vary. For all scenarios, 1,000 replications were carried out.
In each replication the subjects were selected randomly, so that the distributions of the exposure and co-variables among the second-phase cases and controls would reflect those distributions in the population. The overall prevalence of smoking was set to be 22% in accordance to official Swedish statistics . Smoking prevalence in the different exposure categories was assumed according to table 2, but there was no variation in smoking prevalence in the NO2-exposure categories between areas. Thus, the exposure-disease association is confounded by smoking at the individual level . The effect estimates and empiric standard deviations were calculated for all four methods as well as the efficiencies. The efficiencies were calculated as the ratio of the mean square error of the ideal scenario (individual-level information on all subjects) and the mean square error provided by the estimation method at issue.
Table 1 outlines how data are used in the estimation methods we examine. We consider the following methods:
We estimate the parameters of the individual-level model (equation 1) from the second-phase data only. Hence, method 1 is not a two-phase method but it is often used in practice among epidemiologists, for example due to non-response in case-control studies.
The first-phase effect estimates for this method are calculated using individual-level disease status and area-level exposure data; that is, a partially ecologic estimation procedure based on equation 2 . We then adjust the first-phase effect estimates with the difference between the corresponding smoking-adjusted and unadjusted second-phase estimates obtained from the individual-level logistic model (equation 1; see also additional file 2).
We estimate the parameters of the individual-level model based on both first- and second-phase subjects by using missing-data methods based on the EM algorithm (additional file 3). Briefly, in the initial expectation (E) step, the individual-level data obtained in the second phase on air pollution exposure and smoking provide estimates of exposure and smoking effects. Consequently, we can estimate the expected frequency distribution with respect to the exposure and smoking categories across the areas for the non-participating (i.e., only-first-phase) cases and controls, respectively. In the maximization (M) step, we obtain new effect estimates based on the total (observed + expected) numbers of cases and controls within each category of exposure level and smoking status. The E- and M-steps are repeated until the effect estimates converge.
We use the EM algorithm to obtain effect estimates as if the total frequencies estimated in the E-step were the complete data as in method 3 except that the area-level exposure probabilities X 1k and X 2k (k = 1, 2, ..., 12) are not estimated from observed second-phase data but given externally from a GIS-database as a 3 × 12 probability matrix (additional file 3). These external probabilities are used together with observed frequencies for smoking in the E-step, when estimating the total frequency distribution with respect to the exposure and smoking categories across the areas for the non-participating subjects.
All methods are compared with an ideal situation in which individual-level information is available on all subjects. Data are assumed to be missing at random within each area, i.e. the participation rates in the second-phase interviews conditioned on disease status are not related to exposure. However, participation rates may differ between cases and controls and may also vary across the geographical areas, allthough in this study we do not incorporate any such differences in participation rates . All methods are expected to produce bias-free estimates in the current study scenarios.
The 95% confidence intervals (CIs) around the estimates were calculated in order to appreciate the coverage of the methods. When using second-phase data only, confidence intervals of the Wald type were calculated . The variance (for calculating the confidence intervals) in method 2 were estimated according to additional file 2. When estimating the effect with the EM algorithm (i.e. methods 3 and 4), the log-likelihoods including estimated expected exposure data as though they were observed cannot be used to estimate standard errors correctly , and therefore the confidence intervals of Wald type would not yield correct coverage. The standard errors were therefore estimated with the ideal bootstrap technique .
Unbiased or marginally biased (<7%) OR estimates were obtained with all methods (tables 3 and 4). The positive bias induced if smoking is not taken into account is approximately 20% for OR = 1.5, and 33% for OR = 3. The bootstrap technique yielded 95% CIs with accurate coverage and balance for methods 3 and 4; also for the other methods, the coverage was around 95% (data not shown).
Comparing method 3 with method 4 in table 3, the efficiency of method 4 is substantially higher, especially in scenarios 1 and 3. The results obtained with methods 1 and 2 have substantially lower efficiencies than the efficiencies obtained with method 4 in scenarios 1 and 3. In scenario 2, all methods generally perform more equally regarding efficiency, although method 4 still performs better than the others.
In table 4, the efficiencies both for methods 3 and method 4 are generally low and rather equal, although generally, method 4 has higher efficiency than method 3.
To sum up, the gain in efficiency is generally larger when incorporating external area-level data (method 4) than when calculating the area-level probabilities from the individual-level data (method 3).
We have simulated a specific study situation with three exposure categories and a binary confounding factor where additional data collection is desired due for example to missing-data, participation issues, or cost limitations. The simulated study resembles the data we will have access to in our planned case-control study regarding long-term exposure to air pollution and the risk of stroke with smoking as a potential confounder and effect modifier. Generalizations to polytomous exposure categories and confounding factors are straightforward.
We evaluated which of methods 1–4 that performs best with respect to efficiency and precision. Also, we evaluated how the methods perform when varying the number of cases and controls in the first and second phase, to get the optimal design for our planned case-control study. Our simulations compared the efficiencies of methods 1–4 relative to an ideal situation where individual-level information on all variables is available in the first phase. The simulated scenarios were such that all methods produced practically bias-free estimates. Our results indicates that in our study setting, the efficiency is greater with method 4 than with the other two-phase methods (methods 2 and 3) and, as anticipated, greater than the efficiency of method 1 where only second-phase data are used. Method 4 performed better than the other methods in all scenarios (tables 3 and 4). Regarding the optimal design for our planned study, for method 4, there does not seem to be much to gain in precision of the effect estimates by including a larger number of first-phase subjects than in scenario 1. In practice, method 4 is well suited to include many controls in the first phase, due to its use of register data, but we can conclude that the empiric standard errors of method 4 is rather constant when increasing the number of first-phase subjects compared to the initial scenario 1.
In order to gain efficiency compared to the ideal situation, it seems more important to include a large proportion of the first-phase cases than of the first-phase controls into the second phase for method 4, as seen in table 4, where scenario 2.2 has the lowest standard deviations. For method 3, the efficiencies in table 4 are rather equal in all scenarios.
The efficiencies obtained with method 2 in our setting are substantially lower than the efficiencies obtained with method 4, and sometimes even lower than the ones obtained with the second-phase method, method 1 (table 3). This is because method 2 uses second-phase data only for confounding adjustment. Method 2 has been used previously where individual-level data either on exposure or confounding factors are available in the first phase, and it turned out to be an efficient method . However, the variance for the unadjusted first-phase estimate (equation 1) is relatively higher in our present study setting because we use area-level, and not individual-level, first-phase data. In our setting, participation bias is not present, but generally, method 2 is still preferable to method 1, since method 1 does not adjust for potential bias to the second phase.
We only considered scenarios where no participation bias within areas was present. If this assumption cannot be met, neither of the methods would be expected to produce bias-free estimates . Both method 3 and 4 allow for the missing-completely-at-random assumption to be violated if the selective participation is between areas, but not if it is within areas. For example, if the control participation decreases in areas where a large proportion of the population is exposed to high levels of air pollution, this would not per se generate any bias in the estimates of methods 3 and 4. If there is participation bias within an area, for example if participation is related to individual disease status and exposure status, method 3 and 4 may both yield bias. If the area-level exposure data obtained externally are incorrect, methods 2 and 4 would not be expected to produce bias-free estimates. Even if method 4 gains slightly in precision with an increasing number of cases relative to the number of controls in the second phase, highly unbalanced designs would substantially enforce any bias stemming from erroneous exposure data. We only stratified the sampling in the second phase on case/control-status. In practice, the efficiency of the study would increase if we sample larger number of subjects in areas where there is a contrast in exposure distribution compared to areas where the individual-level exposure tend to be more equal. Also, depending on how the exposure is distributed in the population it might be desirable to over-sample subjects from areas with a small population rather than recruiting subjects in exact proportion to the population; for more about sampling in a two-phase design, see [29, 30].
We stress that participation bias in population-based case-control studies is of great concern . Analysis of the data with two-phase methods can reduce the bias and at the same time improve efficiency [14, 17]. Two-phase designs are attractive in partially ecological studies where register data are available and additional data must be collected, a situation in which method 4 can be more effective than method 3. The proposed set-up could be generalized to any situation where individual-level register data are available on disease status and general covariates, and where group affiliation (e.g. residential area) allows for exposure to be assessed at the ecological level, using GIS for example, and where more exact exposure assessment and information on potential covariates for which no register data is available can be gathered in the second phase.
Several studies has been using distance to road as a proxy variable for air pollution [9, 10, 32]. The proportion in an area living within a certain distance to high-traffic roads could be used as first-phase variable with method 4.
In this paper, we have focused on studying long-term health effects of air pollution but there is also evidence of short-term health effects of air pollution . Two-phase designs could be well-suited also for the study of acute effects of air pollution. The first-phase data could, for example, be the proportion of days in which a certain level of air pollution in different residential areas is exceeded, and the second-phase information could involve finding out the location of the study subjects at the time of the acute illness.
Previous studies have shown that the incidence of stroke may be associated with socio-economic factors [33, 34], and that socio-economy can be an effect modifier for the association between air pollution and stroke . When access to data is limited to ecological data, and no individual-level data is available, it may not be possible to differentiate between contextual and compositional effects . Such a differentiation between effects can be enabled in a two-phase design. In our study on air pollution and stroke, we intend to adjust for compositional effects of socio-economic level in a two-phase design. Contextual variables that could be constructed through aggregation include average income, proportion unemployed or other socio-economic characteristics in the neighbourhood. Both methods 3 and 4 could be used to differentiate contextual and individual effects from each other. For this purpose, method 4 can be valuable in settings in which individual-level information is sparse but where ecological information is available, by incorporating the ecological information in the case-control analysis. Such extensions will require more complex statistical modelling, incorporating also random effects.
We have illustrated the differences in performance between three two-phase methods in a study situation where exposure is only available at the area-level in the first phase and where individual-level exposure data is collected in the second-phase. The method that incorporates area-level exposure data in the first-phase, supplemented with individual ascertainment of exposure and confounders for a subsample, yielded the highest efficiency.
Geographical Information Systems
- (NO2 :
Hoek G, Brunekreef B, Fischer P, van Wijnen J: The association between air pollution and heart failure, arrhythmia, embolism, thrombosis, and other cardiovascular causes of death in a time series study. Epidemiology. 2001, 12 (3): 355-357. 10.1097/00001648-200105000-00017.
Le Tertre A, Medina S, Samoli E, Forsberg B, Michelozzi P, Boumghar A, Vonk J, Bellini A, Atkinson R, Ayres J, et al.: Short-term effects of particulate air pollution on cardiovascular diseases in eight European cities. J Epidemiol Community Health. 2002, 56 (10): 773-779. 10.1136/jech.56.10.773.
Pönkä A, Virtanen M: Low-level air pollution and hospital admissions for cardiac and cerebrovascular diseases in Helsinki. Am J Public Health. 1996, 86 (9): 273-1280.
Wong T, Tam W, Yu T, Wong A: Associations between daily mortalities from respiratory and cardiovascular diseases and air pollution in Hong Kong, China. Occupational and environmental medicine. 2002, 59 (1): 30-35. 10.1136/oem.59.1.30.
Logan: Mortality in the London fog incident. Lancet. 1952, 1953 (1): 336-338.
Health aspects of Air Pollution with Particulate Matter, Ozone and Nitrogen Dioxide: World Health Organization. 2003
Hong Y-C, Lee J-T, Kim H, Kwon H-J: Air Pollution: A New Risk Factor in Ischemic Stroke Mortality. Stroke. 2002, 33 (9): 2165-2169. 10.1161/01.STR.0000026865.52610.5B.
Tsai S-S, Goggins WB, Chiu H-F, Yang C-Y: Evidence for an Association Between Air Pollution and Daily Stroke Admissions in Kaohsiung, Taiwan. Stroke. 2003, 34 (11): 2612-2616. 10.1161/01.STR.0000095564.33543.64.
Maheswaran R, Elliott P: Stroke Mortality Associated With Living Near Main Roads in England and Wales: A Geographical Study. Stroke. 2003, 34 (12): 2776-2780. 10.1161/01.STR.0000101750.77547.11.
Hoek G, Brunekreef B, Goldbohm S, Fischer P, van den Brandt PA: Association between mortality and indicators of traffic-related air pollution in the Netherlands: a cohort study. The Lancet. 2002, 360 (9341): 1203-1209. 10.1016/S0140-6736(02)11280-3.
Pope Ca, Burnett Richard T, Thurston George D, Thun Michael J, Calle Eugenia E, Krewski Daniel, Godleski John J: Cardiovascular mortality and long-term exposure to particulate air pollution: epidemiological evidence of general pathophysiological pathways of disease. Circulation. 2004, 109 (1): 71-77. 10.1161/01.CIR.0000108927.80044.7F.
Pope Ca, Thun MJ, Namboodiri MM, Dockery DW, Evans JS, Speizer FE, Heath CW: Particulate air pollution as a predictor of mortality in a prospective study of U.S. adults. Am J Respir Crit Care Med. 1995, 151 (3 Pt 1): 669-674.
Maheswaran R, Haining RP, Brindley P, Law J, Pearson T, Fryers PR, Wise S, Campbell MJ: Outdoor Air Pollution and Stroke in Sheffield, United Kingdom: A Small-Area Level Geographical Study. Stroke. 2005, 36 (2): 239-243. 10.1161/01.STR.0000151363.71221.12.
Greenland S: Ecologic versus individual-level sources of bias in ecologic estimates of contextual health effects. Int J Epidemiol. 2001, 30 (6): 1343-1350. 10.1093/ije/30.6.1343.
Stroh E, Oudin A, Gustafsson S, Pilesjö P, Harrie L, Strömberg U, Jakobsson K: Are associations between socio-economic characteristics and exposure to air pollution a question of study area size? An example from Scania, Sweden. Int J Health Geogr. 2005, 30 (2):
Wacholder S, Weinberg C: Flexible Maximum Likelihood Methods for Assessing Joint Effects in Case- Control Studies with Complex Sampling. Biometrics. 1994, 50: 350-357. 10.2307/2533378.
Strömberg U, Björk J: Incorporating group-level exposure information in case-control studies with missing data on dichotomous exposures. Epidemiology. 2004, 15 (4): 494-503. 10.1097/01.ede.0000129510.67536.36.
Björk J, Strömberg U: Effects of systematic exposure assessment errors in partially ecologic case-control studies. Int J Epidemiol. 2002, 31 (1): 154-160. 10.1093/ije/31.1.154.
Jackson C, Best N, Richardson S: Improving ecological inference using individual-level data. Statistics in Medicine. 2006, 25 (12): 2136-2159. 10.1002/sim.2370.
Wong G, Mason W: The Hierarchical Logistic Regression Model for Multilevel Analysis. Journal of the American Statistical Association. 1985, 80 (391): 513-524. 10.2307/2288464.
Norrving B, Löwenhielm P: Epidemiology of stroke in Lund-Orup, Sweden, 1983–85. Incidence of first stroke and age-related changes in subtypes. Acta Neurlog Scand. 1988, 78 (5): 408-413.
Rothman KJ: Epidemiology An Introduction. 2002, Oxford University Press
Decreased use of tobacco- where do we stand today? (In Swedish: Minskat bruk av tobak- var står vi idag?):Swedish National Institute of Public Health. 2005
Björk J, Strömberg U: Model specification and unmeasured confounders in partially ecologic analyses based on group proportions of exposed. Scandinavian J Work Environ Health. 2005, 31 (3): 184-190.
Cain K, Breslow N: Logistic regression analysis and efficient design for two-stage studies. American Journal of Epidemiology. 1988, 128: 1198-1206.
Hosmer David W, Lemeshow Stanley: Applied logistic regression. 1989, John Wiley & Sons, Inc
Efron B, Tibshirani RJ: An Introduction to the Bootstrap. 1998, Chapman and Hall
Hanley JA, Csizmadi I, Collet J-P: Two-Stage Case-Control Studies: Precision of Parameter Estimates and Considerations in Selecting Sample Size. Am J Epidemiol. 2005, 162 (12): 1225-1234. 10.1093/aje/kwi340.
Breslow NE, Cain KC: Logistic regression for two-stage case-control data. Biometrika. 1988, 75 (1): 11-20. 10.1093/biomet/75.1.11.
McNamee R: Optimal design and efficiency of two-phase case-control studies with error-prone and error-free exposure measures. Biostat. 2005, 6 (4): 590-603. 10.1093/biostatistics/kxi029.
Richiardi L, Boffetta P, Merletti F: Analysis of nonresponse bias in a population-based case-control study on lung cancer. J Clin Epidemiology. 2002, 55 (10): 1033-1040. 10.1016/S0895-4356(02)00455-9.
Wilkinson P, Elliott P, Grundy C, Shaddick G, Thakrar B, Walls P, Falconer S: Case-control study of hospital admission with asthma in children aged 5–14 years: relation with road traffic in north west London. Thorax. 1999, 54 (12): 1070-1074.
Khan FA, Zia E, Janzon L, Engström G: Incidence of Stroke and Stroke Subtypes in Malmo, Sweden, 1990–2000: Marked Differences Between Groups Defined by Birth Country. Stroke. 2004, 35 (9): 2054-2058. 10.1161/01.STR.0000135761.18954.0b.
Engström G, Khan FA, Zia E, Jerntorp I, Pessah-Rasmussen H, Norrving B, Janzon L: Marital Dissolution Is Followed by an Increased Incidence of Stroke. Cerebrovascular Diseases. 2004, 18 (4): 318-324. 10.1159/000080770.
Zeka A, Zanobetti A, Schwartz J: Individual-Level Modifiers of the Effects of Particulate Matter on Daily Mortality. American journal of epidemiology. 2006, 163 (9): 849-859. 10.1093/aje/kwj116.
Kawachi I, Berkman LF: Neighborhoods and Health. 2003, Oxford University Press
The Swedish Council for Working Life and Social Research contributed with financial support.
The author(s) declare that they have no competing interests.
AO: Contributed to study plan and methodological developments. Conducted the simulation study. Responsible for writing the manuscript.
JB: Contributed to study plan, methodological developments and the manuscript writing.
US: Contributed to study plan, methodological developments and the manuscript writing.