Skip to content


  • Research
  • Open Access
  • Open Peer Review

Association of blood lead concentrations with mortality in older women: a prospective cohort study

  • 1Email author,
  • 2,
  • 1,
  • 3,
  • 4,
  • 5,
  • 6,
  • 7 and
  • 1
Environmental Health20098:15

  • Received: 24 October 2008
  • Accepted: 03 April 2009
  • Published:
Open Peer Review reports



Blood lead concentrations have been associated with increased risk of cardiovascular, cancer, and all-cause mortality in adults in general population and occupational cohorts. We aimed to determine the association between blood lead, all cause and cause specific mortality in elderly, community residing women.


Prospective cohort study of 533 women aged 65–87 years enrolled in the Study of Osteoporotic Fractures at 2 US research centers (Baltimore, MD; Monongahela Valley, PA) from 1986–1988. Blood lead concentrations were determined by atomic absorption spectrometry. Using blood lead concentration categorized as < 8 μg/dL (0.384 μmol/L), and ≥ 8 μg/dL (0.384 μmol/L), we determined the relative risk of mortality from all cause, and cause-specific mortality, through Cox proportional hazards regression analysis.


Mean blood lead concentration was 5.3 ± 2.3 μg/dL (range 1–21) [0.25 ± 0.11 μmol/L (range 0.05–1.008)]. After 12.0 ± 3 years of > 95% complete follow-up, 123 (23%) women who died had slightly higher mean (± SD) blood lead 5.56 (± 3) μg/dL [0.27(± 0.14) μmol/L] than survivors: 5.17(± 2.0) [0.25(± 0.1) μmol/L] (p = 0.09). Women with blood lead concentrations ≥ 8 μg/dL (0.384 μmol/L), had 59% increased risk of multivariate adjusted all cause mortality (Hazard Ratio [HR], 1.59; 95% confidence interval [CI], 1.02–2.49) (p = 0.041) especially coronary heart disease (CHD) mortality (HR = 3.08 [CI], (1.23–7.70)(p = 0.016), compared to women with blood lead concentrations < 8 μg/dL(< 0.384 μmol/L). There was no association of blood lead with stroke, cancer, or non cardiovascular deaths.


Women with blood lead concentrations of ≥ 8 μg/dL (0.384 μmol/L), experienced increased mortality, in particular from CHD as compared to those with lower blood lead concentrations.


  • Coronary Heart Disease
  • Homocysteine
  • Lead Exposure
  • Blood Lead Concentration
  • Lower 15th Percentile


Lead is a multitargeted toxicant, affecting cardiovascular, renal and nervous systems, and may contribute to morbidity and mortality through its adverse impacts on these systems [1, 2].

An association between lead and mortality has been observed in both occupational and community based cohorts [3]. Results from the second National Health and Nutrition Examination Survey (NHANES II, 1976–1980) showed that blood lead concentration was an important predictor of mortality [4]. Individuals with baseline blood lead concentrations of 20 to 29 μg/dL [0.96 to 1.39 μmol/L (To convert μg/dL of blood lead into μmol/L, multiply by 0.048)] experienced 46% increased all cause mortality, relative to those with blood lead concentrations less than 10 μg/dL(0.48 μmol/L) [5]. In NHANES III (1988–1994) an increased risk of death from all causes, cardiovascular disease, and cancer was associated with much lower blood lead concentrations of 5–9 μg/dL(0.24–0.43 μmol/L) as compared to those with < 5.0 μg/dL [6]. Furthermore Menke et al documented a 25% increased all cause and 55% increased cardiovascular mortality in NHANES III (1988–1994) at considerably lower blood lead concentrations: > 3.62 μg/dL (0.17 μmol/L) as compared to those with < 1.94 μg/dL (0.09 μmol/L) [7]. However they did not observe an association between blood lead and cancer mortality in this range of exposure.

Environmental exposures to lead have been associated with hypertension and the incidence of clinical cardiovascular endpoints such as coronary heart disease, stroke, and peripheral artery disease [8]. Cardiac abnormalities such as left ventricular hypertrophy [9] and alteration in cardiac rhythm [10] have also been documented with lead exposure. Higher blood concentrations have been associated with cognitive and neuromuscular decline [1113], and renal effects [2, 1416] all of which could contribute to an increased risk of mortality. The effects of blood lead concentrations on cancer mortality however, are poorly understood. In the current analysis we prospectively examined the association of blood lead concentrations and mortality in a cohort of 533 white women with mean age of 72.5 (± 4.4) (range: 68–89) years and mean blood lead concentrations of 5.3 μg/dL (± 2.3 SD) (range: 1–21). We hypothesized that woman with blood lead concentrations above a threshold will experience higher total and cause specific mortality.


Study Population

The Study of Osteoporotic Fractures (SOF) is a longitudinal cohort study that enrolled 9704 white women from 1986 to 1988 using population-based listings in Baltimore, MD; Minneapolis, MN; Portland, OR; and the Monongahela Valley near Pittsburgh, PA. To be eligible to participate, women had to be aged 65 years or older and ambulatory. The lead ancillary study was conducted in 1990–1991 in 533 white women aged 65–87 years enrolled in SOF at either the University of Pittsburgh or University of Maryland clinics. The participants in this study of blood lead concentrations represent a convenience sample obtained from two of the clinical centers of the Study of Osteoporotic Fractures.

Initially, we examined the correlates of blood lead and the association of blood lead concentrations to cognitive function [17]. Analyses were performed by categorizing the study participants into three groups corresponding to the upper and lower 15th percentiles of the distribution of blood lead. Thus, the three groups were: low [= 3 μg/dl (0.14 μmol/L), lower 15th percentile; referent; n = 122)]; medium [4–7 μg/dl (0.19–0.34 μmol/L); n = 332]; and high [= 8 μg/dl (0.38 μmol/L), upper 15th percentile; n = 79]. This categorization was determined a priori [17]. We found a relationship between blood lead concentration as low as 8 μg/dL and worse cognitive function as measured by the part B of Trailmaking Test, but this association was confined to the rural SOF clinic [17, 18]. In a recent analysis in the same population, we found a significantly higher risk of falls and fractures in older women at blood lead concentration ≥ 4 μg/dL (0.19 μmol/L), and faster rate of bone loss at ≥ 8 μg/dL (0.38 μmol/L), when compared to women with blood lead concentration < 3 μg/dL (0.14 μmol/L) [19]. In the current paper, we extend the lead study to mortality outcomes. The protocol and consent forms were approved by the institutional review boards at the participating institutions. All women provided written informed consent.

Questionnaire and interview

Each participant completed a baseline questionnaire that ascertained her education and health behaviors including smoking, alcohol use, and walking for exercise. They also were asked about physician diagnosed diabetes, hypertension (measured blood pressure > 160/90 or thiazide use). They were asked about current use of estrogen.


At the baseline clinic examination, each participant had her blood pressure measured by manual mercury sphygmomanometer. BMD of total hip was measured at the second (1988–1990) examination by Dual energy X-ray absorptiometry (DXA) using Hologic QDR 1000 scanners (Bedford, Mass). Height and weight were obtained using a Harpenden stadiometer (Holtain Ltd, Crymych, UK) and a standard balance beam, respectively, and body mass index (BMI) was calculated as weight divided by height squared (Kg/m2).


The methods of determining deaths in SOF have been published[20, 21]. Briefly, participants were contacted every 4 months by postcard after visit 2 (1991–92) over 12 (± 3) years of follow-up. These contacts are > 95% complete. Deaths were confirmed by death certificates. Hospital discharge summaries were obtained for 41(33%) of deceased participants. The underlying cause of death was coded by a clinical epidemiologist using the International Classification of Diseases, Ninth Revision, Clinical Modification, and categorized as due to cardiovascular disease (CVD) including all diseases of circulatory system except those involving veins and lymphatics [ICD-9-CM codes 425, 429.2, 440–444, 428, 401–404, 410–414, 430–438, and 798.]; Coronary heart disease (CHD) [ICD-9-CM 410–414]; Stroke [ICD-9-CM 430–438]; cancer [ICD-9-CM codes 140 to 239] and all other deaths.

Blood Lead Measurements

A 5.0 ml sample of whole blood was drawn into Vacutainer tubes (BD Vacutainer Systems, Rutherford, New Jersey). Blood samples were analyzed at the Clinical Chemistry Laboratory of the University of Maryland, certified for the analysis of lead in blood by the Occupational Safety and Health Administration and Centers for Disease Control and Prevention, and documents a lower limit of detection for lead of 1 μg/dL. Blood lead concentrations were determined by graphite furnace atomic absorption spectrometry (AAS model 5100, HGA with Zeeman Effect background correction: Perkin Elmer, Norwalk, Connecticut). To determine intralaboratory measurement variability in lead concentration and the stability of samples over 1 year, 100 samples (50 from each clinic) were drawn from randomly selected women during a clinic visit, one year later. The intraclass correlation coefficient for the duplicates was 0.88. Mean values of 4.76 μg/dL (range, 1–13 μg/dL) [0.23(range 0.05–0.62 μmol/L)], and 4.67 μg/dL (range, 1–12 μg/dL) [0.22 μmol/L (range 0.05–0.58) were obtained for the first and second determinations, respectively[17]

Statistical Analysis

Preliminary analyses were performed by categorizing the study participants into three groups corresponding to the upper and lower 15th percentiles of the distribution of blood lead. Thus, the three groups were: low [≤ 3 μg/dl (0.14 μmol/L), lower 15th percentile; referent; n = 122)]; medium [4–7 μg/dl (0.19–0.34 μmol/L); n = 332]; and high [≥ 8 μg/dl (0.384 μmol/L), upper 15th percentile; n = 79]. This categorization was determined a priori based on our previous study of blood lead and cognitive functions [17]. Analysis suggested that mortality outcome was only significant at the highest 15th percentile i.e., ≥ 8 μg/dL (0.384 μmol/L) of blood lead, when compared to the referent and the medium group, we therefore combined these two categories into a new reference group with lead level < 8 ug/dl (0.384 μmol/L). Furthermore, preliminary analysis by dividing the participants into quintiles, also suggested that only the top quintile (80th percentile i.e., ≥ 8 μg/dL (0.384 μmol/L) of blood lead) showed elevated risk of death. We therefore dichotomized lead concentrations above and below 8 μg/dL (80th and 85th percentile was same i.e., ≥ 8 μg/dL(0.384 μmol/L) of blood lead), thus the two groups were: (< 8 μg/dL, referent, n = 454), and (≥ 8 μg/dL, n = 79).

We compared baseline characteristics by lead and mortality status, using chi-square tests for categorical variables and t-tests for continuous variables. Two-tailed p-values were used for all tests, at 5% statistical significance. Separate models were analyzed for all cause and cause specific mortality. CVD mortality was categorized into two subgroups: deaths due to stroke, and coronary heart disease.

We used Cox proportional hazards regression analysis to estimate the Hazard Ratio (HR) and 95% confidence intervals (CI) to determine association between blood lead concentration and mortality. As done previously in SOF[22] we assessed variables for inclusion in the models based on biological plausibility and documented association in literature with blood lead [4, 5] and mortality [23]. Selected on these criteria, we controlled for the following variables into all models: age increase per 5 years, clinic, BMI, education, smoking, alcohol intake, estrogen use, hypertension, total hip BMD, walking for exercise, and diabetes.

The proportionality assumptions of the Cox models were confirmed with Schoenfeld residuals. We plotted cumulative survival in two blood lead concentrations groups over follow-up period by Kaplan- Meier curves. Data were analyzed with Stata (edition 9, StataCorp, College Station, Texas).


The women in lead ancillary study were compared to the rest of SOF study participants. Lead study cohort was younger in age from the rest of the SOF participants (Table 1). A lower proportion of women in lead cohort was hypertensive, or walked for exercise. Proportion of diabetics was higher in the lead study. However, BMI, education, alcohol use, smoking, use of estrogen, bone density in total hip were comparable.
Table 1

Comparison of participants' baseline characteristics between SOF and lead ancillary study.

Characteristics (N total = 9704)

Lead cohort N = 533

SOF participants N = 9171

P value

Age (years), mean SD

70 ± 4

72 ± 5

< 0.001

Body mass index (kg/m2)), mean SD

27 ± 5

26 ± 4


Education (years), mean SD

12 ± 3

13 ± 3


Alcohol (drinks/wk), mean SD

1.9 ± 4

1.8 ± 4


Current smoker, n (%)

65 (12)

902 (10)


Hypertension, n (%)

153 (29)

3594 (39)

< 0.001

Diabetes, n (%)

55 (10)

652 (7)


Current estrogen use, n (%)

67 (13)

1400 (15)


Walk for exercise (yes/no), n (%)

213 (40)

4653 (51)

< 0.001

Total hip, bone density (g/cm2), mean SD

0.77 ± 0.13

0.76 ± 0.13


Mean blood lead concentration was 5.3 ± 2.3 μg/dL (range 1–21) [0.25 ± 0.11 μmol/L (range 0.05–1.008)]. A total of 123 (23%) women died over a mean follow up of 12.0 (± 3.0) years. Women with ≥ 8 μg/dL(0.384 μmol/L), blood lead concentration had higher alcohol intake, were more likely to smoke, and had 8% lower total hip BMD (Table 2).
Table 2

Baseline characteristics in women in SOF lead ancillary study by blood lead concentrations

Characteristics by blood lead concentration

< 8 μg/dL

(< 0.384 μmol/L)

N = 453

≥ 8 μg/dL

(≥ 0.384 μmol/L)

N = 79

P value

All cause mortality, n (col %)

96 (21)

27 (34)


Age (years), mean ± SD

70 ± 4

70 ± 5


Body mass index (kg/m2)), mean ± SD

27 ± 5

26 ± 4


Education (years), mean ± SD

12 ± 3

13 ± 3


Alcohol (drinks/wk), mean ± SD

1.5 ± 3

2.9 ± 5


Current smoker, n (%)

46 (10)

20 (25)


Hypertension, n (%)

128 (28)

25 (32)


Diabetes, n (%)

48 (11)

7 (9)


Current estrogen use, n (%)

60 (13)

7 (9)


Walk for exercise (yes/no), n (%)

183 (40)

30 (38)


Total hip, bone density (g/cm2), mean ± SD

0.77 ± 0.13

0.72 ± 0.12

< 0.006

Women who died had 7% higher mean (± SD) blood lead concentration 5.6 (3) μg/dL, [0.27(± 0.14) μmol/L] than survivors: 5.17(± 2.0) [0.25(± 0.1) μmol/L] μg/dL (p = 0.09, Table 3). As compared to survivors, women who died were older, more likely to smoke and to have hypertension. A lower proportion of women who died reported walking for exercise. Compared to women whose blood lead concentrations were < 8 μg/dL, (< 0.384 μmol/L) survival decreased more rapidly in women with blood lead concentration ≥ 8 μg/dL (≥ 0.384 μmol/L) (Figure 1). Age, clinic, smoking, hypertension, and total hip BMD were significantly associated with mortality in women with blood lead concentration ≥ 8 μg/dL (≥ 0.384 μmol/L) (Table 4).
Table 3

Baseline characteristics in women in SOF lead ancillary study by survival/mortality status.


Died N = 123

Survived N = 410

P value

Age (years), mean ± SD

72 ± 5

70 ± 4


Education (years), mean ± SD

12 ± 3

12 ± 3


Body mass index(kg/m2)), mean ± SD

26 ± 5

27 ± 5


Alcohol (drinks/wk), mean ± SD

1.9 ± 5

1.8 ± 4


Current smoker, n (%)

25 (20)



Hypertension, n (%)

47 (39)

106 (26)


Diabetes, n (%)

15 (12)

40 (10)


Current estrogen use, n (%)

12 (10)

55 (13)


Walk for exercise (yes/no), n (%)

41 (33)

172 (42)


Total hip, bone density (g/cm2), mean ± SD

0.71 ± 0.13

0.77 ± 0.13

< 0.001

All cause death, B-Pb (μg/dL) [μmol/L], mean ± SD

5.56 ± 3 [0.27 ± 0.14]

5.17 ± 2 [0.25 ± 0.1]


CVD death, B-Pb (μg/dL), [μmol/L], mean ± SD

5.81 ± 3 [0.28 ± 0.14 ]

5.19 ± 3 [0.25 ± 0.14]


CHD death, B-Pb (μg/dL), [μmol/L], mean ± SD

5.61 ± 2 [0.27 ± 0.1]

5.19 ± 2 [0.25 ± 0.1]


Stroke death, B-Pb (μg/dL), [μmol/L], mean ± SD

6.33 ± 3 [0.30 ± 0.14]

5.21 ± 2 [0.25 ± 0.1]


Cancer death, B-Pb (μg/dL), [μmol/L], mean ± SD

5.34 ± 2 [0.26 ± 0.1]

5.25 ± 2 [0.25 ± 0.1]


Other death, B-Pb (μg/dL), [μmol/L], mean ± SD

5.39 ± 4 [0.26 ± 0.19]

5.25 ± 2 [0.25 ± 0.1]


*B-Pb: blood lead concentration

Table 4

Multivariable model of all cause mortality by blood lead concentrations

Variable name

Hazard Ratio

95% confidence interval


Lead ≥ 8 μg/dL (≥ 0.384 μmol/L)


1.16, 2.73


Age increase per 5 years


1.36, 1.92

< 0.001



1.06, 2.30


Body mass index(kg/m2))


0.94, 1.02


Education (years)


0.92, 1.05


Alcohol (drinks/wk)


0.95, 1.04


Current smoker


1.18, 2.88




1.20, 2.49




0.83, 1.49


Current estrogen use


0.42, 1.38


Walk for exercise


0.48, 1.02


Total hip, bone density (g/cm2)


0.01, 0.19


Figure 1
Figure 1

Cumulative survival with blood lead concentrations < 8 μg/dL (< 0.384 μmol/L), and ≥ 8 μg/dL (≥ 0.384 μmol/L) in women in SOF. Cumulative survival associated with blood lead concentrations < 8 μg/dL (< 0.384 μmol/L), and ≥ 8 μg/dL (≥ 0.384 μmol/L), in women in SOF lead ancillary study (Log rank test P < 0.007)

Women with baseline blood lead concentration of ≥ 8 μg/dL (≥ 0.384 μmol/L) had a 73% increased risk of dying. (Age and clinic adjusted hazard ratio [HR], 1.73; 95% confidence interval [CI], 1.12–2.68) (p = 0.014) compared to women in blood lead < 8 μg/dL (0.38 μmol/L). With further adjustment for covariates women with ≥ 8 μg/dL (0.384 μmol/L) still had 59% higher risk of all cause mortality (HR = 1.59; 1.02–2.49) (p = 0.041), compared to women with < 8 μg/dL (0.38 μmol/L) of blood lead. Although the multivariate adjusted hazards ratio (95% CI) for CVD mortality for women who had ≥ 8 μg/dL (≥ 0.384 μmol/L) versus the < 8 μg/dL (< 0.38 μmol/L) blood lead concentrations was not significant; 1.78(95% CI, 0.92–3.45), p = 0.089, women in higher lead group experienced 3 fold higher risk of mortality due to coronary heart disease 3.08(95% CI, 1.23–7.70), p < 0.016. There was no association of blood lead and mortality from stroke, cancer and other causes (Table 5 and Figure 2).
Table 5

Hazards Ratio (HR) and 95% confidence interval of all cause mortality by blood lead concentrations

Cause of death


Blood lead concentration (μg/dL) [μmol/L]

P value


(< 8) [< 0.384 ]

(≥ 8) [≥ 0.384 ]


All cause death, n (Col %)


96 (21%)

27 (34%)


   Age, clinic adjusted



1.73 (1.12, 2.68)


   Multivariate adjusted a



1.59 (1.02, 2.49)


Cardiovascular disease b, n(%)



13 (16)


   Age, clinic adjusted



1.90 (1.00, 3.63)


Multivariate adjusted c



1.78 (0.92, 3.45)


Coronary heart disease d, n (%)


15 (4)

8 (11)


Age, clinic adjusted



3.54 (1.48, 8.45)


Multivariate adjusted e



3.08 (1.23, 7.70)


Stroke f, n(%)


17 (4)

4 (5)


Age, clinic adjusted



1.16 (0.34, 4.00)


Multivariate adjusted g



1.13 (0.34, 3.81)


Cancer h, n(%)


30 (7)

8 (10)


   Age, clinic adjusted



1.70 (0.77, 3.75)


   Multivariate adjusted i



1.64 (0.73, 3.71)


All other deaths j, n(%)


25 (7)

6 (10)


   Age, clinic adjusted



1.51 (0.61, 3.72)


   Multivariate adjusted k



1.22 (0.48, 3.10)


*Chi -square p-value only for percentage of deaths in two blood lead strata, the rest are hazards ratio p values.

a,c,e,g,i,k The multivariate model included the following: age, clinic, BMI, education, smoking, alcohol intake, estrogen use, hypertension, walking for exercise, diabetes, and total hip BMD.

b ICD9 Code: All deaths due to CVD, including all diseases of circulatory system except those involving veins and lymphatics: 425,429.2, 440–444,428,401–404,410–414,430–438, and 798.

d ICD9 Code: deaths due to coronary heart disease: 410–414.

f ICD9 Code: Deaths due to stroke: 430–438.

h ICD9 Code: Deaths due to cancer: 140–239.

j ICD9 Code: All other deaths: Non CVD and non cancer deaths

Figure 2
Figure 2

Adjusted hazards ratios and 95% confidence interval of mortality in SOF participants with blood lead concentrations ≥ 8 μg/dL (≥ 0.384 μmol/L). Adjusted hazard ratios and 95% confidence interval of all cause mortality and cause specific mortality in SOF lead ancillary study participants with blood lead concentrations ≥ 8 μg/dL (≥ 0.384 μmol/L), compared to referent < 8 μg/dL (< 0.384 μmol/L),


Blood lead was an important predictor of all cause mortality in this cohort of community dwelling older women. Mortality was significantly higher in women with blood lead concentrations ≥ 8 μg/dL as compared to those with lower blood lead concentrations. Our results are consistent with earlier studies based on occupational cohorts [3, 2426] and the general population: NHANES II and III [47]. To our knowledge, this is the first study to look at the association between blood lead concentrations and mortality in older women with median age of 71 years (range 65–87).

Despite declines in blood lead concentrations during the past 30 years, environmental lead exposure continues to be a public health concern [2]. The use of organic lead as gasoline additive, initiated during the 1920s, was phased out in the US since 1976. Once released as combustion exhaust, particulate lead persists in air, water, and soil. Mean blood lead concentrations in the U.S. population in the NHANES III Phase 2 collected during 1991 to 1994 ages 20 to 49 years were 2.1 μg/dL[1]. The mean blood lead concentration for ages > 1 year has declined further to 1.45 μg/dL(0.07 μmol/L) as reported from the most recent survey (NHANES IV, 2001–2002)[27].

The skeleton is repository for 95% of absorbed lead and can serve as an endogenous source for many years after exposure. Lead may be mobilized from skeleton during conditions of high bone turn over, such as pregnancy, lactation, menopause and aging [28]. A 25% adjusted increase in median blood lead concentration was reported for post menopausal women, compared to premenopausal women in NHANES II [29]. Furthermore in NHANES III, blood lead concentrations were highest in ages 70 years and older [3.4 μg/dL,(0.16 μmol/L) ] [27].

A multitargeted toxicant, lead effects cardiovascular, renal and nervous systems and may contribute to morbidity and mortality through its adverse impacts on these systems. The increased cardiovascular mortality risk may reflect an effect on sub-clinical risk factors for disease. The evidence for this association is supportive [27]. As part of NHANES III, an increased risk of peripheral arterial disease, hypertension and renal dysfunction was observed in populations with an average blood lead concentration of 2 μg/dL (0.10 μmol/L) [2, 14, 27, 30]. For example, the odds ratio of diastolic hypertension was 8.1 comparing women with a blood lead concentration of 4.0–31.1 μg/dL (0.19–1.5 μmol/L) to women with lower blood lead concentrations of 0.5–1.6 μg/dL(0.02–0.08 μmol/L). Other analyses support an association between blood lead and renal function impairment [14, 31, 32], and increased blood pressure [33, 34], a biologically plausible relationship [35].

Lead contributes to nephrotoxicity, even at blood concentration below 5 ug/dL (0.24 μmol/L) [32]. Increase in blood pressure and an association with renal damage have also been observed after lead exposure in rodent models [36, 37]. Alterations in signal transduction that involve renal pathways (eg, angiotensin and vasopressin) were reported in rat models [3840]. Other mechanisms by which lead may increase cardiovascular risk include effects on neuromuscular and neuro-humoral regulation of vascular function, alteration in sodium transport, and alterations in calcium regulation [7, 11, 27, 30, 4147].

Blood lead was associated with almost three fold risk in coronary heart disease (CHD) mortality (HR = 3.08) in our study. Our results are consistent with findings in which bone lead, a more accurate biomarker of chronic lead exposure than blood lead was associated with ischemic heart disease mortality [48]. A one standard deviation increase in patella and tibia lead concentrations was associated with greater risk for ischemic heart disease (Hazard Ratio for patella lead = 1.29; 95% CI, 1.02–1.62).

The pathogenesis of CHD is multifactorial; lead may be one of the mediators by two causal pathways; i.e., mediation through higher blood pressure [8] and by atherogenic process [49]. Lead-related atherosclerosis could be explained by several mechanisms, impairment of renal function [32], induction of oxidative stress [50] and endothelial dysfunction [50].

Previous studies have linked lead as low as 3.62 μg/dL (0.17 μmol/L)with an increased risk of stroke mortality [7, 8]. In our study, we found no significant association with stroke, although the mean lead concentration in participants who died due to stroke was 22% higher as compared to the rest of the cohort (6.33 ug/dL vs. 5.21 ug/dL, p < 0.028)(0.30 vs.0.25 μmol/L)perhaps reflecting the small number of stroke deaths in this cohort (Table 3).

Lead is a toxic metal and categorized as probably carcinogenic to humans (Group 2A IARC 2004) [51 Monograph]. Associations between occupational lead exposure and cancers of brain, stomach, kidney and lung have been reported [5254]. However among non occupational cohorts, there has been inconsistent evidence of an association between blood lead and cancer [5]. Individuals with mean blood lead concentrations 10–19 μg/dL (0.48–0.91 μmol/L) in the NHANES II cohort (1976–1980) did not have increased risk of cancer mortality, when compared to those with blood lead concentrations < 10 μg/dL (0.48 μmol/L).

Our results are consistent with this observation as the median value in the "≥ 8 μg/dL" lead group was 9 μg/dL (0.43 μmol/L). A higher risk of cancer deaths was only observed in with blood lead concentration > 20 μg/dL(0.96 μmol/L) [4]. Similarly, individuals with blood lead concentrations ≥ 3.62 μg/dL (0.17 μmol/L) in the NHANES III (1988–1994) did not have increased risk of cancer mortality when compared to those with < 1.94 μg/dL(0.09 μmol/L) [7]. In contrast, another analysis from the same population survey reported 44% increased risk of cancer death at blood lead concentrations ≥ 5 μg/dL (0.24 μmol/L) when compared to those with < 5 μg/dL [6].

Bone loss accelerates after menopause and bone demineralization may release bone lead into circulation [28]. Inverse association has been reported between mortality, (predominantly stroke deaths) and bone density [55]. In our study women with ≥ 8 μg/dL (≥ 0.384 μmol/L) blood lead had 8% lower total hip bone mineral density at baseline as compared to women with lower lead concentrations. We also observed that women who died had 7% higher blood lead concentration than survivors. In another analysis in older women, each SD increase in BMD loss at the hip was associated with a 1.3-fold increase in total mortality, adjusted for age, baseline BMD, diabetes, hypertension, incident fractures, smoking, physical activity, health status, weight loss, and calcium use. In particular, hip BMD loss was associated with increased mortality from coronary heart disease (relative hazard [RH] = 1.3 per SD; 95% CI, 1.0–1.8) [56].

Alternatively, osteoporosis and atherosclerosis may result from elevated concentrations of homocysteine, an amino acid whose normal metabolism depends on folate and vitamin B12 as cofactors. Lead and homocysteine both are associated with cardiovascular disease and cognitive dysfunction[57]. In subjects 50–70 years of age, blood lead and homocysteine concentrations were correlated (Pearson's r = 0.27, p < 0.01), homocysteine concentration increased 0.35 μmol/L per 1.0 μg/dL (0.05 μmol/L) increase in blood lead (p < 0.01). Homocysteine is an example of plausible mechanism that may mediate the affect of lead on the cardiovascular [58] and central nervous systems [59]. Taken together, more research is clearly needed to further our understanding of the mechanism of lead toxicity and these multisystem outcomes.

Compared to the rest of SOF participants, the lead study cohort was of comparatively younger age, and had lower proportion with hypertension [60]. The proportion of women with type 2 diabetes was higher in the lead cohort, we adjusted for diabetes in secondary analysis and the association of lead, and mortality remained significant. The number ofwomen who are older and atrisk is growing. Cardiovascular disease is the leading cause of mortality worldwide [61] and in the United States [8]. It kills nearlyhalf a million women in the United States every year, more than the nextfivecauses of death combined and nearly twice as many as all forms of cancer, including breast cancer [62]. Environmental toxicants such as lead may explain part of the burden of CVD.

There are several strengths to our study: our follow up was more than 95% complete and we adjudicated all mortality events. We followed women for more than12 years after the blood lead measures were obtained. We controlled for a number of covariates and cardiovascular risk factors. However, this study has several limitations; participation was limited to older Caucasian women, and the findings may not apply to men or nonwhite women. We did not determine co-contaminants such as cadmium that might be associated with cardiovascular disease through its known effects on kidney function [63, 64]. There are factors that differ by lead concentrations and we could not measure may have confounded our results. For example we had no measure of renal function, homocysteine or lipid concentrations and thus we could not examine whether these measures influenced the association between lead and mortality. We relied on death certificates and discharge summaries were only available for 33% of participants which may result in some misclassification of cause of death [65]. Use of death certificates may be problematic for assigning a single cause of death, especially among the oldest women who often have multiple medical problems.


Our study extends the findings of higher mortality associated with blood lead concentrations from NHANES III surveys to community dwelling older women. An increased mortality risk, especially coronary heart disease was found at blood lead concentrations ≥ 8 μg/dL (0.384 μmol/L). Our results add to the existing evidence of adverse affects of lead on health as seen in an older cohort who experienced greater historic environmental lead exposure.



Bone mineral density


Coronary Heart Disease


Cardiovascular Disease


Dual energy X-ray absorptiometry


Hazard Ratio


International Classification of Diseases, Ninth, revision, Clinical Modification


microgram per deciliter


National Health and Nutritional Examination Survey


Study of Osteoporotic Fractures


vitamin D receptor gene.



NK thanks Lily Lui for her assistance with the statistical analysis of the data. The Study of Osteoporotic Fractures (SOF) is supported by the National Institutes of Health funding. The following institutes provide support: The National Institute of Arthritis and Musculoskeletal and Skin Diseases and the National Institute on Aging under the following grant numbers: AG05407, AR35582, AG05394, AR35584, AR35583, R01 AG005407, R01 AG027576-22, 2 R01 AG005394-22A1, and 2 R01 AG027574-22A1.

Authors’ Affiliations

Department of Epidemiology, University of Pittsburgh, Pittsburgh, PA, USA
Department of Biostatistics, University of Pittsburgh, Pittsburgh, PA, USA
Department of Psychiatry, University of Pittsburgh, Pittsburgh, PA, USA
Departments of Medicine, Epidemiology, and Preventive Medicine, University of Maryland, Baltimore, MD, USA
Center for Health Research Northwest/Hawaii, Kaiser Permanente, Portland, OR, USA
School of Public Health and Information Sciences, University of Louisville, Louisville, KY, USA
California Pacific Medical Center Research Institute, San Francisco Coordinating Center, San Francisco, CA, USA


  1. Pirkle JL, Kaufmann RB, Brody DJ, Hickman T, Gunter EW, Paschal DC: Exposure of the U.S. population to lead, 1991–1994. Environ Health Perspect. 1998, 106: 745-750. 10.2307/3434264.View ArticleGoogle Scholar
  2. Muntner P, Menke A, DeSalvo KB, Rabito FA, Batuman V: Continued decline in blood lead levels among adults in the United States: the National Health and Nutrition Examination Surveys. Arch Intern Med. 2005, 165: 2155-2161. 10.1001/archinte.165.18.2155.View ArticleGoogle Scholar
  3. Gerhardsson L, Lundstrom NG, Nordberg G, Wall S: Mortality and lead exposure: a retrospective cohort study of Swedish smelter workers. Br J Ind Med. 1986, 43: 707-712.Google Scholar
  4. Lustberg M, Silbergeld E: Blood lead levels and mortality. Arch Intern Med. 2002, 162: 2443-2449. 10.1001/archinte.162.21.2443.View ArticleGoogle Scholar
  5. Jemal A, Graubard BI, Devesa SS, Flegal KM: The association of blood lead level and cancer mortality among whites in the United States. Environ Health Perspect. 2002, 110: 325-329.View ArticleGoogle Scholar
  6. Schober SE, Mirel LB, Graubard BI, Brody DJ, Flegal KM: Blood lead levels and death from all causes, cardiovascular disease, and cancer: results from the NHANES III mortality study. Environ Health Perspect. 2006, 114: 1538-1541.Google Scholar
  7. Menke A, Muntner P, Batuman V, Silbergeld EK, Guallar E: Blood lead below 0.48 micromol/L (10 microg/dL) and mortality among US adults. Circulation. 2006, 114: 1388-1394. 10.1161/CIRCULATIONAHA.106.628321.View ArticleGoogle Scholar
  8. Navas-Acien A, Guallar E, Silbergeld EK, Rothenberg SJ: Lead exposure and cardiovascular disease – a systematic review. Environ Health Perspect. 2007, 115: 472-482.View ArticleGoogle Scholar
  9. Schwartz J: Lead, blood pressure, and cardiovascular disease in men and women. Environ Health Perspect. 1991, 91: 71-75. 10.2307/3430985.View ArticleGoogle Scholar
  10. Cheng Y, Schwartz J, Vokonas PS, Weiss ST, Aro A, Hu H: Electrocardiographic conduction disturbances in association with low-level lead exposure (the Normative Aging Study). Am J Cardiol. 1998, 82: 594-599. 10.1016/S0002-9149(98)00402-0.View ArticleGoogle Scholar
  11. Nordberg M, Winblad B, Fratiglioni L, Basun H: Lead concentrations in elderly urban people related to blood pressure and mental performance: results from a population-based study. Am J Ind Med. 2000, 38: 290-294. 10.1002/1097-0274(200009)38:3<290::AID-AJIM7>3.0.CO;2-T.View ArticleGoogle Scholar
  12. Weisskopf MG, Proctor SP, Wright RO, Schwartz J, Spiro A, Sparrow D, Nie H, Hu H: Cumulative lead exposure and cognitive performance among elderly men. Epidemiology. 2007, 18: 59-66. 10.1097/01.ede.0000248237.35363.29.View ArticleGoogle Scholar
  13. Weisskopf MG, Wright RO, Schwartz J, Spiro A, Sparrow D, Aro A, Hu H: Cumulative lead exposure and prospective change in cognition among elderly men: the VA Normative Aging Study. Am J Epidemiol. 2004, 160: 1184-1193. 10.1093/aje/kwh179.View ArticleGoogle Scholar
  14. Muntner P, He J, Vupputuri S, Coresh J, Batuman V: Blood lead and chronic kidney disease in the general United States population: results from NHANES III. Kidney Int. 2003, 63: 1044-1050. 10.1046/j.1523-1755.2003.00812.x.View ArticleGoogle Scholar
  15. Kim R, Rotnitsky A, Sparrow D, Weiss S, Wager C, Hu H: A longitudinal study of low-level lead exposure and impairment of renal function. The Normative Aging Study. Jama. 1996, 275: 1177-1181. 10.1001/jama.275.15.1177.View ArticleGoogle Scholar
  16. McMichael AJ, Johnson HM: Long-term mortality profile of heavily-exposed lead smelter workers. J Occup Med. 1982, 24: 375-378. 10.1097/00043764-198205000-00008.View ArticleGoogle Scholar
  17. Muldoon SB, Cauley JA, Kuller LH, Morrow L, Needleman HL, Scott J, Hooper FJ: Effects of blood lead levels on cognitive function of older women. Neuroepidemiology. 1996, 15: 62-72. 10.1159/000109891.View ArticleGoogle Scholar
  18. Muldoon SB, Cauley JA, Kuller LH, Scott J, Rohay J: Lifestyle and sociodemographic factors as determinants of blood lead levels in elderly women. Am J Epidemiol. 1994, 139: 599-608.Google Scholar
  19. Khalil N, Cauley JA, Wilson JW, Talbott EO, Morrow L, Hochberg MC, Hillier TA, Muldoon SB, Cummings SR: Relationship of blood lead levels to incident nonspine fractures and falls in older women: the study of osteoporotic fractures. J Bone Miner Res. 2008, 23: 1417-1425. 10.1359/jbmr.080404.View ArticleGoogle Scholar
  20. Cauley JA, Seeley DG, Browner WS, Ensrud K, Kuller LH, Lipschutz RC, Hulley SB: Estrogen replacement therapy and mortality among older women. The study of osteoporotic fractures. Arch Intern Med. 1997, 157: 2181-2187. 10.1001/archinte.157.19.2181.View ArticleGoogle Scholar
  21. Cauley JA, Thompson DE, Ensrud KC, Scott JC, Black D: Risk of mortality following clinical fractures. Osteoporos Int. 2000, 11: 556-561. 10.1007/s001980070075.View ArticleGoogle Scholar
  22. Kado DM, Duong T, Stone KL, Ensrud KE, Nevitt MC, Greendale GA, Cummings SR: Incident vertebral fractures and mortality in older women: a prospective study. Osteoporos Int. 2003, 14: 589-594. 10.1007/s00198-003-1412-5.View ArticleGoogle Scholar
  23. Kado DM, Lui LY, Cummings SR: Rapid resting heart rate: a simple and powerful predictor of osteoporotic fractures and mortality in older women. J Am Geriatr Soc. 2002, 50: 455-460. 10.1046/j.1532-5415.2002.50110.x.View ArticleGoogle Scholar
  24. Cooper WC, Wong O, Kheifets L: Mortality among employees of lead battery plants and lead-producing plants, 1947–1980. Scand J Work Environ Health. 1985, 11: 331-345.View ArticleGoogle Scholar
  25. Cocco P, Hua F, Boffetta P, Carta P, Flore C, Flore V, Onnis A, Picchiri GF, Colin D: Mortality of Italian lead smelter workers. Scand J Work Environ Health. 1997, 23: 15-23.View ArticleGoogle Scholar
  26. Selevan SG, Landrigan PJ, Stern FB, Jones JH: Mortality of lead smelter workers. Am J Epidemiol. 1985, 122: 673-683.Google Scholar
  27. EPA: Air Quality Criteria for Lead (2006) Final Report. U.S. Environmental Protection Agency, Washington, DC, EPA/600/R-05/144aF-bF. 2006, [accessed February 26 2009]., []Google Scholar
  28. Silbergeld EK, Schwartz J, Mahaffey K: Lead and osteoporosis: mobilization of lead from bone in postmenopausal women. Environ Res. 1988, 47: 79-94. 10.1016/S0013-9351(88)80023-9.View ArticleGoogle Scholar
  29. Nash D, Magder LS, Sherwin R, Rubin RJ, Silbergeld EK: Bone density-related predictors of blood lead level among peri- and postmenopausal women in the United States: The Third National Health and Nutrition Examination Survey, 1988–1994. Am J Epidemiol. 2004, 160: 901-911. 10.1093/aje/kwh296.View ArticleGoogle Scholar
  30. Navas-Acien A, Selvin E, Sharrett AR, Calderon-Aranda E, Silbergeld E, Guallar E: Lead, cadmium, smoking, and increased risk of peripheral arterial disease. Circulation. 2004, 109: 3196-3201. 10.1161/01.CIR.0000130848.18636.B2.View ArticleGoogle Scholar
  31. Lin JL, Lin-Tan DT, Yen TH, Hsu CW, Jenq CC, Chen KH, Hsu KH, Huang YL: Blood lead levels, malnutrition, inflammation, and mortality in patients with diabetes treated by long-term hemodialysis. Am J Kidney Dis. 2008, 51: 107-115. 10.1053/j.ajkd.2007.10.002.View ArticleGoogle Scholar
  32. Ekong EB, Jaar BG, Weaver VM: Lead-related nephrotoxicity: a review of the epidemiologic evidence. Kidney Int. 2006, 70: 2074-2084.View ArticleGoogle Scholar
  33. Nawrot TS, Staessen JA: Low-Level Environmental Exposure to Lead Unmasked as Silent Killer. Circulation. 2006, 114: 1347-1349. 10.1161/CIRCULATIONAHA.106.650440.View ArticleGoogle Scholar
  34. Nawrot TS, Thijs L, Den Hond EM, Roels HA, Staessen JA: An epidemiological re-appraisal of the association between blood pressure and blood lead: a meta-analysis. J Hum Hypertens. 2002, 16: 123-131. 10.1038/sj.jhh.1001300.View ArticleGoogle Scholar
  35. Nowack R, Wiecek A, Exner B, Gretz N, Ritz E: Chronic lead exposure in rats: effects on blood pressure. Eur J Clin Invest. 1993, 23: 433-443. 10.1111/j.1365-2362.1993.tb00787.x.View ArticleGoogle Scholar
  36. Boscolo P, Carmignani M: Neurohumoral blood pressure regulation in lead exposure. Environ Health Perspect. 1988, 78: 101-106. 10.2307/3430508.View ArticleGoogle Scholar
  37. Perry HM, Erlanger MW, Perry EF: Increase in the blood pressure of rats chronically fed low levels of lead. Environ Health Perspect. 1988, 78: 107-111. 10.2307/3430509.View ArticleGoogle Scholar
  38. Staessen JA, Lauwerys RR, Bulpitt CJ, Fagard R, Lijnen P, Roels H, Thijs L, Amery A: Is a positive association between lead exposure and blood pressure supported by animal experiments?. Curr Opin Nephrol Hypertens. 1994, 3: 257-263. 10.1097/00041552-199405000-00005.View ArticleGoogle Scholar
  39. Victery W: Evidence for effects of chronic lead exposure on blood pressure in experimental animals: an overview. Environ Health Perspect. 1988, 78: 71-76. 10.2307/3430504.View ArticleGoogle Scholar
  40. Victery W, Tyroler HA, Volpe R, Grant LD: Summary of discussion sessions: symposium on lead-blood pressure relationships. Environ Health Perspect. 1988, 78: 139-155. 10.2307/3430515.View ArticleGoogle Scholar
  41. Cheng Y, Schwartz J, Sparrow D, Aro A, Weiss ST, Hu H: Bone lead and blood lead levels in relation to baseline blood pressure and the prospective development of hypertension: the Normative Aging Study. Am J Epidemiol. 2001, 153: 164-171. 10.1093/aje/153.2.164.View ArticleGoogle Scholar
  42. Proctor SP, Rotnitzky A, Sparrow D, Weiss ST, Hu H: The relationship of blood lead and dietary calcium to blood pressure in the normative aging study. Int J Epidemiol. 1996, 25: 528-536. 10.1093/ije/25.3.528.View ArticleGoogle Scholar
  43. Hu H, Aro A, Payton M, Korrick S, Sparrow D, Weiss ST, Rotnitzky A: The relationship of bone and blood lead to hypertension. The Normative Aging Study. Jama. 1996, 275: 1171-1176. 10.1001/jama.275.15.1171.View ArticleGoogle Scholar
  44. Nash D, Magder L, Lustberg M, Sherwin RW, Rubin RJ, Kaufmann RB, Silbergeld EK: Blood lead, blood pressure, and hypertension in perimenopausal and postmenopausal women. Jama. 2003, 289: 1523-1532. 10.1001/jama.289.12.1523.View ArticleGoogle Scholar
  45. Pocock SJ, Shaper AG, Ashby D, Delves HT, Clayton BE: The relationship between blood lead, blood pressure, stroke, and heart attacks in middle-aged British men. Environ Health Perspect. 1988, 78: 23-30. 10.2307/3430494.View ArticleGoogle Scholar
  46. Vupputuri S, He J, Muntner P, Bazzano LA, Whelton PK, Batuman V: Blood lead level is associated with elevated blood pressure in blacks. Hypertension. 2003, 41: 463-468. 10.1161/01.HYP.0000055015.39788.29.View ArticleGoogle Scholar
  47. Park SK, Schwartz J, Weisskopf M, Sparrow D, Vokonas PS, Wright RO, Coull B, Nie H, Hu H: Low-level lead exposure, metabolic syndrome, and heart rate variability: the VA Normative Aging Study. Environ Health Perspect. 2006, 114: 1718-1724.Google Scholar
  48. Jain NB, Potula V, Schwartz J, Vokonas PS, Sparrow D, Wright RO, Nie H, Hu H: Lead levels and ischemic heart disease in a prospective study of middle-aged and elderly men: the VA Normative Aging Study. Environ Health Perspect. 2007, 115: 871-875.View ArticleGoogle Scholar
  49. Wojtczak-Jaroszowa J, Kubow S: Carbon monoxide, carbon disulfide, lead and cadmium – four examples of occupational toxic agents linked to cardiovascular disease. Med Hypotheses. 1989, 30: 141-150. 10.1016/0306-9877(89)90101-1.View ArticleGoogle Scholar
  50. Vaziri ND, Ding Y, Ni Z: Compensatory up-regulation of nitric-oxide synthase isoforms in lead-induced hypertension; reversal by a superoxide dismutase-mimetic drug. J Pharmacol Exp Ther. 2001, 298: 679-685.Google Scholar
  51. IARC: Inorganic and Organic Lead Compounds. IARC. 2006, 87:Google Scholar
  52. Gerhardsson L, Hagmar L, Rylander L, Skerfving S: Mortality and cancer incidence among secondary lead smelter workers. Occup Environ Med. 1995, 52: 667-672. 10.1136/oem.52.10.667.View ArticleGoogle Scholar
  53. van Wijngaarden E, Dosemeci M: Brain cancer mortality and potential occupational exposure to lead: findings from the National Longitudinal Mortality Study, 1979–1989. Int J Cancer. 2006, 119: 1136-1144. 10.1002/ijc.21947.View ArticleGoogle Scholar
  54. Cooper WC: Cancer mortality patterns in the lead industry. Ann N Y Acad Sci. 1976, 271: 250-259. 10.1111/j.1749-6632.1976.tb23119.x.View ArticleGoogle Scholar
  55. Browner WS, Seeley DG, Vogt TM, Cummings SR: Non-trauma mortality in elderly women with low bone mineral density. Study of Osteoporotic Fractures Research Group. Lancet. 1991, 338: 355-358. 10.1016/0140-6736(91)90489-C.View ArticleGoogle Scholar
  56. Kado DM, Browner WS, Blackwell T, Gore R, Cummings SR: Rate of bone loss is associated with mortality in older women: a prospective study. J Bone Miner Res. 2000, 15: 1974-1980. 10.1359/jbmr.2000.15.10.1974.View ArticleGoogle Scholar
  57. Schafer JH, Glass TA, Bressler J, Todd AC, Schwartz BS: Blood lead is a predictor of homocysteine levels in a population-based study of older adults. Environ Health Perspect. 2005, 113: 31-35.View ArticleGoogle Scholar
  58. Wald DS, Law M, Morris JK: Homocysteine and cardiovascular disease: evidence on causality from a meta-analysis. Bmj. 2002, 325: 1202-10.1136/bmj.325.7374.1202.View ArticleGoogle Scholar
  59. Dufouil C, Alperovitch A, Ducros V, Tzourio C: Homocysteine, white matter hyperintensities, and cognition in healthy elderly people. Ann Neurol. 2003, 53: 214-221. 10.1002/ana.10440.View ArticleGoogle Scholar
  60. Sands ML, Schwartz AV, Brown BW, Nevitt MC, Seeley DG, Kelsey JL: Relationship of neurological function and age in older women. The study of osteoporotic fractures. Neuroepidemiology. 1998, 17: 318-329. 10.1159/000026186.View ArticleGoogle Scholar
  61. Lopez AD, Mathers CD, Ezzati M, Jamison DT, Murray CJ: Global and regional burden of disease and risk factors, 2001: systematic analysis of population health data. Lancet. 2006, 367: 1747-1757. 10.1016/S0140-6736(06)68770-9.View ArticleGoogle Scholar
  62. A.H.A: Facts about women and cardiovascular diseases American Heart Association. 2007, []Google Scholar
  63. Garcon G, Leleu B, Marez T, Zerimech F, Haguenoer JM, Furon D, Shirali P: Biomonitoring of the adverse effects induced by the chronic exposure to lead and cadmium on kidney function: usefulness of alpha-glutathione S-transferase. Sci Total Environ. 2007, 377: 165-172. 10.1016/j.scitotenv.2007.02.002.View ArticleGoogle Scholar
  64. Baecklund M, Pedersen NL, Bjorkman L, Vahter M: Variation in blood concentrations of cadmium and lead in the elderly. Environ Res. 1999, 80: 222-230. 10.1006/enrs.1998.3895.View ArticleGoogle Scholar
  65. Lloyd-Jones DM, Martin DO, Larson MG, Levy D: Accuracy of death certificates for coding coronary heart disease as the cause of death. Ann Intern Med. 1998, 129: 1020-1026.View ArticleGoogle Scholar


© Khalil et al; licensee BioMed Central Ltd. 2009

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.


By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate. Please note that comments may be removed without notice if they are flagged by another user or do not comply with our community guidelines.