Skip to main content
Download PDF
Download ePub

Analysis of the effects of exposure to polychlorinated biphenyls and chlorinated pesticides on serum lipid levels in residents of Anniston, Alabama

Environmental Health volume 12, Article number: 108 (2013) Cite this article

Abstract

Background

Anniston, Alabama, is the site of a former Monsanto plant where polychlorinated biphenyls (PCBs) were manufactured from 1929 until 1971. Residents of Anniston are known to have elevated levels of PCBs. The objective of the study was to test the hypothesis that levels of the various lipid components (total cholesterol, LDL cholesterol, HDL cholesterol, triglycerides) are differentially associated with concentrations of total PCBs and total pesticides, and further that different congeners, congener groups and different pesticides do not have identical associations in serum samples obtained from Anniston residents in a cross-sectional study.

Methods

Fasting serum samples were obtained from 575 residents of Anniston who were not on any lipid-lowering medication and were analyzed for 35 PCB congeners, nine chlorinated pesticides, total cholesterol, LDL and HDL cholesterol and triglyceride concentrations. Associations between toxicant concentrations and lipid levels were determined using multiple linear regression analysis.

Results

We observed that elevated serum concentrations of lipids were associated with elevated serum concentrations of ΣPCBs and summed pesticides in analyses adjusted for age, race, gender, BMI, alcohol consumption, smoking and exercising status. The strongest associations were seen for PCB congeners with three, four, or at least eight substituted chlorines. Mono-ortho substituted congeners 74 and 156, di-ortho congeners 172 and 194, and tri- and tetra-ortho congeners 199, 196–203, 206 and 209 each were significantly associated with total lipids, total cholesterol and triglycerides. Serum concentrations of HCB and chlordane also had strong associations with lipid components.

Conclusions

Increased concentrations of PCBs and organochlorine pesticides are associated with elevations in total serum lipids, total cholesterol and triglycerides, but the patterns are different for different groups of PCBs and different pesticides. These observations show selective effects of different organochlorines on serum concentrations of different groups of lipids. This elevation in concentrations of serum lipids may be the basis for the increased incidence of cardiovascular disease found in persons with elevated exposures to PCBs and chlorinated pesticides.

Peer Review reports

Background

There has been suggestive evidence for many years that elevations in levels of some persistent organic pollutants (POPs) are associated with elevated levels of serum lipids. Since elevated serum lipids are a major risk factor for cardiovascular disease [1], this association, if causal, may have significant effects on human health. In 1978 two laboratories reported that feeding rats PCBs and/or DDT resulted in elevation of serum cholesterol [2, 3]. Oda et al. [4] reported that feeding rats PCBs resulted in hypercholesterolemia, and suggested that PCB exposure resulted in a stimulation of de novo synthesis of liver lipids. Azaïs-Braesco et al. [5] studied the effects of two different PCB congeners and found that the changes in lipid profiles varied with congener structure. Monkeys fed Aroclor 1254 developed elevated triglycerides, but decreased total cholesterol, HDL and LDL cholesterol [6]. Sanyal et al. [7] reported elevations in lipid synthesis by the liver in DDT-treated monkeys.

In human populations exposed to PCBs, several authors have reported elevations in triglycerides [8, 9] and total cholesterol [10–12]. Other studies of occupationally exposed persons noted elevations in rates of cardiovascular deaths [13]. In a Native American population higher PCB levels were associated with elevations of both triglycerides and total cholesterol. The elevated PCB levels were also associated with an elevation in self-reported cardiovascular disease which appeared to be secondary to the elevation in serum lipids [14], although that study was limited by the population size and the self-reported nature of the diagnosis. However, General Electric scientists, while reporting an association between levels of serum PCBs and serum lipids, have argued that the PCB elevation is a consequence, not a cause, of the hyperlipidemia [15, 16].

Anniston, Alabama, is the home of one of two facilities in the US operated by Monsanto Chemical Company to produce PCBs; PCBs were made in Anniston from 1929 until 1971. In 2003 ATSDR funded a study of the health of Anniston residents through a consortium of universities. The serum PCB levels in 758 Anniston residents, ages 19–93 years, ranged from 0.1 to 170.4 ng/g (ppb), with a median of 3.2 ng/g [17]. These concentrations can be compared to the statement by ATSDR [18] that the average PCB concentration in persons in the United States that are not unusually exposed is between 0.9 and 1.5 ng/g.

The objective of the current study was to assess the relationship between the serum levels of total PCBs, different groups of congeners and single congeners as well as total chlorinated pesticides and pesticide groups with total serum lipids, serum triglycerides, total cholesterol, LDL and HDL cholesterol among residents of Anniston who were not on lipid-lowering medication.

Methods

Information about the study population, sampling methods, data collection techniques and laboratory analyses have been described in detail elsewhere [17, 19], and therefore are presented only briefly here.

The study was reviewed and approved by the Institutional Review Board (IRB) of the University of Alabama at Birmingham (protocol number X050610004) with concurrence from the University at Albany IRB. Written informed consent was obtained from all participants for use of all questionnaire and analytical data for analysis and publication.

Study site and population

Stratified randomized sampling, based on residential proximity to the plant, was used to choose households where an adult household member was invited to enroll in the study. A total of 1,110 persons ages 18 years and older were enrolled. Interviews were conducted by trained interviewers. The objective of the interview was to obtain information about the study participant’s age, gender, race/ethnicity, medications, and health related behaviors such as exercise, smoking and alcohol consumption, each treated as a yes or no. Alcohol consumption was defined as the subject having had at least one drink in the past 30 days. Exercise was evaluated as 10 minutes or more of vigorous exercise each day, while smoking was defined as having consumed 100 or more cigarettes over the lifetime. Information on current smoking was also available but didn’t provide qualitatively different results when included in the models.

Fasting blood samples were obtained from 774 persons for analysis of serum PCBs and pesticides, serum lipids and fasting glucose. Twelve study participants were excluded from the analysis for different reasons: PCB results failed quality control/assurance procedures for eight subjects, there was no medication information for one subject, no race/ethnicity information for one subject and height and weight parameters were not available for 2 participants. Because we are evaluating the relationships between exposure to POPs and serum lipids in this report, analysis will be limited to study of the 575 participants who were not taking any kind of lipid-lowering medication. While other medications can also alter lipid levels we did not adjust for any except to exclude individuals specifically on lipid-lowering medication.

Laboratory analyses

Serum levels of 35 PCB congeners with ortho-substituted chlorines (28, 44, 49, 52, 66, 74, 87, 99, 101, 105, 110, 118, 128, 146, 149, 151, 153, 156, 157, 138–158, 167, 170, 172, 177, 178, 180, 183, 187, 189, 194, 195, 199, 196–203, 206, 209) and 9 organochlorine pesticides [hexachlorobenzene (HCB), β-hexachlorocyclohexane (β-HCCH), γ-HCCH, oxychlordane, transnonachlor, dichlorodiphenyltrichloroethanes (p,p’-DDE, p,p’-DDT, o,p’-DDT) and mirex] were measured by high resolution gas chromatography/isotope-dilution high resolution mass spectrometry at the Centers for Disease Control and Prevention’s National Center for Environmental Health laboratory [20]. At CDC, analyses were conducted as technical assistance and in compliance with Research Determination procedure; an exemption from the CDC IRB was obtained.

Serum levels of different lipid fractions (triglycerides, total cholesterol, LDL cholesterol and HDL cholesterol) were measured at the Clinical Chemistry Laboratory of the Jacksonville, Alabama Medical Center. Total serum lipid levels were calculated using the formula proposed by Phillips et al. [21] and confirmed by Bernert et al. [22].

Total Lipids = 2.27 Total Cholesterol + Triglycerides + 0.623

Statistical analysis

All statistical analyses were conducted using SAS System 9.1.3 package (SAS Institute, Inc., Cary, NC). Descriptive statistics were calculated for outcome variables, demographic characteristics, and exposure variables. Student’s t-test was used in order to assess differences of age, serum concentrations of various lipid fractions and POPs. Normality of covariates was assessed graphically and by the Kolmogorov-Smirnov test. Lipid concentrations were somewhat skewed and POPs concentrations were highly skewed. Therefore both were natural log transformed for the regression analysis.

Since PCB congeners and organochlorine pesticides have different molecular structures, they may have different toxicities and health effects [23]. Various groupings based on structure-activity properties/mechanism of action were proposed as recently reviewed by Warner et al. [24]. In human serum samples, all proposed PCB congeners groupings suffer from the common problem of including several PCB congeners that are highly correlated with the sum of PCBs in human sera (r > 0.90; e.g. dioxin-like, potentially anti-estrogenic, immunotoxic congeners, including PCBs 74, 105, 118, 138, 156, 157, 167, and 170), thus providing little or no discrimination when used in statistical analyses. Hence, we evaluated associations between the outcome variables and groups of PCB congeners only as outlined above, i.e. by number of chlorines and number of ortho substituted chlorines) and pesticides, as well as single PCB congeners. For the pesticides we considered total DDTs (the sum of p,p’-DDE, p,p-DDT and o,p’DDT), the sum of the chlordanes (oxychlordane and trans-nonachlor) and the sum of the hexachlorocyclohexanes (β-HCCH and γ-HCCH), as well as HCB and mirex. PCB congeners were grouped first by number of ortho-substituted chlorines and secondly by the number of total chlorines.

Several PCB congeners (52, 49, 44, 101, 110, 151, 149, and 128) and γ-HCCH were excluded from analyses because of high prevalence (more than 60%) of values below the detection limit. For the remaining PCB congeners and pesticides, values below detection limits were replaced by the detection level divided by the square root of 2.

Multiple linear regression modeling was used to evaluate relationships between five outcome variables (serum concentrations of total lipids, total cholesterol, HDL cholesterol, LDL cholesterol, and triglycerides) and exposure variables (serum levels of total and various groups of PCBs and pesticides). Each regression model was adjusted for confounders defined by selected demographic characteristics of the study population. Because of severe multicollinearity among the various groups of POPs, two models were tested. In Model 1 results were adjusted only for age, age quadratic (age2), body mass index (BMI, analyzed as a continuous variable), race, gender, alcohol consumption, smoking and exercise. Adjustments have been made in previous studies for these biologically important variables often associated with serum lipids and POPs [15, 16, 25–28]. In Model 2, additional adjustments were made for all other POPs except the specific one under investigation. Regression coefficients in Model 1 are free of the excessive multicollinearity that exists among individual congeners of PCBs, groups of congeners of PCBs, and individual pesticides. Attempts to evaluate the unique contribution of an individual congener, or a group of congeners, in Model 2 often fail because of excessive collinearity among predictors and lead to the appearance of statistical artifacts (e.g., a change in sign of coefficient from the original correlation) (See Discussion and Additional file 1). Where Model 1 coefficients differ markedly from Model 2 coefficients, the difference is largely due to multicollinearity [29] and indicates that use of Model 2 is not appropriate. However Model 2, when results do not differ markedly from those obtained in Model 1, allows the possibility of identification of which of the POPs under study is primarily responsible for the association, and is theoretically superior.

Predictive models were validated by assessing R-square statistics and by testing the models in sub-samples of the study population. For main outcomes, results were considered significant at p < 0.05. When each outcome variable was regressed with 27 PCB congeners separately [or in PCB congener groups based on number of chlorines], results were considered significant at p < 0.0019 (0.05/27) [30].

Spearman’s correlation coefficients were calculated for groups of PCBs by total number of chlorines on the molecule, the number of ortho-substituted chlorines on the molecule, by pesticides groups as well as for individual PCB congeners.

Results

Table 1 shows demographic characteristics of the study population. All essential data were available for 575 study participants, none of whom were on any lipid-lowering medication that might obscure the results, although smoking and physical activity data were missing for a few subjects. The mean age was 52.2 and the median was 52. More than seventy percent were within the age range of 37–74 years. Those under 36 and older than 75 were 18.43% and 9.04% respectively, and graphically variable age was considered as normally distributed. Seventy percent of subjects were female. There were approximately equal numbers of Caucasians and African Americans. Nearly 70% of subjects did not drink alcohol (defined as at least one drink in the past 30 days), while nearly half smoked (defined as having smoked more than 100 cigarettes over the lifetime) and had regular exercise (defined as having daily moderate physical activity of at least 10 min duration).

Table 1 Demographic characteristics of study participants (n = 575)
Full size table

Table 2 shows information on BMI and analytical values for lipids and contaminants for the study population. The mean BMI of 30.88 kg/m2, with standard deviation of 8.03, indicates a high rate of obesity. Mean serum concentrations of total cholesterol, LDL cholesterol, HDL cholesterol and triglycerides were within “normal” ranges (triglycerides <200 mg/dL; total cholesterol, 120–200 mg/dL; HDL cholesterol, 35–86 mg/dL; LDL cholesterol, 80–130 mg/dL) [31], although values both lower and higher were found in some individuals. The range of exposures was wide, with serum PCB concentrations ranging from 0.1 to 170.4 ppb. Total pesticide concentrations ranged from 0.15 to 39.07 ppb wet weight. When PCB congeners were grouped by numbers of ortho chlorines or total chlorines, the highest concentration was observed for di-ortho PCBs (mean concentration, 3.95 ppb) and for hexachloro PCBs (mean concentration, 2.59 ppb). Regarding organochlorine pesticides, DDT and its derivatives composed almost 85% of mean total concentrations of pesticides. The other pesticides were in much lower concentrations.

Table 2 Lipid components, body mass index (BMI), and serum concentrations of total PCBs and chlorinated pesticides (n = 575)
Full size table

Table 3 presents results of multiple linear regression models of association between five outcome variables and serum total concentrations of both PCBs and pesticides. Separate regression analyses were fitted for each outcome variable. Results of analyses for total PCBs and total pesticides were considered significant at p < 0.05. Each outcome variable was regressed on PCBs and pesticides with additional adjustment for the confounders (age, gender, race, BMI, alcohol consumption, smoking and exercise) (Model 1). Race and age were significant covariates in both Models 1 and 2, but gender, alcohol consumption, smoking and exercise were not. Both total PCBs and total pesticides were significantly and positively associated with elevations in total lipids, total cholesterol and triglycerides, but not with HDL or LDL cholesterol. In order to evaluate the unique effect of PCBs we therefore adjusted for total pesticides as well as the other confounders, and adjusted results for total pesticides for total PCBs as well as other confounders (Model 2). Total PCBs were significantly and positively associated with total lipids, while total pesticides were significantly and positively associated with levels of total lipids, total cholesterol and triglycerides. There was no significant association between HDL or LDL cholesterol with either total PCBs or total pesticides. The relationship between serum total POPs (the sum of total PCBs plus total pesticides) with each of five outcome variables is presented in Additional file 2. When total PCB concentration was adjusted for total pesticides (Model 2), the significant relationship with total cholesterol and triglycerides disappeared. In contrast, when total pesticides was adjusted for total PCBs, the significant associations with total lipids, total cholesterol and triglycerides, but not LDL or HDL cholesterol, did not change markedly from results of Model 1.

Table 3 Results of multiple linear regression analysis of association between natural log transformed serum concentrations of PCBs and chlorinated pesticides and lipid fractions (n = 575)
Full size table

Table 4 shows results of the associations between serum lipid concentrations with concentrations of PCB congeners classified by number of ortho chlorines. Each outcome variable was regressed with 27 PCB congeners categorized into 3 groups based on number of ortho chlorines. Results were considered significant at p < 0.0019 (0.05/27) [30]. Separate results are presented with adjustment only for confounders other than the contaminants (Model 1) and with additional adjustment for all other groups of POPs (total pesticides and both of the other PCB groups) (Model 2). With Model 1 there were significant positive associations between concentrations of mono-ortho congeners and total lipids, di-ortho congeners with total lipids and triglycerides, and tri-plus tetra-ortho congeners with total lipid, triglycerides and total cholesterol. No association was observed with HDL or LDL cholesterol. When adjusted for other POPs (Model 2), only tri- plus tetra-ortho PCBs showed statistically significant positive correlations with total lipids and triglycerides.

Table 4 Results of multiple linear regression analysis of the associations between natural log transformed serum concentrations of groups of PCB congeners differing by the number of ortho- substituted chlorines and the various lipid fractions (n = 575)
Full size table

Among the results shown in Table 4, there are 10 separate instances in which a reversal of signs of the regression coefficients from positive to a negative occurs between the analyses of Model 1 and Model 2. We call the reader’s attention to the fact that these results should be treated most cautiously, as they are the result of suppression effects due to severe multicollinearity among the predictors. We give further details of these statistical artifacts in the Additional file 1.

The relationships between serum lipids with PCB congeners grouped by numbers of total chlorines are shown in Table 5. Each outcome variable was regressed with 27 PCB congeners categorized into 5 groups based on number of chlorines. Results were considered significant at p < 0.0019 (0.05/27) [30]. Prior to adjustment for other POPs (Model 1), all groups showed significant associations with total lipids and triglycerides. Associations with total cholesterol were observed for groups with three or four, six, seven, and eight or more chlorines. The only significant association with LDL cholesterol was with eight or more chlorines, and there were no associations with HDL cholesterol. These associations disappeared in Model 2 except for the significant positive association between total lipids and PCBs with three or four chlorines.

Table 5 Results of multiple linear regression analysis of association between natural log transformed serum concentrations of groups of PCB congeners based on the number of total chlorines and the various lipid fractions (n = 575)
Full size table

Table 6 provides the associations obtained with single PCB congeners without adjustment for other POPs (Model 1). Each outcome variable was regressed with 27 separate PCB congeners. Results were considered significant at p < 0.0019 (0.05/27) [30]. The mono-ortho substituted congeners 74 and 156 were significantly associated with total lipids, total cholesterol and triglycerides, as were the higher chlorinated di-ortho congeners 172 and 194, as well as the tri-and tetra-ortho congeners 199, 196–203, 206 and 209. Associations with total lipids and triglycerides only were observed for mono-ortho congeners 28 and 189, di-ortho congeners 170 and 180, and tri-ortho congeners 178, 187, and 195. Mono-ortho congener 157, di-ortho congeners 146 and 153, and tri-ortho congeners 177 and 183 were only associated with total lipids. Mono-ortho congeners 66, 118, 105, and 167 and di-ortho congeners 87, 99, and 138–158 were not associated with any lipids. Only PCBs 194 and 209 had positive associations with LDL but not HDL cholesterol at alpha <0.0019. Application of Model 2 to single congeners was not feasible due to extreme multicollinearity.

Table 6 Results of multiple linear regression analysis of associations between natural log transformed serum concentrations of individual PCB congeners and various lipid fractions (n = 575)
Full size table

A similar analysis for the groups of pesticides is shown in Table 7. Results were considered significant at p < 0.0019. All of the pesticide groups showed a positive association with total lipids in Model 1. In addition, DDT was positively associated with triglycerides, while total chlordane, HCB, and HCCH were positively associated with total cholesterol and triglycerides, with HCB also associated with LDL cholesterol (at alpha < 0.0019). When adjusted for other POPs (total PCBs and all other pesticides) (Model 2), most associations of lipid levels with total DDT and other pesticides disappeared. However, total chlordane remained significantly associated with triglycerides, and all associations from Model 1 for HCB remained unchanged, showing strong positive associations with all lipids except for a non-significant negative association with HDL-cholesterol.

Table 7 Results of multiple linear regression analysis of the associations between natural log transformed serum concentrations of the various pesticides or pesticide groups and the various lipid fractions (n = 575)
Full size table

Additional file 3 presents Pearson correlation coefficients for all of the groups of PCBs and pesticides, and demonstrates the high degree of multicollinearity among some of the groups. Additional file 4 presents Pearson correlation coefficients among the single PCB congeners. Note that the correlation coefficients are greater for higher than lower chlorinated congeners.

Discussion

We observed that elevated serum concentrations of lipids were significantly associated with serum concentrations of ΣPCBs and summed pesticides in analyses adjusted for age, race, gender, BMI, alcohol consumption, smoking and exercising status. The strongest associations were seen for PCB congeners with three or four ortho and/or at least eight substituted chlorines. Serum concentrations of HCB and chlordane also had strong associations with lipid components. The results reported here are consistent with conclusions made in study of a Native American population where PCB and pesticide levels were found to be positively correlated with serum total cholesterol and triglyceride concentrations (14).

Elevated concentrations of serum cholesterol and triglycerides and low concentrations of HDL cholesterol are major risk factors for cardiovascular disease [1, 32]. There is supportive evidence from both human [25, 28, 33] and animal [3, 34, 35] studies that exposure to POPs increases risk of cardiovascular disease.

While numerous studies examined association of PCBs with serum lipids as part of other analyses [9, 15, 16, 25, 26], the only previous study that has systematically investigated individual concentrations of POPs in relation to levels of serum lipids is that of Lee et al. (27). They studied a population of 90 individuals over 20 years of age, enriched with overweight and obese persons, and reported associations between concentrations of eight chlorinated pesticides and 22 PCB congeners with serum triglyceride and HDL cholesterol levels. They found heterogeneous relationships between serum concentrations of toxicants and lipids. As in our study they report significant association between concentrations of HCB and serum triglyceride levels. Some of the associations for other POPs they report were non-linear when the POPs were presented in quartiles. There are, however, significant differences in some of their results and ours. This is particularly so in relation to the effects of DDE, which they report to be associated with an elevation in triglycerides and suppression of HDL. We did not detect any effect of total DDTs, including DDE, after adjustment for other POPs and we found no significant effect on HDL cholesterol by DDE. The reason for this difference is uncertain, but may reflect the differences in the populations being studied and/or differences in adjustment for other POPs.

Obesity and change in weight also have profound effects on concentrations of lipids and levels of organochlorines. Lind et al. [36] studied life-time weight change in relation of concentration of POPs in the PIVUS study. The average estimated weight change over 50 years was 14.4 kg. Both the sum of OC pesticide concentrations (4.3 kg more weight gain in quintile 5 vs. quintile 1, p < 0.0001) and the sum of the less-chlorinated PCBs were positively related to the estimated weight change (3.7 kg more weight gain in quintile 2 vs. quintile 1, non-linear relationship p = 0.0015). In contrast, the sum of concentrations of highly-chlorinated PCBs were inversely related to estimated weight change (8.4 kg less weight gain in quintile 5 vs. quintile 1, p < 0.0001). Differences in mode of action, toxicokinetics, non-linear relationships and reverse causation might explain these discrepancies [36]. In the analysis of abdominal obesity of this cohort [37], twenty-one plasma POPs (16 polychlorinated biphenyl (PCB) congeners, 3 organochlorine (OC) pesticides, 1 brominated diphenyl ether (BDE), and 1 dioxin) were measured at baseline in 970 participants aged 70 years with prospective analyses in 511 participants re-examined after 5 years. Abdominal obesity was defined by an increased waist circumference. In the cross-sectional analyses, concentrations of the less chlorinated PCBs, OC pesticides such as p,p’-DDE and dioxin had adjusted odds ratios of 2 to 3 for abdominal obesity. Many relations had inverted U-shapes rather than being linear, particularly in women. In contrast, concentrations of highly chlorinated PCBs were strongly inversely associated with abdominal obesity. In a single model including summary measures of the less chlorinated PCBs, highly chlorinated PCBs, and OC pesticides, both the positive associations and inverse associations strengthened. Similar but somewhat weaker associations were seen between POPs and risk of development of abdominal obesity in the prospective analyses.

In addition, experimental animal studies have shown dose-dependent increases in serum levels of total cholesterol and triglycerides in response to exposure to PCBs [3, 4, 6, 38]. Exposure to PCBs changes the patterns of lipid metabolism and synthesis [39]. In this study, animals were fed either an olive oil or a corn-oil rich diet, and then exposed to PCB 77, a coplanar, dioxin-like congener. They found that the PCB treatment in both groups caused induction of genes involved in fatty acid degradation but that there was upregulation of different genes. These observations raise another possible complication, in that while different PCB congeners and different pesticides may induce different genes, different kinds of dietary fat may influence which genes are induced. As suggested above, PCBs can initiate inflammatory responses in vivo, and this inflammation can be either exacerbated or ameliorated by nutrition. Petriello et al. [40] also showed that diets high in certain dietary lipids such as omega-6 fatty acids can worsen PCB-induced vascular toxicity while diets enriched with bioactive food components such as polyphenols and omega-3 polyunsaturated fatty acids can improve the toxicant-induced inflammation. There is evidence that bioactive nutrients protect through multiple cell signaling pathways, but they have shown that lipid raft caveolae and the antioxidant defense controller nuclear factor (erythroid-derived 2)-like 2 (Nrf2) both play a predominant role in nutritional modulation of PCB-induced vascular toxicity. Interestingly, there appears to be an intimate cross-talk between caveolae-related proteins and cellular Nrf2, and focusing on the use of specific bioactive food components that simultaneously alter both pathways may produce a more effective and efficient cytoprotective response to toxicant exposure. The use of nutrition as a protective tool is an economically beneficial means to address the toxicity of persistent environmental toxicants and may become a sensible means to protect human populations from PCB-induced vascular inflammation and associated chronic diseases [40].

The precise mechanisms responsible for the associations between serum POPs and the various serum lipid components are uncertain. Organochlorines are difficult to metabolize, and exposure causes induction of various degradative enzymes, particularly different cytochrome P450s [41, 42]. In addition, DNA methylation levels in humans have been found to be altered by several persistent organic pollutants, including PCBs and chlorinated pesticides [43], indicating that these chemicals can also induce epigenetic changes. Liver size in animals actually doubles in situations of high exposure, reflecting enzyme induction [44]. Others have documented specific alternations of enzymes involved in lipid synthesis caused by exposure to single PCB congeners [45]. A variety of genes are either up-or down-regulated by different PCB congeners [46, 47], p,p’-DDE [48] and by a mixture of 28 persistent organic pollutants [49]. Thus, there are multiple possible pathways that might lead to selective alteration in rates of synthesis or metabolism of some classes of serum lipids.

Strengths and weaknesses

This study has the strength of relatively large numbers and approximately equal numbers of African-Americans and Caucasians. Exposure status was evaluated objectively and comprehensively. We have excluded individuals on lipid-lowering medication, which would results in changes in lipid levels. We have adjusted results for the important confounders of age, gender, race, BMI, alcohol consumption, smoking and exercise and have also presented results after adjustment for concentrations of other POPs.

However, this study also has some major limitations. The cross-sectional design does not allow for assessing causality. We have a single point in time measurement of both POPs and lipid levels. There may remain some confounding due to the fact that POPs are found in the lipid layers and migrate together. The associations after adjustment for other POPs, seen primarily only with more highly chlorinated PCB congeners which are more lipophilic, could possibly reflect reverse causality. This explanation is less likely in light of results for chlorinated pesticides (especially HCB). We cannot eliminate the possibility that some other lipophilic chemical(s) that was not measured but migrates together with PCBs and chlorinated pesticides has the dominant action.

All of these POPs reside in the lipid fraction in blood, and we assume that blood lipids are in equilibrium with body fat deposits in fasting individuals [21].

Our results are all based on wet weight measurements of levels of POPs, which are unadjusted for lipids. Whether adjusted directly by the methods of Phillips et al. [21] or indirectly – by incorporating unadjusted lipid values as covariates – as proposed by Schisterman et al. [50], adjustments for lipids are appropriate only for non-lipid dependent variables. Since lipids are the outcome variables of the present study, adjusting them directly or indirectly would effectively remove the covariance of the PCBs and the lipid dependent variables. In our previous studies, in which lipids were not dependent variables, we documented that use of wet weight values adjusted for directly or indirectly yielded very similar results [17, 19]. There is increasing evidence for non-linear associations between levels of POPs and some disease outcomes, including effects on serum lipid levels [26, 27], and these may affect our study as well. It is well recognized that multicollinearity, the extent to which predictor variables in a multiple regression analysis share common variance, can have seriously debilitating effects on the analysis and its interpretation, and this factor seriously limits our ability to determine which of the PCB congeners and different pesticides, if any, are responsible for the associations we observe (see Additional file 1). Finally, although we excluded all individuals who were on lipid-lowering medication from our study, there is some evidence that some other medications may also lower lipid levels. We also did not have detailed dietary information to estimate total fat intake or type of fat consumed to stratify or adjust in the analyses.

Conclusions

Serum concentrations of total PCBs (sum of 35 congeners) and total chlorinated pesticides (sum of nine pesticides) were significantly associated with elevated serum levels of total lipids, total cholesterol and triglycerides but not levels of LDL and HDL after adjustment for age, gender, race, BMI, smoking and exercise in a study population who were not on lipid-lowering medication. After adjustment for confounders, associations between different groups of POPs and serum lipids were not homogenous. The PCBs with the strongest associations were those with three, four, or eight or more total chlorines, while, of the pesticides, the most striking associations were observed for hexachlorobenzene, even though concentrations of it were low. Chlordane also was found to be positively associated with some lipid components after adjustment for other contaminant concentrations. These results suggest that, in spite of the fact that concentrations of all of these lipophilic chlorinated compounds are highly correlated, the effects on lipid levels are different for different pesticides and PCB congeners. Our results are consistent with the hypothesis that higher levels of POPs, especially higher chlorinated PCBs and some pesticides, result in elevations of serum lipids and that risk of cardiovascular disease and obesity after exposure to PCBs and chlorinated pesticides is, at least in part, a consequence of the elevations in serum lipids that result from exposure.

Abbreviations

ATSDR:

Agency for toxic substances and disease registry

BMI:

Body-mass index

DDE:

Dichloro-dichlorophenyl-ethylene

DDT:

Dichloro-diphenyl-trichloroethane

DNA:

Deoxyribonucleic acid

HCB:

Hexachlorobenzene

HCCH:

Hexachlorocyclohexane

HDL:

High density lipoprotein cholesterol

LDL:

Low density lipoprotein cholesterol

PCBs:

Polychlorinated biphenyls

POPs:

Persistant organic pollutants

Ppb:

Parts per billion

Ww:

Wet weight.

References

  1. Expert Panel on Detection, Evaluation, and Treatment of High Blood Cholesterol in Adults: Executive summary of the third report of the national cholesterol education program (NCEP) expert panel on detection, evaluation, and treatment of high blood cholesterol in adults (adult treatment panel III). JAMA. 2001, 285: 2486-2497. 10.1001/jama.285.19.2486.

    Article  Google Scholar 

  2. Ishikawa TT, McNeely S, Steiner PM, Glueck CJ, Mellies M, Gartside PC, McMillin C: Effects of chlorinated hydrocarbons on plasma-lipoprotein cholesterol in rats. Metabolism. 1978, 27: 89-96. 10.1016/0026-0495(78)90127-0.

    Article  CAS  Google Scholar 

  3. Kato N, Kato M, Kimura T, Yoshida A: Effect of dietary addition of PCB, DDT, or BHT and dietary protein on vitamin A and cholesterol metabolism. Nutr Rep Int. 1978, 18: 437-445.

    CAS  Google Scholar 

  4. Oda H, Matsushita N, Hirabayashi A, Yoshida A: Cholesterol-rich very low density lipoproteins and fatty liver in rats fed Polychlorinated Biphenyls. Biosci Biotech Biochem. 1994, 58: 2152-2158. 10.1271/bbb.58.2152.

    Article  CAS  Google Scholar 

  5. Azaïs-Braesco V, Macaire JP, Bellenand P, Robertson LW, Pascal G: Effects of two prototypic polychlorinated biphenyls (PCBs) on lipid composition of rat liver and serum. J Nutr Biochem. 1990, 1: 350-354. 10.1016/0955-2863(90)90002-3.

    Article  Google Scholar 

  6. Bell FP, Iverson F, Arnold D, Vidmar TJ: Long-term effects of Aroclor 1254 (PCBs) on plasma lipid and carnitine concentrations in rhesus monkey. Toxicology. 1994, 89: 139-153. 10.1016/0300-483X(94)90222-4.

    Article  CAS  Google Scholar 

  7. Sanyal S, Agarwal N, Dudeja PK, Mahmood A, Subrahmanyam D: Effect of a single oral dose of DDT on lipid metabolism in protein-calorie malnourished monkeys. Indian J Biochem Biophys. 1982, 19: 111-114.

    CAS  Google Scholar 

  8. Baker EL, Landrigan PJ, Glueck CJ, Zack MM, Liddle JA, Burse VW, Housworth WJ, Needham LL: Metabolic consequences of exposure to polychlorinated biphenyls (PCB) in sewage sludge. Am J Epidemiol. 1980, 112: 553-563.

    Google Scholar 

  9. Chase KH, Wong O, Thomas D, Berney BW, Simon RK: Clinical and metabolic abnormalities associated with occupational exposure to polychlorinated biphenyls (PCBs). J Occup Med. 1982, 24: 109-114.

    CAS  Google Scholar 

  10. Takamatsu M, Oki M, Maeda K, Inoue Y, Hirayama H, Yoshizuka K: PCBs in blood of workers exposed to PCBs and their health status. Prog Clin Biol Res. 1984, 137: 59-68.

    CAS  Google Scholar 

  11. Stehr-Green PA, Welty E, Steele G, Steinberg K: Evaluation of potential health effects associated with serum polychlorinated biphenyl levels. Environ Health Perspect. 1986, 70: 255-259.

    Article  CAS  Google Scholar 

  12. Tokunaga S, Kataoka K: A longitudinal analysis on the association of serum lipids and lipoproteins concetnrations with blood polychlorinated biphenyls level in chronic “Yusho” patients. Fukuoka Acta Med. 2003, 94: 110-117.

    CAS  Google Scholar 

  13. Gustavsson P, Hogstedt C: A cohort study of Swedish capacitor manufacturing workers exposed to polychlorinated biphenyls (PCBs). Am J Ind Med. 1997, 32: 234-239. 10.1002/(SICI)1097-0274(199709)32:3<234::AID-AJIM8>3.0.CO;2-X.

    Article  CAS  Google Scholar 

  14. Goncharov A, Haase RF, Santiago-Rivera A, Morse G, McCaffrey RJ, Rej R, Carpenter DO, Akwesasne Task Force on the Environment: High serum PCBs are associated with elevation of serum lipids and cardiovascular disease in a Native American population. Environ Res. 2008, 106: 226-239. 10.1016/j.envres.2007.10.006.

    Article  CAS  Google Scholar 

  15. Lawton RW, Ross MR, Feingold J, Brown JF: Effects of PCB exposure on biochemical and hematological findings in capacitor workers. Environ Health Perspect. 1985, 60: 165-184.

    Article  CAS  Google Scholar 

  16. Brown JF, Lawton RW: Factors controlling the distribution and levels of PCBs after occupational exposure. PCBs: Recent advances in environmental toxicology and health effects. Edited by: Robertson LW, Hansen LG. 2001, Lexington, KY: The University Press of Kentucky

    Google Scholar 

  17. Goncharov A, Bloom M, Pavuk M, Birman I, Carpenter DO: Blood pressure and hypertension in relation to levels of serum polychlorinated biphenyls in residents of Anniston, Alabama. J Hypertens. 2010, 28: 2053-2060. 10.1097/HJH.0b013e32833c5f3e.

    Article  CAS  Google Scholar 

  18. ATSDR (Agency for Toxic Substances and Disease Registry): Toxicological Profile of Polychlorinated Biphenyls. 2000, : US Department of Health and Human Services, 765-

    Google Scholar 

  19. Goncharov A, Pavuk M, Foushee HR, Carpenter DO: Blood pressure in relation to concentrations of PCB congeners and chlorinated pesticides. Environ Health Perspect. 2011, 119: 319-325.

    Article  CAS  Google Scholar 

  20. Sjödin A, Jones RS, Lapeza CR, Focant JF, McGahee EE, Patterson DG: Semiautomated high-throughput extraction and cleanup method for the measurement of polybrominated diphenyl ethers, polybrominated biphenyls, and polychlorinated biphenyls in human serum. Anal Chem. 2004, 76: 1921-1927. 10.1021/ac030381+.

    Article  Google Scholar 

  21. Phillips D, Pirke J, Burse V, Bernert J, Henderson L, Needham L: Chlorinated hydrocarbon levels in human serum: Effects of fasting and feeding. Arch Environ Contam Toxicol. 1989, 18: 495-500. 10.1007/BF01055015.

    Article  CAS  Google Scholar 

  22. Bernert JT, Turner WE, Patterson DG, Needham LL: Calculation of serum “total lipid” concentrations for the adjustment of persistent organohalogen toxicant measurements in human samples. Chemosphere. 2007, 68: 824-831. 10.1016/j.chemosphere.2007.02.043.

    Article  CAS  Google Scholar 

  23. Hansen LG: Stepping backward to improve assessment of PCB congener toxicities. Environ Health Perspect. 1998, 106 (Suppl 1): 171-189. 10.1289/ehp.98106s1171. 46

    Article  CAS  Google Scholar 

  24. Warner J, Osuch JR, Karmaus W, Landgraf JR, Taffe B, O’Keefe M, Mikucki D, Haan P: Common classification schemes for PCB congeners and the gene expression of CYP17, CYP19, ESR1 and ESR2. Sci Total Environ. 2012, 414: 81-89.

    Article  CAS  Google Scholar 

  25. Ha MH, Lee DH, Jacobs DR: Association between serum concentrations of persistent organic pollutants and self-reported cardiovascular disease prevalence: Results from the national health and nutrition examination survey, 1999–2002. Environ Health Perspect. 2007, 115: 1204-1209. 10.1289/ehp.10184.

    Article  CAS  Google Scholar 

  26. Lee D-H, Steffes MW, Sjodin A, Jones RS, Needham LL, Jacobs DR: Low dose of some persistent organic pollutants predicts type 2 diabetes: a nested case–control study. Environ Health Perspect. 2010, 118: 1235-1242. 10.1289/ehp.0901480.

    Article  CAS  Google Scholar 

  27. Lee D-H, Steffes MW, Sjodin A, Jones RS, Needham LL, Jacobs DR: Low dose organochlorine pesticides and polychlorinated biphenyls predict obesity, dyslipidemia, and insulin resistance among people free of diabetes. PLoS One. 2011, 6: e15977-10.1371/journal.pone.0015977. doi: e15977.doi:10.1371/journal.pone.0015977

    Article  CAS  Google Scholar 

  28. Lind PM, van Bavel B, Sulihovic S, Lind L: Circulating levels of persistent organic pollutants (POPs) and carotid atherosclerosis in the elderly. Environ Health Perspect. 2012, 120: 38-43.

    Article  CAS  Google Scholar 

  29. Cohen J, Cohen P, West SG, Aiken LS: Applied multiple correlation/regression analysis for the behavioral sciences. 2003, Mahwah, NJ: Lawrence Erlbaum Associates Publishers

    Google Scholar 

  30. Curran-Everett D: Multiple comparisons: Philosophies and illustrations. Am J Phyesiol Regul Integr Comp Physiol. 2000, 279: R1-R8.

    CAS  Google Scholar 

  31. Rafai N, Bachorik PS, Albers JJ: Lipids, lipoproteins, and apolipoproteins. Tietz Textbook of Clinical Chemistry. Edited by: Burtis CA, Ashwood ER. 1999, Philadelphia, PA: Saunders, 809-861. 3

    Google Scholar 

  32. Chapman MJ, Ginsberg HN, Amarenco P, Andreotti F, Borén J, Catapano AL, Descamps OS, Fisher E, Kovanen PT, Kuivenhoven JA, Lesnik P, Masana L, Nordestgaard BG, Ray KK, Reiner Z, Taskinen M-R, Tokgözoglu L, Tybjær-Hansen A, Watts GF: Eur Heart J. 2011, 32: 1345-1361. 10.1093/eurheartj/ehr112.

    Article  CAS  Google Scholar 

  33. Humblet O, Birnbaum L, Rimm E, Mittleman MA, Hauser R: Dioxins and cardiovascular disease mortality. Environ Health Perspect. 2008, 116: 1443-1448. 10.1289/ehp.11579.

    Article  CAS  Google Scholar 

  34. Jokinen MP, Walker NJ, Brix AE, Sells DM, Haseman JK, Nyska A: Increase in cardiovascular pathology in female Sprague–Dawley rats following chronic treatment with 2,3,7,8tetrachlorodibenzo-p-dioxin and 3,3′,4,4′,5-pentachlorobiphenyl. Cardiovasc Toxicol. 2003, 3: 299-310. 10.1385/CT:3:4:299.

    Article  CAS  Google Scholar 

  35. Lind PM, Orberg J, Edlund UB, Sjöblom L, Lind L: The dioxin-like pollutant PCB 126 (3,3′,4,4′,5-pentachlorobiphenyl) affects risk factors for cardiovascular disease in female rats. Toxicol Lett. 2004, 150: 293-299. 10.1016/j.toxlet.2004.02.008.

    Article  CAS  Google Scholar 

  36. Lind PM, Lee DH, Jacobs DR, Salihovic S, van Bavel B, Wolff MS, Lind L: Circulating levels of persistent organic pollutants are related to retrospective assessment of life-time weight change. Chemosphere. 2013, 90 (3): 998-1004. 10.1016/j.chemosphere.2012.07.051.

    Article  CAS  Google Scholar 

  37. Lee DH, Lind L, Jacobs DR, Salihovic S, van Bavel B, Lind PM: Associations of persistent organic pollutants with abdominal obesity in the elderly: The Prospective Investigation of the Vasculature in Uppsala Seniors (PIVUS) study. Environ Int. 2012, 40: 170-8.

    Article  CAS  Google Scholar 

  38. Boll M, Weber LW, Messner B, Stampfl A: Polychlorinated biphenyls affect the activities of gluconeogenic and lipogenic enzymes in rat liver: is there an interference with regulatory hormone actions?. Xenobiotica. 1998, 28: 479-492. 10.1080/004982598239407.

    Article  CAS  Google Scholar 

  39. Hennig B, Reiterer G, Toborek M, Matveev SV, Daugherty A, Smart E: Dietary fat interacts with PCBs to induce changes in lipid metabolism in mice deficient in low-density lipoprotein receptor. Environ Health Perspect. 2005, 113: 83-87.

    Article  CAS  Google Scholar 

  40. Petriello MC, Newsome B, Hennig B: Influence of nutrition in PCB-induced vascular inflammation. Environ Sci Pollut Res Int. 2013, [Epub ahead of print]

    Google Scholar 

  41. Ngui JS, Bandiera SM: Induction of hepatic CYP2B is a more sensitive indicator of exposure to aroclor 1260 than CYP1A in male rats. Toxicol Appl Pharmacol. 1999, 161: 160-170. 10.1006/taap.1999.8787.

    Article  CAS  Google Scholar 

  42. Pang S, Cao JQ, Katz BH, Hayes CL, Sutter TR, Spink DC: Inductive and inhibitory effects of non-ortho-substituted polychlorinated biphenyls on estrogen metabolism and human cytochromes P450 1A1 and 1B1. Biochem Pharmacol. 1999, 58: 29-38. 10.1016/S0006-2952(99)00070-2.

    Article  CAS  Google Scholar 

  43. Rusiecki JA, Baccarelli A, Bollati V, Tarantini L, Moore LE, Bonefeld-Jorgensen EC: Global DNA hypomethylation is associated with high serum-persistent organic pollutants in Greenlandic Inuit. Environ Health Perspect. 2008, 116: 1547-1552. 10.1289/ehp.11338.

    Article  CAS  Google Scholar 

  44. Imsilp K, Hansen L: PCB profiles in mouse skin biopsies and fat from an environmental mixture. Environ Toxicol Pharmacol. 2005, 19: 71-84. 10.1016/j.etap.2004.04.007.

    Article  CAS  Google Scholar 

  45. Matsusue K, Ishii Y, Ariyoshi N, Oguri K: A highly toxic coplanar polychlorinated biphenyl compound suppresses Delta5 and Delta6 desaturase activities which play key roles in arachidonic acid synthesis in rat liver. Chem Res Toxicol. 1999, 12: 1158-1165. 10.1021/tx990104r.

    Article  CAS  Google Scholar 

  46. Borlak J, Dangers M, Thum T: Aroclor 1254 modulates gene expression of nuclear transcription factors: Implications for albumin gene transcription and protein synthesis in rat hepatocyte cultures. Toxicol Appl Pharmacol. 2002, 181: 79-88. 10.1006/taap.2002.9392.

    Article  CAS  Google Scholar 

  47. Vezina CM, Walker NJ, Olson JR: Subchronic exposure to TCDD, PeCDF, PCB126, and PCB153: Effect on hepatic gene expression. Environ Health Perspect. 2004, 112: 1636-1644. 10.1289/ehp.7253.

    Article  CAS  Google Scholar 

  48. Kelce WR, Lambright CR, Gray LE, Roberts KP: Vinclozolin and p, p’-DDE alter androgen-dependent gene expression: In vivo confirmation of an androgen receptor-mediated mechanism. Toxicol Appl Pharmacol. 1997, 142: 192-200. 10.1006/taap.1996.7966.

    Article  CAS  Google Scholar 

  49. Adeeko A, Li D, Doucet J, Cooke GM, Trasler JM, Robaire B, Hales BF: Gestational exposure to persistent organic pollutants: maternal liver residues, pregnancy outcome, and effects on hepatic gene expression profiles in the dam and fetus. Toxicol Sci. 2003, 72: 242-252. 10.1093/toxsci/kfg023.

    Article  CAS  Google Scholar 

  50. Schisterman EF, Whitcomb BW, Germaine Louis GM, Louis TA: Lipid adjustment in the analysis of environmental contaminants and human health risks. Enviro Health Perspect. 2005, 113: 853-857. 10.1289/ehp.7640.

    Article  CAS  Google Scholar 

Download references

Acknowledgments

The data collection was supported by a grant from the Agency for Toxic Substances and Disease Registry to Jacksonville State University, # 5U50TS473215. We thank Wayman Turner and Andreas Sjödin at the National Center for Environmental Health’s Division of Laboratory Sciences, Center for Disease Control and Prevention, Atlanta, GA, for their expert analytical work on this study. The Anniston Environmental Health Research Consortium Steering Committee members include Shirley Baker, community representative; Scott Bartell, UC Irvine; James Olson, University at Buffalo; Russell Foushee, Alan Percy, University of Alabama at Birmingham; David O. Carpenter, University at Albany; Jane Cash; Martha Lavender, Christie Shelton, Jacksonville State University; Howard Frumkin, University of Washington; Marian Pavuk ATSCR/CDC; Paula Rosenbaum, Allen Silverstone, Ruth Weinstock, Upstate Medical University; and Kirsten Moysich, Roswell Park Cancer Institute. ZA was supported by a grant from the Passport Foundation to the Institute for Health and the Environment of the University at Albany. The contents of this publication are solely the responsibility of the authors and do not necessarily represent ATSDR’s official views.

Author information

Authors and Affiliations

  1. Institute for Health and the Environment, University at Albany, 5 University Place, Rensselaer, NY, 12144, USA

    Zafar Aminov, Richard F Haase & David O Carpenter

  2. Agency for Toxic Substances and Disease Registry, Atlanta, GA, USA

    Marian Pavuk

Authors
  1. Zafar Aminov
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Richard F Haase
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Marian Pavuk
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. David O Carpenter
    View author publications

    You can also search for this author in PubMed Google Scholar

Consortia

Anniston Environmental Health Research Consortium

Corresponding author

Correspondence to David O Carpenter.

Additional information

Competing interests

DOC has served as an expert witness in legal actions against Monsanto relating to exposure of resident of Anniston, Alabama to PCBs, with all compensation paid to the Research Foundation at the University at Albany. The other authors declare that they have no competing interests.

Authors’ contributions

ZA participated in the planning of the study, carried out most of the data analysis and this study constituted a part of his PhD thesis. RH reviewed and advised on the statistical analysis and wrote the material contained in the Additional file 1. MP reviewed and advised on all aspects of the study. DOC designed the study and supervised all aspects of data analysis and preparation of the manuscript in addition to receiving the funding for the project. All authors read and approved the final manuscript.

Electronic supplementary material

12940_2013_711_MOESM1_ESM.docx

Additional file 1:Some Cautions About Confounders, Multicollinearity, Suppression Effects, and Overadjustment in Linear Model Analyses.(DOCX 107 KB)

12940_2013_711_MOESM2_ESM.docx

Additional file 2:Results of multiple linear regression analysis of association between natural log transformed total serum concentrations of persistent organic pollutants and lipid fractions (n = 575).(DOCX 14 KB)

12940_2013_711_MOESM3_ESM.docx

Additional file 3:Pearson’s correlation coefficients for natural log transformed serum concentrations of groups of PCBs based on the total number and number of ortho substituted chlorines and the various pesticides and pesticide groups.(DOCX 28 KB)

Additional file 4:Pearson’s correlation coefficients for natural log transformed PCB congeners.(DOCX 49 KB)

Authors’ original submitted files for images

Below are the links to the authors’ original submitted files for images.

Authors’ original file for figure 1

Authors’ original file for figure 2

Authors’ original file for figure 3

Rights and permissions

Open Access This article is published under license to BioMed Central Ltd. This is an Open Access article is distributed under the terms of the Creative Commons Attribution License ( https://creativecommons.org/licenses/by/2.0 ), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Reprints and permissions

About this article

Cite this article

Aminov, Z., Haase, R.F., Pavuk, M. et al. Analysis of the effects of exposure to polychlorinated biphenyls and chlorinated pesticides on serum lipid levels in residents of Anniston, Alabama. Environ Health 12, 108 (2013). https://doi.org/10.1186/1476-069X-12-108

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/1476-069X-12-108

Keywords

Environmental Health

ISSN: 1476-069X