This article has Open Peer Review reports available.
Toddler temperament and prenatal exposure to lead and maternal depression
- Annemarie Stroustrup1, 2, 8Email author,
- Hsiao-Hsien Hsu2,
- Katherine Svensson2,
- Lourdes Schnaas3,
- Alejandra Cantoral4,
- Maritsa Solano González4,
- Mariana Torres-Calapiz3,
- Chitra Amarasiriwardena2,
- David C. Bellinger5, 6,
- Brent A. Coull6, 7,
- Martha M. Téllez-Rojo4,
- Robert O. Wright1, 2 and
- Rosalind J. Wright1, 2
© The Author(s). 2016
Received: 7 March 2016
Accepted: 30 May 2016
Published: 16 June 2016
Temperament is a psychological construct that reflects both personality and an infant’s reaction to social stimuli. It can be assessed early in life and is stable over time Temperament predicts many later life behaviors and illnesses, including impulsivity, emotional regulation and obesity. Early life exposure to neurotoxicants often results in developmental deficits in attention, social function, and IQ, but environmental predictors of infant temperament are largely unknown. We propose that prenatal exposure to both chemical and non-chemical environmental toxicants impacts the development of temperament, which can itself be used as a marker of risk for maladaptive neurobehavior in later life.
In this study, we assessed associations among prenatal and early life exposure to lead, mercury, poverty, maternal depression and toddler temperament.
A prospective cohort of women living in the Mexico City area were followed longitudinally beginning in the second trimester of pregnancy. Prenatal exposure to lead (blood, bone), mercury, and maternal depression were assessed repeatedly and the Toddler Temperament Scale (TTS) was completed when the child was 24 months old. The association between each measure of prenatal exposure and performance on individual TTS subscales was evaluated by multivariable linear regression. Latent profile analysis was used to classify subjects by TTS performance. Multinomial regression models were used to estimate the prospective association between prenatal exposures and TTS performance.
500 mother-child pairs completed the TTS and had complete data on exposures and covariates. Three latent profiles were identified and categorized as predominantly difficult, intermediate, or easy temperament. Prenatal exposure to maternal depression predicted increasing probability of difficult toddler temperament. Maternal bone lead, a marker of cumulative exposure, also predicted difficult temperament. Prenatal lead exposure modified this association, suggesting that joint exposure in pregnancy to both was most toxic.
Maternal depression predicts difficult temperament and concurrent prenatal exposure to maternal depression and lead predicts a more difficult temperament phenotype in 2 year olds. The role of temperament as an intermediate variable in the path from prenatal exposures to neurobehavioral deficits and other health effects deserves further study.
KeywordsTemperament Prenatal exposure Lead Depression in pregnancy Neurobehavioral outcomes
Temperament reflects the manner in which an individual interacts with and responds to social and emotional environmental cues. Distinct temperament traits are identifiable in infancy and are relatively stable over time [1, 2]. Temperament is a biologically based trait  and is associated with later child behavior, both normal and pathological [4–7]. Early childhood temperament can be seen as an important risk factor for behavioral problems that are not expressed until later in life as well as for diseases such as obesity [8–14]. While the full range of risk factors that predict maladaptive temperament are not well-understood, it is believed that temperament is established during perinatal life through both genetic and environmental factors [13–16]. As such, in utero exposure to neurotoxicants might impact infant temperament, and maladaptive temperament may be an early life intermediate phenotype for behavioral disorders brought on by environmental toxicants.
Although prenatal exposure to elemental metals including lead and mercury is known to be detrimental to cognition and specific behavioral domains in childhood [17–23], the relationship between in utero metal exposure and temperament has not been studied previously. Social stressors such as maternal mental state and stress level – which we refer to as “non-chemical toxicants”  – can also have a significant clinical impact on the developing fetus [25–30]. Women who experience toxic stress, anxiety, or depression while pregnant have children at elevated risk for certain physical, cognitive, and behavioral difficulties [28–32]. To our knowledge, no study has attempted to address whether concurrent prenatal exposure to chemical and non-chemical stressors interact to predict maladaptive temperament phenotypes.
While gene-environment interactions have received much attention, the concurrent exposure to multiple toxins may also multiplicatively increase effects seen in single exposure models [33–42], and studies of prenatal exposure should evaluate both chemical and non-chemical exposures to reflect real-life exposure scenarios. In this study, we hypothesized that prenatal co-exposure to chemical and non-chemical neurotoxicants is associated with difficult infant temperament. The study was nested in a large prospective environmental health cohort study designed to investigate the impact of concurrent prenatal exposure to lead, mercury, maternal depression, socioeconomic status, and maternal nutrition on multiple long-term neurobehavioral outcomes.
Participant identification and enrollment
Between 2007 and 2011, healthy pregnant women in Mexico City were recruited through the Mexican Social Security System to participate in the PROGRESS (Programming Research in Obesity, GRowth, Environment, and Social Stress) birth cohort . Informed consent to participate in the study was obtained from participants. Nine hundred forty-eight women were enrolled prior to 20 weeks of pregnancy and delivered a live infant. Of these, 760 children were evaluated for neurodevelopment in at least one visit at 6, 12, 18, or 24-months of age. Of the 549 completing the 24-month visit, 500 mothers responded to the Toddler Temperament Scale (TTS), the primary outcome in these analyses. Research ethics committees of the participating institutions approved the study (the Comité de Investigación, Comité de Bioseguridad, and the Comité de Ética en la Investigación of the National Institute of Public Health, Mexico, the Partners Human Research Committee at Brigham and Women’s Hospital, the Office of Human Research Administration at the Harvard School of Public Health, and the Program for the Protection of Human Subjects at the Icahn School of Medicine at Mount Sinai).
Participant data collection
Questionnaires were administered to collect sociodemographic information including maternal age, parity, education level, and socioeconomic status (SES). Thirteen variables derived from questionnaire results were used to classify study participant families into six levels based on the SES index created by the Asociación Mexicana de Agencias de Investigación de Mercados y Opinión Pública . These levels were then collapsed into low, medium, and high socioeconomic status.
Maternal lead exposure was assessed by inductively coupled plasma-mass spectrometry (Agilent 8800, Santa Clara, CA) of maternal blood during the second trimester and in bone by maternal in vivo K-shell X-ray fluorescence (K-XRF) one month postpartum (ABIOMED, Danvers, MA, USA) [45, 46]. Blood lead measurement quality control (QC) and quality assurance procedures used were: included analyses of procedural blanks, duplicates, spiked samples, national institute of standard reference material (NIST SRM) 955 (Lead in Blood); NIST SRM 1643e (trace elements in water) and blood samples from the inter-laboratory study program INSPQ/Laboratoire de Toxicologie, Quebec to monitor the accuracy and recovery rates of the procedure for each analytic batch. Lab recovery rates for QC standards and spiked samples with this method were 9- 110 % and precision (given as % RSD) was <5 %. The limit of detection for this procedure was 0.2 ng ml-1.
Our K-XRF protocol measures bone lead at the mid-shaft tibia (cortical bone) and the patella (trabecular bone)  to provide a representation of cumulative fetal lead exposure through gestation [45, 48]. K-XRF produces negative values when the bone lead content is below the detection limit of the instrument. As imputation to replace negative values in this context has not been shown to be beneficial , we included negative values as reported by K-XRF in our analyses.
Maternal mercury exposure was evaluated by measuring mercury deposition in maternal toenails collected during pregnancy. Toenails from all ten toes were collected and pre-cleaned by sonicating for 15 min in approximately 10 mL of 1 % Triton X-100 solution to remove extraneous contaminants. Samples were then rinsed with distilled deionized water and dried at 60 °C for 24 h in a drying oven. Mercury level was assessed using the Direct Mercury Analyzer 80 (Milestone Inc., Monroe, CT) using previously published methods . Samples were analyzed using an aqueous calibration standards and verifyied using different weights of certified reference material GBW 07601 (human hair; Institute of Geophysical and Geochemical Exploration, China). Mercury recovery was 90–110 %, with greater than 90 % precision. The detection limit for samples varied according to sample weight. Sample weight varied from 0.006 g to 0.0.083 g, and the detection limit varied from 0.006 μg/g to 0.08 μg/g (mean = 0.019 μg/g).
Measurements of child development
All children were assessed for motor, language and cognitive development using the Bayley Scales of Infant and Toddler Development, 3rd edition (BSID) at 24 months of age . Child temperament was assessed at 24 months of age using the TTS , which comprises a number of age-appropriate questions. These questions evaluate the nine temperamental characteristics first described by Thomas et al. , and expands on earlier work by Carey measuring temperament in infants [53, 54]. Caregivers are presented with a statement describing a certain behavior and asked to rate how often their child behaves in that way on a 6-point scale. The results are coded so that higher scores indicate more difficult temperament. Although the TTS is designed to be completed independently by parents, in the current study trained psychologists verbally administered the TTS to the enrolled mother at the 24-month study visit. In 9 cases where the mother was not present at the 24-month visit, the TTS questionnaire was mailed to the home for independent completion by the mother.
Measurement of maternal depression risk
The Edinburgh Postnatal Depression Scale (EPDS) was administered to mothers in the second trimester. The EPDS is a ten-item self-report scale designed to identify women experiencing depressive symptoms . It is validated for repeated use during and both immediately and long after pregnancy [56, 57]. For these analyses, the second trimester EPDS result was used as the prenatal depression risk score. If the EPDS was not administered during the second trimester, the third trimester result was used as the prenatal depression risk score. The 24-month EPDS score was obtained at the same study visit as the TTS. Depression risk was evaluated both as a continuous and as a categorical variable dichotomized at an EPDS score of 13, the recommended cut point [55, 58, 59].
Although the focus of this study was to prospectively evaluate the impact of prenatal exposures including maternal depression, we also evaluated the EPDS score obtained cross-sectionally at child age 24-months in analyses, as the caregiver’s mental state at the time of TTS administration has been associated with the assessment of the child’s temperament [60, 61]. As in other studies where depressive symptoms years after childbirth were associated with perinatal depression [62, 63], the categorical variable for prenatal maternal depression risk was associated with depression risk at 24 months (p < 0.001), and the continuous variables were correlated (ρ = 0.66) in our cohort. To address the collinearity induced by including both antenatal and 24-month post-partum depression in the same model, we included variables for both the average of the two scores and the difference between scores in all analyses using the EPDS continuous variable. This transformation from the original correlated measurements to the sum and difference is the basis for traditional MANOVA analyses for multivariate outcomes . The adjusted representation of the prenatal maternal depression score is referred to as “adjusted EPDS” or “adjusted prenatal depression” throughout this manuscript.
Linear regression modeling
We examined univariate descriptive statistics, bivariate associations, and multivariable linear regression of each of the 9 TTS subscales using multiple measures of prenatal lead exposure, prenatal mercury exposure, maternal education, SES index, maternal ferritin during pregnancy (as a marker of nutritional status), and prenatal maternal depression score. Interaction terms for different exposures were also examined. Initial models included maternal ferritin and education, but these were dropped from subsequent models as they were insignificant (ferritin) or strongly correlated with the SES index (maternal education). These analyses were conducted using SAS 9.4 (Research Triangle Institute, Cary, NC).
In order to reduce the dimensionality of the overall nine outcome scale into a smaller set of discrete categories, we also used latent profile analysis (LPA) to evaluate associations between multiple prenatal exposures and temperament phenotype.
Latent profile analysis
Latent profile analysis (LPA) is a probabilistic, model-based variant of traditional nonhierarchical cluster analysis . We used it to objectively classify children into discrete data-driven temperament profiles. LPA assumes that the population consists of a number of unobserved subgroups that are referred to as latent profiles. Individuals within a given latent profile will show similarities in their TTS subscales scores. For example, children in the same latent profile may demonstrate a high score on subscales for mood, activity and approach, low scores on rhythmicity and adaptability, and intermediate scores on the remaining subscales. Sharing a latent profile does not require consistent high or low scoring across all subscales. Rather, it identifies groups of subjects who have a similar performance pattern globally. Because the TTS assesses multiple behavioral domains that contribute to complex temperament phenotypes, we used LPA to reduce the temperament subscale data into discrete categories. We used Bayesian information criteria (BIC) whereby the smallest BIC value indicates the best fit as well as minimizes cross-classification probabilities. BIC has been shown to identify the appropriate number of profiles in finite mixture models  and penalizes the models for a number of parameters that may indicate model over-fit. LPA was implemented on the nine TTS subscales by using a normal mixture model as a model-based clustering technique, as fitted via an expectation–maximization algorithm in the mclust 4.3 R software package .
Multinomial logistic regression
Characteristics of the study cohort compared to the parent PROGRESS cohort and the general Mexican population
Mexican population 
Selected study cohort (n = 500)
PROGRESS families not in the selected cohort (n = 260)
Maternal age (years)
26.9 ± 5.5
27.3 ± 5.3
Maternal 2nd trimester blood Pb, (median (IQR), ug/dL)
Maternal postpartum tibia Pb (mean ± SD, ug/g bone mineral)
2.6 ± 8.6
2.7 ± 8.3
Maternal postpartum patella Pb (mean ± SD, ug/g bone mineral)
4.9 ± 8.9
4.3 ± 8.0
Maternal EPDS score, 2nd or 3rd trimester (mean ± SD)
8.3 ± 5.7
8.9 ± 6.0
More than high school
117 (23.4 %)
60 (23.1 %)
171 (34.2 %)
104 (40.0 %)
Less than high school
212 (42.4 %)
96 (36.9 %)
46 (9.2 %)
33 (12.7 %)
177 (35.4 %)
105 (40.4 %)
277 (55.4 %)
122 (46.9 %)
Associations Between Prenatal Exposures and TTS Subscales [β (p-value)] by Linear Regression Modeling
3. Blood lead
4. Blood lead x EPDS
5. Tibia lead
6. Tibia lead x EPDS
8. Mercury x EPDS
Neither maternal patella K-XRF, nor interaction models using patella lead measurement and adjusted prenatal depression risk were associated with TTS subscale scores. Similarly, interaction models between prenatal mercury level and any measure of prenatal lead exposure were not significantly associated with TTS subscale performance (results not shown).
Associations Between Prenatal Exposures and TTS Profile by Multinomial Logistic Regression Modeling
95 % CI
95 % CI
95 % CI
95 % CI
95 % CI
95 % CI
While associations between prenatal exposure to metals or maternal depression and cognitive development have been widely reported [12, 13, 20, 44–47], the role of such exposures in early life behavioral development is less well-understood. Effects seen in behavior early in life can help to parse the contribution of prenatal vs later life exposures, since exposures through the life-course are often correlated. Also, early life behavioral changes that result from environmental exposures may serve as intermediates for later life behavioral phenotypes, helping us to understand the complex interrelationships among exposure and behavioral development. Environmental health research focused on intelligence has generated a great appreciation for the impact of perinatal environmental exposures on ultimate IQ and intellectual achievement. However, learning and intellectual performance are complex processes that clearly interact with behavioral traits to produce psychological health. The importance of behavioral traits to overall child development is becoming increasingly apparent . Cognition and cognitive performance is dependent on many behavioral traits such as attention and impulsivity that integrate with intellectual processes such as memory and mathematical ability in everyday life. To better understand central nervous system toxicity, the role of toxins in altering behavioral development and cognitive traits should be considered equally important. Prenatal and childhood exposure to maternal depression [74–76], lead [17, 77–79], and mercury [18, 22, 80] have been associated with behavior problems from middle childhood through adolescence. Measurable early life behaviors, such as temperament, predict psychiatric traits later in life including externalizing and internalizing disorders in school age children and ADHD [81, 82]. If early life temperament is predictive of later life psychiatric traits, then our results suggest that cumulative lead exposure and maternal depression may set these trajectories as early as age two. If we are to develop effective treatments or prevention measures for behavioral disorders, we need to both better understand the role of exposure timing and develop methods for early detection of deficits so that developmental plasticity can be leveraged to mitigate the neurotoxic effects of chemical and non-chemical exposures. Evaluation of temperament may provide this intermediate outcome as both sensitive to environmental exposures and measurable at a point in development when effective interventions can be initiated to reduce long-term morbidity.
Our data demonstrate a relationship between cumulative prenatal lead exposure and the likelihood of demonstrating a difficult temperament. Additionally, those mothers in our cohort with highest scores on prenatal depression screening had toddlers most likely to demonstrate difficult temperament traits, even after adjusting for maternal depression at the time of temperament assessment. As shown in Fig. 3, the association of cumulative prenatal lead exposure with difficult temperament was most pronounced among toddlers whose mothers had the highest adjusted prenatal depression scores. This indicates that both prenatal lead exposure and exposure to prenatal maternal depression impact the developing temperament of the child. The inclusion in our models of the mother’s prenatal depression score adjusted for the 24-month post-partum depression risk scores allows us to differentiate an association between prenatal depression risk and temperament from the known association between concurrent maternal depression and maternal report of difficult temperament. Prenatal mercury exposure and SES did not modify the effect of prenatal depression on infant temperament in our analyses.
The impact of in utero exposure to maternal depression and/or environmental chemicals on temperament and the interplay of multiple co-exposures on the establishment of temperament have not been evaluated previously. Our data suggest that cumulative lead exposure rather than a single second trimester lead measurement best predicts the lead-temperament association and that the joint impact of lead and prenatal depression is most predictive of difficult temperament. Tibia bone lead level, which has a half-life of 12 years or more, reflects cumulative lead exposure over the mother’s life-time [46, 83]. Previous studies have demonstrated that bone lead is a better predictor of infant development than blood lead, perhaps due to its longer half-life [48, 84]. However, bone lead cannot distinguish whether there is a specific window of sensitivity for lead exposure. Understanding the role of exposure timing could allow us to develop early intervention strategies.
As the PROGRESS cohort ages, we are measuring other neurobehavioral domains, such as attention, impulsivity, spatial memory, motivation, time estimation and internalizing/externalizing behaviors to further assess the impact of exposure to metals and maternal depression on child behavioral development. We will also address the role of temperament as a predictor of these neurobehavioral phenotypes.
Our study has a number of strengths. As a large, prospective birth cohort study focused on perinatal environmental exposures, both social and chemical environmental factors were assessed prospectively and longitudinally multiple times through pregnancy and early childhood. The EPDS, the BSID and the TTS are validated research measures that were administered by trained study staff, all of whom had masters or doctoral degrees in child psychology. Our statistical approach using LPA reduced the dimensionality of the multiple outcome subscales into a single 3 level index that clearly identified distinct phenotypes similar to those described in prior studies of infant temperament. The relationship of these three phenotypes with BSID performance further allowed us to validate our LPA profiles. Collecting multiple measures of lead exposure allowed us to distinguish between effects of blood lead level at a specific time point as well as cumulative lead.
Our study also has some limitations. The study population is composed of families in urban Mexico, and results may not be fully generalizable to other populations in other settings. Lead exposure in our cohort is generally higher and SES lower than in the United States, but this allows us to test our hypotheses more cost-effectively. Maternal depression was estimated by the EPDS, which is a screening rather than a diagnostic tool, so some women who had positive screens may not have met diagnostic criteria for clinical depression. As is the case for most assessment tools of temperament in childhood, the TTS relies on subjective maternal report.
Prenatal exposure to maternal depression is associated with more difficult temperament traits at age two. This association is potentiated by concurrent prenatal exposure to environmental lead.
BIC, Bayesian information criteria; BSID, Bayley Scales of Infant and Toddler Development, 3rd edition; CI, confidence interval; EPDS, Edinburgh Postnatal Depression Scale; IQR, interquartile range; K-XRF, K-shell X-ray fluorescence; LPA, latent profile analysis; OR, odds ratio; SD, standard deviation; SES, socioeconomic status; TTS, Toddler Temperament Scale
Dr. Stroustrup is supported by grant K23ES022268 from the National Institutes of Environmental Health Sciences (NIEHS). Additional funding for the investigators and this project comes through NIEHS grants R01ES013744, R01ES014930, R01ES021357, P30ES023515, and P42ES016454. The investigators would also like to acknowledge el Centro Medico ABC and the National Institute of Perinatology (Mexico) for provision of medical facilities used in study subject recruitment and evaluation.
Dr. Stroustrup is supported by grant K23ES022268 from the National Institutes of Environmental Health Sciences (NIEHS). Additional funding for the investigators and this project comes through NIEHS grants R01ES013744, R01ES014930, R01ES021357, P30ES023515, and P42ES016454 and the National Institute of Public Health in Mexico.
Availability of data and supporting materials
The dataset and novel code supporting the conclusions of this article are available in the Open Science Framework repository osf.io/73qxe (https://osf.io/73qxe).
AS conceptualized and designed the study, carried out the initial analyses, drafted the initial manuscript, and approved the final manuscript as submitted. HHH conceptualized and designed the study, carried out the initial analyses, reviewed and revised the manuscript, and approved the final manuscript as submitted. KS carried out the initial analyses, reviewed and revised the manuscript, and approved the final manuscript as submitted. LS, AC, MSG, MTC, and MTR designed the data collection instruments, coordinated and supervised data collection, critically reviewed the manuscript, and approved the final manuscript as submitted. CA completed laboratory analyses, reviewed and revised the manuscript, and approved the final manuscript as submitted. DCB critically reviewed the manuscript and approved the final manuscript as submitted. BAC conceptualized and designed the statistical analyses, reviewed and revised the manuscript, and approved the final manuscript as submitted. ROW, RJW, and MTR conceptualized and designed the study, reviewed and revised the manuscript, and approved the final manuscript as submitted.
The authors declare that they have no competing interests.
Consent for publication
Ethics approval and consent to participate
Research ethics committees of the participating institutions approved the study (the Comité de Investigación, Comité de Bioseguridad, and the Comité de Ética en la Investigación of the National Institute of Public Health, Mexico, the Partners Human Research Committee at Brigham and Women’s Hospital, the Office of Human Research Administration at the Harvard School of Public Health, and the Program for the Protection of Human Subjects at the Icahn School of Medicine at Mount Sinai).
The authors have no financial relationships relevant to this article to disclose.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
- Bagner DM, Rodriguez GM, Blake CA, Linares D, Carter AS. Assessment of behavioral and emotional problems in infancy: a systematic review. Clin Child Fam Psychol Rev. 2012;15(2):113–28.View ArticleGoogle Scholar
- Fullard W, McDevitt SC, Carey WB. Assessing temperament in one- to three-year-old children. J Pediatr Psychol. 1984;9(2):205–17.View ArticleGoogle Scholar
- Papageorgiou KA, Ronald A. “He who sees things grow from the beginning will have the finest view of them” a systematic review of genetic studies on psychological traits in infancy. Neurosci Biobehav Rev. 2013;37(8):1500–17.View ArticleGoogle Scholar
- McInerny T, Chamberlin RW. Is it feasible to identify infants who are at risk for later behavioral problems? The Carey Temperament Questionnaire as a prognostic tool. Clin Pediatr (Phila). 1978;17(3):233–8.View ArticleGoogle Scholar
- Sayal K, Heron J, Maughan B, Rowe R, Ramchandani P. Infant temperament and childhood psychiatric disorder: longitudinal study. Child Care Health Dev. 2014;40(2):292–7.View ArticleGoogle Scholar
- Teerikangas OM, Aronen ET, Martin RP, Huttunen MO. Effects of infant temperament and early intervention on the psychiatric symptoms of adolescents. J Am Acad Child Adolesc Psychiatry. 1998;37(10):1070–6.View ArticleGoogle Scholar
- Karalunas SL, Fair D, Musser ED, Aykes K, Iyer SP, Nigg JT. Subtyping attentiondeficit/hyperactivity disorder using temperamentdimensions: toward biologically based nosologic criteria. JAMA Psychiatry. 2014;71(9):1015–24.View ArticleGoogle Scholar
- Anzman-Frasca S, Stifter CA, Birch LL. Temperament and childhood obesity risk: a review of the literature. J Dev Behav Pediatr. 2012;33(9):732–45.View ArticleGoogle Scholar
- Hardee JE, Benson BE, Bar-Haim Y, Mogg K, Bradley BP, Chen G, et al. Patterns of neural connectivity during an attention bias task moderate associations between early childhood temperament and internalizing symptoms in young adulthood. Biol Psychiatry. 2013;74(4):273–9.View ArticleGoogle Scholar
- Hartman C, Hopfer C, Corley R, Hewitt J, Stallings M. Using Cloninger’s temperament scales to predict substance-related behaviors in adolescents: a prospective longitudinal study. Am J Addict. 2013;22(3):246–51.View ArticleGoogle Scholar
- Lahat A, Perez-Edgar K, Degnan KA, Guyer AE, Lejuez CW, Ernst M, et al. Early childhood temperament predicts substance use in young adults. Transl Psychiatry. 2012;2:e157.View ArticleGoogle Scholar
- Slutske WS, Moffitt TE, Poulton R, Caspi A. Undercontrolled temperament at age 3 predicts disordered gambling at age 32: a longitudinal study of a complete birth cohort. Psychol Sci. 2012;23(5):510–6.View ArticleGoogle Scholar
- Smith AK, Rhee SH, Corley RP, Friedman NP, Hewitt JK, Robinson JL. The magnitude of genetic and environmental influences on parental and observational measures of behavioral inhibition and shyness in toddlerhood. Behav Genet. 2012;42(5):764–77.View ArticleGoogle Scholar
- Spungen LB, Farran AC. Effect of intensive care unit exposure on temperament in low birth weight preterm infants. J Dev Behav Pediatr. 1986;7(5):288–92.View ArticleGoogle Scholar
- Riese ML. Genetic influences on neonatal temperament. Acta Genet Med Gemellol (Roma). 1990;39(2):207–13.View ArticleGoogle Scholar
- Zhu P, Sun MS, Hao JH, Chen YJ, Jiang XM, Tao RX, et al. Does prenatal maternal stress impair cognitive development and alter temperament characteristics in toddlers with healthy birth outcomes? Dev Med Child Neurol. 2014;56(3):283–9.View ArticleGoogle Scholar
- Bellinger D, Leviton A, Allred E, Rabinowitz M. Pre- and postnatal lead exposure and behavior problems in school-aged children. Environ Res. 1994;66(1):12–30.View ArticleGoogle Scholar
- Boucher O, Jacobson SW, Plusquellec P, Dewailly E, Ayotte P, Forget-Dubois N, et al. Prenatal methylmercury, postnatal lead exposure, and evidence of attention deficit/hyperactivity disorder among Inuit children in Arctic Quebec. Environ Health Perspect. 2012;120(10):1456–61.View ArticleGoogle Scholar
- Hu H, Tellez-Rojo MM, Bellinger D, Smith D, Ettinger AS, Lamadrid-Figueroa H, et al. Fetal lead exposure at each stage of pregnancy as a predictor of infant mental development. Environ Health Perspect. 2006;114(11):1730–5.Google Scholar
- Lam HS, Kwok KM, Chan PH, So HK, Li AM, Ng PC, et al. Long term neurocognitive impact of low dose prenatal methylmercury exposure in Hong Kong. Environ Int. 2013;54:59–64.View ArticleGoogle Scholar
- Ronchetti R, van den Hazel P, Schoeters G, Hanke W, Rennezova Z, Barreto M, et al. Lead neurotoxicity in children: is prenatal exposure more important than postnatal exposure? Acta Paediatr Suppl. 2006;95(453):45–9.View ArticleGoogle Scholar
- Sagiv SK, Thurston SW, Bellinger DC, Amarasiriwardena C, Korrick SA. Prenatal exposure to mercury and fish consumption during pregnancy and attention-deficit/hyperactivity disorder-related behavior in children. Arch Pediatr Adolesc Med. 2012;166(12):1123–31.View ArticleGoogle Scholar
- Schnaas L, Rothenberg SJ, Flores MF, Martinez S, Hernandez C, Osorio E, et al. Reduced intellectual development in children with prenatal lead exposure. Environ Health Perspect. 2006;114(5):791–7.View ArticleGoogle Scholar
- Cowell WJ, Bellinger DC, Coull BA, Gennings C, Wright RO, Wright RJ. Associations between Prenatal Exposure to Black Carbon and Memory Domains in Urban Children: Modification by Sex and Prenatal Stress. PLoS One. 2015;10(11):e0142492.View ArticleGoogle Scholar
- Barker ED, Kirkham N, Ng J, Jensen SK. Prenatal maternal depression symptoms and nutrition, and child cognitive function. Br J Psychiatry. 2013;203(6):417–21.View ArticleGoogle Scholar
- Dulawa SC. Epigenetic programing of depression during gestation. Bioessays. 2014;36(4):353–8.View ArticleGoogle Scholar
- Musaelyan K, Egeland M, Fernandes C, Pariante CM, Zunszain PA, Thuret S. Modulation of adult hippocampal neurogenesis by early-life environmental challenges triggering immune activation. Neural Plast. 2014;2014:194396.Google Scholar
- Wright RJ. Moving towards making social toxins mainstream in children’s environmental health. Curr Opin Pediatr. 2009;21(2):222–9.View ArticleGoogle Scholar
- Wright RJ. Psychological stress: a social pollutant that may enhance environmental risk. Am J Respir Crit Care Med. 2011;184(7):752–4.View ArticleGoogle Scholar
- Wright RJ, Fisher K, Chiu YH, Wright RO, Fein R, Cohen S, et al. Disrupted prenatal maternal cortisol, maternal obesity, and childhood wheeze. Insights into prenatal programming. Am J Respir Crit Care Med. 2013;187(11):1186–93.View ArticleGoogle Scholar
- Deave T, Heron J, Evans J, Emond A. The impact of maternal depression in pregnancy on early child development. BJOG. 2008;115(8):1043–51.View ArticleGoogle Scholar
- Field T. Prenatal depression effects on early development: a review. Infant Behav Dev. 2011;34(1):1–14.View ArticleGoogle Scholar
- Clougherty JE, Kubzansky LD. A framework for examining social stress and susceptibility to air pollution in respiratory health. Cien Saude Colet. 2010;15(4):2059–74.View ArticleGoogle Scholar
- Clougherty JE, Levy JI, Kubzansky LD, Ryan PB, Suglia SF, Canner MJ, et al. Synergistic effects of traffic-related air pollution and exposure to violence on urban asthma etiology. Environ Health Perspect. 2007;115(8):1140–6.View ArticleGoogle Scholar
- Farley KJ, Meyer JS. Metal mixture modeling evaluation project: 3. Lessons learned and steps forward. Environ Toxicol Chem. 2015;34(4):821–32.View ArticleGoogle Scholar
- Farley KJ, Meyer JS, Balistrieri LS, De Schamphelaere KA, Iwasaki Y, Janssen CR, et al. Metal Mixture Modeling Evaluation project: 2. Comparison of four modeling approaches. Environ Toxicol Chem. 2015;34(4):741–53.View ArticleGoogle Scholar
- Gallagher SS, Rice GE, Scarano LJ, Teuschler LK, Bollweg G, Martin L. Cumulative risk assessment lessons learned: A review of case studies and issue papers. Chemosphere. 2015;120C:697–705.View ArticleGoogle Scholar
- Hicken MT, Adar SD, Diez Roux AV, O’Neill MS, Magzamen S, Auchincloss AH, et al. Do psychosocial stress and social disadvantage modify the association between air pollution and blood pressure?: the multi-ethnic study of atherosclerosis. Am J Epidemiol. 2013;178(10):1550–62.View ArticleGoogle Scholar
- Meyer JS, Farley KJ, Garman ER. Metal mixtures modeling evaluation project: 1. Background. Environ Toxicol Chem. 2015;34(4):726–40.View ArticleGoogle Scholar
- Peters JL, Kubzansky L, McNeely E, Schwartz J, Spiro 3rd A, Sparrow D, et al. Stress as a potential modifier of the impact of lead levels on blood pressure: the normative aging study. Environ Health Perspect. 2007;115(8):1154–9.View ArticleGoogle Scholar
- Shmool JL, Kubzansky LD, Newman OD, Spengler J, Shepard P, Clougherty JE. Social stressors and air pollution across New York City communities: a spatial approach for assessing correlations among multiple exposures. Environ Health. 2014;13:91.View ArticleGoogle Scholar
- Zota AR, Shenassa ED, Morello-Frosch R. Allostatic load amplifies the effect of blood lead levels on elevated blood pressure among middle-aged U.S. adults: a cross-sectional study. Environ Health. 2013;12(1):64.View ArticleGoogle Scholar
- Burris HH, Braun JM, Byun HM, Tarantini L, Mercado A, Wright RJ, et al. Association between birth weight and DNA methylation of IGF2, glucocorticoid receptor and repetitive elements LINE-1 and Alu. Epigenomics. 2013;5(3):271–81.View ArticleGoogle Scholar
- Carrasco AV. The AMAI system of classifying households by socio-economic level: ESOMAR; 2002. (www.esomar.org)
- Chuang HY, Schwartz J, Gonzales-Cossio T, Lugo MC, Palazuelos E, Aro A, et al. Interrelations of lead levels in bone, venous blood, and umbilical cord blood with exogenous lead exposure through maternal plasma lead in peripartum women. Environ Health Perspect. 2001;109(5):527–32.View ArticleGoogle Scholar
- Hu H, Rabinowitz M, Smith D. Bone lead as a biological marker in epidemiologic studies of chronic toxicity: conceptual paradigms. Environ Health Perspect. 1998;106(1):1–8.View ArticleGoogle Scholar
- Hernandez-Avila M, Peterson KE, Gonzalez-Cossio T, Sanin LH, Aro A, Schnaas L, et al. Effect of maternal bone lead on length and head circumference of newborns and 1-month-old infants. Arch Environ Health. 2002;57(5):482–8.View ArticleGoogle Scholar
- Hu H. Bone lead as a new biologic marker of lead dose: recent findings and implications for public health. Environ Health Perspect. 1998;106 Suppl 4:961–7.View ArticleGoogle Scholar
- Tellez-Rojo MM, Hernandez-Avila M, Lamadrid-Figueroa H, Smith D, Hernandez-Cadena L, Mercado A, et al. Impact of bone lead and bone resorption on plasma and whole blood lead levels during pregnancy. Am J Epidemiol. 2004;160(7):668–78.View ArticleGoogle Scholar
- Mordukhovich I, Wright RO, Hu H, Amarasiriwardena C, Baccarelli A, Litonjua A, et al. Associations of toenail arsenic, cadmium, mercury, manganese, and lead with blood pressure in the normative aging study. Environ Health Perspect. 2012;120(1):98–104.View ArticleGoogle Scholar
- Bayley N. Bayley Scales of Infant and Toddler Development. San Antonio: The Psychological Corporation; 2006.Google Scholar
- Chess S, Thomas A, Rutter M, Birch HG. Interaction of temperament and environment in the production of behavioral disturbances in children. Am J Psychiatry. 1963;120:142–8.View ArticleGoogle Scholar
- Carey WB, McDevitt SC. Revision of the Infant Temperament Questionnaire. Pediatrics. 1978;61(5):735–9.Google Scholar
- Carey WB. A simplified method for measuring infant temperament. J Pediatr. 1970;77(2):188–94.View ArticleGoogle Scholar
- Cox JL, Holden JM, Sagovsky R. Detection of postnatal depression. Development of the 10-item Edinburgh Postnatal Depression Scale. Br J Psychiatry. 1987;150:782–6.View ArticleGoogle Scholar
- Cox JL, Chapman G, Murray D, Jones P. Validation of the Edinburgh Postnatal Depression Scale (EPDS) in non-postnatal women. J Affect Disord. 1996;39(3):185–9.View ArticleGoogle Scholar
- Murray D, Cox JL. Screening for depression during pregnancy with the Edinburgh Postnatal Depression Scale (EPDS). J Reprod Infant Psychol. 1990;8:99–106.View ArticleGoogle Scholar
- Murray L, Carothers AD. The validation of the Edinburgh Post-natal Depression Scale on a community sample. Br J Psychiatry. 1990;157:288–90.View ArticleGoogle Scholar
- Boyce P, Stubbs J, Todd A. The Edinburgh Postnatal Depression Scale: validation for an Australian sample. Aust N Z J Psychiatry. 1993;27(3):472–6.View ArticleGoogle Scholar
- Hanington L, Ramchandani P, Stein A. Parental depression and child temperament: assessing child to parent effects in a longitudinal population study. Infant Behav Dev. 2010;33(1):88–95.View ArticleGoogle Scholar
- Kerstis B, Engstrom G, Edlund B, Aarts C. Association between mothers’ and fathers’ depressive symptoms, sense of coherence and perception of their child’s temperament in early parenthood in Sweden. Scand J Public Health. 2013;41(3):233–9.View ArticleGoogle Scholar
- Di Florio A, Forty L, Gordon-Smith K, Heron J, Jones L, Craddock N, et al. Perinatal episodes across the mood disorder spectrum. JAMA Psychiatry. 2013;70(2):168–75.View ArticleGoogle Scholar
- Serati M, Redaelli M, Buoli M, Altamura AC. Perinatal Major Depression Biomarkers: A systematic review. J Affect Disord. 2016;193:391–404.View ArticleGoogle Scholar
- Fitzmaurice GM, Laird LM, Ware JH. Applied Longitudinal Analysis. 2nd ed. New York: Wiley; 2011.Google Scholar
- Vermunt J, Magidson J. Latent class cluster analysis. In: Hagenaars J, McCutcheon A, editors. Applied Latent Class ANalysis. Cambridge: Cambridge University Press; 2002. p. 89–106.View ArticleGoogle Scholar
- D’Unger A, Land K, McCall P, Nagin D. How mandy latent classes of delinquent/criminal careers? Results from mixed Poisson regression analyses of the London, Philadelphia, and Racine Cohort Studies. Am J Sociol. 1998;103(6):1593–630.View ArticleGoogle Scholar
- Wien) IfSaMoWW. Normal Mixture Modeling fitted via EM algorithm for Model-Based Clustering, Classification, and Density Estimation, including Bayesian regularization. The Comprehensive R Archive Network. http://cran.r-project.org/web/packages/mclust/index.html. Published 2014. Accessed 25 April 2014, 2014.
- Laake LM, Bridgett DJ. Happy babies, chatty toddlers: infant positive affect facilitates early expressive, but not receptive language. Infant Behav Dev. 2014;37(1):29–32.View ArticleGoogle Scholar
- Liu J, Bann C, Lester B, Tronick E, Das A, Lagasse L, et al. Neonatal neurobehavior predicts medical and behavioral outcome. Pediatrics. 2010;125(1):e90–8.View ArticleGoogle Scholar
- Sajaniemi N, Hakamies-blomqvist L, Mäkelä J, Avellan A, Rita H, von Wendt L. Cognitive Development, Temperament and Behavior at 2 Years as Indicative of Language Development at 4 Years in Pre-Term Infants. Child Psychiatry Hum Dev. 2001;31(4):329–46.View ArticleGoogle Scholar
- Team RDC. R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2014.Google Scholar
- Garello V, Viterbori P, Usai MC. Temperamental profiles and language development: a replication and an extension. Infant Behav Dev. 2012;35(1):71–82.View ArticleGoogle Scholar
- Bellinger DC. Future directions for neurobehavioral studies of environmental neurotoxicants. Neurotoxicology. 2001;22(5):645–56.View ArticleGoogle Scholar
- Betts KS, Williams GM, Najman JM, Alati R. Maternal depressive, anxious, and stress symptoms during pregnancy predict internalizing problems in adolescence. Depress Anxiety. 2014;31(1):9–18.View ArticleGoogle Scholar
- Dorrington S, Zammit S, Asher L, Evans J, Heron J, Lewis G. Perinatal maternal life events and psychotic experiences in children at twelve years in a birth cohort study. Schizophr Res. 2014;152(1):158–63.View ArticleGoogle Scholar
- Glasheen C, Richardson GA, Kim KH, Larkby CA, Swartz HA, Day NL. Exposure to maternal pre- and postnatal depression and anxiety symptoms: risk for major depression, anxiety disorders, and conduct disorder in adolescent offspring. Dev Psychopathol. 2013;25(4 Pt 1):1045–63.View ArticleGoogle Scholar
- Burns JM, Baghurst PA, Sawyer MG, McMichael AJ, Tong SL. Lifetime low-level exposure to environmental lead and children’s emotional and behavioral development at ages 11–13 years. The Port Pirie Cohort Study. Am J Epidemiol. 1999;149(8):740–9.View ArticleGoogle Scholar
- Dietrich KN, Ris MD, Succop PA, Berger OG, Bornschein RL. Early exposure to lead and juvenile delinquency. Neurotoxicol Teratol. 2001;23(6):511–8.View ArticleGoogle Scholar
- Kordas K, Stoltzfus RJ, Lopez P, Rico JA, Rosado JL. Iron and zinc supplementation does not improve parent or teacher ratings of behavior in first grade Mexican children exposed to lead. J Pediatr. 2005;147(5):632–9.View ArticleGoogle Scholar
- Grandjean P, Weihe P, Nielsen F, Heinzow B, Debes F, Budtz-Jorgensen E. Neurobehavioral deficits at age 7 years associated with prenatal exposure to toxicants from maternal seafood diet. Neurotoxicol Teratol. 2012;34(4):466–72.View ArticleGoogle Scholar
- Bohlin G, Hagekull B. Socio-emotional development: from infancy to young adulthood. Scand J Psychol. 2009;50(6):592–601.View ArticleGoogle Scholar
- Nigg JT, Goldsmith HH, Sachek J. Temperament and attention deficit hyperactivity disorder: the development of a multiple pathway model. J Clin Child Adolesc Psychol. 2004;33(1):42–53.View ArticleGoogle Scholar
- Garrido Latorre F, Hernandez-Avila M, Tamayo Orozco J, Albores Medina CA, Aro A, Palazuelos E, et al. Relationship of blood and bone lead to menopause and bone mineral density among middle-age women in Mexico City. Environ Health Perspect. 2003;111(4):631–6.View ArticleGoogle Scholar
- Silbergeld EK. Lead in bone: implications for toxicology during pregnancy and lactation. Environ Health Perspect. 1991;91:63–70.View ArticleGoogle Scholar