Skip to main content

Assessing dose–response relationships for endocrine disrupting chemicals (EDCs): a focus on non-monotonicity


The fundamental principle in regulatory toxicology is that all chemicals are toxic and that the severity of effect is proportional to the exposure level. An ancillary assumption is that there are no effects at exposures below the lowest observed adverse effect level (LOAEL), either because no effects exist or because they are not statistically resolvable, implying that they would not be adverse. Chemicals that interfere with hormones violate these principles in two important ways: dose–response relationships can be non-monotonic, which have been reported in hundreds of studies of endocrine disrupting chemicals (EDCs); and effects are often observed below the LOAEL, including all environmental epidemiological studies examining EDCs. In recognition of the importance of this issue, Lagarde et al. have published the first proposal to qualitatively assess non-monotonic dose response (NMDR) relationships for use in risk assessments. Their proposal represents a significant step forward in the evaluation of complex datasets for use in risk assessments. Here, we comment on three elements of the Lagarde proposal that we feel need to be assessed more critically and present our arguments: 1) the use of Klimisch scores to evaluate study quality, 2) the concept of evaluating study quality without topical experts’ knowledge and opinions, and 3) the requirement of establishing the biological plausibility of an NMDR before consideration for use in risk assessment. We present evidence-based logical arguments that 1) the use of the Klimisch score should be abandoned for assessing study quality; 2) evaluating study quality requires experts in the specific field; and 3) an understanding of mechanisms should not be required to accept observable, statistically valid phenomena. It is our hope to contribute to the important and ongoing debate about the impact of NMDRs on risk assessment with positive suggestions.

Peer Review reports


Paracelsus, considered the father of modern toxicology, stated, “All things are poison and nothing (is) without poison. Solely the dose determines that a thing is not a poison” [1]. This central dogma in toxicology is often re-stated as “the dose makes the poison”, which is not exactly the same, and has been taken to mean that the adverse effect of a toxin is proportional to the dose. The further assumption of a monotonic, if not linear, relationship between dose and effect is used as the foundation for modern risk assessments, where the effects of high doses are used to predict effects – and lack of effects – at lower doses.

In contrast, a group of independent scientists published in 2012 the first comprehensive review of the endocrine disrupting chemical (EDC) literature that revealed a large number of non-monotonic dose responses (NMDRs) in biochemical, animal and human studies [2]. The large number of NMDRs assessed led several groups to conclude that these dose responses are common for both hormones and EDCs [3-6]. Although non-monotonicity has received significant attention in the last few years, these phenomena are not new and their importance to risk assessment has been considered previously [7].

The 2012 literature review also spawned an intense debate about the reality of NMDRs and their importance for risk assessments (e.g., [8-11]). Some authors argued that because NMDRs are common for hormones, and for drugs that interact with hormone receptors, it is reasonable to predict that environmental chemicals that interact with hormone system would also exhibit NMDRs [2-4,6,12,13]. However, others argued that the data were insufficient to conclude that NMDRs are real or important (e.g., [10]). In general, this kind of debate is healthy and can provide the driving force for new science and new analyses. However, debate surrounding a controversy often paralyzes the risk assessment process. Therefore, a proposal to assess NMDRs using systematic criteria is important to bring this debate within the risk assessment domain.

A new systematic approach to assess NMDRs

Considering the scientific climate and desire to develop approaches for the assessment of NMDRs, Lagarde et al. (2015) [14] published the first formal strategy for considering the use of datasets with NMDRs for inclusion in risk assessment. They propose a five step decision tree for the evaluation of NMDRs for their use in risk assessments: 1) The assessment of study quality; 2) determination of number of doses; 3) characterization of data for specific statistical analyses; 4) statistical analysis using defined criteria; and 5) assessment of biological plausibility.

The contribution made by Lagarde and colleagues is a significant advancement for the field of risk assessment, which was built on the expectation of monotonic dose responses. In this way, the Lagarde decision tree provides the first contribution by which NMDRs could be assessed and then used to identify ‘safe’ levels of chemical exposures.

However, from the perspective of basic science, we would like to address three elements of this decision tree: 1) the use of Klimisch scores to evaluate study quality, 2) the concept of evaluating study quality without topical experts’ opinions, and 3) the requirement of establishing the biological plausibility of an NMDR before consideration for use in risk assessment.

Klimisch scores

The first step in the Lagarde decision tree characterizes the quality of the study under consideration. The assessment of study quality is a standard step in the risk assessment process. In the study of EDCs, endocrinologists and environmental health scientists have proposed a series of criteria that should be met to consider a study “high quality” including the use of appropriate negative and positive controls, the use of sensitive animal species and strains, and the use of appropriate endpoints [3,15-18]. All of these criteria specifically focus on aspects of study design and are derived from an understanding of endocrine systems and their role in development and physiological control. In contrast, Klimisch et al. [19] propose a system for evaluating the quality of a scientific study based on its adherence to test guidelines and study reporting criteria including the employment of Good Laboratory Practices (GLP). Using the Klimisch scoring system, studies given the highest ranking (“Reliable without Restriction”) are those “…studies or data from the literature or reports [presumably not published in the peer review literature] which were carried out or generated according to generally valid and/or internationally accepted testing guidelines (preferably performed according to GLP) or in which the test parameters documented are based on a specific (national) testing guideline (preferably performed according to GLP) or in which all parameters described are closely related/comparable to a guideline method.” [19]. Importantly, as noted elsewhere, GLP criteria are typically only followed by industry-funded or government laboratories as these high-cost, personnel-intensive standards were developed in response to several examples of fraud committed in industry labs [20-22]; thus, the Klimisch score is an industry-developed method which typically gives the highest quality rankings to industry-funded studies [23].

Unfortunately, the Klimisch scoring system confounds quality in study design and execution (which are directly related to quality in the resulting data) with quality in recordkeeping and study reporting. For example, GLP compliant studies do not prevent test substance contamination of the untreated control group [24], or guarantee that the positive control group has responded as expected [17], or that the tissues being studied have been dissected appropriately [21]. Other groups have similarly noted that the conflation of quality of reporting and quality of data is problematic [25].

There are also significant weaknesses in guideline studies as they relate to EDCs – whether or not they are performed according to GLP [4,20]. For example, most guideline studies only examine three treatment doses, which is not sufficient to make a conclusive judgment about the shape of the dose response curve. Similarly, guideline studies can be performed on animal species and strains that are insensitive to hormones, and thus are not appropriately responsive to EDCs at low doses [26]. Moreover, the endpoints assessed in traditional guideline studies do not address the most important chronic diseases in human populations today (e.g., [17]) and therefore will limit the utility of the overall risk assessment process. Unfortunately, the use of Klimisch scores will restrict the endpoints considered “adverse” to those endpoints captured by traditional guideline studies. Thus, while a focus on study quality is a positive aspect of the Lagarde proposal, the reliance on Klimisch scores is a major weakness.

Use of topical experts

Klimisch scores are more of a bureaucratic strategy than a scientific one, and provide a rationale allowing for non-experts to evaluate study quality with confidence, even when they do not understand the underlying biology of the study at hand. The engagement of topical experts would clearly produce difficult challenges, in part because the examples of NMDRs in EDC studies occur at many levels of investigation (e.g., in vitro, animal study, human study), on many different hormone systems (of which there are 10 or so that are evaluated as targets of chemical actions), and at multiple life cycle stages. The complexity of these issues should not be underestimated. As an example from our experience, thyroid hormone has very specific effects during brain development (i.e. processes that occur in utero and the early postnatal period). In rodent studies of brain development, thyroid hormone regulates the expression of different genes through different receptors, in a temporally and spatially specific manner. Studies in genetic strains of mice have revealed which isoform of thyroid hormone receptor is responsible for certain features of thyroid hormone action on brain development [27]. Likewise, painstaking studies over development demonstrate that a single gene (e.g., RC3) is regulated by thyroid hormone in some – but not all – regions of the brain, and at some – but not all – times during development [28].

The complexity of the thyroid system and methods for studying it led to the development of an 81-page document by the American Thyroid Association [29] to guide investigators in this domain and improve the overall quality of research in this area. This complexity obviously extends to other hormones, physiological processes and organisms, including humans. Therefore, to evaluate the quality of a study designed to inform us about the ability of a manufactured chemical to interfere with hormone action, experts in the hormone system and physiological events under study must be recruited to contribute to this essential exercise. The Lagarde et al. method [14] does not specifically address the importance of specialists in the endpoint of interest when risk assessments are being conducted, but their use of the Klimisch score should again be reconsidered for this reason. It is also important to recognize that the strategy of Klimisch et al. is to improve the overall quality of the science being considered in a regulatory decision by excluding studies about which there is some question. We propose that an alternate strategy would improve risk assessment in general: to identify the strength of each study – as well as their limitations – and determine the role of that information in hazard identification and characterization. This will require specialists.

Biological plausibility of NMDRs

The Lagarde et al. proposal first includes a rigorous evaluation of the statistical validity of the NMDR under study. This strategy will eliminate simple outliers in datasets, or when the dataset does not include enough dose levels to reasonably determine the shape (monotonicity versus non-monotonicity) of the dose–response relationship. This is an important issue because datasets can be quite complex and even guideline studies can be filled with random fluctuations. However, the second phase focuses on evaluating the biological plausibility of the dose response relationship. That is, what is the mechanism that produces this dose–response curve? There are two weaknesses with this concept. First, understanding mechanisms that link specific chemical exposures to specific outcomes is highly complex and time consuming, even though several general mechanisms by which NMDRs can be produced are known (e.g. [16,30-32]). In many cases, understanding the mechanism underlying a dose–response shape could take years, or decades, after the discovery of a biological phenomenon. For example, the mechanism (s) by which polychlorinated biphenyls (PCBs) produce neurotoxicity can still be debated nearly 40 years after their production was banned, whereas the phenomenon itself (neurotoxicity) is widely acknowledged [33,34]. Moreover, non-specialists will make the judgment regarding biological plausibility of a dose response, providing an enormous opening for variability in the application of this decision tree, and one potentially driven by agendas. Second, the fact that this mechanistic determination is being required of a chemical exhibiting an NMDR with some health outcome is in contrast to chemicals that produce a monotonic dose–response. Monotonic dose response phenomena are accepted as the default in risk assessments, even when the mechanism is not understood. Thus, there is an inherent asymmetry in the analysis, which reveals a fundamental bias in the approach. In this way, the Lagarde decision tree creates a situation where it is possible for a statistically valid NMDR concerning important adverse effects to be ignored if a risk assessor “feels” that the biological mechanism for the observed non-monotonicity is not sufficiently well understood. These issues should be addressed before it is used in the risk assessment process. Specifically, mechanisms should not be required to accept biological observations or phenomena in the risk assessment process, and non-monotonic and monotonic dose responses should be treated equally in these assessments.


The “risk-based approach” to chemical safety is balanced on the principle that all chemicals are toxic, that ‘the dose makes the poison’, and that there are no adverse effects below the calculated “safe” level. If, and only if, these principles are true, the human population can be safely exposed to hundreds of toxic chemicals simultaneously as long as the exposure to each one is below the level calculated with these assumptions. The risk assessment process in general has been challenged for EDCs, and one part of this challenge is the inability of this risk-based approach to adapt to NMDRs, which are common for this class of chemicals. Recently, several academic and government groups have developed methods to improve the processes of systematic review [25,35,36]. The Lagarde decision tree provides methods by which NMDRs can be assessed and included in a risk assessment. This is important because dose response data are combined with hazard assessment and exposure data in the risk characterization process; if a non-monotonic relationship is apparent between chemical dose and an adverse outcome, extrapolation from high doses that are ‘toxic’ to lower doses, presumed to be safe, should not be done [2,3]. We have reviewed three areas in which the Lagarde decision tree should be improved. With these relatively minor, but very important amendments, this decision tree could offer vast progress for the risk assessment community.



Endocrine disrupting chemicals


Environmental protection agency


Good laboratory practice


Lowest observed adverse effect level


Polychlorinated biphenyls


  1. Waddell WJ. History of dose response. J Toxicol Sci. 2010;35(1):1–8.

    Article  CAS  Google Scholar 

  2. Vandenberg LN, Colborn T, Hayes TB, Heindel JJ, Jacobs Jr DR, Lee DH, et al. Hormones and endocrine-disrupting chemicals: low-dose effects and nonmonotonic dose responses. Endocr Rev. 2012;33(3):378–455.

    Article  CAS  Google Scholar 

  3. Vandenberg LN, Colborn T, Hayes TB, Heindel JJ, Jacobs DR, Lee DH, et al. Regulatory decisions on endocrine disrupting chemicals should be based on the principles of endocrinology. Reprod Toxicol. 2013;38C:1–15.

    Article  Google Scholar 

  4. Zoeller RT, Brown TR, Doan LL, Gore AC, Skakkebaek NE, Soto AM, et al. Endocrine-disrupting chemicals and public health protection: a statement of principles from the endocrine society. Endocrinology. 2012;153(9):4097–110.

    Article  CAS  Google Scholar 

  5. Birnbaum LS. Environmental chemicals: evaluating low-dose effects. Environ Health Perspect. 2012;120(4):A143–4.

    Article  Google Scholar 

  6. Bergman A, Heindel JJ, Jobling S, Kidd KA, Zoeller RT, editors. State of the Science of Endocrine Disrupting Chemicals 2012. Geneva, Switzerland: World Health Organization; 2013.

    Google Scholar 

  7. Melnick R, Lucier G, Wolfe M, Hall R, Stancel G, Prins G, et al. Summary of the National Toxicology Program’s report of the endocrine disruptors low-dose peer review. Environ Health Perspect. 2002;110(4):427–31.

    Article  CAS  Google Scholar 

  8. Zoeller RT, Bergman A, Becher G, Bjerregaard P, Bornman R, Brandt I, et al. A path forward in the debate over health impacts of endocrine disrupting chemicals. Environ Health. 2015;14(1):118.

    Article  Google Scholar 

  9. Vandenberg LN, Colborn T, Hayes TB, Heindel JJ, Jacobs Jr DR, Lee DH, et al. Regulatory decisions on endocrine disrupting chemicals should be based on the principles of endocrinology. Reprod Toxicol. 2013;38:1–15.

    Article  CAS  Google Scholar 

  10. Rhomberg LR, Goodman JE. Low-dose effects and nonmonotonic dose-responses of endocrine disrupting chemicals: has the case been made? Regul Toxicol Pharmacol. 2012;64(1):130–3.

    Article  CAS  Google Scholar 

  11. Munn S, Heindel J. Assessing the risk of exposures to endocrine disrupting chemicals. Chemosphere. 2013;93(6):845–6.

    Article  CAS  Google Scholar 

  12. Gore AC, Heindel JJ, Zoeller RT. Endocrine disruption for endocrinologists (and others). Endocrinology. 2006;147 Suppl 6:S1–3.

    Article  CAS  Google Scholar 

  13. Beausoleil C, Ormsby JN, Gies A, Hass U, Heindel JJ, Holmer ML, et al. Low dose effects and non-monotonic dose responses for endocrine active chemicals: science to practice workshop: workshop summary. Chemosphere. 2013;93(6):847–56.

    Article  CAS  Google Scholar 

  14. Lagarde F, Beausoleil C, Belcher SM, Belzunces LP, Emond C, Guerbet M, et al. Non-monotonic dose–response relationships and endocrine disruptors: a qualitative method of assessment. Environ Health. 2015. In press.

  15. Welshons WV, Nagel SC, vom Saal FS. Large effects from small exposures. III. Endocrine mechanisms mediating effects of bisphenol A at levels of human exposure. Endocrinology. 2006;147:S56–69.

    Article  CAS  Google Scholar 

  16. Welshons WV, Thayer KA, Judy BM, Taylor JA, Curran EM, vom Saal FS. Large effects from small exposures: I. Mechanisms for endocrine-disrupting chemicals with estrogenic activity. Environ Health Perspect. 2003;111:994–1006.

    Article  CAS  Google Scholar 

  17. vom Saal FS, Akingbemi BT, Belcher SM, Crain DA, Crews D, Guidice LC, et al. Flawed experimental design reveals the need for guidelines requiring appropriate positive controls in endocrine disruption research. Toxicol Sci. 2010;115(2):612–3. author reply 614–620.

    Article  CAS  Google Scholar 

  18. Myers JP, Zoeller RT, vom Saal FS. A clash of old and new scientific concepts in toxicity, with important implications for public health. Environ Health Perspect. 2009;117(11):1652–5.

    Article  Google Scholar 

  19. Klimisch HJ, Andreae M, Tillmann U. A systematic approach for evaluating the quality of experimental toxicological and ecotoxicological data. Regul Toxicol Pharmacol. 1997;25(1):1–5.

    Article  CAS  Google Scholar 

  20. Myers JP, vom Saal FS, Akingbemi BT, Arizono K, Belcher S, Colborn T, et al. Why public health agencies cannot depend upon ‘Good Laboratory Practices’ as a criterion for selecting data: the case of bisphenol-A. Environ Health Perspect. 2009;117(3):309–15.

    Article  CAS  Google Scholar 

  21. vom Saal FS, Myers JP. Good laboratory practices are not synonymous with good scientific practices, accurate reporting, or valid data. Environ Health Perspect. 2010;118(2):A60.

    Article  Google Scholar 

  22. Agrawal DK, Arevalo M, Bhalla S, Chai Chivatsi D, Gamaniel KS, Kulshrestha S, et al. Handbook: good laboratory practice (GLP): quality practices for regulated non-chemical research and development. In: Kioy D, Long D, Bhalla S, Seiler J, editors. World Health Organization library, cataloguing-in-publication data. 2nd ed. Switzerland: UNDP/World Bank/WHO Special Programme for Research and Training in Tropical Diseases; 2009.

    Google Scholar 

  23. Zoeller RT, Bergman A, Becher G, Bjerregaard P, Bornman R, Brandt I, et al. A path forward in the debate over health impacts of endocrine disrupting chemicals. Environ Health. 2014;13(1):118.

    Article  Google Scholar 

  24. Hunt PA, Vandevoort CA, Woodruff T, Gerona R. Invalid controls undermine conclusions of FDA studies. Toxicol Sci. 2014. [Epub ahead of print].

  25. Beronius A, Molander L, Ruden C, Hanberg A. Facilitating the use of non-standard in vivo studies in health risk assessment of chemicals: a proposal to improve evaluation criteria and reporting. J Appl Toxicol. 2014;34(6):607–17.

    Article  CAS  Google Scholar 

  26. vom Saal FS, Hughes C. An extensive new literature concerning low-dose effects of bisphenol A shows the need for a new risk assessment. Environ Health Perspect. 2005;113:926–33.

    Article  CAS  Google Scholar 

  27. Fauquier T, Chatonnet F, Picou F, Richard S, Fossat N, Aguilera N, et al. Purkinje cells and Bergmann glia are primary targets of the TRalpha1 thyroid hormone receptor during mouse cerebellum postnatal development. Development. 2014;141(1):166–75.

    Article  CAS  Google Scholar 

  28. Iniguez MA, De Lecea L, Guadano-Ferraz A, Morte B, Gerendasy D, Sutcliffe JG, et al. Cell-specific effects of thyroid hormone on RC3/neurogranin expression in rat brain. Endocrinology. 1996;137(3):1032–41.

    CAS  Google Scholar 

  29. Bianco AC, Anderson G, Forrest D, Galton VA, Gereben B, Kim BW, et al. American thyroid association guide to investigating thyroid hormone economy and action in rodent and cell models. Thyroid. 2014;24(1):88–168.

    Article  Google Scholar 

  30. Soto AM, Sonnenschein C. The two faces of Janus: sex steroids as mediators of both cell proliferation and cell death. J Nat Cancer Inst. 2001;93:1673–5.

    Article  CAS  Google Scholar 

  31. Jeyakumar M, Webb P, Baxter JD, Scanlan TS, Katzenellenbogen JA. Quantification of ligand-regulated nuclear receptor corepressor and coactivator binding, key interactions determining ligand potency and efficacy for the thyroid hormone receptor. Biochemistry. 2008;47(28):7465–76.

    Article  CAS  Google Scholar 

  32. Ismail A, Nawaz Z. Nuclear hormone receptor degradation and gene transcription: an update. IUBMB Life. 2005;57(7):483–90.

    Article  CAS  Google Scholar 

  33. Giera S, Zoeller RT. Effects and predicted consequences of persistent and bioactive organic pollutants on thyroid function. Effects of Persistent and Bioactive Organic Pollutants on Human Health. 2013:203–236.

  34. Giera S, Bansal R, Ortiz-Toro TM, Taub DG, Zoeller RT. Individual Polychlorinated Biphenyl (PCB) congeners produce tissue- and gene-specific effects on thyroid hormone signaling during development. Endocrinology. 2011;152(7):2909–19.

    Article  CAS  Google Scholar 

  35. Krauth D, Woodruff TJ, Bero L. Instruments for assessing risk of bias and other methodological criteria of published animal studies: a systematic review. Environ Health Perspect. 2013;121(9):985–92.

    Google Scholar 

  36. Rooney AA, Boyles AL, Wolfe MS, Bucher JR, Thayer KA. Systematic review and evidence integration for literature-based environmental health science assessments. Environ Health Perspect. 2014. Epub ahead of print.

Download references


The authors gratefully acknowledge funding from the National Institutes of Environmental Health Science (rtz) and the University of Massachusetts – Amherst (lnv). We also thank critical and helpful comments by two reviewers, Drs. Andreas Kortenkamp and Glinda Cooper, and helpful discussions with colleagues.

Author information

Authors and Affiliations


Corresponding authors

Correspondence to R Thomas Zoeller or Laura N Vandenberg.

Additional information

Competing interests

The authors declare that they have no competing interests.

Authors’ contributions

The manuscript was written and edited equally by RTZ and LNV. Both authors read and approved the final manuscript.

Rights and permissions

This article is published under license to BioMed Central Ltd. This is an Open Access article distributed under the terms of the Creative Commons Attribution License (, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly credited. The Creative Commons Public Domain Dedication waiver ( applies to the data made available in this article, unless otherwise stated.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Zoeller, R.T., Vandenberg, L.N. Assessing dose–response relationships for endocrine disrupting chemicals (EDCs): a focus on non-monotonicity. Environ Health 14, 42 (2015).

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: