 Research
 Open Access
 Open Peer Review
 Published:
Bayesian networkbased framework for exposureresponse study design and interpretation
Environmental Healthvolume 18, Article number: 23 (2019)
Abstract
Conventional environmentalhealth riskassessment methods are often limited in their ability to account for uncertainty in contaminant exposure, chemical toxicity and resulting human health risk. Exposure levels and toxicity are both subject to significant measurement errors, and many predicted risks are well below those distinguishable from background incident rates in target populations. To address these issues methods are needed to characterize uncertainties in observations and inferences, including the ability to interpret the influence of improved measurements and larger datasets. Here we develop a Bayesian network (BN) model to quantify the joint effects of measurement errors and different sample sizes on an illustrative exposureresponse system. Categorical variables are included in the network to describe measurement accuracies, actual and measured exposures, actual and measured response, and the true strength of the exposureresponse relationship. Network scenarios are developed by fixing combinations of the exposureresponse strength of relationship (none, medium or strong) and the accuracy of exposure and response measurements (low, high, perfect). Multiple cases are simulated for each scenario, corresponding to a synthetic exposure response study sampled from the known scenario population. A learnfromcases algorithm is then used to assimilate the synthetic observations into an uninformed prior network, yielding updated probabilities for the strength of relationship. Ten replicate studies are simulated for each scenario and sample size, and results are presented for individual trials and their mean prediction. The model as parameterized yields littletono convergence when low accuracy measurements are used, though progressively faster convergence when employing high accuracy or perfect measurements. The inferences from the model are particularly efficient when the true strength of relationship is none or strong with smaller sample sizes. The tool developed in this study can help in the screening and design of exposureresponse studies to better anticipate where such outcomes can occur under different levels of measurement error. It may also serve to inform methods of analysis for other network models that consider multiple streams of evidence from multiple studies of cumulative exposure and effects.
Background
Exposure and doseresponse assessment are among the most critical steps of the environmental riskassessment process (see Fig. 1). These provide information about the adverse health effects of different exposure levels in the population. In toxicological studies uncertainty is introduced due to experimental error (e.g., an imperfectly controlled environment, human factors and experimental conditions leading to dose variability, etc.); limited sample sizes; and the effects of high to lowdose and animaltohuman extrapolation when interpreting the results of the study [1]. In epidemiological studies the assessment is uncertain due to exposure measurement errors; uncertainty in the relationship between exposure and dose to critical cells or organs; the influence of confounding factors affecting members of the population; and incomplete or erroneous data on health endpoints. In either case the relationship between the actual exposure level of a toxicant and the actual response is difficult to estimate by direct measurements [2,3,4,5]. The network model developed herein provides a direct, integrated method for assessing the value of such improvements in exposure and response measurement.
Toxicological experiments are generally done with highdose compound exposure in laboratory animals, and these results are used to predict the potential adverse health endpoint(s) in humans, assuming that similar effects would be expected. However, the levels of chemical exposure in environmental settings are usually much lower than tested levels [1, 6]. Decisions about setting maximum contaminant limits can thus be biased by these measured responses at high dose. In epidemiological studies the sampled population and risk levels are often too small for the exposurerelated increment to be statistically distinguished from background levels of the health endpoint. Epidemiological studies are also prone to known or unknown confounding factors which may affect estimation of exposureresponse relationships in ways similar to the effects of measurement error [7,8,9,10]. Therefore, this study starts with key uncertainty problems in experimental studies: (1) How should prior knowledge be used to learn about the strength of the relationship between true exposure and true response? (2) How do measurement errors in exposure and response affect experimental design and interpretation for toxicological and epidemiological studies? and (3) What are the sample sizes needed to determine whether a significant exposureresponse relationship is present?
We know that prior scientific knowledge about exposure and response mechanisms can lead to better design and interpretation of study results. Furthermore, better understanding of the sources of measurement error, options to reduce it, and its effect on subsequent inference can increase the likelihood of successful experimental designs for future trials and for clinical use. In order to achieve this goal, we propose a Bayesian network (BN) modelbased approach to analyze the probabilistic relationship between true exposure and true response. BNs provide a simple yet holistic approach to the use of both quantitative and qualitative knowledge, with the distinct advantage of combining available information through a mix of expert judgment, mechanistic models, and statistical updating with observed outcomes [11,12,13].
Measurement error in statistical and risk science is a wellstudied topic in the literature [14,15,16,17,18]. However, effects of measurement error on the strength of concentrationresponse relationships in toxicological studies have been limited. BNs can help to understand the effects of measurement errors on the magnitude of an exposure or doseresponse relationship. There are three effects of measurement error in covariates: (1) it causes bias in parameter estimation, (2) it leads to a loss of power for the prediction of a relationship, and (3) it makes structural analysis difficult [19]. Sonderegger et al. [20] investigated the effects of unmeasured temporal variation, and they suggest temporal variation in contaminant concentrations causes important bias in the exposureresponse relationship.
In the next section, we discuss our model, giving background on BNs and our estimation of model parameters. In the following section, we apply the model using illustrative values of model input parameters. We then present our results and discuss further possible applications of our methods and results.
Methods
Using BNs as a riskassessment tool allows us to investigate and quantify the causal relationships between several interacting variables and outcomes because there is a theoretical relation between causality and probability [11, 21,22,23]. Therefore, we aim to predict the strength of relationship between True Exposure (TE) and True Response (TR) based on observations of exposure and response from studies with different sample sizes.
BNs capture causeandeffect relationships through the structure of an acyclic directed graphs, so understanding and designing the diagrams is critical. Figure 2 shows the directed graph of a theoretical exposurerelationship assessment. This simplified influence diagram considers several sources of error under different nodes. Reductions in the Accuracy of exposure measurement (that is, greater errors in exposure measurements or classification) could result from incomplete spatial and/or temporal coverage of the target population in the exposure study; the selection of environmental or internal (biomarker) metrics of exposure that provide an imperfect indication of the critical exposures that matter to the health endpoint; and laboratory and field sampling errors for these metrics. Reductions in the Accuracy of response measurement (that is, greater errors in response measurements or classification) result from the occurrence of incomplete reporting or misdiagnosis of health endpoints in humans (for epidemiological studies) or laboratory animals (for toxicological studies); limited sample sizes in these studies; and errors in fitted relationships and extrapolations for response outcomes. True exposure and true response are the actual exposure and response levels in the target population, reflecting the true magnitude of the exposureresponse relationship. These actual values are measured (or estimated) imperfectly to yield measured exposure and measured response.
Bayesian networks
Bayesian networks were developed in the late 1980s to visualize probabilistic dependency models via Directed Acyclic Graphs (DAG) and model efficiently the joint probability distribution over sets of variables [11, 24]. BNs are strong modeling tools and are relatively simple compared to other modeling approaches [13]. The characterization of linkages between variables is typically probabilistic, rather than deterministic, so that BNs allow use of both quantitative and qualitative information [24].
BNs have been used to analyze problems, and to plan, monitor, and evaluate diverse cases of varying size and complexity in several different disciplines [25,26,27,28,29]. Bayesian models are particularly appropriate for environmental systems because uncertainty is inherent, and BNs have been used widely for ecological applications [30]. Similar potential exists in the field of human health risk assessment [31]. Specifically, a few studies have investigated the relationship between true exposure and true response through BNs [32,33,34,35]. Marella and Vicard (2013) [33] investigated the measurement error generating mechanism by developing an object oriented Bayesian network model. There are also a number of recent examples of BN and related DAG applications in healthrisk assessment [21, 36,37,38]. Several studies investigated interactions among cancer risk components caused by environmental exposure by using a probability tree approach [39, 40]. These papers focus on exposureresponse predictions as a part of fundamental assumptions of the cancer risk network.
Calculations in BNs are based on repetitive applications of Bayes’ theorem (also known as Bayes’ rule or Bayes’ law), which was first derived by Thomas Bayes and published posthumously in 1764 [41]. According to Bayes’ theorem, a prior probability provides information about the initial uncertainty of a parameter (before data are collected, based, for example, on expert judgment), while the posterior probability is calculated using the observed data and its likelihood function to update the uncertainty distribution of the parameter [42]. This feature of the theorem differentiates Bayesian statistical models from ordinary nonBayesian statistical models because the Bayesian approach is a mixture of ordinary models and a joint distribution over the measured variables, and it may incorporate subjective prior beliefs [23]. Bayes’ rule (Eq. 1) allows for iteratively updating the marginal probability distribution over each node in the network as new data are collected and states in the network are observed [41, 43].
BNs bring a holistic approach to understand the important pathways in networks, which are not easily expressed by mathematical equations, by integrating qualitative expert knowledge, equations, probabilistic modeling, and empirical data [11, 44, 45]. When the response variable (X in Eq. 1) is categorical, the BN provides the equivalent of a probabilistic classification approach [46].
We developed a BN (Fig. 3) based on the preliminary directed graph of Fig. 2 by using the GeNIe software package [47]. We chose this software because of its quality, flexible datageneration feature, its userfriendly graphical interface, and availability (free of charge to academic users). The default belief updating algorithm in GeNIe is the clustering algorithm, the fastestknown exact algorithm for Bayesian networks. The clustering algorithm was originally proposed by Lauritzen and Spiegelhalter (1988) and improved by several researchers [48, 49]. We chose the Estimated Posterior Importance Sampling (EPIS) algorithm for sampling cases, which provides more precise results compared to other available algorithms [47].
The accuracy of exposuremeasurement and responsemeasurement levels are represented by AcEM and AcRM, respectively. These accuracy levels can be affected by errors at various stages of the exposure or response estimation activities, as described above. The measured (observed) values of exposure and response are termed ME and MR, respectively. The true exposure (TE) and true response (TR) values are the actual exposure and response levels. Node R represents the complex relationship between TE and TR. For instance, if R is strong, then the degree of causal influence of TE on TR is high and the association between TE and TR approaches a nearly perfect alignment. That is, low TE almost always yields low TR, medium TE almost always yields medium TR, and high TE almost always yields high TR. As such, an increasing strength of relationship (from none to medium to strong), indicates an increased health risk associated with increasing exposure. The state none represents the event that there is no causal linkage between true exposure and true response, so that increasing the exposure levels does not impart any additional risk of the targeted health effect.
The node ER Match is used to compile the results of an exposureresponse study, with each subject in the study classified into one of the three exposure states (l, m or h) and one of three response states (l, m or h), yielding nine possible outcomes for ER Match: (ME, MR) = (l, l); (l, m); (l, h); (m, l); (m, m); (m, h); (h, l); (h, m); and (h, h). This outcome node can consider outcomes for individuals or groups of individuals, with resulting probability updates then propagated back through the network. When the measured exposure and measured risk are the same, i.e., states (l, l), (m, m), or (h, h), this lends support to the belief that a strong relationship exists between the true exposure and the true risk, especially when the measurement errors are low. When the states do not match, this lends support to the belief that the relationship is not strong, and possibly that there is no relationship at all (or the relationship is masked by measurement error).
In the application below we assume a sequence of scenarios for the exposureresponse relationship and the measurement errors, and use these to simulate synthetic measured outcomes in a study population of a given size. These results demonstrate the statistical behavior of the network model and the probability that correct inferences will be drawn for each scenario, in particular showing the variability of inferences and the rates of convergence with sample size.
Parameterization of the illustrative Bayesian network model
To provide an illustrative demonstration of the Bayesian network methodology, we select representative values of the conditional probability tables (CPTs) and prior probabilities in the network to demonstrate how measurement errors influence the ability to distinguish between the possible strengths of the exposureresponse relationship: none, medium or strong. The critical CPTs in the model include those for:

i)
the measured exposure, ME, as influenced by the true exposure (TE) and the accuracy of the exposure measurement (AcEM);

ii)
the measured response, MR, as influenced by the true response (TR) and the accuracy of the response measurement (AcRM); and

iii)
the true response, TR, as influenced by the true exposure (TE) and the strength of the exposureresponse relationship (R).
The conditional probabilities in CPTs i) and ii) reflect the degree of correspondence between the true exposure and the measured exposure, and between the true response and the measured response, respectively. Tables 1 and 2 shows the CPTs for ME and TR, respectively. The first row of the table indicates the states of AcEM followed by the states of TE. For example, if AcEM = low, and the true exposure = TE = low, then the probability that the measured exposure, ME = high equals 0.2.
We assume that there is no prior information about the distributions of the top nodes in the network. Therefore, we use the uniform prior probability distribution over each variable, i.e., we assume that each state in a node with three outcomes has a 33% probability of occurrence, except the relationship (R) node. The R node prior probability is designed to investigate any potential relationship in addition to the strength of relationship. We thus assume a 50% probability of no existing relationship and a 50% probability of some relationship, allocated equally between a medium or a strong relationship, with 25% probability each (see Fig. 3). In all of the analyses that follow, “what if” scenarios are specified by choosing particular values of AcEM and AcRM, to determine the effect of different levels of measurement accuracy.
Data simulation and analysis
We simulate random cases for nine scenarios (Table 3) using GeNIe which allows the users to generate random cases that are representative of the network based on the overall joint probability distribution of the nodes and their states. Each scenarios representing potential combinations of strength of relationship (R), the accuracy of exposure measurement (AcEM) and the accuracy of the response measurement (AcRM). To limit the number of scenarios considered, AcEM and AcRM were varied together so that scenarios reflect either low, medium or high accuracy for both the exposure and response measurements. We progressively increase the sample size from N = 1 to N = 1000 in the following examples, with the posterior probabilities following inclusion of case i serving as the prior probabilities for case i + 1.
GeNIe allows the user to generate random cases that are representative of the network, according to the joint probability distribution over the nodes and their states. Each case represents a hypothetical individual in a group of N that was exposed to a low, medium or high amount of toxicant in an environment, either with uncertainty based on the (equal prior) probabilities shown in the TE node in Fig. 3, or as specified for the scenarios below by selecting either low, medium or high exposure with 100% probability. A “true” population is thus simulated for a scenario with an assumed strength of relationship (none, medium, or strong) and specified levels of exposure and effect measurement error (low, medium or high for each). Given multiple sets of random cases with each (true) specification, we use each of the case sets to update a new “blank” copy of the network (that is, one with the prior specifications for the correct values of AcEM and AcRM, we assume to know the accuracies) and infer the posterior probability that the strength of relationship (informed by the case set) is none, medium, or strong. In essence, we use the simulated study results to update the assumed prior beliefs (in this case, uninformed) regarding the strength of the exposureresponse relationship. If the inferred probabilities align with the true strength of relationship used to generate the cases, then we conclude that the simulated exposureresponse study has the power to properly infer the strength of relationship. This power depends on the accuracy of the measurements and the sample size N, i.e., the number of random cases in each case set. As N increases, the power for proper inference likewise increases. In order to demonstrate the comparative results for different sample sizes, we simulated several N values: 20, 50, 100, and 1000.
The following summarizes the steps in the simulation analysis:

1
Assign a true state for R, AcEM, and AcRM (e.g., define the scenario, Fig. 4, perfectperfect, highhigh, lowlow),

2
Generate a synthetic dataset D of size N for the selected scenario, and repeat for 10 trials,

3
Count the frequency and calculate the average for each state of ER Match,

4
Calculate the posterior distribution for each state of R, given the specifications of the selected scenarios, and the sequential network updates calculated for each case in the dataset D, and

5
Repeat steps 1–4 for different sample sizes (N).
To implement sequential updates of the node state probabilities, we use the Bayes factor (BF) to facilitate the calculation. The BF is first computed as the likelihood ratio of a given set of states in the network relative to the other states, given the (simulated) data comprising ER Match. With a particular focus on the alternative states of R: Ri; i = 1,3, corresponding to a strength of exposureresponse relationship of none, medium and strong, respectively, the Bayes factor is given by [50]:
An increasing BF indicates increasing evidence in support of state value i.
Once the BF is calculated for combinations of states and observations (i.e., for each of the three states of R and for each of the nine observation states of ER Match), each sequential observation of ER Match updates the state probabilities for R as:
where Odds (Ri) = P(Ri) / [1 – P(Ri)]
One important advantage of the BF is that it is not affected by the prior probability at a given stage, nor by the sample size used to inform this probability. Once it is computed using Eq. 2, it may be used repeatedly in Eq. 3 to update the state probabilities in the network as new observations are collected (or simulated) and processed. In the following comparisons, we compute posterior probabilities for 10 realizations of each scenario using an independent sample of ER Match for each. This allows us to track the effects of measurement error on the estimated strength of relationship and compare them across equally plausible samples from a given population scenario.
Results and discussion
We evaluate the efficiency of the model by how well it predicts the strength of relationship when updated using synthetic ER Match results simulated for scenarios with specified values of R (none, medium, or high) and alternative scenarios for AcEM and AcRM (perfectperfect, highhigh, lowlow). The results for these 3 × 3 = 9 scenarios are summarized in Figs. 5, 6 and 7, with the predicted probability for each of the categories of R shown as a function of sample size. In each case, one of the states for R is correct, corresponding to the original population designation, while the other two states are incorrect for the specified scenario. In each case the focus is upon whether and how quickly the predicted probability of the assumed true state of R approaches 1.0. Probability trajectories are shown as predicted from each of the 10 trials of simulated ER Match results for a given scenario (gray lines), as well as the mean probability prediction for each level of R across the 10 trials (black line).
In each figure, the rows represent the actual state of R used to generate the samples of ER Match, while the predicted posterior probabilities are for the state of R corresponding to each column. Each curve depicts the predicted probability of its column value of R given that its row state is true. The three plots along the diagonal of each figure show whether and how quickly the correct results are inferred by the network model using data with varying degrees of measurement error. The offdiagonal plots show whether, and for how large of a sample, false inferences are made for each of the two incorrect states.
Figure 5 summarizes the posterior probabilities of predicted R over different sample sizes assuming perfect measurements of both an individual’s exposure and their response. In this scenario, there is perfect correspondence between TE and ME, and between TR and MR, and the Bayesian network predictions for the true state of R converge to a probability of 1.0 in a relatively direct manner. This convergence is quite rapid for R = strong or none, occurring with approximate sample sizes of N = 20 or N = 50, respectively. Identification of R = medium is more difficult, requiring a sample N = 700 or more. Furthermore, as noted for many of the plots in Fig. 5, inferences from one or more of the individual trials (plotted in grey) exhibit divergent behavior well into the sample count, appearing as outliers relative to the other trials and diverging from the overall mean of the predicted probability over all or some of the preconvergence sample sizes.
Figure 6 shows results for the highhigh accuracy scenario where both the ME and MR correspond closely, but imperfectly, to TE and TR, respectively. As indicated, convergence for correct identification of the true R still occurs for all trials by an approximate sample size of N = 100 for R = strong, and by a sample size of N = 300 for R = none. For R = medium, convergence of all trials to a probability of 1.0 is still not achieved by a sample size of N = 1000. The overall slower convergence of the high accuracy vs. the perfect measurement scenarios is expected, as is the greater variance in individual trials exhibited in Fig. 6 compared to Fig. 5. The especially slow convergence for R = medium may result from our particular model parameterization, but also from the fact that the medium state for R is bounded on both sides by the alternatives none (below) and strong (above). If very strong evidence for R = none accumulates (with a very small number of samples where the subjects’ measured exposure and measured response align), this statistical overabundance of support for R = none still supports the subsequent inference that R = none. The same occurs for R = strong when there is a statistical overabundance (e.g., nearly all samples yield MR = ME). In contrast for R = medium, as unusual (perhaps nonrepresentative) results accumulate, there is somewhere else for the fitted probability to go, either upwards to R = strong or downwards to R = none.
The effects of lowlow accuracy (i.e., high measurement error) are illustrated in Fig. 7, where none of the true states of R and their associated samples lead to correct mean probability predictions that converge to 1.0 by N = 1000. For R = none and R = strong, the mean values of the probabilities are slowly progressing upward (reaching 0.7 for R = none and 0.55 for R = strong when N = 1000), but with extremely high trialtotrial variation which grows larger with sample size. By the time N = 1000, a number of the trials for either R = none or R = strong predict the correct state with probability close to 1.0, but others predict the correct state with probability close to zero, providing “convincing” evidence for the wrong conclusion. Other trials predict probabilities for the correct state between 0 and 1.0, so that the inferences drawn from their exposureresponse analyses span the range from correct to inconclusive to wrong. As such, from the results in Fig. 7, low accuracy measurements can cause significant mislearning to occur in many cases becoming more severe as the study size increases. The presence of variability for “None” and “Strong” cases allows for occasional high and low posterior probabilities compared to the “Medium” scenario.
To provide an overall summary of the effects of measurement error Table 4 shows the sample size needed to (on the average) infer with 90% posterior probability the correct strength (for the three true strengths of relationship) and the three accuracy levels. Increasing accuracy levels require smaller sample sizes to predict the strength of the true relationship. For instance, increasing the accuracy level from low to perfect causes a dramatic decrease in the required sample size (1000+ to 6) for the case of a strong relationship.
The main goal of this study is exploring Bayesian network model as a tool to understand the effects of measurement and classification errors on the accuracy and precision of inferences drawn regarding the strength of exposure and doseresponse relationships. There is a high potential of applying the proposed method to different datasets. We acknowledge the limitations of this study. However, in the future, Bayesian methods can become a routine toolkit for assessing doseresponse measurement and correcting measurement errors. Therefore, there is a growing need of scientific knowledge on advanced statistical methods. The proposed method provides important information on the prior knowledge and likelihood of a strong, medium or weak relationship; metrics of exposure and sources of exposure error or misclassification; and metrics of response and the possible causes of effects misclassification; and the additional data that would be needed to apply the method.
Conclusions
New methods are needed to frame and quantify the joint effects of measurement errors and different sample sizes on the ability of exposure and doseresponse studies to properly infer the presence and magnitude of an actual epidemiological or toxicological relationship. DAGs can provide a powerful approach for visualizing dependencies between variables in a network, allowing the combination of expert judgment for measurement errors and the strength of a relationship with the quantitative study results.
We present an illustrative demonstration of a novel method to frame fundamental uncertainty questions in toxicological/epidemiological studies. We use BNs as a tool to understand the effects of measurement and classification errors on the accuracy and precision of inferences drawn regarding the strength of exposure and doseresponse relationships. For the parameters assumptions, differences in the power to properly infer a strong vs. medium vs. no relationship are found. The results show that cases where the actual strength of relationship is either R = none or R = strong are easier to predict (with smaller sample size) than the case where R = medium. In general, increasing the sample size increases the accuracy level for the predicted R for almost all scenarios, except when the measurement error is high (AcEM, AcRM = low). For these scenarios, the predictions, even over many trials, exhibit little or no convergence. Furthermore while improved measurement accuracy does increase the efficiency of R prediction on average (yielding faster convergence of the mean probability), in most scenarios there are a few, or in some cases many, of the 10 replicate trials that yield incorrect inferences even as the sample size becomes quite large. This suggests that environmental health scientists must be aware of the (perhaps surprisingly high) probability of incorrect inferences being drawn from a single exposureresponse study. Extended versions of the network demonstrated here could assist in this assessment, including, for example, the effects of possible confounding exposures and behaviors, and inclusion of multiple sets of toxicological and epidemiological study results. These insights would be of value in a wide range of contexts requiring the design and interpretation of toxicological and epidemiological studies.
Abbreviations
 AcEM:

The accuracy of the exposure measurement
 AcRM:

The accuracy of the response measurement
 BF:

Bayes Factor
 BN:

Bayesian Network
 CPT:

Conditional probability table
 DAG:

Directed acyclic graphs
 ER:

ExposureResponse Match
 ME:

Measured exposure
 MR:

Measured response
 TE:

True exposure
 TR:

True response
References
 1.
Dong Z, Liu Y, Duan L, Bekele D, Naidu R. Uncertainties in human health risk assessment of environmental contaminants: a review and perspective. Environ Int. 2015;85:120–32. https://doi.org/10.1016/j.envint.2015.09.008.
 2.
Brown CC. The statistical analysis of doseeffect relationships. In: Butler GC, editor. Principles of Ecotoxicology. London: Wiley; 1978.
 3.
Gustafson P. Measurement error and misclassification in statistics and epidemiology: impacts and Bayesian adjustments. Chapman and Hall/CRC; 2003. ISBN10: 1584883359.
 4.
Gwinn MR, Axelrad DA, Bahadori T, Bussard D, Cascio WE, Deener K, Dix D, Thomas RS, Kavlock RJ, Burke TA. Chemical risk assessment: traditional vs public health perspectives. Am J Public Health. 2017;7(108):1032–9.
 5.
Hernández AF, Tsatsakis AM. Human exposure to chemical mixtures: challenges for the integration of toxicology with epidemiology data in risk assessment. Food Chem Toxicol. 2017;103:188–93.
 6.
Andersen ME, Krewski D. Toxicity testing in the 21st century: bringing the vision to life. Toxicol Sci. 2009;107(2):324–30. https://doi.org/10.1093/toxsci/kfn255.
 7.
Lee PH, Burstyn I. Identification of confounder in epidemiologic data contaminated by measurement error in covariates. BMC Med Res Methodol. 2016;1(16):54.
 8.
Rudolph KE, Stuart EA. Using sensitivity analyses for unobserved confounding to address covariate measurement error in propensity score methods. Am J Epidemiol. 2017;187(3):604–13.
 9.
Burstyn I, Gustafson P, Pintos J, Lavoué J, Siemiatycki J. Correction of odds ratios in casecontrol studies for exposure misclassification with partial knowledge of the degree of agreement among experts who assessed exposures. Occup Environ Med. 2018;75(2):155–9.
 10.
Samoli E, Butland BK. Incorporating measurement error from modeled air pollution exposures into epidemiological analyses. Curr Environ Health Rep. 2017;4(4):472–80.
 11.
Pearl J. Probabilistic reasoning in intelligent systems: networks of plausible inference. Los Angeles: Morgan Kaufmann Publishers; 1988.
 12.
Stiber NA, Pantazidou M, Small MJ. Expert system methodology for evaluating reductive dechlorination at TCE sites. Environ Sci Technol. 1999;33(17):3012–20.
 13.
Pollino CA, Henderson C. Bayesian networks: A guide for their application in natural resource management and policy, vol. 14: Australian Government; 2010. http://www.utas.edu.au/__data/assets/pdf_file/0009/588474/TR_14_BNs_a_resource_guide.pdf.
 14.
Rhomberg LR, Chandaliaa JK, Longa CM, Goodmana JE. Measurement error in environmental epidemiology and the shape of exposureresponse curves. Crit Rev Toxicol. 2011;41(8):651–71.
 15.
Gustafson P. Measurement error and misclassification in statistics and epidemiology: impacts and Bayesian adjustments, vol. 159. Boca Ration, FL: CRC Press; 2003.
 16.
Prescott GJ, Garthwaite PH. A Bayesian approach to prospective binary outcome studies with misclassification in a binary risk factor. Stat Med. 2005;24(22):3463–77.
 17.
Fewell Z, Davey Smith G, Sterne JA. The impact of residual and unmeasured confounding in epidemiologic studies: a simulation study. Am J Epidemiol. 2007;166(6):646–55.
 18.
Luo S, Chan W, Detry MA, Massman PJ, Doody RS. Binomial regression with a misclassified covariate and outcome. Stat Methods Med Res. 2016;25(1):101–17.
 19.
Carroll RJ, Ruppert D, Stefanski LA, Crainiceanu CM. Measurement error in nonlinear models: a modern perspective. Boca Raton: Chapman and Hall/CRC; 2006. ISBN10: 1584886331.
 20.
Sonderegger DL, Wang H, Huang Y, Clements WH. Effects of measurement error on the strength of concentrationresponse relationships in aquatic toxicology. Ecotoxicology. 2009;18:824–8.
 21.
Mittal A, Kassim A. Bayesian network technologies: applications and graphical models. Hershey: IGI Publishing; 2007. ISBN10: 1599041413.
 22.
Taroni F, Aitken C, Garbolino P, Biederman A. Bayesian networks and probabilistic inference in forensic science. England: Wiley; 2006.
 23.
Spirtes P, Glymour C, Scheines R. Causation, Prediction, and Search: Carnegie Mellon University, Department of Philosophy; 1993.
 24.
Newton AC. Bayesian Belief Networks in Environmental Modeling: A Review of Recent Progress. Environmental Modelling; 2009. p. 13–50.
 25.
Beaudequin D, Harden F, Roiko A, Stratton H, Lemckert C, Mengersen K. Beyond QMRA: modelling microbial health risk as a complex system using Bayesian networks. Environ Int. 2015;80:8–18. https://doi.org/10.1016/j.envint.2015.03.013.
 26.
Yang C, Ji J, Liu J, Liu J, Yin B. Structural learning of Bayesian networks by bacterial foraging optimization. Int J Approx Reason. 2016;69:147–67. https://doi.org/10.1016/j.ijar.2015.11.003.
 27.
Weber P, MedinaOliva G, Simon C, Iung B. Overview on Bayesian networks applications for dependability, risk analysis and maintenance areas. Eng Appl Artif Intell. 2012;25(4):671–82. https://doi.org/10.1016/j.engappai.2010.06.002.
 28.
Barker GC, GomézTomé N. A risk assessment model for Enterotoxigenic Staphylococcus aureus in pasteurized Milk: a potential route to sourcelevel. Risk Anal. 2013;33(2):249–69.
 29.
Rigaux Ancelet CS, Carlin F, Nguyenthé C, Albert I. Inferring an augmented Bayesian network to confront a complex quantitative microbial risk assessment model with durability studies: application to Bacillus cereus on a courgette purée production chain. Risk Anal. 2013;33(5):877–92.
 30.
McCann RK, Marcot BG, Ellis R. Bayesian belief networks: applications in ecology and natural resource management. Can J For Res. 2006;36(12):3053–62. https://doi.org/10.1139/x06238.
 31.
Kraisangka J, Druzdzel MJ, Benza R. A Risk Calculator for the Pulmonary Arterial Hypertension Based on a Bayesian Network. In: 13th Annual Bayesian Modeling Applications Workshop (BMAW2016), 29 June 2016. New York City; 2016.
 32.
Marella D, Vicard P. Towards an integrated Bayesian network approach to measurement error detection and correction. Commun Stat Simul Comput. 2017. https://doi.org/10.1080/03610918.2017.1387664.
 33.
Marella D, Vicard P. Objectoriented Bayesian networks for modeling the respondent measurement error. Commun Stat Theory Methods. 2013;42(19):3463–77. https://doi.org/10.1080/03610926.2011.630769.
 34.
Corbin M, Haslett S, Pearce N, Maule M, Greenland S. A comparison of sensitivityspecificity imputation, direct imputation and fully Bayesian analysis to adjust for exposure misclassification when validation data are unavailable. Int J Epidemiol. 2017;46:1063–72. https://doi.org/10.1093/ije/dyx027.
 35.
Gronewold AD, Reckhow KH, Vallero DA. Improving human and ecological exposure assessments: a bayesian network modeling approach. Epidemiology. 2008. https://doi.org/10.1097/01.ede.0000340181.65092.ab.
 36.
Woodworth GG. Biostatistics: a Bayesian introduction. New Jersey: John Wiley & Sons, Ltd.; 2004.
 37.
Burns CJ, Wright JM, Pierson JB, Bateson TF, Burstyn I, Goldstein DA, Klaunig JE, Luben TJ, Mihlan G, Ritter L, et al. Evaluating uncertainty to strengthen epidemiologic data for use in human health risk assessments. Environ Health Perspect. 2014;122(11):1160.
 38.
Brewer LE, Wright JM, Rice G, Neas L, Teuschler L. Causal inference in cumulative risk assessment: the roles of directed acyclic graphs. Environ Int. 2017;102:30–41.
 39.
Small MJ. Methods for assessing uncertainty in fundamental assumptions and associated models for cancer risk assessment. Risk Anal. 2008;28(5):1289–308. https://doi.org/10.1111/j.15396924.2008.01134.x.
 40.
Sielken RL, ValdezFlores C. Probabilistic risk assessments use of trees and distributions to reflect uncertainty and variability and to overcome the limitations of default assumptions. Environ Int. 1999;25:755–72.
 41.
Murphy KP. Machine learning a probabilistic perspective. Cambridge, Massachusetts, London, England: The MIT Press; 2012.
 42.
Su C, Andrew A, Karagas MR, Borsuk ME. Using Bayesian networks to discover relations between genes, environment, and disease. BioData Min. 2013;6:6.
 43.
Tang C, Yi Y, Yang Z, Sun J. Risk analysis of emergent water pollution accidents based on a Bayesian network. J Environ Manag. 2016;165:199–205. https://doi.org/10.1016/j.jenvman.2015.09.024.
 44.
GatViks I, Tanay A, Raijman A, Shamir R. A probabilistic methodology for integrating knowledge and experiments on biological networks. J Comput Biol. 2006;13(2):165–81.
 45.
Tighe M, Pollino CA, Wilson SC. Bayesian networks as a screening tool for exposure assessment. J Environ Manag. 2013;123:68–76. https://doi.org/10.1016/j.jenvman.2013.03.018.
 46.
Denison DGT, Holmes CC, Mallick BK, Smith AFM. Bayesian methods for nonlinear classification and regression. England: John Wiley & Sons, Ltd.; 2002.
 47.
GeNIe [software, available from http://www.bayesfusion.com/].
 48.
Jensen FV, Lauritzen SL, Olsen KG. Bayesian updating in recursive graphical models by local computations. Comput Stat Q. 1990;4:269–82.
 49.
Dawid PA. Applications of a general propagation algorithm for probabilistic expert systems. Stat Comput. 1992;2:25–36.
 50.
Jarosz AF, Wiley J. What Are the Odds? A Practical Guide to Computing and Reporting Bayes Factors. J Probl Solv. 2014;7(1). https://doi.org/10.7771/19326246.1167.
Acknowledgements
The models described in this paper were created using the GeNIe Modeler, available free of charge for academic research and teaching use from BayesFusion, LLC, https://www.bayesfusion.com/.
Funding
This research did not receive any specific grant from funding agencies in the public, commercial, or notforprofit sectors.
Availability of data and materials
The datasets during and/or analysed during the current study available from the corresponding author on reasonable request.
Author information
Affiliations
Contributions
NO developed the objectives and the models and analyzed the outcomes in the manuscript. MS made substantial contributions to conception and design, or acquisition of data, or analysis and interpretation of data. MD helped with the development of the Bayesian network model and offered guidance to BN modeling. All authors have been involved in drafting the manuscript or revising it critically for important intellectual content. All authors read and approved the final manuscript.
Corresponding author
Correspondence to Nur H. Orak.
Ethics declarations
Ethics approval and consent to participate
Not applicable.
Consent for publication
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Rights and permissions
Open Access This article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated.
About this article
Received
Accepted
Published
DOI
Keywords
 Health risk assessment
 Exposureresponse
 Bayesian networks
 Measurement error
 Toxicology
 Environment
 Environmental health
Comments
By submitting a comment you agree to abide by our Terms and Community Guidelines. If you find something abusive or that does not comply with our terms or guidelines please flag it as inappropriate. Please note that comments may be removed without notice if they are flagged by another user or do not comply with our community guidelines.