Appendix
Annex 1. Search strategy and inclusion criteria
((“Policy Making”[Mesh]) OR (“Decision Making”[Mesh])) AND (((framework[Title/Abstract]) OR (frameworks[Title/Abstract])) OR ((template[Title/Abstract]) OR (templates[Title/Abstract]) OR (tool[Title/Abstract]) OR (tools[Title/Abstract]))).
Filters: English language, systematic review, last 10 years.
The search was executed 7 January 2021 in the PubMed search engine for Medline.
Annex 2. PRISMA flow diagram
Annex 3. Results of the search: full-text review
The search of PubMed performed on 7 Jan 2021. 399 citations were identified, 25 of which were reviewed in full text: these are listed below with the reason for exclusion.
Abbreviations: E, excluded citation; E2D, evidence-to-decision; I, included citation; LMICs, low- and middle-income countries; NA (not applicable because the publication fulfilled inclusion criteria)
Citation | Title | Include/exclude | Rationale for exclusion |
---|
Baltussen 2019 [1] | Multicriteria decision analysis to support health technology assessment agencies: Benefits, limitations, and the way forward | I | NA |
Boivin 2018 [2] | Patient and public engagement in research and health system decision making: A systematic review of evaluation tools | E | Review of tools for evaluating patient and public engagement, not for decision making |
Burchett 2012 [3] | National decision-making on adopting new vaccines: a systematic review | I | NA |
Carroll 2013 [4] | Best fit framework synthesis: refining the method | E | Describes “best fit” method for qualitative synthesis; no EtD frameworks |
Carvalho 2018 [5] | Capturing budget impact considerations within economic evaluations: A systematic review of economic evaluations of rotavirus vaccine in low- and middle-income countries and a proposed assessment framework | E | Checklist for budget impact analyses |
Clark 2014 [6] | Discrete choice experiments in health economics: A review of the literature | E | Review of discrete chose experiments; no examination of EtD frameworks |
Clark 2018 [7] | Measuring trade-offs in nephrology: A systematic review of discrete choice experiments and conjoint analysis studies | E | Review of discrete choice experiments in nephrology |
Clarke 2016 [8] | The application of theories of the policy process to obesity prevention: a systematic review and meta-synthesis | E | Review of studies where theory underpins the policy development process or adoption of policies. Focus is on explaining the policies and not on what factors should be considered in decision-making. |
Clifford 2017 [9] | What information is used in treatment decision aids? A systematic review of the types of evidence populating health decision aids | E | Focus on patient decision aids |
Dodd 2019 [10] | Investigating the process of evidence-informed health policymaking in Bangladesh: a systematic review | E | Reviews factors linked to policy uptake or prioritization and how and why evidence is used; presents explanatory and descriptive information and not frameworks for normative decisions |
Gentil 2015 [11] | A systematic review of socio-economic assessments in support of coastal zone management (1992–2011) | E | Describes concepts used for decision-making; presents descriptive information and not normative frameworks |
Kolasa 2015 [12] | Pricing and reimbursement frameworks in Central Eastern Europe: a decision tool to support choices | E | Review revealed 33 pricing and reimbursement schemes; led to framework with two economic questions. Exclude as exclusively economic focus. |
Kristensen 2019 [13] | Identifying the need for good practices in health technology assessment: Summary of the ISPOR HTA Council Working Group Report on Good Practices in HTA | E | Neither this paper or the full report (https://www.ispor.org/member-groups/councils-roundtables/health-technology-assessment-council) provides a review of EtD frameworks (referred to as “contextualization”). |
Lam 2018 [14] | Decision support tools for regenerative medicine: Systematic
review | E | Examines decision support tools for product development and manufacturing of cell and gene therapies in regenerative medicine; does not focus on clinical medicine, public health or environmental health |
LaRocca 2012 [15] | The effectiveness of knowledge translation strategies used in public health: A systematic review | E | Review of evaluations of knowledge translation strategies and not the strategies themselves |
Laurans 2013 [16] | Use of ecosystem services economic valuation for decision making: Questioning a literature blindspot | E | Focuses on the types and uses of Ecosystem Services economic Valuation (ESV), not on the criteria for decision making |
Liverani 2013 [17] | Political and institutional influences on the use of evidence in public health policy. A systematic review | E | Examines factors that impact the use of evidence in policy-making |
Mayer 2017 [18] | Costing evidence for health care decision making in Austria: A systematic review | E | Examines economic analyses and costing methods used in Austria; does not present EtD frameworks |
Mustafa 2017 [19] | Decision making about healthcare-related tests and diagnostic test strategies. Paper 3: a systematic review shows limitations in most tools designed to assess quality and develop recommendations | I | NA |
Sullivan 2015 [42] | What guidance are economists given on how to present economic evaluations for policymakers? A systematic review | E | Review of reporting guidance for economic analyses; does not deal directly with EtD concepts |
Trapero-Bertram 2019 [33] | What attributes should be included in a discrete choice experiment related to health technologies? A systematic literature review | E | Review of attributes for discrete choice experiments; not a review of EtD frameworks |
Tsoi 2013 [35] | Harmonization of reimbursement and regulatory approval processes: a systematic review of international experiences | E | Review of approaches to harmonize reimbursement and regulatory approval processes |
Tsoi 2015 [39] | Systematic narrative review of decision frameworks to select the appropriate modelling approaches for health economic evaluations | E | Examines frameworks for selecting economic modelling approaches |
Votruba 2018 [25] | A systematic review of frameworks for the interrelationships of mental health evidence and policy in low- and middle-income countries | E | Review of theories and frameworks explaining use of evidence to formulate policies in mental health in LMICs; does not review frameworks for decision-making |
Wickremasinghe 2016 [31] | District decision-making for health in low-income settings: A systematic literature review | I | NA |
From other sources/ad hoc | | |
Domrumel 2020 [37] | Organizational aspect in healthcare decision-making: a literature review | E | Systematic review of individual criteria for decision-making (not a review of frameworks or sets of criteria) |
Morgan 2018 [38] | Decision-making frameworks and considerations for informing coverage decisions for healthcare interventions: a critical interpretive synthesis. | I | NA |
References for the full-text review
1. Baltussen R, Marsh K, Thokala P, et al. Multicriteria Decision Analysis to Support Health Technology Assessment Agencies: Benefits, Limitations, and the Way Forward. Value Health. 2019;22(11):1283–1288.
2. Boivin A, L’Espérance A, Gauvin FP, et al. Patient and public engagement in research and health system decision making: A systematic review of evaluation tools. Health Expect. 2018;21(6):1075–1084.
3. Burchett HE, Mounier-Jack S, Griffiths UK, Mills AJ. National decision-making on adopting new vaccines: a systematic review. Health Policy Plan. 2012;27 Suppl 2:ii62–76.
4. Carroll C, Booth A, Leaviss J, Rick J. “Best fit” framework synthesis: refining the method. BMC Med Res Methodol. 2013;13:37.
5. Carvalho N, Jit M, Cox S, Yoong J, Hutubessy RCW. Capturing Budget Impact Considerations Within Economic Evaluations: A Systematic Review of Economic Evaluations of Rotavirus Vaccine in Low- and Middle-Income Countries and a Proposed Assessment Framework. Pharmacoeconomics. 2018;36(1):79–90.
6. Clark MD, Determann D, Petrou S, Moro D, de Bekker-Grob EW. Discrete choice experiments in health economics: a review of the literature. Pharmacoeconomics. 2014;32(9):883–902.
7. Clark MD, Szczepura A, Gumber A, Howard K, Moro D, Morton RL. Measuring trade-offs in nephrology: a systematic review of discrete choice experiments and conjoint analysis studies. Nephrol Dial Transplant. 2018;33(2):348–355.
8. Clarke B, Swinburn B, Sacks G. The application of theories of the policy process to obesity prevention: a systematic review and meta-synthesis. BMC Public Health. 2016;16(1):1084.
9. Clifford AM, Ryan J, Walsh C, McCurtin A. What information is used in treatment decision aids? A systematic review of the types of evidence populating health decision aids. BMC Med Inform Decis Mak. 2017;17(1):22.
10. Dodd M, Ivers R, Zwi AB, Rahman A, Jagnoor J. Investigating the process of evidence-informed health policymaking in Bangladesh: a systematic review. Health Policy Plan. 2019;34(6):469–478.
11. Le Gentil E, Mongruel R. A systematic review of socio-economic assessments in support of coastal zone management (1992–2011). J Environ Manage. 2015;149:85–96.
12. Kolasa K, Kalo Z, Hornby E. Pricing and reimbursement frameworks in Central Eastern Europe: a decision tool to support choices. Expert Rev Pharmacoecon Outcomes Res. 2015;15(1):145–155.
13. Kristensen FB, Husereau D, Huić M, et al. Identifying the Need for Good Practices in Health Technology Assessment: Summary of the ISPOR HTA Council Working Group Report on Good Practices in HTA. Value Health. 2019;22(1):13–20.
14. Lam C, Meinert E, Alturkistani A, et al. Decision Support Tools for Regenerative Medicine: Systematic Review. J Med Internet Res. 2018;20(12):e12448.
15. LaRocca R, Yost J, Dobbins M, Ciliska D, Butt M. The effectiveness of knowledge translation strategies used in public health: a systematic review. BMC Public Health. 2012;12:751.
16. Laurans Y, Rankovic A, Billé R, Pirard R, Mermet L. Use of ecosystem services economic valuation for decision making: questioning a literature blindspot. J Environ Manage. 2013;119:208–219.
17. Liverani M, Hawkins B, Parkhurst JO. Political and institutional influences on the use of evidence in public health policy. A systematic review. PLoS One. 2013;8(10):e77404.
18. Mayer S, Kiss N, Łaszewska A, Simon J. Costing evidence for health care decision-making in Austria: A systematic review. PLoS One. 2017;12(8):e0183116.
19. Mustafa RA, Wiercioch W, Falavigna M, et al. Decision making about healthcare-related tests and diagnostic test strategies. Paper 3: a systematic review shows limitations in most tools designed to assess quality and develop recommendations. J Clin Epi. 2017;92:29–37.
20. Sullivan SM, Wells G, Coyle D. What Guidance are Economists Given on How to Present Economic Evaluations for Policymakers? A Systematic Review. Value Health. 2015;18(6):915–924.
21. Trapero-Bertran M, Rodríguez-Martín B, López-Bastida J. What attributes should be included in a discrete choice experiment related to health technologies? A systematic literature review. PloS one. 2019;14(7):e0219905.
22. Tsoi B, Masucci L, Campbell K, Drummond M, O’Reilly D, Goeree R. Harmonization of reimbursement and regulatory approval processes: a systematic review of international experiences. Expert Rev Pharmacoecon Outcomes Res. 2013;13(4):497–511.
23. Tsoi B, O’Reilly D, Jegathisawaran J, Tarride JE, Blackhouse G, Goeree R. Systematic narrative review of decision frameworks to select the appropriate modelling approaches for health economic evaluations. BMC Res Notes. 2015;8:244.
24. Votruba N, Ziemann A, Grant J, Thornicroft G. A systematic review of frameworks for the interrelationships of mental health evidence and policy in low- and middle-income countries. Health Res Policy Syst. 2018;16(1):85.
25. Wickremasinghe D, Hashmi IE, Schellenberg J, Avan BI. District decision-making for health in low-income settings: a systematic literature review. Health Policy and Planning. 2016;31(suppl_2):ii12-ii24.
26. Dubromel A, Duvinage-Vonesch MA, Geffroy L, Dussart C. Organizational aspect in healthcare decision-making: a literature review. J Mark Access Health Policy. 2020;8(1):1810905.
27. Morgan RL, Kelley L, Guyatt GH, Johnson A, Lavis JN. Decision-making frameworks and considerations for informing coverage decisions for healthcare interventions: a critical interpretive synthesis. J Clin Epi. 2018;94:143–150.