Skip to main page content
U.S. flag

An official website of the United States government

Dot gov

The .gov means it’s official.
Federal government websites often end in .gov or .mil. Before sharing sensitive information, make sure you’re on a federal government site.

Https

The site is secure.
The https:// ensures that you are connecting to the official website and that any information you provide is encrypted and transmitted securely.

Access keys NCBI Homepage MyNCBI Homepage Main Content Main Navigation
. 2016 Apr;34(4):349-61.
doi: 10.1007/s40273-015-0327-2.

AdViSHE: A Validation-Assessment Tool of Health-Economic Models for Decision Makers and Model Users

P Vemer  1   2 , I Corro Ramos  3 , G A K van Voorn  4 , M J Al  3 , T L Feenstra  5   6
Affiliations

AdViSHE: A Validation-Assessment Tool of Health-Economic Models for Decision Makers and Model Users

P Vemer et al. Pharmacoeconomics. 2016 Apr.

Abstract

Background: A trade-off exists between building confidence in health-economic (HE) decision models and the use of scarce resources. We aimed to create a practical tool providing model users with a structured view into the validation status of HE decision models, to address this trade-off.

Methods: A Delphi panel was organized, and was completed by a workshop during an international conference. The proposed tool was constructed iteratively based on comments from, and the discussion amongst, panellists. During the Delphi process, comments were solicited on the importance and feasibility of possible validation techniques for modellers, their relevance for decision makers, and the overall structure and formulation in the tool.

Results: The panel consisted of 47 experts in HE modelling and HE decision making from various professional and international backgrounds. In addition, 50 discussants actively engaged in the discussion at the conference workshop and returned 19 questionnaires with additional comments. The final version consists of 13 items covering all relevant aspects of HE decision models: the conceptual model, the input data, the implemented software program, and the model outcomes.

Conclusions: Assessment of the Validation Status of Health-Economic decision models (AdViSHE) is a validation-assessment tool in which model developers report in a systematic way both on validation efforts performed and on their outcomes. Subsequently, model users can establish whether confidence in the model is justified or whether additional validation efforts should be undertaken. In this way, AdViSHE enhances transparency of the validation status of HE models and supports efficient model validation.

PubMed Disclaimer

Figures

Fig. 1
Fig. 1
Building the validation-assessment tool. Grey boxes display work by the project team; white boxes display input from outside sources. 1High non-response since the invitations were sent out to a very wide range of people with the aim of selecting a suitable panel; see Table 1. AdViSHE Assessment of the Validation Status of Health-Economic decision models
Fig. 2
Fig. 2
Typology of validation techniques, based on [4]
Fig. 3
Fig. 3
HE expert questions. AdViSHE Assessment of the Validation Status of Health-Economic decision models, HE health-economic. 1 ISPOR International Society For Pharmacoeconomics and Outcomes Research
Fig. 4
Fig. 4
AdViSHE: Assessment of the Validation Status of Health-Economic decision models. 1 ISPOR International Society For Pharmacoeconomics and Outcomes Research, SMDM Society for Medical Decision making, CHEERS Consolidated Health Economic Evaluation Reporting Standards
Fig. 4
Fig. 4
AdViSHE: Assessment of the Validation Status of Health-Economic decision models. 1 ISPOR International Society For Pharmacoeconomics and Outcomes Research, SMDM Society for Medical Decision making, CHEERS Consolidated Health Economic Evaluation Reporting Standards
Fig. 4
Fig. 4
AdViSHE: Assessment of the Validation Status of Health-Economic decision models. 1 ISPOR International Society For Pharmacoeconomics and Outcomes Research, SMDM Society for Medical Decision making, CHEERS Consolidated Health Economic Evaluation Reporting Standards
Fig. 4
Fig. 4
AdViSHE: Assessment of the Validation Status of Health-Economic decision models. 1 ISPOR International Society For Pharmacoeconomics and Outcomes Research, SMDM Society for Medical Decision making, CHEERS Consolidated Health Economic Evaluation Reporting Standards
See this image and copyright information in PMC

References

    1. Caro JJ, Briggs AH, Siebert U, Kuntz KM. ISPOR-SMDM Modeling Good Research Practices Task force. Modeling good research practices—overview: a report of the ISPOR-SMDM Modeling Good Research Practices Task Force-1. Value Health. 2012;15(6):796–803. doi: 10.1016/j.jval.2012.06.012. - DOI - PubMed
    1. Balci O. Golden rules of verification, validation, testing, and certification of modeling and simulation applications. SCS M&S Mag 2010;4.
    1. Caro JJ, Eddy DM, Kan H, Kaltz C, Patel B, Eldessouki R, Briggs Ah, ISPOR-AMCP-NPC Modeling CER Task Forces Questionnaire to assess relevance and credibility of modeling studies for informing health care decision making: an ISPOR-AMCP-NPC Good Practice Task Force Report. Value Health. 2014;17(2):174–182. doi: 10.1016/j.jval.2014.01.003. - DOI - PubMed
    1. Sargent RG. Validation and verification of simulation models. In: Ingalls R, Rossetti M, Smith J, Peters B, editors. 2004 Winter Simulation Conference Piscataway, NJ. IEEE Press; 2004.
    1. Law AM. How to build valid and credible simulation models. Peters B, Smith J, Medeiros D, Rohrer M, editors. 2001 Winter Simulation Conference Arlington, VA. IEEE Press; 2001.

Publication types

LinkOut - more resources