Replicating the violence risk appraisal guide: a total forensic cohort study.

<h4>Introduction</h4>The performance of violence risk assessment instruments can be primarily investigated by analysing two psychometric properties: discrimination and calibration. Although many studies have examined the discrimination capacity of the Violence Risk Appraisal Guide (VRAG)...

Descripción completa

Guardado en:
Detalles Bibliográficos
Autores principales: Astrid Rossegger, Jérôme Endrass, Juliane Gerth, Jay P Singh
Formato: article
Lenguaje:EN
Publicado: Public Library of Science (PLoS) 2014
Materias:
R
Q
Acceso en línea:https://doaj.org/article/8a89c2b879ed4b56b12ba490a31fdacc
Etiquetas: Agregar Etiqueta
Sin Etiquetas, Sea el primero en etiquetar este registro!
id oai:doaj.org-article:8a89c2b879ed4b56b12ba490a31fdacc
record_format dspace
spelling oai:doaj.org-article:8a89c2b879ed4b56b12ba490a31fdacc2021-11-18T08:28:09ZReplicating the violence risk appraisal guide: a total forensic cohort study.1932-620310.1371/journal.pone.0091845https://doaj.org/article/8a89c2b879ed4b56b12ba490a31fdacc2014-01-01T00:00:00Zhttps://www.ncbi.nlm.nih.gov/pmc/articles/pmid/24632561/?tool=EBIhttps://doaj.org/toc/1932-6203<h4>Introduction</h4>The performance of violence risk assessment instruments can be primarily investigated by analysing two psychometric properties: discrimination and calibration. Although many studies have examined the discrimination capacity of the Violence Risk Appraisal Guide (VRAG) and other actuarial risk assessment tools, few have evaluated how well calibrated these instruments are. The aim of the present investigation was to replicate the development study of the VRAG in Europe including measurements of discrimination and calibration.<h4>Method</h4>Using a prospective study design, we assessed a total cohort of violent offenders in the Zurich Canton of Switzerland using the VRAG prior to discharge from prisons, secure facilities, and outpatient clinics. Assessors adhered strictly to the assessment protocol set out in the instrument's manual. After controlling for attrition, 206 offenders were followed in the community for a fixed period of 7 years. We used charges and convictions for subsequent violent offenses as the outcomes. Receiver operating characteristic analysis was conducted to measure discrimination, and Sanders' decomposition of the Brier score as well as Bayesian credible intervals were calculated to measure calibration.<h4>Results</h4>The discrimination of the VRAG's risk bins was modest (area under the curve = 0.72, 95% CI = 0.63-0.81, p<0.05). However, the calibration of the tool was poor, with Sanders' calibration score suggesting an average assessment error of 21% in the probabilistic estimates associated with each bin. The Bayesian credible intervals revealed that in five out of nine risk bins the intervals did not contain the expected risk rates.<h4>Discussion</h4>Measurement of the calibration validity of risk assessment instruments needs to be improved, as has been done with respect to discrimination. Additional replication studies that focus on the calibration of actuarial risk assessment instruments are needed. Meanwhile, we recommend caution when using the VRAG probabilistic risk estimates in practice.Astrid RosseggerJérôme EndrassJuliane GerthJay P SinghPublic Library of Science (PLoS)articleMedicineRScienceQENPLoS ONE, Vol 9, Iss 3, p e91845 (2014)
institution DOAJ
collection DOAJ
language EN
topic Medicine
R
Science
Q
spellingShingle Medicine
R
Science
Q
Astrid Rossegger
Jérôme Endrass
Juliane Gerth
Jay P Singh
Replicating the violence risk appraisal guide: a total forensic cohort study.
description <h4>Introduction</h4>The performance of violence risk assessment instruments can be primarily investigated by analysing two psychometric properties: discrimination and calibration. Although many studies have examined the discrimination capacity of the Violence Risk Appraisal Guide (VRAG) and other actuarial risk assessment tools, few have evaluated how well calibrated these instruments are. The aim of the present investigation was to replicate the development study of the VRAG in Europe including measurements of discrimination and calibration.<h4>Method</h4>Using a prospective study design, we assessed a total cohort of violent offenders in the Zurich Canton of Switzerland using the VRAG prior to discharge from prisons, secure facilities, and outpatient clinics. Assessors adhered strictly to the assessment protocol set out in the instrument's manual. After controlling for attrition, 206 offenders were followed in the community for a fixed period of 7 years. We used charges and convictions for subsequent violent offenses as the outcomes. Receiver operating characteristic analysis was conducted to measure discrimination, and Sanders' decomposition of the Brier score as well as Bayesian credible intervals were calculated to measure calibration.<h4>Results</h4>The discrimination of the VRAG's risk bins was modest (area under the curve = 0.72, 95% CI = 0.63-0.81, p<0.05). However, the calibration of the tool was poor, with Sanders' calibration score suggesting an average assessment error of 21% in the probabilistic estimates associated with each bin. The Bayesian credible intervals revealed that in five out of nine risk bins the intervals did not contain the expected risk rates.<h4>Discussion</h4>Measurement of the calibration validity of risk assessment instruments needs to be improved, as has been done with respect to discrimination. Additional replication studies that focus on the calibration of actuarial risk assessment instruments are needed. Meanwhile, we recommend caution when using the VRAG probabilistic risk estimates in practice.
format article
author Astrid Rossegger
Jérôme Endrass
Juliane Gerth
Jay P Singh
author_facet Astrid Rossegger
Jérôme Endrass
Juliane Gerth
Jay P Singh
author_sort Astrid Rossegger
title Replicating the violence risk appraisal guide: a total forensic cohort study.
title_short Replicating the violence risk appraisal guide: a total forensic cohort study.
title_full Replicating the violence risk appraisal guide: a total forensic cohort study.
title_fullStr Replicating the violence risk appraisal guide: a total forensic cohort study.
title_full_unstemmed Replicating the violence risk appraisal guide: a total forensic cohort study.
title_sort replicating the violence risk appraisal guide: a total forensic cohort study.
publisher Public Library of Science (PLoS)
publishDate 2014
url https://doaj.org/article/8a89c2b879ed4b56b12ba490a31fdacc
work_keys_str_mv AT astridrossegger replicatingtheviolenceriskappraisalguideatotalforensiccohortstudy
AT jeromeendrass replicatingtheviolenceriskappraisalguideatotalforensiccohortstudy
AT julianegerth replicatingtheviolenceriskappraisalguideatotalforensiccohortstudy
AT jaypsingh replicatingtheviolenceriskappraisalguideatotalforensiccohortstudy
_version_ 1718421753794920448