Hierarchical Decision Ensembles- An inferential framework for uncertain Human-AI collaboration in forensic examinations.

Ganesh Krishnan,

Heike Hofmann

arXiv (Cornell University), Journal Year: 2021, Volume and Issue: unknown

Published: Oct. 31, 2021

Forensic examination of evidence like firearms and toolmarks, traditionally involves a visual therefore subjective assessment similarity two questioned items. Statistical models are used to overcome this subjectivity allow specification error rates. These generally quite complex produce abstract results at different levels the analysis. Presenting such metrics complicated examiners is challenging, as do not have substantial statistical training accurately interpret results. This creates distrust in modelling lowers rate acceptance more objective measures that discipline large striving for. We present an inferential framework for assessing model its output. The designed calibrate trust forensic experts by bridging gap between domain specific knowledge predictive results, allowing validate claims while critically

Language: Английский

Interpol review of forensic firearm examination 2019–2022 DOI Creative Commons
Erwin J.A.T. Mattijssen, Wim Kerkhoff,

Rob Hermsen

et al.

Forensic Science International Synergy, Journal Year: 2022, Volume and Issue: 6, P. 100305 - 100305

Published: Dec. 14, 2022

Language: Английский

Citations

6

Where-to-from-here plenary panel – personal reflections DOI
Caroline Gibb

Australian Journal of Forensic Sciences, Journal Year: 2024, Volume and Issue: 56(sup1), P. 197 - 200

Published: April 28, 2024

As a seasoned forensic scientist and practitioner with more than two decades of experience spanning both industry research, I have invested considerable time in reflecting on the current state future direction science. This reflection, fuelled by my recent participation professional conference (The 23rd Triennial Meeting International Association Forensic Sciences (IAFS)), has reinforced perspective industry's advancement critical areas requiring attention to promote positive reform. In this narrative, articulate insights garnered during plenary panel session, firmly grounded vision for field's advancement.

Language: Английский

Citations

0

Hidden multiple comparisons increase forensic error rates DOI Creative Commons
Susan VanderPlas, Alicia L. Carriquiry, Heike Hofmann

et al.

Proceedings of the National Academy of Sciences, Journal Year: 2024, Volume and Issue: 121(25)

Published: June 10, 2024

When wires are cut, the tool produces striations on cut surface; as in other forms of forensic analysis, these striation marks used to connect evidence source that created them. Here, we argue practice comparing two wire surfaces introduces complexities not present better-investigated examination toolmarks such those observed bullets, comparisons inherently require multiple distinct comparisons, increasing expected false discovery rate. We call attention comparison problem and relate it situations forensics involve database searches.

Language: Английский

Citations

0

Jack of all trades, master of one: Domain-specific and domain-general contributions to perceptual expertise in visual comparison DOI Open Access
Bethany Growns, James D. Dunn, Erwin J.A.T. Mattijssen

et al.

Published: June 19, 2024

People vary substantially in their ability to visually compare or ‘match’ patterns – some are much more accurate than others. This is a varied and generalisable the general population for example, novices who excel fingerprint-matching also firearms-matching. Forensic feature-comparison examiners this task, but no research has investigated generalisability of skill. The extent which superiority will generalise predict related tasks unclear. In study, we perceptual expertise amongst forensic by comparing performance other within outside area expertise. We recruited 85 experts from three disciplines (face, fingerprint, firearms) asked them complete four different visual comparison tasks: faces, fingerprints, firearms, novel objects. Examiners displayed domain-specific expertise: they outperformed domain Yet skill generalised: These results provide key insight into domain-general contributions examiners’ lends still leads best performance.

Language: Английский

Citations

0

Jack of all trades, master of one: domain-specific and domain-general contributions to perceptual expertise in visual comparison DOI Creative Commons
Bethany Growns, James D. Dunn, Rebecca K. Helm

et al.

Cognitive Research Principles and Implications, Journal Year: 2024, Volume and Issue: 9(1)

Published: Oct. 29, 2024

Abstract Perceptual expertise is typically domain-specific and rarely generalises beyond an expert’s domain of experience. Forensic feature-comparison examiners outperform the norm in visual comparison, but emerging research suggests that they show advantages on other similar tasks outside their expertise. For example, fingerprint not only novices also face comparison. Yet, extent to which skills generalise poorly understood. In this study, we investigated generalisability perceptual amongst forensic by comparing performance within area We recruited 85 experts from three disciplines (face, fingerprint, firearms) asked them complete four different comparison tasks: faces, fingerprints, firearms, novel-objects. Examiners displayed expertise: outperformed some skill generalised: However, while individual differences examiners’ experience were associated with a novel task, related expert domain. These results provide key insight into domain-general contributions lends generalisable tasks, best still seen

Language: Английский

Citations

0

Cross entropy and log likelihood ratio cost as performance measures for multi‐conclusion categorical outcomes scales DOI

Eric M. Warren,

John C. Handley,

H. David Sheets

et al.

Journal of Forensic Sciences, Journal Year: 2024, Volume and Issue: unknown

Published: Dec. 10, 2024

Abstract The inconclusive category in forensics reporting is the appropriate response many cases, but it poses challenges estimating an “error rate”. We discuss use of a class information‐theoretic measures related to cross entropy as alternative set metrics that allows for performance evaluation results presented using multi‐category scales. This paper shows how this metrics, and particular log likelihood ratio cost, which already with forensic methods machine learning communities, can be readily adapted widely used multiple conclusions Bayesian credible intervals on these estimated numerical methods. application published test shown. It demonstrated, results, reducing number categories proficiency from five or six three increases entropy, indicating higher was justified, they increased level agreement ground truth.

Language: Английский

Citations

0

Methodological problems in every black-box study of forensic firearm comparisons DOI Creative Commons
Maria Cuellar, Susan VanderPlas, Amanda Luby

et al.

Law Probability and Risk, Journal Year: 2024, Volume and Issue: 23(1)

Published: Jan. 1, 2024

Abstract Reviews conducted by the National Academy of Sciences (2009) and President’s Council Advisors on Science Technology (2016) concluded that field forensic firearm comparisons has not been demonstrated to be scientifically valid. Scientific validity requires adequately designed studies examiner performance in terms accuracy, repeatability, reproducibility. Researchers have performed “black-box” with goal estimating these measures. As statisticians expertise experimental design, we a literature search such date then evaluated design statistical analysis methods used each study. Our conclusion is all our methodological flaws are so grave they render invalid, is, incapable establishing scientific firearms examination. Notably, error rates among examiners, both collectively individually, remain unknown. Therefore, statements about common origin bullets or cartridge cases based examination “individual” characteristics do basis. We provide some recommendations for future studies.

Language: Английский

Citations

0

Automated interpretation of comparison scores for firearm toolmarks on cartridge case primers DOI
Martin Baiker,

Ivo Alberink,

Laura B. Granell

et al.

Forensic Science International, Journal Year: 2023, Volume and Issue: 353, P. 111858 - 111858

Published: Oct. 12, 2023

Language: Английский

Citations

0

2022 Firearm and Toolmarks Policy and Practice Forum DOI Creative Commons
Nicole S. Jones, John Grassel

Published: May 6, 2022

The National Institute of Justice (NIJ) and the Forensic Technology Center Excellence, an NIJ program hosted a four-day symposium, January 11–14, 2022. symposium included presentations panel discussions on topics relevant to recent advances in firearm toolmark examination with focus future. brought together 685 criminal justice processionals explore implementation three-dimensional (3D) imaging technologies, best practices for forensic evidence, federal initiatives, gun crime intelligence, black box studies examination, legal challenges admissibility current evidence engineering solutions that will be used court future, Organization Scientific Area Committee (OSAC) standards reporting, uniform language testimony conclusion scales. provided examples how agencies implement new technologies firearms incorporate statistics add weight comparisons, address issues, operationalize intelligence improve public safety share information community. also platform discuss series considerations forensic, law enforcement, greater community could help support successful national transition accelerate adoption examination.

Language: Английский

Citations

0

Laboratory Analysis of Fired Ammunition DOI
Erwin J.A.T. Mattijssen, Fabiano Riva

Elsevier eBooks, Journal Year: 2022, Volume and Issue: unknown, P. 381 - 386

Published: Nov. 4, 2022

Language: Английский

Citations

0