BACKGROUND
Despite
the
Coronary
Artery
Reporting
and
Data
System
(CAD-RADS)
providing
a
standardized
approach,
radiologists
continue
to
favor
free-text
reports.
This
preference
creates
significant
challenges
for
data
extraction
analysis
in
longitudinal
studies,
potentially
limiting
large-scale
research
quality
assessment
initiatives.
OBJECTIVE
To
evaluate
ability
of
GPT-4o
model
convert
real-world
coronary
CT
angiography
(CCTA)
reports
into
structured
automatically
identify
CAD-RADS
categories
P
Categories.
METHODS
retrospective
study
analyzed
CCTA
from
January
2024
July
2024.
A
subset
25
was
used
prompt
engineering
instruct
LLMs
extracting
categories,
Categories,
presence
myocardial
bridges
non-calcified
plaques.
Reports
were
processed
using
API
custom
Python
scripts.
The
ground
truth
established
by
radiologist
based
on
2.0
guidelines.
Model
performance
assessed
accuracy,
sensitivity,
specificity,
F1
score.
Intra-rater
reliability
Cohen's
Kappa
coefficient.
RESULTS
Among
999
patients
(median
age
66
years,
range
58-74;
650
males),
categorization
showed
accuracy
0.98-1.00,
sensitivity
0.95-1.00,
specificity
score
0.96-1.00.
Categories
demonstrated
0.97-1.00,
0.90-1.00,
0.91-0.99.
Myocardial
bridge
detection
achieved
0.98
calcified
plaque
accuracy.
values
all
classifications
exceeded
0.98.
CONCLUSIONS
efficiently
accurately
converts
data,
excelling
classification,
burden
assessment,
Meta-Radiology,
Journal Year:
2024,
Volume and Issue:
2(2), P. 100080 - 100080
Published: May 8, 2024
Influenced
by
ChatGPT,
artificial
intelligence
(AI)
large
models
have
witnessed
a
global
upsurge
in
model
research
and
development.
As
people
enjoy
the
convenience
this
AI
model,
more
subdivided
fields
are
gradually
being
proposed,
especially
radiology
imaging
field.
This
article
first
introduces
development
history
of
models,
technical
details,
workflow,
working
principles
multimodal
video
generation
models.
Secondly,
we
summarize
latest
progress
education,
report
generation,
applications
unimodal
radiology.
Finally,
paper
also
summarizes
some
challenges
radiology,
with
aim
better
promoting
rapid
revolution
field
radiography.
BACKGROUND
Despite
the
Coronary
Artery
Reporting
and
Data
System
(CAD-RADS)
providing
a
standardized
approach,
radiologists
continue
to
favor
free-text
reports.
This
preference
creates
significant
challenges
for
data
extraction
analysis
in
longitudinal
studies,
potentially
limiting
large-scale
research
quality
assessment
initiatives.
OBJECTIVE
To
evaluate
ability
of
GPT-4o
model
convert
real-world
coronary
CT
angiography
(CCTA)
reports
into
structured
automatically
identify
CAD-RADS
categories
P
Categories.
METHODS
retrospective
study
analyzed
CCTA
from
January
2024
July
2024.
A
subset
25
was
used
prompt
engineering
instruct
LLMs
extracting
categories,
Categories,
presence
myocardial
bridges
non-calcified
plaques.
Reports
were
processed
using
API
custom
Python
scripts.
The
ground
truth
established
by
radiologist
based
on
2.0
guidelines.
Model
performance
assessed
accuracy,
sensitivity,
specificity,
F1
score.
Intra-rater
reliability
Cohen's
Kappa
coefficient.
RESULTS
Among
999
patients
(median
age
66
years,
range
58-74;
650
males),
categorization
showed
accuracy
0.98-1.00,
sensitivity
0.95-1.00,
specificity
score
0.96-1.00.
Categories
demonstrated
0.97-1.00,
0.90-1.00,
0.91-0.99.
Myocardial
bridge
detection
achieved
0.98
calcified
plaque
accuracy.
values
all
classifications
exceeded
0.98.
CONCLUSIONS
efficiently
accurately
converts
data,
excelling
classification,
burden
assessment,