A workflow for collecting and understanding stories at scale, supported by artificial intelligence
Evaluation,
Год журнала:
2025,
Номер
unknown
Опубликована: Апрель 15, 2025
This
article
presents
an
artificial
intelligence-assisted
causal
mapping
pipeline
for
gathering
and
analysing
stakeholder
perspectives
at
scale.
Evidence
relevant
to
constructing
a
programme
theory,
as
well
evidence
the
influences
flowing
through
it,
are
both
collected
same
time,
without
evaluator
needing
possess
prior
theory.
The
method
uses
intelligence
interviewer
conduct
interviews,
automated
coding
identify
claims
in
transcripts,
synthesise
visualise
results.
authors
tested
this
approach
by
interviewing
participants
about
problems
facing
United
States.
Results
indicate
that
can
efficiently
collect
process
qualitative
data,
producing
useful
maps
capture
respondents’
views.
discusses
potential
of
evaluation,
enabling
rapid,
large-scale
analysis.
It
also
notes
limitations
ethical
concerns,
emphasising
need
human
oversight
verification.
Язык: Английский
Artificial intelligence and the future of evaluation education: Possibilities and prototypes
New Directions for Evaluation,
Год журнала:
2023,
Номер
2023(178-179), С. 97 - 109
Опубликована: Июнь 1, 2023
Abstract
Advancements
in
Artificial
Intelligence
(AI)
signal
a
paradigmatic
shift
with
the
potential
for
transforming
many
various
aspects
of
society,
including
evaluation
education,
implications
subsequent
practice.
This
article
explores
AI
evaluator
and
education.
Specifically,
discusses
key
issues
education
equitable
language
access
to
navigating
program,
social
science,
theory,
understanding
theorists
their
philosophies,
case
studies
simulations.
The
paper
then
considers
how
chatbots
might
address
these
issues,
documents
efforts
prototype
three
use
cases
guidance
counselor,
teaching
assistant,
mentor
chatbot
young
emerging
evaluations
or
anyone
who
wants
it.
concludes
ruminations
on
additional
research
activities
topics
such
as
best
integrate
literacy
training
into
existing
programs,
making
strategic
linkages
practitioners,
educators.
Язык: Английский
Evaluation criteria for artificial intelligence
New Directions for Evaluation,
Год журнала:
2023,
Номер
2023(178-179), С. 123 - 134
Опубликована: Июнь 1, 2023
Abstract
Criteria
identify
and
define
the
aspects
on
which
what
we
evaluate
is
judged
play
a
central
role
in
evaluation
practice.
While
work
use
of
AI
burgeoning,
at
time
writing,
set
criteria
to
consider
evaluating
has
not
been
proposed.
As
first
step
this
direction,
Teasdale's
Domains
Framework
was
used
as
lens
through
critically
read
articles
included
special
issue.
This
resulted
identification
eight
domains
for
evaluation.
Three
these
relate
conceptualization
implementation
Five
are
focused
outcomes,
specifically
those
stemming
from
More
needed
further
deliberate
possible
Язык: Английский
Artificial Intelligence and the Future of Evaluation: from Augmented to Automated Evaluation
Digital Government Research and Practice,
Год журнала:
2024,
Номер
unknown
Опубликована: Сен. 13, 2024
The
recent
developments
in
artificial
intelligence
(AI)
are
revolutionizing
professional
practices
across
various
fields,
including
evaluation.
With
its
advanced
automation
and
learning
capabilities,
AI
is
bringing
significant
changing
to
the
way
organizations
societies
function.
Evaluation
no
exception
this
trend,
even
though
evaluators
adopting
at
a
slower
pace.
This
article
examines
ongoing
applications
that
already
improve
enhance
evaluation
practice.
We
advance
our
discussion
by
exploring
potential
impact
of
on
policy
cycle.
Subsequently,
we
analyze
incorporation
into
autonomous
systems
could
design,
implement
evaluate
public
policies
with
minimal
human
supervision.
Язык: Английский