We
investigated
the
factors
underlying
naturalistic
action
recognition
and
understanding,
as
well
theerrors
occurring
during
failures.
Participants
saw
full-light
stimuli
of
ten
different
whole-bodyactions
presented
in
three
conditions:
normal
videos,
videos
with
temporal
orderof
frames
scrambled,
single
static
representative
frames.
After
each
stimulus
presentationparticipants
completed
one
two
tasks
-
a
forced
choice
task
where
they
were
given
potentialaction
labels
options,
or
free
description
task,
could
describe
performedin
their
own
words.
While
generally,
combination
form,
motion,
temporalinformation
led
to
highest
for
some
actions
form
information
was
sufficient
andadding
motion
did
not
increase
accuracy.
also
analysed
errorsin
found
primarily
types.
One
type
errors
on
semanticlevel,
while
other
consisted
reverting
kinematic
level
body
part
processing
without
anyattribution
semantics.
elaborate
these
results
context
perception.
Wiley Interdisciplinary Reviews Cognitive Science,
Год журнала:
2023,
Номер
14(5)
Опубликована: Апрель 25, 2023
Abstract
The
findings
of
cognitive
linguistics
demonstrate
the
thoroughly
embodied
grounding
linguistic
constructions
and
meaning
ranging
from
abstract
thought
to
interactive
communication.
A
historical
survey
updated
summary
work
in
this
area
illustrates
many
layers
bodily
that
we
rely
on
when
thinking
communicating
as
human
beings.
Key
distinctions,
definitions,
clarifications,
plus
an
overview
key
works
cognition
provide
necessary
context
for
understanding
specific
aspects
embodiment,
including
schemas
iconicity,
mapping
metaphor,
categories
projections,
grammar
thought,
intersubjectivity,
textual
meaning.
Realigning
philosophical
presuppositions
with
has
important
consequences:
Body
mind
can
be
reunited
lived
experience.
Both
imaginative
rational
understood
reliant
same
movement
memory
structures.
Even
most
habituated
form‐content
relationships
language
growing
out
vital
networks
real‐world
experiential
relations,
personal
interpersonal.
And
instead
being
narrow
purview
semantics
pragmatics,
study
embraced
purpose
function
linguistics.
These
consequences
have
potential
revolutionizing
scientific
inquiry
theory
building
across
a
wide
array
disciplines.
This
article
is
categorized
under:
Linguistics
>
Cognitive
Psychology
Language
Philosophy
Foundations
Science
CAAI Transactions on Intelligence Technology,
Год журнала:
2025,
Номер
unknown
Опубликована: Март 26, 2025
ABSTRACT
To
overcome
the
deficiencies
of
single‐modal
emotion
recognition
based
on
facial
expression
or
bodily
posture
in
natural
scenes,
a
spatial
guidance
and
temporal
enhancement
(SG‐TE)
network
is
proposed
for
facial‐bodily
recognition.
First,
ResNet50,
DNN
ransformer
models
are
used
to
capture
texture
vectors,
skeleton
vectors
whole‐body
geometric
an
intraframe
correlation
attention
(S‐CAG)
mechanism,
which
guides
vector
by
vector,
designed
exploit
potential
emotional
between
face
posture.
Second,
interframe
significant
segment
(T‐SSE)
structure
embedded
into
transformer
enhance
high
intensity
frame
information
avoid
asynchrony.
Finally,
adaptive
weight
assignment
(M‐AWA)
strategy
constructed
realise
fusion.
The
experimental
results
BabyRobot
Emotion
Dataset
(BRED)
Context‐Aware
Recognition
(CAER)
dataset
indicate
that
reaches
accuracies
81.61%
89.39%,
9.61%
9.46%
higher
than
those
baseline
network,
respectively.
Compared
with
state‐of‐the‐art
methods,
method
achieves
7.73%
20.57%
accuracy
methods
posture,
respectively,
2.16%
dual‐modal
Therefore,
method,
adaptively
fuses
complementary
improves
quality
real‐world
scenarios.
PLoS ONE,
Год журнала:
2024,
Номер
19(2), С. e0293920 - e0293920
Опубликована: Фев. 1, 2024
Faces
are
a
primary
means
of
conveying
social
information
between
humans.
One
important
factor
modulating
the
perception
human
faces
is
emotional
expression.
Face
inversion
also
affects
perception,
including
judgments
expression,
possibly
through
disruption
configural
processing.
intriguing
effect
an
illusion
whereby
appear
to
be
physically
smaller
when
upright
than
inverted.
This
appears
highly
selective
for
faces.
In
this
study,
we
investigated
whether
expression
face
(neutral,
happy,
afraid,
and
angry)
modulates
magnitude
size
illusion.
Results
showed
that
all
four
expressions,
there
was
clear
bias
inverted
stimuli
judged
as
larger
ones.
demonstrates
no
influence
on
underestimation
faces,
surprising
result
given
recognition
different
expressions
known
affected
unevenly
by
inversion.
discussed
considering
recent
neuroimaging
research
which
used
population
receptive
field
(pRF)
mapping
investigate
neural
mechanisms
underlying
features
may
provide
explanation
how
one.
Elucidation
would
lead
greater
understanding
humans
communicate.
Frontiers in Integrative Neuroscience,
Год журнала:
2024,
Номер
18
Опубликована: Март 12, 2024
We
investigated
the
factors
underlying
naturalistic
action
recognition
and
understanding,
as
well
errors
occurring
during
failures.
Participants
saw
full-light
stimuli
of
ten
different
whole-body
actions
presented
in
three
conditions:
normal
videos,
videos
with
temporal
order
frames
scrambled,
single
static
representative
frames.
After
each
stimulus
presentation
participants
completed
one
two
tasks-a
forced
choice
task
where
they
were
given
potential
labels
options,
or
a
free
description
task,
could
describe
performed
their
own
words.
While
generally,
combination
form,
motion,
information
led
to
highest
for
some
form
was
sufficient
adding
motion
did
not
increase
accuracy.
also
analyzed
found
primarily
types.
One
type
error
on
semantic
level,
while
other
consisted
reverting
kinematic
level
body
part
processing
without
any
attribution
semantics.
elaborate
these
results
context
perception.
The
study
reported
in
the
paper
focused
on
applying
a
set
of
affective
body
gestures
extracted
from
Geneva
Multimodal
Emotion
Portrayals
(GEMEP)
dataset
to
two
pedagogical
animated
agents
an
online
lecture
context
and
studying
effects
those
subjects'
perception
agents'
emotions.
131
participants
completed
survey
where
they
watched
different
animations
featuring
female
male
agent
expressing
six
emotions
(anger,
joy,
sadness,
disgust,
fear,
surprise)
while
delivering
segment.
After
watching
animations,
subjects
were
asked
identify
Findings
showed
that
only
one
expression
angry
emotion
by
was
recognized
with
acceptable
level
accuracy
(recognition
rate
>75%),
remaining
low
recognition
rates
ranging
1.5%
64%.
A
mapping
results
Russel's
Circumplex
model
participants'
identification
levels
arousal
valence
slightly
more
accurate
than
quality
but
still
<75%
for
5
out
6
emotions).
Results
suggest
hand
arm
alone
are
not
sufficient
conveying
agent's
type
arousal.
Brain Sciences,
Год журнала:
2024,
Номер
14(12), С. 1172 - 1172
Опубликована: Ноя. 22, 2024
Background/Objectives:
As
a
form
of
visual
input,
bodily
expressions
can
be
maintained
and
manipulated
in
working
memory
(VWM)
over
short
period
time.
While
the
prefrontal
cortex
(PFC)
plays
an
indispensable
role
top-down
control,
it
remains
largely
unclear
whether
this
region
also
modulates
VWM
storage
during
delay
period.
Therefore,
two
primary
goals
study
were
to
examine
emotional
bodies
would
elicit
heightened
brain
activity
among
areas
such
as
PFC
extrastriate
body
area
(EBA)
effects
subsequently
modulate
functional
connectivity
patterns
for
active
maintenance
periods.
Methods:
During
magnetic
resonance
imaging
(fMRI)
scanning,
participants
performed
delayed-response
task
which
they
instructed
view
maintain
stimulus
before
emotion
categorization
(happiness,
anger,
neutral).
If
processing
happy
angry
consume
increased
cognitive
demands,
stronger
activation
its
with
perceptual
observed.
Results:
Results
based
on
univariate
multivariate
analyses
conducted
data
collected
presentation
revealed
enhanced
left
EBA.
Importantly,
subsequent
delayed-period
using
psychophysiological
interaction
model
indicated
that
between
EBA
increases
compared
neutral
bodies.
Conclusions:
The
emotion-modulated
coupling
deepens
our
understanding
organization
underlying
information.
