Cognitive load classification of mixed reality human computer interaction tasks based on multimodal sensor signals
Yukang Hou,
No information about this author
Qingsheng Xie,
No information about this author
Ning Zhang
No information about this author
et al.
Scientific Reports,
Journal Year:
2025,
Volume and Issue:
15(1)
Published: April 21, 2025
Evaluating
cognitive
load
in
mixed
reality
(MR)
has
become
a
significant
challenge
human-computer
interaction
(HCI).
To
address
this,
we
established
an
MR
multimodal
experimental
platform
with
three
distinct
environments
to
induce
varying
levels
of
load.
Participants
engaged
MR-based
CNC
machine
tool
tasks
within
these
environments.
Using
the
built-in
sensors
HoloLens
2
head-mounted
display
(MR-HMD)
and
wearable
heart
rate
sensors,
collected
device
physiological
data
from
participants
wearing
MR-HMD
while
performing
tasks.
The
was
assessed
by
using
NASA-TLX
questionnaire.
Experimental
results
indicated
that
operation
time
required
environment
increased
49%
under
high
compared
low-load
conditions.
High-load
also
led
anxiety,
frustration,
decreased
performance
among
participants.
Through
comparative
experiments,
identified
suitable
sensor
streams
algorithms
for
classification
designed
digital
twin
factory
warning
prototype
system.
This
system
utilizes
improved
Transformer-CL
algorithm,
achieving
accuracy
95.83%.
provides
warnings,
reducing
risks
associated
work
Language: Английский
VR for construction engineering and management: Review of user experience perspective
Internet of Things,
Journal Year:
2024,
Volume and Issue:
27, P. 101275 - 101275
Published: July 7, 2024
Language: Английский
Mixed Reality as a Perspective Education Tool in Industry 5.0
Lecture notes in mechanical engineering,
Journal Year:
2024,
Volume and Issue:
unknown, P. 60 - 73
Published: Jan. 1, 2024
Language: Английский
A Survey on the Design of Virtual Reality Interaction Interfaces
M. Chen,
No information about this author
Huicong Hu,
No information about this author
Ruiqi Yao
No information about this author
et al.
Sensors,
Journal Year:
2024,
Volume and Issue:
24(19), P. 6204 - 6204
Published: Sept. 25, 2024
Virtual
reality
(VR)
technology
has
made
remarkable
progress
in
recent
years
and
will
be
widely
used
the
future.
As
a
bridge
for
information
exchanges
between
users
VR
systems,
interaction
interface
is
pivotal
providing
with
good
experience
emerged
as
key
research
focus.
In
this
review,
we
conducted
comprehensive
search
of
Web
Science
CNKI
databases
from
2011
to
2023
identify
articles
dedicated
design.
Through
meticulous
analysis
438
articles,
paper
offers
substantial
contribution
emerging
field
interactive
research,
an
in-depth
review
principal
advancements.
This
revealed
that
majority
studies
are
centered
on
practical
case
analyses
within
specific
application
scenarios,
employing
empirical
evaluation
methods
assess
objective
or
subjective
metrics.
We
then
concentrated
elucidating
foundational
principles
design
their
methodologies,
reference
future
endeavors.
Additionally,
limitations,
challenges,
directions
were
discussed,
highlighting
need
further
continuously
refine
development
standards
guidelines
According
findings
there
necessity
enhance
multi-channel
interfaces.
Furthermore,
it
essential
focus
diverse
characteristics
propose
more
inclusive
solutions.
Adopting
interdisciplinary
approaches
could
lead
breakthroughs
creation
personalized
adaptive
Language: Английский
Based on the Research of Computer Graphics Art Design and Visual Communication Design
Published: Dec. 29, 2023
Computer
graphic
art
design
and
visual
communication
are
two
closely
related
fields.
is
a
process
of
using
computer
technology
to
create
effects,
while
method
conveying
information,
emotions
concepts
through
elements.
The
research
development
these
fields
great
significance
for
improving
people's
aesthetic
concept,
satisfying
spiritual
needs
promoting
the
social
culture.
Language: Английский