Cited by A compact fingertip-shaped visuo-tactile sensor for manipulator adaptive grasping control

A Compact Visuo-Tactile Robotic Skin for Micron-Level Tactile Perception DOI

Shixin Zhang, Yiyong Yang, Fuchun Sun

et al.

IEEE Sensors Journal, Journal Year: 2024, Volume and Issue: 24(9), P. 15273 - 15282

Published: March 18, 2024

Visuo-tactile skins (VTSs) are classified into coated-type, marker-type, and thermochromic-type. Coating wear resistance spatial resolution central issues for the coated-type VTS. This article proposes a wire-drawing process applied to VTS enhance coating robustness. The has more stable mechanical properties, including high adhesion, adaptive deformation, rupture resistance. Under different degrees of it can remain continuous undamaged. In addition, nanoscale particle distribution, whose microstructures similar spraying provide micron-scale resolution. Via test, higher than coating. Further, combined with multitask learning model identify textures clothing properties 18 fabrics 98% recognition accuracy. results show that using new highly learnable tactile data.

Language: Английский

Citations

PaLmTac: A Vision-Based Tactile Sensor Leveraging Distributed-Modality Design and Modal-Matching Recognition for Soft Hand Perception DOI

Shixin Zhang, Yiyong Yang, Jianhua Shan

et al.

IEEE Journal of Selected Topics in Signal Processing, Journal Year: 2024, Volume and Issue: 18(3), P. 288 - 298

Published: April 1, 2024

This paper proposes a vision-based tactile sensor (VBTS) embedded into the soft hand palm, named PaLmTac. We adopt distributed modality design instead of overlaying function layers. On one hand, problem unrelated integration (texture and temperature) is solved. other combining regional recognition can avoid mixed information. Herein, Level-Regional Feature Extraction Network (LRFE-Net) presented to match design. leverage feature mapping, convolution, vectorization construct mechanism, which extract features in parallel control fusion degrees. The level mechanism balances learning difficulty each modality. Compared with existing VBTSs, PaLmTac optimizes reduces interference. provides novel idea multimodal VBTS sensing expected be applied human-computer interaction scenarios based on fusion.

Language: Английский

Citations

A braille detection system based on visuo-tactile sensing DOI

Shixin Zhang,

J. H. Du,

Yuhao Sun

et al.

Measurement, Journal Year: 2025, Volume and Issue: unknown, P. 116827 - 116827

Published: Jan. 1, 2025

Language: Английский

Citations

Force Measurement Technology of Vision‐Based Tactile Sensor DOI

Bin Fang, Jie Zhao,

Nailong Liu

et al.

Advanced Intelligent Systems, Journal Year: 2024, Volume and Issue: unknown

Published: Sept. 23, 2024

Marker‐type vision‐based tactile sensors (VTS) realize force sensing by calibrating marker vector information. The visualization can provide high‐precision and multimodal information to promote robotic dexterous manipulation development. Considering VTS's contribution measurement, this article reviews the advanced measurement technologies of VTSs. First, working principle marker‐type VTSs is introduced, including single‐layer markers, double‐layer color coding, optical flow. Then, relationship between type category discussed in detail. On basis, process feature extraction summarized, image processing marker‐matching technologies. According learning approach, methods are classified into physical deep models. Further, branches each method analyzed terms input types. Combined with measuring range precision, correlation sensor design, materials, recognition performance further discussed. Finally, difficulties challenges analyzed, future developments proposed. This review aims deepen understanding research progress applications a reference for community technology generations related fields.

Language: Английский

Citations

Tactile data generation and applications based on visuo-tactile sensors: A review DOI

Yuhao Sun, Ning Cheng, Shixin Zhang

et al.

Information Fusion, Journal Year: 2025, Volume and Issue: unknown, P. 103162 - 103162

Published: April 1, 2025

Language: Английский

Citations

Virtual prototyping of vision-based tactile sensors design for robotic-assisted precision machining DOI

Islam Mohamed Zaid, Hussain Sajwani, Mohamad Halwani

et al.

Sensors and Actuators A Physical, Journal Year: 2024, Volume and Issue: 374, P. 115469 - 115469

Published: May 15, 2024

Vision-Based Tactile Sensors (VBTS) play a key role in enhancing the accuracy and efficiency of machining operations robotic-assisted precision systems. Equipped with VBTS, these systems offer contact-based measurements, which are essential accurate components for industries such as aerospace, automotive, medical devices, electronics. This paper presents novel approach to virtual prototyping specifically perpendicularity measurements using Computer-Aided Design (CAD) generation VBTS designs, Finite Element Analysis (FEA) simulations, Sim2Real deep learning achieve high measurements. The enables an understanding contact between different designs machined surfaces terms module shape, thickness, markers' density. Additive manufacturing was employed fabricate molds module, followed by experimental validation robotic arm confirm effectiveness optimized design. results show that deviation from hemispherical shape reduces data quality captured camera, hence increasing prediction errors. Additionally, reducing thickness enhances Importantly distribution density significantly up 92 markers at above it rate improvement becomes less pronounced. An height 20 mm, 2 169 found be within stringent standards aerospace industry 0.58∘ root mean square error, 1.64° max absolute error around roll pitch axis rotation. established methodology can transferred wide variety elastomer-based sensors.

Language: Английский

Citations

An improved vision-based tactile skin with imaging adjustment system to reduce defocusing caused by contact depth changes DOI

Shixin Zhang, Yuhao Sun,

Nailong Liu

et al.

Sensors and Actuators A Physical, Journal Year: 2024, Volume and Issue: 374, P. 115495 - 115495

Published: May 18, 2024

Language: Английский

Citations

Artificial Skin Based on Visuo‐Tactile Sensing for 3D Shape Reconstruction: Material, Method, and Evaluation DOI

Shixin Zhang, Yiyong Yang, Yuhao Sun

et al.

Advanced Functional Materials, Journal Year: 2024, Volume and Issue: unknown

Published: Oct. 25, 2024

Abstract Artificial skin has shown great potential in robot perception and human healthcare. It provides multifunctional tactile sensing, including 3D shape reconstruction, contact feedback, temperature perception, where the reconstruction function is indispensable for dexterous hands cognition interaction. Vision‐based sensor (VTS) an innovative bionic supports high‐resolution, high‐precision, high‐density compared with electronic sensors. Considering unique contribution of visuo‐tactile sensing to artificial skin, this review focuses on techniques VTS. methods are classified into five categories based modalities, hardware categories, modeling approaches: 1) photometric stereo, 2) binocular depth calibration, 3) optical flow, 4) deep learning, 5) ToF (time flight). In addition, association difference analyzed from perspective, development technological details summarized. On basis, challenges direction discussed. This can be viewed as a technology guide provide references interested researchers. Furthermore, it expected promote extensive application VTS skins.

Language: Английский

Citations

A compact fingertip-shaped visuo-tactile sensor for manipulator adaptive grasping control DOI

Shixin Zhang, Yuhao Sun,

Sitong Zuo

et al.

Sensors and Actuators A Physical, Journal Year: 2024, Volume and Issue: 379, P. 115945 - 115945

Published: Oct. 2, 2024

Language: Английский

Citations