1
|
Zhang Y, Xie Y, Zhao Q, Xu X, Deng H, Yi N. Vision-Based Grasping Method for Prosthetic Hands via Geometry and Symmetry Axis Recognition. Biomimetics (Basel) 2025; 10:242. [PMID: 40277641 PMCID: PMC12025014 DOI: 10.3390/biomimetics10040242] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2025] [Revised: 04/11/2025] [Accepted: 04/13/2025] [Indexed: 04/26/2025] Open
Abstract
This paper proposes a grasping method for prosthetic hands based on object geometry and symmetry axis. The method utilizes computer vision to extract the geometric shape, spatial position, and symmetry axis of target objects and selects appropriate grasping modes and postures through the extracted features. First, grasping patterns are classified based on the analysis of hand-grasping movements. A mapping relationship between object geometry and grasp patterns is established. Then, target object images are captured using binocular depth cameras, and the YOLO algorithm is employed for object detection. The SIFT algorithm is applied to extract the object's symmetry axis, thereby determining the optimal grasp point and initial hand posture. An experimental platform is built based on a seven-degree-of-freedom (7-DoF) robotic arm and a multi-mode prosthetic hand to conduct grasping experiments on objects with different characteristics. Experimental results demonstrate that the proposed method achieves high accuracy and real-time performance in recognizing object geometric features. The system can automatically match appropriate grasp modes according to object features, improving grasp stability and success rate.
Collapse
Affiliation(s)
- Yi Zhang
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, Central South University, Changsha 410083, China; (Y.Z.); (Y.X.); (Q.Z.); (X.X.)
- College of Mechanical & Electrical Engineering, Central South University, Changsha 410083, China
| | - Yanwei Xie
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, Central South University, Changsha 410083, China; (Y.Z.); (Y.X.); (Q.Z.); (X.X.)
- College of Mechanical & Electrical Engineering, Central South University, Changsha 410083, China
| | - Qian Zhao
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, Central South University, Changsha 410083, China; (Y.Z.); (Y.X.); (Q.Z.); (X.X.)
- College of Mechanical & Electrical Engineering, Central South University, Changsha 410083, China
| | - Xiaolei Xu
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, Central South University, Changsha 410083, China; (Y.Z.); (Y.X.); (Q.Z.); (X.X.)
- College of Mechanical & Electrical Engineering, Central South University, Changsha 410083, China
| | - Hua Deng
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, Central South University, Changsha 410083, China; (Y.Z.); (Y.X.); (Q.Z.); (X.X.)
- College of Mechanical & Electrical Engineering, Central South University, Changsha 410083, China
| | - Nianen Yi
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, Central South University, Changsha 410083, China; (Y.Z.); (Y.X.); (Q.Z.); (X.X.)
- College of Mechanical & Electrical Engineering, Central South University, Changsha 410083, China
| |
Collapse
|
2
|
Medina-Coello P, Salvador-Domínguez B, Badesa FJ, Rodríguez Corral JM, Plastrotmann H, Morgado-Estévez A. Anthropomorphic Robotic Hand Prosthesis Developed for Children. Biomimetics (Basel) 2024; 9:401. [PMID: 39056842 PMCID: PMC11275007 DOI: 10.3390/biomimetics9070401] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/29/2024] [Revised: 06/21/2024] [Accepted: 06/29/2024] [Indexed: 07/28/2024] Open
Abstract
The use of both hands is a common practice in everyday life. The capacity to interact with the environment is largely dependent on the ability to use both hands. A thorough review of the current state of the art reveals that commercially available prosthetic hands designed for children are very different in functionality from those developed for adults, primarily due to prosthetic hands for adults featuring a greater number of actuated joints. Many times, patients stop using their prosthetic device because they feel that it does not fit well in terms of shape and size. With the idea of solving these problems, the design of HandBot-Kid has been developed with the anthropomorphic qualities of a child between the ages of eight and twelve in mind. Fitting the features of this age range, the robotic hand has a length of 16 cm, width of 7 cm, thickness of 3.6 cm, and weight of 328 g. The prosthesis is equipped with a total of fifteen degrees of freedom (DOF), with three DOFs allocated to each finger. The concept of design for manufacturing and assembly (DFMA) has been integrated into the development process, enabling the number of parts to be optimized in order to reduce the production time and cost. The utilization of 3D printing technology in conjunction with aluminum machining enabled the manufacturing process of the robotic hand prototype to be streamlined. The flexion-extension movement of each finger exhibits a trajectory that is highly similar to that of a real human finger. The four-bar mechanism integrated into the finger design achieves a mechanical advantage (MA) of 40.33% and a fingertip pressure force of 10.23 N. Finally, HandBot-Kid was subjected to a series of studies and taxonomical tests, including Cutkosky (16 points) and Kapandji (4 points) score tests, and the functional results were compared with some commercial solutions for children mentioned in the state of the art.
Collapse
Affiliation(s)
- Pablo Medina-Coello
- Applied Robotics Research Group (TEP-940), School of Engineering, University of Cadiz, 11519 Puerto Real, Spain; (B.S.-D.); (J.M.R.C.); (A.M.-E.)
| | - Blas Salvador-Domínguez
- Applied Robotics Research Group (TEP-940), School of Engineering, University of Cadiz, 11519 Puerto Real, Spain; (B.S.-D.); (J.M.R.C.); (A.M.-E.)
| | - Francisco J. Badesa
- Centre for Automation and Robotics (CAR) UPM-CSIC, Universidad Politecnica de Madrid (UPM), 28040 Madrid, Spain;
| | - José María Rodríguez Corral
- Applied Robotics Research Group (TEP-940), School of Engineering, University of Cadiz, 11519 Puerto Real, Spain; (B.S.-D.); (J.M.R.C.); (A.M.-E.)
| | - Henrik Plastrotmann
- Department of Electrical Engineering and Computer Science, University of Applied Science Münster, 48565 Steinfurt, Germany;
| | - Arturo Morgado-Estévez
- Applied Robotics Research Group (TEP-940), School of Engineering, University of Cadiz, 11519 Puerto Real, Spain; (B.S.-D.); (J.M.R.C.); (A.M.-E.)
| |
Collapse
|
3
|
Zhai Y, Wu S, Hu Q, Zhou W, Shen Y, Yan X, Ma Y. Influence of grasping postures on skin deformation of hand. Sci Rep 2023; 13:21416. [PMID: 38049461 PMCID: PMC10695991 DOI: 10.1038/s41598-023-48658-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2022] [Accepted: 11/29/2023] [Indexed: 12/06/2023] Open
Abstract
To investigate the influence of different grasping postures on the hand's skin deformation, a handheld 3D EVA SCANNER was used to obtain 3D models of 111 women in five postures, including a straight posture and grasping cylinders with various diameters (4/6/8/10 cm). Skin relaxation strain ratio ([Formula: see text]) and surface area skin relaxation strain ratio ([Formula: see text]) were used as measures of skin deformation between two landmarks and multiple landmarks, respectively. The effects of grasping posture on skin deformation in different directions were analyzed. The results revealed significant variations in skin deformation among different grasping postures, except for the width of middle finger metacarpal and the length of middle finger's proximal phalanx. The [Formula: see text] increased with decreasing grasping object diameter, ranging from 5 to 18% on the coronal axis, and from 4 to 20% on the vertical axis. The overall variation of [Formula: see text] ranged from 5 to 37.5%, following the same trend as [Formula: see text] except for the surface area of tiger's mouth, which exhibited a maximum difference of 10.9% with significant differences. These findings have potential applications in improving the design of hand equipment and understanding hand movement characteristics.
Collapse
Affiliation(s)
- Yanru Zhai
- School of Textile and Clothing, Nantong University, Nantong, 226019, China
| | - Shaoguo Wu
- School of Textile and Clothing, Nantong University, Nantong, 226019, China
| | - Qinyue Hu
- School of Textile and Clothing, Nantong University, Nantong, 226019, China
| | - Wenjing Zhou
- School of Textile and Clothing, Nantong University, Nantong, 226019, China
| | - Yue Shen
- School of Textile and Clothing, Nantong University, Nantong, 226019, China.
| | - Xuefeng Yan
- School of Textile and Clothing, Nantong University, Nantong, 226019, China.
| | - Yan Ma
- School of Textile and Clothing, Nantong University, Nantong, 226019, China.
| |
Collapse
|
4
|
Zhang Y, Zhao Q, Deng H, Xu X. Design of a Multi-Mode Mechanical Finger Based on Linkage and Tendon Fusion Transmission. Biomimetics (Basel) 2023; 8:316. [PMID: 37504204 PMCID: PMC10807053 DOI: 10.3390/biomimetics8030316] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2023] [Revised: 07/10/2023] [Accepted: 07/11/2023] [Indexed: 07/29/2023] Open
Abstract
Today, most humanoid mechanical fingers use an underactuated mechanism driven by linkages or tendons, with only a single and fixed grasping trajectory. This paper proposes a new multi-mode humanoid finger mechanism based on linkage and tendon fusion transmission, which is embedded with an adjustable-length tendon mechanism to achieve three types of grasping mode. The structural parameters of the mechanism are optimized according to the kinematic and static models. Furthermore, a discussion was conducted on how to set the speed ratio of the linkage driving motor and the tendon driving motor to adjust the length and tension of the tendon, in order to achieve the switching of the shape-adaptive, coupled-adaptive, and variable coupling-adaptive grasping modes. Finally, the multi-mode functionality of the proposed finger mechanism was verified through multiple grasping experiments.
Collapse
Affiliation(s)
- Yi Zhang
- College of Mechanical & Electrical Engineering, Central South University, Changsha 410083, China; (Y.Z.); (Q.Z.); (X.X.)
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, Central South University, Changsha 410083, China
| | - Qian Zhao
- College of Mechanical & Electrical Engineering, Central South University, Changsha 410083, China; (Y.Z.); (Q.Z.); (X.X.)
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, Central South University, Changsha 410083, China
| | - Hua Deng
- College of Mechanical & Electrical Engineering, Central South University, Changsha 410083, China; (Y.Z.); (Q.Z.); (X.X.)
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, Central South University, Changsha 410083, China
| | - Xiaolei Xu
- College of Mechanical & Electrical Engineering, Central South University, Changsha 410083, China; (Y.Z.); (Q.Z.); (X.X.)
- State Key Laboratory of Precision Manufacturing for Extreme Service Performance, Central South University, Changsha 410083, China
| |
Collapse
|
5
|
Liu Y, Jiang L, Liu H, Ming D. A straightforward and miniature implementation method of postural synergies to replicate human grasp characteristics accurately and intuitively. BIOINSPIRATION & BIOMIMETICS 2022; 17:026012. [PMID: 34874283 DOI: 10.1088/1748-3190/ac3f7f] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/29/2021] [Accepted: 12/02/2021] [Indexed: 06/13/2023]
Abstract
Postural synergies have great potential for replicating human grasp characteristics, simplify grasp control and reduce the number of hardware actuators required. However, due to their complex mapping relationship and jagged transmission ratio, the implemented mechanisms are always too bulky and loose, which greatly limits their application. With current solutions, the replication accuracy of motion characteristics or intuitive control is compromised, and hitherto no work in the literature has reported the replication errors. To overcome these limitations, we present a novel design framework to determine the actuation configuration, implementation scheme and physical parameters. In this way, the mechanism is miniaturized and can be compactly embedded in the palm of the hand. A self-contained synergistic robot hand with integrated mechanism, sensors and a suitable electrical system is built. The experiments demonstrate that the robot hand can accurately replicate the motion characteristics of two primary synergies, maintain intuitive control to simplify grasp control, has a good capability for anthropomorphic motion and can grasp different objects with versatile grasp functionality.
Collapse
Affiliation(s)
- Yuan Liu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China
| | - Li Jiang
- State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin, 150001, People's Republic of China
| | - Hong Liu
- State Key Laboratory of Robotics and System, Harbin Institute of Technology, Harbin, 150001, People's Republic of China
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China
| |
Collapse
|