1
|
Dafarra S, Pattacini U, Romualdi G, Rapetti L, Grieco R, Darvish K, Milani G, Valli E, Sorrentino I, Viceconte PM, Scalzo A, Traversaro S, Sartore C, Elobaid M, Guedelha N, Herron C, Leonessa A, Draicchio F, Metta G, Maggiali M, Pucci D. iCub3 avatar system: Enabling remote fully immersive embodiment of humanoid robots. Sci Robot 2024; 9:eadh3834. [PMID: 38266102 DOI: 10.1126/scirobotics.adh3834] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2023] [Accepted: 12/21/2023] [Indexed: 01/26/2024]
Abstract
We present an avatar system designed to facilitate the embodiment of humanoid robots by human operators, validated through iCub3, a humanoid developed at the Istituto Italiano di Tecnologia. More precisely, the paper makes two contributions: First, we present the humanoid iCub3 as a robotic avatar that integrates the latest significant improvements after about 15 years of development of the iCub series. Second, we present a versatile avatar system enabling humans to embody humanoid robots encompassing aspects such as locomotion, manipulation, voice, and facial expressions with comprehensive sensory feedback including visual, auditory, haptic, weight, and touch modalities. We validated the system by implementing several avatar architecture instances, each tailored to specific requirements. First, we evaluated the optimized architecture for verbal, nonverbal, and physical interactions with a remote recipient. This testing involved the operator in Genoa and the avatar in the Biennale di Venezia, Venice-about 290 kilometers away-thus allowing the operator to visit the Italian art exhibition remotely. Second, we evaluated the optimized architecture for recipient physical collaboration and public engagement on stage, live, at the We Make Future show, a prominent world digital innovation festival. In this instance, the operator was situated in Genoa while the avatar operated in Rimini-about 300 kilometers away-interacting with a recipient who entrusted the avatar with a payload to carry on stage before an audience of approximately 2000 spectators. Third, we present the architecture implemented by the iCub Team for the All Nippon Airways (ANA) Avatar XPrize competition.
Collapse
Affiliation(s)
- Stefano Dafarra
- Artificial and Mechanical Intelligence, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Ugo Pattacini
- iCub Tech Facility, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Giulio Romualdi
- Artificial and Mechanical Intelligence, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Lorenzo Rapetti
- Artificial and Mechanical Intelligence, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Riccardo Grieco
- Artificial and Mechanical Intelligence, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Kourosh Darvish
- Artificial and Mechanical Intelligence, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Gianluca Milani
- Artificial and Mechanical Intelligence, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Enrico Valli
- Artificial and Mechanical Intelligence, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Ines Sorrentino
- Artificial and Mechanical Intelligence, Istituto Italiano di Tecnologia, Genoa, Italy
- School of Computer Science, University of Manchester, Manchester, UK
| | - Paolo Maria Viceconte
- Artificial and Mechanical Intelligence, Istituto Italiano di Tecnologia, Genoa, Italy
- Department of Computer, Control, and Management Engineering, Sapienza Università di Roma, Rome, Italy
| | | | - Silvio Traversaro
- Artificial and Mechanical Intelligence, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Carlotta Sartore
- Artificial and Mechanical Intelligence, Istituto Italiano di Tecnologia, Genoa, Italy
- School of Computer Science, University of Manchester, Manchester, UK
| | - Mohamed Elobaid
- Artificial and Mechanical Intelligence, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Nuno Guedelha
- Artificial and Mechanical Intelligence, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Connor Herron
- Department of Mechanical Engineering, Virginia Tech, Blacksburg, VA, USA
| | - Alexander Leonessa
- Department of Mechanical Engineering, Virginia Tech, Blacksburg, VA, USA
| | - Francesco Draicchio
- Department of Medicine, Epidemiology, Occupational and Environmental Hygiene, Istituto Nazionale Assicurazione Infortuni sul Lavoro (INAIL), Rome, Italy
| | - Giorgio Metta
- iCub Tech Facility, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Marco Maggiali
- iCub Tech Facility, Istituto Italiano di Tecnologia, Genoa, Italy
| | - Daniele Pucci
- Artificial and Mechanical Intelligence, Istituto Italiano di Tecnologia, Genoa, Italy
- School of Computer Science, University of Manchester, Manchester, UK
| |
Collapse
|
2
|
Sorrentino I, Andrade Chavez FJ, Latella C, Fiorio L, Traversaro S, Rapetti L, Tirupachuri Y, Guedelha N, Maggiali M, Dussoni S, Metta G, Pucci D. A Novel Sensorised Insole for Sensing Feet Pressure Distributions. Sensors (Basel) 2020; 20:E747. [PMID: 32013226 PMCID: PMC7038453 DOI: 10.3390/s20030747] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/31/2019] [Revised: 01/18/2020] [Accepted: 01/27/2020] [Indexed: 12/04/2022]
Abstract
Wearable sensors are gaining in popularity because they enable outdoor experimental monitoring. This paper presents a cost-effective sensorised insole based on a mesh of tactile capacitive sensors. Each sensor's spatial resolution is about 4 taxels/cm 2 in order to have an accurate reconstruction of the contact pressure distribution. As a consequence, the insole provides information such as contact forces, moments, and centre of pressure. To retrieve this information, a calibration technique that fuses measurements from a vacuum chamber and shoes equipped with force/torque sensors is proposed. The validation analysis shows that the best performance achieved a root mean square error (RMSE) of about 7 N for the contact forces and 2 N m for the contact moments when using the force/torque shoe data as ground truth. Thus, the insole may be an alternative to force/torque sensors for certain applications, with a considerably more cost-effective and less invasive hardware.
Collapse
Affiliation(s)
- Ines Sorrentino
- Dynamic Interaction Control at Istituto Italiano di Tecnologia, Center for Robotics and Intelligent Systems, Via San Quirico 19D, Genoa, Italy, (F.J.A.C.)
| | - Francisco Javier Andrade Chavez
- Dynamic Interaction Control at Istituto Italiano di Tecnologia, Center for Robotics and Intelligent Systems, Via San Quirico 19D, Genoa, Italy, (F.J.A.C.)
| | - Claudia Latella
- Dynamic Interaction Control at Istituto Italiano di Tecnologia, Center for Robotics and Intelligent Systems, Via San Quirico 19D, Genoa, Italy, (F.J.A.C.)
| | - Luca Fiorio
- iCub Tech at Istituto Italiano di Tecnologia, Via San Quirico 19D, Genoa, Italy, (L.F.)
| | - Silvio Traversaro
- iCub Tech at Istituto Italiano di Tecnologia, Via San Quirico 19D, Genoa, Italy, (L.F.)
| | - Lorenzo Rapetti
- Dynamic Interaction Control at Istituto Italiano di Tecnologia, Center for Robotics and Intelligent Systems, Via San Quirico 19D, Genoa, Italy, (F.J.A.C.)
- Machine Learning and Optimisation, The University of Manchester, Manchester M13 9PL, UK
| | - Yeshasvi Tirupachuri
- Dynamic Interaction Control at Istituto Italiano di Tecnologia, Center for Robotics and Intelligent Systems, Via San Quirico 19D, Genoa, Italy, (F.J.A.C.)
| | - Nuno Guedelha
- Dynamic Interaction Control at Istituto Italiano di Tecnologia, Center for Robotics and Intelligent Systems, Via San Quirico 19D, Genoa, Italy, (F.J.A.C.)
| | - Marco Maggiali
- iCub Tech at Istituto Italiano di Tecnologia, Via San Quirico 19D, Genoa, Italy, (L.F.)
| | - Simeone Dussoni
- iCub Tech at Istituto Italiano di Tecnologia, Via San Quirico 19D, Genoa, Italy, (L.F.)
| | - Giorgio Metta
- Dynamic Interaction Control at Istituto Italiano di Tecnologia, Center for Robotics and Intelligent Systems, Via San Quirico 19D, Genoa, Italy, (F.J.A.C.)
| | - Daniele Pucci
- Dynamic Interaction Control at Istituto Italiano di Tecnologia, Center for Robotics and Intelligent Systems, Via San Quirico 19D, Genoa, Italy, (F.J.A.C.)
| |
Collapse
|
3
|
Woolley PA, Guedelha N, Graves JAM. Anatomy and chromosomes of two intersexual dasyurid marsupials. Reprod Fertil Dev 2003; 15:293-301. [PMID: 14588187 DOI: 10.1071/rd03045] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2003] [Accepted: 09/02/2003] [Indexed: 11/23/2022] Open
Abstract
The intersexual phenotypes of marsupials with XXY and XO chromosome constitutions imply that not all sexual dimorphisms are under the control of testicular hormones and, ultimately, the SRY gene on the Y chromosome. It has been hypothesised that there is a gene on the X chromosome that determines whether either a scrotum will form (one copy of the gene) or a pouch with teats (two copies of the gene). Here, we describe the anatomy and chromosomes of two intersexual dasyurid marsupials. One, a Dasyuroides byrnei, had a pouch, but the reproductive tract was essentially male. The other, a Sminthopsis douglasi, had a hemipouch and a hemiscrotum and the reproductive tract was essentially female. The S. douglasi was a mosaic for cells with an apparently normal 2n = 14, XX female karyotype and cells with 2n = 14 plus (usually) two dot-like supernumerary elements 2n = 14, XX + 2B. The D. byrnei cells examined also had a 2n = 14, XX + 2B karyotype. In fibroblasts from the male and female sides of the S. douglasi, it was possible to assign the 2n = 14, XX karyotype to the male side and the 2n = 14, XX + 2B to the female side.
Collapse
Affiliation(s)
- P A Woolley
- Department of Zoology, La Trobe University, Bundoora, Vic, Australia.
| | | | | |
Collapse
|
4
|
De Leo AA, Guedelha N, Toder R, Voullaire L, Ferguson-Smith MA, O'Brien PC, Graves JA. Comparative chromosome painting between marsupial orders: relationships with a 2n = 14 ancestral marsupial karyotype. Chromosome Res 1999; 7:509-17. [PMID: 10598566 DOI: 10.1023/a:1009233327176] [Citation(s) in RCA: 30] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
A 2n = 14 karyotype is shared by some species in each of the marsupial orders in Australian and American superfamilies, suggesting that the ancestral marsupial chromosome complement was 2n = 14. We have used chromosome painting between distantly related marsupial species to discover whether genome arrangements in 2n = 14 species in two Australian orders support this hypothesis. Cross-species chromosome painting was used to investigate chromosome rearrangements between a macropodid species Macropus eugenii (2n = 16) and a wombat species in a different suborder (Lasiorhinus latifrons, 2n = 14), and a dasyurid species in a different order (Sminthopsis macroura, 2n = 14). We demonstrate that many chromosome regions are conserved between all three species, and deduce how the similar 2n = 14 karyotypes of species in the two orders are related to a common ancestral 2n = 14 karyotype.
Collapse
Affiliation(s)
- A A De Leo
- Department of Biochemistry and Genetics, La Trobe University, Bundoora, VIC, Australia
| | | | | | | | | | | | | |
Collapse
|