1
|
Papagianopoulos I, De Mey G, Kos A, Wiecek B, Chatziathasiou V. Obstacle Detection in Infrared Navigation for Blind People and Mobile Robots. Sensors (Basel) 2023; 23:7198. [PMID: 37631734 PMCID: PMC10457989 DOI: 10.3390/s23167198] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Revised: 08/03/2023] [Accepted: 08/14/2023] [Indexed: 08/27/2023]
Abstract
The paper is a continuation of the authors' work intended for infrared navigation for blind people and mobile robots. This concerns the detection of obstacles in the person's or mobile robot's trajectory, in particular, the detection of corners. The temperature distribution of a building's internal wall near a corner has been investigated. Due to geometry, more heat will be transferred by conduction so that inside the building, the temperature on the wall will be decreasing towards a corner. The problem will be investigated theoretically and numerically, and the results are confirmed by experimental measurements. The purpose of this research is to help blind people by equipping them with a small infrared camera that warns them when they are approaching a corner inside a building. The same aim is addressed to mobile robots.
Collapse
Affiliation(s)
- Ioannis Papagianopoulos
- Department of Electrical and Computer Engineers, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece; (I.P.); (V.C.)
- Department of Electronics and Information Systems, Ghent University, Technologiepark 126, 9052 Ghent, Belgium;
| | - Gilbert De Mey
- Department of Electronics and Information Systems, Ghent University, Technologiepark 126, 9052 Ghent, Belgium;
| | - Andrzej Kos
- Institute of Electronics, AGH University of Science and Technology, al. Mickiewicza 30, 30-059 Krakow, Poland
| | - Boguslaw Wiecek
- Institute of Electronics, Lodz University of Technology, ul. Wólczańska 221, 90-924 Lodz, Poland;
| | - Vasilis Chatziathasiou
- Department of Electrical and Computer Engineers, Aristotle University of Thessaloniki, 54124 Thessaloniki, Greece; (I.P.); (V.C.)
| |
Collapse
|
2
|
Rocha D, Pinto L, Machado J, Soares F, Carvalho V. Using Object Detection Technology to Identify Defects in Clothing for Blind People. Sensors (Basel) 2023; 23:s23094381. [PMID: 37177584 PMCID: PMC10181740 DOI: 10.3390/s23094381] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 04/25/2023] [Accepted: 04/26/2023] [Indexed: 05/15/2023]
Abstract
Blind people often encounter challenges in managing their clothing, specifically in identifying defects such as stains or holes. With the progress of the computer vision field, it is crucial to minimize these limitations as much as possible to assist blind people with selecting appropriate clothing. Therefore, the objective of this paper is to use object detection technology to categorize and detect stains on garments. The defect detection system proposed in this study relies on the You Only Look Once (YOLO) architecture, which is a single-stage object detector that is well-suited for automated inspection tasks. The authors collected a dataset of clothing with defects and used it to train and evaluate the proposed system. The methodology used for the optimization of the defect detection system was based on three main components: (i) increasing the dataset with new defects, illumination conditions, and backgrounds, (ii) introducing data augmentation, and (iii) introducing defect classification. The authors compared and evaluated three different YOLOv5 models. The results of this study demonstrate that the proposed approach is effective and suitable for different challenging defect detection conditions, showing high average precision (AP) values, and paving the way for a mobile application to be accessible for the blind community.
Collapse
Affiliation(s)
- Daniel Rocha
- Algoritmi Research Centre/LASI, University of Minho, 4800-058 Guimarães, Portugal
- 2Ai, School of Technology, Polytechnic Institute of Cávado and Ave, 4750-810 Barcelos, Portugal
- INL-International Nanotechnology Laboratory, 4715-330 Braga, Portugal
| | - Leandro Pinto
- 2Ai, School of Technology, Polytechnic Institute of Cávado and Ave, 4750-810 Barcelos, Portugal
| | - José Machado
- MEtRICs Research Centre, University of Minho, 4800-058 Guimarães, Portugal
| | - Filomena Soares
- Algoritmi Research Centre/LASI, University of Minho, 4800-058 Guimarães, Portugal
| | - Vítor Carvalho
- Algoritmi Research Centre/LASI, University of Minho, 4800-058 Guimarães, Portugal
- 2Ai, School of Technology, Polytechnic Institute of Cávado and Ave, 4750-810 Barcelos, Portugal
| |
Collapse
|
3
|
Messaoudi MD, Menelas BAJ, Mcheick H. Review of Navigation Assistive Tools and Technologies for the Visually Impaired. Sensors (Basel) 2022; 22:s22207888. [PMID: 36298237 PMCID: PMC9606951 DOI: 10.3390/s22207888] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/26/2022] [Revised: 09/28/2022] [Accepted: 10/10/2022] [Indexed: 05/14/2023]
Abstract
The visually impaired suffer greatly while moving from one place to another. They face challenges in going outdoors and in protecting themselves from moving and stationary objects, and they also lack confidence due to restricted mobility. Due to the recent rapid rise in the number of visually impaired persons, the development of assistive devices has emerged as a significant research field. This review study introduces several techniques to help the visually impaired with their mobility and presents the state-of-the-art of recent assistive technologies that facilitate their everyday life. It also analyses comprehensive multiple mobility assistive technologies for indoor and outdoor environments and describes the different location and feedback methods for the visually impaired using assistive tools based on recent technologies. The navigation tools used for the visually impaired are discussed in detail in subsequent sections. Finally, a detailed analysis of various methods is also carried out, with future recommendations.
Collapse
|
4
|
Lee K, Hong J, Jarjue E, Mensah EE, Kacorri H. From the Lab to People's Home: Lessons from Accessing Blind Participants' Interactions via Smart Glasses in Remote Studies. Web4All (2022) 2022; 2022:24. [PMID: 37942017 PMCID: PMC10631802 DOI: 10.1145/3493612.3520448] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/10/2023]
Abstract
Researchers have adopted remote methods, such as online surveys and video conferencing, to overcome challenges in conducting in-person usability testing, such as participation, user representation, and safety. However, remote user evaluation on hardware testbeds is limited, especially for blind participants, as such methods restrict access to observations of user interactions. We employ smart glasses in usability testing with blind people and share our lessons from a case study conducted in blind participants' homes (N = 12), where the experimenter can access participants' activities via dual video conferencing: a third-person view via a laptop camera and a first-person view via smart glasses worn by the participant. We show that smart glasses hold potential for observing participants' interactions with smartphone testbeds remotely; on average 58.7% of the interactions were fully captured via the first-person view compared to 3.7% via the third-person. However, this gain is not uniform across participants as it is susceptible to head movements orienting the ear towards a sound source, which highlights the need for a more inclusive camera form factor. We also share our lessons learned when it comes to dealing with lack of screen reader support in smart glasses, a rapidly draining battery, and Internet connectivity in remote studies with blind participants.
Collapse
Affiliation(s)
| | - Jonggi Hong
- Smith-Kettlewell Eye Research Institute, San Francisco, CA, USA
| | | | | | | |
Collapse
|
5
|
Lee K, Sato D, Asakawa S, Asakawa C, Kacorri H. Accessing Passersby Proxemic Signals through a Head-Worn Camera: Opportunities and Limitations for the Blind. ASSETS 2021; 21:10.1145/3441852.3471232. [PMID: 35187543 PMCID: PMC8855357 DOI: 10.1145/3441852.3471232] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
The spatial behavior of passersby can be critical to blind individuals to initiate interactions, preserve personal space, or practice social distancing during a pandemic. Among other use cases, wearable cameras employing computer vision can be used to extract proxemic signals of others and thus increase access to the spatial behavior of passersby for blind people. Analyzing data collected in a study with blind (N=10) and sighted (N=40) participants, we explore: (i) visual information on approaching passersby captured by a head-worn camera; (ii) pedestrian detection algorithms for extracting proxemic signals such as passerby presence, relative position, distance, and head pose; and (iii) opportunities and limitations of using wearable cameras for helping blind people access proxemics related to nearby people. Our observations and findings provide insights into dyadic behaviors for assistive pedestrian detection and lead to implications for the design of future head-worn cameras and interactions.
Collapse
Affiliation(s)
- Kyungjun Lee
- University of Maryland, College Park, College Park, Maryland, USA
| | - Daisuke Sato
- Carnegie Mellon University, Pittsburgh, Pennsylvania, USA
| | | | | | - Hernisa Kacorri
- University of Maryland, College Park, College Park, Maryland, USA
| |
Collapse
|
6
|
Glenk LM, Přibylová L, Stetina BU, Demirel S, Weissenbacher K. Perceptions on Health Benefits of Guide Dog Ownership in an Austrian Population of Blind People with and without a Guide Dog. Animals (Basel) 2019; 9:E428. [PMID: 31284677 PMCID: PMC6680747 DOI: 10.3390/ani9070428] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2019] [Revised: 06/27/2019] [Accepted: 07/02/2019] [Indexed: 11/17/2022] Open
Abstract
Blindness has previously been associated with impaired quality of life (QOL). Guide dogs may not only support blind people in their independency, but also facilitate social relationships and overall health. This study sought to investigate whether blind people from Austria with a guide dog, when compared with blind people without a guide dog, differ in their QOL, annual medical costs, and attitudes towards the human-guide dog relationship. Participants (n = 36) filled out an online accessible questionnaire that consisted of the World Health Organization (WHO)QOL-BREF and additional self-designed questions. Guide dog ownership was not associated with a better QOL. However, yearly medical cost expenditures were descriptively lower in guide dog owners, who were also more likely to believe that guide dogs can increase their independency and exert positive effects on health. Moreover, guide dog owners more likely considered a guide dog as a family member than non-guide dog owners. Although within the framework of this study, owning a guide dog was not significantly associated with increased QOL, some differences between the groups regarding health beliefs, attitude towards the dog, and relationship with the dog were identified. Accounting for the emerging prevalence of visual impairment, further research into this topic is warranted.
Collapse
Affiliation(s)
- Lisa Maria Glenk
- Comparative Medicine, The Interuniversity Messerli Research Institute, University of Veterinary Medicine Vienna, Medical University Vienna, University of Vienna, Vienna 1210, Austria.
| | - Lucie Přibylová
- Comparative Medicine, The Interuniversity Messerli Research Institute, University of Veterinary Medicine Vienna, Medical University Vienna, University of Vienna, Vienna 1210, Austria
| | - Birgit Ursula Stetina
- Department of Clinical Psychology, Faculty of Psychology, Sigmund Freud University Vienna, Vienna 1020, Austria
| | - Sami Demirel
- Coordination Center for Assistance Dogs, The Interuniversity Messerli Research Institute, University of Veterinary Medicine Vienna, Medical University Vienna, University of Vienna, Vienna 1210, Austria
| | - Karl Weissenbacher
- Coordination Center for Assistance Dogs, The Interuniversity Messerli Research Institute, University of Veterinary Medicine Vienna, Medical University Vienna, University of Vienna, Vienna 1210, Austria
| |
Collapse
|
7
|
Kubanek M, Bobulski J. Device for Acoustic Support of Orientation in the Surroundings for Blind People. Sensors (Basel) 2018; 18:s18124309. [PMID: 30563278 PMCID: PMC6308681 DOI: 10.3390/s18124309] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/09/2018] [Revised: 11/27/2018] [Accepted: 12/04/2018] [Indexed: 11/16/2022]
Abstract
The constant development of modern technologies allows the creation of new and, above all, mobile devices supporting people with disabilities. All work carried out to improve the lives of people with disabilities is an important element of the field of science. The work presents matters related to the anatomy and physiology of hearing, imaginative abilities of blind people and devices supporting these people. The authors elaborated a prototype of an electronic device that supports the orientation of blind people in the environment by means of sound signals. Sounds are denoted to present to a blind person a simplified map of the depth of space in front of the device user. An innovative element of the work is the use of Kinect sensor, scanning the space in front of the user, as well as a set of developed algorithms for learning and generating acoustic space, taking into account the inclination of the head. The experiments carried out indicate the correct interpretation of the modeled audible signals, and the tests carried out on persons with impaired vision organs demonstrate high efficiency of the developed concept.
Collapse
Affiliation(s)
- Mariusz Kubanek
- Institute of Computer and Information Sciences, Czestochowa University of Technology, 42-201 Czestochowa, Poland.
| | - Janusz Bobulski
- Institute of Computer and Information Sciences, Czestochowa University of Technology, 42-201 Czestochowa, Poland.
| |
Collapse
|
8
|
Tai KC. Equipment factors affecting identification of water level with echo for the blind. Assist Technol 2018; 32:61-67. [PMID: 29742033 DOI: 10.1080/10400435.2018.1474284] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/16/2022] Open
Abstract
Blind people adopt their remaining intact senses to perceive the world for tasks such as determining the water level in a bowl. Pouring water into a bowl generates water sounds and echoes reflected in the bowl. This research develops a bowl with increased echo (called an echo bowl), and analyzes the accuracy of water levels perceived by visually impaired people using a container or a kettle to pour water into a common bowl or an echo bowl. The analysis of factors of pouring and filled equipment indicates that the container has a significantly lower water level error than the kettle when pouring water. The water level error with different combinations of equipment is smallest when pouring water from the container to the echo bowl, and largest when pouring water from the kettle to the common bowl. This work also analyzes the sound of pouring water from the equipment by a simple linear regression analysis, and uses it to interpret the results of the pouring experiment.
Collapse
|
9
|
Hudec M, Smutny Z. RUDO: A Home Ambient Intelligence System for Blind People. Sensors (Basel) 2017; 17:E1926. [PMID: 28829372 PMCID: PMC5580207 DOI: 10.3390/s17081926] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/29/2017] [Revised: 08/05/2017] [Accepted: 08/19/2017] [Indexed: 11/21/2022]
Abstract
The article introduces an ambient intelligence system for blind people which besides providing assistance in home environment also helps with various situations and roles in which blind people may find themselves involved. RUDO, the designed system, comprises several modules that mainly support or ensure recognition of approaching people, alerting to other household members' movement in the flat, work on a computer, supervision of (sighted) children, cooperation of a sighted and a blind person (e.g., when studying), control of heating and zonal regulation by a blind person. It has a unified user interface that gives the blind person access to individual functions. The interface for blind people offers assistance with work on a computer, including writing in Braille on a regular keyboard and specialized work in informatics and electronics (e.g., programming). RUDO can complement the standard aids used by blind people at home, it increases their independence and creates conditions that allow them to become fully involved. RUDO also supports blind people sharing a home with sighted people, which contributes to their feeling of security and greater inclusion in society. RUDO has been implemented in a household for two years, which allows an evaluation of its use in practice.
Collapse
Affiliation(s)
- Milan Hudec
- Department of Computer Science, Faculty of Natural Sciences, Matej Bel University, Tajovského 40, 974 01 Banská Bystrica, Slovakia.
| | - Zdenek Smutny
- Department of Systems Analysis, Faculty of Informatics and Statistics, University of Economics, Prague, W. Churchill Sq. 1938/4, 130 67 Prague, Czech Republic.
| |
Collapse
|
10
|
Buonamici F, Carfagni M, Furferi R, Governi L, Volpe Y. Are We Ready to Build a System for Assisting Blind People in Tactile Exploration of Bas-Reliefs? Sensors (Basel) 2016; 16:s16091361. [PMID: 27563906 PMCID: PMC5038639 DOI: 10.3390/s16091361] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/06/2016] [Revised: 08/10/2016] [Accepted: 08/18/2016] [Indexed: 12/30/2022]
Abstract
Nowadays, the creation of methodologies and tools for facilitating the 3D reproduction of artworks and, contextually, to make their exploration possible and more meaningful for blind users is becoming increasingly relevant in society. Accordingly, the creation of integrated systems including both tactile media (e.g., bas-reliefs) and interfaces capable of providing the users with an experience cognitively comparable to the one originally envisioned by the artist, may be considered the next step for enhancing artworks exploration. In light of this, the present work provides a description of a first-attempt system designed to aid blind people (BP) in the tactile exploration of bas-reliefs. In detail, consistent hardware layout, comprising a hand-tracking system based on Kinect® sensor and an audio device, together with a number of methodologies, algorithms and information related to physical design are proposed. Moreover, according to experimental test on the developed system related to the device position, some design alternatives are suggested so as to discuss pros and cons.
Collapse
Affiliation(s)
- Francesco Buonamici
- Department of Industrial Engineering, University of Florence, Florence 50139, Italy
| | - Monica Carfagni
- Department of Industrial Engineering, University of Florence, Florence 50139, Italy.
| | - Rocco Furferi
- Department of Industrial Engineering, University of Florence, Florence 50139, Italy.
| | - Lapo Governi
- Department of Industrial Engineering, University of Florence, Florence 50139, Italy.
| | - Yary Volpe
- Department of Industrial Engineering, University of Florence, Florence 50139, Italy.
| |
Collapse
|