1
|
Larrazabal A, García Cena C, Martínez C. Video-oculography eye tracking towards clinical applications: A review. Comput Biol Med 2019; 108:57-66. [DOI: 10.1016/j.compbiomed.2019.03.025] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2018] [Revised: 02/20/2019] [Accepted: 03/26/2019] [Indexed: 10/27/2022]
|
2
|
Foy HJ, Chapman P. Mental workload is reflected in driver behaviour, physiology, eye movements and prefrontal cortex activation. APPLIED ERGONOMICS 2018; 73:90-99. [PMID: 30098645 DOI: 10.1016/j.apergo.2018.06.006] [Citation(s) in RCA: 59] [Impact Index Per Article: 8.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/12/2017] [Revised: 04/28/2018] [Accepted: 06/20/2018] [Indexed: 06/08/2023]
Abstract
Mental workload is an important factor during driving, as both high and low levels may result in driver error. This research examined the mental workload of drivers caused by changes in road environment and how such changes impact upon behaviour, physiological responses, eye movements and brain activity. The experiment used functional near infrared spectroscopy to record prefrontal cortex activation associated with changes in mental workload during simulated driving. Increases in subjective ratings of mental workload caused by changes in road type were accompanied by increases in skin conductance, acceleration signatures and horizontal spread of search. Such changes were also associated with increases in the concentration of oxygenated haemoglobin in the prefrontal cortex. Mental workload fluctuates during driving. Such changes can be identified using a range of measures which could be used to inform the development of in-vehicle devices and partially autonomous systems.
Collapse
Affiliation(s)
- Hannah J Foy
- School of Psychology, University of Nottingham, Nottingham, NG7 2RD, UK.
| | - Peter Chapman
- School of Psychology, University of Nottingham, Nottingham, NG7 2RD, UK.
| |
Collapse
|
3
|
Harezlak K, Kasprowski P. Application of eye tracking in medicine: A survey, research issues and challenges. Comput Med Imaging Graph 2017; 65:176-190. [PMID: 28606763 DOI: 10.1016/j.compmedimag.2017.04.006] [Citation(s) in RCA: 43] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2017] [Revised: 03/22/2017] [Accepted: 04/27/2017] [Indexed: 10/19/2022]
Abstract
The performance and quality of medical procedures and treatments are inextricably linked to technological development. The application of more advanced techniques provides the opportunity to gain wider knowledge and deeper understanding of the human body and mind functioning. The eye tracking methods used to register eye movement to find the direction and targets of a person's gaze are well in line with the nature of the topic. By providing methods for capturing and processing images of the eye it has become possible not only to reveal abnormalities in eye functioning but also to conduct cognitive studies focused on learning about peoples' emotions and intentions. The usefulness of the application of eye tracking technology in medicine was proved in many research studies. The aim of this paper is to give an insight into those studies and the way they utilize eye imaging in medical applications. These studies were differentiated taking their purpose and experimental paradigms into account. Additionally, methods for eye movement visualization and metrics for its quantifying were presented. Apart from presenting the state of the art, the aim of the paper was also to point out possible applications of eye tracking in medicine that have not been exhaustively investigated yet, and are going to be a perspective long-term direction of research.
Collapse
Affiliation(s)
- Katarzyna Harezlak
- Institute of Informatics, Silesian University of Technology, ul. Akademicka 16, 44-100 Gliwice, Poland.
| | - Pawel Kasprowski
- Institute of Informatics, Silesian University of Technology, ul. Akademicka 16, 44-100 Gliwice, Poland
| |
Collapse
|
4
|
Empirical Study on Designing of Gaze Tracking Camera Based on the Information of User's Head Movement. SENSORS 2016; 16:s16091396. [PMID: 27589768 PMCID: PMC5038674 DOI: 10.3390/s16091396] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/17/2016] [Revised: 08/24/2016] [Accepted: 08/25/2016] [Indexed: 11/22/2022]
Abstract
Gaze tracking is the technology that identifies a region in space that a user is looking at. Most previous non-wearable gaze tracking systems use a near-infrared (NIR) light camera with an NIR illuminator. Based on the kind of camera lens used, the viewing angle and depth-of-field (DOF) of a gaze tracking camera can be different, which affects the performance of the gaze tracking system. Nevertheless, to our best knowledge, most previous researches implemented gaze tracking cameras without ground truth information for determining the optimal viewing angle and DOF of the camera lens. Eye-tracker manufacturers might also use ground truth information, but they do not provide this in public. Therefore, researchers and developers of gaze tracking systems cannot refer to such information for implementing gaze tracking system. We address this problem providing an empirical study in which we design an optimal gaze tracking camera based on experimental measurements of the amount and velocity of user’s head movements. Based on our results and analyses, researchers and developers might be able to more easily implement an optimal gaze tracking system. Experimental results show that our gaze tracking system shows high performance in terms of accuracy, user convenience and interest.
Collapse
|
5
|
2D Gaze Estimation Based on Pupil-Glint Vector Using an Artificial Neural Network. APPLIED SCIENCES-BASEL 2016. [DOI: 10.3390/app6060174] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
6
|
Pupil and Glint Detection Using Wearable Camera Sensor and Near-Infrared LED Array. SENSORS 2015; 15:30126-41. [PMID: 26633416 PMCID: PMC4721713 DOI: 10.3390/s151229792] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/13/2015] [Revised: 11/17/2015] [Accepted: 11/27/2015] [Indexed: 12/02/2022]
Abstract
This paper proposes a novel pupil and glint detection method for gaze tracking system using a wearable camera sensor and near-infrared LED array. A novel circular ring rays location (CRRL) method is proposed for pupil boundary points detection. Firstly, improved Otsu optimal threshold binarization, opening-and-closing operation and projection of 3D gray-level histogram are utilized to estimate rough pupil center and radius. Secondly, a circular ring area including pupil edge inside is determined according to rough pupil center and radius. Thirdly, a series of rays are shot from inner to outer ring to collect pupil boundary points. Interference points are eliminated by calculating gradient amplitude. At last, an improved total least squares is proposed to fit collected pupil boundary points. In addition, the improved total least squares developed is utilized for the solution of Gaussian function deformation to calculate glint center. The experimental results show that the proposed method is more robust and accurate than conventional detection methods. When interference factors such as glints and natural light reflection are located on pupil contour, pupil boundary points and center can be detected accurately. The proposed method contributes to enhance stability, accuracy and real-time quality of gaze tracking system.
Collapse
|
7
|
Lee JM, Lee HC, Gwon SY, Jung D, Pan W, Cho CW, Park KR, Kim HC, Cha J. A new gaze estimation method considering external light. SENSORS 2015; 15:5935-81. [PMID: 25769050 PMCID: PMC4435212 DOI: 10.3390/s150305935] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/14/2014] [Revised: 03/03/2015] [Accepted: 03/04/2015] [Indexed: 11/16/2022]
Abstract
Gaze tracking systems usually utilize near-infrared (NIR) lights and NIR cameras, and the performance of such systems is mainly affected by external light sources that include NIR components. This is ascribed to the production of additional (imposter) corneal specular reflection (SR) caused by the external light, which makes it difficult to discriminate between the correct SR as caused by the NIR illuminator of the gaze tracking system and the imposter SR. To overcome this problem, a new method is proposed for determining the correct SR in the presence of external light based on the relationship between the corneal SR and the pupil movable area with the relative position of the pupil and the corneal SR. The experimental results showed that the proposed method makes the gaze tracking system robust to the existence of external light.
Collapse
Affiliation(s)
- Jong Man Lee
- Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea.
| | - Hyeon Chang Lee
- Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea.
| | - Su Yeong Gwon
- Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea.
| | - Dongwook Jung
- Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea.
| | - Weiyuan Pan
- Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea.
| | - Chul Woo Cho
- Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea.
| | - Kang Ryoung Park
- Division of Electronics and Electrical Engineering, Dongguk University, 26 Pil-dong 3-ga, Jung-gu, Seoul 100-715, Korea.
| | - Hyun-Cheol Kim
- Electronics and Telecommunications Research Institute, 218 Gajeong-ro, Yuseong-gu, Daejeon 305-700, Korea.
| | - Jihun Cha
- Electronics and Telecommunications Research Institute, 218 Gajeong-ro, Yuseong-gu, Daejeon 305-700, Korea.
| |
Collapse
|
8
|
SVM versus MAP on accelerometer data to distinguish among locomotor activities executed at different speeds. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2013; 2013:343084. [PMID: 24376469 PMCID: PMC3860084 DOI: 10.1155/2013/343084] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/18/2013] [Revised: 10/07/2013] [Accepted: 10/18/2013] [Indexed: 11/17/2022]
Abstract
Two approaches to the classification of different locomotor activities performed at various speeds are here presented and evaluated: a maximum a posteriori (MAP) Bayes' classification scheme and a Support Vector Machine (SVM) are applied on a 2D projection of 16 features extracted from accelerometer data. The locomotor activities (level walking, stair climbing, and stair descending) were recorded by an inertial sensor placed on the shank (preferred leg), performed in a natural indoor-outdoor scenario by 10 healthy young adults (age 25-35 yrs.). From each segmented activity epoch, sixteen features were chosen in the frequency and time domain. Dimension reduction was then performed through 2D Sammon's mapping. An Artificial Neural Network (ANN) was trained to mimic Sammon's mapping on the whole dataset. In the Bayes' approach, the two features were then fed to a Bayes' classifier that incorporates an update rule, while, in the SVM scheme, the ANN was considered as the kernel function of the classifier. Bayes' approach performed slightly better than SVM on both the training set (91.4% versus 90.7%) and the testing set (84.2% versus 76.0%), favoring the proposed Bayes' scheme as more suitable than the proposed SVM in distinguishing among the different monitored activities.
Collapse
|