1
|
Gomez LM, Willingham L, Wang J, Nasrallah S, Vandillen MB, Mari G. Duration of biophysical profile in periviable and very preterm low-risk pregnancies. Am J Obstet Gynecol 2024:S0002-9378(24)00449-6. [PMID: 38527604 DOI: 10.1016/j.ajog.2024.03.020] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2024] [Revised: 03/18/2024] [Accepted: 03/18/2024] [Indexed: 03/27/2024]
Abstract
BACKGROUND In recent years, perinatal viability has shifted from 24 to 22 weeks of gestation at many institutions after improvements in survival in neonates delivered at the limit of viability. Monitoring these fetuses is essential because antenatal interventions with resuscitation efforts are available for patients at risk of delivery at the limit of viability. However, fetal monitoring using biophysical profiles has not been extensively studied in very preterm pregnancies, particularly in the periviable period (20 weeks 0 days to 23 weeks 6 days). OBJECTIVE This study aimed to (1) investigate whether the completion of biophysical profiles within 30 minutes is feasible in very preterm pregnancies, and (2) determine the average observation time required to achieve a score of 8 out of 8 in very preterm pregnancies from 20 weeks 0 days to 31 weeks 6 days. STUDY DESIGN This study prospectively evaluated biophysical scores in singleton pregnancies undergoing routine ultrasonography at or near viability from 20 weeks 0 days to 23 weeks 6 days (periviable or group I), 24 weeks 0 days to 27 weeks 6 days (group II), and 28 weeks 0 days to 31 weeks 6 days (group III). The results and duration of biophysical profiles were compared with those of a control group (32 weeks 0 days to 35 weeks 6 days) undergoing indicated fetal surveillance. Biophysical profiles were performed for all studied pregnancies until a score of 8 out of 8 was obtained. When >1 biophysical profile was obtained during pregnancy, each was analyzed individually. Pregnancies with fetal anomalies or obstetrical/medical indications for fetal well-being surveillance were excluded. Analysis of variance and post hoc Tukey tests were used for comparisons. RESULTS Data were collected for 123 participants, yielding 79, 75, and 72 studies for groups I, II, and III, respectively. The control group included 42 patients, yielding 140 studies. At 30 minutes, 80% (63/79) of the studies in the periviable group had a score of 8 out of 8, as opposed to 100% (140/140) in the control group (P<.001). The mean±standard deviation time in minutes to achieve a biophysical score of 8 out of 8 was 23.3±10.1 in the periviable group, as opposed to 9.4±6.5 in controls (P<.001). Extending the study to +2 standard deviations (43.6 minutes) in the periviable group resulted in 97% (77/79) of the scans scoring 8 out of 8 in the absence of adverse outcomes. In the other groups, a biophysical score of 8 out of 8 within 30 minutes was obtained in 97% (73/75) and 100% (72/72) in groups II and III, respectively; the mean±standard deviation times were 17.1±8.4 minutes (group II) and 13.1±7.3 minutes (group III). No adverse outcomes developed during the study participation in groups I to III. CONCLUSION Biophysical scores of 8 out of 8 can be successfully achieved in low-risk periviable pregnancies (20 weeks 0 days to 23 weeks 6 days) within an observation time longer than the standard 30-minute duration. The time required to reach a score of 8 out of 8 decreases as gestation progresses. We suggest adjusting the observation time for biophysical profile completion according to the gestational age.
Collapse
Affiliation(s)
- Luis M Gomez
- Department of Obstetrics and Gynecology, University of Tennessee Health Science Center, Memphis, TN.
| | - Laura Willingham
- Department of Obstetrics and Gynecology, University of Tennessee Health Science Center, Memphis, TN
| | - Jenny Wang
- Department of Obstetrics and Gynecology, University of Tennessee Health Science Center, Memphis, TN
| | - Sebastian Nasrallah
- Department of Obstetrics and Gynecology, University of Tennessee Health Science Center, Memphis, TN
| | - Michael B Vandillen
- Department of Obstetrics and Gynecology, University of Tennessee Health Science Center, Memphis, TN
| | - Giancarlo Mari
- Department of Obstetrics and Gynecology, University of Tennessee Health Science Center, Memphis, TN
| |
Collapse
|
2
|
Basner M, Barnett I, Carlin M, Choi GH, Czech JJ, Ecker AJ, Gilad Y, Godwin T, Jodts E, Jones CW, Kaizi-Lutu M, Kali J, Opsomer JD, Park-Chavar S, Smith MG, Schneller V, Song N, Shaw PA. Effects of Aircraft Noise on Sleep: Federal Aviation Administration National Sleep Study Protocol. Int J Environ Res Public Health 2023; 20:7024. [PMID: 37947580 PMCID: PMC10650692 DOI: 10.3390/ijerph20217024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Revised: 09/28/2023] [Accepted: 11/01/2023] [Indexed: 11/12/2023]
Abstract
Aircraft noise can disrupt sleep and impair recuperation. The last U.S. investigation into the effects of aircraft noise on sleep dates back more than 20 years. Since then, traffic patterns and the noise levels produced by single aircraft have changed substantially. It is therefore important to acquire current data on sleep disturbance relative to varying degrees of aircraft noise exposure in the U.S. that can be used to check and potentially update the existing noise policy. This manuscript describes the design, procedures, and analytical approaches of the FAA's National Sleep Study. Seventy-seven U.S. airports with relevant nighttime air traffic from 39 states are included in the sampling frame. Based on simulation-based power calculations, the field study aims to recruit 400 participants from four noise strata and record an electrocardiogram (ECG), body movement, and sound pressure levels in the bedroom for five consecutive nights. The primary outcome of the study is an exposure-response function between the instantaneous, maximum A-weighted sound pressure levels (dBA) of individual aircraft measured in the bedroom and awakening probability inferred from changes in heart rate and body movement. Self-reported sleep disturbance due to aircraft noise is the secondary outcome that will be associated with long-term average noise exposure metrics such as the Day-Night Average Sound Level (DNL) and the Nighttime Equivalent Sound Level (Lnight). The effect of aircraft noise on several other physiological and self-report outcomes will also be investigated. This study will provide key insights into the effects of aircraft noise on objectively and subjectively assessed sleep disturbance.
Collapse
Affiliation(s)
- Mathias Basner
- Unit for Experimental Psychiatry, Division of Sleep and Chronobiology, Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA 19104, USA
| | - Ian Barnett
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA 19104, USA
| | - Michele Carlin
- Unit for Experimental Psychiatry, Division of Sleep and Chronobiology, Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA 19104, USA
| | - Grace H. Choi
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA 19104, USA
| | - Joseph J. Czech
- Harris Miller Miller & Hanson Inc. (HMMH), Anaheim, CA 92805, USA
| | - Adrian J. Ecker
- Unit for Experimental Psychiatry, Division of Sleep and Chronobiology, Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA 19104, USA
| | - Yoni Gilad
- Unit for Experimental Psychiatry, Division of Sleep and Chronobiology, Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA 19104, USA
| | | | | | - Christopher W. Jones
- Unit for Experimental Psychiatry, Division of Sleep and Chronobiology, Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA 19104, USA
| | - Marc Kaizi-Lutu
- Unit for Experimental Psychiatry, Division of Sleep and Chronobiology, Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA 19104, USA
| | | | | | - Sierra Park-Chavar
- Unit for Experimental Psychiatry, Division of Sleep and Chronobiology, Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA 19104, USA
| | - Michael G. Smith
- Unit for Experimental Psychiatry, Division of Sleep and Chronobiology, Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA 19104, USA
| | - Victoria Schneller
- Unit for Experimental Psychiatry, Division of Sleep and Chronobiology, Department of Psychiatry, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA 19104, USA
| | - Nianfu Song
- Center for Clinical Epidemiology & Biostatistics, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA 19104, USA
| | - Pamela A. Shaw
- Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania Perelman School of Medicine, Philadelphia, PA 19104, USA
| |
Collapse
|
3
|
Geangu E, Smith WAP, Mason HT, Martinez-Cedillo AP, Hunter D, Knight MI, Liang H, del Carmen Garcia de Soria Bazan M, Tse ZTH, Rowland T, Corpuz D, Hunter J, Singh N, Vuong QC, Abdelgayed MRS, Mullineaux DR, Smith S, Muller BR. EgoActive: Integrated Wireless Wearable Sensors for Capturing Infant Egocentric Auditory-Visual Statistics and Autonomic Nervous System Function 'in the Wild'. Sensors (Basel) 2023; 23:7930. [PMID: 37765987 PMCID: PMC10534696 DOI: 10.3390/s23187930] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/28/2023] [Revised: 08/25/2023] [Accepted: 09/11/2023] [Indexed: 09/29/2023]
Abstract
There have been sustained efforts toward using naturalistic methods in developmental science to measure infant behaviors in the real world from an egocentric perspective because statistical regularities in the environment can shape and be shaped by the developing infant. However, there is no user-friendly and unobtrusive technology to densely and reliably sample life in the wild. To address this gap, we present the design, implementation and validation of the EgoActive platform, which addresses limitations of existing wearable technologies for developmental research. EgoActive records the active infants' egocentric perspective of the world via a miniature wireless head-mounted camera concurrently with their physiological responses to this input via a lightweight, wireless ECG/acceleration sensor. We also provide software tools to facilitate data analyses. Our validation studies showed that the cameras and body sensors performed well. Families also reported that the platform was comfortable, easy to use and operate, and did not interfere with daily activities. The synchronized multimodal data from the EgoActive platform can help tease apart complex processes that are important for child development to further our understanding of areas ranging from executive function to emotion processing and social learning.
Collapse
Affiliation(s)
- Elena Geangu
- Psychology Department, University of York, York YO10 5DD, UK; (A.P.M.-C.); (M.d.C.G.d.S.B.)
| | - William A. P. Smith
- Department of Computer Science, University of York, York YO10 5DD, UK; (W.A.P.S.); (J.H.); (M.R.S.A.); (B.R.M.)
| | - Harry T. Mason
- School of Physics, Engineering and Technology, University of York, York YO10 5DD, UK; (H.T.M.); (D.H.); (N.S.); (S.S.)
| | | | - David Hunter
- School of Physics, Engineering and Technology, University of York, York YO10 5DD, UK; (H.T.M.); (D.H.); (N.S.); (S.S.)
| | - Marina I. Knight
- Department of Mathematics, University of York, York YO10 5DD, UK; (M.I.K.); (D.R.M.)
| | - Haipeng Liang
- School of Engineering and Materials Science, Queen Mary University of London, London E1 2AT, UK; (H.L.); (Z.T.H.T.)
| | | | - Zion Tsz Ho Tse
- School of Engineering and Materials Science, Queen Mary University of London, London E1 2AT, UK; (H.L.); (Z.T.H.T.)
| | - Thomas Rowland
- Protolabs, Halesfield 8, Telford TF7 4QN, UK; (T.R.); (D.C.)
| | - Dom Corpuz
- Protolabs, Halesfield 8, Telford TF7 4QN, UK; (T.R.); (D.C.)
| | - Josh Hunter
- Department of Computer Science, University of York, York YO10 5DD, UK; (W.A.P.S.); (J.H.); (M.R.S.A.); (B.R.M.)
| | - Nishant Singh
- School of Physics, Engineering and Technology, University of York, York YO10 5DD, UK; (H.T.M.); (D.H.); (N.S.); (S.S.)
| | - Quoc C. Vuong
- Biosciences Institute, Newcastle University, Newcastle upon Tyne NE1 7RU, UK;
| | - Mona Ragab Sayed Abdelgayed
- Department of Computer Science, University of York, York YO10 5DD, UK; (W.A.P.S.); (J.H.); (M.R.S.A.); (B.R.M.)
| | - David R. Mullineaux
- Department of Mathematics, University of York, York YO10 5DD, UK; (M.I.K.); (D.R.M.)
| | - Stephen Smith
- School of Physics, Engineering and Technology, University of York, York YO10 5DD, UK; (H.T.M.); (D.H.); (N.S.); (S.S.)
| | - Bruce R. Muller
- Department of Computer Science, University of York, York YO10 5DD, UK; (W.A.P.S.); (J.H.); (M.R.S.A.); (B.R.M.)
| |
Collapse
|
4
|
Cheng X, Bao B, Cui W, Liu S, Zhong J, Cai L, Yang H. Classification and Analysis of Human Body Movement Characteristics Associated with Acrophobia Induced by Virtual Reality Scenes of Heights. Sensors (Basel) 2023; 23:5482. [PMID: 37420652 DOI: 10.3390/s23125482] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Revised: 05/26/2023] [Accepted: 06/08/2023] [Indexed: 07/09/2023]
Abstract
Acrophobia (fear of heights), a prevalent psychological disorder, elicits profound fear and evokes a range of adverse physiological responses in individuals when exposed to heights, which will lead to a very dangerous state for people in actual heights. In this paper, we explore the behavioral influences in terms of movements in people confronted with virtual reality scenes of extreme heights and develop an acrophobia classification model based on human movement characteristics. To this end, we used wireless miniaturized inertial navigation sensors (WMINS) network to obtain the information of limb movements in the virtual environment. Based on these data, we constructed a series of data feature processing processes, proposed a system model for the classification of acrophobia and non-acrophobia based on human motion feature analysis, and realized the classification recognition of acrophobia and non-acrophobia through the designed integrated learning model. The final accuracy of acrophobia dichotomous classification based on limb motion information reached 94.64%, which has higher accuracy and efficiency compared with other existing research models. Overall, our study demonstrates a strong correlation between people's mental state during fear of heights and their limb movements at that time.
Collapse
Affiliation(s)
- Xiankai Cheng
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei 230026, China
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
| | - Benkun Bao
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei 230026, China
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
| | - Weidong Cui
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
| | - Shuai Liu
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei 230026, China
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
| | - Jun Zhong
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei 230026, China
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
| | - Liming Cai
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
| | - Hongbo Yang
- School of Biomedical Engineering (Suzhou), Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei 230026, China
- Suzhou Institute of Biomedical Engineering and Technology, Chinese Academy of Sciences, Suzhou 215163, China
| |
Collapse
|
5
|
Đorđić V, Cvetković M, Popović B, Radanović D, Lazić M, Cvetković B, Andrašić S, Buišić S, Marković M. Physical Activity, Eating Habits and Mental Health during COVID-19 Lockdown Period in Serbian Adolescents. Healthcare (Basel) 2022; 10. [PMID: 35627970 DOI: 10.3390/healthcare10050834] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2022] [Revised: 04/19/2022] [Accepted: 04/21/2022] [Indexed: 12/07/2022] Open
Abstract
The COVID-19 pandemic has impacted almost every aspect of life, especially daily physical activity and healthy eating habits but also mental health. Our study aimed to examine the relationship between the physical activity level, eating habits and mental health of Serbian adolescents during the COVID-19 pandemic. A total of 3506 students from the territory of the Republic of Serbia participated in this study. IPAQ-short version and HBSC-FFQ were used to assess physical activity level and eating habits, along with self-rated health. Moderate correlations were identified between physical activity, eating habits and mental health, along with average physical activity, very high life satisfaction (β = 0.177, p < 0.01) and very low emotional distress (β = −0.150, p < 0.01). A significant predictor of mental health was the frequency of breakfast on weekdays (β = 0.167, p < 0.01 for life satisfaction and β = −0.153, p < 0.01 for emotional distress), but not on weekends. Since the pandemic’s course is uncertain, the focus should be on maintaining good physical activity, nutrition and well-being.
Collapse
|
6
|
Li J, Kells PA, Osgood AC, Gautam SH, Shew WL. Collapse of complexity of brain and body activity due to excessive inhibition and MeCP2 disruption. Proc Natl Acad Sci U S A 2021; 118:e2106378118. [PMID: 34686597 DOI: 10.1073/pnas.2106378118] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/02/2021] [Indexed: 11/18/2022] Open
Abstract
Complex body movements require complex dynamics and coordination among neurons in motor cortex. Conversely, a long-standing theoretical notion supposes that if many neurons in motor cortex become excessively synchronized, they may lack the necessary complexity for healthy motor coding. However, direct experimental support for this idea is rare and underlying mechanisms are unclear. Here we recorded three-dimensional body movements and spiking activity of many single neurons in motor cortex of rats with enhanced synaptic inhibition and a transgenic rat model of Rett syndrome (RTT). For both cases, we found a collapse of complexity in the motor system. Reduced complexity was apparent in lower-dimensional, stereotyped brain-body interactions, neural synchrony, and simpler behavior. Our results demonstrate how imbalanced inhibition can cause excessive synchrony among movement-related neurons and, consequently, a stereotyped motor code. Excessive inhibition and synchrony may underlie abnormal motor function in RTT.
Collapse
|
7
|
Furley P, Roth A. Coding Body Language in Sports: The Nonverbal Behavior Coding System for Soccer Penalties. J Sport Exerc Psychol 2021; 43:140-154. [PMID: 33730693 DOI: 10.1123/jsep.2020-0066] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/11/2020] [Revised: 09/17/2020] [Accepted: 10/05/2020] [Indexed: 06/12/2023]
Abstract
Nonverbal behavior (NVB) plays an important role in sports. However, it has been difficult to measure, as no coding schemes exist to objectively measure NVB in sports. Therefore, the authors adapted the Body Action and Posture Coding System to the context of soccer penalties, validated it, and initially used this system (Nonverbal Behavior Coding System for Soccer Penalties [NBCSP]) to explore NVB in penalties. Study 1 demonstrated that the NBCSP had good to excellent intercoder reliability regarding the occurrence and temporal precision of NVBs. It also showed that the coding system could differentiate certain postures and behaviors as a function of emotional valence (i.e., positive vs. negative emotional states). Study 2 identified differences in NVB for successful and missed shots in a sample of penalties (time spent looking toward the goal, toward the ground, right arm movement, and how upright the body posture was). The authors discuss the utility of the coding system for different sport contexts.
Collapse
|
8
|
Fink B, Apalkova Y, Butovskaya ML, Shackelford TK. Are There Differences in Experts' and Lay Assessors' Attractiveness Judgments of Non-Professional Men's Dance/Gait Movements? Percept Mot Skills 2020; 128:492-506. [PMID: 33092486 DOI: 10.1177/0031512520967607] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Research on attractiveness assessments of men's dance has shown that raters derive and integrate information about male mating-related qualities into their attractiveness assessments, but prior studies have focused on lay assessors (i.e., individuals with no professional dance background) rather than dance experts. We recruited male and female Russian dance experts (n = 23) to judge gender-neutral, featureless virtual characters, animated with motion-captured dance movements and gaits of British men, and compared their dance assessments to those from a group of Russian male and female lay assessors (n = 73). The dance experts provided higher dance and gait attractiveness judgments than the lay assessors. Both groups judged the gait movements to be of higher attractiveness than the dance movements. Differences in attractiveness assessments between experts and lay assessors were larger for the male judges than for the female judges. In an additional survey, the dance experts (versus lay assessors) placed greater emphasis on the importance of dance-related capacities and skills. We discuss our findings with reference to past research on dance/gait attractiveness as assessed by lay judges and the role of expertise in assessing body movement.
Collapse
Affiliation(s)
- Bernhard Fink
- Biosocial Science Information, Biedermannsdorf, Austria.,Department of Evolutionary Anthropology, University of Vienna, Vienna, Austria
| | - Yulia Apalkova
- Institute of Ethnology and Anthropology, Russian Academy of Sciences, Moscow, Russian Federation
| | - Marina L Butovskaya
- Institute of Ethnology and Anthropology, Russian Academy of Sciences, Moscow, Russian Federation.,Higher School of Economics, National Research University, Moscow, Russian Federation.,Social Anthropology Research and Education Center, Russian State University for Humanities, Moscow, Russian Federation
| | - Todd K Shackelford
- Department of Psychology, Oakland University, Rochester, Michigan, United States
| |
Collapse
|
9
|
Chen S, Saiki S, Nakamura M. Nonintrusive Fine-Grained Home Care Monitoring: Characterizing Quality of In-Home Postural Changes Using Bone-Based Human Sensing. Sensors (Basel) 2020; 20:E5894. [PMID: 33081059 PMCID: PMC7588905 DOI: 10.3390/s20205894] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/09/2020] [Revised: 10/12/2020] [Accepted: 10/14/2020] [Indexed: 12/04/2022]
Abstract
In contrast to the physical activities of able-bodied people at home, most people who require long-term specific care (e.g., bedridden patients and patients who have difficulty walking) usually show more low-intensity slow physical activities with postural changes. Although the existing devices can detect data such as heart rate and the number of steps, they have been increasing the physical burden relying on long-term wearing. The purpose of this paper is to realize a noninvasive fine-grained home care monitoring system that is sustainable for people requiring special care. In the proposed method, we present a novel technique that integrates inexpensive camera devices and bone-based human sensing technologies to characterize the quality of in-home postural changes. We realize a local process in feature data acquisition once per second, which extends from a computer browser to Raspberry Pi. Our key idea is to regard the changes of the bounding box output by standalone pose estimation models in the shape and distance as the quality of the pose conversion, body movement, and positional changes. Furthermore, we use multiple servers to realize distributed processing that uploads data to implement home monitoring as a web service. Based on the experimental results, we conveyed our findings and advice to the subject that include where the daily living habits and the irregularity of home care timings needed improvement.
Collapse
Affiliation(s)
- Sinan Chen
- Graduate School of System Informatics, Kobe University, 1-1 Rokkodai-cho, Nada, Kobe 657-8501, Japan; (S.S.); (M.N.)
| | - Sachio Saiki
- Graduate School of System Informatics, Kobe University, 1-1 Rokkodai-cho, Nada, Kobe 657-8501, Japan; (S.S.); (M.N.)
| | - Masahide Nakamura
- Graduate School of System Informatics, Kobe University, 1-1 Rokkodai-cho, Nada, Kobe 657-8501, Japan; (S.S.); (M.N.)
- RIKEN Center for Advanced Intelligence Project, 1-4-1 Nihonbashi, Chuo-ku, Tokyo 103-0027, Japan
| |
Collapse
|
10
|
Tomalski P, Malinowska-Korczak A. What Do Young Infants Do During Eye-Tracking Experiments? IP-BET - A Coding Scheme for Quantifying Spontaneous Infant and Parent Behaviour. Front Psychol 2020; 11:764. [PMID: 32411051 PMCID: PMC7198886 DOI: 10.3389/fpsyg.2020.00764] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/24/2019] [Accepted: 03/30/2020] [Indexed: 11/13/2022] Open
Abstract
Eye-tracking measurement of looking is the fundamental method in infancy research. Over the last few decades it has provided many of the most significant discoveries in developmental psychology. Infants engage in looking tasks and use their bodies for learning differently from adults, yet, the breadth of their behavioural repertoire and the constraints that the testing situation places on them remain under-explored. Young infants are tested in close physical proximity to their parent, interact during the experiment and rely on the parent to stay engaged in the task. Infants may also engage a different set of skills (e.g. when self-regulating) to perform the very same looking tasks in comparison with adult participants. We devised a coding scheme to systematically analyse task-relevant (attention to the screen) and extraneous behaviours [body movement, self-touch, non-nutritive sucking (NNS), affect] that infants exhibit during an eye-tracking session. We also measured parental behaviours (attention to the screen or the child), including dyadic interactions with the infant (talking, physical contact). We outline the rationale for the scheme and present descriptive data on the behaviour of a large group of typical 5- and 6-month-olds (n = 94) during three standard eye-tracking tasks in two seating arrangements. The majority of infants showed very high and consistent within-group attention to the screen, while there were large individual differences in the amount of limb and body movement and the use of self-regulatory behaviours (NNS, self-touch, object manipulation). Very few sex differences were found. Parents spent most time attending to the screen, but engaged in some forms of dyadic interaction, despite being given standard task instructions that minimise parental interference. Our results demonstrate the variability in infants' extraneous behaviours during standard eye-tracking despite comparable duration of attention to the screen. They show that spontaneous interactions with the parent should be more systematically considered as an integral part of the measurement of infant looking. We discuss the utility of our scheme to better understand the dynamics of looking and task performance in infant looking paradigms: those involving eye-tracking and those measuring looking duration.
Collapse
Affiliation(s)
- Przemysław Tomalski
- Neurocognitive Development Lab, Institute of Psychology, Polish Academy of Sciences, Warsaw, Poland
| | - Anna Malinowska-Korczak
- Neurocognitive Development Lab, Institute of Psychology, Polish Academy of Sciences, Warsaw, Poland
| |
Collapse
|
11
|
Senn O, Rose D, Bechtold T, Kilchenmann L, Hoesl F, Jerjen R, Baldassarre A, Alessandri E. Preliminaries to a Psychological Model of Musical Groove. Front Psychol 2019; 10:1228. [PMID: 31214069 PMCID: PMC6558102 DOI: 10.3389/fpsyg.2019.01228] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2019] [Accepted: 05/09/2019] [Indexed: 01/20/2023] Open
Affiliation(s)
- Olivier Senn
- School of Music, Lucerne University of Applied Sciences and Arts, Lucerne, Switzerland
| | - Dawn Rose
- School of Music, Lucerne University of Applied Sciences and Arts, Lucerne, Switzerland
| | - Toni Bechtold
- School of Music, Lucerne University of Applied Sciences and Arts, Lucerne, Switzerland
| | - Lorenz Kilchenmann
- School of Music, Lucerne University of Applied Sciences and Arts, Lucerne, Switzerland
| | - Florian Hoesl
- School of Music, Lucerne University of Applied Sciences and Arts, Lucerne, Switzerland
| | - Rafael Jerjen
- School of Music, Lucerne University of Applied Sciences and Arts, Lucerne, Switzerland
| | - Antonio Baldassarre
- School of Music, Lucerne University of Applied Sciences and Arts, Lucerne, Switzerland
| | - Elena Alessandri
- School of Music, Lucerne University of Applied Sciences and Arts, Lucerne, Switzerland
| |
Collapse
|
12
|
Abstract
We examined the relationship between endogenous rhythms, auditory and visual cues, and body movement in the temporal coordination of duet singers. Sixteen pairs of experienced vocalists sang a familiar melody in Solo and two Duet conditions. Vocalists sang together in Unison (simultaneously producing identical pitches) and Round Duet conditions (one vocalist, the Follower, producing pitches at an eight-tone delay from their partner, the Leader) while facing Inward (full visual cues) and Outward (reduced visual cues). Larger tempo differences in partners' spontaneous (temporally unconstrained) Solo performances were associated with larger asynchrony in Duet performances, consistent with coupling predictions for oscillators with similar natural frequencies. Vocalists were slightly but consistently more synchronous in Duets when facing their partner (Inward) than when facing Outward; Unison and Round performances were equally synchronous. The greater difficulty of Rounds production was evidenced in vocalists' slower performance rates and more variable head movements; Followers directed their head gaze away from their partner and used bobbing head movements to mark the musical beat. The strength of Followers' head movements corresponded to the amount of tone onset asynchrony with their partners, indicating a strong association between timing and movement under increased attentional and working memory demands in music performance.
Collapse
Affiliation(s)
- Caroline Palmer
- 1 Department of Psychology, McGill University, Montreal, Quebec, Canada
| | - Frances Spidle
- 1 Department of Psychology, McGill University, Montreal, Quebec, Canada
| | - Erik Koopmans
- 1 Department of Psychology, McGill University, Montreal, Quebec, Canada
| | - Peter Schubert
- 2 Schulich School of Music, McGill University, Montreal, Quebec, Canada
| |
Collapse
|
13
|
Massie-Laberge C, Cossette I, Wanderley MM. Kinematic Analysis of Pianists' Expressive Performances of Romantic Excerpts: Applications for Enhanced Pedagogical Approaches. Front Psychol 2019; 9:2725. [PMID: 30687180 PMCID: PMC6335316 DOI: 10.3389/fpsyg.2018.02725] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2018] [Accepted: 12/18/2018] [Indexed: 11/13/2022] Open
Abstract
Established pedagogical theories for classical piano usually do not consider the essential relationship between the musical structure, whole body movements, and expression. Research focusing on musicians' expression has shown that body movements reflect the performer's understanding of the musical structure. However, most studies to date focus on the performance of a single piece at a time, leaving unanswered the question on how structural parameters of pieces with varied technical difficulties influence pianists' movements. In this study, 10 pianists performed three contrasting Romantic excerpts in terms of technical level and character, while motion data was collected with a passive infrared motion capture system. We observed how pianists modulate their performances for each of the three pieces and measured the absolute difference in percentage of duration and quantity of motion (QoM) between four expressive conditions (normal, deadpan, exaggerated, immobile). We analyzed common patterns within the time-series of position data to investigate whether pianists embody musical structure in similar ways. A survey was filled in by pianists to understand how they conceive the relationship between body movements and musical structure. Results show that the variation in duration between the exaggerated and deadpan conditions was significant in one measure for one of the excerpts, and that tempo was less affected by the QoM used than by the level of expression. By applying PCA on the pianists' position data, we found that the head QoM is an important parameter for communicating different expressions and structural features. Significant variations in head QoM were found in the immobile and deadpan conditions if compared to the normal condition, only in specific regions of the score. Recurrent head movements occurred along with certain structural parameters for two of the excerpts only. Altogether, these results indicate that the analysis of pianists' body movements and expressive intentions should be carried out in relation to the specific musical context, being dependent on the technical level of the pieces and the repertoire. These results, combined with piano teaching methods, may lead to the development of new approaches in instrumental lessons to help students make independent choices regarding body movements and expression.
Collapse
|
14
|
Joshi R, Bierling BL, Long X, Weijers J, Feijs L, Van Pul C, Andriessen P. A Ballistographic Approach for Continuous and Non-Obtrusive Monitoring of Movement in Neonates. IEEE J Transl Eng Health Med 2018; 6:2700809. [PMID: 30405978 PMCID: PMC6204923 DOI: 10.1109/jtehm.2018.2875703] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 08/12/2018] [Revised: 09/12/2018] [Accepted: 10/06/2018] [Indexed: 01/31/2023]
Abstract
Continuously monitoring body movement in preterm infants can have important clinical applications since changes in movement-patterns can be a significant marker for clinical deteriorations including the onset of sepsis, seizures, and apneas. This paper proposes a system and method to monitor body movement of preterm infants in a clinical environment using ballistography. The ballistographic signal (BSG) is acquired using a thin and a film-like sensor that is placed underneath an infant. Manual annotations based on video-recordings served as a reference standard for identifying movement. We investigated the performance of multiple features, constructed from the BSG waveform, to discriminate movement from no movement based on data acquired from 10 preterm infants. Since routine cardiorespiratory monitoring is prone to movement artifacts, we also compared the application of these features on the simultaneously acquired cardiorespiratory waveforms, i.e., the electrocardiogram, the chest impedance, and the photoplethysmogram. The BSG-based-features consistently outperformed those based on the routinely acquired cardiorespiratory waveforms. The best performing BSG-based feature-the signal instability index-had a mean (standard deviation) effect size of 0.90 (0.06), as measured by the area under the receiver operating curve. The proposed system for monitoring body movement is robust to noise, non-obtrusive, and has high performance in clinical settings.
Collapse
Affiliation(s)
- Rohan Joshi
- Department of Industrial DesignEindhoven University of Technology5612AZEindhovenThe Netherlands
- Department of Clinical PhysicsMáxima Medical Center5504DBVeldhovenThe Netherlands
- Department of Fertility, Pregnancy, and Parenting SolutionsPhilips Research5656AEEindhovenThe Netherlands
| | - Bart L Bierling
- Department of Industrial DesignEindhoven University of Technology5612AZEindhovenThe Netherlands
| | - Xi Long
- Department of Fertility, Pregnancy, and Parenting SolutionsPhilips Research5656AEEindhovenThe Netherlands
- Department of Electrical EngineeringEindhoven University of Technology5612AZEindhovenThe Netherlands
| | - Janna Weijers
- Department of NeonatologyMáxima Medical Center5504DBVeldhovenThe Netherlands
| | - Loe Feijs
- Department of Industrial DesignEindhoven University of Technology5612AZEindhovenThe Netherlands
| | - Carola Van Pul
- Department of Clinical PhysicsMáxima Medical Center5504DBVeldhovenThe Netherlands
- Department of Applied PhysicsEindhoven University of Technology5612AZEindhovenThe Netherlands
| | - Peter Andriessen
- Department of NeonatologyMáxima Medical Center5504DBVeldhovenThe Netherlands
| |
Collapse
|
15
|
Pfeffer MM, Paletta A, Suchar G. New Perspectives on Burnout: A Controlled Study on Movement Analysis of Burnout Patients. Front Psychol 2018; 9:1150. [PMID: 30038594 PMCID: PMC6046446 DOI: 10.3389/fpsyg.2018.01150] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2018] [Accepted: 06/15/2018] [Indexed: 11/17/2022] Open
Abstract
Introduction: Despite extensive research on burnout, there has been to date no systematic movement analysis of burnout patients, although it is well known that psychiatric diseases express themselves through movements, such as psychomotor retardation or agitation. Since the movement expression of burnout patients has not been systematically investigated so far, the aim of this study is to close this knowledge gap in order to obtain a new perspective on burnout. Methods: Hospitalized burnout patients (n = 22; age 47.2 ± 9.1 years) and health controls (n = 20; age 41.5 ± 15.0 years) participated in a standardized movement sequence with verbal instructions. The objective Burnout Inventory Scale and diagnostics by psychiatrists were used for diagnosis. Two certified movement-analysts independently rated each participant via video by using the Effort System of Laban Movement Analysis as an instrument of dance therapy and behavior observation. Cohen's Kappa was used to test the inter-rater reliability of the movement analysts and non-parametric Mann-Whitney U tests were undertaken to assess the differences between the two groups. Results: The rater-agreement Kappa ranges from 0.66 to 0.92 (p < 0.001) with the Confidence Interval (95%) from 0.46 to 1.1. Results of the Mann-Whitney U tests indicate that burnout patients show significantly less frequent movements for the following Effort elements: Bound U(n1 = 22, n2 = 20) = 112.5, p = 0.001; Indirect U(n1 = 22, n2 = 20) = 114.5, p = 0.001; Light U(n1 = 22, n2 = 20) = 115, p = 0.001 and Sustained U(n1 = 22, n2 = 20) = 130, p = 0.01. Discussion: Burnout patients have significant deficits in all four Effort elements of the Laban Movement Analysis (Flow, Space, Time, Weight) and therefore have deficits regarding their body movement. The findings presented here provide an additional perspective on burnout.
Collapse
Affiliation(s)
| | - Andrea Paletta
- Institute of Sport Science, University of Graz, Graz, Austria
| | | |
Collapse
|
16
|
Perugia G, van Berkel R, Díaz-Boladeras M, Català-Mallofré A, Rauterberg M, Barakova E. Understanding Engagement in Dementia Through Behavior. The Ethographic and Laban-Inspired Coding System of Engagement (ELICSE) and the Evidence-Based Model of Engagement-Related Behavior (EMODEB). Front Psychol 2018; 9:690. [PMID: 29881360 PMCID: PMC5976786 DOI: 10.3389/fpsyg.2018.00690] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2017] [Accepted: 04/20/2018] [Indexed: 11/18/2022] Open
Abstract
Engagement in activities is of crucial importance for people with dementia. State of the art assessment techniques rely exclusively on behavior observation to measure engagement in dementia. These techniques are either too general to grasp how engagement is naturally expressed through behavior or too complex to be traced back to an overall engagement state. We carried out a longitudinal study to develop a coding system of engagement-related behavior that could tackle these issues and to create an evidence-based model of engagement to make meaning of such a coding system. Fourteen elderlies with mild to moderate dementia took part in the study. They were involved in two activities: a game-based cognitive stimulation and a robot-based free play. The coding system was developed with a mixed approach: ethographic and Laban-inspired. First, we developed two ethograms to describe the behavior of participants in the two activities in detail. Then, we used Laban Movement Analysis (LMA) to identify a common structure to the behaviors in the two ethograms and unify them in a unique coding system. The inter-rater reliability (IRR) of the coding system proved to be excellent for cognitive games (kappa = 0.78) and very good for robot play (kappa = 0.74). From the scoring of the videos, we developed an evidence-based model of engagement. This was based on the most frequent patterns of body part organization (i.e., the way body parts are connected in movement) observed during activities. Each pattern was given a meaning in terms of engagement by making reference to the literature. The model was tested using structural equation modeling (SEM). It achieved an excellent goodness of fit and all the hypothesized relations between variables were significant. We called the coding system that we developed the Ethographic and Laban-Inspired Coding System of Engagement (ELICSE) and the model the Evidence-based Model of Engagement-related Behavior (EMODEB). To the best of our knowledge, the ELICSE and the EMODEB constitute the first formalization of engagement-related behavior for dementia that describes how behavior unfolds over time and what it means in terms of engagement.
Collapse
Affiliation(s)
- Giulia Perugia
- Designed Intelligence, Industrial Design, Eindhoven University of Technology, Eindhoven, Netherlands.,Technical Research Center for Dependency Care and Autonomous Living, Automatic Control Department, Technical University of Catalonia, Vilanova i la Geltrú, Spain
| | - Roos van Berkel
- Designed Intelligence, Industrial Design, Eindhoven University of Technology, Eindhoven, Netherlands
| | - Marta Díaz-Boladeras
- Technical Research Center for Dependency Care and Autonomous Living, Automatic Control Department, Technical University of Catalonia, Vilanova i la Geltrú, Spain
| | - Andreu Català-Mallofré
- Technical Research Center for Dependency Care and Autonomous Living, Automatic Control Department, Technical University of Catalonia, Vilanova i la Geltrú, Spain
| | - Matthias Rauterberg
- Designed Intelligence, Industrial Design, Eindhoven University of Technology, Eindhoven, Netherlands
| | - Emilia Barakova
- Designed Intelligence, Industrial Design, Eindhoven University of Technology, Eindhoven, Netherlands
| |
Collapse
|
17
|
Riemer V, Frommel J, Layher G, Neumann H, Schrader C. Identifying Features of Bodily Expression As Indicators of Emotional Experience during Multimedia Learning. Front Psychol 2017; 8:1303. [PMID: 28798717 PMCID: PMC5529426 DOI: 10.3389/fpsyg.2017.01303] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2017] [Accepted: 07/17/2017] [Indexed: 11/30/2022] Open
Abstract
The importance of emotions experienced by learners during their interaction with multimedia learning systems, such as serious games, underscores the need to identify sources of information that allow the recognition of learners’ emotional experience without interrupting the learning process. Bodily expression is gaining in attention as one of these sources of information. However, to date, the question of how bodily expression can convey different emotions has largely been addressed in research relying on acted emotion displays. Following a more contextualized approach, the present study aims to identify features of bodily expression (i.e., posture and activity of the upper body and the head) that relate to genuine emotional experience during interaction with a serious game. In a multimethod approach, 70 undergraduates played a serious game relating to financial education while their bodily expression was captured using an off-the-shelf depth-image sensor (Microsoft Kinect). In addition, self-reports of experienced enjoyment, boredom, and frustration were collected repeatedly during gameplay, to address the dynamic changes in emotions occurring in educational tasks. Results showed that, firstly, the intensities of all emotions indeed changed significantly over the course of the game. Secondly, by using generalized estimating equations, distinct features of bodily expression could be identified as significant indicators for each emotion under investigation. A participant keeping their head more turned to the right was positively related to frustration being experienced, whereas keeping their head more turned to the left was positively related to enjoyment. Furthermore, having their upper body positioned more closely to the gaming screen was also positively related to frustration. Finally, increased activity of a participant’s head emerged as a significant indicator of boredom being experienced. These results confirm the value of bodily expression as an indicator of emotional experience in multimedia learning systems. Furthermore, the findings may guide developers of emotion recognition procedures by focusing on the identified features of bodily expression.
Collapse
Affiliation(s)
- Valentin Riemer
- Institute of Psychology and Education, Ulm UniversityUlm, Germany
| | - Julian Frommel
- Institute of Media Informatics, Ulm UniversityUlm, Germany
| | - Georg Layher
- Institute of Neural Information Processing, Ulm UniversityUlm, Germany
| | - Heiko Neumann
- Institute of Neural Information Processing, Ulm UniversityUlm, Germany
| | - Claudia Schrader
- Institute of Psychology and Education, Ulm UniversityUlm, Germany
| |
Collapse
|
18
|
De D, Mukherjee A, Sau A, Bhakta I. Design of smart neonatal health monitoring system using SMCC. Healthc Technol Lett 2017; 4:13-19. [PMID: 28261491 DOI: 10.1049/htl.2016.0054] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2016] [Revised: 08/19/2016] [Accepted: 08/30/2016] [Indexed: 11/19/2022] Open
Abstract
Automated health monitoring and alert system development is a demanding research area today. Most of the currently available monitoring and controlling medical devices are wired which limits freeness of working environment. Wireless sensor network (WSN) is a better alternative in such an environment. Neonatal intensive care unit is used to take care of sick and premature neonates. Hypothermia is an independent risk factor for neonatal mortality and morbidity. To prevent it an automated monitoring system is required. In this Letter, an automated neonatal health monitoring system is designed using sensor mobile cloud computing (SMCC). SMCC is based on WSN and MCC. In the authors' system temperature sensor, acceleration sensor and heart rate measurement sensor are used to monitor body temperature, acceleration due to body movement and heart rate of neonates. The sensor data are stored inside the cloud. The health person continuously monitors and accesses these data through the mobile device using an Android Application for neonatal monitoring. When an abnormal situation arises, an alert is generated in the mobile device of the health person. By alerting health professional using such an automated system, early care is provided to the affected babies and the probability of recovery is increased.
Collapse
Affiliation(s)
- Debashis De
- Department of Computer Science and Engineering, West Bengal University of Technology, BF142, Sector-I, Salt Lake, Kolkata 700 064, West Bengal, India; Department of Physics, University of Western Australia, Perth, 35 Stirling Highway, Crawley 6009 WA, Australia
| | - Anwesha Mukherjee
- Department of Computer Science and Engineering , West Bengal University of Technology , BF142, Sector-I, Salt Lake, Kolkata 700 064, West Bengal , India
| | - Arkaprabha Sau
- Medical Division, Port Hospital, Haldia Dock Complex, Kolkata Port Trust, West Bengal 721 607, India; Department of Community Medicine, R.G. Kar Medical Collage and Hospital, Kolkata 700 004, West Bengal, India
| | - Ishita Bhakta
- Department of Computer Science and Engineering , West Bengal University of Technology , BF142, Sector-I, Salt Lake, Kolkata 700 064, West Bengal , India
| |
Collapse
|
19
|
Yang Y, Liu C, Yu H, Shao D, Tsow F, Tao N. Motion robust remote photoplethysmography in CIELab color space. J Biomed Opt 2016; 21:117001. [PMID: 27812695 PMCID: PMC5995145 DOI: 10.1117/1.jbo.21.11.117001] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/20/2016] [Accepted: 10/18/2016] [Indexed: 06/06/2023]
Abstract
Remote photoplethysmography (rPPG) is attractive for tracking a subject’s physiological parameters without wearing a device. However, rPPG is known to be prone to body movement-induced artifacts, making it unreliable in realistic situations. Here we report a method to minimize the movement-induced artifacts. The method selects an optimal region of interest (ROI) automatically, prunes frames in which the ROI is not clearly captured (e.g., subject moves out of the view), and analyzes rPPG using an algorithm in CIELab color space, rather than the widely used RGB color space. We show that body movement primarily affects image intensity, rather than chromaticity, and separating chromaticity from intensity in CIELab color space thus helps achieve effective reduction of the movement-induced artifacts. We validate the method by performing a pilot study including 17 people with diverse skin tones.
Collapse
Affiliation(s)
- Yuting Yang
- Arizona State University, Biodesign Institute, Tempe, Arizona 85287-5801, United States
- Nanjing University, School Chemistry and Chemical Engineering, State Key Lab of Analytical Chemistry for Life Science, Nanjing, Jiangsu 210093, China
| | - Chenbin Liu
- Arizona State University, Biodesign Institute, Tempe, Arizona 85287-5801, United States
- Nanjing University, School Chemistry and Chemical Engineering, State Key Lab of Analytical Chemistry for Life Science, Nanjing, Jiangsu 210093, China
| | - Hui Yu
- Arizona State University, Biodesign Institute, Tempe, Arizona 85287-5801, United States
- Nanjing University, School Chemistry and Chemical Engineering, State Key Lab of Analytical Chemistry for Life Science, Nanjing, Jiangsu 210093, China
| | - Dangdang Shao
- Arizona State University, Biodesign Institute, Tempe, Arizona 85287-5801, United States
| | - Francis Tsow
- Arizona State University, Biodesign Institute, Tempe, Arizona 85287-5801, United States
| | - Nongjian Tao
- Arizona State University, Biodesign Institute, Tempe, Arizona 85287-5801, United States
- Nanjing University, School Chemistry and Chemical Engineering, State Key Lab of Analytical Chemistry for Life Science, Nanjing, Jiangsu 210093, China
| |
Collapse
|
20
|
Senn O, Kilchenmann L, von Georgi R, Bullerjahn C. The Effect of Expert Performance Microtiming on Listeners' Experience of Groove in Swing or Funk Music. Front Psychol 2016; 7:1487. [PMID: 27761117 PMCID: PMC5050221 DOI: 10.3389/fpsyg.2016.01487] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2016] [Accepted: 09/15/2016] [Indexed: 11/13/2022] Open
Abstract
This study tested the influence of expert performance microtiming on listeners' experience of groove. Two professional rhythm section performances (bass/drums) in swing and funk style were recorded, and the performances' original microtemporal deviations from a regular metronomic grid were scaled to several levels of magnitude. Music expert (n = 79) and non-expert (n = 81) listeners rated the groove qualities of stimuli using a newly developed questionnaire that measures three dimensions of the groove experience (Entrainment, Enjoyment, and the absence of Irritation). Findings show that music expert listeners were more sensitive to microtiming manipulations than non-experts. Across both expertise groups and for both styles, groove ratings were high for microtiming magnitudes equal or smaller than those originally performed and decreased for exaggerated microtiming magnitudes. In particular, both the fully quantized music and the music with the originally performed microtiming pattern were rated equally high on groove. This means that neither the claims of PD theory (that microtiming deviations are necessary for groove) nor the opposing exactitude hypothesis (that microtiming deviations are detrimental to groove) were supported by the data.
Collapse
Affiliation(s)
- Olivier Senn
- School of Music, Lucerne University of Applied Sciences and Arts Lucerne, Switzerland
| | - Lorenz Kilchenmann
- School of Music, Lucerne University of Applied Sciences and Arts Lucerne, Switzerland
| | - Richard von Georgi
- Department of Social Sciences and Cultural Studies, Institute of Musicology and Music Education, Justus-Liebig-University GiessenGiessen, Germany; SRH Hochschule der populären KünsteBerlin, Germany
| | - Claudia Bullerjahn
- Department of Social Sciences and Cultural Studies, Institute of Musicology and Music Education, Justus-Liebig-University Giessen Giessen, Germany
| |
Collapse
|
21
|
Aung MSH, Kaltwang S, Romera-Paredes B, Martinez B, Singh A, Cella M, Valstar M, Meng H, Kemp A, Shafizadeh M, Elkins AC, Kanakam N, de Rothschild A, Tyler N, Watson PJ, de C Williams AC, Pantic M, Bianchi-Berthouze N. The Automatic Detection of Chronic Pain-Related Expression: Requirements, Challenges and the Multimodal EmoPain Dataset. IEEE Trans Affect Comput 2016; 7:435-451. [PMID: 30906508 PMCID: PMC6430129 DOI: 10.1109/taffc.2015.2462830] [Citation(s) in RCA: 33] [Impact Index Per Article: 4.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Pain-related emotions are a major barrier to effective self rehabilitation in chronic pain. Automated coaching systems capable of detecting these emotions are a potential solution. This paper lays the foundation for the development of such systems by making three contributions. First, through literature reviews, an overview of how pain is expressed in chronic pain and the motivation for detecting it in physical rehabilitation is provided. Second, a fully labelled multimodal dataset (named 'EmoPain') containing high resolution multiple-view face videos, head mounted and room audio signals, full body 3D motion capture and electromyographic signals from back muscles is supplied. Natural unconstrained pain related facial expressions and body movement behaviours were elicited from people with chronic pain carrying out physical exercises. Both instructed and non-instructed exercises were considered to reflect traditional scenarios of physiotherapist directed therapy and home-based self-directed therapy. Two sets of labels were assigned: level of pain from facial expressions annotated by eight raters and the occurrence of six pain-related body behaviours segmented by four experts. Third, through exploratory experiments grounded in the data, the factors and challenges in the automated recognition of such expressions and behaviour are described, the paper concludes by discussing potential avenues in the context of these findings also highlighting differences for the two exercise scenarios addressed.
Collapse
Affiliation(s)
- Min S H Aung
- UCL Interaction Centre, University, College London, London WC1E 6BT, Unithed Kingdom
| | - Sebastian Kaltwang
- Department of Computing, Imperial College London, London SW7 2AZ, Unithed Kingdom
| | | | - Brais Martinez
- Department of Computing, Imperial College London, London SW7 2AZ, Unithed Kingdom
| | - Aneesha Singh
- UCL Interaction Centre, University, College London, London WC1E 6BT, Unithed Kingdom
| | - Matteo Cella
- Department of Clinical, Educational & Health Psychology, University College London, London WC1E 6BT, Unithed Kingdom
| | - Michel Valstar
- Department of Computing, Imperial College London, London SW7 2AZ, Unithed Kingdom
| | - Hongying Meng
- UCL Interaction Centre, University, College London, London WC1E 6BT, Unithed Kingdom
| | - Andrew Kemp
- Physiotherapy Department, Maidstone & Tunbridge Wells NHS Trust, TN2 4QJ
| | - Moshen Shafizadeh
- UCL Interaction Centre, University, College London, London WC1E 6BT, Unithed Kingdom
| | - Aaron C Elkins
- Department of Computing, Imperial College London, London SW7 2AZ, Unithed Kingdom
| | - Natalie Kanakam
- Department of Clinical, Educational & Health Psychology, University College London, London WC1E 6BT, Unithed Kingdom
| | - Amschel de Rothschild
- Department of Clinical, Educational & Health Psychology, University College London, London WC1E 6BT, Unithed Kingdom
| | - Nick Tyler
- Department of Civil, Environmental & Geomatic Engineering, University College London, London WC1E 6BT, Unithed Kingdom
| | - Paul J Watson
- Department of Health Sciences, University of Leicester, Leicester LE5 7PW, Unithed Kingdom
| | - Amanda C de C Williams
- Department of Clinical, Educational & Health Psychology, University College London, London WC1E 6BT, Unithed Kingdom
| | - Maja Pantic
- Department of Computing, Imperial College London, London SW7 2AZ, Unithed Kingdom
| | | |
Collapse
|
22
|
Klaming L, van Minde D, Weda H, Nielsen T, Duijm LEM. The Relation Between Anticipatory Anxiety and Movement During an MR Examination. Acad Radiol 2015; 22:1571-8. [PMID: 26410806 DOI: 10.1016/j.acra.2015.08.020] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2014] [Revised: 03/31/2015] [Accepted: 08/23/2015] [Indexed: 11/17/2022]
Abstract
RATIONALE AND OBJECTIVES During a magnetic resonance imaging (MRI) examination, patients are required to remain still to minimize motion that may compromise image quality and may make rescanning necessary. It is often assumed that anxiety, which is experienced by a considerable number of patients undergoing an MR examination, increases motion and decreases image quality. The present study explores the relationship between anxiety and movement of patients during an MR examination. MATERIALS AND METHODS Anxiety was measured subjectively by means of the State Anxiety Inventory and a visual analogue scale for claustrophobia. Motion and image quality were measured in three different ways. First, software was used that allows an estimation of motion based on tracker scans between the clinical scans. Second, the MRI technician who performed the MR examination was asked to indicate the degree of motion artifacts and image quality for each patient. Third, after all scans had been collected, two radiologists evaluated each clinical scan. RESULTS No or low correlations between anxiety and the distinct measures of motion and image quality were found for all three measures. CONCLUSIONS This finding shows that there is little evidence for the assumption that anxiety increases motion and decreases image quality during an MR examination.
Collapse
Affiliation(s)
- Laura Klaming
- Philips Research Laboratories Europe High Tech Campus 34 5656 AE Eindhoven, The Netherlands.
| | - Daisy van Minde
- Philips Research Laboratories Europe High Tech Campus 34 5656 AE Eindhoven, The Netherlands
| | - Hans Weda
- Philips Research Laboratories Europe High Tech Campus 34 5656 AE Eindhoven, The Netherlands
| | - Tim Nielsen
- Philips Technologie GmbH Innovative Technologies Research Laboratories Röntgenstrasse 24-26 22335 Hamburg, Germany
| | - Lucien E M Duijm
- Canisius Wilhelmina Hospital Department of Radiology Weg door Jonkerbos 100 6532 SZ Nijmegen PO Box 9015 6500 GS Nijmegen, The Netherlands
| |
Collapse
|
23
|
Kilchenmann L, Senn O. Microtiming in Swing and Funk affects the body movement behavior of music expert listeners. Front Psychol 2015; 6:1232. [PMID: 26347694 PMCID: PMC4542135 DOI: 10.3389/fpsyg.2015.01232] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2015] [Accepted: 08/03/2015] [Indexed: 11/17/2022] Open
Abstract
The theory of Participatory Discrepancies (or PDs) claims that minute temporal asynchronies (microtiming) in music performance are crucial for prompting bodily entrainment in listeners, which is a fundamental effect of the “groove” experience. Previous research has failed to find evidence to support this theory. The present study tested the influence of varying PD magnitudes on the beat-related body movement behavior of music listeners. 160 participants (79 music experts, 81 non-experts) listened to 12 music clips in either Funk or Swing style. These stimuli were based on two audio recordings (one in each style) of expert drum and bass duo performances. In one series of six clips, the PDs were downscaled from their originally performed magnitude to complete quantization in steps of 20%. In another series of six clips, the PDs were upscaled from their original magnitude to double magnitude in steps of 20%. The intensity of the listeners' beat-related head movement was measured using video-based motion capture technology and Fourier analysis. A mixed-design Four-Factor ANOVA showed that the PD manipulations had a significant effect on the expert listeners' entrainment behavior. The experts moved more when listening to stimuli with PDs that were downscaled by 60% compared to completely quantized stimuli. This finding offers partial support for PD theory: PDs of a certain magnitude do augment entrainment in listeners. But the effect was found to be small to moderately sized, and it affected music expert listeners only.
Collapse
Affiliation(s)
- Lorenz Kilchenmann
- School of Music, Lucerne University of Applied Sciences and Arts Lucerne, Switzerland
| | - Olivier Senn
- School of Music, Lucerne University of Applied Sciences and Arts Lucerne, Switzerland
| |
Collapse
|
24
|
Abstract
People judge attractiveness and make trait inferences from the physical appearance of others, and research reveals high agreement among observers making such judgments. Evolutionary psychologists have argued that interest in physical appearance and beauty reflects adaptations that motivate the search for desirable qualities in a potential partner. Although men more than women value the physical appearance of a partner, appearance universally affects social perception in both sexes. Most studies of attractiveness perceptions have focused on third party assessments of static representations of the face and body. Corroborating evidence suggests that body movement, such as dance, also conveys information about mate quality. Here we review evidence that dynamic cues (e.g., gait, dance) also influence perceptions of mate quality, including personality traits, strength, and overall attractiveness. We recommend that attractiveness research considers the informational value of body movement in addition to static cues, to present an integrated perspective on human social perception.
Collapse
Affiliation(s)
- Bernhard Fink
- Institute of Psychology, University of Göttingen , Göttingen, Germany ; Courant Research Center Evolution of Social Behavior, University of Göttingen , Göttingen, Germany
| | - Bettina Weege
- Institute of Psychology, University of Göttingen , Göttingen, Germany ; Courant Research Center Evolution of Social Behavior, University of Göttingen , Göttingen, Germany
| | - Nick Neave
- Department of Psychology, Northumbria University , Newcastle upon Tyne, UK
| | - Michael N Pham
- Department of Psychology, Oakland University , Rochester, MI, USA
| | | |
Collapse
|
25
|
Abstract
In an experiment on dyadic social interaction, we invited participants to verbal interactions in cooperative, competitive, and 'fun task' conditions. We focused on the link between interactants' affectivity and their nonverbal synchrony, and explored which further variables contributed to affectivity: interactants' personality traits, sex, and the prescribed interaction tasks. Nonverbal synchrony was quantified by the coordination of interactants' body movement, using an automated video-analysis algorithm (motion energy analysis). Traits were assessed with standard questionnaires of personality, attachment, interactional style, psychopathology, and interpersonal reactivity. We included 168 previously unacquainted individuals who were randomly allocated to same-sex dyads (84 females, 84 males, mean age 27.8 years). Dyads discussed four topics of general interest drawn from an urn of eight topics, and finally engaged in a fun interaction. Each interaction lasted 5 min. In between interactions, participants repeatedly assessed their affect. Using hierarchical linear modeling, we found moderate to strong effect sizes for synchrony to occur, especially in competitive and fun task conditions. Positive affect was associated positively with synchrony, negative affect was associated negatively. As for causal direction, data supported the interpretation that synchrony entailed affect rather than vice versa. The link between nonverbal synchrony and affect was strongest in female dyads. The findings extend previous reports of synchrony and mimicry associated with emotion in relationships and suggest a possible mechanism of the synchrony-affect correlation.
Collapse
Affiliation(s)
- Wolfgang Tschacher
- Abteilung für Psychotherapie, Universitätsklinik für Psychiatrie und Psychotherapie, Universität BernBern, Switzerland
| | | | | |
Collapse
|
26
|
Abstract
It is increasingly recognized that motor routines dynamically shape the processing of sensory inflow (e.g., when hand movements are used to feel a texture or identify an object). In the present research, we captured the shaping of auditory perception by movement in humans by taking advantage of a specific context: music. Participants listened to a repeated rhythmical sequence before and after moving their bodies to this rhythm in a specific meter. We found that the brain responses to the rhythm (as recorded with electroencephalography) after body movement were significantly enhanced at frequencies related to the meter to which the participants had moved. These results provide evidence that body movement can selectively shape the subsequent internal representation of auditory rhythms.
Collapse
Affiliation(s)
- Baptiste Chemin
- Institute of Neuroscience, System and Cognition Department, Université Catholique de Louvain
| | - André Mouraux
- Institute of Neuroscience, System and Cognition Department, Université Catholique de Louvain
| | - Sylvie Nozaradan
- Institute of Neuroscience, System and Cognition Department, Université Catholique de Louvain International Laboratory for Brain, Music and Sound Research, Montreal, Canada
| |
Collapse
|
27
|
Abstract
Musicians sway expressively as they play in ways that seem clearly related to the music, but quantifying the relationship has been difficult. We suggest that a complex systems framework and its accompanying tools for analyzing non-linear dynamical systems can help identify the motor synergies involved. Synergies are temporary assemblies of parts that come together to accomplish specific goals. We assume that the goal of the performer is to convey musical structure and expression to the audience and to other performers. We provide examples of how dynamical systems tools, such as recurrence quantification analysis (RQA), can be used to examine performers' movements and relate them to the musical structure and to the musician's expressive intentions. We show how detrended fluctuation analysis (DFA) can be used to identify synergies and discover how they are affected by the performer's expressive intentions.
Collapse
Affiliation(s)
- Alexander P. Demos
- Music Performance Lab, Department of Psychology, University of ConnecticutStorrs, CT, USA
| | - Roger Chaffin
- Music Performance Lab, Department of Psychology, University of ConnecticutStorrs, CT, USA
| | - Vivek Kant
- Department of Systems Design Engineering, University of WaterlooWaterloo, ON, Canada
| |
Collapse
|
28
|
Cappelle T, Fink B. Changes in women's attractiveness perception of masculine men's dances across the ovulatory cycle: preliminary data. Evol Psychol 2013; 11:965-72. [PMID: 24113580 PMCID: PMC10429995] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2013] [Accepted: 10/04/2013] [Indexed: 06/02/2023] Open
Abstract
Women's preferences for putative cues of genetic quality in men's voices, faces, bodies, and behavioral displays are stronger during the fertile phase of the ovulatory cycle. Here we show that ovulatory cycle-related changes in women's attractiveness perceptions of male features are also found with dance movements, especially those perceived as highly masculine. Dance movements of 79 British men were recorded with an optical motion-capture system whilst dancing to a basic rhythm. Virtual humanoid characters (avatars) were created and converted into 15-second video clips and rated by 37 women on masculinity. Another 23 women judged the attractiveness of the 10 dancers who scored highest and those 10 who scored lowest on masculinity once in days of high fertility and once in days of low fertility of their ovulatory cycle. High-masculine dancers were judged higher on attractiveness around ovulation than on other cycle days, whilst no such perceptual difference was found for low-masculine dancers. We suggest that women may gain fitness benefits from evolved preferences for masculinity cues they obtain from male dance movements.
Collapse
Affiliation(s)
- Tessa Cappelle
- Department of Biological Personality Psychology and Diagnostics and Courant
Research Centre Evolution of Social Behavior, University of Göttingen,
Göttingen, Germany
| | - Bernhard Fink
- Department of Biological Personality Psychology and Diagnostics and Courant
Research Centre Evolution of Social Behavior, University of Göttingen,
Göttingen, Germany
| |
Collapse
|
29
|
Ragert M, Schroeder T, Keller PE. Knowing too little or too much: the effects of familiarity with a co-performer's part on interpersonal coordination in musical ensembles. Front Psychol 2013; 4:368. [PMID: 23805116 PMCID: PMC3691551 DOI: 10.3389/fpsyg.2013.00368] [Citation(s) in RCA: 46] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2013] [Accepted: 06/04/2013] [Indexed: 12/02/2022] Open
Abstract
Expert ensemble musicians produce exquisitely coordinated sounds, but rehearsal is typically required to do so. Ensemble coordination may thus be influenced by the degree to which individuals are familiar with each other's parts. Such familiarity may affect the ability to predict and synchronize with co-performers' actions. Internal models related to action simulation and anticipatory musical imagery may be affected by knowledge of (1) the musical structure of a co-performer's part (e.g., in terms of its rhythm and phrase structure) and/or (2) the co-performer's idiosyncratic playing style (e.g., expressive micro-timing variations). The current study investigated the effects of familiarity on interpersonal coordination in piano duos. Skilled pianists were required to play several duets with different partners. One condition included duets for which co-performers had previously practiced both parts, while another condition included duets for which each performer had practiced only their own part. Each piece was recorded six times without joint rehearsal or visual contact to examine the effects of increasing familiarity. Interpersonal coordination was quantified by measuring asynchronies between pianists' keystroke timing and the correlation of their body (head and torso) movements, which were recorded with a motion capture system. The results suggest that familiarity with a co-performer's part, in the absence of familiarity with their playing style, engenders predictions about micro-timing variations that are based instead upon one's own playing style, leading to a mismatch between predictions and actual events at short timescales. Predictions at longer timescales—that is, those related to musical measures and phrases, and reflected in head movements and body sway—are, however, facilitated by familiarity with the structure of a co-performer's part. These findings point to a dissociation between interpersonal coordination at the level of keystrokes and body movements.
Collapse
Affiliation(s)
- Marie Ragert
- Music Cognition and Action Group, Max-Planck Institute for Human Cognitive and Brain Sciences Leipzig, Germany
| | | | | |
Collapse
|
30
|
Abstract
It is common scientific knowledge, that most of what we say within a conversation is not only expressed by the words' meaning alone, but also through our gestures, postures, and body movements. This non-verbal mode is possibly rooted firmly in our human evolutionary heritage, and as such, some scientists argue that it serves as a fundamental assessment and expression tool for our inner qualities. Studies of nonverbal communication have established that a universal, culture-free, non-verbal sign system exists, that is available to all individuals for negotiating social encounters. Thus, it is not only the kind of gestures and expressions humans use in social communication, but also the way these movements are performed, as this seems to convey key information about an individual's quality. Dance, for example, is a special form of movement, which can be observed in human courtship displays. Recent research suggests that people are sensitive to the variation in dance movements, and that dance performance provides information about an individual's mate quality in terms of health and strength. This article reviews the role of body movement in human non-verbal communication, and highlights its significance in human mate preferences in order to promote future work in this research area within the evolutionary psychology framework.
Collapse
Affiliation(s)
- Nadine Hugill
- Department of Sociobiology/Anthropology, Institute of Zoology and Anthropology, University of Göttingen, Göttingen, Germany
| | - Bernhard Fink
- Department of Sociobiology/Anthropology, Institute of Zoology and Anthropology, University of Göttingen, Göttingen, Germany
| | - Nick Neave
- Department of Psychology, School of Psychology and Sport Sciences, Northumbria University, Newcastle upon Tyne, United Kingdom
| |
Collapse
|