1
|
Itoi C, Ujiie Y, Ooishi Y, Kashino M. The relationship between subjective difficulty in interoceptive processing and accuracy of heartbeat perception in autistic individuals. Discov Ment Health 2024; 4:13. [PMID: 38637435 PMCID: PMC11026320 DOI: 10.1007/s44192-024-00065-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Accepted: 04/01/2024] [Indexed: 04/20/2024]
Abstract
Most autistic people experience difficulties in sensory processing, including interoceptive processing. For example, they often report subjective difficulties in the interoceptive processing of interoceptive input, such as difficulty in interpreting bodily signals, including hunger, thirst, and fatigue. However, whether these subjective interoceptive difficulties are from underlying problems in interoceptive accuracy remains unclear. This study investigated the relationship between subjective interoceptive difficulty and behavioral interoceptive accuracy in autistic adults and a control group. Subjective interoceptive accuracy was measured using an interoceptive sensitivity questionnaire, and behavioral interoceptive accuracy was measured using a heartbeat counting task. The results showed no significant relationship between subjective interoceptive difficulty and behavioral interoceptive accuracy in the autistic or control groups. This suggests that subjective interoceptive difficulty and behavioral interoceptive accuracy reflect different aspects of interoceptive processing. One possible interpretation is that autistic adults can identify individual local sensory inputs, such as heartbeats, however, they have difficulty integrating multiple inputs and recognizing internal body states such as hunger and fatigue.
Collapse
Affiliation(s)
- Chihiro Itoi
- NTT Communication Science Laboratories, 3-1 Morinosato Wakamiya, Atsugi, Kanagawa, 243-0198, Japan.
- Division of Psychology, Institute of Human Sciences, University of Tsukuba, 1-1-1 Tennodai, Tsukuba, 305-8577, Japan.
| | - Yuta Ujiie
- College of Contemporary Psychology, Rikkyo University, 1-2-26 Kitano, Niiza-shi, Saitama, 352-8558, Japan
- Research Organization of Open Innovation and Collaboration, Ritsumeikan University, 2-150 Iwakura-cho, Ibaraki, 567-8570, Japan
| | - Yuuki Ooishi
- NTT Communication Science Laboratories, 3-1 Morinosato Wakamiya, Atsugi, Kanagawa, 243-0198, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, 3-1 Morinosato Wakamiya, Atsugi, Kanagawa, 243-0198, Japan
| |
Collapse
|
2
|
Nasu D, Baba T, Imamura T, Yamaguchi M, Kitanishi Y, Kashino M. Virtual reality perceptual training can improve the temporal discrimination ability of swinging during softball batting. Front Sports Act Living 2024; 6:1332149. [PMID: 38450282 PMCID: PMC10915064 DOI: 10.3389/fspor.2024.1332149] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Accepted: 02/08/2024] [Indexed: 03/08/2024] Open
Abstract
Perception and action uncoupling in fastball sports anticipatory training is often criticized. Nevertheless, perception-only training offers distinct advantages, such as flexibility concerning time, place, and injury limitations. Therefore, the effectiveness of this training approach warrants evaluation. This study developed a virtual reality (VR) training system based on the idea that the two visual pathways in the brain are associated with visual information attributes, rather than perception or action. A key feature of this study's perception-only training was its presentation of not only the opponent's kinematics but also the ball's flight information (the attributes that guide hitting) to train the visual system necessary for real situations. Seventeen female softball batters were assigned to two groups: a training group (N = 9) and a control group (N = 8). Only the training group underwent the VR anticipatory skill training to discriminate the different ball speeds. Both groups completed a perception test and an action test on the VR during the pre- and post-training periods. The perception test assessed response accuracy (RA) in discriminating ball speed, and the action test assessed the temporal difference in swing onset (delta onset). Comparison of these two outcome variables between groups revealed that perception-only training improved both perceptual and action responses. This study demonstrated the effectiveness of perception-only training and emphasized the need for its thoughtful utilization and design.
Collapse
Affiliation(s)
- Daiki Nasu
- NTT Communication Science Laboratories, NTT Corporation, Kanagawa, Japan
| | | | | | - Masumi Yamaguchi
- NTT Communication Science Laboratories, NTT Corporation, Kanagawa, Japan
| | | | - Makio Kashino
- NTT Communication Science Laboratories, NTT Corporation, Kanagawa, Japan
| |
Collapse
|
3
|
Minami S, Watanabe K, Saijo N, Kashino M. Neural oscillation amplitude in the frontal cortex predicts esport results. iScience 2023; 26:106845. [PMID: 37250772 PMCID: PMC10212977 DOI: 10.1016/j.isci.2023.106845] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2022] [Revised: 03/28/2023] [Accepted: 05/04/2023] [Indexed: 05/31/2023] Open
Abstract
In competitive matches, strategic decisions and emotional control are important. Relevant cognitive functions and corresponding neural activities in simple and short-term laboratory tasks have been reported. Brain resources are intensively allocated in the frontal cortex during strategic decision-making. The suppression of the frontal cortex with alpha-synchronization optimizes emotional control. However, no studies have reported the contribution of neural activity to the outcome of a more complex and prolonged task. To clarify this issue, we focused on a fighting video game following a two-round first-pass system. Frontal high-gamma and alpha power in the first and third pre-round periods, respectively, were found to be increased in a winning match. Furthermore, inter-participant variations in the importance of strategic decisions and emotional control in the first and third pre-round periods were correlated with frontal high-gamma and alpha power, respectively. Therefore, the psychological and mental state, involving frontal neural fluctuations, is predictive of match outcome.
Collapse
Affiliation(s)
- Sorato Minami
- NTT Communication Science Laboratories, 3-1, Morinosato Wakamiya, Atsugi, Kanagawa 243-0198, Japan
| | - Ken Watanabe
- NTT Communication Science Laboratories, 3-1, Morinosato Wakamiya, Atsugi, Kanagawa 243-0198, Japan
- School of Fundamental Science and Engineering, Waseda University, 3-4-1 Okubo, Shinjuku, Tokyo 169-8555, Japan
| | - Naoki Saijo
- NTT Communication Science Laboratories, 3-1, Morinosato Wakamiya, Atsugi, Kanagawa 243-0198, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, 3-1, Morinosato Wakamiya, Atsugi, Kanagawa 243-0198, Japan
| |
Collapse
|
4
|
Nishizono R, Saijo N, Kashino M. Highly reproducible eyeblink timing during formula car driving. iScience 2023; 26:106803. [PMID: 37378324 PMCID: PMC10291330 DOI: 10.1016/j.isci.2023.106803] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Revised: 02/01/2023] [Accepted: 04/28/2023] [Indexed: 06/29/2023] Open
Abstract
How do humans blink while driving a vehicle? Although gaze control patterns have been previously reported in relation to successful steering, eyeblinks that disrupt vision are believed to be randomly distributed during driving or are ignored. Herein, we demonstrate that eyeblink timing shows reproducible patterns during real formula car racing driving and is related to car control. We studied three top-level racing drivers. Their eyeblinks and driving behavior were acquired during practice sessions. The results revealed that the drivers blinked at surprisingly similar positions on the courses. We identified three factors underlying the eyeblink patterns: the driver's individual blink count, lap pace associated with how strictly they followed their pattern on each lap, and car acceleration associated with when/where to blink at a moment. These findings suggest that the eyeblink pattern reflected cognitive states during in-the-wild driving and experts appear to change such cognitive states continuously and dynamically.
Collapse
Affiliation(s)
- Ryota Nishizono
- NTT Communication Science Laboratories, Morinosato Wakamiya 3-1, Atsugi, Kanagawa 243-0198, Japan
| | - Naoki Saijo
- NTT Communication Science Laboratories, Morinosato Wakamiya 3-1, Atsugi, Kanagawa 243-0198, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, Morinosato Wakamiya 3-1, Atsugi, Kanagawa 243-0198, Japan
| |
Collapse
|
5
|
Nasu D, Baba T, Imamura T, Yamaguchi M, Kitanishi Y, Kashino M. Simplified Virtual Reality System Can Be Used to Evaluate the Temporal Discrimination Ability in Softball Batting as in the Real Environment. Front Sports Act Living 2022; 4:843896. [PMID: 35548456 PMCID: PMC9082152 DOI: 10.3389/fspor.2022.843896] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2021] [Accepted: 03/24/2022] [Indexed: 11/29/2022] Open
Abstract
Recently, virtual reality (VR) technology has developed rapidly and has increasingly come to be used in the sports field. VR technology ranges from large, highly immersive devices to simple devices such as smartphones, and the respective usefulness and shortcomings of different device types have been debated. Simple devices have advantages such as portability, but also provide only a weak sense of realism. It is important to understand the purpose and extent to which VR technologies can be used. Our purpose in this study was to briefly measure one of the cognitive-motor abilities used in softball batting: temporal discrimination ability in swing onset when a batter faces two types of balls thrown at different speeds. We investigated whether a simplified head-mounted display (HMD) system can evaluate such cognitive-motor ability to the same extent as in a real environment. Ten elite female softball batters swung at fastballs and slowballs randomly thrown by the same pitcher in both real and 3D VR environments, with the same range of trajectories. We then compared the temporal discrimination ability of swing onset analyzed by video analysis between environments. We found that the discrimination ability in VR is almost the same as in reality. In addition, questionnaire items on the VR system related to user experience and cybersickness showed overall promising responses. However, we also found that the system had some issues that need to be considered, such as leading to early swing onset and large variability in it. We discussed the usefulness and limitations of the VR system by combining the results for swing onset with the questionnaire responses. By understanding the characteristics of VR technology and using it as an efficient evaluation and training of players, the sports field can make significant progress.
Collapse
Affiliation(s)
- Daiki Nasu
- NTT Communication Science Laboratories, NTT Corporation, Kanagawa, Japan
- *Correspondence: Daiki Nasu
| | - Takamichi Baba
- Biostatistics Center, Shionogi & Co., Ltd., Osaka, Japan
| | - Takumi Imamura
- Biostatistics Center, Shionogi & Co., Ltd., Osaka, Japan
| | - Masumi Yamaguchi
- NTT Communication Science Laboratories, NTT Corporation, Kanagawa, Japan
| | | | - Makio Kashino
- NTT Communication Science Laboratories, NTT Corporation, Kanagawa, Japan
| |
Collapse
|
6
|
Ooishi Y, Kobayashi M, Kashino M, Ueno K. Presence of Three-Dimensional Sound Field Facilitates Listeners' Mood, Felt Emotion, and Respiration Rate When Listening to Music. Front Psychol 2021; 12:650777. [PMID: 34867569 PMCID: PMC8637927 DOI: 10.3389/fpsyg.2021.650777] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2021] [Accepted: 10/15/2021] [Indexed: 11/23/2022] Open
Abstract
Many studies have investigated the effects of music listening from the viewpoint of music features such as tempo or key by measuring psychological or psychophysiological responses. In addition, technologies for three-dimensional sound field (3D-SF) reproduction and binaural recording have been developed to induce a realistic sensation of sound. However, it is still unclear whether music listened to in the presence of 3D-SF is more impressive than in the absence of it. We hypothesized that the presence of a 3D-SF when listening to music facilitates listeners' moods, emotions for music, and physiological activities such as respiration rate. Here, we examined this hypothesis by evaluating differences between a reproduction condition with headphones (HD condition) and one with a 3D-SF reproduction system (3D-SF condition). We used a 3D-SF reproduction system based on the boundary surface control principle (BoSC system) to reproduce a sound field of music in the 3D-SF condition. Music in the 3D-SF condition was binaurally recorded through a dummy head in the BoSC reproduction room and reproduced with headphones in the HD condition. Therefore, music in the HD condition was auditorily as rich in information as that in the 3D-SF condition, but the 3D-sound field surrounding listeners was absent. We measured the respiration rate and heart rate of participants listening to acousmonium and pipe organ music. The participants rated their felt moods before and after they listened to music, and after they listened, they also rated their felt emotion. We found that the increase in respiration rate, the degree of decrease in well-being, and unpleasantness for both pieces in the 3D-SF condition were greater than in the HD condition. These results suggest that the presence of 3D-SF enhances changes in mood, felt emotion for music, and respiration rate when listening to music.
Collapse
Affiliation(s)
- Yuuki Ooishi
- NTT Communication Science Laboratories, NTT Corporation, Atsugi, Japan
| | - Maori Kobayashi
- Faculty of Human Sciences, School of Human Sciences, Waseda University, Tokorozawa, Japan
- Department of Architecture, School of Science and Technology, Meiji University, Kawasaki, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, NTT Corporation, Atsugi, Japan
| | - Kanako Ueno
- Department of Architecture, School of Science and Technology, Meiji University, Kawasaki, Japan
- Core Research for Evolutional Science and Technology, Japan Science and Technology Agency (CREST, JST), Tokyo, Japan
| |
Collapse
|
7
|
Saijo N, Nishizono R, Kashino M. Relationship between pre-driving heart rate and driving performance in formula car racing: a case study. Annu Int Conf IEEE Eng Med Biol Soc 2021; 2021:4957-4960. [PMID: 34892320 DOI: 10.1109/embc46164.2021.9630288] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Formula car racing is highly competitive and induces significant physical stress. Previous studies have shown that intense physical stresses, such as g-force, accelerate the driver's heart rate (HR). In contrast, it remains unclear whether psychological stress affects the physiological states of racers and racing performance. To investigate this phenomenon, we developed a wearable monitor that can track the driver's HR during a race. The HR and driving performance of two professional drivers were monitored in real racing situations. Changes in HR were then evaluated based on changes in the racing situation and car behavior. The results suggest that HR acceleration is strongly correlated with race situations such as free practice or qualifying sessions, and that such changes are related to subsequent driving performance.
Collapse
|
8
|
Matsumura S, Watanabe K, Saijo N, Ooishi Y, Kimura T, Kashino M. Positive Relationship Between Precompetitive Sympathetic Predominance and Competitive Performance in Elite Extreme Sports Athletes. Front Sports Act Living 2021; 3:712439. [PMID: 34498000 PMCID: PMC8421024 DOI: 10.3389/fspor.2021.712439] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2021] [Accepted: 07/23/2021] [Indexed: 11/21/2022] Open
Abstract
Elite athletes achieve superior performance under high pressure in competitive situations. Although it is known that such situations affect the precompetitive activity of their autonomic nervous system (ANS), the relationship between precompetitive ANS activity and performance remains controversial. Especially in extreme sports, it has been shown that cardiac sympathetic tone occurs in athletes before competition attempts. However, the relationship between precompetitive sympathetic tone and performance is unclear. To investigate this relationship in extreme sports, we organized a freestyle snowboard jumping competition and examined competitors' physiological states and performance during this event. The electrocardiograms (ECGs) of 20 elite snowboarders were measured 10 min before each jump in different competitive situations: practice, qualifying, and final sessions. The mean heart rate (HR), the low-frequency to high-frequency component ratio (LF/HF ratio), the logarithm of the HF (lnHF) component of the frequency-domain of the heart rate variability (HRV), the ratio of the standard deviation of all R-R intervals to the root mean square of successive differences of R-R intervals (SDNN/rMSSD ratio), and the rMSSD of the time-domain of the HRV were calculated from the ECG data. The results showed a significant increase in the mean HR as well as significant decreases in the lnHF component and rMSSD of the HRV as the sessions progressed. Interestingly, the mean HR, LF/HF ratio and SDNN/rMSSD ratio of the HRV showed significant positive correlations with competitive scores, and the lnHF component and rMSSD of the HRV showed significant negative correlations with the scores. Our results indicate that precompetitive ANS activity becomes predominantly sympathetic in elite extreme athletes, such as freestyle snowboarders, when the competition intensifies, and that this sympathetic predominance is positively related to competitive performance.
Collapse
|
9
|
Fujihira H, Itoi C, Furukawa S, Kato N, Kashino M. Auditory brainstem responses in adults with autism spectrum disorder. Clin Neurophysiol Pract 2021; 6:179-184. [PMID: 34235293 PMCID: PMC8249870 DOI: 10.1016/j.cnp.2021.04.004] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/23/2020] [Revised: 04/01/2021] [Accepted: 04/26/2021] [Indexed: 12/02/2022] Open
Abstract
OBJECTIVE To investigate possible differences in the auditory peripheral and brainstem functions between adults with autism spectrum disorder (ASD) and neurotypical (NT) adults. METHODS Click-evoked auditory brainstem responses (ABRs) were obtained from 17 high-functioning ASD adults (aged 21-38 years) and 20 NT adults (aged 22-36 years). A relatively large number of stimulus presentations (6000) were adopted, and ABRs by horizontal and vertical electrode montages were evaluated, in order to allow precise evaluations of early ABR components. RESULTS Waves I, II, III, and V were identified in the vertical electrode montage, and wave I and the summating potential (SP) in electrocochleograms were identified in the horizontal electrode montage. There were no significant group differences in the wave I, II, III, and V latencies or the interpeak latencies (IPLs) in the vertical electrode montage. In the horizontal montage, the ASD adults exhibited significantly shortened SP latencies compared with the NT adults, whereas there was no significant group difference in the wave I latency. CONCLUSION The ASD adults may have the abnormalities of processing more in the peripheral auditory system than in the brainstem. SIGNIFICANCE The current study suggests that the peripheral abnormality is associated with ASD.
Collapse
Affiliation(s)
- H. Fujihira
- NTT Communication Science Laboratories, Morinosato Wakamiya, Atsugi, Kanagawa, Japan
- Japan Society for the Promotion of Science (JSPS), Kojimachi, Chiyoda-ku, Tokyo, Japan
| | - C. Itoi
- Department of Psychology, Faculty of Letters, Chuo University, Higashinakano, Hachioji, Tokyo, Japan
| | - S. Furukawa
- NTT Communication Science Laboratories, Morinosato Wakamiya, Atsugi, Kanagawa, Japan
| | - N. Kato
- Medical Institute of Developmental Disabilities Research, Showa University, Kitakarasuyama, Setagaya, Tokyo, Japan
| | - M. Kashino
- NTT Communication Science Laboratories, Morinosato Wakamiya, Atsugi, Kanagawa, Japan
| |
Collapse
|
10
|
Hashimoto T, Takiyama K, Miki T, Kobayashi H, Nasu D, Ijiri T, Kuwata M, Kashino M, Nakazawa K. Effort-dependent effects on uniform and diverse muscle activity features in skilled pitching. Sci Rep 2021; 11:8211. [PMID: 33859271 PMCID: PMC8050268 DOI: 10.1038/s41598-021-87614-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2020] [Accepted: 03/02/2021] [Indexed: 11/09/2022] Open
Abstract
How do skilled players change their motion patterns depending on motion effort? Pitchers commonly accelerate wrist and elbow joint rotations via proximal joint motions. Contrastingly, they show individually different pitching motions, such as in wind-up or follow-through. Despite the generality of the uniform and diverse features, effort-dependent effects on these features are unclear. Here, we reveal the effort dependence based on muscle activity data in natural three-dimensional pitching performed by skilled players. We extract motor modules and their effort dependence from the muscle activity data via tensor decomposition. Then, we reveal the unknown relations among motor modules, common features, unique features, and effort dependence. The current study clarifies that common features are obvious in distinguishing between low and high effort and that unique features are evident in differentiating high and highest efforts.
Collapse
Affiliation(s)
- Tsubasa Hashimoto
- Department of Electrical Engineering and Computer Science, Tokyo University of Agriculture and Technology, 2-24-16, Nakacho, Koganei, Tokyo, Japan
| | - Ken Takiyama
- Department of Electrical Engineering and Computer Science, Tokyo University of Agriculture and Technology, 2-24-16, Nakacho, Koganei, Tokyo, Japan.
| | - Takeshi Miki
- Department of Life Sciences, Graduate School of Arts and Sciences, The University of Tokyo, Tokyo, Japan
| | - Hirofumi Kobayashi
- Department of Life Sciences, Graduate School of Arts and Sciences, The University of Tokyo, Tokyo, Japan
| | - Daiki Nasu
- NTT Communication Science Laboratories, Nippon Telegraph and Telephone Corporation, Atsugi, Kanagawa, Japan
| | - Tetsuya Ijiri
- Department of Life Sciences, Graduate School of Arts and Sciences, The University of Tokyo, Tokyo, Japan
| | - Masumi Kuwata
- Department of Life Sciences, Graduate School of Arts and Sciences, The University of Tokyo, Tokyo, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, Nippon Telegraph and Telephone Corporation, Atsugi, Kanagawa, Japan
| | - Kimitaka Nakazawa
- Department of Life Sciences, Graduate School of Arts and Sciences, The University of Tokyo, Tokyo, Japan
| |
Collapse
|
11
|
Lin IF, Itahashi T, Kashino M, Kato N, Hashimoto RI. Brain activations while processing degraded speech in adults with autism spectrum disorder. Neuropsychologia 2021; 152:107750. [PMID: 33417913 DOI: 10.1016/j.neuropsychologia.2021.107750] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2020] [Revised: 12/14/2020] [Accepted: 12/31/2020] [Indexed: 11/17/2022]
Abstract
Individuals with autism spectrum disorder (ASD) are found to have difficulties in understanding speech in adverse conditions. In this study, we used noise-vocoded speech (VS) to investigate neural processing of degraded speech in individuals with ASD. We ran fMRI experiments in the ASD group and a typically developed control (TDC) group while they listened to clear speech (CS), VS, and spectrally rotated VS (SRVS), and they were requested to pay attention to the heard sentence and answer whether it was intelligible or not. The VS used in this experiment was spectrally degraded but still intelligible, but the SRVS was unintelligible. We recruited 21 right-handed adult males with ASD and 24 age-matched and right-handed male TDC participants for this experiment. Compared with the TDC group, we observed reduced functional connectivity (FC) between the left dorsal premotor cortex and left temporoparietal junction in the ASD group for the effect of task difficulty in speech processing, computed as VS-(CS + SRVS)/2. Furthermore, the observed reduced FC was negatively correlated with their Autism-Spectrum Quotient scores. This observation supports our hypothesis that the disrupted dorsal stream for attentive process of degraded speech in individuals with ASD might be related to their difficulty in understanding speech in adverse conditions.
Collapse
Affiliation(s)
- I-Fan Lin
- Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa, 243-0124, Japan; Department of Medicine, Taipei Medical University, Taipei, Taiwan, 11031; Department of Occupational Medicine, Shuang Ho Hospital, New Taipei City, Taiwan, 23561.
| | - Takashi Itahashi
- Medical Institute of Developmental Disabilities Research, Showa University Karasuyama Hospital, Tokyo, 157-8577, Japan
| | - Makio Kashino
- Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa, 243-0124, Japan; School of Engineering, Tokyo Institute of Technology, Yokohama, 226-8503, Japan; Graduate School of Education, University of Tokyo, Tokyo, 113-0033, Japan
| | - Nobumasa Kato
- Medical Institute of Developmental Disabilities Research, Showa University Karasuyama Hospital, Tokyo, 157-8577, Japan
| | - Ryu-Ichiro Hashimoto
- Medical Institute of Developmental Disabilities Research, Showa University Karasuyama Hospital, Tokyo, 157-8577, Japan; Department of Language Sciences, Tokyo Metropolitan University, Tokyo, 192-0364, Japan.
| |
Collapse
|
12
|
Abstract
This study investigated the amount of impact of each release parameter - pitch speed, release position, release projection angle and spin rate and axis - on pitch location during four-seam fastball pitching. Data from 26 pitchers, including professionals, semi-professionals and collegiate pitchers, were obtained by using simplified radar ball-tracking system called TrackMan Baseball. The results of a multiple linear regression analysis indicate that the release projection angle had the largest effect on the pitch locations and the spin rate had the smallest effect among significant predictor variables in both vertical and horizontal planes. The amounts of change in pitch location affected by 1-SD changes in release projection angles in vertical and horizontal planes (0.73° and 0.69°, respectively) were both about half of home-plate width (19.8 cm and 18.2 cm); those affected by 1-SD changes in the spin rate (67.7 rpm) were both about 1/10 of the size of a baseball (0.83 cm and 0.75 cm). The results of this study are concrete indicators for coaches and players when they use a ball-tracking system and interpret the measured data.
Collapse
Affiliation(s)
- Daiki Nasu
- NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa, Japan
| |
Collapse
|
13
|
Nasu D, Yamaguchi M, Kobayashi A, Saijo N, Kashino M, Kimura T. Behavioral Measures in a Cognitive-Motor Batting Task Explain Real Game Performance of Top Athletes. Front Sports Act Living 2020; 2:55. [PMID: 33345046 PMCID: PMC7739838 DOI: 10.3389/fspor.2020.00055] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2019] [Accepted: 04/16/2020] [Indexed: 11/13/2022] Open
Abstract
Excellent athletic performance in baseball and softball batting is achieved through the momentary cognitive-motor processes. However, in previous studies, cognitive and motor processes are investigated separately. In this study, we focused on the difference in the time of swing onset (a delta onset) during a batting task where 17 elite female softball batters hit balls randomly thrown at two different speeds by pitchers. The delta onset included both cognitive and motor processes because the batters needed to anticipate the ball speed and discriminate their swing motion according to the time-to-contact. Then, we investigated the relationship between the delta onset and the batting outcomes of the batting task, and the relationship between the experimental outcomes and actual batting performance (batting average) over a season. We used path analysis to clarify the structure of the cognitive-motor processes and consequent performance. We found that the batters who had a larger delta onset attained superior batting outcomes (i.e., higher exit velocity and lower miss ratio) in the batting task, and these experimental outcomes explained 67% of the batting average in real games. On the other hand, the cognitive scores (judgement accuracy and rapidity) obtained from a button pressing task, where batters responded to a ball by pressing a button instead of actually swinging, explained only 34% of the batting average. Therefore, our model quantitatively describes the key cognitive-motor structure for athletes and can partially predict a batter's performance in real games. These findings suggest that it is important to employ both cognitive and motor processes in performing tasks, such as this batting task, to properly evaluate a batter's actual ability.
Collapse
Affiliation(s)
- Daiki Nasu
- NTT Communication Science Laboratories, Nippon Telegraph and Telephone Corporation, Kanagawa, Japan
| | - Masumi Yamaguchi
- NTT Communication Science Laboratories, Nippon Telegraph and Telephone Corporation, Kanagawa, Japan
| | - Akemi Kobayashi
- NTT Communication Science Laboratories, Nippon Telegraph and Telephone Corporation, Kanagawa, Japan
| | - Naoki Saijo
- NTT Communication Science Laboratories, Nippon Telegraph and Telephone Corporation, Kanagawa, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, Nippon Telegraph and Telephone Corporation, Kanagawa, Japan
| | - Toshitaka Kimura
- NTT Communication Science Laboratories, Nippon Telegraph and Telephone Corporation, Kanagawa, Japan
| |
Collapse
|
14
|
Liao HI, Kashino M, Shimojo S. Attractiveness in the Eyes: A Possibility of Positive Loop between Transient Pupil Constriction and Facial Attraction. J Cogn Neurosci 2020; 33:315-340. [PMID: 33166194 DOI: 10.1162/jocn_a_01649] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
Contrary to the long-held belief of a close linkage between pupil dilation and attractiveness, we found an early and transient pupil constriction response when participants viewed an attractive face (and the effect of luminance/contrast was controlled). While human participants were making an attractiveness judgment on faces, their pupil constricted more for the more attractive (as-to-be-rated) faces. Further experiments showed that the effect of pupil constriction to attractiveness judgment extended to intrinsically esthetic visual objects such as natural scene images (as well as faces) but not to line-drawing geometric figures. When participants were asked to judge the roundness of faces, pupil constriction still correlated with their attractiveness but not the roundness rating score, indicating the automaticity of the pupil constriction to attractiveness. When pupillary responses were manipulated implicitly by relative background luminance changes (from the prestimulus screen), the facial attractiveness ratings were in accordance with the amount of pupil constriction, which could not be explained solely by simultaneous or sequential luminance contrast. The overall results suggest that pupil constriction not only reflects but, as a part of self-monitoring and attribution mechanisms, also possibly contributes to facial attractiveness implicitly.
Collapse
Affiliation(s)
| | - Makio Kashino
- NTT Corporation, Atsugi, Kanagawa, Japan.,Tokyo Institute of Technology
| | | |
Collapse
|
15
|
Kishita Y, Ueda H, Kashino M. Temporally Coupled Coordination of Eye and Body Movements in Baseball Batting for a Wide Range of Ball Speeds. Front Sports Act Living 2020; 2:64. [PMID: 33345055 PMCID: PMC7739824 DOI: 10.3389/fspor.2020.00064] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2020] [Accepted: 05/11/2020] [Indexed: 11/17/2022] Open
Abstract
We investigated the visuomotor strategies of baseball batting, in particular, the relationship between eye and body (head and hip) movements during batting for a wide range of ball speeds. Nine college baseball players participated in the experiment and hit balls projected by a pitching machine operating at four different ball speeds (80, 100, 120, 140 km/h). Eye movements were measured with a wearable eye tracker, and body movements were measured with an optical motion capture system. In the early period of the ball's flight, batters foveated the ball with overshooting head movements in the direction of the ball's flight while compensating for the overshooting head movements with eye movements for the two slower ball speeds (80 and 100 km/h) and only head rotations for the two faster ball speeds (120 and 140 km/h). After that, batters made a predictive saccade and a quick head rotation to the future ball position before the angular velocity of the ball drastically increased. We also found that regardless of the ball speed, the onsets of the predictive saccade and the quick head movement were temporally aligned with the bat-ball contact and rotation of the hip (swing motion), but were not correlated with the elapsed time from the ball's release or the ball's location. These results indicate that the gaze movements in baseball batting are not solely driven by external visual information (ball position or velocity) but are determined in relation to other body movements.
Collapse
Affiliation(s)
- Yuki Kishita
- Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, Tokyo, Japan
| | - Hiroshi Ueda
- NTT Communication Science Laboratories, Nippon Telegraph and Telephone Co., Kanagawa, Japan
| | - Makio Kashino
- Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, Tokyo, Japan
- NTT Communication Science Laboratories, Nippon Telegraph and Telephone Co., Kanagawa, Japan
| |
Collapse
|
16
|
Abstract
In baseball, batters swing in response to a ball moving at high speed within a limited amount of time—about 0. 5 s. In order to make such movement possible, quick and accurate trajectory prediction followed by accurate swing motion with optimal body-eye coordination is considered essential, but the mechanisms involved are not clearly understood. The present study aims to clarify the strategies of eye and head movements adopted by elite baseball batters in actual game situations. In our experiment, six current professional baseball batters faced former professional baseball pitchers in a scenario close to a real game (i.e., without the batters informed about pitch type in advance). We measured eye movements with a wearable eye-tracker and head movements and bat trajectories with an optical motion capture system while the batters hit. In the eye movement measurements, contrary to previous studies, we found distinctive predictive saccades directed toward the predicted trajectory, of which the first saccades were initiated approximately 80–220 ms before impact for all participants. Predictive saccades were initiated significantly later when batters knew the types of pitch in advance compared to when they did not. We also found that the best three batters started predictive saccades significantly later and tended to have fewer gaze-ball errors than the other three batters. This result suggests that top batters spend slightly more time obtaining visual information by delaying the initiation of saccades. Furthermore, although all batters showed positive correlations between bat location and head direction at the time of impact, the better batters showed no correlation between bat location and gaze direction at that time. These results raise the possibility of differences in the coding process for the location of bat-ball contact; namely, that top batters might utilize head direction to encode impact locations.
Collapse
Affiliation(s)
- Yuki Kishita
- Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, Tokyo, Japan
| | - Hiroshi Ueda
- NTT Communication Science Laboratories, Nippon Telegraph and Telephone Co., Atsugi, Japan
| | - Makio Kashino
- Department of Information and Communications Engineering, School of Engineering, Tokyo Institute of Technology, Tokyo, Japan.,NTT Communication Science Laboratories, Nippon Telegraph and Telephone Co., Atsugi, Japan
| |
Collapse
|
17
|
Abstract
A core symptom of autism spectrum disorder (ASD) is restricted and repetitive behavior, characterized partly by insistence on sameness and excessively focused interest. This behavior has often been interpreted as a manifestation of anxiety and fear triggered by resistance to change. The implicit assumption underlying this interpretation is that perception per se (such as the judgment of sameness and changes in sensory stimuli) is not different between ASD and typically developed (TD) individuals, but that only the emotional response to the same amount of perceived change is. However, few studies have examined how individuals with ASD actually perceive a repeated presentation of the same sensory stimulus. To explore this issue, we conducted a listening test to compare perception of a repeated sound pattern, namely a spoken word, between ASD and TD groups. Prolonged listening to a repeated word without a pause may induce perceptual changes, which is known as the verbal transformation effect. We discovered that individuals with ASD tend to perceive more drastic changes or differences for the same repeated auditory pattern. This suggests that such variable perception incites individuals with ASD to persist for sameness.
Collapse
Affiliation(s)
- Chihiro Itoi
- Department of Psychology, Faculty of Letters, Chuo University, 742-1 Higashinakano, Hachioji, Tokyo, 192-0393, Japan.
| | - Nobumasa Kato
- Medical Institute of Developmental Disabilities Research, Showa University, Kitakarasuyama 6-11-11, Setagaya, Tokyo, 157-8577, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, 3-1 Morinosato Wakamiya, Atsugi, Kanagawa, 243-0198, Japan.
| |
Collapse
|
18
|
Abstract
There are indications that the pupillary dilation response (PDR) reflects surprising moments in an auditory sequence such as the appearance of a deviant noise against repetitively presented pure tones (4), and salient and loud sounds that are evaluated by human paricipants subjectively (12). In the current study, we further examined whether the reflection of PDR in auditory surprise can be accumulated and revealed in complex and yet structured auditory stimuli, i.e., music, and when the surprise is defined subjectively. Participants listened to 15 excerpts of music while their pupillary responses were recorded. In the surprise-rating session, participants rated how surprising an instance in the excerpt was, i.e., rich in variation versus monotonous, while they listened to it. In the passive-listening session, they listened to the same 15 excerpts again but were not involved in any task. The pupil diameter data obtained from both sessions were time-aligned to the rating data obtained from the surprise-rating session. Results showed that in both sessions, mean pupil diameter was larger at moments rated more surprising than unsurprising. The result suggests that the PDR reflects surprise in music automatically.
Collapse
Affiliation(s)
- Hsin-I Liao
- NTT Communication Science Laboratories, NTT Cooperation,, Japan
| | - Makoto Yoneya
- NTT Communication Science Laboratories, NTT Cooperation,, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, NTT Cooperation,, Japan
| | | |
Collapse
|
19
|
Kondo HM, Pressnitzer D, Shimada Y, Kochiyama T, Kashino M. Inhibition-excitation balance in the parietal cortex modulates volitional control for auditory and visual multistability. Sci Rep 2018; 8:14548. [PMID: 30267021 PMCID: PMC6162284 DOI: 10.1038/s41598-018-32892-3] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2018] [Accepted: 09/18/2018] [Indexed: 11/25/2022] Open
Abstract
Perceptual organisation must select one interpretation from several alternatives to guide behaviour. Computational models suggest that this could be achieved through an interplay between inhibition and excitation across competing types of neural population coding for each interpretation. Here, to test for such models, we used magnetic resonance spectroscopy to measure non-invasively the concentrations of inhibitory γ-aminobutyric acid (GABA) and excitatory glutamate-glutamine (Glx) in several brain regions. Human participants first performed auditory and visual multistability tasks that produced spontaneous switching between percepts. Then, we observed that longer percept durations during behaviour were associated with higher GABA/Glx ratios in the sensory area coding for each modality. When participants were asked to voluntarily modulate their perception, a common factor across modalities emerged: the GABA/Glx ratio in the posterior parietal cortex tended to be positively correlated with the amount of effective volitional control. Our results provide direct evidence implicating that the balance between neural inhibition and excitation within sensory regions resolves perceptual competition. This powerful computational principle appears to be leveraged by both audition and vision, implemented independently across modalities, but modulated by an integrated control process.
Collapse
Affiliation(s)
- Hirohito M Kondo
- School of Psychology, Chukyo University, Nagoya, Aichi, Japan.
- Human Information Science Laboratory, NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa, Japan.
| | - Daniel Pressnitzer
- Laboratoire des Systèmes Perceptifs, CNRS UMR 8248, Paris, France
- Département d'Études Cognitive, École Normale Supérieure, Paris, France
| | - Yasuhiro Shimada
- Brain Activity Imaging Center, ATR-Promotions, Seika-cho, Kyoto, Japan
| | - Takanori Kochiyama
- Brain Activity Imaging Center, ATR-Promotions, Seika-cho, Kyoto, Japan
- Department of Cognitive Neuroscience, Advanced Telecommunications Research Institute International, Seika-cho, Kyoto, Japan
| | - Makio Kashino
- Sports Brain Science Project, NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa, Japan
- School of Engineering, Tokyo Institute of Technology, Yokohama, Kanagawa, Japan
| |
Collapse
|
20
|
Ishida M, Arai T, Kashino M. Perceptual Restoration of Temporally Distorted Speech in L1 vs. L2: Local Time Reversal and Modulation Filtering. Front Psychol 2018; 9:1749. [PMID: 30283390 PMCID: PMC6156149 DOI: 10.3389/fpsyg.2018.01749] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2018] [Accepted: 08/29/2018] [Indexed: 11/13/2022] Open
Abstract
Speech is intelligible even when the temporal envelope of speech is distorted. The current study investigates how native and non-native speakers perceptually restore temporally distorted speech. Participants were native English speakers (NS), and native Japanese speakers who spoke English as a second language (NNS). In Experiment 1, participants listened to “locally time-reversed speech” where every x-ms of speech signal was reversed on the temporal axis. Here, the local time reversal shifted the constituents of the speech signal forward or backward from the original position, and the amplitude envelope of speech was altered as a function of reversed segment length. In Experiment 2, participants listened to “modulation-filtered speech” where the modulation frequency components of speech were low-pass filtered at a particular cut-off frequency. Here, the temporal envelope of speech was altered as a function of cut-off frequency. The results suggest that speech becomes gradually unintelligible as the length of reversed segments increases (Experiment 1), and as a lower cut-off frequency is imposed (Experiment 2). Both experiments exhibit the equivalent level of speech intelligibility across six levels of degradation for native and non-native speakers respectively, which poses a question whether the regular occurrence of local time reversal can be discussed in the modulation frequency domain, by simply converting the length of reversed segments (ms) into frequency (Hz).
Collapse
Affiliation(s)
- Mako Ishida
- NTT Communication Science Laboratories, Atsugi, Japan.,Japan Society for the Promotion of Science, Tokyo, Japan.,Department of Information and Communication Sciences, Sophia University, Tokyo, Japan
| | - Takayuki Arai
- Department of Information and Communication Sciences, Sophia University, Tokyo, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, Atsugi, Japan
| |
Collapse
|
21
|
Mitani K, Kashino M. Auditory Feedback Assists Post hoc Error Correction of Temporal Reproduction, and Perception of Self-Produced Time Intervals in Subsecond Range. Front Psychol 2018; 8:2325. [PMID: 29403407 PMCID: PMC5780434 DOI: 10.3389/fpsyg.2017.02325] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2017] [Accepted: 12/21/2017] [Indexed: 11/13/2022] Open
Abstract
We examined whether auditory feedback assists the post hoc error correction of temporal reproduction, and the perception of self-produced time intervals in the subsecond and suprasecond ranges. Here, we employed a temporal reproduction task with a single motor response at a point in time with and without auditory feedback. This task limits participants to reducing errors by employing auditory feedback in a post hoc manner. Additionally, the participants were asked to judge the self-produced timing in this task. The results showed that, in the presence of auditory feedback, the participants exhibited smaller variability and bias in terms of temporal reproduction and the perception of self-produced time intervals in the subsecond range but not in the suprasecond range. Furthermore, in the presence of auditory feedback, the positive serial dependency of temporal reproduction, which is the tendency of reproduced intervals to be similar to those in adjacent trials, was reduced in the subsecond range but not in the suprasecond range. These results suggest that auditory feedback assists the post hoc error correction of temporal reproduction, and the perception of self-produced time intervals in the subsecond range.
Collapse
Affiliation(s)
- Keita Mitani
- Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, Yokohama, Japan.,Japan Society for the Promotion of Science, Tokyo, Japan
| | - Makio Kashino
- Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, Yokohama, Japan.,NTT Communication Science Laboratories, Nippon Telegraph and Telephone Corporation, Atsugi, Japan
| |
Collapse
|
22
|
Yoneya M, Liao HI, Furukawa S, Kashino M. WITHDRAWN: Auditory Surprise Model Based on Pattern Retrieval from the Past Observation. Neuroscience 2017:S0306-4522(17)30914-4. [PMID: 29294342 DOI: 10.1016/j.neuroscience.2017.12.024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/04/2017] [Revised: 12/15/2017] [Accepted: 12/18/2017] [Indexed: 11/28/2022]
Abstract
This article has been withdrawn: please see Elsevier Policy on Article Withdrawal (http://www.elsevier.com/locate/withdrawalpolicy). This article has been withdrawn at the request of the authors. The authors regrets that the reason for withdrawal is due to an disagreement in authorship and in scope of data disclosure. The authors apologize to the readers for this unfortunate error.
Collapse
Affiliation(s)
- Makoto Yoneya
- NTT Communication Science Laboratories, 3-1 Morinosato Wakamiya, Atsugi, Kanagawa, Japan; Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, 4259 Nagatsuda, Midori-ku, Yokohama, Kanagawa, Japan.
| | - Hsin-I Liao
- NTT Communication Science Laboratories, 3-1 Morinosato Wakamiya, Atsugi, Kanagawa, Japan.
| | - Shigeto Furukawa
- NTT Communication Science Laboratories, 3-1 Morinosato Wakamiya, Atsugi, Kanagawa, Japan.
| | - Makio Kashino
- NTT Communication Science Laboratories, 3-1 Morinosato Wakamiya, Atsugi, Kanagawa, Japan; Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, 4259 Nagatsuda, Midori-ku, Yokohama, Kanagawa, Japan.
| |
Collapse
|
23
|
Ooishi Y, Mukai H, Watanabe K, Kawato S, Kashino M. Increase in salivary oxytocin and decrease in salivary cortisol after listening to relaxing slow-tempo and exciting fast-tempo music. PLoS One 2017; 12:e0189075. [PMID: 29211795 PMCID: PMC5718605 DOI: 10.1371/journal.pone.0189075] [Citation(s) in RCA: 40] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2017] [Accepted: 11/17/2017] [Indexed: 02/07/2023] Open
Abstract
Relaxation and excitation are components of the effects of music listening. The tempo of music is often considered a critical factor when determining these effects: listening to slow-tempo and fast-tempo music elicits relaxation and excitation, respectively. However, the chemical bases that underlie these relaxation and excitation effects remain unclear. Since parasympathetic and sympathetic nerve activities are facilitated by oxytocin and glucocorticoid, respectively, we hypothesized that listening to relaxing slow-tempo and exciting fast-tempo music is accompanied by increases in the oxytocin and cortisol levels, respectively. We evaluated the change in the salivary oxytocin and cortisol levels of participants listening to slow-tempo and fast-tempo music sequences. We measured the heart rate (HR) and calculated the heart rate variability (HRV) to evaluate the strength of autonomic nerve activity. After listening to a music sequence, the participants rated their arousal and valence levels. We found that both the salivary oxytocin concentration and the high frequency component of the HRV (HF) increased and the HR decreased when a slow-tempo music sequence was presented. The salivary cortisol level decreased and the low frequency of the HRV (LF) to HF ratio (LF/HF) increased when a fast-tempo music sequence was presented. The ratio of the change in the oxytocin level was correlated with the change in HF, LF/HF and HR, whereas that in the cortisol level did not show any correlation with indices of autonomic nerve activity. There was no correlation between the change in oxytocin level and self-reported emotions, while the change in cortisol level correlated with the arousal level. These findings suggest that listening to slow-tempo and fast-tempo music is accompanied by an increase in the oxytocin level and a decrease in the cortisol level, respectively, and imply that such music listening-related changes in oxytocin and cortisol are involved in physiological relaxation and emotional excitation, respectively.
Collapse
Affiliation(s)
- Yuuki Ooishi
- NTT Communication Science Laboratories, NTT Corporation, Morinosato Wakamiya Atsugi, Kanagawa, Japan
- * E-mail:
| | - Hideo Mukai
- Department of Computer Science, School of Science and Technology, Meiji University, Tama, Kawasaki, Kanagawa, Japan
- Department of Biophysics and Life Sciences, Graduate School of Arts and Sciences, University of Tokyo, Meguro, Tokyo, Japan
| | - Ken Watanabe
- NTT Communication Science Laboratories, NTT Corporation, Morinosato Wakamiya Atsugi, Kanagawa, Japan
- Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, Midori-ku, Yokohama, Kanagawa, Japan
| | - Suguru Kawato
- Department of Biophysics and Life Sciences, Graduate School of Arts and Sciences, University of Tokyo, Meguro, Tokyo, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, NTT Corporation, Morinosato Wakamiya Atsugi, Kanagawa, Japan
- Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, Midori-ku, Yokohama, Kanagawa, Japan
- Core Research for Evolutional Science and Technology, Japan Science and Technology Agency (CREST, JST), Atsugi, Kanagawa, Japan
| |
Collapse
|
24
|
Altmann CF, Ueda R, Bucher B, Furukawa S, Ono K, Kashino M, Mima T, Fukuyama H. Trading of dynamic interaural time and level difference cues and its effect on the auditory motion-onset response measured with electroencephalography. Neuroimage 2017; 159:185-194. [DOI: 10.1016/j.neuroimage.2017.07.055] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2017] [Revised: 06/15/2017] [Accepted: 07/25/2017] [Indexed: 11/29/2022] Open
|
25
|
Altmann CF, Ueda R, Furukawa S, Kashino M, Mima T, Fukuyama H. Auditory Mismatch Negativity in Response to Changes of Counter-Balanced Interaural Time and Level Differences. Front Neurosci 2017; 11:387. [PMID: 28729820 PMCID: PMC5498526 DOI: 10.3389/fnins.2017.00387] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2017] [Accepted: 06/20/2017] [Indexed: 11/13/2022] Open
Abstract
Interaural time differences (ITD) and interaural level differences (ILD) both signal horizontal sound source location. To achieve a unified percept of our acoustic environment, these two cues require integration. In the present study, we tested this integration of ITD and ILD with electroencephalography (EEG) by measuring the mismatch negativity (MMN). The MMN can arise in response to spatial changes and is at least partly generated in auditory cortex. In our study, we aimed at testing for an MMN in response to stimuli with counter-balanced ITD/ILD cues. To this end, we employed a roving oddball paradigm with alternating sound sequences in two types of blocks: (a) lateralized stimuli with congruently combined ITD/ILD cues and (b) midline stimuli created by counter-balanced, incongruently combined ITD/ILD cues. We observed a significant MMN peaking at about 112–128 ms after change onset for the congruent ITD/ILD cues, for both lower (0.5 kHz) and higher carrier frequency (4 kHz). More importantly, we also observed significant MMN peaking at about 129 ms for incongruently combined ITD/ILD cues, but this effect was only detectable in the lower frequency range (0.5 kHz). There were no significant differences of the MMN responses for the two types of cue combinations (congruent/incongruent). These results suggest that—at least in the lower frequency ranges (0.5 kHz)—ITD and ILD are processed independently at the level of the MMN in auditory cortex.
Collapse
Affiliation(s)
- Christian F Altmann
- Human Brain Research Center, Graduate School of Medicine, Kyoto UniversityKyoto, Japan
| | - Ryuhei Ueda
- Department of Psychology, Graduate School of Letters, Kyoto UniversityKyoto, Japan
| | - Shigeto Furukawa
- NTT Communication Science Laboratories, NTT CorporationAtsugi, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, NTT CorporationAtsugi, Japan
| | - Tatsuya Mima
- Graduate School of Core Ethics and Frontier Science, Ritsumeikan UniversityKyoto, Japan
| | - Hidenao Fukuyama
- Human Brain Research Center, Graduate School of Medicine, Kyoto UniversityKyoto, Japan
| |
Collapse
|
26
|
Watanabe K, Ooishi Y, Kashino M. Heart rate responses induced by acoustic tempo and its interaction with basal heart rate. Sci Rep 2017; 7:43856. [PMID: 28266647 PMCID: PMC5339732 DOI: 10.1038/srep43856] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2016] [Accepted: 02/01/2017] [Indexed: 11/13/2022] Open
Abstract
Many studies have revealed the influences of music on the autonomic nervous system (ANS). Since previous studies focused on the effects of acoustic tempo on the ANS, and humans have their own physiological oscillations such as the heart rate (HR), the effects of acoustic tempo might depend on the HR. Here we show the relationship between HR elevation induced by acoustic tempo and individual basal HR. Since high tempo-induced HR elevation requires fast respiration, which is based on sympatho-respiratory coupling, we controlled the participants’ respiration at a faster rate (20 CPM) than usual (15 CPM). We found that sound stimuli with a faster tempo than the individual basal HR increased the HR. However, the HR increased following a gradual increase in the acoustic tempo only when the extent of the gradual increase in tempo was within a specific range (around + 2%/min). The HR did not follow the increase in acoustic tempo when the rate of the increase in the acoustic tempo exceeded 3% per minute. These results suggest that the effect of the sympatho-respiratory coupling underlying the HR elevation caused by a high acoustic tempo depends on the basal HR, and the strength and the temporal dynamics of the tempo.
Collapse
Affiliation(s)
- Ken Watanabe
- Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, 4259 Nagatsuta-cho, Midori-ku, Yokohama, Kanagawa 226-8503, Japan
| | - Yuuki Ooishi
- NTT Communication Science Laboratories, NTT Corporation, 3-1, Morinosato Wakamiya Atsugi, Kanagawa 243-0198, Japan
| | - Makio Kashino
- Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, 4259 Nagatsuta-cho, Midori-ku, Yokohama, Kanagawa 226-8503, Japan.,NTT Communication Science Laboratories, NTT Corporation, 3-1, Morinosato Wakamiya Atsugi, Kanagawa 243-0198, Japan.,Core Research for Evolutional Science and Technology, Japan Science and Technology Agency (CREST, JST), Atsugi, Kanagawa 243-0198, Japan
| |
Collapse
|
27
|
Lin IF, Shirama A, Kato N, Kashino M. The singular nature of auditory and visual scene analysis in autism. Philos Trans R Soc Lond B Biol Sci 2017; 372:20160115. [PMID: 28044025 PMCID: PMC5206282 DOI: 10.1098/rstb.2016.0115] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/27/2016] [Indexed: 12/16/2022] Open
Abstract
Individuals with autism spectrum disorder often have difficulty acquiring relevant auditory and visual information in daily environments, despite not being diagnosed as hearing impaired or having low vision. Resent psychophysical and neurophysiological studies have shown that autistic individuals have highly specific individual differences at various levels of information processing, including feature extraction, automatic grouping and top-down modulation in auditory and visual scene analysis. Comparison of the characteristics of scene analysis between auditory and visual modalities reveals some essential commonalities, which could provide clues about the underlying neural mechanisms. Further progress in this line of research may suggest effective methods for diagnosing and supporting autistic individuals.This article is part of the themed issue 'Auditory and visual scene analysis'.
Collapse
Affiliation(s)
- I-Fan Lin
- NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa 243-0198, Japan
- Taipei City Hospital, Taipei 106, Taiwan
| | - Aya Shirama
- NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa 243-0198, Japan
| | - Nobumasa Kato
- Medical Institute of Developmental Disabilities Research, Showa University Karasuyama Hospital, Tokyo 157-8577, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa 243-0198, Japan
- School of Engineering, Tokyo Institute of Technology, Yokohama, Kanagawa 226-8503, Japan
- CREST, JST, Atsugi, Kanagawa 243-0198, Japan
| |
Collapse
|
28
|
Kitagawa N, Kato M, Kashino M. Auditory-Somatosensory Temporal Sensitivity Improves When the Somatosensory Event Is Caused by Voluntary Body Movement. Front Integr Neurosci 2016; 10:42. [PMID: 28018189 PMCID: PMC5159416 DOI: 10.3389/fnint.2016.00042] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/30/2016] [Accepted: 11/30/2016] [Indexed: 11/27/2022] Open
Abstract
When we actively interact with the environment, it is crucial that we perceive a precise temporal relationship between our own actions and sensory effects to guide our body movements. Thus, we hypothesized that voluntary movements improve perceptual sensitivity to the temporal disparity between auditory and movement-related somatosensory events compared to when they are delivered passively to sensory receptors. In the voluntary condition, participants voluntarily tapped a button, and a noise burst was presented at various onset asynchronies relative to the button press. The participants made either “sound-first” or “touch-first” responses. We found that the performance of temporal order judgment (TOJ) in the voluntary condition (as indexed by the just noticeable difference (JND)) was significantly better (M = 42.5 ms ± 3.8 SEM) than that when their finger was passively stimulated (passive condition: M = 66.8 ms ± 6.3 SEM). We further examined whether the performance improvement with voluntary action can be attributed to the prediction of the timing of the stimulation from sensory cues (sensory-based prediction), kinesthetic cues contained in voluntary action, and/or to the prediction of stimulation timing from the efference copy of the motor command (motor-based prediction). When three noise bursts were presented before the target burst with regular intervals (predictable condition) and when the participant’s finger was moved passively to press the button (involuntary condition), the TOJ performance was not improved from that in the passive condition. These results suggest that the improvement in sensitivity to temporal disparity between somatosensory and auditory events caused by the voluntary action cannot be attributed to sensory-based prediction and kinesthetic cues. Rather, the prediction from the efference copy of the motor command would be crucial for improving the temporal sensitivity.
Collapse
Affiliation(s)
| | - Masaharu Kato
- NTT Communication Science Laboratories, NTT CorporationKanagawa, Japan; Center for Baby Science, Doshisha UniversityKyoto, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, NTT CorporationKanagawa, Japan; School of Engineering, Tokyo Institute of TechnologyKanagawa, Japan
| |
Collapse
|
29
|
Otsuka S, Furukawa S, Yamagishi S, Hirota K, Kashino M. Relation Between Cochlear Mechanics and Performance of Temporal Fine Structure-Based Tasks. J Assoc Res Otolaryngol 2016; 17:541-557. [PMID: 27631508 PMCID: PMC5112215 DOI: 10.1007/s10162-016-0581-9] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2015] [Accepted: 08/09/2016] [Indexed: 12/01/2022] Open
Abstract
This study examined whether the mechanical characteristics of the cochlea could influence individual variation in the ability to use temporal fine structure (TFS) information. Cochlear mechanical functioning was evaluated by swept-tone evoked otoacoustic emissions (OAEs), which are thought to comprise linear reflection by micromechanical impedance perturbations, such as spatial variations in the number or geometry of outer hair cells, on the basilar membrane (BM). Low-rate (2 Hz) frequency modulation detection limens (FMDLs) were measured for carrier frequency of 1000 Hz and interaural phase difference (IPD) thresholds as indices of TFS sensitivity and high-rate (16 Hz) FMDLs and amplitude modulation detection limens (AMDLs) as indices of sensitivity to non-TFS cues. Significant correlations were found among low-rate FMDLs, low-rate AMDLs, and IPD thresholds (R = 0.47-0.59). A principal component analysis was used to show a common factor that could account for 81.1, 74.1, and 62.9 % of the variance in low-rate FMDLs, low-rate AMDLs, and IPD thresholds, respectively. An OAE feature, specifically a characteristic dip around 2-2.5 kHz in OAE spectra, showed a significant correlation with the common factor (R = 0.54). High-rate FMDLs and AMDLs were correlated with each other (R = 0.56) but not with the other measures. The results can be interpreted as indicating that (1) the low-rate AMDLs, as well as the IPD thresholds and low-rate FMDLs, depend on the use of TFS information coded in neural phase locking and (2) the use of TFS information is influenced by a particular aspect of cochlear mechanics, such as mechanical irregularity along the BM.
Collapse
Affiliation(s)
- Sho Otsuka
- Department of Human and Engineered Environmental Studies, Graduate School of Frontier Sciences, The University of Tokyo, Kashiwanoha, Kashiwa, Chiba 277-8563 Japan
- NTT Communication Science Laboratories, NTT Corporation, Morinosato Wakamiya, Atsugi, Kanagawa 243-0198 Japan
| | - Shigeto Furukawa
- NTT Communication Science Laboratories, NTT Corporation, Morinosato Wakamiya, Atsugi, Kanagawa 243-0198 Japan
| | - Shimpei Yamagishi
- Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, Nagatsuta-cho, Midori-ku, Yokohama, Kanagawa 226-8503 Japan
| | - Koich Hirota
- Interfaculty Initiative in Information Studies/Graduate School of Interdisciplinary Information Studies, The University of Tokyo, Kashiwanoha, Kashiwa, Chiba 277-8563 Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, NTT Corporation, Morinosato Wakamiya, Atsugi, Kanagawa 243-0198 Japan
- Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, Nagatsuta-cho, Midori-ku, Yokohama, Kanagawa 226-8503 Japan
| |
Collapse
|
30
|
Abstract
Although superior visual search skills have been repeatedly reported for individuals with autism spectrum disorder, the underlying mechanisms remain controversial. To specify the locus where individuals with autism spectrum disorder excel in visual search, we compared the performance of autism spectrum disorder adults and healthy controls in briefly presented search tasks, where the search display was replaced by a noise mask at a stimulus-mask asynchrony of 160 ms to interfere with a serial search process while bottom-up visual processing remains intact. We found that participants with autism spectrum disorder show faster overall reaction times regardless of the number of stimuli and the presence of a target with higher accuracy than controls in a luminance and shape conjunction search task as well as a hard feature search task where the target feature information was ineffective in prioritizing likely target stimuli. In addition, the analysis of target eccentricity illustrated that the autism spectrum disorder group has better target discriminability regardless of target eccentricity, suggesting that the autism spectrum disorder advantage does not derive from a reduced crowding effect, which is known to be enhanced with increasing retinal eccentricity. The findings suggest that individuals with autism spectrum disorder excel in non-search processes, especially in the simultaneous discrimination of multiple visual stimuli.
Collapse
Affiliation(s)
- Aya Shirama
- 1 Nippon Telegraph and Telephone Corporation, Japan.,2 Showa University, Japan.,3 Japan Society for the Promotion of Science, Japan
| | | | - Makio Kashino
- 1 Nippon Telegraph and Telephone Corporation, Japan.,4 CREST, Japan
| |
Collapse
|
31
|
Petsas T, Harrison J, Kashino M, Furukawa S, Chait M. The effect of distraction on change detection in crowded acoustic scenes. Hear Res 2016; 341:179-189. [PMID: 27598040 PMCID: PMC5090045 DOI: 10.1016/j.heares.2016.08.015] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/14/2016] [Revised: 08/23/2016] [Accepted: 08/31/2016] [Indexed: 11/13/2022]
Abstract
In this series of behavioural experiments we investigated the effect of distraction on the maintenance of acoustic scene information in short-term memory. Stimuli are artificial acoustic ‘scenes’ composed of several (up to twelve) concurrent tone-pip streams (‘sources’). A gap (1000 ms) is inserted partway through the ‘scene’; Changes in the form of an appearance of a new source or disappearance of an existing source, occur after the gap in 50% of the trials. Listeners were instructed to monitor the unfolding ‘soundscapes’ for these events. Distraction was measured by presenting distractor stimuli during the gap. Experiments 1 and 2 used a dual task design where listeners were required to perform a task with varying attentional demands (‘High Demand’ vs. ‘Low Demand’) on brief auditory (Experiment 1a) or visual (Experiment 1b) signals presented during the gap. Experiments 2 and 3 required participants to ignore distractor sounds and focus on the change detection task. Our results demonstrate that the maintenance of scene information in short-term memory is influenced by the availability of attentional and/or processing resources during the gap, and that this dependence appears to be modality specific. We also show that these processes are susceptible to bottom up driven distraction even in situations when the distractors are not novel, but occur on each trial. Change detection performance is systematically linked with the, independently determined, perceptual salience of the distractor sound. The findings also demonstrate that the present task may be a useful objective means for determining relative perceptual salience. Distraction is measured by presenting distractor stimuli during a scene gap. Scene maintenance in memory depends on availability of resources during the gap. This dependence appears to be modality specific. Scene maintenance also prone to bottom up distraction even when distractors not novel. Performance depends on the perceptual salience of the distractor sound.
Collapse
Affiliation(s)
| | | | - Makio Kashino
- Human Information Science Laboratory, NTT Communication Science Laboratories, NTT Corporation, 3-1, Morinosato-Wakamiya, Atsugi-shi, Kanagawa, Japan
| | - Shigeto Furukawa
- Human Information Science Laboratory, NTT Communication Science Laboratories, NTT Corporation, 3-1, Morinosato-Wakamiya, Atsugi-shi, Kanagawa, Japan
| | - Maria Chait
- UCL Ear Institute, 332 Gray's Inn Rd, London, UK.
| |
Collapse
|
32
|
Yamagishi S, Otsuka S, Furukawa S, Kashino M. Subcortical correlates of auditory perceptual organization in humans. Hear Res 2016; 339:104-11. [PMID: 27371867 DOI: 10.1016/j.heares.2016.06.016] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/16/2016] [Revised: 06/22/2016] [Accepted: 06/27/2016] [Indexed: 11/25/2022]
Abstract
To make sense of complex auditory scenes, the auditory system sequentially organizes auditory components into perceptual objects or streams. In the conventional view of this process, the cortex plays a major role in perceptual organization, and subcortical mechanisms merely provide the cortex with acoustical features. Here, we show that the neural activities of the brainstem are linked to perceptual organization, which alternates spontaneously for human listeners without any stimulus change. The stimulus used in the experiment was an unchanging sequence of repeated triplet tones, which can be interpreted as either one or two streams. Listeners were instructed to report the perceptual states whenever they experienced perceptual switching between one and two streams throughout the stimulus presentation. Simultaneously, we recorded event related potentials with scalp electrodes. We measured the frequency-following response (FFR), which is considered to originate from the brainstem. We also assessed thalamo-cortical activity through the middle-latency response (MLR). The results demonstrate that the FFR and MLR varied with the state of auditory stream perception. In addition, we found that the MLR change precedes the FFR change with perceptual switching from a one-stream to a two-stream percept. This suggests that there are top-down influences on brainstem activity from the thalamo-cortical pathway. These findings are consistent with the idea of a distributed, hierarchical neural network for perceptual organization and suggest that the network extends to the brainstem level.
Collapse
Affiliation(s)
- Shimpei Yamagishi
- Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, Yokohama, Kanagawa, 226-8503, Japan.
| | - Sho Otsuka
- NTT Communication Science Laboratories, NTT Corporation, 3-1 Morinosato Wakamiya, Atsugi, Kanagawa, 243-0198, Japan.
| | - Shigeto Furukawa
- NTT Communication Science Laboratories, NTT Corporation, 3-1 Morinosato Wakamiya, Atsugi, Kanagawa, 243-0198, Japan.
| | - Makio Kashino
- Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, Yokohama, Kanagawa, 226-8503, Japan; NTT Communication Science Laboratories, NTT Corporation, 3-1 Morinosato Wakamiya, Atsugi, Kanagawa, 243-0198, Japan.
| |
Collapse
|
33
|
Mitani K, Kashino M. Self-Produced Time Intervals Are Perceived as More Variable and/or Shorter Depending on Temporal Context in Subsecond and Suprasecond Ranges. Front Integr Neurosci 2016; 10:19. [PMID: 27313515 PMCID: PMC4887498 DOI: 10.3389/fnint.2016.00019] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2016] [Accepted: 05/17/2016] [Indexed: 11/24/2022] Open
Abstract
The processing of time intervals is fundamental for sensorimotor and cognitive functions. Perceptual and motor timing are often performed concurrently (e.g., playing a musical instrument). Although previous studies have shown the influence of body movements on time perception, how we perceive self-produced time intervals has remained unclear. Furthermore, it has been suggested that the timing mechanisms are distinct for the sub- and suprasecond ranges. Here, we compared perceptual performances for self-produced and passively presented time intervals in random contexts (i.e., multiple target intervals presented in a session) across the sub- and suprasecond ranges (Experiment 1) and within the sub- (Experiment 2) and suprasecond (Experiment 3) ranges, and in a constant context (i.e., a single target interval presented in a session) in the sub- and suprasecond ranges (Experiment 4). We show that self-produced time intervals were perceived as shorter and more variable across the sub- and suprasecond ranges and within the suprasecond range but not within the subsecond range in a random context. In a constant context, the self-produced time intervals were perceived as more variable in the suprasecond range but not in the subsecond range. The impairing effects indicate that motor timing interferes with perceptual timing. The dependence of impairment on temporal contexts suggests multiple timing mechanisms for the subsecond and suprasecond ranges. In addition, violation of the scalar property (i.e., a constant variability to target interval ratio) was observed between the sub- and suprasecond ranges. The violation was clearer for motor timing than for perceptual timing. This suggests that the multiple timing mechanisms for the sub- and suprasecond ranges overlap more for perception than for motor. Moreover, the central tendency effect (i.e., where shorter base intervals are overestimated and longer base intervals are underestimated) disappeared with motor timing within the subsecond range, suggesting multiple subsecond timing system for perception and motor.
Collapse
Affiliation(s)
- Keita Mitani
- Department of Information Processing, Tokyo Institute of Technology Yokohama, Japan
| | - Makio Kashino
- Department of Information Processing, Tokyo Institute of TechnologyYokohama, Japan; Human Information Science Laboratory, NTT Communication Science Laboratories, Nippon Telegraph and Telephone CorporationAtsugi, Japan
| |
Collapse
|
34
|
Lin IF, Agus TR, Suied C, Pressnitzer D, Yamada T, Komine Y, Kato N, Kashino M. Fast response to human voices in autism. Sci Rep 2016; 6:26336. [PMID: 27193919 PMCID: PMC4872056 DOI: 10.1038/srep26336] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2015] [Accepted: 04/21/2016] [Indexed: 11/11/2022] Open
Abstract
Individuals with autism spectrum disorders (ASD) are reported to allocate less spontaneous attention to voices. Here, we investigated how vocal sounds are processed in ASD adults, when those sounds are attended. Participants were asked to react as fast as possible to target stimuli (either voices or strings) while ignoring distracting stimuli. Response times (RTs) were measured. Results showed that, similar to neurotypical (NT) adults, ASD adults were faster to recognize voices compared to strings. Surprisingly, ASD adults had even shorter RTs for voices than the NT adults, suggesting a faster voice recognition process. To investigate the acoustic underpinnings of this effect, we created auditory chimeras that retained only the temporal or the spectral features of voices. For the NT group, no RT advantage was found for the chimeras compared to strings: both sets of features had to be present to observe an RT advantage. However, for the ASD group, shorter RTs were observed for both chimeras. These observations indicate that the previously observed attentional deficit to voices in ASD individuals could be due to a failure to combine acoustic features, even though such features may be well represented at a sensory level.
Collapse
Affiliation(s)
- I-Fan Lin
- NTT Communication Science Laboratories, 3-1 Morinosato Wakamiya, Atsugi, Kanagawa, 243-0198 Japan
- Department of Human Sciences, Tokyo Metropolitan University, 1-1 Minami-Osawa, Hachioji, Tokyo, 192-0397 Japan
| | - Trevor R. Agus
- School of Creative Arts, Queen’s University Belfast, Belfast, BT7 1NN, United Kingdom
| | - Clara Suied
- Département Action et Cognition en Situation Opérationnelle, Institut de Recherche Biomédicale des Armées, 91223 Brétigny sur Orge, France
| | - Daniel Pressnitzer
- CNRS UMR 8248, Ecole normale supérieure, 29 rue d’Ulm, 75005 Paris, France
| | - Takashi Yamada
- Medical Institute of Developmental Disabilities Research, Showa University, Kitakarasuyama 6-11-11, Setagaya, Tokyo, 157-8577 Japan
- ATR Brain Information Communication Research Laboratory Group, Hikaridai 2-2-2, Sourakugun Seikacho, Kyoto, 619-0237 Japan
| | - Yoko Komine
- Medical Institute of Developmental Disabilities Research, Showa University, Kitakarasuyama 6-11-11, Setagaya, Tokyo, 157-8577 Japan
| | - Nobumasa Kato
- Medical Institute of Developmental Disabilities Research, Showa University, Kitakarasuyama 6-11-11, Setagaya, Tokyo, 157-8577 Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, 3-1 Morinosato Wakamiya, Atsugi, Kanagawa, 243-0198 Japan
- Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, 4259 Nagatsuta, Midori, Yokohama, Kanagawa, 226-8503 Japan
| |
Collapse
|
35
|
Liao HI, Yoneya M, Kidani S, Kashino M, Furukawa S. Human Pupillary Dilation Response to Deviant Auditory Stimuli: Effects of Stimulus Properties and Voluntary Attention. Front Neurosci 2016; 10:43. [PMID: 26924959 PMCID: PMC4756168 DOI: 10.3389/fnins.2016.00043] [Citation(s) in RCA: 49] [Impact Index Per Article: 6.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2015] [Accepted: 02/01/2016] [Indexed: 12/03/2022] Open
Abstract
A unique sound that deviates from a repetitive background sound induces signature neural responses, such as mismatch negativity and novelty P3 response in electro-encephalography studies. Here we show that a deviant auditory stimulus induces a human pupillary dilation response (PDR) that is sensitive to the stimulus properties and irrespective whether attention is directed to the sounds or not. In an auditory oddball sequence, we used white noise and 2000-Hz tones as oddballs against repeated 1000-Hz tones. Participants' pupillary responses were recorded while they listened to the auditory oddball sequence. In Experiment 1, they were not involved in any task. Results show that pupils dilated to the noise oddballs for approximately 4 s, but no such PDR was found for the 2000-Hz tone oddballs. In Experiments 2, two types of visual oddballs were presented synchronously with the auditory oddballs. Participants discriminated the auditory or visual oddballs while trying to ignore stimuli from the other modality. The purpose of this manipulation was to direct attention to or away from the auditory sequence. In Experiment 3, the visual oddballs and the auditory oddballs were always presented asynchronously to prevent residuals of attention on to-be-ignored oddballs due to the concurrence with the attended oddballs. Results show that pupils dilated to both the noise and 2000-Hz tone oddballs in all conditions. Most importantly, PDRs to noise were larger than those to the 2000-Hz tone oddballs regardless of the attention condition in both experiments. The overall results suggest that the stimulus-dependent factor of the PDR appears to be independent of attention.
Collapse
Affiliation(s)
- Hsin-I Liao
- Human Information Science Laboratory, NTT Communication Science Laboratories, NTT Corporation Atsugi, Japan
| | - Makoto Yoneya
- Human Information Science Laboratory, NTT Communication Science Laboratories, NTT CorporationAtsugi, Japan; Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of TechnologyYokohama, Japan
| | - Shunsuke Kidani
- Human Information Science Laboratory, NTT Communication Science Laboratories, NTT Corporation Atsugi, Japan
| | - Makio Kashino
- Human Information Science Laboratory, NTT Communication Science Laboratories, NTT CorporationAtsugi, Japan; Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of TechnologyYokohama, Japan
| | - Shigeto Furukawa
- Human Information Science Laboratory, NTT Communication Science Laboratories, NTT Corporation Atsugi, Japan
| |
Collapse
|
36
|
Masutomi K, Barascud N, Kashino M, McDermott JH, Chait M. Sound segregation via embedded repetition is robust to inattention. J Exp Psychol Hum Percept Perform 2015; 42:386-400. [PMID: 26480248 PMCID: PMC4763252 DOI: 10.1037/xhp0000147] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
The segregation of sound sources from the mixture of sounds that enters the ear is a core capacity of human hearing, but the extent to which this process is dependent on attention remains unclear. This study investigated the effect of attention on the ability to segregate sounds via repetition. We utilized a dual task design in which stimuli to be segregated were presented along with stimuli for a "decoy" task that required continuous monitoring. The task to assess segregation presented a target sound 10 times in a row, each time concurrent with a different distractor sound. McDermott, Wrobleski, and Oxenham (2011) demonstrated that repetition causes the target sound to be segregated from the distractors. Segregation was queried by asking listeners whether a subsequent probe sound was identical to the target. A control task presented similar stimuli but probed discrimination without engaging segregation processes. We present results from 3 different decoy tasks: a visual multiple object tracking task, a rapid serial visual presentation (RSVP) digit encoding task, and a demanding auditory monitoring task. Load was manipulated by using high- and low-demand versions of each decoy task. The data provide converging evidence of a small effect of attention that is nonspecific, in that it affected the segregation and control tasks to a similar extent. In all cases, segregation performance remained high despite the presence of a concurrent, objectively demanding decoy task. The results suggest that repetition-based segregation is robust to inattention.
Collapse
Affiliation(s)
- Keiko Masutomi
- Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology
| | | | - Makio Kashino
- Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology
| | - Josh H McDermott
- Department of Brain and Cognitive Sciences, Massachusetts Institute of Technology
| | | |
Collapse
|
37
|
Abstract
Many studies have revealed the influences of music, and particularly its tempo, on the autonomic nervous system (ANS) and respiration patterns. Since there is the interaction between the ANS and the respiratory system, namely sympatho-respiratory coupling, it is possible that the effect of musical tempo on the ANS is modulated by the respiratory system. Therefore, we investigated the effects of the relationship between musical tempo and respiratory rate on the ANS. Fifty-two healthy people aged 18–35 years participated in this study. Their respiratory rates were controlled by using a silent electronic metronome and they listened to simple drum sounds with a constant tempo. We varied the respiratory rate—acoustic tempo combination. The respiratory rate was controlled at 15 or 20 cycles per minute (CPM) and the acoustic tempo was 60 or 80 beats per minute (BPM) or the environment was silent. Electrocardiograms and an elastic chest band were used to measure the heart rate and respiratory rate, respectively. The mean heart rate and heart rate variability (HRV) were regarded as indices of ANS activity. We observed a significant increase in the mean heart rate and the low (0.04–0.15 Hz) to high (0.15–0.40 Hz) frequency ratio of HRV, only when the respiratory rate was controlled at 20 CPM and the acoustic tempo was 80 BPM. We suggest that the effect of acoustic tempo on the sympathetic tone is modulated by the respiratory system.
Collapse
Affiliation(s)
- Ken Watanabe
- Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, Yokohama, Japan
- * E-mail:
| | - Yuuki Ooishi
- Human Information Science Laboratory, NTT Communication Science Laboratories, NTT Corporation, Atsugi, Japan
| | - Makio Kashino
- Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, Yokohama, Japan
- Human Information Science Laboratory, NTT Communication Science Laboratories, NTT Corporation, Atsugi, Japan
- CREST, Japan Science and Technology Agency, Atsugi, Japan
| |
Collapse
|
38
|
Abstract
Voices can convey information about a speaker. When forming an abstract representation of a speaker, it is important to extract relevant features from acoustic signals that are invariant to the modulation of these signals. This study investigated the way in which individuals with autism spectrum disorder (ASD) recognize and memorize vocal identity. The ASD group and control group performed similarly in a task when asked to choose the name of the newly-learned speaker based on his or her voice, and the ASD group outperformed the control group in a subsequent familiarity test when asked to discriminate the previously trained voices and untrained voices. These findings suggest that individuals with ASD recognized and memorized voices as well as the neurotypical individuals did, but they categorized voices in a different way: individuals with ASD categorized voices quantitatively based on the exact acoustic features, while neurotypical individuals categorized voices qualitatively based on the acoustic patterns correlated to the speakers' physical and mental properties.
Collapse
Affiliation(s)
- I-Fan Lin
- NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa, Japan
- * E-mail: (IL); (MK)
| | - Takashi Yamada
- Medical Institute of Developmental Disabilities Research, Showa University, Tokyo, Japan
- ATR Brain Information Communication Research Laboratory Group, Kyoto, Japan
| | - Yoko Komine
- Medical Institute of Developmental Disabilities Research, Showa University, Tokyo, Japan
| | - Nobumasa Kato
- Medical Institute of Developmental Disabilities Research, Showa University, Tokyo, Japan
| | - Masaharu Kato
- NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa, Japan
- Center for Baby Science, Doshisha University, Kyoto, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa, Japan
- Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, Yokohama, Kanagawa, Japan
- CREST, JST, Atsugi, Kanagawa, Japan
- * E-mail: (IL); (MK)
| |
Collapse
|
39
|
Abstract
Working memory is linked to the functions of the frontal areas, in which neural activity is mediated by dopaminergic and serotonergic tones. However, there is no consensus regarding how the dopaminergic and serotonergic systems influence working memory subprocesses. The present study used an imaging genetics approach to examine the interaction between neurochemical functions and working memory performance. We focused on functional polymorphisms of the catechol-O-methyltransferase (COMT) Val158Met and serotonin 2A receptor (HTR2A) -1438G/A genes, and devised a delayed recognition task to isolate the encoding, retention, and retrieval processes for visual information. The COMT genotypes affected recognition accuracy, whereas the HTR2A genotypes were associated with recognition response times. Activations specifically related to working memory were found in the right frontal and parietal areas, such as the middle frontal gyrus (MFG), inferior frontal gyrus (IFG), anterior cingulate cortex (ACC), and inferior parietal lobule (IPL). MFG and ACC/IPL activations were sensitive to differences between the COMT genotypes and between the HTR2A genotypes, respectively. Structural equation modeling demonstrated that stronger connectivity in the ACC-MFG and ACC-IFG networks is related to better task performance. The behavioral and fMRI results suggest that the dopaminergic and serotonergic systems play different roles in the working memory subprocesses and modulate closer cooperation between lateral and medial frontal activations.
Collapse
Affiliation(s)
- Hirohito M. Kondo
- Human Information Science Laboratory, NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa 243–0198, Japan
- Department of Child Development, United Graduate School of Child Development, Osaka University, Suita, Osaka 565–0871, Japan
- * E-mail:
| | - Michio Nomura
- Division of Cognitive Psychology in Education, Graduate School of Education, Kyoto University, Kyoto 606–8501, Japan
| | - Makio Kashino
- Human Information Science Laboratory, NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa 243–0198, Japan
- Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, Yokohama, Kanagawa 226–8503, Japan
| |
Collapse
|
40
|
Liao HI, Shimojo S, Kashino M. Pupil constriction during visual preference decision. J Vis 2014. [DOI: 10.1167/14.10.1285] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022] Open
|
41
|
Kondo HM, Toshima I, Pressnitzer D, Kashino M. Probing the time course of head-motion cues integration during auditory scene analysis. Front Neurosci 2014; 8:170. [PMID: 25009456 PMCID: PMC4067593 DOI: 10.3389/fnins.2014.00170] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2014] [Accepted: 06/04/2014] [Indexed: 11/13/2022] Open
Abstract
The perceptual organization of auditory scenes is a hard but important problem to solve for human listeners. It is thus likely that cues from several modalities are pooled for auditory scene analysis, including sensory-motor cues related to the active exploration of the scene. We previously reported a strong effect of head motion on auditory streaming. Streaming refers to an experimental paradigm where listeners hear sequences of pure tones, and rate their perception of one or more subjective sources called streams. To disentangle the effects of head motion (changes in acoustic cues at the ear, subjective location cues, and motor cues), we used a robotic telepresence system, Telehead. We found that head motion induced perceptual reorganization even when the acoustic scene had not changed. Here we reanalyzed the same data to probe the time course of sensory-motor integration. We show that motor cues had a different time course compared to acoustic or subjective location cues: motor cues impacted perceptual organization earlier and for a shorter time than other cues, with successive positive and negative contributions to streaming. An additional experiment controlled for the effects of volitional anticipatory components, and found that arm or leg movements did not have any impact on scene analysis. These data provide a first investigation of the time course of the complex integration of sensory-motor cues in an auditory scene analysis task, and they suggest a loose temporal coupling between the different mechanisms involved.
Collapse
Affiliation(s)
- Hirohito M Kondo
- NTT Communication Science Laboratories, NTT Corporation Atsugi, Japan ; Department of Child Development, United Graduate School of Child Development, Osaka University, Kanazawa University, Hamamatsu University School of Medicine, Chiba University, and University of Fukui Suita, Japan
| | - Iwaki Toshima
- NTT Communication Science Laboratories, NTT Corporation Atsugi, Japan
| | - Daniel Pressnitzer
- Laboratoire des Systèmes Perceptifs, CNRS UMR 8248 Paris, France ; Département d'études cognitives, École normale supérieure Paris, France
| | - Makio Kashino
- NTT Communication Science Laboratories, NTT Corporation Atsugi, Japan ; Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology Yokohama, Japan
| |
Collapse
|
42
|
Altmann CF, Terada S, Kashino M, Goto K, Mima T, Fukuyama H, Furukawa S. Independent or integrated processing of interaural time and level differences in human auditory cortex? Hear Res 2014; 312:121-7. [PMID: 24709274 DOI: 10.1016/j.heares.2014.03.009] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 12/03/2013] [Revised: 02/24/2014] [Accepted: 03/24/2014] [Indexed: 11/28/2022]
Abstract
Sound localization in the horizontal plane is mainly determined by interaural time differences (ITD) and interaural level differences (ILD). Both cues result in an estimate of sound source location and in many real-life situations these two cues are roughly congruent. When stimulating listeners with headphones it is possible to counterbalance the two cues, so called ITD/ILD trading. This phenomenon speaks for integrated ITD/ILD processing at the behavioral level. However, it is unclear at what stages of the auditory processing stream ITD and ILD cues are integrated to provide a unified percept of sound lateralization. Therefore, we set out to test with human electroencephalography for integrated versus independent ITD/ILD processing at the level of preattentive cortical processing by measuring the mismatch negativity (MMN) to changes in sound lateralization. We presented a series of diotic standards (perceived at a midline position) that were interrupted by deviants that entailed either a change in a) ITD only, b) ILD only, c) congruent ITD and ILD, or d) counterbalanced ITD/ILD (ITD/ILD trading). The sound stimuli were either i) pure tones with a frequency of 500 Hz, or ii) amplitude modulated tones with a carrier frequency of 4000 Hz and a modulation frequency of 125 Hz. We observed significant MMN for the ITD/ILD traded deviants in case of the 500 Hz pure tones, and for the 4000 Hz amplitude-modulated tone. This speaks for independent processing of ITD and ILD at the level of the MMN within auditory cortex. However, the combined ITD/ILD cues elicited smaller MMN than the sum of the MMN induced in response to ITD and ILD cues presented in isolation for 500 Hz, but not 4000 Hz, suggesting independent processing for the higher frequency only. Thus, the two markers for independent processing - additivity and cue-conflict - resulted in contradicting conclusions with a dissociation between the lower (500 Hz) and higher frequency (4000 Hz) bands.
Collapse
Affiliation(s)
- Christian F Altmann
- Human Brain Research Center, Graduate School of Medicine, Kyoto University, Kyoto 606-8507, Japan; Career-Path Promotion Unit for Young Life Scientists, Kyoto University, Kyoto 606-8501, Japan.
| | - Satoshi Terada
- Career-Path Promotion Unit for Young Life Scientists, Kyoto University, Kyoto 606-8501, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, NTT Corporation, 3-1 Morinosato Wakamiya, Atsugi, Kanagawa 243-0198, Japan
| | - Kazuhiro Goto
- Human Brain Research Center, Graduate School of Medicine, Kyoto University, Kyoto 606-8507, Japan; Career-Path Promotion Unit for Young Life Scientists, Kyoto University, Kyoto 606-8501, Japan; Department of Psychology, Faculty of Human Society, Sagami Women's University, Sagamihara 252-0383, Japan
| | - Tatsuya Mima
- Human Brain Research Center, Graduate School of Medicine, Kyoto University, Kyoto 606-8507, Japan
| | - Hidenao Fukuyama
- Human Brain Research Center, Graduate School of Medicine, Kyoto University, Kyoto 606-8507, Japan
| | - Shigeto Furukawa
- NTT Communication Science Laboratories, NTT Corporation, 3-1 Morinosato Wakamiya, Atsugi, Kanagawa 243-0198, Japan
| |
Collapse
|
43
|
Otsuka S, Furukawa S, Yamagishi S, Hirota K, Kashino M. Interindividual variation of sensitivity to frequency modulation: its relation with click-evoked and distortion product otoacoustic emissions. J Assoc Res Otolaryngol 2014; 15:175-86. [PMID: 24504749 PMCID: PMC3946142 DOI: 10.1007/s10162-013-0439-3] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/19/2013] [Accepted: 12/23/2013] [Indexed: 10/25/2022] Open
Abstract
The frequency modulation detection limen (FMDL) with a low modulation rate has been used as a measure of the listener's sensitivity to the temporal fine structure of a stimulus, which is represented by the pattern of neural phase locking at the auditory periphery. An alternative to the phase locking cue, the excitation pattern cue, has been suggested to contribute to frequency modulation (FM) detection. If the excitation pattern cue has a significant contribution to low-rate FM detection, the functionality of cochlear mechanics underlying the excitation pattern should be reflected in low-rate FMDLs. This study explored the relationship between cochlear mechanics and low-rate FMDLs by evaluating physiological measures of cochlear functions, namely distortion product otoacoustic emissions (DPOAEs) and click-evoked otoacoustic emissions (CEOAEs). DPOAEs and CEOAEs reflect nonlinear cochlear gain. CEOAEs have been considered also to reflect the degree of irregularity, such as spatial variations in number or geometry of outer hair cells, on the basilar membrane. The irregularity profile could affect the reliability of the phase locking cue, thereby influencing the FMDLs. The features extracted from DPOAEs and CEOAEs, when combined, could account for more than 30 % of the inter-listener variation of low-rate FMDLs. This implies that both cochlear gain and irregularity on the basilar membrane have some influence on sensitivity to low-rate FM: the loss of cochlear gain or broader tuning might influence the excitation pattern cue, and the irregularity on the basilar membrane might disturb the ability to use the phase locking cue.
Collapse
Affiliation(s)
- Sho Otsuka
- Department of Human and Engineered Environmental Studies, Graduate School of Frontier Sciences, The University of Tokyo, 5-1-5 Kashiwanoha, Kashiwa, Chiba, 277-8563, Japan,
| | | | | | | | | |
Collapse
|
44
|
Abstract
The subliminal mere exposure effect (SMEE) is the phenomenon wherein people tend to prefer patterns they have repeatedly observed without consciously identifying them. One popular explanation for the SMEE is that perceptual fluency within exposed patterns is misattributed to a feeling of preference for those patterns. Assuming that perceptual fluency is negatively correlated with the amount of mental effort needed to analyze perceptual aspects of incoming stimuli, pupil diameter should associate with SMEE strength since the former is known to reflect mental effort. To examine this hypothesis, we measured participants' pupil diameter during exposure to subthreshold stimuli. Following exposure, a preference test was administered. Average pupil diameter throughout exposure was smaller when the SMEE was induced than when the SMEE was not induced. This supports the hypothesis that increasing perceptual fluency during mere exposure modulates autonomic nervous responses, such as pupil diameter, and eventually leads to preference.
Collapse
Affiliation(s)
- Sanae Yoshimoto
- Department of Psychology, Japan Women’s University, Kawasaki, Kanagawa, Japan
- NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa, Japan
- CREST, Japan Science and Technology Agency, Atsugi, Kanagawa, Japan
- * E-mail:
| | - Hisato Imai
- Department of Psychology, Gakushuin University, Toshima-ku, Tokyo, Japan
| | - Makio Kashino
- NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa, Japan
- CREST, Japan Science and Technology Agency, Atsugi, Kanagawa, Japan
| | - Tatsuto Takeuchi
- Department of Psychology, Japan Women’s University, Kawasaki, Kanagawa, Japan
- NTT Communication Science Laboratories, NTT Corporation, Atsugi, Kanagawa, Japan
- CREST, Japan Science and Technology Agency, Atsugi, Kanagawa, Japan
| |
Collapse
|
45
|
Lin IF, Kashino M, Ohta H, Yamada T, Tani M, Watanabe H, Kanai C, Ohno T, Takayama Y, Iwanami A, Kato N. The effect of intranasal oxytocin versus placebo treatment on the autonomic responses to human sounds in autism: a single-blind, randomized, placebo-controlled, crossover design study. Mol Autism 2014; 5:20. [PMID: 24576333 PMCID: PMC4015306 DOI: 10.1186/2040-2392-5-20] [Citation(s) in RCA: 29] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2013] [Accepted: 02/04/2014] [Indexed: 12/21/2022] Open
Abstract
BACKGROUND Many individuals with autism spectrum disorders (ASD) have difficulty with verbal communication, which might be due to a lack of spontaneous orientation toward social auditory stimuli. Previous studies have shown that a single dose of oxytocin improves speech comprehension in autism. The primary aim of this study was to investigate whether the orientation behaviors toward human sounds are different for neurotypical (NT) adults and adults with ASD and whether oxytocin has an effect on their orientation behaviors toward human sounds. METHODS This was a randomized, placebo-controlled, within-subject, crossover design study of intranasal oxytocin versus placebo in 13 NT adults and 16 adults with ASD. Subjects were randomized to 24 IU intranasal oxytocin or placebo on different days, and they were blind to the treatment. The participants then listened passively to human and non-human affective sounds while their skin conductance responses (SCRs) and the changes in peripheral blood vessel constriction were monitored as an indicator of spontaneous orientation. The monitored data were analyzed by a mixed-design ANOVA. RESULTS Oxytocin enhanced the difference between the SCRs to human and non-human sounds in both the NT and ASD groups (F(1,56) = 6.046, p = 0.017). Further correlation coefficient analysis showed significant correlations between this SCR difference and the scores in the autism spectrum quotient 'attention to detail' and 'social skill' subscales and interpersonal reactivity index and social functioning scale in the ASD group. Oxytocin was well tolerated, and no serious adverse effects were reported. CONCLUSIONS The difference in SCRs implies that oxytocin nasal spray may enhance orientation behaviors toward human sounds in the presence of other environmental sounds in both ASD and NT adults. TRIAL REGISTRATION UMIN-CTR Clinical Trial, Unique trial number: UMIN000005809.
Collapse
Affiliation(s)
- I-Fan Lin
- NTT Communication Science Laboratories, NTT Corporation, 3-1, Morinosato Wakamiya, Atsugi, Kanagawa 243-0198, Japan.
| | | | | | | | | | | | | | | | | | | | | |
Collapse
|
46
|
Masutomi K, Kashino M. Frequency-change aftereffect produced by adaptation to real and illusory unidirectional frequency sweeps. J Acoust Soc Am 2013; 134:EL14-EL18. [PMID: 23862900 DOI: 10.1121/1.4807304] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
It was examined whether illusory and real continuities induce the frequency-change aftereffect, in which repeated exposure to a frequency sweep results in a shift in the perceived frequency change direction of a subsequent test sound. The magnitude of the aftereffect for different types of adaptors ("real sweep," "illusory sweep," and "sweep with gap") was compared. Listeners judged the direction of a frequency change of the test sound and showed a significant aftereffect only for the "real sweep" adaptors. The results suggest that the illusory sweeps are processed after the stage of frequency-change detection.
Collapse
Affiliation(s)
- Keiko Masutomi
- Department of Information Processing, Interdisciplinary Graduate School of Science and Engineering, Tokyo Institute of Technology, 4259, Yokohama, Kanagawa 226-8503 Japan.
| | | |
Collapse
|
47
|
Furukawa S, Washizawa S, Ochi A, Kashino M. How independent are the pitch and interaural-time-difference mechanisms that rely on temporal fine structure information? Adv Exp Med Biol 2013; 787:91-9. [PMID: 23716213 DOI: 10.1007/978-1-4614-1590-9_11] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Subscribe] [Scholar Register] [Indexed: 11/30/2022]
Abstract
The temporal fine structure (TFS) of acoustical signals, represented as the phase-locking pattern of the auditory nerve, is the major information for listeners performing a variety of auditory tasks, e.g., judging pitch and detecting interaural time differences (ITDs). Two experiments tested the hypothesis that processes for TFS-based pitch and ITD involve a common mechanism that processes TFS information and the efficiency of the common mechanism determines the performance of the two tasks. The first experiment measured the thresholds for detecting TFS-based pitch shifts (Moore and Moore, J Acoust Soc Am 113:977-985, 2003) and for detecting ITD for a group of normal-hearing listeners. The detection thresholds for level increments and for interaural level differences were also measured. The stimulus was a harmonic complex (F0 = 100 Hz) that was spectrally shaped for the frequency region around the 11th harmonic. We expected a positive correlation between the pitch and ITD thresholds, based on the hypothesis that a common TFS mechanism plays a determinant role. We failed to find evidence for a positive correlation, hence no support for the above hypothesis. The second experiment examined whether perceptual learning with respect to detecting TFS-based pitch shifts via training would transfer to performance in other untrained tasks. The stimuli and tasks were the same as those used in the first experiment. Generally, training in the pitch task improved performance in the (trained) pitch task, but degraded the performance in the (untrained) ITD task, which was unexpected on the basis of the hypothesis. No training effect was observed in the other untrained tasks. The results imply that the pitch and ITD processes compete with each other for limited neural resources.
Collapse
Affiliation(s)
- Shigeto Furukawa
- NTT Communication Science Laboratories, NTT Corporation, Kanagawa, Japan.
| | | | | | | |
Collapse
|
48
|
Koizumi A, Kitagawa N, Kondo HM, Kitamura MS, Sato T, Kashino M. Serotonin transporter gene-linked polymorphism affects detection of facial expressions. PLoS One 2013; 8:e59074. [PMID: 23516600 PMCID: PMC3597599 DOI: 10.1371/journal.pone.0059074] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/22/2012] [Accepted: 02/11/2013] [Indexed: 12/16/2022] Open
Abstract
Previous studies have demonstrated that the serotonin transporter gene-linked polymorphic region (5-HTTLPR) affects the recognition of facial expressions and attention to them. However, the relationship between 5-HTTLPR and the perceptual detection of others' facial expressions, the process which takes place prior to emotional labeling (i.e., recognition), is not clear. To examine whether the perceptual detection of emotional facial expressions is influenced by the allelic variation (short/long) of 5-HTTLPR, happy and sad facial expressions were presented at weak and mid intensities (25% and 50%). Ninety-eight participants, genotyped for 5-HTTLPR, judged whether emotion in images of faces was present. Participants with short alleles showed higher sensitivity (d′) to happy than to sad expressions, while participants with long allele(s) showed no such positivity advantage. This effect of 5-HTTLPR was found at different facial expression intensities among males and females. The results suggest that at the perceptual stage, a short allele enhances the processing of positive facial expressions rather than that of negative facial expressions.
Collapse
Affiliation(s)
- Ai Koizumi
- NTT Communication Science Laboratories, NTT Corporation, Kanagawa, Japan.
| | | | | | | | | | | |
Collapse
|
49
|
Abstract
Background The auditory continuity illusion or the perceptual restoration of a target sound briefly interrupted by an extraneous sound has been shown to depend on masking. However, little is known about factors other than masking. Methodology/Principal Findings We examined whether a sequence of flanking transient sounds affects the apparent continuity of a target tone alternated with a bandpass noise at regular intervals. The flanking sounds significantly increased the limit of perceiving apparent continuity in terms of the maximum target level at a fixed noise level, irrespective of the frequency separation between the target and flanking sounds: the flanking sounds enhanced the continuity illusion. This effect was dependent on the temporal relationship between the flanking sounds and noise bursts. Conclusions/Significance The spectrotemporal characteristics of the enhancement effect suggest that a mechanism to compensate for exogenous attentional distraction may contribute to the continuity illusion.
Collapse
Affiliation(s)
- Maori Kobayashi
- Department of Science and Technology, Meiji University, Kawasaki, Kanagawa, Japan.
| | | |
Collapse
|
50
|
Cervantes Constantino F, Pinggera L, Paranamana S, Kashino M, Chait M. Detection of appearing and disappearing objects in complex acoustic scenes. PLoS One 2012; 7:e46167. [PMID: 23029426 PMCID: PMC3459829 DOI: 10.1371/journal.pone.0046167] [Citation(s) in RCA: 35] [Impact Index Per Article: 2.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2011] [Accepted: 08/30/2012] [Indexed: 11/19/2022] Open
Abstract
The ability to detect sudden changes in the environment is critical for survival. Hearing is hypothesized to play a major role in this process by serving as an "early warning device," rapidly directing attention to new events. Here, we investigate listeners' sensitivity to changes in complex acoustic scenes-what makes certain events "pop-out" and grab attention while others remain unnoticed? We use artificial "scenes" populated by multiple pure-tone components, each with a unique frequency and amplitude modulation rate. Importantly, these scenes lack semantic attributes, which may have confounded previous studies, thus allowing us to probe low-level processes involved in auditory change perception. Our results reveal a striking difference between "appear" and "disappear" events. Listeners are remarkably tuned to object appearance: change detection and identification performance are at ceiling; response times are short, with little effect of scene-size, suggesting a pop-out process. In contrast, listeners have difficulty detecting disappearing objects, even in small scenes: performance rapidly deteriorates with growing scene-size; response times are slow, and even when change is detected, the changed component is rarely successfully identified. We also measured change detection performance when a noise or silent gap was inserted at the time of change or when the scene was interrupted by a distractor that occurred at the time of change but did not mask any scene elements. Gaps adversely affected the processing of item appearance but not disappearance. However, distractors reduced both appearance and disappearance detection. Together, our results suggest a role for neural adaptation and sensitivity to transients in the process of auditory change detection, similar to what has been demonstrated for visual change detection. Importantly, listeners consistently performed better for item addition (relative to deletion) across all scene interruptions used, suggesting a robust perceptual representation of item appearance.
Collapse
Affiliation(s)
| | - Leyla Pinggera
- Ear Institute, University College London, London, United Kingdom
| | | | - Makio Kashino
- NTT Communication Science Laboratories, NTT Corporation, Atsugi, Japan
| | - Maria Chait
- Ear Institute, University College London, London, United Kingdom
- * E-mail:
| |
Collapse
|