Leadership dynamics in musical groups: Quantifying effects of musical structure on directionality of influence in concert performance videos

Music ensemble performance provides an ecologically valid context for investigating leadership dynamics in small group interactions. Musical texture, specifically the relative salience of simultaneously sounding ensemble parts, is a feature that can potentially alter leadership dynamics by introducing hierarchical relationships between individual parts. The present study extended previous work on quantifying interpersonal coupling in musical ensembles by examining the relationship between musical texture and leader-follower relations, operationalised as directionality of influence between co-performers' body motion in concert video recordings. It was hypothesised that the directionality of influence, indexed by Granger Causality, would be greater for 'homophonic' textures with a clear distinction between melody and accompaniment parts than for 'polyphonic' textures with less distinction between melody and accompaniment. This hypothesis was tested by using pose estimation algorithms to track instrumentalists' body movements in a string quartet and a clarinet quintet, and then applying Granger Causality analysis to their head motion to estimate directional influence between instrumentalist pairs for sections of the pieces that varied in texture. It was found that Granger Causality values were generally higher (indicating greater directionality of influence) for homophonic than polyphonic textures. Furthermore, considering melody and accompaniment instrument roles revealed more evidence for the melody instrument influencing accompanying instruments than vice versa, plus a high degree of directionality among accompanying instruments, in homophonic textures. These observed patterns of directional information flow in co-performer body motion are consistent with changing leader-follower relations depending on hierarchical relations between ensemble parts in terms of the relative salience of melodic material in the musical texture. The finding that automatic pose estimation can detect modulations of leadership dynamics in standard video recordings under naturalistic performance conditions has implications for investigating interpersonal coordination in large-scale music video datasets representing different cultural traditions, and for exploring nonverbal communication in group activities more generally.

Resilience improvement through a multicomponent physical and cognitive intervention for older people: the DanzArTe emotional well-being technology project

BACKGROUND

Resilience is a crucial component of successful aging. However, which interventions might increase resilience in older adults is yet unclear.

AIMS

This study aims to assess the feasibility and the physical and psychological effects of a technology-based multicomponent dance movement intervention that includes physical, cognitive, and sensory activation in older people living in community-dwelling and nursing home.

METHODS

DanzArTe program consists of four sessions on a weekly basis, using a technological platform that integrates visual and auditory contents in real time. 122 participants (mean age = 76.3 ± 8.8 years, 91 females = 74.6%) from seven nursing homes and community-dwelling subjects were assessed, before and after the intervention, with the Resilience Scale-14 items (RES-14), the Multidimensional Prognostic Index (MPI), the Psychological General Well-Being Index (PGWBI-S), and the Client Satisfaction Questionnaire-8 (CSQ-8). Mann-Whitney and Wilcoxon signed-ranks tests were used for statistical analyses.

RESULTS

At baseline significant differences in MPI and RES-14 between community-dwelling and nursing home residents were observed (p < 0.001 for both analyses). After the intervention, resilience significantly increased in total sample (RES-14 mean T1 = 74.6 Vs. T2 = 75.7) and in the nursing home residents (RES-14 mean T1 = 68.1 Vs. T2 = 71.8). All participants showed high overall satisfaction for DanzArTe program (CSQ-8 mean = 23.9 ± 4.4). No differences in MPI and PGWBI-S were observed.

DISCUSSION

DanzArTe was a feasible intervention and high appreciated by all older adults. Nursing home residents revealed improvements in resilience after DanzArTe program.

CONCLUSION

The DanzArTe technology-based multi-component intervention may improve resilience in older people living in nursing homes.

The PRO-HOME Project. A multicomponent intervention for the protected discharge from the hospital of multimorbid and polytreated older individuals by using innovative technologies: A pilot study

BACKGROUD

Discharge planning from the hospital of frail older patients is an important step to avoid inappropriate long-stay hospitalizations and to prevent the risks related to the prolonged hospitalization. In this frame, we developed an experimental trial-'PRO-HOME', a multicomponent programme of interventions for multimorbid and polytreated hospitalized older patients.

AIM

The main aim of the study was to develop a protected discharge facility using a mini apartment equipped with advanced architectural and technological components to reduce the length of hospital stay of older participants (aged 65+ years old) admitted to the hospital for an acute event, deemed stable and dischargeable.

MATERIALS AND METHODS

This is a pilot randomized controlled study, comparing 30 hospitalized participants included in a multidimensional, transitional care programme based on information and communication technologies to 30 patients in standard usual care until hospital discharge.

RESULTS

We presented the study design of the PRO-HOME programme, including architectural and technological components, the enrolment procedures, the components of the intervention that is physical activity, cognitive training and life-style education and the evaluation method of the intervention based on the Comprehensive Geriatric Assessment to explore the changes in the individual domains that are target of the multicomponent intervention.

CONCLUSIONS

The final results will suggest whether the PRO-HOME programme represents a useful and feasible intervention to reduce the length of hospital stay of multimorbid and polytreated hospitalized older patients and improve their physical and cognitive performances and overall quality of life.

PATIENT OR PUBLIC CONTRIBUTION

Due to the characteristics of the population of interest of the PRO-HOME study, we involved in the study design and programme of the activities the participants enrolled in a previous smart home-based project named MoDiPro carried-out during a 3-year period. The elderly participants from the local population involved were asked, by means of focus groups, for feedback on their experience in MoDiPro, and their suggestions were integrated into the design phase of the current PRO-HOME project. The focus groups included open group interviews with a qualitative collection of the patients' feedback so that the participants could interact with each other.

Interpersonal sensorimotor communication shapes intrapersonal coordination in a musical ensemble

Social behaviors rely on the coordination of multiple effectors within one's own body as well as between the interacting bodies. However, little is known about how coupling at the interpersonal level impacts coordination among body parts at the intrapersonal level, especially in ecological, complex, situations. Here, we perturbed interpersonal sensorimotor communication in violin players of an orchestra and investigated how this impacted musicians' intrapersonal movements coordination. More precisely, first section violinists were asked to turn their back to the conductor and to face the second section of violinists, who still faced the conductor. Motion capture of head and bow kinematics showed that altering the usual interpersonal coupling scheme increased intrapersonal coordination. Our perturbation also induced smaller yet more complex head movements, which spanned multiple, faster timescales that closely matched the metrical levels of the musical score. Importantly, perturbation differentially increased intrapersonal coordination across these timescales. We interpret this behavioral shift as a sensorimotor strategy that exploits periodical movements to effectively tune sensory processing in time and allows coping with the disruption in the interpersonal coupling scheme. As such, head movements, which are usually deemed to fulfill communicative functions, may possibly be adapted to help regulate own performance in time.

A functional magnetic resonance imaging examination of audiovisual observation of a point-light string quartet using intersubject correlation and physical feature analysis

We use functional Magnetic Resonance Imaging (fMRI) to explore synchronized neural responses between observers of audiovisual presentation of a string quartet performance during free viewing. Audio presentation was accompanied by visual presentation of the string quartet as stick figures observed from a static viewpoint. Brain data from 18 musical novices were obtained during audiovisual presentation of a 116 s performance of the allegro of String Quartet, No. 14 in D minor by Schubert played by the 'Quartetto di Cremona.' These data were analyzed using intersubject correlation (ISC). Results showed extensive ISC in auditory and visual areas as well as parietal cortex, frontal cortex and subcortical areas including the medial geniculate and basal ganglia (putamen). These results from a single fixed viewpoint of multiple musicians are greater than previous reports of ISC from unstructured group activity but are broadly consistent with related research that used ISC to explore listening to music or watching solo dance. A feature analysis examining the relationship between brain activity and physical features of the auditory and visual signals yielded findings of a large proportion of activity related to auditory and visual processing, particularly in the superior temporal gyrus (STG) as well as midbrain areas. Motor areas were also involved, potentially as a result of watching motion from the stick figure display of musicians in the string quartet. These results reveal involvement of areas such as the putamen in processing complex musical performance and highlight the potential of using brief naturalistic stimuli to localize distinct brain areas and elucidate potential mechanisms underlying multisensory integration.

Bridging the gap between emotion and joint action

Our daily human life is filled with a myriad of joint action moments, be it children playing, adults working together (i.e., team sports), or strangers navigating through a crowd. Joint action brings individuals (and embodiment of their emotions) together, in space and in time. Yet little is known about how individual emotions propagate through embodied presence in a group, and how joint action changes individual emotion. In fact, the multi-agent component is largely missing from neuroscience-based approaches to emotion, and reversely joint action research has not found a way yet to include emotion as one of the key parameters to model socio-motor interaction. In this review, we first identify the gap and then stockpile evidence showing strong entanglement between emotion and acting together from various branches of sciences. We propose an integrative approach to bridge the gap, highlight five research avenues to do so in behavioral neuroscience and digital sciences, and address some of the key challenges in the area faced by modern societies.

Analysis of Movement Quality in Full-Body Physical Activities

Full-body human movement is characterized by fine-grain expressive qualities that humans are easily capable of exhibiting and recognizing in others’ movement. In sports (e.g., martial arts) and performing arts (e.g., dance), the same sequence of movements can be performed in a wide range of ways characterized by different qualities, often in terms of subtle (spatial and temporal) perturbations of the movement. Even a non-expert observer can distinguish between a top-level and average performance by a dancer or martial artist. The difference is not in the performed movements--the same in both cases--but in the “quality” of their performance.

In this article, we present a computational framework aimed at an automated approximate measure of movement quality in full-body physical activities. Starting from motion capture data, the framework computes low-level (e.g., a limb velocity) and high-level (e.g., synchronization between different limbs) movement features. Then, this vector of features is integrated to compute a value aimed at providing a quantitative assessment of movement quality approximating the evaluation that an external expert observer would give of the same sequence of movements.

Next, a system representing a concrete implementation of the framework is proposed. Karate is adopted as a testbed. We selected two different katas (i.e., detailed choreographies of movements in karate) characterized by different overall attitudes and expressions (aggressiveness, meditation), and we asked seven athletes, having various levels of experience and age, to perform them. Motion capture data were collected from the performances and were analyzed with the system. The results of the automated analysis were compared with the scores given by 14 karate experts who rated the same performances. Results show that the movement-quality scores computed by the system and the ratings given by the human observers are highly correlated (Pearson’s correlations r = 0.84, p = 0.001 and r = 0.75, p = 0.005).

Computational Feature Analysis of Body Movements Reveals Hierarchical Brain Organization

Social species spend considerable time observing the body movements of others to understand their actions, predict their emotions, watch their games, or enjoy their dance movements. Given the important information obtained from body movements, we still know surprisingly little about the details of brain mechanisms underlying movement perception. In this fMRI study, we investigated the relations between movement features obtained from automated computational analyses of video clips and the corresponding brain activity. Our results show that low-level computational features map to specific brain areas related to early visual- and motion-sensitive regions, while mid-level computational features are related to dynamic aspects of posture encoded in occipital–temporal cortex, posterior superior temporal sulcus and superior parietal lobe. Furthermore, behavioral features obtained from subjective ratings correlated with activity in higher action observation regions. Our computational feature-based analysis suggests that the neural mechanism of movement encoding is organized in the brain not so much by semantic categories than by feature statistics of the body movements.

Measuring social interaction in music ensembles

Music ensembles are an ideal test-bed for quantitative analysis of social interaction. Music is an inherently social activity, and music ensembles offer a broad variety of scenarios which are particularly suitable for investigation. Small ensembles, such as string quartets, are deemed a significant example of self-managed teams, where all musicians contribute equally to a task. In bigger ensembles, such as orchestras, the relationship between a leader (the conductor) and a group of followers (the musicians) clearly emerges. This paper presents an overview of recent research on social interaction in music ensembles with a particular focus on (i) studies from cognitive neuroscience; and (ii) studies adopting a computational approach for carrying out automatic quantitative analysis of ensemble music performances.

Adaptive Body Gesture Representation for Automatic Emotion Recognition

We present a computational model and a system for the automated recognition of emotions starting from full-body movement. Three-dimensional motion data of full-body movements are obtained either from professional optical motion-capture systems (Qualisys) or from low-cost RGB-D sensors (Kinect and Kinect2). A number of features are then automatically extracted at different levels, from kinematics of a single joint to more global expressive features inspired by psychology and humanistic theories (e.g., contraction index, fluidity, and impulsiveness). An abstraction layer based on dictionary learning further processes these movement features to increase the model generality and to deal with intraclass variability, noise, and incomplete information characterizing emotion expression in human movement. The resulting feature vector is the input for a classifier performing real-time automatic emotion recognition based on linear support vector machines. The recognition performance of the proposed model is presented and discussed, including the tradeoff between precision of the tracking measures (we compare the Kinect RGB-D sensor and the Qualisys motion-capture system) versus dimension of the training dataset. The resulting model and system have been successfully applied in the development of serious games for helping autistic children learn to recognize and express emotions by means of their full-body movement.

An investigation of the ‘female camouflage effect’ in autism using a computerized ADOS-2 and a test of sex/gender differences

Background

Autism spectrum conditions (autism) are diagnosed more frequently in boys than in girls. Females with autism may have been under-identified due to not only a male-biased understanding of autism but also females’ camouflaging. The study describes a new technique that allows automated coding of non-verbal mode of communication (gestures) and offers the possibility of objective, evaluation of gestures, independent of human judgment. The EyesWeb software platform and the Kinect sensor during two demonstration activities of ADOS-2 (Autism Diagnostic Observation Schedule, Second Edition) were used.

Methods

The study group consisted of 33 high-functioning Polish girls and boys with formal diagnosis of autism or Asperger syndrome aged 5–10, with fluent speech, IQ average and above and their parents (girls with autism, n = 16; boys with autism, n = 17). All children were assessed during two demonstration activities of Module 3 of ADOS-2, administered in Polish, and coded using Polish codes. Children were also assessed with Polish versions of the Eyes and Faces Tests. Parents provided information on the author-reviewed Polish research translation of SCQ (Social Communication Questionnaire, Current and Lifetime) and Polish version of AQ Child (Autism Spectrum Quotient, Child).

Results

Girls with autism tended to use gestures more vividly as compared to boys with autism during two demonstration activities of ADOS-2. Girls with autism made significantly more mistakes than boys with autism on the Faces Test. All children with autism had high scores in AQ Child, which confirmed the presence of autistic traits in this group. The current communication skills of boys with autism reported by parents in SCQ were significantly better than those of girls with autism. However, both girls with autism and boys with autism improved in the social and communication abilities over the lifetime. The number of stereotypic behaviours in boys significantly decreased over life whereas it remained at a comparable level in girls with autism.

Conclusions

High-functioning females with autism might present better on non-verbal (gestures) mode of communication than boys with autism. It may camouflage other diagnostic features. It poses risk of under-diagnosis or not receiving the appropriate diagnosis for this population. Further research is required to examine this phenomenon so appropriate gender revisions to the diagnostic assessments might be implemented.

The movements made by performers in a skilled quartet: a distinctive pattern, and the function that it serves

When people perform a task as part of a joint action, their behavior is not the same as it would be if they were performing the same task alone, since it has to be adapted to facilitate shared understanding (or sometimes to prevent it). Joint performance of music offers a test bed for ecologically valid investigations of the way non-verbal behavior facilitates joint action. Here we compare the expressive movement of violinists when playing in solo and ensemble conditions. The first violinists of two string quartets (SQs), professional and student, were asked to play the same musical fragments in a solo condition and with the quartet. Synchronized multimodal recordings were created from the performances, using a specially developed software platform. Different patterns of head movement were observed. By quantifying them using an appropriate measure of entropy, we showed that head movements are more predictable in the quartet scenario. Rater evaluations showed that the change does not, as might be assumed, entail markedly reduced expression. They showed some ability to discriminate between solo and ensemble performances, but did not distinguish them in terms of emotional content or expressiveness. The data raise provocative questions about joint action in realistically complex scenarios.

Enhanced apoptosis of peripheral blood mononuclear cells in cardiac transplanted patients undergoing chronic immunosuppressive treatment

Apoptosis plays a major role in tissue transplantation because intact T-cell-apoptosis pathways are required for the induction of tolerance to allografts. Moreover, immunosuppressive agents commonly used in clinical transplantation medicine promote lymphocyte apoptosis inhibiting the expression and production of cytokines involved in lymphocyte survival. The aim of our study was to evaluate peripheral blood mononuclear cells (PBMC) spontaneous apoptosis in patients undergoing chronic immunosuppressive treatment after cardiac transplantation. PBMC obtained from patients (n = 31) and controls matched for age and sex (n = 25) were cultured for 72 h and apoptosis was evaluated by quantification of fragmented DNA, staining with Hoechst 33258 dye and annexin V binding. We also investigated Fas expression and FasL mRNA expression as well as the ability of an IgM anti-Fas antibody to induce apoptosis. Finally, we evaluated IL2 production induced by PHA and the ability of IL2 to prevent apoptosis. In patients, PBMC underwent enhanced spontaneous apoptosis in comparison with controls. However, we could not find any difference between patients and normals as regards the expression of Fas and of FasL mRNA, even if the cross-linking of the Fas molecule induced apoptosis in PBMC from patients, whereas it failed to induce cell death in normals. We also found that IL2 production was significantly decreased in patients and that the addition of IL2 to the culture medium reduced PBMC spontaneous apoptosis. Our findings suggest that in cardiac transplanted patients PBMC undergo enhanced spontaneous apoptosis, which may contribute to prevent allograft rejection.

The A3 adenosine receptor induces cytoskeleton rearrangement in human astrocytoma cells via a specific action on Rho proteins

In previous studies, we have demonstrated that exposure of astroglial cells to A3 adenosine receptor agonists results in dual actions on cell survival, with "trophic" and antiapoptotic effects at nanomolar concentrations and induction of cell death at micromolar agonist concentrations. The protective actions of A3 agonists have been associated with a reinforcement of the actin cytoskeleton, which likely results in increased resistance of cells to cytotoxic stimuli. The molecular mechanisms at the basis of this effect and the signalling pathway(s) linking the A3 receptor to the actin cytoskeleton have never been elucidated. Based on previous literature data suggesting that the actin cytoskeleton is controlled by small GTP-binding proteins of the Rho family, in the study reported here we investigated the involvement of these proteins in the effects induced by A3 agonists on human astrocytoma ADF cells. The presence of the A3 adenosine receptor in these cells has been confirmed by immunoblotting analysis. As expected, exposure of human astrocytoma ADF cells to nanomolar concentrations of the selective A3 agonist 2-chloro-N6-(3-iodobenzyl)-adenosine-5'-N-methyluronamide (CI-IB-MECA) resulted in formation of thick actin positive stress fibers. Preexposure of cells to the C3B toxin that inactivates Rho-proteins completely prevented the actin changes induced by CI-IB-MECA. Exposure to the A3 agonist also resulted in significant reduction of Rho-GDI, an inhibitory protein known to maintain Rho proteins in their inactive state, suggesting a potentiation of Rho-mediated effects. This effect was fully counteracted by the concomitant exposure to the selective A3 receptor antagonist MRS1191. These results suggest that the reinforcement of the actin cytoskeleton induced by A3 receptor agonists is mediated by an interference with the activation/inactivation cycle of Rho proteins, which may, therefore, represent a biological target for the identification of novel neuroprotective strategies.

2-Chloro-adenosine induces a glutamate-dependent calcium response in C2C12 myotubes

Adenosine and its derivatives may induce acute changes, i.e., injury and death, in muscle cells. In the present work, we evaluated the intracellular calcium concentration in C2C12 myogenic cells differentiated in vitro to form myotubes and exposed to a metabolically stable analogue of adenosine, 2-chloro-adenosine. The compound was able to significantly modify ionic homeostasis by sensitizing muscle cells to the excitatory amino acid glutamate. A single exposure to glutamate led to a marked increase in intracellular calcium level. This is the first demonstration that adenosine analogues can regulate muscle cell integrity and function via an indirect increase of intracellular calcium ions.

Adenosine- and 2-chloro-adenosine-induced cytopathic effects on myoblastic cells and myotubes: involvement of different intracellular mechanisms

We recently suggested that, in muscular dystrophies, the excessive accumulation of adenosine as a result of an altered purine metabolism may contribute to progressive functional deterioration and muscle cell death. To verify this hypothesis, we have taken advantage of C2C12 myoblastic cells, which can be differentiated in vitro into multinucleated cells (myotubes). Exposure of both proliferating myoblasts and differentiated myotubes to adenosine or its metabolically-stable analog, 2-chloro-adenosine, resulted in apoptotic cell death and myotube disruption. Cytotoxicity by either nucleoside did not depend upon extracellular adenosine receptors, but, at least in part, by entry into cells via the membrane nitro-benzyl-thio-inosine-sensitive transporter. The adenosine kinase inhibitor, 5-iodotubercidin, prevented 2-chloro-adenosine-induced (but not adenosine-induced) effects, suggesting that an intracellular phosphorylation/activation reaction plays a key role in 2-chloro-adenosine-mediated cytotoxicity. Conversely, adenosine cytotoxicity was aggravated by the addition of homocysteine, suggesting that adenosine effects may be due to the accumulation of S-adenosyl-homocysteine, which blocks intracellular methylation-dependent reactions. Both nucleosides markedly disrupted the myotube structure via an effect on the actin cytoskeleton; however, also for myotubes, there were marked differences in the morphological alterations induced by these two nucleosides. These results show that adenosine and 2-chloro-adenosine induce apoptosis of myogenic cells via completely different metabolic pathways, and are consistent with the hypothesis that adenosine accumulation in dystrophic muscles may represent a novel pathogenetic pathway in muscle diseases.

Apoptosis induced by 2-chloro-adenosine and 2-chloro-2'-deoxy-adenosine in a human astrocytoma cell line: differential mechanisms and possible clinical relevance

We have previously demonstrated that 2-chloro-adenosine (2-CA) can induce apoptosis of rat astroglial cells (Abbracchio et al. [1995] Biochem. Biophys. Res. Commun. 213:908-915). In the present study, we have characterized, for the first time, the effects induced on a human astrocytoma cell line (ADF cells) by both 2-CA and its related analog 2-chloro-2'-deoxy-adenosine (2-CdA, that is employed as anti-cancer agent in chronic lymphoid malignancies). Exposure of these cells to either adenosine analog resulted in time- and concentration-dependent apoptosis. Experiments with pharmacological agents known to interfere with adenosine receptors, its membrane transporter, and intracellular nucleoside kinases showed that: (i) cell death induced by either adenosine analog did not depend on extracellular adenosine receptors, but on a direct intracellular action; however, only in the case of 2-CA, was entry into cells mediated by the specific nitrobenzyl-tioinosine-sensitive transporter; (ii) for both adenosine analogs, induction of apoptosis required the phosphorylation/activation by specific intracellular nucleoside kinases, i.e., adenosine kinase for 2-CA, and deoxycytidine kinase for 2-CdA. In addition, only in the case of 2-CdA, was induction of apoptosis preceded by a block of cells at the G2/M phase of the cell cycle. Finally, at concentrations of either analog that killed about 80-90% of astrocytoma cells, a significantly lower effect on the viability of primary cortical neurons was observed. In conclusion, both adenosine analogs can trigger apoptosis of human astrocytoma cells, albeit with different mechanisms. This effect together with the relative sparing of neuronal cells, may have potential clinical implications for the therapy of tumors of glial origin.