Reproducibility of the dynamics of facial expressions in unilateral facial palsy

Frontiers in Three-Dimensional Surface Imaging Systems for 3D Face Acquisition in Craniofacial Research and Practice: An Updated Literature Review

Digitalizing all aspects of dental care is a contemporary approach to ensuring the best possible clinical outcomes. Ongoing advancements in 3D face acquisition have been driven by continuous research on craniofacial structures and treatment effects. An array of 3D surface-imaging systems are currently available for generating photorealistic 3D facial images. However, choosing a purpose-specific system is challenging for clinicians due to variations in accuracy, reliability, resolution, and portability. Therefore, this review aims to provide clinicians and researchers with an overview of currently used or potential 3D surface imaging technologies and systems for 3D face acquisition in craniofacial research and daily practice. Through a comprehensive literature search, 71 articles meeting the inclusion criteria were included in the qualitative analysis, investigating the hardware, software, and operational aspects of these systems. The review offers updated information on 3D surface imaging technologies and systems to guide clinicians in selecting an optimal 3D face acquisition system. While some of these systems have already been implemented in clinical settings, others hold promise. Furthermore, driven by technological advances, novel devices will become cost-effective and portable, and will also enable accurate quantitative assessments, rapid treatment simulations, and improved outcomes.

'Are dynamic procedures superior to static in treating the paralytic eyelid in facial paralysis?'

BACKGROUND

Facial nerve weakness can cause deficient eye closure with reduced corneal protection. Surgical remedies can be static to oppose the levator muscle (lid loading) or dynamic procedures, which act to increase the strength of closure. This retrospective cohort study compares these groups. The hypothesis is that dynamic reconstruction has advantages over static techniques in terms of eye closure, symptomatic improvement, blink restoration, and complication rate.

METHODS

Two cohorts were compared: those treated with a gold weight insertion into the upper eyelid and those who had received dynamic reconstruction. These included temporalis transfer; cross face nerve grafting alone (CFNG) and CFNG followed by free tissue transfer. Assessments included standard photography and video; measurement of eyelid excursion including residual gap and if full eye closure was possible. The presence of the blink reflex and symptoms of dry eye was assessed.

RESULTS

Overall improvement in eye closure was similar with the gold weight compared to dynamic procedures (5.1 mm vs 5.3 mm). Dynamic procedures however gave improved results in terms of symptom relief and restoration of blink. They also had fewer complications and revision rates overall.

CONCLUSION

The study confirms the hypothesis that dynamic reconstructions of the paralysed eyelid confer advantages compared to simple lid loading techniques. Improvements in lid excursion are similar, but symptom improvement and blink restoration are significantly better. A decision regarding eyelid reanimation should be made early in the patient's journey of facial reanimation to allow for accurate planning and placement of nerve grafts at an early stage.

Cosmetic appreciation and emotional processing in patients with a peripheral facial palsy: A systematic review

Background; The goal of this review is 1) to summarize the studies assessing PFP by casual observers, patients themselves and the cosmetic appreciation of the PFP and 2) to summarize the studies assessing whether there is a difference in emotional recognition/processing of facial emotions and/or cognitive tasks in patients with a PFP. Materials and Methods; A multi-database systematic literature search was performed using the following databases: Pubmed, Embase, Medline, and The Cochrane Library from the earliest date of each database up to December 2019. Population of interest consisted of patients with a PFP and studies that investigated cosmetic appreciation and/or emotional recognition and/or emotional processing in these patients. Two authors rated the methodological quality of the included studies independently using the 'Newcastle - Ottawa Quality Assessment Scale' for nonrandomised studies' (NOS). Two authors extracted the outcome data regarding cosmetic appreciation and/or emotional recognition/processing from the included studies. Results; Twelve hundred and thirty-two studies were found of which eleven studies met the inclusion criteria. Most studies were assessed to be of 'fair' to 'good' methodological quality. The Cohen's kappa (between author RL and SP) was 0.68. Two studies investigated emotional processing and/or emotional recognition. Nine studies investigated cosmetic appreciation in both patients and casual observers. Important findings of this systematic review are that there is a correlation between the perceived severity of the PFP of the patients and the ratings by casual observers. Secondly there seems to be a laterality difference in cosmetic appreciation and thirdly there might to be a decreased emotional recognition and processing in patients with a PFP. Conclusion; Emotional recognition and cosmetic appreciation in patients with a PFP is an under investigated area, in which further studies are needed to substantiate the findings in current literature.

Three-Dimensional Dynamic Analysis of the Reproducibility of Verbal and Nonverbal Facial Expressions

OBJECTIVE

The aim of this study is to compare the short- and long-term reproducibility of verbal and nonverbal facial expressions of normal people using dynamic 3-dimensional (3-D) imaging.

DESIGN

Prospective, cross-sectional, controlled study.

SETTING

Peking University School and Hospital of Stomatology, Beijing, China.

PATIENTS AND PARTICIPANTS

Twenty-seven participants, 12 males and 15 females, were recruited for this study.

METHODS

A 3-D dynamic system was applied to capture the process of 4 nonverbal facial expressions (smile lips closed, smile lips open, lip purse, cheek puff) and 2 verbal facial expressions (/i:/, /u:/) at an initial time point, 15 minutes later, and 1 week later. Key frames were selected from each expression recording sequence.

MAIN OUTCOME MEASURES

The root mean square (RMS) between each key frame and its corresponding frame at rest was calculated. ΔRMS reflected the difference of the same key frames between the different sessions of the same expression of the same participant. The reproducibility of different facial expressions at different time intervals were analyzed.

RESULTS

There was no significant difference in verbal and nonverbal expression repeatability during a 15-minute interval, except for cheek puff motion. Following a 1-week interval, verbal expression repeatability was superior to that of nonverbal expressions (P < .01). Compared with nonverbal expressions, the repeatability of verbal expressions did not obviously decrease with the increase in recording interval.

CONCLUSIONS

Dynamic 3-D imaging is a useful technique for facial expression analysis. Verbal expressions showed greater reproducibility than nonverbal expressions.

Video-Based Facial Weakness Analysis

OBJECTIVE

Facial weakness is a common sign of neurological diseases such as Bell's palsy and stroke. However, recognizing facial weakness still remains as a challenge, because it requires experience and neurological training.

METHODS

We propose a framework for facial weakness detection, which models the temporal dynamics of both shape and appearance-based features of each target frame through a bi-directional long short-term memory network (Bi-LSTM). The system is evaluated on a "in-the-wild"video dataset that is verified by three board-certified neurologists. In addition, three emergency medical services (EMS) personnel and three upper level residents rated the dataset. We compare the evaluation of the proposed algorithm with other comparison methods as well as the human raters.

RESULTS

Experimental evaluation demonstrates that: (1) the proposed algorithm achieves the accuracy, sensitivity, and specificity of 94.3%, 91.4%, and 95.7%, which outperforms other comparison methods and achieves the equal performance to paramedics; (2) the framework can provide visualizable and interpretable results that increases model transparency and interpretability; (3) a prototype is implemented as a proof-of-concept showcase to show the feasibility of an inexpensive solution for facial weakness detection.

CONCLUSION

The experiment results suggest that the proposed framework can identify facial weakness effectively.

SIGNIFICANCE

We provide a proof-of-concept study, showing that such technology could be used by non-neurologists to more readily identify facial weakness in the field, leading to increasing coverage and earlier treatment.

Combining an end to side nerve to masseter transfer with cross face nerve graft for functional upgrade in partial facial paralysis-an observational cohort study

BACKGROUND

Results of a single stage technique combining cross facial nerve graft(s) (CFNG) with an ipsilateral end to side nerve to masseter transfer (NTM) in incomplete facial paralysis are assessed in a retrospective cohort study. The hypothesis is that the technique can safely improve the quality of smile in these patients. End to side coaptations for the recipient facial nerve minimise the risk of iatrogenic function loss, contrasting with the end to end neurorrhaphies used in conventional babysitting procedures.

METHODS

A series of 27 patients was studied through case note review and standardised assessments. Surgical technique involves extensive exposure of the facial nerve and the NTM on the affected side and access is by bilateral preauricular incisions. End to end coaptations are made to the facial nerve on the donor side and on the recipient a standard CFNG is combined with an end to side NTM coaptation. Follow up was a minimum of 9 months from surgery.

RESULTS

Overall improvement in the Sunnybrook scale averaged 33, from a pre-operative score of 40 (p < 0.05). Average upgrade of 4.7 mm of increased movement at the modiolus was achieved (p < 0.05), 43% improvement compared to the normal side. An improved resting symmetry of 3.8 mm was achieved in relevant cases. Where eye closure was strengthened the average improvement was 5 mm of increased lid closure. The smile achieved was spontaneous in 22 of 27 cases.

CONCLUSION

The study confirms the hypothesis that CFNG with NTM transfer offers a physiological upgrade of facial movement in partial facial paralysis, applicable in both early and longstanding cases.

Region Based Parallel Hierarchy Convolutional Neural Network for Automatic Facial Nerve Paralysis Evaluation

In this article, we propose a parallel hierarchy convolutional neural network (PHCNN) combining a Long Short-Term Memory (LSTM) network structure to quantitatively assess the grading of facial nerve paralysis (FNP) by considering the region-based asymmetric facial features and temporal variation of the image sequences. FNP, such as Bell's palsy, is the most common facial symptom of neuromotor dysfunctions. It causes the weakness of facial muscles for the normal emotional expression and movements. The subjective judgement by clinicians completely depends on individual experience, which may not lead to a uniform evaluation. Existing computer-aided methods mainly rely on some complicated imaging equipment, which is complicated and expensive for facial functional rehabilitation. Compared with the subjective judgment and complex imaging processing, the objective and intelligent measurement can potentially avoid this issue. Considering dynamic variation in both global and regional facial areas, the proposed hierarchical network with LSTM structure can effectively improve the diagnostic accuracy and extract paralysis detail from the low-level shape, contour to sematic level features. By segmenting the facial area into two palsy regions, the proposed method can discriminate FNP from normal face accurately and significantly reduce the effect caused by age wrinkles and unrepresentative organs with shape and position variations on feature learning. Experiment on the YouTube Facial Palsy Database and Extended CohnKanade Database shows that the proposed method is superior to the state of the art deep learning methods.