What's in a Smile? Initial Analyses of Dynamic Changes in Facial Shape and Appearance

An Exploration of Pathologies of Multilevel Principal Components Analysis in Statistical Models of Shape

3D facial surface imaging is a useful tool in dentistry and in terms of diagnostics and treatment planning. Between-group PCA (bgPCA) is a method that has been used to analyse shapes in biological morphometrics, although various “pathologies” of bgPCA have recently been proposed. Monte Carlo (MC) simulated datasets were created here in order to explore “pathologies” of multilevel PCA (mPCA), where mPCA with two levels is equivalent to bgPCA. The first set of MC experiments involved 300 uncorrelated normally distributed variables, whereas the second set of MC experiments used correlated multivariate MC data describing 3D facial shape. We confirmed results of numerical experiments from other researchers that indicated that bgPCA (and so also mPCA) can give a false impression of strong differences in component scores between groups when there is none in reality. These spurious differences in component scores via mPCA decreased significantly as the sample sizes per group were increased. Eigenvalues via mPCA were also found to be strongly affected by imbalances in sample sizes per group, although this problem was removed by using weighted forms of covariance matrices suggested by the maximum likelihood solution of the two-level model. However, this did not solve problems of spurious differences between groups in these simulations, which was driven by very small sample sizes in one group. As a “rule of thumb” only, all of our experiments indicate that reasonable results are obtained when sample sizes per group in all groups are at least equal to the number of variables. Interestingly, the sum of all eigenvalues over both levels via mPCA scaled approximately linearly with the inverse of the sample size per group in all experiments. Finally, between-group variation was added explicitly to the MC data generation model in two experiments considered here. Results for the sum of all eigenvalues via mPCA predicted the asymptotic amount for the total amount of variance correctly in this case, whereas standard “single-level” PCA underestimated this quantity.

An exploration of adolescent facial shape changes with age via multilevel partial least squares regression

BACKGROUND AND OBJECTIVES

Multilevel statistical models represent the existence of hierarchies or clustering within populations of subjects (or shapes in this work). This is a distinct advantage over single-level methods that do not. Multilevel partial-least squares regression (mPLSR) is used here to study facial shape changes with age during adolescence in Welsh and Finnish samples comprising males and females.

METHODS

3D facial images were obtained for Welsh and Finnish male and female subjects at multiple ages from 12 to 17 years old. 1000 3D points were defined regularly for each shape by using "meshmonk" software. A three-level model was used here, including level 1 (sex/ethnicity); level 2, all "subject" variations excluding sex, ethnicity, and age; and level 3, age. The mathematical formalism of mPLSR is given in an Appendix.

RESULTS

Differences in facial shape between the ages of 12 and 17 predicted by mPLSR agree well with previous results of multilevel principal components analysis (mPCA); buccal fat is reduced with increasing age and features such as the nose, brow, and chin become larger and more distinct. Differences due to ethnicity and sex are also observed. Plausible simulated faces are predicted from the model for different ages, sexes and ethnicities. Our models provide good representations of the shape data by consideration of appropriate measures of model fit (RMSE and R2).

CONCLUSIONS

Repeat measures in our dataset for the same subject at different ages can only be modelled indirectly at the lowest level of the model at discrete ages via mPCA. By contrast, mPLSR models age explicitly as a continuous covariate, which is a strong advantage of mPLSR over mPCA. These investigations demonstrate that multivariate multilevel methods such as mPLSR can be used to describe such age-related changes for dense 3D point data. mPLSR might be of much use in future for the prediction of facial shapes for missing persons at specific ages or for simulating shapes for syndromes that affect facial shape in new subject populations.

Initial Investigations of the Cranial Size and Shape of Adult Eurasian Otters (Lutra lutra) in Great Britain

Three-dimensional (3D) surface scans were carried out in order to determine the shapes of the upper sections of (skeletal) crania of adult Eurasian otters (Lutra lutra) from Great Britain. Landmark points were placed on these shapes using a graphical user interface (GUI) and distance measurements (i.e., the length, height, and width of the crania) were found by using the landmark points. Male otters had significantly larger skulls than females (P < 0.001). Differences in size also occurred by geographical area in Great Britain (P < 0.05). Multilevel Principal Components Analysis (mPCA) indicated that sex and geographical area explained 31.1% and 9.6% of shape variation in "unscaled" shape data and that they explained 17.2% and 9.7% of variation in "scaled" data. The first mode of variation at level 1 (sex) correctly reflected size changes between males and females for "unscaled" shape data. Modes at level 2 (geographical area) also showed possible changes in size and shape. Clustering by sex and geographical area was observed in standardized component scores. Such clustering in a cranial shape by geographical area might reflect genetic differences in otter populations in Great Britain, although other potentially confounding factors (e.g., population age-structure, diet, etc.) might also drive regional differences. This work provides a successful first test of the effectiveness of 3D surface scans and multivariate methods, such as mPCA, to study the cranial morphology of otters.

Multilevel Analysis of the Influence of Maternal Smoking and Alcohol Consumption on the Facial Shape of English Adolescents

This cross-sectional study aims to assess the influence of maternal smoking and alcohol consumption during pregnancy on the facial shape of non-syndromic English adolescents and demonstrate the potential benefits of using multilevel principal component analysis (mPCA). A cohort of 3755 non-syndromic 15-year-olds from the Avon Longitudinal Study of Parents and Children (ALSPAC), England, were included. Maternal smoking and alcohol consumption during the 1st and 2nd trimesters of pregnancy were determined via questionnaire at 18 weeks gestation. 21 facial landmarks, used as a proxy for the main facial features, were manually plotted onto 3D facial scans of the participants. The effect of maternal smoking and maternal alcohol consumption (average 1-2 glasses per week) was minimal, with 0.66% and 0.48% of the variation in the 21 landmarks of non-syndromic offspring explained, respectively. This study provides a further example of mPCA being used effectively as a descriptive analysis in facial shape research. This is the first example of mPCA being extended to four levels to assess the influence of environmental factors. Further work on the influence of high/low levels of smoking and alcohol and providing inferential evidence is required.

Multilevel principal components analysis of three-dimensional facial growth in adolescents

BACKGROUND AND OBJECTIVES

The study of age-related facial shape changes across different populations and sexes requires new multivariate tools to disentangle different sources of variations present in 3D facial images. Here we wish to use a multivariate technique called multilevel principal components analysis (mPCA) to study three-dimensional facial growth in adolescents.

METHODS

These facial shapes were captured for Welsh and Finnish subjects (both male and female) at multiple ages from 12 to 17 years old (i.e., repeated-measures data). 1000 "dense" 3D points were defined regularly for each shape by using a deformable template via "meshmonk" software. A three-level model was used here, namely: level 1 (sex/ethnicity); level 2, all "subject" variations excluding sex, ethnicity, and age; and level 3, age. The technicalities underpinning the mPCA method are presented in Appendices.

RESULTS

Eigenvalues via mPCA predicted that: level 1 (ethnicity/sex) contained 7.9% of variation; level 2 contained 71.5%; and level 3 (age) contained 20.6%. The results for the eigenvalues via mPCA followed a similar pattern to those results of single-level PCA. Results for modes of variation made sense, where effects due to ethnicity, sex, and age were reflected in modes at appropriate levels of the model. Standardised scores at level 1 via mPCA showed much stronger differentiation between sex and ethnicity groups than results of single-level PCA. Results for standardised scores from both single-level PCA and mPCA at level 3 indicated that females had different average "trajectories" with respect to these scores than males, which suggests that facial shape matures in different ways for males and females. No strong evidence of differences in growth patterns between Finnish and Welsh subjects was observed.

CONCLUSIONS

mPCA results agree with existing research relating to the general process of facial changes in adolescents with respect to age quoted in the literature. They support previous evidence that suggests that males demonstrate larger changes and for a longer period of time compared to females, especially in the lower third of the face. These calculations are therefore an excellent initial test that multivariate multilevel methods such as mPCA can be used to describe such age-related changes for "dense" 3D point data.

An Evaluation Approach for a Physically-Based Sticky Lip Model †

Physically-based mouth models operate on the principle that a better mouth animation will be produced by simulating physically accurate behaviour of the mouth. In the development of these models, it is useful to have an evaluation approach which can be used to judge the effectiveness of a model and draw comparisons against other models and real-life mouth behaviour. This article presents a set of metrics which can be used to describe the motion of the lips, as well as a process for measuring these from video of real or simulated mouths, implemented using Python and OpenCV. As an example, the process is used to evaluate a physically-based mouth model focusing on recreating the stickiness effect of saliva between the lips. The metrics highlight the changes in behaviour due to the addition of stickiness between the lips in the synthetic mouth model and show quantitatively improved behaviour in relation to real mouth movements. The article concludes that the presented metrics provide a useful approach for evaluation of mouth animation models that incorporate sticky lip effects.