Evaluation of the 3D error of 2 face-scanning systems: An in vitro analysis

Smartphone applications for facial scanning: A technical and scoping review

INTRODUCTION

Facial scanning through smartphone scanning applications (SSA) is increasingly being used for medical applications as cost-effective, chairside method. However, clinical validation is lacking. This review aims to address: (1) Which SSA could perform facial scanning? (2) Which SSA can be clinically used? (3) Which SSA have been reported and scientifically validated for medical applications?

METHODS

Technical search for SSA designed for face or object scanning was conducted on Google, Apple App Store, and Google Play Store from August 2022 to December 2023. Literature search was performed on PubMed, Cochrane, EMBASE, MEDLINE, Scopus, IEEE Xplore, ACM Digital Library, Clinicaltrials.gov, ICTRP (WHO) and preprints up to 2023. Eligibility criteria included English-written scientific articles incorporating at least one SSA for clinical purposes. SSA selection and data extraction were executed by one reviewer, validated by second, with third reviewer being consulted for discordances.

RESULTS

Sixty-three applications designed for three-dimensional object scanning were retrieved, with 52 currently offering facial scanning capabilities. Fifty-six scientific articles, comprising two case reports, 16 proof-of-concepts and 38 experimental studies were analysed. Thirteen applications (123D Catch, 3D Creator, Bellus 3D Dental Pro, Bellus 3D Face app, Bellus 3D Face Maker, Capture, Heges, Metascan, Polycam, Scandy Pro, Scaniverse, Tap tap tap and Trnio) were reported in literature for digital workflow integration, comparison or proof-of-concept studies.

CONCLUSION

Fifty-two SSA can perform facial scanning currently and can be used clinically, offering cost-effectiveness, portability and user-friendliness. Although clinical validation is crucial, only 13 SSA were scientifically validated, underlying awareness of potential pitfalls and limitations.

Accuracy of Smartphone-Based Three-Dimensional Facial Scanning System: A Systematic Review

BACKGROUND

Recently, the integration of 3D face scanning into smartphones has raised vast interest in plastic surgery. With the release of smartphones featuring 3D face scanning technology, users now can capture detailed 3D models of their faces using their smartphones. However, trueness and precision of this system is less well established.

METHODS

PubMed, Cochrane Library, Embase, ScienceDirect, Scopus, and Web of Science databases were searched for studies evaluating 3D scanning of smartphone devices and conventional 3D imaging systems from January 1, 2017, to June 1, 2023. A qualitative systematic review was conducted by two review authors after independently selecting studies, extracting data, and assessing the risk of bias of included studies.

RESULTS

A total of 11 studies were included, all focusing on the accuracy of smartphone 3D facial scanning. The results show that although smartphones perform poorly on deep and irregular surfaces, they are accurate enough for clinical applications and have the advantage of being economical and portable.

CONCLUSIONS

Smartphone-based 3D facial scanning has been basically validated for clinical application, showing broad clinical application prospects in plastic surgery.

LEVEL OF EVIDENCE II

This journal requires that authors assign a level of evidence to each article. For a full description of these Evidence-Based Medicine ratings, please refer to the Table of Contents or the online Instructions to Authors   www.springer.com/00266 .

Creating three-dimensional virtual patients by superimposing intraoral and facial digital scans guided with an aligner system: A dental technique

A technique for creating 3-dimensional virtual patients (3DVPs) by superimposing intraoral and facial digital scans guided with a novel aligner system is described. This aligner system supports design modifications to adapt to different facial scanning methods (FSMs) and reduce the impact of FSMs on the accuracy of 3DVPs. Two different designs of the aligner system are described: one for use with less-accurate FSMs and another for use with more-accurate FSMs. These virtual designs are available for download and use.

Comparison of three-dimensional imaging of the nose using three different 3D-photography systems: an observational study

BACKGROUND

New 3D technologies for superficial soft tissue changes, especially in plastic and reconstructive surgical procedures, can improve the planning and documentation of facial surgeries. The purpose of this study was to compare and determine the applicability and feasibility of three different 3D-photography systems in clinical practice imaging the nose.

METHODS

A total of 16 healthy non-operated noses were included in this prospective study. A plaster model of each nose was produced, digitized, and converted to a .stl mesh (= ground truth model). Three-dimensional images of each nose were then taken using Artec Space Spider (gold standard), Planmeca ProFace®, and the Bellus3D Dental Pro application. All resulting .stl files were aligned to the ground truth model using MeshLab software, and the root mean square error (RMSE), mean surface distance (MSD), and Hausdorff distance (HD) were calculated.

RESULTS

The Artec Space Spider 3D-photography system showed significantly better results compared to the two other systems in regard to RMSE, MSD, and HD (each p < 0.001). There was no significant difference between Planmeca ProFace® and Bellus3D Dental Pro in terms of RMSE, MSD, and HD. Overall, all three camera systems showed a clinically acceptable deviation to the reference model (range: -1.23-1.57 mm).

CONCLUSIONS

The three evaluated 3D-photography systems were suitable for nose imaging in the clinical routine. While Artec Space Spider showed the highest accuracy, the Bellus3D Dental Pro app may be the most feasible option for everyday clinical use due to its portability, ease of use, and low cost. This study presents three different systems, allowing readers to extrapolate to other systems when planning to introduce 3D photography in the clinical routine.

Current status of optical scanning in facial prosthetics: A systematic review and meta-analysis

Purpose To assess the accuracy of scanning technologies for constructing facial prostheses on human faces.Study selection Our systematic search was performed on five databases. Studies reporting on human volunteers (P) whose faces were scanned with a scanning technology were eligible. The anthropometrical interlandmark distances (ILDs) were used as indicators of accuracy; the ILDs are measured on the virtual models (I) and directly on the faces (C). The virtual models deviated from their true values (O). Studies reporting the measurements on patients with or without facial deformities were included, but cadavers or inanimate objects were reasons for exclusion. We performed a mean difference (MD) / standardized MD analysis with a random effect model. The difficulties regarding the scanning procedure mentioned in the articles were also assessed.Results We found 3723 records after duplicate removal. Twenty five articles were eligible for the qualitative review, and ten articles were included in the quantitative synthesis. Eight different ILDs were compared in MD analyses. The differences were between -0.54-0.43 mm. We also performed a regional three-dimensional analysis to compare scanning technologies in each major region. No significant differences were found in any of the regions and axes. The most mentioned difficulties were artifacts due to motion or blinking.Conclusions The results suggest no systematic skew in linear dimensions neither between direct caliper measurements nor between measurements on the scanned models, scanning technologies, or facial regions.

Can smartphones be used for routine dental clinical application? A validation study for using smartphone-generated 3D facial images

OBJECTIVES

To compare the accuracy of smartphone-generated three-dimensional (3D) facial images to that of direct anthropometry (DA) and 3dMD with the aim of assessing the validity and reliability of smartphone-generated 3D facial images for routine clinical applications.

MATERIALS AND METHODS

Twenty-five anthropometric soft-tissue facial landmarks were labelled manually on 22 orthognathic surgery patients (11 males and 11 females; mean age 26.2 ± 5.3 years). For each labelled face, two imaging operations were performed using two different surface imaging systems: 3dMDface and Bellus3D FaceApp. Next, 42 inter-landmark facial measurements amongst the identified facial landmarks were measured directly on each labelled face and also digitally on 3D facial images. The measurements obtained from smartphone-generated 3D facial images (SGI) were statistically compared with those from DA and 3dMD.

RESULTS

SGI had slightly higher measurement values than DA and 3dMD, but there was no statistically significant difference between the mean values of inter-landmark measures across the three methods. Clinically acceptable differences (≤3 mm or ≤5°) were observed for 67 % and 74 % of measurements with good agreement between DA and SGI, and 3dMD and SGI, respectively. An overall small systematic bias of ± 0.2 mm was observed between the three methods. Furthermore, the mean absolute difference between DA and SGI methods was highest for linear (1.41 ± 0.33 mm) as well as angular measurements (3.07 ± 0.73°).

CONCLUSIONS

SGI demonstrated fair trueness compared to DA and 3dMD. The central region and flat areas of the face in SGI are more accurate. Despite this, SGI have limited clinical application, and the panfacial accuracy of the SGI would be more desirable from a clinical application standpoint.

CLINICAL SIGNIFICANCE

The usage of SGI in clinical practice for region-specific macro-proportional facial assessment involving central and flat regions of the face or for patient education purposes, which does not require accuracy within 3 mm and 5° can be considered.

Application of three-dimensional reconstruction technology in dentistry: a narrative review

BACKGROUND

Three-dimensional(3D) reconstruction technology is a method of transforming real goals into mathematical models consistent with computer logic expressions and has been widely used in dentistry, but the lack of review and summary leads to confusion and misinterpretation of information. The purpose of this review is to provide the first comprehensive link and scientific analysis of 3D reconstruction technology and dentistry to bridge the information bias between these two disciplines.

METHODS

The IEEE Xplore and PubMed databases were used for rigorous searches based on specific inclusion and exclusion criteria, supplemented by Google Academic as a complementary tool to retrieve all literature up to February 2023. We conducted a narrative review focusing on the empirical findings of the application of 3D reconstruction technology to dentistry.

RESULTS

We classify the technologies applied to dentistry according to their principles and summarize the different characteristics of each category, as well as the different application scenarios determined by these characteristics of each technique. In addition, we indicate their development prospects and worthy research directions in the field of dentistry, from individual techniques to the overall discipline of 3D reconstruction technology, respectively.

CONCLUSIONS

Researchers and clinicians should make different decisions on the choice of 3D reconstruction technology based on different objectives. The main trend in the future development of 3D reconstruction technology is the joint application of technology.

Accuracy between 2D Photography and Dual-Structured Light 3D Facial Scanner for Facial Anthropometry: A Clinical Study

(1) Background: Facial scanners are used in different fields of dentistry to digitalize the soft tissues of the patient's face. The development of technology has allowed the patient to have a 3-dimensional virtual representation, facilitating facial integration in the diagnosis and treatment plan. However, the accuracy of the facial scanner and the obtaining of better results with respect to the manual or two-dimensional (2D) method are questionable. The objective of this clinical trial was to evaluate the usefulness and accuracy of the 3D method (a dual-structured light facial scanner) and compare it with the 2D method (photography) to obtain facial analysis in the maximum intercuspation position and smile position. (2) Methods: A total of 60 participants were included, and nine facial landmarks and five interlandmarks distances were determined by two independent calibrated operators for each participant. All measurements were made using three methods: the manual method (manual measurement), the 2D method (photography), and the 3D method (facial scanner). All clinical and lighting conditions, as well as the specific parameters of each method, were standardized and controlled. The facial interlandmark distances were made by using a digital caliper, a 2D software program (Adobe Photoshop, version 21.0.2), and a 3D software program (Meshlab, version 2020.12), respectively. The data were analyzed by SPSS statistical software. The Kolmogorov-Smirnov test revealed that trueness and precision values were normally distributed (p > 0.05), so a Student's t-test was employed. (3) Results: Statistically significant differences (p ≤ 0.01) were observed in all interlandmark measurements in the 2D group (photography) to compare with the manual group. The 2D method obtained a mean accuracy value of 2.09 (±3.38) and 2.494 (±3.67) in maximum intercuspation and smile, respectively. On the other hand, the 3D method (facial scanner) obtained a mean accuracy value of 0.61 (±1.65) and 0.28 (±2.03) in maximum intercuspation and smile, respectively. There were no statistically significant differences with the manual method. (4) Conclusions: The employed technique demonstrated that it influences the accuracy of facial records. The 3D method reported acceptable accuracy values, while the 2D method showed discrepancies over the clinically acceptable limits.

A Simple Way to Reduce 3D Model Deformation in Smartphone Photogrammetry

Recently, the term smartphone photogrammetry gained popularity. This suggests that photogrammetry may become a simple measurement tool by virtually every smartphone user. The research was undertaken to clarify whether it is appropriate to use the Structure from Motion-Multi Stereo View (SfM-MVS) procedure with self-calibration as it is done in Uncrewed Aerial Vehicle photogrammetry. First, the geometric stability of smartphone cameras was tested. Fourteen smartphones were calibrated on the checkerboard test field. The process was repeated multiple times. These observations were found: (1) most smartphone cameras have lower stability of the internal orientation parameters than a Digital Single-Lens Reflex (DSLR) camera, and (2) the principal distance and position of the principal point are constantly changing. Then, based on images from two selected smartphones, 3D models of a small sculpture were developed. The SfM-MVS method was used, with self-calibration and pre-calibration variants. By comparing the resultant models with the reference DSLR-created model it was shown that introducing calibration obtained in the test field instead of self-calibration improves the geometry of 3D models. In particular, deformations of local concavities and convexities decreased. In conclusion, there is real potential in smartphone photogrammetry, but it also has its limits.

Accuracy of RGB-D camera-based and stereophotogrammetric facial scanners: a comparative study

OBJECTIVES

This study aimed to evaluate and compare the accuracy and inter-operator reliability of a low-cost red-green-blue-depth (RGB-D) camera-based facial scanner (Bellus3D Arc7) with a stereophotogrammetry facial scanner (3dMD) and to explore the possibility of the former as a clinical substitute for the latter.

METHODS

A mannequin head was selected as the research object. In the RGB-D camera-based facial scanner group, the head was continuously scanned five times using an RGB-D camera-based facial scanner (Bellus3D Arc7), and the outcome data of each scan was then imported into CAD software (MeshLab) to reconstruct three-dimensional (3D) facial photographs. In the stereophotogrammetry facial scanner group, the mannequin head was scanned with a stereophotogrammetry facial scanner (3dMD). Selected parameters were directly measured on the reconstructed 3D virtual faces using a CAD software. The same parameters were then measured directly on the mannequin head using the direct anthropometry (DA) method as the gold standard for later comparison. The accuracy of the facial scanners was evaluated in terms of trueness and precision. Trueness was evaluated by comparing the measurement results of the two groups with each other and with that of DA using equivalence tests and average absolute deviations, while precision and inter-operator reliability were assessed using the intraclass correlation coefficient (ICC). A 3D facial mesh deviation between the two groups was also calculated for further reference using a 3D metrology software (GOM inspect pro).

RESULTS

In terms of trueness, the average absolute deviations between RGB-D camera-based and stereophotogrammetry facial scanners, between RGB-D camera-based facial scanner and DA, and between stereophotogrammetry facial scanner and DA were statistically equivalent at 0.50±0.27 mm, 0.61±0.42 mm, and 0.28±0.14 mm, respectively. Equivalence test results confirmed that their equivalence was within clinical requirements (<1 mm). The ICC for each parameter was approximately 0.999 in terms of precision and inter-operator reliability. A 3D facial mesh analysis suggested that the deviation between the two groups was 0.37±0.01 mm.

CONCLUSIONS

For facial scanners, an accuracy of <1 mm is commonly considered clinically acceptable. Both the RGB-D camera-based and stereophotogrammetry facial scanners in this study showed acceptable trueness, high precision, and inter-operator reliability. A low-cost RGB-D camera-based facial scanner could be an eligible clinical substitute for traditional stereophotogrammetry.

CLINICAL SIGNIFICANCE

The low-cost RGB-D camera-based facial scanner showed clinically acceptable trueness, high precision, and inter-operator reliability; thus, it could be an eligible clinical substitute for traditional stereophotogrammetry.

Present and future of extraoral maxillofacial prosthodontics: Cancer rehabilitation

Historically, facial prosthetics have successfully rehabilitated individuals with acquired or congenital anatomical deficiencies of the face. This history includes extensive efforts in research and development to explore best practices in materials, methods, and artisanal techniques. Presently, extraoral maxillofacial rehabilitation is managed by a multiprofessional team that has evolved with a broadened scope of knowledge, skills, and responsibility. This includes the mandatory integration of different professional specialists to cover the bio-psycho-social needs of the patient, systemic health and pathology surveillance, and advanced restorative techniques, which may include 3D technologies. In addition, recent digital workflows allow us to optimize this multidisciplinary integration and reduce the active time of both patients and clinicians, as well as improve the cost-efficiency of the care system, promoting its access to both patients and health systems. This paper discusses factors that affect extraoral maxillofacial rehabilitation's present and future opportunities from teamwork consolidation, techniques utilizing technology, and health systems opportunities.

Comparison of the accuracy of different handheld-type scanners in three-dimensional facial image recognition

PURPOSE

Handheld-type scanners are widely used in clinical practice. This study examined the accuracy of handheld-type scanners using plaster statues to assess their performance in facial recognition.

METHODS

Twelve 4-mm zirconia balls as measuring points were attached to the facial portions of three types of plaster statue. Six digital facial images of each plaster statue were obtained using one of the following five handheld-type scanners: Artec Eva, Artec Spider, Bellus 3D FaceApp, SNAP, and Vectra H1. Four-millimeter spherical objects were manually placed at the measurement points on the scanned data generated using computer-aided design software and coordinate positions were measured using a contact-type high-resolution three-dimensional measurement device. Consequently, the discrepancy between the distance measured using the contact-type device and that measured using the handheld-type scanner was calculated. The scanning time, processing time, and deviation of the distance between the measuring points were analyzed using two-way analysis of variance and t-test with Bonferroni correction.

RESULTS

The scanning and processing times ranged from 15.2 to 42.2 s and 20.7 to 234.2 s, respectively. Overall, 97% of all measured distances by Spider were within ±1.00% deviation; 79%, Vectra; 73%, Eva; 70%, Bellus; and 42%, SNAP.

CONCLUSIONS

The performance of handheld-type scanners using plaster statues varied among the different scanners. The scanning time of Eva and the processing time of Bellus were significantly shorter than those of other scanners. Furthermore, Spider exhibited the best accuracy, followed by Eva, Vectra, Bellus, and SNAP.

3D Printed Customized Facemask for Maxillary Protraction in the Early Treatment of a Class III Malocclusion: Proof-of-Concept Clinical Case

In order to improve fit and comfort, a maxillary protraction facemask customized to the patient’s anatomy was produced by means of 3D face scanning, digital design and additive manufacturing. An 8-year-old patient in need of early treatment for the Class III malocclusion received a rapid palatal expander and a Petit-type facemask, whose components were digitally designed on a 3D scan of the patient’s face. For face scanning, the iPad Pro 2018 tablet (Apple, Cupertino, CA, USA) with the Bellus3D DentalPro application (Bellus3D, Campbell, CA, USA) was used. Facemask components were modelled with 3D Blender software. The rests were 3D printed in BioMed Clear biocompatible resin (Formlabs, Somerville, MA, USA), and the bar in stainless steel. For greater comfort, the internal surface of the rests was lined with a polymer gel pad (Silipos, Niagara Falls, NY, USA). The manufacturing procedure of the customized facemask is patented. The patient wore the facemask at night for a period of 9 months. The patient’s experience was evaluated with a questionnaire at 1 week, 3, 6, and 10 months of treatment. The customized facemask was well accepted by the patient and obtained the expected treatment outcome. Furthermore, 3D face scanning, 3D modelling and 3D printing allow for the manufacturing of customized facemasks with improved fit and comfort, favoring patient compliance and treatment success.