How reliable is assessment of true vocal cord-arytenoid unit mobility in patients affected by laryngeal cancer? a multi-institutional study on 366 patients from the ARYFIX collaborative group

PURPOSE

In clinical practice the assessment of the "vocal cord-arytenoid unit" (VCAU) mobility is crucial in the staging, prognosis, and choice of treatment of laryngeal squamous cell carcinoma (LSCC). The aim of the present study was to measure repeatability and reliability of clinical assessment of VCAU mobility and radiologic analysis of posterior laryngeal extension.

METHODS

In this multi-institutional retrospective study, patients with LSCC-induced impairment of VCAU mobility who received curative treatment were included; pre-treatment endoscopy and contrast-enhanced imaging were collected and evaluated by raters. According to their evaluations, concordance, number of assigned categories, and inter- and intra-rater agreement were calculated.

RESULTS

Twenty-two otorhinolaryngologists evaluated 366 videolaryngoscopies (total evaluations: 2170) and 6 radiologists evaluated 237 imaging studies (total evaluations: 477). The concordance of clinical rating was excellent in only 22.7% of cases. Overall, inter- and intra-rater agreement was weak. Supraglottic cancers and transoral endoscopy were associated with the lowest inter-observer reliability values. Radiologic inter-rater agreement was low and did not vary with imaging technique. Intra-rater reliability of radiologic evaluation was optimal.

CONCLUSIONS

The current methods to assess VCAU mobility and posterior extension of LSCC are flawed by weak inter-observer agreement and reliability. Radiologic evaluation was characterized by very high intra-rater agreement, but weak inter-observer reliability. The relevance of VCAU mobility assessment in laryngeal oncology should be re-weighted. Patients affected by LSCC requiring imaging should be referred to dedicated radiologists with experience in head and neck oncology.

Computer-aided designed 3D-printed polymeric scaffolds for personalized reconstruction of maxillary and mandibular defects: a proof-of-concept study

PURPOSE

To investigate the potential reconstruction of complex maxillofacial defects using computer-aided design 3D-printed polymeric scaffolds by defining the production process, simulating the surgical procedure, and explore the feasibility and reproducibility of the whole algorithm.

METHODS

This a preclinical study to investigate feasibility, reproducibility and efficacy of the reconstruction algorithm proposed. It encompassed 3 phases: (1) scaffold production (CAD and 3D-printing in polylactic acid); (2) surgical simulation on cadaver heads (navigation-guided osteotomies and scaffold fixation); (3) assessment of reconstruction (bone and occlusal morphological conformance, symmetry, and mechanical stress tests).

RESULTS

Six cadaver heads were dissected. Six types of defects (3 mandibular and 3 maxillary) with different degree of complexity were tested. In all case the reconstruction algorithm could be successfully completed. Bone morphological conformance was optimal while the occlusal one was slightly higher. Mechanical stress tests were good (mean value, 318.6 and 286.4 N for maxillary and mandibular defects, respectively).

CONCLUSIONS

Our reconstructive algorithm was feasible and reproducible in a preclinical setting. Functional and aesthetic outcomes were satisfactory independently of the complexity of the defect.

Prognostic Value of Anteroposterior Extension in Oral Tongue and Floor Squamous Cell Carcinoma

Importance

The tongue and oral floor represent the most involved subsite by oral cancer, and there are no reported systems to classify anteroposterior tumor extension with prognostic effect. In other cancers, the anterior vs posterior tumor extension is a relevant prognostic factor.

Objective

To establish whether anterior vs posterior tumor extension may represent a prognostic factor in oral tongue and floor squamous cell carcinoma (OTFSCC).

Design, Setting, and Participants

This was a retrospective cohort study of patients who underwent surgery for OTFSCC from January 1, 2010, to December 31, 2021, at 2 tertiary-level academic institutions in Italy (University of Padua and University of Brescia). Patients eligible for the study had histologically proven primary OTFSCC; underwent surgery-based, curative treatment; and had available preoperative contrast-enhanced imaging.

Exposures

Four anatomical lines were designed to assess tumor extension: (1) chin-palate line (CPL), (2) chin-basion line, (3) Stensen duct line, and (4) lingual septum line. Preoperative imaging was re-evaluated, and tumor extension was classified as either anterior or posterior according to the lines.

Main Outcomes and Measures

Overall survival and time to recurrence (TTR) were evaluated according to tumor extension. These outcomes were reported as 5-year survival rates with 95% CIs.

Results

Of the 133 patients included, 79 (59.4%) were male, and the mean (SD) age was 62.7 (15.4) years. The 5-year TTR difference was higher for posterior vs anterior OTFSCC classified according to CPL (21.0%; 95% CI, 8.3%-33.7%), Stensen duct line (15.5%; 95% CI, 1.0%-30.0%), and lingual septum line (17.2%; 95% CI, 2.2%-32.3%). Overall survival analysis showed similar results. At the multivariable analysis on TTR, N status (adjusted hazard ratio [HR], 3.0; 95% CI, 1.2-7.1) and anteroposterior classification according to CPL (adjusted HR, 7.1; 95% CI, 0.9-54.6) were the variables associated with the highest adjusted HRs.

Conclusions and Relevance

In this cohort study, OTFSCC with a posterior extension to the CPL was associated with a higher risk of recurrence and death. This analysis suggests that the poor prognosis conveyed by the posterior tumor extension is independent of other relevant prognosticators except for the burden of nodal disease. This estimate is not precise and does not allow for definitive clinically important conclusions; therefore, further prospective studies are necessary to confirm these data.

Treatment of loco-regional recurrence of nasopharyngeal carcinoma in a non-endemic area: oncologic outcomes, morbidity, and proposal of a prognostic nomogram

Introduction

The study assessed outcomes and toxicities of different treatment modalities for local and/or regional recurrent nasopharyngeal carcinoma (NPC) in a non-endemic area.

Methods

Patients treated with curative intent for recurrent NPC with salvage surgery, photon-based radiotherapy, proton therapy (PT), with or without chemotherapy, at different Italian referral centers between 1998 and 2020 were included. Adverse events and complications were classified according to the Common Terminology Criteria for Adverse Events. Characteristics of the patients, tumors, treatments, and complications are presented along with uni- and multivariate analysis of prognostic factors. A survival predictive nomogram is also provided.

Results

A total of 140 patients treated from 1998 to 2020 were retrospectively assessed. Cases with lower age, comorbidity rate, stage, and shorter disease-free interval (DFI) preferentially underwent endoscopic surgery. More advanced cases underwent re-irradiation, fairly distributed between photon-based radiotherapy and PT. Age and DFI were independent factors influencing overall survival. No independent prognostic effect of treatment modality was observed. No significant difference in the morbidity profile of treatments was observed, with 40% of patients experiencing at least one adverse event classified as G3 or higher.

Conclusion

Recurrent NPC in a non-endemic area has dissimilar aspects compared to its endemic counterpart, suggesting the need for further studies that can guide the choice of the best treatment modality.

The Prognostic Role of the Immune Microenvironment in Sinonasal Intestinal-Type Adenocarcinoma: A Computer-Assisted Image Analysis of CD3+ and CD8+ Tumor-Infiltrating Lymphocytes

The prognostic value of conventional histopathological parameters in the sinonasal intestinal-type adenocarcinoma (ITAC) has been debated and novel variables should be investigated. Increasing evidence demonstrated that the evolution of cancer is strongly dependent upon the complex interactions within tumor microenvironment. The aim of this retrospective study was to assess the features of immune microenvironment in terms of CD3⁺ and CD8⁺ cells in a series of ITAC and explore their prognostic role, as well as their relations with clinicopathological variables. A computer-assisted image analysis of CD3⁺ and CD8⁺ tumor-infiltrating lymphocytes (TIL) density was conducted on surgical specimens of 51 patients with ITAC that underwent a curative treatment including surgery. ITAC displays variable TIL density, which is associated with OS. In a univariate model, the density of CD3⁺ TIL was significantly related to OS (p = 0.012), whereas the association with CD8+ TIL density resulted in being non-significant (p = 0.056). Patients with intermediate CD3⁺ TIL density were associated with the best outcome, whereas 5-year OS was the lowest for intermediate CD8⁺ TIL density. CD3⁺ TIL density maintained a significant association with OS in the multivariable analysis. TIL density was not significantly related to demographic and clinicopathological variables. CD3⁺ TIL density was independently associated with OS in a non-linear fashion and patients with intermediate CD3⁺ TIL density had the best outcome. Though based on a preliminary analysis on a relatively small series of patients, this finding makes TIL density a potential independent prognostic factor of ITAC.

Temporal Evolution and Prognostic Role of Indeterminate Response Sub-Groups in Patients with Differentiated Thyroid Cancer after Initial Therapy with Radioiodine

The clinical outcome of patients affected by Differentiated Thyroid Carcinoma (DTC) and an indeterminate response (IR) after initial therapy is not yet clear. IR includes three different sub-groups of patients: (1) IRTg+ group: Detectable thyroglobulin (Tg), regardless of antithyroglobulin antibodies (TgAb) presence or imaging studies; (2) IRTgAb+ group: Positive TgAb, regardless of Tg levels and nonspecific imaging findings; (3) IRImaging+ group: Nonspecific findings on neck ultrasonography or faint uptake in the thyroid bed on the whole-body scan, negative TgAb, and undetectable Tg. The main aim of this retrospective study was to investigate the dynamic evolution and prognostic role of these patients. From January 2010 to December 2017, 2176 patients who received radioiodine for DTC after total thyroidectomy were included. Two-hundred-eighty-eight patients had IR one year after therapy (187 TgAb+, 76 Tg+, 25 imaging+). After two years, 110 patients (38%) were reclassified as an excellent response and 5 (2%) as an incomplete response; after five years, 221 (77%) achieved an excellent response and 11 (4%) showed an incomplete response. One-year stimulated Tg and nodal disease at diagnosis may predict the final status of the disease. Progression-free survival was significantly shorter in IRTg+ than in IRTgAb+ and IRimaging+ groups. Considering Tg+ patients, a threshold of 3.3 ng/mL is best to predict prognosis.

Salvage surgery in recurrent sinonasal cancers: Proposal for a prognostic model based on clinicopathologic and treatment-related parameters

BACKGROUND

Evidence on survival and major prognosticators after salvage surgery in recurrent sinonasal cancers (SNC) is limited.

METHODS

A retrospective, single-center study of recurrent SNC treated with salvage surgery between 1997 and 2019 was conducted. Univariate and multivariable analyses were performed to define a prognostic score for overall survival (OS).

RESULTS

One hundred and eighteen patients were included. Recurrent SNC originated mostly in the naso-ethmoidal box (67.8%) and were mainly epithelial (76.2%), high-grade (49.2%), and locally advanced (rpT4, 60.1%) malignancies. Negative margins were achieved in 56.6% of cases. Two- and 5-year OS were 71.7% and 56%, respectively. The prognostic model included treatment modality for primary tumor, histology, rpT class, margin status, perineural invasion, and adjuvant radiotherapy and stratified patients into three prognostic groups (5-year OS: 84.4%, 44.9%, and 0%, respectively).

CONCLUSIONS

Treatment of recurrent SNC can result in good long-term survival estimates with limited morbidity. Our score can provide excellent prognostic stratification.

Tumor-stroma ratio, neoangiogenesis and prognosis in laryngeal carcinoma. A pilot study on preoperative biopsies and matched surgical specimens

OBJECTIVES

The interaction between tumor cells and stroma is critical in tumorigenesis, tumor neo-angiogenesis and cancer progression. The aims of this study were to: (i) evaluate the concordance between tumor-stroma ratio (TSR) and microvascular density (MVD) on paired biopsy and surgical specimens of laryngeal carcinoma (LSCC); (ii) investigate the association of TSR with angiogenesis (CD105- and CD31-assessed MVD); (iii) assess the prognostic role of TSR and MVD evaluated on preoperative biopsies and paired surgical specimens.

METHODS

TSR, CD105- and CD31-assessed MVD were analyzed in paired biopsies and surgical specimens of 43 consecutive cases.

RESULTS

TSR showed good agreement between biopsies and surgical specimens (AC1 statistic: 0.7957). In biopsies, TSR low/stroma-rich cases showed higher CD105-assessed MVD (p = 0.0380). In surgical specimens both median CD105- and CD31-assessed MVD were significantly higher in TSR low/stroma-rich than in TSR high/stroma-poor patients (p = 0.0089 and p = 0.0391). In the univariate Cox's model, TSR predicted disease-free survival (DFS) in both biopsies and surgical specimens (p = 0.0003 and p = 0.0002). DFS was associated with CD105- and CD31-assessed MVD in biopsies (p < 0.0001 for both) and surgical specimens (p < 0.0001 for both). Considering biopsies, the multivariate analysis found both TSR (p = 0.0032; HR = 6.112, 95%CI: 1.833-20.378) and CD105-assessed MVD (p = 0.0002; HR = 1.201, 95%CI: 1.090-1.322) as DFS predictor. In paired surgical specimens, both TSR (p = 0.0074; HR = 6.137, 95%CI: 1.626-23.172) and CD105-assessed MVD (p = 0.0005; HR = 1.172 95 %CI 1.071-1.282) retained their significance in multivariate analysis.

CONCLUSIONS

If confirmed by large prospective studies, TSR and MVD could be proposed as prognostic biomarkers of LSCC for a possible treatment intensification or targeted therapy.

Does Reorganization of Clinicopathological Information Improve Prognostic Stratification and Prediction of Chemoradiosensitivity in Sinonasal Carcinomas? A Retrospective Study on 145 Patients

Background

The classification of sinonasal carcinomas (SNCs) is a conundrum. Consequently, prognosis and prediction of response to non-surgical treatment are often unreliable. The availability of prognostic and predictive measures is an unmet need, and the first logical source of information to be investigated is represented by the clinicopathological features of the disease. The hypothesis of the study was that clinicopathological information on SNC could be exploited to better predict prognosis and chemoradiosensitivity.

Methods

All patients affected by SNC who received curative treatment, including surgery, at the Unit of Otorhinolaryngology—Head and Neck Surgery of the University of Brescia between October 1998 and February 2019 were included in the analysis. The institutional series was reviewed and a survival analysis was performed. Machine learning and multivariable statistical methods were employed to develop, analyze, and test 3 experimental classifications (classification #1, based on cytomorphological, histomorphological, and differentiation information; classification #2, based on differentiation information; and classification #3, based on locoregional extension) of SNC, based on the inherent clinicopathological information. The association of experimental classifications with prognosis and chemoradiosensitivity was tested.

Results

The study included 145 patients. From a prognostic standpoint, the machine learning-generated classification of SNC provided better prediction than the current World Health Organization classification. However, the prediction of the chemoradiosensitivity of SNC was not achievable.

Conclusions

Reorganization of clinicopathological information, with special reference to those related to tumor differentiation, can improve the reliability of prognosis of SNC. Prediction of chemoradiosensitivity remains an unmet need and further research is required.

The MUSES∗: a prognostic study on 1360 patients with sinonasal cancer undergoing endoscopic surgery-based treatment: ∗MUlti-institutional collaborative Study on Endoscopically treated Sinonasal cancers

BACKGROUND

Over the last 2 decades, transnasal endoscopic surgery (TES) has become the most frequently employed surgical technique to treat sinonasal malignancies. The rarity and heterogeneity of sinonasal cancers have hampered large non-population-based analyses.

METHODOLOGY

All patients receiving TES-including treatment between 1995 and 2021 in 5 referral hospitals were included. A prognostic study was performed, and multivariable models were transformed into nomograms. Training and validation sets were based on results from 3 European and 2 non-European centres, respectively.

RESULTS

The training and validation set included 940 and 420 patients, respectively. The mean age at surgery, primary-versus-recurrent presentation, histology distribution, type of surgery, T category and type of adjuvant treatment were differently distributed in the training and validation set. In the training set, 5-year overall survival and recurrence-free survival with a 95%-confidence interval were 72.7% (69.5-76.0%) and 66.4% (63.1-69.8%), respectively, significantly varying with histology. At multivariable analyses, age, gender, previous treatment, the extent of resection on the cranial, lateral and posterolateral axes, grade/subtype, T category, nodal status, margin status and adjuvant treatment were all associated with different prognostic outcomes, displaying a heterogeneous significance and effect size according to histology. The internal and external validation of nomograms was satisfactory (optimism-corrected C-index >0.7 and cumulative area under curve >0.7) for all histologies but mucosal melanoma.

CONCLUSIONS

Outcomes of TES-based treatment of sinonasal cancers vary substantially with histology. This large, non-population-based study provides benchmark data on the prognosis of sinonasal cancers that are deemed suitable for treatment including TES.

Resection of the internal carotid artery in selected patients affected by cancer of the skull base

Invasion of the internal carotid artery (ICA) has been historically considered a criterion of non-resectability of skull base cancer (SBC). Patients affected by SBC who underwent surgery including resection of ICA at two tertiary institutions were included. Demographics, oncologic, and surgical information, complications, and survival outcomes were retrospectively reviewed. Survival outcomes were calculated. Ten patients were included. Three surgical approaches (transnasal endoscopic, transorbital, and transpetrosal) were employed to resect the invaded/abutted tract(s) of the ICA. All patients underwent ICA temporary balloon occlusion test. In two patients, an extracranial-to-intracranial arterial bypass was harvested. Major neuromorbidity was observed in two patients. Perioperative mortality of the series was 10.0%. Mean overall survival was 27.2 months, with 2-year overall and progression-free survival rate of 88.9%. ICA resection is feasible as part of the ablation performed for very advanced SBCs. Survival outcomes are acceptable in adequately selected patients.

Development of a cadaveric head and neck cancer model and three-dimensional analysis of margins in surgical navigation-aided ablations

INTRODUCTION

The adequacy of the surgical resection is the main controllable variable that is in the hands of the surgical team. There exists an unmet need to increase the rate of negative margins, particularly in cancers invading the craniofacial area. The study aimed 1) at developing a gross tumor model to be utilized for research, educational, and training purposes and 2) establishing the 3-dimensional relationship between the outer surface of the surgical specimen and tumor surface and test the effect of guiding ablations on cadavers with surgical navigation (SN).

MATERIAL AND METHODS

Seven cadaver heads were employed to create 24 craniofacial tumor models. Simulation of tumor resections was performed by 8 surgeons. Fourteen and 10 resections were performed with and without SN-guidance, respectively. Gross specimens underwent computed tomography and 3-dimensional analysis through dedicated software. Task load was assessed through a validated questionnaire. Tumor model reliability was studied based on visual analogue scale rate by surgeons and radiologists.

RESULTS

SN reduced the rate of margin involvement, particularly by decreasing the percentage of the gross specimen outer surface involvement in areas uncovered by normal bony structures. The workload of SN-aided ablations was found to be medium-to-somewhat-high. Tumor model reliability was deemed satisfactory except for the extension to bony structures.

CONCLUSIONS

A gross tumor model for head and neck cancers involving the craniofacial area was developed and resulted satisfactorily reliable from both a surgical and radiologic standpoint. SN reduced the rate of margin involvement, particularly by improving delineation of bone-uncovered areas.

Navigation-Guided Transnasal Endoscopic Delineation of the Posterior Margin for Maxillary Sinus Cancers: A Preclinical Study

Background

The resection of advanced maxillary sinus cancers can be challenging due to the anatomical proximity to surrounding critical anatomical structures. Transnasal endoscopy can effectively aid the delineation of the posterior margin of resection. Implementation with 3D-rendered surgical navigation with virtual endoscopy (3D-SNVE) may represent a step forward. This study aimed to demonstrate and quantify the benefits of this technology.

Material and Method

Four maxillary tumor models with critical posterior extension were created in four artificial skulls (Sawbones^®). Images were acquired with cone-beam computed tomography and the tumor and carotid were contoured. Eight head and neck surgeons were recruited for the simulations. Surgeons delineated the posterior margin of resection through a transnasal approach and avoided the carotid while establishing an adequate resection margin with respect to tumor extirpation. Three simulations were performed: 1) unguided: based on a pre-simulation study of cross-sectional imaging; 2) tumor-guided: guided by real-time tool tracking with 3D tumor and carotid rendering; 3) carotid-guided: tumor-guided with a 2-mm alert cloud surrounding the carotid. Distances of the planes from the carotid and tumor were classified as follows and the points of the plane were classified accordingly: “red”: through the carotid artery; “orange”: <2 mm from the carotid; “yellow”: >2 mm from the carotid and within the tumor or <5 mm from the tumor; “green”: >2 mm from the carotid and 5–10 mm from the tumor; and “blue”: >2 mm from the carotid and >10 mm from the tumor. The three techniques (unguided, tumor-guided, and carotid-guided) were compared.

Results

3D-SNVE for the transnasal delineation of the posterior margin in maxillary tumor models significantly improved the rate of margin-negative clearance around the tumor and reduced damage to the carotid artery. “Green” cuts occurred in 52.4% in the unguided setting versus 62.1% and 64.9% in the tumor- and carotid-guided settings, respectively (p < 0.0001). “Red” cuts occurred 6.7% of the time in the unguided setting versus 0.9% and 1.0% in the tumor- and carotid-guided settings, respectively (p < 0.0001).

Conclusions

This preclinical study has demonstrated that 3D-SNVE provides a substantial improvement of the posterior margin delineation in terms of safety and oncological adequacy. Translation into the clinical setting, with a meticulous assessment of the oncological outcomes, will be the proposed next step.

Augmented Reality and Intraoperative Navigation in Sinonasal Malignancies: A Preclinical Study

Objective

To report the first use of a novel projected augmented reality (AR) system in open sinonasal tumor resections in preclinical models and to compare the AR approach with an advanced intraoperative navigation (IN) system.

Methods

Four tumor models were created. Five head and neck surgeons participated in the study performing virtual osteotomies. Unguided, AR, IN, and AR + IN simulations were performed. Statistical comparisons between approaches were obtained. Intratumoral cut rate was the main outcome. The groups were also compared in terms of percentage of intratumoral, close, adequate, and excessive distances from the tumor. Information on a wearable gaze tracker headset and NASA Task Load Index questionnaire results were analyzed as well.

Results

A total of 335 cuts were simulated. Intratumoral cuts were observed in 20.7%, 9.4%, 1.2,% and 0% of the unguided, AR, IN, and AR + IN simulations, respectively (p < 0.0001). The AR was superior than the unguided approach in univariate and multivariate models. The percentage of time looking at the screen during the procedures was 55.5% for the unguided approaches and 0%, 78.5%, and 61.8% in AR, IN, and AR + IN, respectively (p < 0.001). The combined approach significantly reduced the screen time compared with the IN procedure alone.

Conclusion

We reported the use of a novel AR system for oncological resections in open sinonasal approaches, with improved margin delineation compared with unguided techniques. AR improved the gaze-toggling drawback of IN. Further refinements of the AR system are needed before translating our experience to clinical practice.

Hybrid Robotics for Endoscopic Transnasal Skull Base Surgery: Single-Centre Case Series

BACKGROUND

Only preclinical studies and case reports have described robotic surgery for endoscopic transnasal skull base surgery.

OBJECTIVE

To evaluate the role of a novel robotic endoscope holder, developed for transsphenoidal surgery.

METHODS

Patients were prospectively enrolled for 3 mo at the Neurosurgery Unit of Brescia. Endoscope Robot® was used to assist during the sphenoidal phase of the approach, tumor removal, and skull base reconstruction. A Likert scale questionnaire was given to all surgeons after each procedure. Patients who underwent robotic-assisted surgery were matched with nonrobotic ones for pathology and type of procedure. All surgical videos were evaluated during bimanual phases.

RESULTS

Twenty-one patients underwent robot-assisted, endoscopic transsphenoidal surgery for different pathologies (16 pituitary adenomas, 3 chordomas, 1 craniopharyngioma, 1 pituitary exploration for Cushing disease) for a total of 23 procedures (1 patient underwent 2 endoscopic revisions of a skull base reconstruction). Subjective advantages reported by surgeons included smoothness of movement, image steadiness, and improvement of maneuvers in narrow spaces and with angled endoscopes; as the main limitation, Endoscope Robot® appeared to be relatively heavy during the initial endoscope positioning. A comparative analysis with a historical matched cohort documented similar clinical outcomes, while endoscope lens cleaning and position readjustments were significantly less frequent in robotic procedures.

CONCLUSION

Although confirmation in larger studies is needed, Endoscope Robot® was a safe and effective tool, especially advantageous in lengthy interventions through deep and narrow corridors.

Additive Manufacturing for Personalized Skull Base Reconstruction in Endoscopic Transclival Surgery: A Proof-of-Concept Study

BACKGROUND

Endoscopic transnasal transclival intradural surgery is limited by a high postoperative cerebrospinal fluid leak rate. The aim of this study was to investigate the role of three-dimensional printing to create a personalized, rigid scaffold for clival reconstruction.

METHODS

Two different types of clivectomy were performed in 5 specimens with the aid of neuronavigation, and 11 clival reconstructions were simulated. They were repaired with polylactide, three-dimensional-printed scaffolds that were manually designed in a computer-aided environment based either on the real or on the predicted defect. Scaffolds were printed with a fused filament fabrication technique and different offsets. They were positioned and fixed either following the gasket seal technique or with screws. Postdissection radiological evaluation of scaffold position was performed in all cases. In 3 specimens, the cerebrospinal fluid leak pressure point was measured immediately after reconstruction.

RESULTS

The production process took approximately 30 hours. The designed scaffolds were satisfactory when no offset was added. Wings were added during the design to allow for screw positioning, but broke in 30% of cases. Radiological assessment documented maximal accuracy of scaffold positioning when the scaffold was created on the real defect; accuracy was satisfactory when the predicted clivectomy was performed under neuronavigation guidance. The cerebrospinal fluid leak pressure point was significantly higher when the scaffold was fixed with screws compared with the gasket technique.

CONCLUSIONS

In this preclinical setting, additive manufacturing allows the creation of customized scaffolds that are effective in reconstructing even large and geometrically complex clival defects.

When is a multidisciplinary surgical approach required in sinonasal tumours with cranial involvement?

The term “sinonasal tumours” includes a large spectrum of diseases, which are characterized by heterogeneous biological behavior and prognosis, and located in a critical anatomic area. Diagnosis and treatment of sinonasal tumours require the contribution of different disciplines. A narrative review was performed to highlight the role of surgeons in contributing to a multidisciplinary approach to sinonasal tumours. Diagnosis and staging of sinonasal tumours is challenging and requires collaboration between surgeons, radiologists, and pathologists. The identification and management of critical extensions (orbital or intracranial encroachment, vascular abutment or encasement) is fundamental for successful treatment. Most cases of advanced sinonasal tumours can undergo surgical intervention by an adequately trained otorhinolaryngological team. The contribution of neurosurgeons and oculoplastic surgeons is required in selected scenarios. In rare circumstances, multidisciplinary reconstructive strategies can be indicated for complex tissue defects. Furthermore, a multidisciplinary approach is pivotal in the management of perioperative complications. While surgery remains the mainstay of treatment, the role of non-surgical adjuvant or even exclusive treatments is constantly expanding.

Objective evaluation of orbito-zygomatic reconstruction with scapular tip free flaps to restore facial projection and orbital volume

BACKGROUND

Restoring anatomical contour and position of the malar eminence and orbital rim following ablative mid-face procedures is critical in maintaining facial contour and orbit position.

OBJECTIVE

To report our reconstructive approach using the scapular tip free-flap (STFF) for orbito-zygomatic defects, evaluating contour and overall shape restoration.

METHODS

The study included 2 series: a clinical cohort of 15 consecutive patients who underwent an orbito-zygomatic reconstruction with a STFF and a cohort of 10 patients who had CT scan imaging but did not have orbito-zygomatic surgical resection or reconstruction. Using a 3D software, overall conformance (OC) and contour conformance (CC) with respect to the mirrored contralateral (clinical cohort) or native zygoma (preclinical cohort) were analyzed. Postoperative orbital volumes were also measured in the clinical cohort. Mean, median, root-mean-square (RMS), minimum and maximum measurements were obtained both for OC and CC. Conformance values of clinical and preclinical cohort were compared to objectively evaluate the quality of reconstruction in terms of orbito-zygomatic framework restoration (Mann-Whitney test).

RESULTS

All measurements for OC and CC between scapular tip and the zygoma showed no differences, both on the clinical (RMS: OC 3.29 mm vs CC 3.32 mm -p = NS-) and preclinical (RMS: OC 2.03 mm and CC 2.31 mm -p = NS-) cohorts. Moreover, there were no differences in post-operative orbital volumes in the clinical cohort. Clinical outcomes of the case-series are also reported.

CONCLUSION

The STFF is highly effective in restoring facial projection and orbital volume in orbito-zygomatic reconstruction.

Validation of the European Laryngological Society classification of glottic vascular changes as seen by narrow band imaging in the optical biopsy setting

Purpose

In 2016, the European Laryngological Society (ELS) proposed a classification for vascular changes occurring in glottic lesions as visible by narrow band imaging (NBI), based on the dichotomic distinction between longitudinal vessels (not suspicious) and perpendicular ones (suspicious). The aim of our study was to validate this classification assessing the interobserver agreement and diagnostic test performance in detecting the final histopathology.

Methods

A retrospective study was carried out by reviewing clinical charts, preoperative videos, and final pathologic diagnosis of patients submitted to transoral microsurgery for laryngeal lesions in two Italian referral centers. In each institution, two physicians, independently re-assessed each case applying the ELS classification.

Results

The cohort was composed of 707 patients. The pathologic report showed benign lesions in 208 (29.5%) cases, papillomatosis in 34 (4.8%), squamous intraepithelial neoplasia (SIN) up to carcinoma in situ in 200 (28.2%), and squamous cell carcinoma (SCC) in 265 (37.5%). The interobserver agreement was extremely high in both institutions (k = 0.954, p < 0.001 and k = 0.880, p < 0.001). Considering the diagnostic performance for identification of at least SIN or SCC, the sensitivity was 0.804 and 0.902, the specificity 0.793 and 0.581, the positive predictive value 0.882 and 0.564, and the negative predictive value 0.678 and 0.908, respectively.

Conclusion

The ELS classification for NBI vascular changes of glottic lesions is a highly reliable tool whose systematic use allows a better diagnostic evaluation of suspicious laryngeal lesions, reliably distinguishing benign ones from those with a diagnosis of papillomatosis, SIN or SCC, thus paving the way towards confirmation of the optical biopsy concept.

Sinonasal cancer encroaching the orbit: Ablation or preservation?

BACKGROUND

Encroachment on the orbital cavity represents a challenge in the management of sinonasal cancer. Criteria guiding orbital preservation lack univocal consensus. Stage of orbital involvement is best assessed through magnetic resonance imaging (MRI).

METHODS

Patients affected by orbit-encroaching sinonasal cancer with available preoperative MRI, receiving surgery-based treatment at the University of Brescia between May 2005 and October 2018 were included. All cases were reviewed by expert radiologists and pathologists. Diagnostic performance of MRI was calculated using pathological information as reference. Survival analysis was performed.

RESULTS

The study included 123 patients. The orbit was abutted in 53 (43.1%) patients, whereas orbital invasion reached the periorbit in 18 (14.6%), extraconal fat and/or medial lacrimal sac in 29 (23.6%), extrinsic ocular muscles in 7 (5.7%), intraconal compartment in 4 (3.3%), and orbital apex in 12 (9.8%). Seventy-six (61.8%) patients received orbit-sparing surgery, 47 (38.2%) underwent orbital ablation (OA). Accuracy of MRI in detecting involvement by cancer was ≥80.0% for the orbital wall, extraconal fat, and muscles, and <80.0% for the periorbit and intraconal compartment. Previous surgery, neoadjuvant chemotherapy, and perineural invasion decreased MRI accuracy. Age, histology, tumor grade, pT category, N status, perineural invasion, orbital invasion stage, and need for OA were found to affect prognosis. Five-year orbital dysfunction-free survival was 92.8%.

CONCLUSION

Conservative management of sinonasal cancers encroaching the orbit is feasible. MRI is essential to preoperatively stage orbital invasion, yet with some limitation. Given the dismal prognosis despite aggressive surgery, neoadjuvant non-surgical therapies should be considered in patients requiring OA.

A new landmark for lingual artery identification during transoral surgery: Anatomic-radiologic study

BACKGROUND

A landmark for the identification of the lingual artery (LA) through a transoral perspective can provide surgeons with an easy method to prevent and manage intraoperative bleeding during transoral approach to the base of tongue (BOT).

METHODS

Thirteen tongue and five head and neck specimens were dissected to identify and assess the reliability of the lingual point (LP) as a new landmark for the LA at BOT. The pathway of 42 LAs was radiologically evaluated; axial depth and vertical offset were measured for each LA.

RESULTS

Dissection study: a description of LP is provided; the LA was easily identified in all specimens (36/36 sides) using LP as a landmark. Radiologic study: the mean depth of the LA was 4.2 mm, the mean vertical offset was 1.3 mm.

CONCLUSIONS

LP is a simple and reliable landmark for identification of the LA, potentially helping surgeons to prevent and manage intraoperative bleeding.

Differentiated Thyroid Cancer: The Role of ATA Nodal Risk Factors in N1b Patients

OBJECTIVES/HYPOTHESIS

Nodal involvement is frequent in patients with differentiated thyroid cancers (DTCs), but its prognostic relevance is not univocal. Some characteristics of nodal metastases can increase the risk of recurrence. We attempted to quantify the impact on survival of nodal factors included in the American Thyroid Association (ATA) risk stratification system in N1b patients with DTC.

STUDY DESIGN

Retrospective study.

METHODS

A retrospective analysis of patients affected by DTC who underwent therapeutic lateral neck dissection (ND) was performed. The impact on the prognosis of the number of positive lymph nodes (LNs), dimension of nodal metastasis, and microscopic and macroscopic extranodal extension (miENE and maENE, respectively) was investigated.

RESULTS

The study included 347 N1b patients who underwent 401 therapeutic lateral NDs. Mean number of positive LNs was nine, mean nodal ratio was 0.27, and mean diameter of metastasis was 15.5 mm. ENE was detected in 25.9% of patients (22.5% miENE and 3.5% maENE). In univariate analysis, the presence of maENE had an impact on disease specific survival (DSS) (P = .023); increasing number of positive LNs affected DSS and locoregional control (LRC) (P = .009 and =.006, respectively); increasing metastatic node dimension was a risk factors for overall survival, DSS, and metastases free survival (MFS) (P = .05, =.013 and =.016). In multivariate analysis, number of positive LNs and LN dimension were independent risk factors for LRC and MFS, respectively (HR 1.1, P = .028; HR 1.1, P = .026).

CONCLUSIONS

In our analysis on a cohort of N1b patients, the number of positive LNs and LN dimension were confirmed as independent risk factors for locoregional and distant recurrence, respectively.

LEVEL OF EVIDENCE

4 Laryngoscope, 131:E1029-E1034, 2021.

Selection of the surgical approach for lesions with parapharyngeal space involvement: A single-center experience on 153 cases

BACKGROUND

The parapharyngeal space (PPS) can harbor a variety of tumors that can be approached through a wide spectrum of surgical routes. A decisional algorithm on the surgical approach to resect PPS lesions was tested in terms of reliability by retrospectively applying it to a large series of patients.

METHODS

Patients treated at the Unit of Otorhinolaryngology - Head and Neck Surgery of the University of Brescia, Italy, for tumor or tumor-like lesions involving the PPS between October 1986 and July 2019 were included in the retrospective analysis. Tumor characteristics, clinical presentation, diagnostic work-up, type of resection, surgical approach, and oncologic and morbidity outcomes were reviewed. Reliability of the algorithm was calculated as the number of cases in which the expected approach was confirmed/total number of cases × 100.

RESULTS

The analysis included 153 patients. Most lesions (64.1%) were benign. The most frequent complaint at presentation was unilateral oropharyngeal medialization (47.1%), followed by neck/parotid swelling (41.2%). Ninety-two (61.3%) lesions were excised through an enucleation/extracapsular dissection. Wide-margin resection and compartmental resection were performed in 17 (11.3%) and 41 (27.3%) patients, respectively. A single-corridor approach was employed in 132 (87.4%) cases. Combinations of multiple corridors were adopted in 19 (12.6%) patients. Reliability of the decision-making algorithm was 91.2%. Capsular integrity and margin status affected prognosis of pleomorphic adenomas and PPS malignancies, respectively.

CONCLUSION

The proposed decision-making algorithm can reliably guide approach selection, which should primarily aim at ensuring intact-capsule excision of benign lesions suspicious for pleomorphic adenomas and clear-margins resection of PPS malignancies.

Olfactory and Gustatory Outcomes in COVID-19: A Prospective Evaluation in Nonhospitalized Subjects

OBJECTIVE

To prospectively assess the rate and timing of recovery of olfactory (OD) and gustatory (GD) dysfunction in patients affected by COVID-19.

STUDY DESIGN

Cohort study.

SETTING

Population-based evaluation in a COVID-19 high-prevalence region.

SUBJECTS AND METHODS

We analyzed the clinical course of OD and GD in a cohort of home-quarantined SARS-CoV-2-positive patients from Northern Italy. Physicians administered a survey-based questionnaire at recruitment (T0). During follow-up, patients responded to online dedicated surveys modulated according to symptoms at T0.

RESULTS

A total of 151 patients completed the follow-up survey. OD and/or GD were observed in 83% and 89% of subjects, respectively. Resolution rates of OD and GD at 30 days from onset were 87% and 82%, respectively. Risk factors for late resolution were grade of dysfunction at onset (total vs partial), gender, and presence of nasal congestion. Three (2%) patients previously reporting complete resolution of symptoms complained of subsequent recurrence of OD and/or GD after a mean of 19 days from resolution of the previous episode.

CONCLUSION

COVID-19-related OD and GD had high rate of resolution in the first month from onset of symptoms. However, in 10% to 15% of patients, these symptoms showed only partial improvement after this period.

Smell and taste alterations in COVID-19: a cross-sectional analysis of different cohorts

BACKGROUND

Olfactory (OD) and gustatory (GD) dysfunction have been proven to be a typical symptom of severe acute respiratory syndrome-coronavirus-2 (SARS-CoV-2) infection. However, their prevalence in different patient populations still needs to be clarified.

METHODS

A cross-sectional study was performed from March 27 to April 1, 2020, in Northern Italy. Physicians administered a survey-based questionnaire to SARS-CoV-2-positive patients with the aim of assessing symptoms, focusing on OD and GD. Two groups were studied: group A, patients hospitalized at Azianda Socio Sanitaria Territoriale (ASST) Spedali Civili University Hospital of Brescia; and group B, home-quarantined subjects.

RESULTS

A total of 508 patients were enrolled: 295 in group A and 213 in group B. Mean age ± standard deviation (SD) was 55 ± 15 years; 56% were men. Overall, OD and GD were present in 56% (95% confidence interval [CI], 51% to 60%) and 63% (95% CI, 59% to 67%) of cases, respectively. In group A, the prevalence of OD and GD was 44% (95% CI, 38% to 50%) and 52% (95% CI, 46% to 58%), respectively. In group B, the prevalence of OD and GD was 72% (95% CI, 65% to 79%) and 79% (95% CI, 73% to 84%), respectively. In the entire cohort, total loss of olfaction and taste was reported in 64% and 60% of cases, respectively. OD and GD occurred as the first symptom in 10% and 11% of cases, respectively; in the remaining cases, they occurred after a mean of 4 ± 3 days following the first symptom. At the time of the questionnaire, complete resolution of OD and GD was reported in 52% and 55% of cases, respectively (mean duration, 9 ± 5 days in both).

CONCLUSION

OD and GD are more prevalent in home-quarantined subjects, and they are independently associated with younger age and female gender.

Navigation-guided osteotomies improve margin delineation in tumors involving the sinonasal area: A preclinical study

OBJECTIVES

To demonstrate and quantify, in a preclinical setting, the benefit of three-dimensional (3D) navigation guidance for margin delineation during ablative open surgery for advanced sinonasal cancer.

MATERIALS AND METHODS

Seven tumor models were created. 3D images were acquired with cone beam computed tomography, and 3D tumor segmentations were contoured. Eight surgeons with variable experience were recruited for the simulation of osteotomies. Three simulations were performed: 1) Unguided, 2) Guided using real-time tool tracking with 3D tumor segmentation (tumor-guided), and 3) Guided by 3D visualization of both the tumor and 1-cm margin segmentations (margin-guided). Analysis of cutting planes was performed and distance from the tumor surface was classified as follows: "intratumoral" when 0 mm or negative, "close" when greater than 0 mm and less than or equal to 5 mm, "adequate" when greater than 5 mm and less than or equal to 15 mm, and "excessive" over 15 mm. The three techniques (unguided, tumor-guided, margin-guided) were statistically compared.

RESULTS

The use of 3D navigation for margin delineation significantly improved control of margins: unguided cuts had 18.1% intratumoral cuts compared to 0% intratumoral cuts with 3D navigation (p < 0.0001).

CONCLUSION

This preclinical study has demonstrated the significant benefit of navigation-guided osteotomies for sinonasal tumors. Translation into the clinical setting - with rigorous assessment of oncological outcomes - would be the proposed next step.

LATERAL NECK DISSECTION FOR AGGRESSIVE VARIANTS OF WELL-DIFFERENTIATED THYROID CANCER

Objective: Well-differentiated thyroid cancer (WDTC) is characterized by favorable disease course and excellent survival. However, some histologic subtypes, known as aggressive histologic variants (AHVs), present a more aggressive behavior than conventional WDTC. The aim of this study was to evaluate the pattern of nodal involvement and factors influencing prognosis in N1b patients with AHVs. Methods: A multicentric retrospective analysis of patients who underwent therapeutic lateral neck dissection (ND) for WDTC between 1994 and 2015 was accomplished. AHVs included the following subtypes: tall cell, Hürtle cell, diffuse sclerosing, and poorly differentiated papillary thyroid cancer. Results: The study included a total of 352 N1b patients, 40 (11.4%) of whom had AHVs. AHVs present a similar distribution of positive nodes if compared with conventional WDTC. In AHV patients, 5-year overall survival (OS), disease-specific survival (DSS), locoregional control, and metastasis-free survival were 82.2%, 93.6%, 80.3%, and 87.3%, respectively. Advanced age (>55 years) was the only significant factor affecting survival (OS, P<.001; DSS, P = .011) in this group. In the AHV group, there were 9 (22.5%) recurrences; patients with regional recurrence and without distant metastases were effectively treated by surgery. Conclusion: The distribution of positive lymph nodes in case of AHVs is similar to that of conventional WDTC, with only level V at a relatively greater risk of harboring metastases in the former group. Survival outcomes in N1b patients with AHVs remain optimal. Total thyroidectomy, ND, and adjuvant radioiodine administration have been demonstrated to be effective treatments in the setting of AHVs. Abbreviations: AHV = aggressive histologic variant; DOD = died of disease; DSS = disease-specific survival; DSV = diffuse sclerosing variant; ETE = extrathyroidal extension; HCC = Hürthle cell carcinoma; LRC = locoregional control; LVI = lymphovascular invasion; MFS = metastasis-free survival; ND = neck dissection; NED = no evidence of disease; OS = overall survival; PDA = poorly differentiated areas; PTC = papillary thyroid carcinoma; RAI = radioiodine therapy; TCV = tall cell variant; WDTC = well-differentiated thyroid cancer.

Open Partial Horizontal Laryngectomies for T3⁻T4 Laryngeal Cancer: Prognostic Impact of Anterior vs. Posterior Laryngeal Compartmentalization

Open partial horizontal laryngectomies (OPHLs) are well-established and oncologically safe procedures for intermediate–advanced laryngeal cancers (LC). T–N categories are well-known prognosticators: herein we tested if “anterior” vs. “posterior” tumor location (as defined in respect to the paraglottic space divided according to a plane passing through the arytenoid vocal process, perpendicular to the ipsilateral thyroid lamina) may represent an additional prognostic factor. We analyzed a retrospective cohort of 85 T3–4a glottic LCs, treated by Type II or III OPHL (according to the European Laryngological Society classification) from 2005 to 2017 at two academic institutions. Five-year overall survival (OS), disease-specific survivals (DSS), and recurrence-free survivals (RFS) were compared according to tumor location and pT category. Anterior and posterior tumors were 43.5% and 56.5%, respectively, 78.8% of lesions were T3 and 21.2% were T4a. Five-year OS, DSS, and RFS for T3 were 74.1%, 80.5%, and 63.4%, respectively, and for T4a 71.8%, 71.8%, and 43%, respectively (p not significant). In relation to tumor location, the survival outcomes were 91%, 94.1%, and 72.6%, respectively, for anterior tumors, and 60.3%, 66.3%, and 49.1%, respectively, for posterior lesions (statistically significant differences). These data provide evidence that laryngeal compartmentalization is a valid prognosticator, even more powerful than the pT category.

Side-Door Temporoparietal Fascia Flap: A Novel Strategy for Anterior Skull Base Reconstruction

BACKGROUND

The armamentarium for anterior skull base (ASB) reconstruction includes a variegate spectrum of grafts, endonasal pedicled flaps, regional pedicled flaps, and free flaps, which are selected to face specific scenarios. The use of a vascularized flap in case of large ABS defects ensures an adequate blood supply. The aim of this study was to evaluate the possible role of temporoparietal fascia flap (TPFF) in ASB reconstruction.

METHODS

Eight fresh-frozen head specimens were dissected to evaluate the adequacy of TPFF and pericranial flap (PF) for the reconstruction of ASB defects. The percentage of coverage of the ASB was calculated for TPFF and PF. An anatomic-radiologic analysis was performed to provide useful practical information for flap harvesting and positioning.

RESULTS

The TPFF was easily transposed to the ABS defect through an epidural corridor; the edges of the TPFF were successfully placed in the intradural space, in the epidural space, or on the extracranial surface of the ABS defect. The PF was particularly adequate for median defects, and the TPFF was shown to be useful also in cases with paramedian-supraorbital extension. The median percentage of coverage of the ASB was significantly higher for TPFF (85.1%) than PF (65.7%) (P = 0.018).

CONCLUSIONS

The supraorbital epidural corridor is a possible novel pathway for transposition of the TPFF for ASB reconstruction. Side-door TPFF was shown to be an ideal choice for large ASB defect with lateral supraorbital extension and could be useful in the scenario of salvage reconstruction for recurrent ABS cerebrospinal fluid leak.

Three-Dimensional Map of Isoprognostic Zones in Glottic Cancer Treated by Transoral Laser Microsurgery as a Unimodal Treatment Strategy

Introduction

The Union for International Cancer Control–American Joint Committee on Cancer TNM staging system for glottic squamous cell carcinoma (SCC) includes different types of lesions defined by the involvement of specific subsites in each T category. Our study aims to identify different subcategories according to tumor local extension and determine oncologic outcomes after treatment by transoral laser microsurgery (TLM) alone.

Methods

We retrospectively evaluated 410 patients affected by previously untreated pT1-pT3 glottic SCC treated by TLM alone from January 2005 to December 2015 at the Departments of Otorhinolaryngology—Head and Neck Surgery, Universities of Genoa and Brescia, Italy. All patients had at least 2 years of follow-up. Clinical, radiological, surgical, and histopathological data were reviewed and tumors divided into six subcategories: I, pT1a not involving the anterior commissure (AC); II, pT1b involving the AC; III, pT2 extending superficially to the supraglottis or the subglottis; IV, pT2 infiltrating the vocal muscle; V, pT3 involving the anterior paraglottic space; VI, pT2 or pT3 with vertical extension across the AC with/without involvement of the pre-epiglottic space. Recurrence-free survival (RFS), local control with laser alone (LCL), and organ preservation (OP) were defined as the primary oncologic outcomes.

Results

The 2, 5, and 10-year RFS for the entire series were 85.7, 80.3, and 73.8%, LCL rates 93.8, 92.1, and 89.6%, and OP rates 96.8, 95.9, and 93.5%, respectively. However, when comparing the rates of RFS, LCL, and OP for each subcategory, important differences emerged. In particular, subcategories V and VI showed a significantly increased risk of local recurrence [hazard ratio (HR) = 9.2 and 13.3, respectively]. These subcategories also had a significantly reduced probability to achieve LCL (HR: 73.6 and 93.5, respectively) and OP (HR: 6.4 and 8.1, respectively).

Conclusion

The present classification in subcategories allows introducing the concept of a three-dimensional map of isoprognostic zones in glottic SCC treated by TLM alone as a useful tool in its management by a multidisciplinary tumor board.

Therapeutic lateral neck dissection in well-differentiated thyroid cancer: Analysis on factors predicting distribution of positive nodes and prognosis

BACKGROUND

Neck dissection is considered the treatment of choice in patients with lateral neck metastases from well-differentiated thyroid cancer.

METHODS

A multicenter, retrospective review of patients who underwent therapeutic lateral neck dissection for well-differentiated thyroid carcinoma was carried out.

RESULTS

The study included a total of 405 lateral neck dissections performed in 352 patients; 197 women (56%) and 155 men (44%). When considering ipsilateral neck metastases, levels IIa, IIb, III, IV, Va, Vb, and V (not otherwise specified) were involved in 42%, 6%, 73%, 67%, 11%, 31%, and 35% of cases, respectively. Five-year and 10-year overall survival (OS) were 93% and 81%, respectively. Age >55 years, pathologic T (pT)4 category, tumor diameter >4 cm, aggressive variants of well-differentiated thyroid carcinoma, endovascular invasion, and number of positive nodes >5 turned out to be the most important prognostic factors.

CONCLUSION

Neck dissection is a valid treatment option in the presence of neck metastasis from well-differentiated thyroid carcinoma. Levels IIa, III, IV, and Vb should always be removed.