Automated quantitative assessment of HER-2/neu immunohistochemical expression in breast cancer

Quantitative comparison of immunohistochemical staining measured by digital image analysis versus pathologist visual scoring

Abstract

Immunohistochemical (IHC) assays performed on formalin-fixed paraffin-embedded (FFPE) tissue sections traditionally have been semi-quantified by pathologist visual scoring of staining. IHC is useful for validating biomarkers discovered through genomics methods as large clinical repositories of FFPE specimens support the construction of tissue microarrays (TMAs) for high throughput studies. Due to the ubiquitous availability of IHC techniques in clinical laboratories, validated IHC biomarkers may be translated readily into clinical use. However, the method of pathologist semi-quantification is costly, inherently subjective, and produces ordinal rather than continuous variable data. Computer-aided analysis of digitized whole slide images may overcome these limitations. Using TMAs representing 215 ovarian serous carcinoma specimens stained for S100A1, we assessed the degree to which data obtained using computer-aided methods correlated with data obtained by pathologist visual scoring. To evaluate computer-aided image classification, IHC staining within pathologist annotated and software-classified areas of carcinoma were compared for each case. Two metrics for IHC staining were used: the percentage of carcinoma with S100A1 staining (%Pos), and the product of the staining intensity (optical density [OD] of staining) multiplied by the percentage of carcinoma with S100A1 staining (OD*%Pos). A comparison of the IHC staining data obtained from manual annotations and software-derived annotations showed strong agreement, indicating that software efficiently classifies carcinomatous areas within IHC slide images. Comparisons of IHC intensity data derived using pixel analysis software versus pathologist visual scoring demonstrated high Spearman correlations of 0.88 for %Pos (p < 0.0001) and 0.90 for OD*%Pos (p < 0.0001). This study demonstrated that computer-aided methods to classify image areas of interest (e.g., carcinomatous areas of tissue specimens) and quantify IHC staining intensity within those areas can produce highly similar data to visual evaluation by a pathologist.

Virtual slides

The virtual slide(s) for this article can be found here: http://www.diagnosticpathology.diagnomx.eu/vs/1649068103671302

Utility of multispectral imaging in automated quantitative scoring of immunohistochemistry

BACKGROUND

Automated scanning devices and image analysis software provide a means to overcome the limitations of manual semiquantitative scoring of immunohistochemistry. Common drawbacks to automated imaging systems include an inability to classify tissue type and an inability to segregate cytoplasmic and nuclear staining.

METHODS

Immunohistochemistry for the membranous marker α-catenin, the cytoplasmic marker stathmin and the nuclear marker Ki-67 was performed on tissue microarrays (TMA) of archival formalin-fixed paraffin-embedded tissue comprising 471 (α-catenin and stathmin) and 511 (Ki-67) cases of prostate adenocarcinoma. These TMA were quantitatively analysed using two commercially available automated image analysers, the Ariol SL-50 system and the Nuance system from CRi. Both systems use brightfield microscopy for automated, unbiased and standardised quantification of immunohistochemistry, while the Nuance system has spectral deconvolution capabilities.

RESULTS

Overall concordance between scores from both systems was excellent (r=0.90; 0.83-0.95). The software associated with the multispectral imager allowed accurate automated classification of tissue type into epithelial glandular structures and stroma, and a single-step segmentation of staining into cytoplasmic or nuclear compartments allowing independent evaluation of these areas. The Nuance system, however, was not able to distinguish reliably between tumour and non-tumour tissue. In addition, variance in the labour and time required for analysis between the two systems was also noted.

CONCLUSION

Despite limitations, this study suggests some beneficial role for the use of a multispectral imaging system in automated analysis of immunohistochemistry.

Image analysis of HER2 immunohistochemical staining. Reproducibility and concordance with fluorescence in situ hybridization of a laboratory-validated scoring technique

Image analysis of the HER2 immunohistochemical (IHC) stain can help determine which breast cancer patients may benefit from HER2-targeted therapy. We studied the concordance of HER2 IHC and fluorescence in situ hybridization (FISH) as well as reproducibility of surgical pathologist (SP) and cytotechnologist (CT) interpretations using manual and image analysis methodologies on 154 IHC cases. Concordances with FISH were good for IHC negative (0, 1+) cases (range, 97%-100%) and positive (3+) cases (range, 87%-100%). Image analysis had fewer equivocal (2+) results (10.4%) than CT (14.9%) and SP (16.2%) manual methods, with higher concordances to FISH (31%, 26%, and 20% for image analysis, CT manual, and SP manual, respectively). CT manual (κ = 0.747) and image analysis (κ = 0.779) methods had better interobserver reproducibility than SP manual (κ = 0.697). CT image analysis had better intraobserver reproducibility (κ = 0.882) than CT (κ = 0.828) and SP (κ = 0.766) manual methods. HER2 IHC analysis performed by image analysis can produce accurate results with improved reproducibility.

Pathology Imaging Informatics for Clinical Practice and Investigative and Translational Research

Pathologists routinely interpret gross and microscopic specimens to render diagnoses and to engage in a broad spectrum of investigative research. Multiple studies have demonstrated that imaging technologies have progressed to a level at which properly digitized specimens provide sufficient quality comparable to the traditional glass slides examinations. Continued advancements in this area will have a profound impact on the manner in which pathology is conducted from this point on. Several leading institutions have already undertaken ambitious projects directed toward digitally imaging, archiving, and sharing pathology specimens. As a result of these advances, the use of informatics in diagnostic and investigative pathology applications is expanding rapidly. In addition, the advent of novel technologies such as multispectral imaging makes it possible to visualize and analyze imaged specimens using multiple wavelengths simultaneously. As these powerful technologies become increasingly accepted and adopted, the opportunities for gaining new insight into the underlying mechanisms of diseases as well as the potential for discriminating among subtypes of pathologies are growing accordingly.

Membrane connectivity estimated by digital image analysis of HER2 immunohistochemistry is concordant with visual scoring and fluorescence in situ hybridization results: algorithm evaluation on breast cancer tissue microarrays

Introduction

The human epidermal growth factor receptor 2 (HER2) is an established biomarker for management of patients with breast cancer. While conventional testing of HER2 protein expression is based on semi-quantitative visual scoring of the immunohistochemistry (IHC) result, efforts to reduce inter-observer variation and to produce continuous estimates of the IHC data are potentiated by digital image analysis technologies.

Methods

HER2 IHC was performed on the tissue microarrays (TMAs) of 195 patients with an early ductal carcinoma of the breast. Digital images of the IHC slides were obtained by Aperio ScanScope GL Slide Scanner. Membrane connectivity algorithm (HER2-CONNECT™, Visiopharm) was used for digital image analysis (DA). A pathologist evaluated the images on the screen twice (visual evaluations: VE1 and VE2). HER2 fluorescence in situ hybridization (FISH) was performed on the corresponding sections of the TMAs. The agreement between the IHC HER2 scores, obtained by VE1, VE2, and DA was tested for individual TMA spots and patient's maximum TMA spot values (VE1max, VE2max, DAmax). The latter were compared with the FISH data. Correlation of the continuous variable of the membrane connectivity estimate with the FISH data was tested.

Results

The pathologist intra-observer agreement (VE1 and VE2) on HER2 IHC score was almost perfect: kappa 0.91 (by spot) and 0.88 (by patient). The agreement between visual evaluation and digital image analysis was almost perfect at the spot level (kappa 0.86 and 0.87, with VE1 and VE2 respectively) and at the patient level (kappa 0.80 and 0.86, with VE1max and VE2max, respectively). The DA was more accurate than VE in detection of FISH-positive patients by recruiting 3 or 2 additional FISH-positive patients to the IHC score 2+ category from the IHC 0/1+ category by VE1max or VE2max, respectively. The DA continuous variable of the membrane connectivity correlated with the FISH data (HER2 and CEP17 copy numbers, and HER2/CEP17 ratio).

Conclusion

HER2 IHC digital image analysis based on membrane connectivity estimate was in almost perfect agreement with the visual evaluation of the pathologist and more accurate in detection of HER2 FISH-positive patients. Most immediate benefit of integrating the DA algorithm into the routine pathology HER2 testing may be obtained by alerting/reassuring pathologists of potentially misinterpreted IHC 0/1+ versus 2+ cases.

Rational variety mapping for contrast-enhanced nonlinear unsupervised segmentation of multispectral images of unstained specimen

A methodology is proposed for nonlinear contrast-enhanced unsupervised segmentation of multispectral (color) microscopy images of principally unstained specimens. The methodology exploits spectral diversity and spatial sparseness to find anatomical differences between materials (cells, nuclei, and background) present in the image. It consists of rth-order rational variety mapping (RVM) followed by matrix/tensor factorization. Sparseness constraint implies duality between nonlinear unsupervised segmentation and multiclass pattern assignment problems. Classes not linearly separable in the original input space become separable with high probability in the higher-dimensional mapped space. Hence, RVM mapping has two advantages: it takes implicitly into account nonlinearities present in the image (ie, they are not required to be known) and it increases spectral diversity (ie, contrast) between materials, due to increased dimensionality of the mapped space. This is expected to improve performance of systems for automated classification and analysis of microscopic histopathological images. The methodology was validated using RVM of the second and third orders of the experimental multispectral microscopy images of unstained sciatic nerve fibers (nervus ischiadicus) and of unstained white pulp in the spleen tissue, compared with a manually defined ground truth labeled by two trained pathophysiologists. The methodology can also be useful for additional contrast enhancement of images of stained specimens.

Observer variability in the interpretation of HER2/neu immunohistochemical expression with unaided and computer-aided digital microscopy

CONTEXT

Observer variability in digital microscopy and the effect of computer-aided digital microscopy are underexamined areas in need of further research, considering the increasing use and future role of digital imaging in pathology. A reduction in observer variability using computer aids could enhance the statistical power of studies designed to determine the utility of new biomarkers and accelerate their incorporation in clinical practice.

OBJECTIVES

To quantify interobserver and intraobserver variability in immunohistochemical analysis of HER2/neu with digital microscopy and computer-aided digital microscopy, and to test the hypothesis that observer agreement in the quantitative assessment of HER2/neu immunohistochemical expression is increased with the use of computer-aided microscopy.

DESIGN

A set of 335 digital microscopy images extracted from 64 breast cancer tissue slides stained with a HER2 antibody, were read by 14 observers in 2 reading modes: the unaided mode and the computer-aided mode. In the unaided mode, HER2 images were displayed on a calibrated color monitor with no other information, whereas in the computer-aided mode, observers were shown a HER2 image along with a corresponding feature plot showing computer-extracted values of membrane staining intensity and membrane completeness for the particular image under examination and, at the same time, mean feature values of the different HER2 categories. In both modes, observers were asked to provide a continuous score of HER2 expression.

RESULTS

Agreement analysis performed on the output of the study showed significant improvement in both interobserver and intraobserver agreement when the computer-aided reading mode was used to evaluate preselected image fields.

CONCLUSION

The role of computer-aided digital microscopy in reducing observer variability in immunohistochemistry is promising.

Observer variability in the interpretation of HER2/neu immunohistochemical expression with unaided and computer-aided digital microscopy

CONTEXT

Observer variability in digital microscopy and the effect of computer-aided digital microscopy are underexamined areas in need of further research, considering the increasing use and future role of digital imaging in pathology. A reduction in observer variability using computer aids could enhance the statistical power of studies designed to determine the utility of new biomarkers and accelerate their incorporation in clinical practice.

OBJECTIVES

To quantify interobserver and intraobserver variability in immunohistochemical analysis of HER2/neu with digital microscopy and computer-aided digital microscopy, and to test the hypothesis that observer agreement in the quantitative assessment of HER2/neu immunohistochemical expression is increased with the use of computer-aided microscopy.

DESIGN

A set of 335 digital microscopy images extracted from 64 breast cancer tissue slides stained with a HER2 antibody, were read by 14 observers in 2 reading modes: the unaided mode and the computer-aided mode. In the unaided mode, HER2 images were displayed on a calibrated color monitor with no other information, whereas in the computer-aided mode, observers were shown a HER2 image along with a corresponding feature plot showing computer-extracted values of membrane staining intensity and membrane completeness for the particular image under examination and, at the same time, mean feature values of the different HER2 categories. In both modes, observers were asked to provide a continuous score of HER2 expression.

RESULTS

Agreement analysis performed on the output of the study showed significant improvement in both interobserver and intraobserver agreement when the computer-aided reading mode was used to evaluate preselected image fields.

CONCLUSION

The role of computer-aided digital microscopy in reducing observer variability in immunohistochemistry is promising.

Automated segmentation of cells with IHC membrane staining

This study presents a fully automated membrane segmentation technique for immunohistochemical tissue images with membrane staining, which is a critical task in computerized immunohistochemistry (IHC). Membrane segmentation is particularly tricky in immunohistochemical tissue images because the cellular membranes are visible only in the stained tracts of the cell, while the unstained tracts are not visible. Our automated method provides accurate segmentation of the cellular membranes in the stained tracts and reconstructs the approximate location of the unstained tracts using nuclear membranes as a spatial reference. Accurate cell-by-cell membrane segmentation allows per cell morphological analysis and quantification of the target membrane proteins that is fundamental in several medical applications such as cancer characterization and classification, personalized therapy design, and for any other applications requiring cell morphology characterization. Experimental results on real datasets from different anatomical locations demonstrate the wide applicability and high accuracy of our approach in the context of IHC analysis.

Time-efficient sparse analysis of histopathological whole slide images

Histopathological examination is a powerful standard for the prognosis of critical diseases. But, despite significant advances in high-speed and high-resolution scanning devices or in virtual exploration capabilities, the clinical analysis of whole slide images (WSI) largely remains the work of human experts. We propose an innovative platform in which multi-scale computer vision algorithms perform fast analysis of a histopathological WSI. It relies on application-driven for high-resolution and generic for low-resolution image analysis algorithms embedded in a multi-scale framework to rapidly identify the high power fields of interest used by the pathologist to assess a global grading. GPU technologies as well speed up the global time-efficiency of the system. Sparse coding and dynamic sampling constitute the keystone of our approach. These methods are implemented within a computer-aided breast biopsy analysis application based on histopathology images and designed in collaboration with a pathology department. The current ground truth slides correspond to about 36,000 high magnification (40×) high power fields. The processing time to achieve automatic WSI analysis is on a par with the pathologist's performance (about ten minutes a WSI), which constitutes by itself a major contribution of the proposed methodology.

Improving the visualization and detection of tissue folds in whole slide images through color enhancement

OBJECTIVE

The objective of this paper is to improve the visualization and detection of tissue folds, which are prominent among tissue slides, from the pre-scan image of a whole slide image by introducing a color enhancement method that enables the differentiation between fold and non-fold image pixels.

METHOD

The weighted difference between the color saturation and luminance of the image pixels is used as shifting factor to the original RGB color of the image.

RESULTS

Application of the enhancement method to hematoxylin and eosin (H&E) stained images improves the visualization of tissue folds regardless of the colorimetric variations in the images. Detection of tissue folds after application of the enhancement also improves but the presence of nuclei, which are also stained dark like the folds, was found to sometimes affect the detection accuracy.

CONCLUSION

The presence of tissue artifacts could affect the quality of whole slide images, especially that whole slide scanners select the focus points from the pre-scan image wherein the artifacts are indistinguishable from real tissue area. We have a presented in this paper an enhancement scheme that improves the visualization and detection of tissue folds from pre-scan images. Since the method works on the simulated pre-scan images its integration to the actual whole slide imaging process should also be possible.

Automated segmentation of tissue images for computerized IHC analysis

This paper presents two automated methods for the segmentation of immunohistochemical tissue images that overcome the limitations of the manual approach as well as of the existing computerized techniques. The first independent method, based on unsupervised color clustering, recognizes automatically the target cancerous areas in the specimen and disregards the stroma; the second method, based on colors separation and morphological processing, exploits automated segmentation of the nuclear membranes of the cancerous cells. Extensive experimental results on real tissue images demonstrate the accuracy of our techniques compared to manual segmentations; additional experiments show that our techniques are more effective in immunohistochemical images than popular approaches based on supervised learning or active contours. The proposed procedure can be exploited for any applications that require tissues and cells exploration and to perform reliable and standardized measures of the activity of specific proteins involved in multi-factorial genetic pathologies.

Requirements for the valid quantification of immunostains on tissue microarray materials using image analysis

Antibody-based proteomics applied to tissue microarray (TMA) technology provides a very efficient means of visualizing and locating antigen expression in large collections of normal and pathological tissue samples. To characterize antigen expression on TMAs, the use of image analysis methods avoids the effects of human subjectivity evidenced in manual microscopical analysis. Thus, these methods have the potential to significantly enhance both precision and reproducibility. Although some commercial systems include tools for the quantitative evaluation of immunohistochemistry-stained images, there exists no clear agreement on best practices to allow for correct and reproducible quantification results. Our study focuses on practical aspects regarding (i) image acquisition (ii) segmentation of staining and counterstaining areas and (iii) extraction of quantitative features. We illustrate our findings using a commercial system to quantify different immunohistochemistry markers targeting proteins with different expression patterns (cytoplasmic, nuclear or membranous) in colon cancer or brain tumor TMAs. Our investigations led us to identify several steps that we consider essential for standardizing computer-assisted immunostaining quantification experiments. In addition, we propose a data normalization process based on reference materials to be able to compare measurements between studies involving different TMAs. In conclusion, we recommend certain critical prerequisites that commercial or in-house systems should satisfy in order to permit valid immunostaining quantification.