Perspective on Multimodal Imaging Techniques Coupling Mass Spectrometry and Vibrational Spectroscopy: Picturing the Best of Both Worlds

Cross-Scale Multimodal Imaging for Organic Matter in Extraterrestrial Samples

The analysis of extraterrestrial organic matter in samples returned by space missions provides a unique opportunity to study prebiotic chemistry. A comprehensive understanding of the occurrence and composition of organic matter is fundamental to unraveling its origin and evolutionary history. However, the scarcity and complexity of these materials pose considerable analytical challenges. Here, we developed a cross-scale multimodal imaging workflow that integrated mass spectrometry imaging (MSI) and vibrational spectroscopy imaging, including desorption electrospray ionization coupled quadrupole-time-of-flight mass spectrometry (DESI-Q-TOF/MS), time-of-flight secondary ion mass spectrometry (TOF-SIMS), nanoscale secondary ion mass spectrometry (NanoSIMS), focal plane array-Fourier transform infrared spectroscopy (FPA-FTIR), and optical photothermal infrared spectroscopy (O-PTIR). This workflow was applied to the Murchison meteorite, with the objective of establishing spatial associations between mineral phases, molecular composition, functional groups, and isotopic composition on a scale from the millimeter to the submicron. The spatial resolution of DESI has been improved from 100 to 200 to 20 μm, enabling spatial correlation with other imaging techniques. For the first time, the enrichment of organic matter─including CHN, CHO, and CHNO compounds and polycyclic aromatic hydrocarbons (PAHs)─in fine-grained rims (FGRs) surrounding silicate chondrules has been observed. Furthermore, the cross-scale multimodal imaging also reveals differences in organic matter composition between Ca-carbonate and phyllosilicates, as well as spatial heterogeneity within the latter. This workflow provides a new paradigm for studying the complex occurrence and composition of organic matter in various research fields, enhancing our understanding of prebiotic materials in the solar system.

Emergency multimodality imaging for a giant cystic renal artery aneurysm in a lung adenocarcinoma patient with iodinated contrast media allergy: A case report

INTRODUCTION AND IMPORTANCE

Renal artery aneurysm (RAA) is a rare, but potentially life-threatening condition. The rarity of malignancy-associated RAAs limits our understanding of their natural history, morphological characteristics, intervention criteria, and available treatment options. When these aneurysms manifest as large cystic formations, they may mimic renal masses or cysts. Managing these aneurysms presents significant challenges, particularly for patients with contraindications to conventional imaging techniques, such as allergies to iodinated contrast agents.

CASE PRESENTATION

This study presents a case of a 36-year-old male patient diagnosed with lung adenocarcinoma accompanied by pleural metastasis, who was suspected of having renal aneurysms. Due to an allergy to iodine contrast agents, the patient was unable to undergo computed tomography angiography (CTA). To address this challenge, we developed an emergency multimodal imaging pathway utilizing non-enhanced computed tomography (CT), Doppler ultrasound, and contrast-enhanced ultrasound (CEUS) for patients allergic to iodine contrast agents. This approach offers significant advantages, including reduced diagnostic time, the use of a safe blood pool microbubble contrast agent, and high spatial resolution. Ultimately, the patient was diagnosed with saccular RAA and underwent immediate surgical intervention, including renal artery reconstruction. The surgery was completed successfully and without complications. After treatment, the patient experienced rapid remission of symptoms related to the renal aneurysm.

CLINICAL DISCUSSION

This case illustrates the efficacy of a multimodal imaging approach-comprising CT, US, and CEUS-in the emergency diagnosis of RAA, particularly for patients with contraindications to iodinated contrast agents. While CTA is often considered the gold standard, it is associated with limitations such as radiation exposure and potential nephrotoxicity. In light of these constraints, the integration of non-contrast CT, conventional US, and CEUS proved to be an optimal strategy, yielding comprehensive diagnostic information without incurring the risks associated with iodinated or gadolinium-based contrast. CEUS, in particular, proves invaluable by providing real-time, high-resolution imaging of blood flow patterns within the RAA, a capability that conventional US alone cannot achieve, which is essential for differential diagnosis and treatment planning. This multimodal approach addresses the limitations of single-modality techniques by delivering anatomical, morphological, and functional data. It is especially advantageous for oncology patients who require frequent imaging and long-term follow-up, as it mitigates cumulative radiation exposure. The use of microbubble contrast agents in CEUS offers an extremely low risk of allergic reactions and is not affected by renal function, providing reliable diagnostic support. The rapid and accurate diagnosis facilitated by this multimodal strategy is critical in emergency settings, potentially averting severe complications such as aneurysm rupture. Nonetheless, this approach may face challenges related to operator dependency and the necessity for specialized equipment.

CONCLUSION

This case highlights the essential role of multimodal imaging in the emergency diagnosis of RAA, especially in oncology patients with a history of severe allergic reactions to iodinated contrast agents. It also underscores the need for rapid diagnosis and intervention for RAA in patients with malignancies, demonstrating how multimodal imaging enhances diagnostic accuracy while minimizing risks associated with contrast agents.

Morphological and molecular preservation through universal preparation of fresh-frozen tissue samples for multimodal imaging workflows

The landscape of tissue-based imaging modalities is constantly and rapidly evolving. While formalin-fixed, paraffin-embedded material is still useful for histological imaging, the fixation process irreversibly changes the molecular composition of the sample. Therefore, many imaging approaches require fresh-frozen material to get meaningful results. This is particularly true for molecular imaging techniques such as mass spectrometry imaging, which are widely used to probe the spatial arrangement of the tissue metabolome. As high-quality fresh-frozen tissues are limited in their availability, any sample preparation workflow they are subjected to needs to ensure morphological and molecular preservation of the tissues and be compatible with as many of the established and emerging imaging techniques as possible to obtain the maximum possible insights from the tissues. Here we describe a universal sample preparation workflow, from the initial step of freezing the tissues to the cold embedding in a new hydroxypropyl methylcellulose/polyvinylpyrrolidone-enriched hydrogel and the generation of thin tissue sections for analysis. Moreover, we highlight the optimized storage conditions that limit molecular and morphological degradation of the sections. The protocol is compatible with human and plant tissues and can be easily adapted for the preparation of alternative sample formats (e.g., three-dimensional cell cultures). The integrated workflow is universally compatible with histological tissue analysis, mass spectrometry imaging and imaging mass cytometry, as well as spatial proteomic, genomic and transcriptomic tissue analysis. The protocol can be completed within 4 h and requires minimal prior experience in the preparation of tissue samples for multimodal imaging experiments.

Advances in mass spectrometry imaging for spatial cancer metabolomics

Mass spectrometry (MS) has become a central technique in cancer research. The ability to analyze various types of biomolecules in complex biological matrices makes it well suited for understanding biochemical alterations associated with disease progression. Different biological samples, including serum, urine, saliva, and tissues have been successfully analyzed using mass spectrometry. In particular, spatial metabolomics using MS imaging (MSI) allows the direct visualization of metabolite distributions in tissues, thus enabling in-depth understanding of cancer-associated biochemical changes within specific structures. In recent years, MSI studies have been increasingly used to uncover metabolic reprogramming associated with cancer development, enabling the discovery of key biomarkers with potential for cancer diagnostics. In this review, we aim to cover the basic principles of MSI experiments for the nonspecialists, including fundamentals, the sample preparation process, the evolution of the mass spectrometry techniques used, and data analysis strategies. We also review MSI advances associated with cancer research in the last 5 years, including spatial lipidomics and glycomics, the adoption of three-dimensional and multimodal imaging MSI approaches, and the implementation of artificial intelligence/machine learning in MSI-based cancer studies. The adoption of MSI in clinical research and for single-cell metabolomics is also discussed. Spatially resolved studies on other small molecule metabolites such as amino acids, polyamines, and nucleotides/nucleosides will not be discussed in the context.

Advances in multimodal mass spectrometry for single-cell analysis and imaging enhancement

Multimodal mass spectrometry (MMS) incorporates an imaging modality with probe-based mass spectrometry (MS) to enable precise, targeted data acquisition and provide additional biological and chemical data not available by MS alone. Two categories of MMS are covered; in the first, an imaging modality guides the MS probe to target individual cells and to reduce acquisition time by automatically defining regions of interest. In the second category, imaging and MS data are coupled in the data analysis pipeline to increase the effective spatial resolution using a higher resolution imaging method, correct for tissue deformation, and incorporate fine morphological features in an MS imaging dataset. Recent methodological and computational developments are covered along with their application to single-cell and imaging analyses.

A multimodal pipeline for image correction and registration of mass spectrometry imaging with microscopy

The integration of matrix-assisted laser desorption/ionization mass spectrometry imaging (MALDI MSI) and histology plays a pivotal role in advancing our understanding of complex heterogeneous tissues, which provides a comprehensive description of biological tissue with both wide molecule coverage and high lateral resolution. Herein, we proposed a novel strategy for the correction and registration of MALDI MSI data with hematoxylin & eosin (H&E) staining images. To overcome the challenges of discrepancies in spatial resolution towards the unification of the two imaging modalities, a deep learning-based interpolation algorithm for MALDI MSI data was constructed, which enables spatial coherence and the following orientation matching between images. Coupled with the affine transformation (AT) and the subsequent moving least squares algorithm, the two types of images from one rat brain tissue section were aligned automatically with high accuracy. Moreover, we demonstrated the practicality of the developed pipeline by projecting it to a rat cerebral ischemia-reperfusion injury model, which would help decipher the link between molecular metabolism and pathological interpretation towards microregion. This new approach offers the chance for other types of bioimaging to boost the field of multimodal image fusion.

RaMALDI: Enabling simultaneous Raman and MALDI imaging of the same tissue section

Multimodal tissue imaging techniques that integrate two complementary modalities are powerful discovery tools for unraveling biological processes and identifying biomarkers of disease. Combining Raman spectroscopic imaging (RSI) and matrix-assisted laser-desorption/ionization (MALDI) mass spectrometry imaging (MSI) to obtain fused images with the advantages of both modalities has the potential of providing spatially resolved, sensitive, specific biomolecular information, but has so far involved two separate sample preparations, or even consecutive tissue sections for RSI and MALDI MSI, resulting in images with inherent disparities. We have developed RaMALDI, a streamlined, integrated, multimodal imaging workflow of RSI and MALDI MSI, performed on a single tissue section with one sample preparation protocol. We show that RaMALDI imaging of various tissues effectively integrates molecular information acquired from both RSI and MALDI MSI of the same sample, which will drive discoveries in cell biology, biomedicine, and pathology, and advance tissue diagnostics.

Spatial Omics Imaging of Fresh-Frozen Tissue and Routine FFPE Histopathology of a Single Cancer Needle Core Biopsy: A Freezing Device and Multimodal Workflow

The complex molecular alterations that underlie cancer pathophysiology are studied in depth with omics methods using bulk tissue extracts. For spatially resolved tissue diagnostics using needle biopsy cores, however, histopathological analysis using stained FFPE tissue and the immunohistochemistry (IHC) of a few marker proteins is currently the main clinical focus. Today, spatial omics imaging using MSI or IRI is an emerging diagnostic technology for the identification and classification of various cancer types. However, to conserve tissue-specific metabolomic states, fast, reliable, and precise methods for the preparation of fresh-frozen (FF) tissue sections are crucial. Such methods are often incompatible with clinical practice, since spatial metabolomics and the routine histopathology of needle biopsies currently require two biopsies for FF and FFPE sampling, respectively. Therefore, we developed a device and corresponding laboratory and computational workflows for the multimodal spatial omics analysis of fresh-frozen, longitudinally sectioned needle biopsies to accompany standard FFPE histopathology of the same biopsy core. As a proof-of-concept, we analyzed surgical human liver cancer specimens using IRI and MSI with precise co-registration and, following FFPE processing, by sequential clinical pathology analysis of the same biopsy core. This workflow allowed for a spatial comparison between different spectral profiles and alterations in tissue histology, as well as a direct comparison for histological diagnosis without the need for an extra biopsy.

MSIr: Automatic Registration Service for Mass Spectrometry Imaging and Histology

Mass spectrometry imaging (MSI) is a powerful tool that can be used to simultaneously investigate the spatial distribution of different molecules in samples. However, it is difficult to comprehensively analyze complex biological systems with only a single analytical technique due to different analytical properties and application limitations. Therefore, many analytical methods have been combined to extend data interpretation, evaluate data credibility, and facilitate data mining to explore important temporal and spatial relationships in biological systems. Image registration is an initial and critical step for multimodal imaging data fusion. However, the image registration of multimodal images is not a simple task. The property difference between each data modality may include spatial resolution, image characteristics, or both. The image registrations between MSI and different imaging techniques are often achieved indirectly through histology. Many methods exist for image registration between MSI data and histological images. However, most of them are manual or semiautomatic and have their prerequisites. Here, we built MSI Registrar (MSIr), a web service for automatic registration between MSI and histology. It can help to reduce subjectivity and processing time efficiently. MSIr provides an interface for manually selecting region of interests from histological images; the user selects regions of interest to extract the corresponding spectrum indices in MSI data. In the performance evaluation, MSIr can quickly map MSI data to histological images and help pinpoint molecular components at specific locations in tissues. Most registrations were adequate and were without excessive shifts. MSIr is freely available at https://msir.cmdm.tw and https://github.com/CMDM-Lab/MSIr.

Artificial Intelligence and Precision Medicine: A New Frontier for the Treatment of Brain Tumors

Brain tumors are a widespread and serious neurological phenomenon that can be life- threatening. The computing field has allowed for the development of artificial intelligence (AI), which can mimic the neural network of the human brain. One use of this technology has been to help researchers capture hidden, high-dimensional images of brain tumors. These images can provide new insights into the nature of brain tumors and help to improve treatment options. AI and precision medicine (PM) are converging to revolutionize healthcare. AI has the potential to improve cancer imaging interpretation in several ways, including more accurate tumor genotyping, more precise delineation of tumor volume, and better prediction of clinical outcomes. AI-assisted brain surgery can be an effective and safe option for treating brain tumors. This review discusses various AI and PM techniques that can be used in brain tumor treatment. These new techniques for the treatment of brain tumors, i.e., genomic profiling, microRNA panels, quantitative imaging, and radiomics, hold great promise for the future. However, there are challenges that must be overcome for these technologies to reach their full potential and improve healthcare.

Exploring New Methods to Study and Moderate Proton Beam Damage for Multimodal Imaging on a Single Tissue Section

Characterizing proton beam damage in biological materials is of interest to enable the integration of proton microprobe elemental mapping techniques with other imaging modalities. It is also of relevance to obtain a deeper understanding of mechanical damage to lipids in tissues during proton beam cancer therapy. We have developed a novel strategy to characterize proton beam damage to lipids in biological tissues based on mass spectrometry imaging. This methodology is applied to characterize changes to lipids in tissues ex vivo, irradiated under different conditions designed to mitigate beam damage. This work shows that performing proton beam irradiation at ambient pressure, as well as including the application of an organic matrix prior to irradiation, can reduce damage to lipids in tissues. We also discovered that, irrespective of proton beam irradiation, placing a sample in a vacuum prior to desorption electrospray ionization imaging can enhance lipid signals, a conclusion that may be of future benefit to the mass spectrometry imaging community.

What are we imaging? Software tools and experimental strategies for annotation and identification of small molecules in mass spectrometry imaging

Mass spectrometry imaging (MSI) has become a widespread analytical technique to perform nonlabeled spatial molecular identification. The Achilles' heel of MSI is the annotation and identification of molecular species due to intrinsic limitations of the technique (lack of chromatographic separation and the difficulty to apply tandem MS). Successful strategies to perform annotation and identification combine extra analytical steps, like using orthogonal analytical techniques to identify compounds; with algorithms that integrate the spectral and spatial information. In this review, we discuss different experimental strategies and bioinformatics tools to annotate and identify compounds in MSI experiments. We target strategies and tools for small molecule applications, such as lipidomics and metabolomics. First, we explain how sample preparation and the acquisition process influences annotation and identification, from sample preservation to the use of orthogonal techniques. Then, we review twelve software tools for annotation and identification in MSI. Finally, we offer perspectives on two current needs of the MSI community: the adaptation of guidelines for communicating confidence levels in identifications; and the creation of a standard format to store and exchange annotations and identifications in MSI.

Image to insight: exploring natural products through mass spectrometry imaging

Covering: 2017 to 2022Mass spectrometry imaging (MSI) has become a mature molecular imaging technique that is well-matched for natural product (NP) discovery. Here we present a brief overview of MSI, followed by a thorough discussion of different MSI applications in NP research. This review will mainly focus on the recent progress of MSI in plants and microorganisms as they are the main producers of NPs. Specifically, the opportunity and potential of combining MSI with other imaging modalities and stable isotope labeling are discussed. Throughout, we focus on both the strengths and weaknesses of MSI, with an eye on future improvements that are necessary for the progression of MSI toward routine NP studies. Finally, we discuss new areas of research, future perspectives, and the overall direction that the field may take in the years to come.

SALDI-MS and SERS Multimodal Imaging: One Nanostructured Substrate to Rule Them Both

Imaging techniques based on mass spectrometry or spectroscopy methods inform in situ about the chemical composition of biological tissues or organisms, but they are sometimes limited by their specificity, sensitivity, or spatial resolution. Multimodal imaging addresses these limitations by combining several imaging modalities; however, measuring the same sample with the same preparation using multiple imaging techniques is still uncommon due to the incompatibility between substrates, sample preparation protocols, and data formats. We present a multimodal imaging approach that employs a gold-coated nanostructured silicon substrate to couple surface-assisted laser desorption/ionization mass spectrometry (SALDI-MS) and surface-enhanced Raman spectroscopy (SERS). Our approach integrates both imaging modalities by using the same substrate, sample preparation, and data analysis software on the same sample, allowing the coregistration of both images. We transferred molecules from clean fingertips and fingertips covered with plasticine modeling clay onto our nanostructure and analyzed their chemical composition and distribution by SALDI-MS and SERS. Multimodal analysis located the traces of plasticine on fingermarks and provided chemical information on the composition of the clay. Our multimodal approach effectively combines the advantages of mass spectrometry and vibrational spectroscopy with the signal enhancing abilities of our nanostructured substrate.

A new update of MALDI-TOF mass spectrometry in lipid research

Matrix-assisted laser desorption and ionization (MALDI) mass spectrometry (MS) is an indispensable tool in modern lipid research since it is fast, sensitive, tolerates sample impurities and provides spectra without major analyte fragmentation. We will discuss some methodological aspects, the related ion-forming processes and the MALDI MS characteristics of the different lipid classes (with the focus on glycerophospholipids) and the progress, which was achieved during the last ten years. Particular attention will be given to quantitative aspects of MALDI MS since this is widely considered as the most serious drawback of the method. Although the detailed role of the matrix is not yet completely understood, it will be explicitly shown that the careful choice of the matrix is crucial (besides the careful evaluation of the positive and negative ion mass spectra) in order to be able to detect all lipid classes of interest. Two developments will be highlighted: spatially resolved Imaging MS is nowadays well established and the distribution of lipids in tissues merits increasing interest because lipids are readily detectable and represent ubiquitous compounds. It will also be shown that a combination of MALDI MS with thin-layer chromatography (TLC) enables a fast spatially resolved screening of an entire TLC plate which makes the method competitive with LC/MS.

LA-ICP-MS and MALDI-MS image registration for correlating nanomaterial biodistributions and their biochemical effects

Laser ablation inductively-coupled plasma mass spectrometry (LA-ICP-MS) imaging and matrix assisted laser desorption ionization mass spectrometry imaging (MALDI-MSI) are complementary methods that measure distributions of elements and biomolecules in tissue sections. Quantitative correlations of the information provided by these two imaging modalities requires that the datasets be registered in the same coordinate system, allowing for pixel-by-pixel comparisons. We describe here a computational workflow written in Python that accomplishes this registration, even for adjacent tissue sections, with accuracies within ±50 μm. The value of this registration process is demonstrated by correlating images of tissue sections from mice injected with gold nanomaterial drug delivery systems. Quantitative correlations of the nanomaterial delivery vehicle, as detected by LA-ICP-MS imaging, with biochemical changes, as detected by MALDI-MSI, provide deeper insight into how nanomaterial delivery systems influence lipid biochemistry in tissues. Moreover, the registration process allows the more precise images associated with LA-ICP-MS imaging to be leveraged to achieve improved segmentation in MALDI-MS images, resulting in the identification of lipids that are most associated with different sub-organ regions in tissues.

Imaging lipids in biological samples with surface-assisted laser desorption/ionization mass spectrometry: A concise review of the last decade

Knowing the spatial location of the lipid species present in biological samples is of paramount importance for the elucidation of pathological and physiological processes. In this context, mass spectrometry imaging (MSI) has emerged as a powerful technology allowing the visualization of the spatial distributions of biomolecules, including lipids, in complex biological samples. Among the different ionization methods available, the emerging surface-assisted laser desorption/ionization (SALDI) MSI offers unique capabilities for the study of lipids. This review describes the specific advantages of SALDI-MSI for lipid analysis, including the ability to perform analyses in both ionization modes with the same nanosubstrate, the detection of lipids characterized by low ionization efficiency in MALDI-MS, and the possibilities of surface modification to improve the detection of lipids. The complementarity of SALDI and MALDI-MSI is also discussed. Finally, this review presents data processing strategies applied in SALDI-MSI of lipids, as well as examples of applications of SALDI-MSI in biomedical lipidomics.