Remote-sensing hyperspectral imaging for applications in archaeological areas: Non-invasive investigations on wall paintings and on mural inscriptions in the Pompeii site

Look but don't touch: Non-invasive chemical analysis of organic paint binders - A review

Diagnostics on historical art samples are decisive for assessing degradation and understanding the chemical composition of supports and polychromies. These investigations help us in uncovering the artist's style and techniques and provide invaluable information for restoration, preservation and conservation. In paint formulation, the binder, also known as medium, disperses insoluble pigments and creates a homogeneous, adhesive mixture. Various analytical techniques, often used in combination, are usually employed to characterize binders with infrared (IR) and Raman spectroscopies being the most common choices. Recently, mass spectrometry (MS) has gained prominence for its ability to allow detailed structural characterization and identification, thanks to soft ionization sources such as matrix-assisted laser desorption ionization (MALDI) and electrospray ionization (ESI). However, MS typically requires micro-sampling, which is often prohibited for highly valuable artworks. This limitation has driven research toward the development of innovative minimally invasive sampling strategies like enzyme-functionalized gels applied to polychromies for in-situ protein digestion and peptide extraction. These quasi-non-invasive methods offer powerful solutions for extracting and characterizing organic painting binders, unlocking valuable insights into these elusive materials. This review aims to explore both the most common non-invasive analytical techniques used to characterize ancient and contemporary painting binders, and the most recent advancements in minimally invasive sampling strategies, which represent convenient and interesting approaches to enable the use of invasive analytical approaches while preserving the integrity of precious artworks.

A Study on Pigment Composition of Buddhist Cave Paintings Based on Hyperspectral Technology

The value of the Buddhist cave lies not only in the Buddha statues but also in the surface painting. Hyperspectral imaging technology, as an emerging and effective method for component identification, offers a non-contact and non-destructive approach to the preservation and restoration of oil paintings. This study employed hyperspectral cameras to capture common pigments on the surfaces of Buddhist caves. Then, the results were processed and used as a database to identify the paintings. Additionally, a series of experiments were conducted to examine the impact of binder, substrate types, and pigment sizes on the reflectance spectrum of the paints. The Spectral Angle Matching (SAM) algorithm was then used to analyze the Yuanjue Cave and Qiqushan Stone Carvings of the Tang Dynasty in China. The findings revealed that the position of absorption peaks in the reflectance spectra is not significantly influenced by the substrate but is affected by the binder. Moreover, the absorption depth varies regularly with particle size. Furthermore, the spectral matching results demonstrate that components can be accurately identified even for similar colors. Based on the pigment distribution, the study also inferred specific details of ancient paintings, including the painting steps and hidden information in the manuscript layout. These findings hold significant implications for the restoration of representative surface paintings of the Tang Dynasty Buddhist cave, providing a reference for the selection of restoration materials and methods.

Virtual cleaning of sooty mural hyperspectral images using the LIME model and improved dark channel prior

Murals, as important carriers of cultural heritage and historical records, showcase artistic, aesthetic, social, and political significance. In ancient times, religious activities such as burning incense and candles in temples led to many murals being polluted by soot, causing them to darken, lose details, and, in severe cases, completely blacken. As a result, the development of efficient virtual cleaning methods has become a key strategy for addressing this issue. In this study, we use synthetic true colour and false colour images in different bands of the hyperspectral spectrum, and use a guided filter fusion technique to fuse these two images into a new image of the sooty mural. Through analyzing the histograms and colour distribution scatterplots of the synthetic sooty mural images, we observed significant similarities to low-luminance images. To enhance the synthesized murals, we applied the LIME model. In addition, comparisons of the histograms and colour distribution scatterplots of the enhanced sooty mural images with those of haze images revealed notable similarities. Therefore, we applied the dark channel prior algorithm to remove soot from the mural images. Considering that soot particles are larger than haze particles, we introduced guided filtering to refine the transmission map and created a nonlinear transformation function to enhance its details. In terms of both visual perception and quantitative analysis, the proposed method significantly outperforms previous methods in the virtual cleaning of sooty murals. This technology can not only restore the colours and details of murals but also provide new clues for subsequent mural studies, allowing people to once again appreciate the true beauty of the murals.

Fifteenth century Florentine mural investigated in situ with VNIR Hyperspectral Imaging and NIR Photography supports interpretation as a bloodletting scene

This study provides new data which suggest a novel interpretative hypothesis not only on the specific painting, but on the use of bloodletting as medical practice in the Florentine Quattrocento. As a part of a cycle of frescoes devoted to the Seven Corporal Works of Mercy, the examined lunette depicts the "Visit to the sick" in a domestic interior, but it has never been considered as an historical document of precise medical practices. The scene's definitive interpretation is still unresolved because of the uncertainty of some iconographic details. A campaign of in-situ and non-invasive technical investigations was performed to retrieve possible traces of previous details today concealed. The technical solutions adopted to implement the measurements campaign are illustrated, as an experimental example for remote sensing inspection of mural paintings in-situ. The position of the painting high up on a wall of an historical venue led to opting for stand-alone optical imaging techniques which could operate in remote sensing mode. By combining the use of portable Hyperspectral Imaging with Near Infrared photography a set of detailed images could be obtained that highlighted details not otherwise detectable. Focused on the objects held by the persons present, the analysis of the mural of Visit of the Buonomini in her Lying in Bed, the gift of swaddling cloth could be a tourniquet, shadows of folds of a blanket a thumb lancet, and an object held a blood collection bowl, supported the hypothesis that it could be a medieval bloodletting scene.

Assessment of hyperspectral imaging and CycleGAN-simulated narrowband techniques to detect early esophageal cancer

The clinical signs and symptoms of esophageal cancer (EC) are often not discernible until the intermediate or advanced phases. The detection of EC in advanced stages significantly decreases the survival rate to below 20%. This study conducts a comparative analysis of the efficacy of several imaging techniques, including white light image (WLI), narrowband imaging (NBI), cycle-consistent adversarial network simulated narrowband image (CNBI), and hyperspectral imaging simulated narrowband image (HNBI), in the early detection of esophageal cancer (EC). In conjunction with Kaohsiung Armed Forces General Hospital, a dataset consisting of 1000 EC pictures was used, including 500 images captured using WLI and 500 images captured using NBI. The CycleGAN model was used to generate the CNBI dataset. Additionally, a novel method for HSI imaging was created with the objective of generating HNBI pictures. The evaluation of the efficacy of these four picture types in early detection of EC was conducted using three indicators: CIEDE2000, entropy, and the structural similarity index measure (SSIM). Results of the CIEDE2000, entropy, and SSIM analyses suggest that using CycleGAN to generate CNBI images and HSI model for creating HNBI images is superior in detecting early esophageal cancer compared to the use of conventional WLI and NBI techniques.

A Novel Transmittance Vis-NIR Hyper-Spectral Imaging Scanner for Analysis of Photographic Negatives: A Potential Tool for Photography Conservation

This work illustrates a novel prototype of a transmittance hyperspectral imaging (HSI) scanner, operating in the 400-900 nm range, and designed on purpose for non-invasive analysis of photographic materials, such as negatives, films and slides. The instrument provides high-quality spectral data and high-definition spectral images on targets of small size (e.g., 35 mm film strips) and is the first example of HSI instrumentation specifically designed for applications in the photographic conservation field. The instrument was tested in laboratory and on a set of specimens selected from a damaged photographic archive. This experimentation, though preliminary, demonstrated the soundness of a technical approach based on HSI for large-scale spectroscopic characterization of photographic archival materials. The obtained results encourage the continuation of experimentation of HSI as an advanced tool for photography conservation.

Current progress on murals: distribution, conservation and utilization

As non-renewable cultural heritages, murals have important implications in historical customs, religions, and philosophy as well as their aesthetic values. Recently, many murals are threatened by natural factors and human activities. During the past decades, there are increasing interest in the investigation of murals. Here we review the current status of murals and provide an up-to-date summary of achievements related to murals. The murals that draw the most attention are distributed in Mexico, Ireland, China, and Spain. The aesthetics, history, cultural, educational, and economic values of murals are comprehensively analyzed. The main research technologies used to detect the chemical compositions and physical structures of murals are also summarized. The restoration of murals includes several procedures such as stabilization, repair, surface cleaning, and pigment reconversion. Emerging technologies such as computer science benefit the research and conservation of murals. We also propose that tourism management and climate change should be incorporated into the conservation of murals in the future.

Multiband Photogrammetry and Hybrid Image Analysis for the Investigation of a Wall Painting by Paolo de San Leocadio and Francesco Pagano in the Cathedral of Valencia

A workflow for the photogrammetric combination of non-invasive multispectral imaging techniques ranging from ultraviolet (UV) and visible (VIS) to near infrared (NIR) for the investigation of wall paintings is presented. Hereby, different methods for image analysis and visualisation techniques are discussed. This includes the combination of spectral bands in hybrid false-colour images and image analysis by applying NDVI/NDPI and PCA. The aim of the research is to generate a high-resolution photogrammetric image set, providing information on underdrawings, material differences, damages, painting techniques and conservation measures. The image data are superimposed with pixel accuracy in a geographic information system (GIS) for further analysis, tracing of observations and findings and the annotation of further information. The research is carried out on the 'Adoration of the Shepherds', an early Spanish Renaissance wall painting created in 1472 by Paolo de San Leocadio and Francesco Pagano in the Cathedral of Valencia. The wall painting is preserved in an unfinished condition, and half of it is represented by the initial plaster and preparation layers. This gives the possibility to compare and evaluate the observations of the finished areas as well as carry out an in-depth study of the working techniques.

Focusing on Volatile Organic Compounds of Natural Resins by Selected-Ion Flow Tube-Mass Spectrometry

The analysis of archeological artifacts, due to the high value of antique objects, is preferably performed by nondestructive, noninvasive, and in situ techniques. At present, the most common in situ protocols used for the analysis of organic materials are spectroscopic approaches. In this work, we tested selected-ion flow tube-mass spectrometry (SIFT-MS), a transportable mass spectrometry system for the characterization and discrimination of natural resins by the analysis of their volatile organic compounds profiles. We chose diterpenoid, triterpenoid, and aromatic resins as reference materials, focusing on the most identified in archeological artifacts. This work aims to create a SIFT-MS database of mass spectra suitable for characterizing archeological samples. The spectral data obtained by SIFT-MS were interpreted with the aid of chromatograms and mass spectra obtained by head space-gas chromatography/mass spectrometry (HS-GC/MS). Finally, principal components analysis (PCA) was used to further underline the differences among the different materials and to investigate the possibility of discriminating different classes of resins based on their SIFT spectra.

Acquisition of High Spectral Resolution Diffuse Reflectance Image Cubes (350-2500 nm) from Archaeological Wall Paintings and Other Immovable Heritage Using a Field-Deployable Spatial Scanning Reflectance Spectrometry Hyperspectral System

There is growing interest in bringing non-invasive laboratory-based analytical imaging tools to field sites to study wall paintings in order to collect molecular information on the macroscale. Analytical imaging tools, such as reflectance imaging spectrometry, have provided a wealth of information about artist materials and working methods, as well as painting conditions. Currently, scientific analyses of wall paintings have been limited to point-measurement techniques such as reflectance spectroscopy (near-ultraviolet, visible, near-infrared, and mid-infrared), X-ray fluorescence, and Raman spectroscopy. Macroscale data collection methods have been limited to multispectral imaging in reflectance and luminescence modes, which lacks sufficient spectral bands to allow for the mapping and identification of artist materials of interest. The development of laboratory-based reflectance and elemental imaging spectrometers and scanning systems has sparked interest in developing truly portable versions, which can be brought to field sites to study wall paintings where there is insufficient space or electrical power for laboratory instruments. This paper presents the design and testing of a simple hyperspectral system consisting of a 2D spatial spot scanning spectrometer, which provides high spectral resolution diffuse reflectance spectra from 350 to 2500 nm with high signal to noise and moderate spatial resolution (few mm). This spectral range at high spectral resolution was found to provide robust chemical specificity sufficient to identify and map many artists' materials, as well as the byproducts of weathering and conservation coatings across the surface of ancient and Byzantine Cypriot wall paintings. Here, we present a detailed description of the hyperspectral system, its performance, and examples of its use to study wall paintings from Roman tombs in Cyprus. The spectral/spatial image processing workflow to make maps of pigments and constituent painting materials is also discussed. This type of configurable hyperspectral system and the imaging processing workflow offer a new tool for the field study of wall paintings and other immovable heritage.

Rapid Detection of Nonprotein Nitrogen Adulterants in Milk Powder Using Point-Scan Raman Hyperspectral Imaging Technology

To develop a rapid detection method for nonprotein nitrogen adulterants, this experiment sets up a set of point-scan Raman hyperspectral imaging systems to qualitatively distinguish and quantitatively and positionally analyze samples spiked with a single nonprotein nitrogen adulterant and samples spiked with a mixture of nine nonprotein nitrogen adulterants at different concentrations (5 × 10-3 to 2.000%, w/w). The results showed that for samples spiked with single nonprotein nitrogen adulterants, the number of pixels corresponding to the adulterant in the region of interest increased linearly with an increase in the analyte concentration, the average coefficient of determination (R 2) was above 0.99, the minimum detection concentration of nonprotein nitrogen adulterants reached 0.010%, and the relative standard deviation (RSD) of the predicted concentration was less than 6%. For the sample spiked with a mixture of nine nonprotein nitrogen adulterants, the standard curve could be used to accurately predict the additive concentration when the additive concentration was greater than 1.200%. The detection method established in this study has good accuracy, high sensitivity, and strong stability. It provides a method for technical implementation of real-time and rapid detection of adulterants in milk powder at the port site and has good application and promotion prospects.

Developing Macro-Raman Mapping as a Tool for Studying the Pigment Distribution of Art Objects

Raman spectroscopy is a well-appreciated technique in cultural heritage research for its ability to obtain molecular information nondestructively. During Raman mapping experiments, advantage is taken of the excellent spatial resolution of the approach, allowing to visualize the spatial distribution of the molecules. In the current research, macro-Raman mapping is proposed, allowing us to map large areas of an artwork (typically tens or hundreds of square centimeters). Therefore, a new setup is made, using a commercially available mobile Raman spectrometer and fast translation stages. Moreover, the probe is equipped with a triangulator to measure the distance to the surface of the artwork and thus achieving accurate focusing of the Raman probe. Finally, the correct setup is guaranteed by using a calibration module that is designed to allow for spectral calibration and aligning all components of the probe. The use of the method is demonstrated by three cases, where different data processing techniques are illustrated.

Investigation of Ancient Wall Painting Fragments Discovered in the Roman Baths from Alburnus Maior by Complementary Non-Destructive Techniques

In this study, several wall painting fragments discovered in the Roman baths from the archeological site Alburnus Maior (Roşia Montană, Romania) were analyzed with the aim to investigate the material composition of both plasters and pictorial layers. Dated from the beginning of the second century AD, these rare findings stand among the oldest examples of preserved decorative polychrome paintings on plaster excavated thus far in the former territory of the Roman province of Dacia. A non-destructive multi-analytical approach based on complementary techniques was considered: Fourier transform infrared (FTIR) spectroscopy, X-ray fluorescence (XRF), X-ray diffraction (XRD), UV fluorescence, and hyperspectral imaging (HSI). The obtained results highlight a common Roman color palette mainly based on naturally occurring earth pigments. Red ochre, yellow ochre, manganese-rich ochres/wads, carbon black, and calcite were identified. A traditional two-layer sequence of plasters was found—arriccio (based on lime and siliceous sands), and intonaco (pure lime). The presence of an organic protein binder, identified via FTIR analysis, and sustained by combined imaging documentation, indicates that the pigments were applied a secco. The obtained results are discussed in relation to previous published data, and they can be considered as valuable archeological indicators that contribute to the understanding of the painting techniques and the materials used in the Roman provinces.

Reflectance Imaging Spectroscopy (RIS) for Operation Night Watch: Challenges and Achievements of Imaging Rembrandt's Masterpiece in the Glass Chamber at the Rijksmuseum

Visible and infrared reflectance imaging spectroscopy is one of the several non-invasive techniques used during Operation Night Watch for the study of Rembrandt’s iconic masterpiece The Night Watch (1642). The goals of this project include the identification and mapping of the artists’ materials, providing information about the painting technique used as well as documenting the painting’s current state and ultimately determining the possible conservation plan. The large size of the painting (3.78 m by 4.53 m) and the diversity of the technical investigations being performed make Operation Night Watch the largest research project ever undertaken at the Rijksmuseum. To construct a complete reflectance image cube at a high spatial resolution (168 µm²) and spectral resolution (2.54 to 6 nm), the painting was imaged with two high-sensitivity line scanning hyperspectral cameras (VNIR 400 to 1000 nm, 2.54 nm, and SWIR 900 to 2500 nm, 6 nm). Given the large size of the painting, a custom computer-controlled 3-D imaging frame was constructed to move each camera, along with lights, across the painting surface. A third axis, normal to the painting, was added along with a distance-sensing system which kept the cameras in focus during the scanning. A total of 200 hyperspectral image swaths were collected, mosaicked and registered to a high-resolution color image to sub-pixel accuracy using a novel registration algorithm. The preliminary analysis of the VNIR and SWIR reflectance images has identified many of the pigments used and their distribution across the painting. The SWIR, in particular, has provided an improved visualization of the preparatory sketches and changes in the painted composition. These data sets, when combined with the results from the other spectral imaging modalities and paint sample analyses, will provide the most complete understanding of the materials and painting techniques used by Rembrandt in The Night Watch.

Assessing Laser Cleaning of a Limestone Monument by Fiber Optics Reflectance Spectroscopy (FORS) and Visible and Near-Infrared (VNIR) Hyperspectral Imaging (HSI)

Fiber optics reflectance spectroscopy (FORS) and visible and near-infrared (VNIR) hyperspectral imaging (HSI) were applied to assess and control the laser cleaning process of a deeply darkened limestone surface collected from the historic entrance gate of Castello Svevo, Bari, Italy. Both techniques enabled us to verify the different degree of removal of a thick deposit of black crust from the surface of the walls. Results obtained were in good agreement with those of previous studies of the elemental composition achieved by application of laser-induced breakdown spectroscopy (LIBS). Coupling FORS and VNIR-HSI provided important information on the optimal conditions to evaluate the conservation status and determine the more appropriate level of cleaning restoration, thus avoiding over- and/or under-cleaning. Imaging spectroscopy was used to obtain maps of areas featuring the same or different spectral characteristics, so to achieve a sufficient removal of unwanted layers, without modifying the surface underneath, and to increase the efficiency of traditional cleaning techniques. The performance of the combined non-invasive approach used in this work shows promise for further applications to other types of rocks and highlights the potential for in situ assessment of the laser cleaning process based on reflectance spectroscopy.