Hyperspectral reflectance-based phenotyping for quantitative genetics in crops: Progress and challenges

Spectral ecophysiology: hyperspectral pressure-volume curves to estimate leaf turgor loss

Turgor loss point (TLP) is an important proxy for plant drought tolerance, species habitat suitability, and drought-induced plant mortality risk. Thus, TLP serves as a critical tool for evaluating climate change impacts on plants, making it imperative to develop high-throughput and in situ methods to measure TLP. We developed hyperspectral pressure-volume curves (PV curves) to estimate TLP using leaf spectral reflectance. We used partial least square regression models to estimate water potential (Ψ) and relative water content (RWC) for two species, Frangula caroliniana and Magnolia grandiflora. RWC and Ψ's model for each species had R2 ≥ 0.7 and %RMSE = 7-10. We constructed PV curves with model estimates and compared the accuracy of directly measured and spectra-predicted TLP. Our findings indicate that leaf spectral measurements are an alternative method for estimating TLP. F. caroliniana TLP's values were -1.62 ± 0.15 (means ± SD) and -1.62 ± 0.34 MPa for observed and reflectance predicted, respectively (P > 0.05), while M. grandiflora were -1.78 ± 0.34 and -1.66 ± 0.41 MPa (P > 0.05). The estimation of TLP through leaf reflectance-based PV curves opens a broad range of possibilities for future research aimed at understanding and monitoring plant water relations on a large scale with spectral ecophysiology.

Prediction of biomass accumulation and tolerance of wheat seedlings to drought and elevated temperatures using hyperspectral imaging

Early prediction of important agricultural traits in wheat opens up broad prospects for the development of approaches to accelerate the selection of genotypes for further breeding trials. This study is devoted to the search for predictors of biomass accumulation and tolerance of wheat to abiotic stressors. Hyperspectral (HS) and chlorophyll fluorescence (ChlF) parameters were analyzed as predictors under laboratory conditions. The predictive ability of reflectance and normalized difference indices (NDIs), as well as their relationship with parameters of photosynthetic activity, which is a key process influencing organic matter production and crop yields, were analyzed. HS parameters calculated using the wavelengths in Red (R) band and the spectral range next to the red edge (FR-NIR) were found to be correlated with biomass accumulation. The same ranges showed potential for predicting wheat tolerance to elevated temperatures. The relationship of HS predictors with biomass accumulation and heat tolerance were of opposite sign. A number of ChlF parameters also showed statistically significant correlation with biomass accumulation and heat tolerance. A correlation between HS and ChlF parameters, that demonstrated potential for predicting biomass accumulation and tolerance, has been shown. No predictors of drought tolerance were found among the HS and ChlF parameters analyzed.

To have value, comparisons of high-throughput phenotyping methods need statistical tests of bias and variance

The gap between genomics and phenomics is narrowing. The rate at which it is narrowing, however, is being slowed by improper statistical comparison of methods. Quantification using Pearson's correlation coefficient (r) is commonly used to assess method quality, but it is an often misleading statistic for this purpose as it is unable to provide information about the relative quality of two methods. Using r can both erroneously discount methods that are inherently more precise and validate methods that are less accurate. These errors occur because of logical flaws inherent in the use of r when comparing methods, not as a problem of limited sample size or the unavoidable possibility of a type I error. A popular alternative to using r is to measure the limits of agreement (LOA). However both r and LOA fail to identify which instrument is more or less variable than the other and can lead to incorrect conclusions about method quality. An alternative approach, comparing variances of methods, requires repeated measurements of the same subject, but avoids incorrect conclusions. Variance comparison is arguably the most important component of method validation and, thus, when repeated measurements are possible, variance comparison provides considerable value to these studies. Statistical tests to compare variances presented here are well established, easy to interpret and ubiquitously available. The widespread use of r has potentially led to numerous incorrect conclusions about method quality, hampering development, and the approach described here would be useful to advance high throughput phenotyping methods but can also extend into any branch of science. The adoption of the statistical techniques outlined in this paper will help speed the adoption of new high throughput phenotyping techniques by indicating when one should reject a new method, outright replace an old method or conditionally use a new method.

Optimal-Band Analysis for Chlorophyll Quantification in Rice Leaves Using a Custom Hyperspectral Imaging System

Hyperspectral imaging (HSI) is a promising tool in chlorophyll quantification, providing a non-invasive method to collect important information for effective crop management. HSI contributes to food security solutions by optimising crop yields. In this study, we presented a custom HSI system specifically designed to provide a quantitative analysis of leaf chlorophyll content (LCC). To ensure precise estimation, significant wavelengths were identified using optimal-band analysis. Our research was centred on two sets of 120 leaf samples sourced from Thailand's unique Chaew Khing rice variant. The samples were subjected to (i) an analytical LCC assessment and (ii) HSI imaging for spectral reflectance data capture. A linear regression comparison of these datasets revealed that the green (575 ± 2 nm) and near-infrared (788 ± 2 nm) bands were the most outstanding performers. Notably, the green normalised difference vegetation index (GNDVI) was the most reliable during cross-validation (R2=0.78 and RMSE = 2.4 µg∙cm-2), outperforming other examined vegetable indices (VIs), such as the simple ratio (RED/GREEN) and the chlorophyll index. The potential development of a streamlined sensor dependent only on these two wavelengths is a significant outcome of identifying these two optimal bands. This innovation can be seamlessly integrated into farming landscapes or attached to UAVs, allowing real-time monitoring and rapid, targeted N management interventions.

Hyperspectral Proximal Sensing for Estimating Photosynthetic Capacities at Leaf and Canopy Scales

Agronomists, plant breeders, and plant biologists have been promoting the need to develop high-throughput methods to measure plant traits of interest for decades. Measuring these plant traits or phenotypes is often a bottleneck since skilled personnel, resources, and ample time are required. Additionally, plant phenotypic traits from only a select number of breeding lines or varieties can be quantified because the "gold standard" measurement of a desired trait cannot be completed in a timely manner. As such, numerous approaches have been developed and implemented to better understand the biology and production of crops and ecosystems. In this chapter, we explain one of the recent approaches leveraging hyperspectral measurements to estimate different aspects of photosynthesis. Notably, we outline the use of hyperspectral radiometer and imaging to rapidly estimate two of the rate-limiting steps of photosynthesis: the maximum rate of the carboxylation of Rubisco (Vcmax) and the maximum rate of electron transfer or regeneration of RuBP (Jmax).

A leaf-level spectral library to support high throughput plant phenotyping: Predictive accuracy and model transfer

Leaf-level hyperspectral reflectance has become an effective tool for high-throughput phenotyping of plant leaf traits due to its rapid, low-cost, multi-sensing, and non-destructive nature. However, collecting samples for model calibration can still be expensive; and models show poor transferability among different datasets. This study had three specific objectives: (i) assemble a large library of leaf hyperspectral data (n=2460) from maize and sorghum, (ii) evaluate two machine-learning approaches to estimate nine leaf properties (chlorophyll, thickness, water content, nitrogen, phosphorus, potassium, calcium, magnesium, and sulfur), and (iii) investigate the usefulness of this spectral library for predicting external datasets (n=445) including soybean and camelina using extra-weighted spiking. Internal cross-validation showed satisfactory performance of the spectral library to estimate all nine traits (average R 2 0.688), with Partial Least Squares Regression outperforming Deep Neural Network models. Models calibrated solely using the spectral library showed degraded performance on external datasets (average R 2 0.159 for camelina, 0.337 for soybean). Models improved significantly when a small portion of external samples (n=20) was added to the library via extra-weighted spiking (average R 2 0.574 for camelina, 0.536 for soybean). The leaf-level spectral library greatly benefits plant physiological and biochemical phenotyping; whereas extra-weight spiking improves model transferability and extends its utility.

Dissection of Hyperspectral Reflectance to Estimate Photosynthetic Characteristics in Upland Cotton (Gossypium hirsutum L.) under Different Nitrogen Fertilizer Application Based on Machine Learning Algorithms

Hyperspectral technology has enabled rapid and efficient nitrogen monitoring in crops. However, most approaches involve direct monitoring of nitrogen content or physiological and biochemical indicators directly related to nitrogen, which cannot reflect the overall plant nutritional status. Two important photosynthetic traits, the fraction of absorbed photosynthetically active radiation (FAPAR) and the net photosynthetic rate (Pn), were previously shown to respond positively to nitrogen changes. Here, Pn and FAPAR were used for correlation analysis with hyperspectral data to establish a relationship between nitrogen status and hyperspectral characteristics through photosynthetic traits. Using principal component and band autocorrelation analyses of the original spectral reflectance, two band positions (350-450 and 600-750 nm) sensitive to nitrogen changes were obtained. The performances of four machine learning algorithm models based on six forms of hyperspectral transformations showed that the light gradient boosting machine (LightGBM) model based on the hyperspectral first derivative could better invert the Pn of function-leaves in cotton, and the random forest (RF) model based on hyperspectral first derivative could better invert the FAPAR of the cotton canopy. These results provide advanced metrics for non-destructive tracking of cotton nitrogen status, which can be used to diagnose nitrogen nutrition and cotton growth status in large farms.

Hyperspectral Remote Sensing for Phenotyping the Physiological Drought Response of Common and Tepary Bean

Proximal remote sensing offers a powerful tool for high-throughput phenotyping of plants for assessing stress response. Bean plants, an important legume for human consumption, are often grown in regions with limited rainfall and irrigation and are therefore bred to further enhance drought tolerance. We assessed physiological (stomatal conductance and predawn and midday leaf water potential) and ground- and tower-based hyperspectral remote sensing (400 to 2,400 nm and 400 to 900 nm, respectively) measurements to evaluate drought response in 12 common bean and 4 tepary bean genotypes across 3 field campaigns (1 predrought and 2 post-drought). Hyperspectral data in partial least squares regression models predicted these physiological traits (R ² = 0.20 to 0.55; root mean square percent error 16% to 31%). Furthermore, ground-based partial least squares regression models successfully ranked genotypic drought responses similar to the physiologically based ranks. This study demonstrates applications of high-resolution hyperspectral remote sensing for predicting plant traits and phenotyping drought response across genotypes for vegetation monitoring and breeding population screening.

Quantification of Photosynthetic Pigments in Neopyropia yezoensis Using Hyperspectral Imagery

Phycobilisomes and chlorophyll-a (Chla) play important roles in the photosynthetic physiology of red macroalgae and serve as the primary light-harvesting antennae and reaction center for photosystem II. Neopyropia is an economically important red macroalga widely cultivated in East Asian countries. The contents and ratios of 3 main phycobiliproteins and Chla are visible traits to evaluate its commercial quality. The traditional analytical methods used for measuring these components have several limitations. Therefore, a high-throughput, nondestructive, optical method based on hyperspectral imaging technology was developed for phenotyping the pigments phycoerythrin (PE), phycocyanin (PC), allophycocyanin (APC), and Chla in Neopyropia thalli in this study. The average spectra from the region of interest were collected at wavelengths ranging from 400 to 1000 nm using a hyperspectral camera. Following different preprocessing methods, 2 machine learning methods, partial least squares regression (PLSR) and support vector machine regression (SVR), were performed to establish the best prediction models for PE, PC, APC, and Chla contents. The prediction results showed that the PLSR model performed the best for PE (R _Test ² = 0.96, MAPE = 8.31%, RPD = 5.21) and the SVR model performed the best for PC (R _Test ² = 0.94, MAPE = 7.18%, RPD = 4.16) and APC (R _Test ² = 0.84, MAPE = 18.25%, RPD = 2.53). Two models (PLSR and SVR) performed almost the same for Chla (PLSR: R _Test ² = 0.92, MAPE = 12.77%, RPD = 3.61; SVR: R _Test ² = 0.93, MAPE = 13.51%, RPD =3.60). Further validation of the optimal models was performed using field-collected samples, and the result demonstrated satisfactory robustness and accuracy. The distribution of PE, PC, APC, and Chla contents within a thallus was visualized according to the optimal prediction models. The results showed that hyperspectral imaging technology was effective for fast, accurate, and noninvasive phenotyping of the PE, PC, APC, and Chla contents of Neopyropia in situ. This could benefit the efficiency of macroalgae breeding, phenomics research, and other related applications.

Proximal and remote sensing in plant phenomics: 20 years of progress, challenges, and perspectives

Plant phenomics (PP) has been recognized as a bottleneck in studying the interactions of genomics and environment on plants, limiting the progress of smart breeding and precise cultivation. High-throughput plant phenotyping is challenging owing to the spatio-temporal dynamics of traits. Proximal and remote sensing (PRS) techniques are increasingly used for plant phenotyping because of their advantages in multi-dimensional data acquisition and analysis. Substantial progress of PRS applications in PP has been observed over the last two decades and is analyzed here from an interdisciplinary perspective based on 2972 publications. This progress covers most aspects of PRS application in PP, including patterns of global spatial distribution and temporal dynamics, specific PRS technologies, phenotypic research fields, working environments, species, and traits. Subsequently, we demonstrate how to link PRS to multi-omics studies, including how to achieve multi-dimensional PRS data acquisition and processing, how to systematically integrate all kinds of phenotypic information and derive phenotypic knowledge with biological significance, and how to link PP to multi-omics association analysis. Finally, we identify three future perspectives for PRS-based PP: (1) strengthening the spatial and temporal consistency of PRS data, (2) exploring novel phenotypic traits, and (3) facilitating multi-omics communication.

Hyperspectral Technique Combined With Deep Learning Algorithm for Prediction of Phenotyping Traits in Lettuce

The currently available methods for evaluating most biochemical traits of plant phenotyping are destructive and have extremely low throughput. However, hyperspectral techniques can non-destructively obtain the spectral reflectance characteristics of plants, which can provide abundant biophysical and biochemical information. Therefore, plant spectra combined with machine learning algorithms can be used to predict plant phenotyping traits. However, the raw spectral reflectance characteristics contain noise and redundant information, thus can easily affect the robustness of the models developed via multivariate analysis methods. In this study, two end-to-end deep learning models were developed based on 2D convolutional neural networks (2DCNN) and fully connected neural networks (FCNN; Deep2D and DeepFC, respectively) to rapidly and non-destructively predict the phenotyping traits of lettuces from spectral reflectance. Three linear and two nonlinear multivariate analysis methods were used to develop models to weigh the performance of the deep learning models. The models based on multivariate analysis methods require a series of manual feature extractions, such as pretreatment and wavelength selection, while the proposed models can automatically extract the features in relation to phenotyping traits. A visible near-infrared hyperspectral camera was used to image lettuce plants growing in the field, and the spectra extracted from the images were used to train the network. The proposed models achieved good performance with a determination coefficient of prediction ( R p 2 ) of 0.9030 and 0.8490 using Deep2D for soluble solids content and DeepFC for pH, respectively. The performance of the deep learning models was compared with five multivariate analysis method. The quantitative analysis showed that the deep learning models had higher R p 2 than all the multivariate analysis methods, indicating better performance. Also, wavelength selection and different pretreatment methods had different effects on different multivariate analysis methods, and the selection of appropriate multivariate analysis methods and pretreatment methods increased more time and computational cost. Unlike multivariate analysis methods, the proposed deep learning models did not require any pretreatment or dimensionality reduction and thus are more suitable for application in high-throughput plant phenotyping platforms. These results indicate that the deep learning models can better predict phenotyping traits of plants using spectral reflectance.

Advances in field-based high-throughput photosynthetic phenotyping

Gas exchange techniques revolutionized plant research and advanced understanding, including associated fluxes and efficiencies, of photosynthesis, photorespiration, and respiration of plants from cellular to ecosystem scales. These techniques remain the gold standard for inferring photosynthetic rates and underlying physiology/biochemistry, although their utility for high-throughput phenotyping (HTP) of photosynthesis is limited both by the number of gas exchange systems available and the number of personnel available to operate the equipment. Remote sensing techniques have long been used to assess ecosystem productivity at coarse spatial and temporal resolutions, and advances in sensor technology coupled with advanced statistical techniques are expanding remote sensing tools to finer spatial scales and increasing the number and complexity of phenotypes that can be extracted. In this review, we outline the photosynthetic phenotypes of interest to the plant science community and describe the advances in high-throughput techniques to characterize photosynthesis at spatial scales useful to infer treatment or genotypic variation in field-based experiments or breeding trials. We will accomplish this objective by presenting six lessons learned thus far through the development and application of proximal/remote sensing-based measurements and the accompanying statistical analyses. We will conclude by outlining what we perceive as the current limitations, bottlenecks, and opportunities facing HTP of photosynthesis.

Prediction of Photosynthetic, Biophysical, and Biochemical Traits in Wheat Canopies to Reduce the Phenotyping Bottleneck

To achieve food security, it is necessary to increase crop radiation use efficiency (RUE) and yield through the enhancement of canopy photosynthesis to increase the availability of assimilates for the grain, but its study in the field is constrained by low throughput and the lack of integrative measurements at canopy level. In this study, partial least squares regression (PLSR) was used with high-throughput phenotyping (HTP) data in spring wheat to build predictive models of photosynthetic, biophysical, and biochemical traits for the top, middle, and bottom layers of wheat canopies. The combined layer model predictions performed better than individual layer predictions with a significance as follows for photosynthesis R ² = 0.48, RMSE = 5.24 μmol m^-2 s^-1 and stomatal conductance: R ² = 0.36, RMSE = 0.14 mol m^-2 s^-1. The predictions of these traits from PLSR models upscaled to canopy level compared to field observations were statistically significant at initiation of booting (R ² = 0.3, p < 0.05; R ² = 0.29, p < 0.05) and at 7 days after anthesis (R ² = 0.15, p < 0.05; R ² = 0.65, p < 0.001). Using HTP allowed us to increase phenotyping capacity 30-fold compared to conventional phenotyping methods. This approach can be adapted to screen breeding progeny and genetic resources for RUE and to improve our understanding of wheat physiology by adding different layers of the canopy to physiological modeling.

Dynamics and genetic regulation of leaf nutrient concentration in barley based on hyperspectral imaging and machine learning

Biofortification, the enrichment of nutrients in crop plants, is of increasing importance to improve human health. The wild barley nested association mapping (NAM) population HEB-25 was developed to improve agronomic traits including nutrient concentration. Here, we evaluated the potential of high-throughput hyperspectral imaging in HEB-25 to predict leaf concentration of 15 mineral nutrients, sampled from two field experiments and four developmental stages. Particularly accurate predictions were obtained by partial least squares regression (PLS) modeling of leaf concentrations for N, P and K reaching coefficients of determination of 0.90, 0.75 and 0.89, respectively. We recognized nutrient-specific patterns of variation of leaf nutrient concentration between developmental stages. A number of quantitative trait loci (QTL) associated with the simultaneous expression of leaf nutrients were detected, indicating their potential co-regulation in barley. For example, the wild barley allele of QTL-4H-1 simultaneously increased leaf concentration of N, P, K and Cu. Similar effects of the same QTL were previously reported for nutrient concentrations in grains, supporting a potential parallel regulation of N, P, K and Cu in leaves and grains of HEB-25. Our study provides a new approach for nutrient assessment in large-scale field experiments to ultimately select genes and genotypes supporting plant biofortification.