UAV and Ground Image-Based Phenotyping: A Proof of Concept with Durum Wheat

Infrared Thermography Monitoring of Durum and Common Wheat for Adaptability Assessing and Yield Performance Prediction

Wheat is one of the most cultivated cereals thanks to both its nutritional value and its versatility to technological transformation. Nevertheless, the growth and yield of wheat, as well as of the other food crops, can be strongly limited by many abiotic and biotic stress factors. To face this need, new methodological approaches are required to optimize wheat cultivation from both a qualitative and quantitative point of view. In this context, crop analysis based on imaging techniques has become an important tool in agriculture. Thermography is an appealing method that represents an outstanding approach in crop monitoring, as it is well suited to the emerging needs of the precision agriculture management strategies. In this work, we performed an on-field infrared monitoring of several durum and common wheat varieties to evaluate their adaptability to the internal Mediterranean area chosen for cultivation. Two new indices based on the thermal data useful to estimate the agronomical response of wheat subjected to natural stress conditions during different phenological stages of growth have been introduced. The comparison with some productive parameters collected at harvest highlighted the correlation of the indices with the wheat yield (ranging between p < 0.001 and p < 0.05), providing interesting information for their early prediction.

Field Plant Monitoring from Macro to Micro Scale: Feasibility and Validation of Combined Field Monitoring Approaches from Remote to in Vivo to Cope with Drought Stress in Tomato

Monitoring plant growth and development during cultivation to optimize resource use efficiency is crucial to achieve an increased sustainability of agriculture systems and ensure food security. In this study, we compared field monitoring approaches from the macro to micro scale with the aim of developing novel in vivo tools for field phenotyping and advancing the efficiency of drought stress detection at the field level. To this end, we tested different methodologies in the monitoring of tomato growth under different water regimes: (i) micro-scale (inserted in the plant stem) real-time monitoring with an organic electrochemical transistor (OECT)-based sensor, namely a bioristor, that enables continuous monitoring of the plant; (ii) medium-scale (<1 m from the canopy) monitoring through red-green-blue (RGB) low-cost imaging; (iii) macro-scale multispectral and thermal monitoring using an unmanned aerial vehicle (UAV). High correlations between aerial and proximal remote sensing were found with chlorophyll-related indices, although at specific time points (NDVI and NDRE with GGA and SPAD). The ion concentration and allocation monitored by the index R of the bioristor during the drought defense response were highly correlated with the water use indices (Crop Water Stress Index (CSWI), relative water content (RWC), vapor pressure deficit (VPD)). A high negative correlation was observed with the CWSI and, in turn, with the RWC. Although proximal remote sensing measurements correlated well with water stress indices, vegetation indices provide information about the crop's status at a specific moment. Meanwhile, the bioristor continuously monitors the ion movements and the correlated water use during plant growth and development, making this tool a promising device for field monitoring.

Image-based phenotyping of seed architectural traits and prediction of seed weight using machine learning models in soybean

Among seed attributes, weight is one of the main factors determining the soybean harvest index. Recently, the focus of soybean breeding has shifted to improving seed size and weight for crop optimization in terms of seed and oil yield. With recent technological advancements, there is an increasing application of imaging sensors that provide simple, real-time, non-destructive, and inexpensive image data for rapid image-based prediction of seed traits in plant breeding programs. The present work is related to digital image analysis of seed traits for the prediction of hundred-seed weight (HSW) in soybean. The image-based seed architectural traits (i-traits) measured were area size (AS), perimeter length (PL), length (L), width (W), length-to-width ratio (LWR), intersection of length and width (IS), seed circularity (CS), and distance between IS and CG (DS). The phenotypic investigation revealed significant genetic variability among 164 soybean genotypes for both i-traits and manually measured seed weight. Seven popular machine learning (ML) algorithms, namely Simple Linear Regression (SLR), Multiple Linear Regression (MLR), Random Forest (RF), Support Vector Regression (SVR), LASSO Regression (LR), Ridge Regression (RR), and Elastic Net Regression (EN), were used to create models that can predict the weight of soybean seeds based on the image-based novel features derived from the Red-Green-Blue (RGB)/visual image. Among the models, random forest and multiple linear regression models that use multiple explanatory variables related to seed size traits (AS, L, W, and DS) were identified as the best models for predicting seed weight with the highest prediction accuracy (coefficient of determination, R2=0.98 and 0.94, respectively) and the lowest prediction error, i.e., root mean square error (RMSE) and mean absolute error (MAE). Finally, principal components analysis (PCA) and a hierarchical clustering approach were used to identify IC538070 as a superior genotype with a larger seed size and weight. The identified donors/traits can potentially be used in soybean improvement programs.

Defining durum wheat ideotypes adapted to Mediterranean environments through remote sensing traits

An acceleration of the genetic advances of durum wheat, as a major crop for the Mediterranean region, is required, but phenotyping still represents a bottleneck for breeding. This study aims to define durum wheat ideotypes under Mediterranean conditions by selecting the most suitable phenotypic remote sensing traits among different ones informing on characteristics related with leaf pigments/photosynthetic status, crop water status, and crop growth/green biomass. A set of 24 post-green revolution durum wheat cultivars were assessed in a wide set of 19 environments, accounted as the specific combinations of a range of latitudes in Spain, under different management conditions (water regimes and planting dates), through 3 consecutive years. Thus, red-green-blue and multispectral derived vegetation indices and canopy temperature were evaluated at anthesis and grain filling. The potential of the assessed remote sensing parameters alone and all combined as grain yield (GY) predictors was evaluated through random forest regression models performed for each environment and phenological stage. Biomass and plot greenness indicators consistently proved to be reliable GY predictors in all of the environments tested for both phenological stages. For the lowest-yielding environment, the contribution of water status measurements was higher during anthesis, whereas, for the highest-yielding environments, better predictions were reported during grain filling. Remote sensing traits measured during the grain filling and informing on pigment content and photosynthetic capacity were highlighted under the environments with warmer conditions, as the late-planting treatments. Overall, canopy greenness indicators were reported as the highest correlated traits for most of the environments and regardless of the phenological moment assessed. The addition of carbon isotope composition of mature kernels was attempted to increase the accuracies, but only a few were slightly benefited, as differences in water status among cultivars were already accounted by the measurement of canopy temperature.

Remotely Sensed Phenotypic Traits for Heritability Estimates and Grain Yield Prediction of Barley Using Multispectral Imaging from UAVs

This study tested the potential of parametric and nonparametric regression modeling utilizing multispectral data from two different unoccupied aerial vehicles (UAVs) as a tool for the prediction of and indirect selection of grain yield (GY) in barley breeding experiments. The coefficient of determination (R²) of the nonparametric models for GY prediction ranged between 0.33 and 0.61 depending on the UAV and flight date, where the highest value was achieved with the DJI Phantom 4 Multispectral (P4M) image from 26 May (milk ripening). The parametric models performed worse than the nonparametric ones for GY prediction. Independent of the retrieval method and UAV, GY retrieval was more accurate in milk ripening than dough ripening. The leaf area index (LAI), fraction of absorbed photosynthetically active radiation (fAPAR), fraction vegetation cover (fCover), and leaf chlorophyll content (LCC) were modeled at milk ripening using nonparametric models with the P4M images. A significant effect of the genotype was found for the estimated biophysical variables, which was referred to as remotely sensed phenotypic traits (RSPTs). Measured GY heritability was lower, with a few exceptions, compared to the RSPTs, indicating that GY was more environmentally influenced than the RSPTs. The moderate to strong genetic correlation of the RSPTs to GY in the present study indicated their potential utility as an indirect selection approach to identify high-yield genotypes of winter barley.

Development of a Quick-Install Rapid Phenotyping System

In recent years, there has been a growing need for accessible High-Throughput Plant Phenotyping (HTPP) platforms that can take measurements of plant traits in open fields. This paper presents a phenotyping system designed to address this issue by combining ultrasonic and multispectral sensing of the crop canopy with other diverse measurements under varying environmental conditions. The system demonstrates a throughput increase by a factor of 50 when compared to a manual setup, allowing for efficient mapping of crop status across a field with crops grown in rows of any spacing. Tests presented in this paper illustrate the type of experimentation that can be performed with the platform, emphasizing the output from each sensor. The system integration, versatility, and ergonomics are the most significant contributions. The presented system can be used for studying plant responses to different treatments and/or stresses under diverse farming practices in virtually any field environment. It was shown that crop height and several vegetation indices, most of them common indicators of plant physiological status, can be easily paired with corresponding environmental conditions to facilitate data analysis at the fine spatial scale.

Analysis of durum wheat photosynthetic organs during grain filling reveals the ear as a water stress-tolerant organ and the peduncle as the largest pool of primary metabolites

The pool of carbon- and nitrogen-rich metabolites is quantitatively relevant in non-foliar photosynthetic organs during grain filling, which have a better response to water limitation than flag leaves. The response of durum wheat to contrasting water regimes has been extensively studied at leaf and agronomic level in previous studies, but the water stress effects on source-sink dynamics, particularly non-foliar photosynthetic organs, is more limited. Our study aims to investigate the response of different photosynthetic organs to water stress and to quantify the pool of carbon and nitrogen metabolites available for grain filling. Five durum wheat varieties were grown in field trials in the Spanish region of Castile and León under irrigated and rainfed conditions. Water stress led to a significant decrease in yield, biomass, and carbon and nitrogen assimilation, improved water use efficiency, and modified grain quality traits in the five varieties. The pool of carbon (glucose, glucose-6-phosphate, fructose, sucrose, starch, and malate) and nitrogen (glutamate, amino acids, proteins and chlorophylls) metabolites in leaf blades and sheaths, peduncles, awns, glumes and lemmas were also analysed. The results showed that the metabolism of the blades and peduncles was the most susceptible to water stress, while ear metabolism showed higher stability, particularly at mid-grain filling. Interestingly, the total metabolite content per organ highlighted that a large source of nutrients, which may be directly involved in grain filling, are found outside the blades, with the peduncles being quantitatively the most relevant. We conclude that yield improvements in our Mediterranean agro-ecosystem are highly linked to the success of shoots in producing ears and a higher number of grains, while grain filling is highly dependent on the capacity of non-foliar organs to fix CO₂ and N. The ear organs show higher stress resilience than other organs, which deserves our attention in future breeding programmes.

Improving in-season wheat yield prediction using remote sensing and additional agronomic traits as predictors

The development of accurate grain yield (GY) multivariate models using normalized difference vegetation index (NDVI) assessments obtained from aerial vehicles and additional agronomic traits is a promising option to assist, or even substitute, laborious agronomic in-field evaluations for wheat variety trials. This study proposed improved GY prediction models for wheat experimental trials. Calibration models were developed using all possible combinations of aerial NDVI, plant height, phenology, and ear density from experimental trials of three crop seasons. First, models were developed using 20, 50 and 100 plots in training sets and GY predictions were only moderately improved by increasing the size of the training set. Then, the best models predicting GY were defined in terms of the lowest Bayesian information criterion (BIC) and the inclusion of days to heading, ear density or plant height together with NDVI in most cases were better (lower BIC) than NDVI alone. This was particularly evident when NDVI saturates (with yields above 8 t ha^-1) with models including NDVI and days to heading providing a 50% increase in the prediction accuracy and a 10% decrease in the root mean square error. These results showed an improvement of NDVI prediction models by the addition of other agronomic traits. Moreover, NDVI and additional agronomic traits were unreliable predictors of grain yield in wheat landraces and conventional yield quantification methods must be used in this case. Saturation and underestimation of productivity may be explained by differences in other yield components that NDVI alone cannot detect (e.g. differences in grain size and number).

Monitoring Dewatering Fish Spawning Sites in the Reservoir of a Large Hydropower Plant in a Lowland Country Using Unmanned Aerial Vehicles

This paper presents research concerning dewatered areas in the littoral zones of the Kaunas hydropower plant (HPP) reservoir in Lithuania. It is a multipurpose reservoir that is primarily used by two large hydropower plants for power generation. As a result of the peaking operation regime of the Kaunas HPP, the large quantity of water that is subtracted and released into the reservoir by the Kruonis pumped storage hydropower plant (PSP), and the reservoir morphology, i.e., the shallow, gently sloping littoral zone, significant dewatered areas can appear during drawdown operations. This is especially dangerous during the fish spawning period. Therefore, reservoir operation rules are in force that limit the operation of HPPs and secure other reservoir stakeholder needs. There is a lack of knowledge concerning fish spawning locations, how they change, and what areas are dewatered at different stages of HPP operation. This knowledge is crucial for decision-making and efficient reservoir storage management in order to simultaneously increase power generation and protect the environment. Current assessments of the spawning sites are mostly based on studies that were carried out in the 1990s. Surveying fish spawning sites is typically a difficult task that is usually carried out by performing manual bathymetric measurements due to the limitations of sonar in such conditions. A detailed survey of a small (approximately 5 ha) area containing several potential spawning sites was carried out using Unmanned Aerial Vehicles (UAV) equipped with multispectral and conventional RGB cameras. The captured images were processed using photogrammetry and analyzed using various techniques, including machine learning. In order to highlight water and track changes, various indices were calculated and assessed, such as the Normalized Difference Water Index (NDWI), Normalized Difference Vegetation Index (NDVI), Visible Atmospherically Resistant Index (VARI), and Normalized Green-Red Difference Index (NGRDI). High-resolution multispectral images were used to analyze the spectral footprint of aquatic macrophytes, and the possibility of using the results of this study to identify and map potential spawning sites over the entire reservoir (approximately 63.5 km²) was evaluated. The aim of the study was to investigate and implement modern surveying techniques to improve usage of reservoir storage during hydropower plant drawdown operations. The experimental results show that thresholding of the NGRDI and supervised classification of the NDWI were the best-performing methods for the shoreline detection in the fish spawning sites.

UAV Image-Based Crop Growth Analysis of 3D-Reconstructed Crop Canopies

Plant growth rate is an essential phenotypic parameter for quantifying potential crop productivity. Under field conditions, manual measurement of plant growth rate is less accurate in most cases. Image-based high-throughput platforms offer great potential for rapid, non-destructive, and objective estimation of plant growth parameters. The aim of this study was to assess the potential for quantifying plant growth rate using UAV-based (unoccupied aerial vehicle) imagery collected multiple times throughout the growing season. In this study, six diverse lines of lentils were grown in three replicates of 1 m² microplots with six biomass collection time-points throughout the growing season over five site-years. Aerial imagery was collected simultaneously with each manual measurement of the above-ground biomass time-point and was used to produce two-dimensional orthomosaics and three-dimensional point clouds. Non-linear logistic models were fit to multiple data collection points throughout the growing season. Overall, remotely detected vegetation area and crop volume were found to produce trends comparable to the accumulation of dry weight biomass throughout the growing season. The growth rate and G50 (days to 50% of maximum growth) parameters of the model effectively quantified lentil growth rate indicating significant potential for image-based tools to be used in plant breeding programs. Comparing image-based groundcover and vegetation volume estimates with manually measured above-ground biomass suggested strong correlations. Vegetation area measured from a UAV has utility in quantifying lentil biomass and is indicative of leaf area early in the growing season. For mid- to late-season biomass estimation, plot volume was determined to be a better estimator. Apart from traditional traits, the estimation and analysis of plant parameters not typically collected in traditional breeding programs are possible with image-based methods, and this can create new opportunities to improve breeding efficiency mainly by offering new phenotypes and affecting selection intensity.

Identification lodging degree of wheat using point cloud data and convolutional neural network

Wheat is one of the important food crops, and it is often subjected to different stresses during its growth. Lodging is a common disaster in filling and maturity for wheat, which not only affects the quality of wheat grains, but also causes severe yield reduction. Assessing the degree of wheat lodging is of great significance for yield estimation, wheat harvesting and agricultural insurance claims. In particular, point cloud data extracted from unmanned aerial vehicle (UAV) images have provided technical support for accurately assessing the degree of wheat lodging. However, it is difficult to process point cloud data due to the cluttered distribution, which limits the wide application of point cloud data. Therefore, a classification method of wheat lodging degree based on dimensionality reduction images from point cloud data was proposed. Firstly, 2D images were obtained from the 3D point cloud data of the UAV images of wheat field, which were generated by dimensionality reduction based on Hotelling transform and point cloud interpolation method. Then three convolutional neural network (CNN) models were used to realize the classification of different lodging degrees of wheat, including AlexNet, VGG16, and MobileNetV2. Finally, the self-built wheat lodging dataset was used to evaluate the classification model, aiming to improve the universality and scalability of the lodging discrimination method. The results showed that based on MobileNetV2, the dimensionality reduction image from point cloud obtained by the method proposed in this paper has achieved good results in identifying the lodging degree of wheat. The F1-Score of the classification model was 96.7% for filling, and 94.6% for maturity. In conclusion, the point cloud dimensionality reduction method proposed in this study could meet the accurate identification of wheat lodging degree at the field scale.

Preharvest phenotypic prediction of grain quality and yield of durum wheat using multispectral imaging

Durum wheat is an important cereal that is widely grown in the Mediterranean basin. In addition to high yield, grain quality traits are of high importance for farmers. The strong influence of climatic conditions makes the improvement of grain quality traits, like protein content, vitreousness, and test weight, a challenging task. Evaluation of quality traits post-harvest is time- and labor-intensive and requires expensive equipment, such as near-infrared spectroscopes or hyperspectral imagers. Predicting not only yield but also important quality traits in the field before harvest is of high value for breeders aiming to optimize resource allocation. Implementation of efficient approaches for trait prediction, such as the use of high-resolution spectral data acquired by a multispectral camera mounted on unmanned aerial vehicles (UAVs), needs to be explored. In this study, we have acquired multispectral image data with an 11-band multispectral camera mounted on a UAV and analyzed the data with machine learning (ML) models to predict grain yield and important quality traits in breeding micro-plots. Combining 11-band multispectral data for 34 cultivars and 16 environments allowed to develop ML models with good prediction capability. Applying the trained models to test sets explained a considerable degree of phenotypic variance with good accuracy showing r squared values of 0.84, 0.69, 0.64, and 0.61 and normalized root mean squared errors of 0.17, 0.07, 0.14, and 0.03 for grain yield, protein content, vitreousness, and test weight, respectively.

Phenotypic Traits Estimation and Preliminary Yield Assessment in Different Phenophases of Wheat Breeding Experiment Based on UAV Multispectral Images

The utility of unmanned aerial vehicles (UAV) imagery in retrieving phenotypic data to support plant breeding research has been a topic of increasing interest in recent years. The advantages of image-based phenotyping are related to the high spatial and temporal resolution of the retrieved data and the non-destructive and rapid method of data acquisition. This study trains parametric and nonparametric regression models to retrieve leaf area index (LAI), fraction of absorbed photosynthetically active radiation (fAPAR), fractional vegetation cover (fCover), leaf chlorophyll content (LCC), canopy chlorophyll content (CCC), and grain yield (GY) of winter durum wheat breeding experiment from four-bands UAV images. A ground dataset, collected during two field campaigns and complemented with data from a previous study, is used for model development. The dataset is split at random into two parts, one for training and one for testing the models. The tested parametric models use the vegetation index formula and parametric functions. The tested nonparametric models are partial least square regression (PLSR), random forest regression (RFR), support vector regression (SVR), kernel ridge regression (KRR), and Gaussian processes regression (GPR). The retrieved biophysical variables along with traditional phenotypic traits (plant height, yield, and tillering) are analysed for detection of genetic diversity, proximity, and similarity in the studied genotypes. Analysis of variance (ANOVA), Duncan’s multiple range test, correlation analysis, and principal component analysis (PCA) are performed with the phenotypic traits. The parametric and nonparametric models show close results for GY retrieval, with parametric models indicating slightly higher accuracy (R2 = 0.49; MRSE = 0.58 kg/plot; rRMSE = 6.1%). However, the nonparametric model, GPR, computes per pixel uncertainty estimation, making it more appealing for operational use. Furthermore, our results demonstrate that grain filling was better than flowering phenological stage to predict GY. The nonparametric models show better results for biophysical variables retrieval, with GPR presenting the highest prediction performance. Nonetheless, robust models are found only for LAI (R2 = 0.48; MRSE = 0.64; rRMSE = 13.5%) and LCC (R2 = 0.49; MRSE = 31.57 mg m−2; rRMSE = 6.4%) and therefore these are the only remotely sensed phenotypic traits included in the statistical analysis for preliminary assessment of wheat productivity. The results from ANOVA and PCA illustrate that the retrieved remotely sensed phenotypic traits are a valuable addition to the traditional phenotypic traits for plant breeding studies. We believe that these preliminary results could speed up crop improvement programs; however, stronger interdisciplinary research is still needed, as well as uncertainty estimation of the remotely sensed phenotypic traits.

Dataset of above and below ground traits assessed in Durum wheat cultivars grown under Mediterranean environments differing in water and temperature conditions

Ideotypic characteristics of durum wheat associated with higher yield under different water and temperature regimes were studied under Mediterranean conditions. The focus of this paper is to provide raw and supplemental data from the research article entitled "Durum wheat ideotypes in Mediterranean environments differing in water and temperature conditions" [1], which aims to define specific durum wheat ideotypes according to their responses to different agronomic conditions. In this context, six modern (i.e. post green revolution) genotypes with contrasting yield performance (i.e. high vs low yield) were grown during two consecutive years under different treatments: (i) winter planting under support-irrigation conditions, (ii) winter planting under rainfed conditions, (iii) late planting under support-irrigation. Trials were conducted at the INIA station of Colmenar de Oreja (Madrid). Different traits were assessed to inform about water status (canopy temperature at anthesis and stable carbon isotope composition (δ13C) of the flag leaf and mature grains), root performance (root traits and the oxygen isotope composition (δ18O) in the stem base water), phenology (days from sowing to heading), nitrogen status/photosynthetic capacity (nitrogen content and stable isotope composition (δ15N) of the flag leaf and mature grain together with the pigment contents and the nitrogen balance index (NBI) of the flag leaf), crop growth (plant height (PH) and the normalized difference vegetation index (NDVI) at anthesis), grain yield and agronomic yield components. For most of the parameters assessed, data analysis demonstrated significant differences among genotypes within each treatment. The level of significance was determined using the Tukey-b test on independent samples, and ideotypes were modelled from the results of principle component analysis. The present data shed light on traits that help to define specific ideotype characteristics that confer genotypic adaptation to a wide range of agronomic conditions produced by variations in planting date, water conditions and season.

Prospectus of Genomic Selection and Phenomics in Cereal, Legume and Oilseed Breeding Programs

The last decade witnessed an unprecedented increase in the adoption of genomic selection (GS) and phenomics tools in plant breeding programs, especially in major cereal crops. GS has demonstrated the potential for selecting superior genotypes with high precision and accelerating the breeding cycle. Phenomics is a rapidly advancing domain to alleviate phenotyping bottlenecks and explores new large-scale phenotyping and data acquisition methods. In this review, we discuss the lesson learned from GS and phenomics in six self-pollinated crops, primarily focusing on rice, wheat, soybean, common bean, chickpea, and groundnut, and their implementation schemes are discussed after assessing their impact in the breeding programs. Here, the status of the adoption of genomics and phenomics is provided for those crops, with a complete GS overview. GS’s progress until 2020 is discussed in detail, and relevant information and links to the source codes are provided for implementing this technology into plant breeding programs, with most of the examples from wheat breeding programs. Detailed information about various phenotyping tools is provided to strengthen the field of phenomics for a plant breeder in the coming years. Finally, we highlight the benefits of merging genomic selection, phenomics, and machine and deep learning that have resulted in extraordinary results during recent years in wheat, rice, and soybean. Hence, there is a potential for adopting these technologies into crops like the common bean, chickpea, and groundnut. The adoption of phenomics and GS into different breeding programs will accelerate genetic gain that would create an impact on food security, realizing the need to feed an ever-growing population.

Detecting Plant Stress Using Thermal and Optical Imagery From an Unoccupied Aerial Vehicle

Soil and water salinization has global impact on the sustainability of agricultural production, affecting the health and condition of staple crops and reducing potential yields. Identifying or developing salt-tolerant varieties of commercial crops is a potential pathway to enhance food and water security and deliver on the global demand for an increase in food supplies. Our study focuses on a phenotyping experiment that was designed to establish the influence of salinity stress on a diversity panel of the wild tomato species, Solanum pimpinellifolium. Here, we explore how unoccupied aerial vehicles (UAVs) equipped with both an optical and thermal infrared camera can be used to map and monitor plant temperature (Tp) changes in response to applied salinity stress. An object-based image analysis approach was developed to delineate individual tomato plants, while a green-red vegetation index derived from calibrated red, green, and blue (RGB) optical data allowed the discrimination of vegetation from the soil background. Tp was retrieved simultaneously from the co-mounted thermal camera, with Tp deviation from the ambient temperature and its change across time used as a potential indication of stress. Results showed that Tp differences between salt-treated and control plants were detectable across the five separate UAV campaigns undertaken during the field experiment. Using a simple statistical approach, we show that crop water stress index values greater than 0.36 indicated conditions of plant stress. The optimum period to collect UAV-based Tp for identifying plant stress was found between fruit formation and ripening. Preliminary results also indicate that UAV-based Tp may be used to detect plant stress before it is visually apparent, although further research with more frequent image collections and field observations is required. Our findings provide a tool to accelerate field phenotyping to identify salt-resistant germplasm and may allow farmers to alleviate yield losses through early detection of plant stress via management interventions.

Resources for image-based high-throughput phenotyping in crops and data sharing challenges

High-throughput phenotyping (HTP) platforms are capable of monitoring the phenotypic variation of plants through multiple types of sensors, such as red green and blue (RGB) cameras, hyperspectral sensors, and computed tomography, which can be associated with environmental and genotypic data. Because of the wide range of information provided, HTP datasets represent a valuable asset to characterize crop phenotypes. As HTP becomes widely employed with more tools and data being released, it is important that researchers are aware of these resources and how they can be applied to accelerate crop improvement. Researchers may exploit these datasets either for phenotype comparison or employ them as a benchmark to assess tool performance and to support the development of tools that are better at generalizing between different crops and environments. In this review, we describe the use of image-based HTP for yield prediction, root phenotyping, development of climate-resilient crops, detecting pathogen and pest infestation, and quantitative trait measurement. We emphasize the need for researchers to share phenotypic data, and offer a comprehensive list of available datasets to assist crop breeders and tool developers to leverage these resources in order to accelerate crop breeding.

Identification of Quantitative Trait Loci Hotspots Affecting Agronomic Traits and High-Throughput Vegetation Indices in Rainfed Wheat

Understanding the genetic basis of agronomic traits is essential for wheat breeding programs to develop new cultivars with enhanced grain yield under climate change conditions. The use of high-throughput phenotyping (HTP) technologies for the assessment of agronomic performance through drought-adaptive traits opens new possibilities in plant breeding. HTP together with a genome-wide association study (GWAS) mapping approach can be a useful method to dissect the genetic control of complex traits in wheat to enhance grain yield under drought stress. This study aimed to identify molecular markers associated with agronomic and remotely sensed vegetation index (VI)-related traits under rainfed conditions in bread wheat and to use an in silico candidate gene (CG) approach to search for upregulated CGs under abiotic stress. The plant material consisted of 170 landraces and 184 modern cultivars from the Mediterranean basin. The collection was phenotyped for agronomic and VI traits derived from multispectral images over 3 and 2 years, respectively. The GWAS identified 2,579 marker-trait associations (MTAs). The quantitative trait loci (QTL) overview index statistic detected 11 QTL hotspots involving more than one trait in at least 2 years. A CG analysis detected 12 CGs upregulated under abiotic stress in six QTL hotspots and 46 downregulated CGs in 10 QTL hotspots. The current study highlights the utility of VI to identify chromosome regions that contribute to yield and drought tolerance under rainfed Mediterranean conditions.

Comparative Performance of High-Yielding European Wheat Cultivars Under Contrasting Mediterranean Conditions

Understanding the interaction between genotype performance and the target environment is the key to improving genetic gain, particularly in the context of climate change. Wheat production is seriously compromised in agricultural regions affected by water and heat stress, such as the Mediterranean basin. Moreover, wheat production may be also limited by the nitrogen availability in the soil. We have sought to dissect the agronomic and physiological traits related to the performance of 12 high-yield European bread wheat varieties under Mediterranean rainfed conditions and different levels of N fertilization during two contrasting crop seasons. Grain yield was more than two times higher in the first season than the second season and was associated with much greater rainfall and lower temperatures. However, the nitrogen effect was rather minor. Genotypic effects existed for the two seasons. While several of the varieties from central/northern Europe yielded more than those from southern Europe during the optimal season, the opposite trend occurred in the dry season. The varieties from central/northern Europe were associated with delayed phenology and a longer crop cycle, while the varieties from southern Europe were characterized by a shorter crop cycle but comparatively higher duration of the reproductive period, associated with an earlier beginning of stem elongation and a greater number of ears per area. However, some of the cultivars from northern Europe maintained a relatively high yield capacity in both seasons. Thus, KWS Siskin from the UK exhibited intermediate phenology, resulting in a relatively long reproductive period, together with a high green area throughout the crop cycle.

Automatic Fruit Morphology Phenome and Genetic Analysis: An Application in the Octoploid Strawberry

Automatizing phenotype measurement will decisively contribute to increase plant breeding efficiency. Among phenotypes, morphological traits are relevant in many fruit breeding programs, as appearance influences consumer preference. Often, these traits are manually or semiautomatically obtained. Yet, fruit morphology evaluation can be enhanced using fully automatized procedures and digital images provide a cost-effective opportunity for this purpose. Here, we present an automatized pipeline for comprehensive phenomic and genetic analysis of morphology traits extracted from internal and external strawberry (Fragaria x ananassa) images. The pipeline segments, classifies, and labels the images and extracts conformation features, including linear (area, perimeter, height, width, circularity, shape descriptor, ratio between height and width) and multivariate (Fourier elliptical components and Generalized Procrustes) statistics. Internal color patterns are obtained using an autoencoder to smooth out the image. In addition, we develop a variational autoencoder to automatically detect the most likely number of underlying shapes. Bayesian modeling is employed to estimate both additive and dominance effects for all traits. As expected, conformational traits are clearly heritable. Interestingly, dominance variance is higher than the additive component for most of the traits. Overall, we show that fruit shape and color can be quickly and automatically evaluated and are moderately heritable. Although we study strawberry images, the algorithm can be applied to other fruits, as shown in the GitHub repository.

Modeling of Diurnal Changing Patterns in Airborne Crop Remote Sensing Images

Airborne remote sensing technologies have been widely applied in field crop phenotyping. However, the quality of current remote sensing data suffers from significant diurnal variances. The severity of the diurnal issue has been reported in various plant phenotyping studies over the last four decades, but there are limited studies on the modeling of the diurnal changing patterns that allow people to precisely predict the level of diurnal impacts. In order to comprehensively investigate the diurnal variability, it is necessary to collect time series field images with very high sampling frequencies, which has been difficult. In 2019, Purdue agricultural (Ag) engineers deployed their first field visible to near infrared (VNIR) hyperspectral gantry platform, which is capable of repetitively imaging the same field plots every 2.5 min. A total of 8631 hyperspectral images of the same field were collected for two genotypes of corn plants from the vegetative stage V4 to the reproductive stage R1 in the 2019 growing season. The analysis of these images showed that although the diurnal variability is very significant for almost all the image-derived phenotyping features, the diurnal changes follow stable patterns. This makes it possible to predict the imaging drifts by modeling the changing patterns. This paper reports detailed diurnal changing patterns for several selected plant phenotyping features such as Normalized Difference Vegetation Index (NDVI), Relative Water Content (RWC), and single spectrum bands. For example, NDVI showed a repeatable V-shaped diurnal pattern, which linearly drops by 0.012 per hour before the highest sun angle and increases thereafter by 0.010 per hour. The different diurnal changing patterns in different nitrogen stress treatments, genotypes and leaf stages were also compared and discussed. With the modeling results of this work, Ag remote sensing users will be able to more precisely estimate the deviation/change of crop feature predictions caused by the specific imaging time of the day. This will help people to more confidently decide on the acceptable imaging time window during a day. It can also be used to calibrate/compensate the remote sensing result against the time effect.

Haplotype analysis from unmanned aerial vehicle imagery of rice MAGIC population for the trait dissection of biomass and plant architecture

Unmanned aerial vehicles (UAVs) are popular tools for high-throughput phenotyping of crops in the field. However, their use for evaluation of individual lines is limited in crop breeding because research on what the UAV image data represent is still developing. Here, we investigated the connection between shoot biomass of rice plants and the vegetation fraction (VF) estimated from high-resolution orthomosaic images taken by a UAV 10 m above a field during the vegetative stage. Haplotype-based genome-wide association studies of multi-parental advanced generation inter-cross (MAGIC) lines revealed four quantitative trait loci (QTLs) for VF. VF was correlated with shoot biomass, but the haplotype effect on VF was better correlated with that on shoot biomass at these QTLs. Further genetic characterization revealed the relationships between these QTLs and plant spreading habit, final shoot biomass and panicle weight. Thus, genetic analysis using high-throughput phenotyping data derived from low-altitude, high-resolution UAV images during early stages of rice growing in the field provides insights into plant growth, architecture, final biomass, and yield.

Using Unmanned Aerial Vehicle and Ground-Based RGB Indices to Assess Agronomic Performance of Wheat Landraces and Cultivars in a Mediterranean-Type Environment

The adaptability and stability of new bread wheat cultivars that can be successfully grown in rainfed conditions are of paramount importance. Plant improvement can be boosted using effective high-throughput phenotyping tools in dry areas of the Mediterranean basin, where drought and heat stress are expected to increase yield instability. Remote sensing has been of growing interest in breeding programs since it is a cost-effective technology useful for assessing the canopy structure as well as the physiological traits of large genotype collections. The purpose of this study was to evaluate the use of a 4-band multispectral camera on-board an unmanned aerial vehicle (UAV) and ground-based RGB imagery to predict agronomic traits as well as quantify the best estimation of leaf area index (LAI) in rainfed conditions. A collection of 365 bread wheat genotypes, including 181 Mediterranean landraces and 184 modern cultivars, was evaluated during two consecutive growing seasons. Several vegetation indices (VI) derived from multispectral UAV and ground-based RGB images were calculated at different image acquisition dates of the crop cycle. The modified triangular vegetation index (MTVI2) proved to have a good accuracy to estimate LAI (R2 = 0.61). Although the stepwise multiple regression analysis showed that grain yield and number of grains per square meter (NGm2) were the agronomic traits most suitable to be predicted, the R2 were low due to field trials were conducted under rainfed conditions. Moreover, the prediction of agronomic traits was slightly better with ground-based RGB VI rather than with UAV multispectral VIs. NDVI and GNDVI, from multispectral images, were present in most of the prediction equations. Repeated measurements confirmed that the ability of VIs to predict yield depends on the range of phenotypic data. The current study highlights the potential use of VI and RGB images as an efficient tool for high-throughput phenotyping under rainfed Mediterranean conditions.

High Throughput Field Phenotyping for Plant Height Using UAV-Based RGB Imagery in Wheat Breeding Lines: Feasibility and Validation

Plant height (PH) is an essential trait in the screening of most crops. While in crops such as wheat, medium stature helps reduce lodging, tall plants are preferred to increase total above-ground biomass. PH is an easy trait to measure manually, although it can be labor-intense depending on the number of plots. There is an increasing demand for alternative approaches to estimate PH in a higher throughput mode. Crop surface models (CSMs) derived from dense point clouds generated via aerial imagery could be used to estimate PH. This study evaluates PH estimation at different phenological stages using plot-level information from aerial imaging-derived 3D CSM in wheat inbred lines during two consecutive years. Multi-temporal and high spatial resolution images were collected by fixed-wing (P l a t F W ) and multi-rotor (P l a t M R ) unmanned aerial vehicle (UAV) platforms over two wheat populations (50 and 150 lines). The PH was measured and compared at four growth stages (GS) using ground-truth measurements (PHground) and UAV-based estimates (PHaerial). The CSMs generated from the aerial imagery were validated using ground control points (GCPs) as fixed reference targets at different heights. The results show that PH estimations using P l a t F W were consistent with those obtained from P l a t M R , showing some slight differences due to image processing settings. The GCPs heights derived from CSM showed a high correlation and low error compared to their actual heights (R 2 ≥ 0.90, RMSE ≤ 4 cm). The coefficient of determination (R 2) between PHground and PHaerial at different GS ranged from 0.35 to 0.88, and the root mean square error (RMSE) from 0.39 to 4.02 cm for both platforms. In general, similar and higher heritability was obtained using PHaerial across different GS and years and ranged according to the variability, and environmental error of the PHground observed (0.06-0.97). Finally, we also observed high Spearman rank correlations (0.47-0.91) and R 2 (0.63-0.95) of PHaerial adjusted and predicted values against PHground values. This study provides an example of the use of UAV-based high-resolution RGB imagery to obtain time-series estimates of PH, scalable to tens-of-thousands of plots, and thus suitable to be applied in plant wheat breeding trials.

Vegetation Indices Data Clustering for Dynamic Monitoring and Classification of Wheat Yield Crop Traits

Monitoring the spatial and temporal variability of yield crop traits using remote sensing techniques is the basis for the correct adoption of precision farming. Vegetation index images are mainly associated with yield and yield-related physiological traits, although quick and sound strategies for the classification of the areas with plants with homogeneous agronomic crop traits are still to be explored. A classification technique based on remote sensing spectral information analysis was performed to discriminate between wheat cultivars. The study analyzes the ability of the cluster method applied to the data of three vegetation indices (VIs) collected by high-resolution UAV at three different crop stages (seedling, tillering, and flowering), to detect the yield and yield component dynamics of seven durum wheat cultivars. Ground truth data were grouped according to the identified clusters for VI cluster validation. The yield crop variability recorded in the field at harvest showed values ranging from 2.55 to 7.90 t. The ability of the VI clusters to identify areas with similar agronomic characteristics for the parameters collected and analyzed a posteriori revealed an already important ability to detect areas with different yield potential at seedling (5.88 t ha−1 for the first cluster, 4.22 t ha−1 for the fourth). At tillering, an enormous difficulty in differentiating the less productive areas in particular was recorded (5.66 t ha−1 for cluster 1 and 4.74, 4.31, and 4.66 t ha−1 for clusters 2, 3, and 4, respectively). An excellent ability to group areas with the same yield production at flowering was recorded for the cluster 1 (6.44 t ha−1), followed by cluster 2 (5.6 t ha−1), cluster 3 (4.31 t ha−1), and cluster 4 (3.85 t ha−1). Agronomic crop traits, cultivars, and environmental variability were analyzed. The multiple uses of VIs have improved the sensitivity of k-means clustering for a new image segmentation strategy. The cluster method can be considered an effective and simple tool for the dynamic monitoring and assessment of agronomic traits in open field wheat crops.

High-Throughput Plant Phenotyping Platform (HT3P) as a Novel Tool for Estimating Agronomic Traits From the Lab to the Field

Food scarcity, population growth, and global climate change have propelled crop yield growth driven by high-throughput phenotyping into the era of big data. However, access to large-scale phenotypic data has now become a critical barrier that phenomics urgently must overcome. Fortunately, the high-throughput plant phenotyping platform (HT3P), employing advanced sensors and data collection systems, can take full advantage of non-destructive and high-throughput methods to monitor, quantify, and evaluate specific phenotypes for large-scale agricultural experiments, and it can effectively perform phenotypic tasks that traditional phenotyping could not do. In this way, HT3Ps are novel and powerful tools, for which various commercial, customized, and even self-developed ones have been recently introduced in rising numbers. Here, we review these HT3Ps in nearly 7 years from greenhouses and growth chambers to the field, and from ground-based proximal phenotyping to aerial large-scale remote sensing. Platform configurations, novelties, operating modes, current developments, as well the strengths and weaknesses of diverse types of HT3Ps are thoroughly and clearly described. Then, miscellaneous combinations of HT3Ps for comparative validation and comprehensive analysis are systematically present, for the first time. Finally, we consider current phenotypic challenges and provide fresh perspectives on future development trends of HT3Ps. This review aims to provide ideas, thoughts, and insights for the optimal selection, exploitation, and utilization of HT3Ps, and thereby pave the way to break through current phenotyping bottlenecks in botany.

Applying RGB- and Thermal-Based Vegetation Indices from UAVs for High-Throughput Field Phenotyping of Drought Tolerance in Forage Grasses

The persistence and productivity of forage grasses, important sources for feed production, are threatened by climate change-induced drought. Breeding programs are in search of new drought tolerant forage grass varieties, but those programs still rely on time-consuming and less consistent visual scoring by breeders. In this study, we evaluate whether Unmanned Aerial Vehicle (UAV) based remote sensing can complement or replace this visual breeder score. A field experiment was set up to test the drought tolerance of genotypes from three common forage types of two different species: Festuca arundinacea, diploid Lolium perenne and tetraploid Lolium perenne. Drought stress was imposed by using mobile rainout shelters. UAV flights with RGB and thermal sensors were conducted at five time points during the experiment. Visual-based indices from different colour spaces were selected that were closely correlated to the breeder score. Furthermore, several indices, in particular H and NDLab, from the HSV (Hue Saturation Value) and CIELab (Commission Internationale de l’éclairage) colour space, respectively, displayed a broad-sense heritability that was as high or higher than the visual breeder score, making these indices highly suited for high-throughput field phenotyping applications that can complement or even replace the breeder score. The thermal-based Crop Water Stress Index CWSI provided complementary information to visual-based indices, enabling the analysis of differences in ecophysiological mechanisms for coping with reduced water availability between species and ploidy levels. All species/types displayed variation in drought stress tolerance, which confirms that there is sufficient variation for selection within these groups of grasses. Our results confirmed the better drought tolerance potential of Festuca arundinacea, but also showed which Lolium perenne genotypes are more tolerant.

Remote-Sensing-Combined Haplotype Analysis Using Multi-Parental Advanced Generation Inter-Cross Lines Reveals Phenology QTLs for Canopy Height in Rice

High-throughput phenotyping systems with unmanned aerial vehicles (UAVs) enable observation of crop lines in the field. In this study, we show the ability of time-course monitoring of canopy height (CH) to identify quantitative trait loci (QTLs) and to characterise their pleiotropic effect on various traits. We generated a digital surface model from low-altitude UAV-captured colour digital images and investigated CH data of rice multi-parental advanced generation inter-cross (MAGIC) lines from tillering and heading to maturation. Genome-wide association studies (GWASs) using the CH data and haplotype information of the MAGIC lines revealed 11 QTLs for CH. Each QTL showed haplotype effects on different features of CH such as stage-specificity and constancy. Haplotype analysis revealed relationships at the QTL level between CH and, vegetation fraction and leaf colour [derived from UAV red-green-blue (RGB) data], and CH and yield-related traits. Noticeably, haplotypes with canopy lowering effects at qCH1-4, qCH2, and qCH10-2 increased the ratio of panicle weight to leaf and stem weight, suggesting biomass allocation to grain yield or others through growth regulation of CH. Allele mining using gene information with eight founders of the MAGIC lines revealed the possibility that qCH1-4 contains multiple alleles of semi-dwarf 1 (sd1), the IR-8 allele of which significantly contributed to the "green revolution" in rice. This use of remote-sensing-derived phenotyping data into genetics using the MAGIC lines gives insight into how rice plants grow, develop, and produce grains in phenology and provides information on effective haplotypes for breeding with ideal plant architecture and grain yield.

Thermal Imaging for Plant Stress Detection and Phenotyping

In the last few years, large efforts have been made to develop new methods to optimize stress detection in crop fields. Thus, plant phenotyping based on imaging techniques has become an essential tool in agriculture. In particular, leaf temperature is a valuable indicator of the physiological status of plants, responding to both biotic and abiotic stressors. Often combined with other imaging sensors and data-mining techniques, thermography is crucial in the implementation of a more automatized, precise and sustainable agriculture. However, thermal data need some corrections related to the environmental and measuring conditions in order to achieve a correct interpretation of the data. This review focuses on the state of the art of thermography applied to the detection of biotic stress. The work will also revise the most important abiotic stress factors affecting the measurements as well as practical issues that need to be considered in order to implement this technique, particularly at the field scale.

Multi-Temporal Predictive Modelling of Sorghum Biomass Using UAV-Based Hyperspectral and LiDAR Data

High-throughput phenotyping using high spatial, spectral, and temporal resolution remote sensing (RS) data has become a critical part of the plant breeding chain focused on reducing the time and cost of the selection process for the “best” genotypes with respect to the trait(s) of interest. In this paper, the potential of accurate and reliable sorghum biomass prediction using visible and near infrared (VNIR) and short-wave infrared (SWIR) hyperspectral data as well as light detection and ranging (LiDAR) data acquired by sensors mounted on UAV platforms is investigated. Predictive models are developed using classical regression-based machine learning methods for nine experiments conducted during the 2017 and 2018 growing seasons at the Agronomy Center for Research and Education (ACRE) at Purdue University, Indiana, USA. The impact of the regression method, data source, timing of RS and field-based biomass reference data acquisition, and the number of samples on the prediction results are investigated. R2 values for end-of-season biomass ranged from 0.64 to 0.89 for different experiments when features from all the data sources were included. Geometry-based features derived from the LiDAR point cloud to characterize plant structure and chemistry-based features extracted from hyperspectral data provided the most accurate predictions. Evaluation of the impact of the time of data acquisition during the growing season on the prediction results indicated that although the most accurate and reliable predictions of final biomass were achieved using remotely sensed data from mid-season to end-of-season, predictions in mid-season provided adequate results to differentiate between promising varieties for selection. The analysis of variance (ANOVA) of the accuracies of the predictive models showed that both the data source and regression method are important factors for a reliable prediction; however, the data source was more important with 69% significance, versus 28% significance for the regression method.

The potential of remote sensing and artificial intelligence as tools to improve the resilience of agriculture production systems

Modern agriculture and food production systems are facing increasing pressures from climate change, land and water availability, and, more recently, a pandemic. These factors are threatening the environmental and economic sustainability of current and future food supply systems. Scientific and technological innovations are needed more than ever to secure enough food for a fast-growing global population. Scientific advances have led to a better understanding of how various components of the agricultural system interact, from the cell to the field level. Despite incredible advances in genetic tools over the past few decades, our ability to accurately assess crop status in the field, at scale, has been severely lacking until recently. Thanks to recent advances in remote sensing and Artificial Intelligence (AI), we can now quantify field scale phenotypic information accurately and integrate the big data into predictive and prescriptive management tools. This review focuses on the use of recent technological advances in remote sensing and AI to improve the resilience of agricultural systems, and we will present a unique opportunity for the development of prescriptive tools needed to address the next decade's agricultural and human nutrition challenges.

Leaf versus whole-canopy remote sensing methodologies for crop monitoring under conservation agriculture: a case of study with maize in Zimbabwe

Enhancing nitrogen fertilization efficiency for improving yield is a major challenge for smallholder farming systems. Rapid and cost-effective methodologies with the capability to assess the effects of fertilization are required to facilitate smallholder farm management. This study compares maize leaf and canopy-based approaches for assessing N fertilization performance under different tillage, residue coverage and top-dressing conditions in Zimbabwe. Among the measurements made on individual leaves, chlorophyll readings were the best indicators for both N content in leaves (R < 0.700) and grain yield (GY) (R < 0.800). Canopy indices reported even higher correlation coefficients when assessing GY, especially those based on the measurements of the vegetation density as the green area indices (R < 0.850). Canopy measurements from both ground and aerial platforms performed very similar, but indices assessed from the UAV performed best in capturing the most relevant information from the whole plot and correlations with GY and leaf N content were slightly higher. Leaf-based measurements demonstrated utility in monitoring N leaf content, though canopy measurements outperformed the leaf readings in assessing GY parameters, while providing the additional value derived from the affordability and easiness of using a pheno-pole system or the high-throughput capacities of the UAVs.

Automatic wheat ear counting using machine learning based on RGB UAV imagery

In wheat (Triticum aestivum L) and other cereals, the number of ears per unit area is one of the main yield-determining components. An automatic evaluation of this parameter may contribute to the advance of wheat phenotyping and monitoring. There is no standard protocol for wheat ear counting in the field, and moreover it is time consuming. An automatic ear-counting system is proposed using machine learning techniques based on RGB (red, green, blue) images acquired from an unmanned aerial vehicle (UAV). Evaluation was performed on a set of 12 winter wheat cultivars with three nitrogen treatments during the 2017-2018 crop season. The automatic system uses a frequency filter, segmentation and feature extraction, with different classification techniques, to discriminate wheat ears in micro-plot images. The relationship between the image-based manual counting and the algorithm counting exhibited high levels of accuracy and efficiency. In addition, manual ear counting was conducted in the field for secondary validation. The correlations between the automatic and the manual in-situ ear counting with grain yield were also compared. Correlations between the automatic ear counting and grain yield were stronger than those between manual in-situ counting and GY, particularly for the lower nitrogen treatment. Methodological requirements and limitations are discussed.

Robust mosaicking of maize fields from aerial imagery

PREMISE

Aerial imagery from small unmanned aerial vehicle systems is a promising approach for high-throughput phenotyping and precision agriculture. A key requirement for both applications is to create a field-scale mosaic of the aerial imagery sequence so that the same features are in registration, a very challenging problem for crop imagery.

METHODS

We have developed an improved mosaicking pipeline, Video Mosaicking and summariZation (VMZ), which uses a novel two-dimensional mosaicking algorithm that minimizes errors in estimating the transformations between successive frames during registration. The VMZ pipeline uses only the imagery, rather than relying on vehicle telemetry, ground control points, or global positioning system data, to estimate the frame-to-frame homographies. It exploits the spatiotemporal ordering of the image frames to reduce the computational complexity of finding corresponding features between frames using feature descriptors. We compared the performance of VMZ to a standard two-dimensional mosaicking algorithm (AutoStitch) by mosaicking imagery of two maize (Zea mays) research nurseries freely flown with a variety of trajectories.

RESULTS

The VMZ pipeline produces superior mosaics faster. Using the speeded up robust features (SURF) descriptor, VMZ produces the highest-quality mosaics.

DISCUSSION

Our results demonstrate the value of VMZ for the future automated extraction of plant phenotypes and dynamic scouting for crop management.

Systematic Mapping Study on Remote Sensing in Agriculture

The area of remote sensing techniques in agriculture has reached a significant degree of development and maturity, with numerous journals, conferences, and organizations specialized in it. Moreover, many review papers are available in the literature. The present work describes a literature review that adopts the form of a systematic mapping study, following a formal methodology. Eight mapping questions were defined, analyzing the main types of research, techniques, platforms, topics, and spectral information. A predefined search string was applied in the Scopus database, obtaining 1590 candidate papers. Afterwards, the most relevant 106 papers were selected, considering those with more than six citations per year. These are analyzed in more detail, answering the mapping questions for each paper. In this way, the current trends and new opportunities are discovered. As a result, increasing interest in the area has been observed since 2000; the most frequently addressed problems are those related to parameter estimation, growth vigor, and water usage, using classification techniques, that are mostly applied on RGB and hyperspectral images, captured from drones and satellites. A general recommendation that emerges from this study is to build on existing resources, such as agricultural image datasets, public satellite imagery, and deep learning toolkits.

Applications of UAV Thermal Imagery in Precision Agriculture: State of the Art and Future Research Outlook

Low-altitude remote sensing (RS) using unmanned aerial vehicles (UAVs) is a powerful tool in precision agriculture (PA). In that context, thermal RS has many potential uses. The surface temperature of plants changes rapidly under stress conditions, which makes thermal RS a useful tool for real-time detection of plant stress conditions. Current applications of UAV thermal RS include monitoring plant water stress, detecting plant diseases, assessing crop yield estimation, and plant phenotyping. However, the correct use and interpretation of thermal data are based on basic knowledge of the nature of thermal radiation. Therefore, aspects that are related to calibration and ground data collection, in which the use of reference panels is highly recommended, as well as data processing, must be carefully considered. This paper aims to review the state of the art of UAV thermal RS in agriculture, outlining an overview of the latest applications and providing a future research outlook.

Assessing durum wheat ear and leaf metabolomes in the field through hyperspectral data

Hyperspectral techniques are currently used to retrieve information concerning plant biophysical traits, predominantly targeting pigments, water, and nitrogen-protein contents, structural elements, and the leaf area index. Even so, hyperspectral data could be more extensively exploited to overcome the breeding challenges being faced under global climate change by advancing high-throughput field phenotyping. In this study, we explore the potential of field spectroscopy to predict the metabolite profiles in flag leaves and ear bracts in durum wheat. The full-range reflectance spectra (visible (VIS)-near-infrared (NIR)-short wave infrared (SWIR)) of flag leaves, ears and canopies were recorded in a collection of contrasting genotypes grown in four environments under different water regimes. GC-MS metabolite profiles were analyzed in the flag leaves, ear bracts, glumes, and lemmas. The results from regression models exceeded 50% of the explained variation (adj-R² in the validation sets) for at least 15 metabolites in each plant organ, whereas their errors were considerably low. The best regressions were obtained for malate (82%), glycerate and serine (63%) in leaves; myo-inositol (81%) in lemmas; glycolate (80%) in glumes; sucrose in leaves and glumes (68%); γ-aminobutyric acid (GABA) in leaves and glumes (61% and 71%, respectively); proline and glucose in lemmas (74% and 71%, respectively) and glumes (72% and 69%, respectively). The selection of wavebands in the models and the performance of the models based on canopy and VIS organ spectra and yield prediction are discussed. We feel that this technique will likely to be of interest due to its broad applicability in ecophysiology research, plant breeding programmes, and the agri-food industry.

Using NDVI to Differentiate Wheat Genotypes Productivity Under Dryland and Irrigated Conditions

Crop breeders are looking for tools to facilitate the screening of genotypes in field trials. Remote sensing-based indices such as normalized difference vegetative index (NDVI) are sensitive to biomass and nitrogen (N) variability in crop canopies. The objectives of this study were (i) to determine if proximal sensor-based NDVI readings can differentiate the yield of winter wheat (Triticum aestivum L.) genotypes and (ii) to determine if NDVI readings can be used to classify wheat genotypes into grain yield productivity classes. This study was conducted in northeastern Colorado in 2010 and 2011. The NDVI readings were acquired weekly from March to June, during 2010 and 2011. The correlation between NDVI and grain yield was determined using Pearson’s product-moment correlation coefficient (r). The k-means clustering method was used to classify mean NDVI and mean grain yield into three classes. The overall accuracy between NDVI and yield classes was reported. The findings of this study show that, under dryland conditions, there is a reliable correlation between grain yield and NDVI at the early growing season, at the anthesis growth stage, and the mid-grain filling growth stage, as well as a poor association under irrigated conditions. Our results suggest that when the sensor is not saturated, i.e., NDVI < 0.9, NDVI could assess grain yield with fair accuracy. This study demonstrated the potential of using NDVI readings as a tool to differentiate and identify superior wheat genotypes.

The Senescence (Stay-Green)—An Important Trait to Exploit Crop Residuals for Bioenergy

In this review, we present a comprehensive revisit of past research and advances developed on the stay-green (SG) paradigm. The study aims to provide an application-focused review of the SG phenotypes as crop residuals for bioenergy. Little is known about the SG trait as a germplasm enhancer resource for energy storage as a system for alternative energy. Initially described as a single locus recessive trait, SG was shortly after reported as a quantitative trait governed by complex physiological and metabolic networks including chlorophyll efficiency, nitrogen contents, nutrient remobilization and source-sink balance. Together with the fact that phenotyping efforts have improved rapidly in the last decade, new approaches based on sensing technologies have had an impact in SG identification. Since SG is linked to delayed senescence, we present a review of the term senescence applied to crop residuals and bioenergy. Firstly, we discuss the idiosyncrasy of senescence. Secondly, we present biological processes that determine the fate of senescence. Thirdly, we present the genetics underlying SG for crop-trait improvement in different crops. Further, this review explores the potential uses of senescence for bioenergy crops. Finally, we discuss how high-throughput phenotyping methods assist new technologies such as genomic selection in a cost-efficient manner.

A Robust Automated Image-Based Phenotyping Method for Rapid Vegetative Screening of Wheat Germplasm for Nitrogen Use Efficiency

Nitrogen use efficiency (NUE) in crops is generally low, with more than 60% of applied nitrogen (N) being lost to the environment, which increases production costs and affects ecosystems and human habitats. To overcome these issues, the breeding of crop varieties with improved NUE is needed, requiring efficient phenotyping methods along with molecular and genetic approaches. To develop an effective phenotypic screening method, experiments on wheat varieties under various N levels were conducted in the automated phenotyping platform at Plant Phenomics Victoria, Horsham. The results from the initial experiment showed that two relative N levels-5 mM and 20 mM, designated as low and optimum N, respectively-were ideal to screen a diverse range of wheat germplasm for NUE on the automated imaging phenotyping platform. In the second experiment, estimated plant parameters such as shoot biomass and top-view area, derived from digital images, showed high correlations with phenotypic traits such as shoot biomass and leaf area seven weeks after sowing, indicating that they could be used as surrogate measures of the latter. Plant growth analysis confirmed that the estimated plant parameters from the vegetative linear growth phase determined by the "broken-stick" model could effectively differentiate the performance of wheat varieties for NUE. Based on this study, vegetative phenotypic screens should focus on selecting wheat varieties under low N conditions, which were highly correlated with biomass and grain yield at harvest. Analysis indicated a relationship between controlled and field conditions for the same varieties, suggesting that greenhouse screens could be used to prioritise a higher value germplasm for subsequent field studies. Overall, our results showed that this phenotypic screening method is highly applicable and can be applied for the identification of N-efficient wheat germplasm at the vegetative growth phase.

Surveillance of panicle positions by unmanned aerial vehicle to reveal morphological features of rice

Rice plant architecture affects biomass and grain yield. Thus, it is important to select rice genotypes with ideal plant architecture. High-throughput phenotyping by use of an unmanned aerial vehicle (UAV) allows all lines in a field to be observed in less time than with traditional procedures. However, discrimination of plants in dense plantings is difficult, especially during the reproductive stage, because leaves and panicles overlap. Here, we developed an original method that relies on using UAV to identify panicle positions for dissecting plant architecture and to distinguish rice lines by detecting red flags attached to panicle bases. The plant architecture of recombinant inbred lines derived from Japanese cultivars ‘Hokuriku 193’ and ‘Mizuhochikara’, which differ in plant architecture, was assessed using a commercial camera-UAV system. Orthomosaics were made from UAV digital images. The center of plants was plotted on the image during the vegetative stage. The horizontal distance from the center to the red flag during the reproductive stage was used as the panicle position (PP). The red flags enabled us to recognize the positions of the panicles at a rate of 92%. The PP phenotype was related to but was not identical with the phenotypes of the panicle base angle, leaf sheath angle, and score of spreading habit. These results indicate that PP on orthomosaics could be used as an index of plant architecture under field conditions.

New Strategies for Time Delay Estimation During System Calibration for UAV-Based GNSS/INS-Assisted Imaging Systems

The need for accurate 3D spatial information is growing rapidly in many of today’s key industries, such as precision agriculture, emergency management, infrastructure monitoring, and defense. Unmanned aerial vehicles (UAVs) equipped with global navigation satellite systems/inertial navigation systems (GNSS/INS) and consumer-grade digital imaging sensors are capable of providing accurate 3D spatial information at a relatively low cost. However, with the use of consumer-grade sensors, system calibration is critical for accurate 3D reconstruction. In this study, ‘consumer-grade’ refers to cameras that require system calibration by the user instead of by the manufacturer or other high-end laboratory settings, as well as relatively low-cost GNSS/INS units. In addition to classical spatial system calibration, many consumer-grade sensors also need temporal calibration for accurate 3D reconstruction. This study examines the accuracy impact of time delay in the synchronization between the GNSS/INS unit and cameras on-board UAV-based mapping systems. After reviewing existing strategies, this study presents two approaches (direct and indirect) to correct for time delay between GNSS/INS recorded event markers and actual time of image exposure. Our results show that both approaches are capable of handling and correcting this time delay, with the direct approach being more rigorous. When a time delay exists and the direct or indirect approach is applied, horizontal accuracy of 1–3 times the ground sampling distance (GSD) can be achieved without either the use of any ground control points (GCPs) or adjusting the original GNSS/INS trajectory information.