Evaluating Maize Genotype Performance under Low Nitrogen Conditions Using RGB UAV Phenotyping Techniques

Field phenotyping for African crops: overview and perspectives

Improvements in crop productivity are required to meet the dietary demands of the rapidly-increasing African population. The development of key staple crop cultivars that are high-yielding and resilient to biotic and abiotic stresses is essential. To contribute to this objective, high-throughput plant phenotyping approaches are important enablers for the African plant science community to measure complex quantitative phenotypes and to establish the genetic basis of agriculturally relevant traits. These advances will facilitate the screening of germplasm for optimum performance and adaptation to low-input agriculture and resource-constrained environments. Increasing the capacity to investigate plant function and structure through non-invasive technologies is an effective strategy to aid plant breeding and additionally may contribute to precision agriculture. However, despite the significant global advances in basic knowledge and sensor technology for plant phenotyping, Africa still lags behind in the development and implementation of these systems due to several practical, financial, geographical and political barriers. Currently, field phenotyping is mostly carried out by manual methods that are prone to error, costly, labor-intensive and may come with adverse economic implications. Therefore, improvements in advanced field phenotyping capabilities and appropriate implementation are key factors for success in modern breeding and agricultural monitoring. In this review, we provide an overview of the current state of field phenotyping and the challenges limiting its implementation in some African countries. We suggest that the lack of appropriate field phenotyping infrastructures is impeding the development of improved crop cultivars and will have a detrimental impact on the agricultural sector and on food security. We highlight the prospects for integrating emerging and advanced low-cost phenotyping technologies into breeding protocols and characterizing crop responses to environmental challenges in field experimentation. Finally, we explore strategies for overcoming the barriers and maximizing the full potential of emerging field phenotyping technologies in African agriculture. This review paper will open new windows and provide new perspectives for breeders and the entire plant science community in Africa.

Remote sensing for field pea yield estimation: A study of multi-scale data fusion approaches in phenomics

Introduction

Remote sensing using unmanned aerial systems (UAS) are prevalent for phenomics and precision agricultural applications. The high-resolution data for these applications can provide useful spectral characteristics of crops associated with performance traits such as seed yield. With the recent availability of high-resolution satellite imagery, there has been growing interest in using this technology for plot-scale remote sensing applications, particularly those related to breeding programs. This study compared the features extracted from high-resolution satellite and UAS multispectral imagery (visible and near-infrared) to predict the seed yield from two diverse plot-scale field pea yield trials (advanced breeding and variety testing) using the random forest model.

Methods

The multi-modal (spectral and textural features) and multi-scale (satellite and UAS) data fusion approaches were evaluated to improve seed yield prediction accuracy across trials and time points. These approaches included both image fusion, such as pan-sharpening of satellite imagery with UAS imagery using intensity-hue-saturation transformation and additive wavelet luminance proportional approaches, and feature fusion, which involved integrating extracted spectral features. In addition, we also compared the image fusion approach to high-definition satellite data with a resolution of 0.15 m/pixel. The effectiveness of each approach was evaluated with data at both individual and combined time points.

Results and discussion

The major findings can be summarized as follows: (1) the inclusion of the texture features did not improve the model performance, (2) the performance of the model using spectral features from satellite imagery at its original resolution can provide similar results as UAS imagery, with variation depending on the field pea yield trial under study and the growth stage, (3) the model performance improved after applying multi-scale, multiple time point feature fusion, (4) the features extracted from the pan-sharpened satellite imagery using intensity-hue-saturation transformation (image fusion) showed better model performance than those with original satellite imagery or high definition imagery, and (5) the green normalized difference vegetation index and transformed triangular vegetation index were identified as key features contributing to high model performance across trials and time points. These findings demonstrate the potential of high-resolution satellite imagery and data fusion approaches for plot-scale phenomics applications.

On correlation between canopy vegetation and growth indexes of maize varieties with different nitrogen efficiencies

Studying the canopy spectral reflection characteristics of different N-efficient maize varieties and analyzing the relationship between their growth indicators and spectral vegetation indices can help the breeding and application of N-efficient maize varieties. To achieve the optimal management of N fertilizer resources, developing N-efficient maize varieties is necessary. In this research, maize varieties, i.e., the low-N-efficient (Zhengdan 958, ZD958), the high-N efficient (Xianyu 335, XY335), the double-high varieties (Qiule 368, QL368), and the double inefficient-type varieties (Yudan 606 YD606), were used as materials. Results indicate that nitrogen fertilization significantly increased the vegetation indices NDVI, GNDVI, GOSAVI, and RVI of maize varieties with different nitrogen efficiencies. These findings were consistent with the performance of yield, dry matter mass, and leaf nitrogen content and were also found highest under both medium and high nitrogen conditions in the double-high variety QL368. The correlations of dry matter quality, leaf nitrogen content, yield, and vegetation indices (NDVI, GNDVI, RVI, and GOSAVI) at the filling stage of different N-efficient maize varieties were all highly significant and positive. In this relationship, the best effect was found at the filling stages, with correlation coefficients reaching 0.772-0.942, 0.774-0.970, 0754-0.960, and 0.800-0.960. The results showed that the yield, dry matter weight, and leaf nitrogen content of maize varieties with different nitrogen efficiencies increased first and then stabilized with the increase in the nitrogen application level in different periods, and the highest nitrogen application level of maize yield should be between 270 and 360 kg/hm². At the filling stage, canopy vegetation index of maize varieties with different nitrogen efficiencies was positively correlated with yield, dry matter weight, and leaf nitrogen content, especially GNDVI and GOSAVI on the leaf nitrogen content. It can be used as a means to predict its growth index.

Proximal and remote sensing in plant phenomics: 20 years of progress, challenges, and perspectives

Plant phenomics (PP) has been recognized as a bottleneck in studying the interactions of genomics and environment on plants, limiting the progress of smart breeding and precise cultivation. High-throughput plant phenotyping is challenging owing to the spatio-temporal dynamics of traits. Proximal and remote sensing (PRS) techniques are increasingly used for plant phenotyping because of their advantages in multi-dimensional data acquisition and analysis. Substantial progress of PRS applications in PP has been observed over the last two decades and is analyzed here from an interdisciplinary perspective based on 2972 publications. This progress covers most aspects of PRS application in PP, including patterns of global spatial distribution and temporal dynamics, specific PRS technologies, phenotypic research fields, working environments, species, and traits. Subsequently, we demonstrate how to link PRS to multi-omics studies, including how to achieve multi-dimensional PRS data acquisition and processing, how to systematically integrate all kinds of phenotypic information and derive phenotypic knowledge with biological significance, and how to link PP to multi-omics association analysis. Finally, we identify three future perspectives for PRS-based PP: (1) strengthening the spatial and temporal consistency of PRS data, (2) exploring novel phenotypic traits, and (3) facilitating multi-omics communication.

Exploration of Alternative Approaches to Phenotyping of Late Leaf Spot and Groundnut Rosette Virus Disease for Groundnut Breeding

Late leaf spot (LLS), caused by Nothopassalora personata (Berk. & M.A Curt.), and groundnut rosette disease (GRD), [caused by groundnut rosette virus (GRV)], represent the most important biotic constraints to groundnut production in Uganda. Application of visual scores in selection for disease resistance presents a challenge especially when breeding experiments are large because it is resource-intensive, subjective, and error-prone. High-throughput phenotyping (HTP) can alleviate these constraints. The objective of this study is to determine if HTP derived indices can replace visual scores in a groundnut breeding program in Uganda. Fifty genotypes were planted under rain-fed conditions at two locations, Nakabango (GRD hotspot) and NaSARRI (LLS hotspot). Three handheld sensors (RGB camera, GreenSeeker, and Thermal camera) were used to collect HTP data on the dates visual scores were taken. Pearson correlation was made between the indices and visual scores, and logistic models for predicting visual scores were developed. Normalized difference vegetation index (NDVI) (r = -0.89) and red-green-blue (RGB) color space indices CSI (r = 0.76), v* (r = -0.80), and b* (r = -0.75) were highly correlated with LLS visual scores. NDVI (r = -0.72), v* (r = -0.71), b* (r = -0.64), and GA (r = -0.67) were best related to the GRD visual symptoms. Heritability estimates indicated NDVI, green area (GA), greener area (GGA), a*, and hue angle having the highest heritability (H ² > 0.75). Logistic models developed using these indices were 68% accurate for LLS and 45% accurate for GRD. The accuracy of the models improved to 91 and 84% when the nearest score method was used for LLS and GRD, respectively. Results presented in this study indicated that use of handheld remote sensing tools can improve screening for GRD and LLS resistance, and the best associated indices can be used for indirect selection for resistance and improve genetic gain in groundnut breeding.

Assessing Phytosanitary Application Efficiency of a Boom Sprayer Machine Using RGB Sensor in Grassy Fields

The systematic use of plant protection products is now being called into question with the growing awareness of the risks they can represent for the environment and human health. The application of precision agriculture technologies helps to improve agricultural production but also to rationalize input costs and improve ecological footprints. Here we present a study on fungicide application efficiency and its impact on the grass quality of a golf course green using the free open-source image analysis software FIJI (Image J) to analyze ground RGB (high-resolution digital cameras) and multispectral aerial imagery in combination with experimental data of spray pressure and hydraulic slot nozzle size of a boom sprayer machine. The multivariate regression model best explained variance in the normalized green-red difference index (NGRDI) as a relevant indicator of healthy turfgrass fields from the aerial, ground, and machine data set.

Genetic analysis and yield assessment of maize hybrids under low and optimal nitrogen environments

Development of maize hybrids that possess tolerant genes to low soil nitrogen is critical for long-term maize production in areas with low soil fertility. In this study, estimates for combining ability effects for grain yield and secondary traits of selected inbred lines, identify potential parents for hybrid development and yield potential of the crosses under sub-optimal and optimal N environments. One hundred hybrids were evaluated under sub-optimal and optimal N environments for two years. The experimental layout was a 10 × 10 alpha lattice design with two replications for two experiments. The results obtained showed that, the genotypes evaluated varied for grain yield and the characters measured under sub-optimal and optimal N conditions. Grain yield reduction due to N stress was 40.9%. General and specific combining ability (GCA) and (SCA) effects for mean squares varied for grain yield demonstrating the importance of additive and non-additive genetic effects for the hybrids evaluated under the study conditions. Even though significant variations were detected for GCA and SCA, GCA which is the additive gene action component mainly controlled the heritage of grain yield under both conditions. Inbred line 15 was identified as the superior parent with positive and significant GCA for grain yield under sub-optimal N. Genotypic correlation studies displayed that grain yield was positively correlated with ears per plant under sub-optimal N and was also positively associated with anthesis-silking interval under high N. The hybrids 52, 75, 81 and 37 were identified to be significantly superior in terms of grain yield, ASI and EPP under the two-contrasting conditions. The results suggest that, there is a need for development of low N tolerant inbred lines and hybrids for production under soils with low N status in the Guinea savanna of Ghana for high grain yield to be realised.

Phenotypic Traits Estimation and Preliminary Yield Assessment in Different Phenophases of Wheat Breeding Experiment Based on UAV Multispectral Images

The utility of unmanned aerial vehicles (UAV) imagery in retrieving phenotypic data to support plant breeding research has been a topic of increasing interest in recent years. The advantages of image-based phenotyping are related to the high spatial and temporal resolution of the retrieved data and the non-destructive and rapid method of data acquisition. This study trains parametric and nonparametric regression models to retrieve leaf area index (LAI), fraction of absorbed photosynthetically active radiation (fAPAR), fractional vegetation cover (fCover), leaf chlorophyll content (LCC), canopy chlorophyll content (CCC), and grain yield (GY) of winter durum wheat breeding experiment from four-bands UAV images. A ground dataset, collected during two field campaigns and complemented with data from a previous study, is used for model development. The dataset is split at random into two parts, one for training and one for testing the models. The tested parametric models use the vegetation index formula and parametric functions. The tested nonparametric models are partial least square regression (PLSR), random forest regression (RFR), support vector regression (SVR), kernel ridge regression (KRR), and Gaussian processes regression (GPR). The retrieved biophysical variables along with traditional phenotypic traits (plant height, yield, and tillering) are analysed for detection of genetic diversity, proximity, and similarity in the studied genotypes. Analysis of variance (ANOVA), Duncan’s multiple range test, correlation analysis, and principal component analysis (PCA) are performed with the phenotypic traits. The parametric and nonparametric models show close results for GY retrieval, with parametric models indicating slightly higher accuracy (R2 = 0.49; MRSE = 0.58 kg/plot; rRMSE = 6.1%). However, the nonparametric model, GPR, computes per pixel uncertainty estimation, making it more appealing for operational use. Furthermore, our results demonstrate that grain filling was better than flowering phenological stage to predict GY. The nonparametric models show better results for biophysical variables retrieval, with GPR presenting the highest prediction performance. Nonetheless, robust models are found only for LAI (R2 = 0.48; MRSE = 0.64; rRMSE = 13.5%) and LCC (R2 = 0.49; MRSE = 31.57 mg m−2; rRMSE = 6.4%) and therefore these are the only remotely sensed phenotypic traits included in the statistical analysis for preliminary assessment of wheat productivity. The results from ANOVA and PCA illustrate that the retrieved remotely sensed phenotypic traits are a valuable addition to the traditional phenotypic traits for plant breeding studies. We believe that these preliminary results could speed up crop improvement programs; however, stronger interdisciplinary research is still needed, as well as uncertainty estimation of the remotely sensed phenotypic traits.

Maize Yield Prediction at an Early Developmental Stage Using Multispectral Images and Genotype Data for Preliminary Hybrid Selection

Assessing crop production in the field often requires breeders to wait until the end of the season to collect yield-related measurements, limiting the pace of the breeding cycle. Early prediction of crop performance can reduce this constraint by allowing breeders more time to focus on the highest-performing varieties. Here, we present a multimodal deep learning model for predicting the performance of maize (Zea mays) at an early developmental stage, offering the potential to accelerate crop breeding. We employed multispectral images and eight vegetation indices, collected by an uncrewed aerial vehicle approximately 60 days after sowing, over three consecutive growing cycles (2017, 2018 and 2019). The multimodal deep learning approach was used to integrate field management and genotype information with the multispectral data, providing context to the conditions that the plants experienced during the trial. Model performance was assessed using holdout data, in which the model accurately predicted the yield (RMSE 1.07 t/ha, a relative RMSE of 7.60% of 16 t/ha, and R2 score 0.73) and identified the majority of high-yielding varieties, outperforming previously published models for early yield prediction. The inclusion of vegetation indices was important for model performance, with a normalized difference vegetation index and green with normalized difference vegetation index contributing the most to model performance. The model provides a decision support tool, identifying promising lines early in the field trial.

Wheat Yield Prediction Based on Unmanned Aerial Vehicles-Collected Red–Green–Blue Imagery

Unmanned aerial vehicles-collected (UAVs) digital red–green–blue (RGB) images provided a cost-effective method for precision agriculture applications regarding yield prediction. This study aims to fully explore the potential of UAV-collected RGB images in yield prediction of winter wheat by comparing it to multi-source observations, including thermal, structure, volumetric metrics, and ground-observed leaf area index (LAI) and chlorophyll content under the same level or across different levels of nitrogen fertilization. Color indices are vegetation indices calculated by the vegetation reflectance at visible bands (i.e., red, green, and blue) derived from RGB images. The results showed that some of the color indices collected at the jointing, flowering, and early maturity stages had high correlation (R2 = 0.76–0.93) with wheat grain yield. They gave the highest prediction power (R2 = 0.92–0.93) under four levels of nitrogen fertilization at the flowering stage. In contrast, the other measurements including canopy temperature, volumetric metrics, and ground-observed chlorophyll content showed lower correlation (R2 = 0.52–0.85) to grain yield. In addition, thermal information as well as volumetric metrics generally had little contribution to the improvement of grain yield prediction when combining them with color indices derived from digital images. Especially, LAI had inferior performance to color indices in grain yield prediction within the same level of nitrogen fertilization at the flowering stage (R2 = 0.00–0.40 and R2 = 0.55–0.68), and color indices provided slightly better prediction of yield than LAI at the flowering stage (R2 = 0.93, RMSE = 32.18 g/m2 and R2 = 0.89, RMSE = 39.82 g/m2) under all levels of nitrogen fertilization. This study highlights the capabilities of color indices in wheat yield prediction across genotypes, which also indicates the potential of precision agriculture application using many other flexible, affordable, and easy-to-handle devices such as mobile phones and near surface digital cameras in the future.

Peanut Leaf Wilting Estimation From RGB Color Indices and Logistic Models

Peanut (Arachis hypogaea L.) is an important crop for United States agriculture and worldwide. Low soil moisture is a major constraint for production in all peanut growing regions with negative effects on yield quantity and quality. Leaf wilting is a visual symptom of low moisture stress used in breeding to improve stress tolerance, but visual rating is slow when thousands of breeding lines are evaluated and can be subject to personnel scoring bias. Photogrammetry might be used instead. The objective of this article is to determine if color space indices derived from red-green-blue (RGB) images can accurately estimate leaf wilting for breeding selection and irrigation triggering in peanut production. RGB images were collected with a digital camera proximally and aerially by a unmanned aerial vehicle during 2018 and 2019. Visual rating was performed on the same days as image collection. Vegetation indices were intensity, hue, saturation, lightness, a^∗, b^∗, u^∗, v^∗, green area (GA), greener area (GGA), and crop senescence index (CSI). In particular, hue, a^∗, u^∗, GA, GGA, and CSI were significantly (p ≤ 0.0001) associated with leaf wilting. These indices were further used to train an ordinal logistic regression model for wilting estimation. This model had 90% accuracy when images were taken aerially and 99% when images were taken proximally. This article reports on a simple yet key aspect of peanut screening for tolerance to low soil moisture stress and uses novel, fast, cost-effective, and accurate RGB-derived models to estimate leaf wilting.

Scaling up high-throughput phenotyping for abiotic stress selection in the field

High-throughput phenotyping (HTP) is in its infancy for deployment in large-scale breeding programmes. With the ability to measure correlated traits associated with physiological ideotypes, in-field phenotyping methods are available for screening of abiotic stress responses. As cropping environments become more hostile and unpredictable due to the effects of climate change, the need to characterise variability across spatial and temporal scales will become increasingly important. The sensor technologies that have enabled HTP from macroscopic through to satellite sensors may also be utilised here to complement spatial characterisation using envirotyping, which can improve estimations of genotypic performance across environments by better accounting for variation at the plot, trial and inter-trial levels. Climate change is leading to increased variation at all physical and temporal scales in the cropping environment. Maintaining yield stability under circumstances with greater levels of abiotic stress while capitalising upon yield potential in good years, requires approaches to plant breeding that target the physiological limitations to crop performance in specific environments. This requires dynamic modelling of conditions within target populations of environments, GxExM predictions, clustering of environments so breeding trajectories can be defined, and the development of screens that enable selection for genetic gain to occur. High-throughput phenotyping (HTP), combined with related technologies used for envirotyping, can help to address these challenges. Non-destructive analysis of the morphological, biochemical and physiological qualities of plant canopies using HTP has great potential to complement whole-genome selection, which is becoming increasingly common in breeding programmes. A range of novel analytic techniques, such as machine learning and deep learning, combined with a widening range of sensors, allow rapid assessment of large breeding populations that are repeatable and objective. Secondary traits underlying radiation use efficiency and water use efficiency can be screened with HTP for selection at the early stages of a breeding programme. HTP and envirotyping technologies can also characterise spatial variability at trial and within-plot levels, which can be used to correct for spatial variations that confound measurements of genotypic values. This review explores HTP for abiotic stress selection through a physiological trait lens and additionally investigates the use of envirotyping and EC to characterise spatial variability at all physical scales in METs.

High-throughput image segmentation and machine learning approaches in the plant sciences across multiple scales

Agriculture has benefited greatly from the rise of big data and high-performance computing. The acquisition and analysis of data across biological scales have resulted in strategies modeling inter- actions between plant genotype and environment, models of root architecture that provide insight into resource utilization, and the elucidation of cell-to-cell communication mechanisms that are instrumental in plant development. Image segmentation and machine learning approaches for interpreting plant image data are among many of the computational methodologies that have evolved to address challenging agricultural and biological problems. These approaches have led to contributions such as the accelerated identification of gene that modulate stress responses in plants and automated high-throughput phenotyping for early detection of plant diseases. The continued acquisition of high throughput imaging across multiple biological scales provides opportunities to further push the boundaries of our understandings quicker than ever before. In this review, we explore the current state of the art methodologies in plant image segmentation and machine learning at the agricultural, organ, and cellular scales in plants. We show how the methodologies for segmentation and classification differ due to the diversity of physical characteristics found at these different scales. We also discuss the hardware technologies most commonly used at these different scales, the types of quantitative metrics that can be extracted from these images, and how the biological mechanisms by which plants respond to abiotic/biotic stresses or genotypic modifications can be extracted from these approaches.

High-Throughput Plant Phenotyping Platform (HT3P) as a Novel Tool for Estimating Agronomic Traits From the Lab to the Field

Food scarcity, population growth, and global climate change have propelled crop yield growth driven by high-throughput phenotyping into the era of big data. However, access to large-scale phenotypic data has now become a critical barrier that phenomics urgently must overcome. Fortunately, the high-throughput plant phenotyping platform (HT3P), employing advanced sensors and data collection systems, can take full advantage of non-destructive and high-throughput methods to monitor, quantify, and evaluate specific phenotypes for large-scale agricultural experiments, and it can effectively perform phenotypic tasks that traditional phenotyping could not do. In this way, HT3Ps are novel and powerful tools, for which various commercial, customized, and even self-developed ones have been recently introduced in rising numbers. Here, we review these HT3Ps in nearly 7 years from greenhouses and growth chambers to the field, and from ground-based proximal phenotyping to aerial large-scale remote sensing. Platform configurations, novelties, operating modes, current developments, as well the strengths and weaknesses of diverse types of HT3Ps are thoroughly and clearly described. Then, miscellaneous combinations of HT3Ps for comparative validation and comprehensive analysis are systematically present, for the first time. Finally, we consider current phenotypic challenges and provide fresh perspectives on future development trends of HT3Ps. This review aims to provide ideas, thoughts, and insights for the optimal selection, exploitation, and utilization of HT3Ps, and thereby pave the way to break through current phenotyping bottlenecks in botany.

Applying RGB- and Thermal-Based Vegetation Indices from UAVs for High-Throughput Field Phenotyping of Drought Tolerance in Forage Grasses

The persistence and productivity of forage grasses, important sources for feed production, are threatened by climate change-induced drought. Breeding programs are in search of new drought tolerant forage grass varieties, but those programs still rely on time-consuming and less consistent visual scoring by breeders. In this study, we evaluate whether Unmanned Aerial Vehicle (UAV) based remote sensing can complement or replace this visual breeder score. A field experiment was set up to test the drought tolerance of genotypes from three common forage types of two different species: Festuca arundinacea, diploid Lolium perenne and tetraploid Lolium perenne. Drought stress was imposed by using mobile rainout shelters. UAV flights with RGB and thermal sensors were conducted at five time points during the experiment. Visual-based indices from different colour spaces were selected that were closely correlated to the breeder score. Furthermore, several indices, in particular H and NDLab, from the HSV (Hue Saturation Value) and CIELab (Commission Internationale de l’éclairage) colour space, respectively, displayed a broad-sense heritability that was as high or higher than the visual breeder score, making these indices highly suited for high-throughput field phenotyping applications that can complement or even replace the breeder score. The thermal-based Crop Water Stress Index CWSI provided complementary information to visual-based indices, enabling the analysis of differences in ecophysiological mechanisms for coping with reduced water availability between species and ploidy levels. All species/types displayed variation in drought stress tolerance, which confirms that there is sufficient variation for selection within these groups of grasses. Our results confirmed the better drought tolerance potential of Festuca arundinacea, but also showed which Lolium perenne genotypes are more tolerant.

Meta-analysis of Unmanned Aerial Vehicle (UAV) Imagery for Agro-environmental Monitoring Using Machine Learning and Statistical Models

Unmanned Aerial Vehicle (UAV) imaging systems have recently gained significant attention from researchers and practitioners as a cost-effective means for agro-environmental applications. In particular, machine learning algorithms have been applied to UAV-based remote sensing data for enhancing the UAV capabilities of various applications. This systematic review was performed on studies through a statistical meta-analysis of UAV applications along with machine learning algorithms in agro-environmental monitoring. For this purpose, a total number of 163 peer-reviewed articles published in 13 high-impact remote sensing journals over the past 20 years were reviewed focusing on several features, including study area, application, sensor type, platform type, and spatial resolution. The meta-analysis revealed that 62% and 38% of the studies applied regression and classification models, respectively. Visible sensor technology was the most frequently used sensor with the highest overall accuracy among classification articles. Regarding regression models, linear regression and random forest were the most frequently applied models in UAV remote sensing imagery processing. Finally, the results of this study confirm that applying machine learning approaches on UAV imagery produces fast and reliable results. Agriculture, forestry, and grassland mapping were found as the top three UAV applications in this review, in 42%, 22%, and 8% of the studies, respectively.

Leaf versus whole-canopy remote sensing methodologies for crop monitoring under conservation agriculture: a case of study with maize in Zimbabwe

Enhancing nitrogen fertilization efficiency for improving yield is a major challenge for smallholder farming systems. Rapid and cost-effective methodologies with the capability to assess the effects of fertilization are required to facilitate smallholder farm management. This study compares maize leaf and canopy-based approaches for assessing N fertilization performance under different tillage, residue coverage and top-dressing conditions in Zimbabwe. Among the measurements made on individual leaves, chlorophyll readings were the best indicators for both N content in leaves (R < 0.700) and grain yield (GY) (R < 0.800). Canopy indices reported even higher correlation coefficients when assessing GY, especially those based on the measurements of the vegetation density as the green area indices (R < 0.850). Canopy measurements from both ground and aerial platforms performed very similar, but indices assessed from the UAV performed best in capturing the most relevant information from the whole plot and correlations with GY and leaf N content were slightly higher. Leaf-based measurements demonstrated utility in monitoring N leaf content, though canopy measurements outperformed the leaf readings in assessing GY parameters, while providing the additional value derived from the affordability and easiness of using a pheno-pole system or the high-throughput capacities of the UAVs.

How does nitrogen shape plant architecture?

Plant nitrogen (N), acquired mainly in the form of nitrate and ammonium from soil, dominates growth and development, and high-yield crop production relies heavily on N fertilization. The mechanisms of root adaptation to altered supply of N forms and concentrations have been well characterized and reviewed, while reports concerning the effects of N on the architecture of vegetative and reproductive organs are limited and are widely dispersed in the literature. In this review, we summarize the nitrate and amino acid regulation of shoot branching, flowering, and panicle development, as well as the N regulation of cell division and expansion in shaping plant architecture, mainly in cereal crops. The basic regulatory steps involving the control of plant architecture by the N supply are auxin-, cytokinin-, and strigolactone-controlled cell division in shoot apical meristem and gibberellin-controlled inverse regulation of shoot height and tillering. In addition, transport of amino acids has been shown to be involved in the control of shoot branching. The N supply may alter the timing and duration of the transition from the vegetative to the reproductive growth phase, which in turn may affect cereal crop architecture, particularly the structure of panicles for grain yield. Thus, proper manipulation of N-regulated architecture can increase crop yield and N use efficiency.

Remote sensing techniques and stable isotopes as phenotyping tools to assess wheat yield performance: Effects of growing temperature and vernalization

This study compares distinct phenotypic approaches to assess wheat performance under different growing temperatures and vernalization needs. A set of 38 (winter and facultative) wheat cultivars were planted in Valladolid (Spain) under irrigation and two contrasting planting dates: normal (late autumn), and late (late winter). The late plating trial exhibited a 1.5 °C increase in average crop temperature. Measurements with different remote sensing techniques were performed at heading and grain filling, as well as carbon isotope composition (δ¹³C) and nitrogen content analysis. Multispectral and RGB vegetation indices and canopy temperature related better to grain yield (GY) across the whole set of genotypes in the normal compared with the late planting, with indices (such as the RGB indices Hue, a* and the spectral indices NDVI, EVI and CCI) measured at grain filling performing the best. Aerially assessed remote sensing indices only performed better than ground-acquired ones at heading. Nitrogen content and δ¹³C correlated with GY at both planting dates. Correlations within winter and facultative genotypes were much weaker, particularly in the facultative subset. For both planting dates, the best GY prediction models were achieved when combining remote sensing indices with δ¹³C and nitrogen of mature grains. Implications for phenotyping in the context of increasing temperatures are further discussed.

Predicting Biomass and Yield in a Tomato Phenotyping Experiment Using UAV Imagery and Random Forest

Biomass and yield are key variables for assessing the production and performance of agricultural systems. Modeling and predicting the biomass and yield of individual plants at the farm scale represents a major challenge in precision agriculture, particularly when salinity and other abiotic stresses may play a role. Here, we evaluate a diversity panel of the wild tomato species (Solanum pimpinellifolium) through both field and unmanned aerial vehicle (UAV)-based phenotyping of 600 control and 600 salt-treated plants. The study objective was to predict fresh shoot mass, tomato fruit numbers, and yield mass at harvest based on a range of variables derived from the UAV imagery. UAV-based red-green-blue (RGB) imageries collected 1, 2, 4, 6, 7, and 8 weeks before harvest were also used to determine if prediction accuracies varied between control and salt-treated plants. Multispectral UAV-based imagery was also collected 1 and 2 weeks prior to harvest to further explore predictive insights. In order to estimate the end of season biomass and yield, a random forest machine learning approach was implemented using UAV-imagery-derived predictors as input variables. Shape features derived from the UAV, such as plant area, border length, width, and length, were found to have the highest importance in the predictions, followed by vegetation indices and the entropy texture measure. The multispectral UAV imagery collected 2 weeks prior to harvest produced the highest explained variances for fresh shoot mass (87.95%), fruit numbers (63.88%), and yield mass per plant (66.51%). The RGB UAV imagery produced very similar results to those of the multispectral UAV dataset, with the explained variance reducing as a function of increasing time to harvest. The results showed that predicting the yield of salt-stressed plants produced higher accuracies when the models excluded control plants, whereas predicting the yield of control plants was not affected by the inclusion of salt-stressed plants within the models. This research demonstrates that it is possible to predict the average biomass and yield up to 8 weeks prior to harvest within 4.23% of field-based measurements and up to 4 weeks prior to harvest at the individual plant level. Results from this work may be useful in providing guidance for yield forecasting of healthy and salt-stressed tomato plants, which in turn may inform growing practices, logistical planning, and sales operations.

Color Calibration of Proximal Sensing RGB Images of Oilseed Rape Canopy via Deep Learning Combined with K-Means Algorithm

Plant color is a key feature for estimating parameters of the plant grown under different conditions using remote sensing images. In this case, the variation in plant color should be only due to the influence of the growing conditions and not due to external confounding factors like a light source. Hence, the impact of the light source in plant color should be alleviated using color calibration algorithms. This study aims to develop an efficient, robust, and cutting-edge approach for automatic color calibration of three-band (red green blue: RGB) images. Specifically, we combined the k-means model and deep learning for accurate color calibration matrix (CCM) estimation. A dataset of 3150 RGB images for oilseed rape was collected by a proximal sensing technique under varying illumination conditions and used to train, validate, and test our proposed framework. Firstly, we manually derived CCMs by mapping RGB color values of each patch of a color chart obtained in an image to standard RGB (sRGB) color values of that chart. Secondly, we grouped the images into clusters according to the CCM assigned to each image using the unsupervised k-means algorithm. Thirdly, the images with the new cluster labels were used to train and validate the deep learning convolutional neural network (CNN) algorithm for an automatic CCM estimation. Finally, the estimated CCM was applied to the input image to obtain an image with a calibrated color. The performance of our model for estimating CCM was evaluated using the Euclidean distance between the standard and the estimated color values of the test dataset. The experimental results showed that our deep learning framework can efficiently extract useful low-level features for discriminating images with inconsistent colors and achieved overall training and validation accuracies of 98.00% and 98.53%, respectively. Further, the final CCM provided an average Euclidean distance of 16.23 ΔΕ and outperformed the previously reported methods. This proposed technique can be used in real-time plant phenotyping at multiscale levels.

Proposal for an Embedded System Architecture Using a GNDVI Algorithm to Support UAV-Based Agrochemical Spraying

An important area in precision agriculture is related to the efficient use of chemicals applied onto fields. Efforts have been made to diminish their use, aiming at cost reduction and fewer chemical residues in the final agricultural products. The use of unmanned aerial vehicles (UAVs) presents itself as an attractive and cheap alternative for spraying pesticides and fertilizers compared to conventional mass spraying performed by ordinary manned aircraft. Besides being cheaper than manned aircraft, small UAVs are capable of performing fine-grained instead of the mass spraying. Observing this improved method, this paper reports the design of an embedded real-time UAV spraying control system supported by onboard image processing. The proposal uses a normalized difference vegetation index (NDVI) algorithm to detect the exact locations in which the chemicals are needed. Using this information, the automated spraying control system performs punctual applications while the UAV navigates over the crops. The system architecture is designed to run on low-cost hardware, which demands an efficient NDVI algorithm. The experiments were conducted using Raspberry Pi 3 as the embedded hardware. First, experiments in a laboratory were conducted in which the algorithm was proved to be correct and efficient. Then, field tests in real conditions were conducted for validation purposes. These validation tests were performed in an agronomic research station with the Raspberry hardware integrated into a UAV flying over a field of crops. The average CPU usage was about 20% while memory consumption was about 70 MB for high definition images, with 4% CPU usage and 20.3 MB RAM being observed for low-resolution images. The average current measured to execute the proposed algorithm was 0.11 A. The obtained results prove that the proposed solution is efficient in terms of processing and energy consumption when used in embedded hardware and provides measurements which are coherent with the commercial GreenSeeker equipment.

A Robust Automated Image-Based Phenotyping Method for Rapid Vegetative Screening of Wheat Germplasm for Nitrogen Use Efficiency

Nitrogen use efficiency (NUE) in crops is generally low, with more than 60% of applied nitrogen (N) being lost to the environment, which increases production costs and affects ecosystems and human habitats. To overcome these issues, the breeding of crop varieties with improved NUE is needed, requiring efficient phenotyping methods along with molecular and genetic approaches. To develop an effective phenotypic screening method, experiments on wheat varieties under various N levels were conducted in the automated phenotyping platform at Plant Phenomics Victoria, Horsham. The results from the initial experiment showed that two relative N levels-5 mM and 20 mM, designated as low and optimum N, respectively-were ideal to screen a diverse range of wheat germplasm for NUE on the automated imaging phenotyping platform. In the second experiment, estimated plant parameters such as shoot biomass and top-view area, derived from digital images, showed high correlations with phenotypic traits such as shoot biomass and leaf area seven weeks after sowing, indicating that they could be used as surrogate measures of the latter. Plant growth analysis confirmed that the estimated plant parameters from the vegetative linear growth phase determined by the "broken-stick" model could effectively differentiate the performance of wheat varieties for NUE. Based on this study, vegetative phenotypic screens should focus on selecting wheat varieties under low N conditions, which were highly correlated with biomass and grain yield at harvest. Analysis indicated a relationship between controlled and field conditions for the same varieties, suggesting that greenhouse screens could be used to prioritise a higher value germplasm for subsequent field studies. Overall, our results showed that this phenotypic screening method is highly applicable and can be applied for the identification of N-efficient wheat germplasm at the vegetative growth phase.

Predicting Zea mays Flowering Time, Yield, and Kernel Dimensions by Analyzing Aerial Images

Image analysis methods for measuring crop phenotypes may replace traditional measurements if they more efficiently and reliably capture similar or superior information. This study used a recreational-grade unmanned aerial vehicle carrying a spectrally-modified consumer-grade camera to collect images in which each pixel value is a vegetation index based on the normalized difference between the blue and near infrared wavelength bands (BNDVI). The subjects of the study were Zea mays hybrids with good yield potential grown in 4-row plots. Flights were conducted at least once per week during three successive growing seasons in south-central Wisconsin. Average BNDVI for each plot (genotype) rose steadily through June, peaked in July, and then declined as plants matured. BNDVI histograms changed shape over the season as the canopy concealed soil, became more uniformly green, then senesced. Principal Components Analysis (PCA) captured the change in histogram shape. PC1 represented canopy closure. PC2 represented the mean of the BNDVI distribution. PC3 represented the spread of the distribution. Correlation analysis showed that flowering time correlated with PC2 and PC3 best (r ≈ 0.5) a few days before the event (day in which 50% of the plants exhibited tassels). Three ears were picked from each plot to quantify kernel dimensions by image analysis before each plot was mechanically harvested to determine grain weight per plot. Correlations between this measurement of yield and PC2 were low in June but exceeded 0.4 within 10 days after flowering. Kernel length correlated similarly with PC2. The correlation between PC2 and kernel thickness displayed a similar but inverted time course. These results indicate that greater mid-season BNDVI values correlate positively with yield comprised of tall, thin kernels. Partial least squares regression performed on the BNDVI time courses predicted flowering time (r = 0.54-0.79) and yield (r = 0.4-0.69). This three-year experiment demonstrated that readily available hardware and software can create a phenotyping platform capable of predicting maize flowering time, yield, and kernel dimensions to a useful degree.

New Strategies for Time Delay Estimation During System Calibration for UAV-Based GNSS/INS-Assisted Imaging Systems

The need for accurate 3D spatial information is growing rapidly in many of today’s key industries, such as precision agriculture, emergency management, infrastructure monitoring, and defense. Unmanned aerial vehicles (UAVs) equipped with global navigation satellite systems/inertial navigation systems (GNSS/INS) and consumer-grade digital imaging sensors are capable of providing accurate 3D spatial information at a relatively low cost. However, with the use of consumer-grade sensors, system calibration is critical for accurate 3D reconstruction. In this study, ‘consumer-grade’ refers to cameras that require system calibration by the user instead of by the manufacturer or other high-end laboratory settings, as well as relatively low-cost GNSS/INS units. In addition to classical spatial system calibration, many consumer-grade sensors also need temporal calibration for accurate 3D reconstruction. This study examines the accuracy impact of time delay in the synchronization between the GNSS/INS unit and cameras on-board UAV-based mapping systems. After reviewing existing strategies, this study presents two approaches (direct and indirect) to correct for time delay between GNSS/INS recorded event markers and actual time of image exposure. Our results show that both approaches are capable of handling and correcting this time delay, with the direct approach being more rigorous. When a time delay exists and the direct or indirect approach is applied, horizontal accuracy of 1–3 times the ground sampling distance (GSD) can be achieved without either the use of any ground control points (GCPs) or adjusting the original GNSS/INS trajectory information.

UAV and Ground Image-Based Phenotyping: A Proof of Concept with Durum Wheat

Climate change is one of the primary culprits behind the restraint in the increase of cereal crop yields. In order to address its effects, effort has been focused on understanding the interaction between genotypic performance and the environment. Recent advances in unmanned aerial vehicles (UAV) have enabled the assembly of imaging sensors into precision aerial phenotyping platforms, so that a large number of plots can be screened effectively and rapidly. However, ground evaluations may still be an alternative in terms of cost and resolution. We compared the performance of red–green–blue (RGB), multispectral, and thermal data of individual plots captured from the ground and taken from a UAV, to assess genotypic differences in yield. Our results showed that crop vigor, together with the quantity and duration of green biomass that contributed to grain filling, were critical phenotypic traits for the selection of germplasm that is better adapted to present and future Mediterranean conditions. In this sense, the use of RGB images is presented as a powerful and low-cost approach for assessing crop performance. For example, broad sense heritability for some RGB indices was clearly higher than that of grain yield in the support irrigation (four times), rainfed (by 50%), and late planting (10%). Moreover, there wasn’t any significant effect from platform proximity (distance between the sensor and crop canopy) on the vegetation indexes, and both ground and aerial measurements performed similarly in assessing yield.