A Deep Learning Method for Fully Automatic Stomatal Morphometry and Maximal Conductance Estimation

FieldDino: Rapid In-Field Stomatal Anatomy and Physiology Phenotyping

Stomatal anatomy and physiology define CO2 availability for photosynthesis and regulate plant water use. Despite being key drivers of yield and dynamic responsiveness to abiotic stresses, conventional measurement techniques of stomatal traits are laborious and slow, limiting adoption in plant breeding. Advances in instrumentation and data analyses present an opportunity to screen stomatal traits at scales relevant to plant breeding. We present a high-throughput robust field-based phenotyping approach, FieldDino, for screening stomatal physiology and anatomy. The method allows measurements to be collected in < 15 s and consists of: (1) stomatal conductance measurements using a handheld porometer; (2) in situ collection of epidermal images with a digital microscope, 3D-printed leaf clip and Python-based app; and (3) automated deep-learning analysis of stomatal features. The YOLOv8-M model trained on images collected in the field achieved strong performance metrics with an mAp@0.5 of 97.1% for stomatal detection. When validated in large field trials of 200 wheat genotypes under two irrigation treatments, FieldDino captured wide diversity in stomatal traits. FieldDino enables stomatal data collection and analysis at unprecedented scales in the field. This will advance research on stomatal biology and accelerate the incorporation of stomatal traits into plant breeding programs for resilience to abiotic stress.

Machine learning-enabled computer vision for plant phenotyping: a primer on AI/ML and a case study on stomatal patterning

Artificial intelligence and machine learning (AI/ML) can be used to automatically analyze large image datasets. One valuable application of this approach is estimation of plant trait data contained within images. Here we review 39 papers that describe the development and/or application of such models for estimation of stomatal traits from epidermal micrographs. In doing so, we hope to provide plant biologists with a foundational understanding of AI/ML and summarize the current capabilities and limitations of published tools. While most models show human-level performance for stomatal density (SD) quantification at superhuman speed, they are often likely to be limited in how broadly they can be applied across phenotypic diversity associated with genetic, environmental, or developmental variation. Other models can make predictions across greater phenotypic diversity and/or additional stomatal/epidermal traits, but require significantly greater time investment to generate ground-truth data. We discuss the challenges and opportunities presented by AI/ML-enabled computer vision analysis, and make recommendations for future work to advance accelerated stomatal phenotyping.

Application of deep learning for the analysis of stomata: a review of current methods and future directions

Plant physiology and metabolism rely on the function of stomata, structures on the surface of above-ground organs that facilitate the exchange of gases with the atmosphere. The morphology of the guard cells and corresponding pore that make up the stomata, as well as the density (number per unit area), are critical in determining overall gas exchange capacity. These characteristics can be quantified visually from images captured using microscopy, traditionally relying on time-consuming manual analysis. However, deep learning (DL) models provide a promising route to increase the throughput and accuracy of plant phenotyping tasks, including stomatal analysis. Here we review the published literature on the application of DL for stomatal analysis. We discuss the variation in pipelines used, from data acquisition, pre-processing, DL architecture, and output evaluation to post-processing. We introduce the most common network structures, the plant species that have been studied, and the measurements that have been performed. Through this review, we hope to promote the use of DL methods for plant phenotyping tasks and highlight future requirements to optimize uptake, predominantly focusing on the sharing of datasets and generalization of models as well as the caveats associated with utilizing image data to infer physiological function.

RotatedStomataNet: a deep rotated object detection network for directional stomata phenotype analysis

KEY MESSAGE

Innovatively, we consider stomatal detection as rotated object detection and provide an end-to-end, batch, rotated, real-time stomatal density and aperture size intelligent detection and identification system, RotatedeStomataNet. Stomata acts as a pathway for air and water vapor in the course of respiration, transpiration, and other gas metabolism, so the stomata phenotype is important for plant growth and development. Intelligent detection of high-throughput stoma is a key issue. Nevertheless, currently available methods usually suffer from detection errors or cumbersome operations when facing densely and unevenly arranged stomata. The proposed RotatedStomataNet innovatively regards stomata detection as rotated object detection, enabling an end-to-end, real-time, and intelligent phenotype analysis of stomata and apertures. The system is constructed based on the Arabidopsis and maize stomatal data sets acquired destructively, and the maize stomatal data set acquired in a non-destructive way, enabling the one-stop automatic collection of phenotypic, such as the location, density, length, and width of stomata and apertures without step-by-step operations. The accuracy of this system to acquire stomata and apertures has been well demonstrated in monocotyledon and dicotyledon, such as Arabidopsis, soybean, wheat, and maize. The experimental results that the prediction results of the method are consistent with those of manual labeling. The test sets, the system code, and their usage are also given ( https://github.com/AITAhenu/RotatedStomataNet ).

Plant microphenotype: from innovative imaging to computational analysis

The microphenotype plays a key role in bridging the gap between the genotype and the complex macro phenotype. In this article, we review the advances in data acquisition and the intelligent analysis of plant microphenotyping and present applications of microphenotyping in plant science over the past two decades. We then point out several challenges in this field and suggest that cross-scale image acquisition strategies, powerful artificial intelligence algorithms, advanced genetic analysis, and computational phenotyping need to be established and performed to better understand interactions among genotype, environment, and management. Microphenotyping has entered the era of Microphenotyping 3.0 and will largely advance functional genomics and plant science.

Climate change impacts on crop breeding: Targeting interacting biotic and abiotic stresses for wheat improvement

Wheat (Triticum aestivum L.) as a staple crop is closely interwoven into the development of modern society. Its influence on culture and economic development is global. Recent instability in wheat markets has demonstrated its importance in guaranteeing food security across national borders. Climate change threatens food security as it interacts with a multitude of factors impacting wheat production. The challenge needs to be addressed with a multidisciplinary perspective delivered across research, private, and government sectors. Many experimental studies have identified the major biotic and abiotic stresses impacting wheat production, but fewer have addressed the combinations of stresses that occur simultaneously or sequentially during the wheat growth cycle. Here, we argue that biotic and abiotic stress interactions, and the genetics and genomics underlying them, have been insufficiently addressed by the crop science community. We propose this as a reason for the limited transfer of practical and feasible climate adaptation knowledge from research projects into routine farming practice. To address this gap, we propose that novel methodology integration can align large volumes of data available from crop breeding programs with increasingly cheaper omics tools to predict wheat performance under different climate change scenarios. Underlying this is our proposal that breeders design and deliver future wheat ideotypes based on new or enhanced understanding of the genetic and physiological processes that are triggered when wheat is subjected to combinations of stresses. By defining this to a trait and/or genetic level, new insights can be made for yield improvement under future climate conditions.

Image-based classification of wheat spikes by glume pubescence using convolutional neural networks

Introduction

Pubescence is an important phenotypic trait observed in both vegetative and generative plant organs. Pubescent plants demonstrate increased resistance to various environmental stresses such as drought, low temperatures, and pests. It serves as a significant morphological marker and aids in selecting stress-resistant cultivars, particularly in wheat. In wheat, pubescence is visible on leaves, leaf sheath, glumes and nodes. Regarding glumes, the presence of pubescence plays a pivotal role in its classification. It supplements other spike characteristics, aiding in distinguishing between different varieties within the wheat species. The determination of pubescence typically involves visual analysis by an expert. However, methods without the use of binocular loupe tend to be subjective, while employing additional equipment is labor-intensive. This paper proposes an integrated approach to determine glume pubescence presence in spike images captured under laboratory conditions using a digital camera and convolutional neural networks.

Methods

Initially, image segmentation is conducted to extract the contour of the spike body, followed by cropping of the spike images to an equal size. These images are then classified based on glume pubescence (pubescent/glabrous) using various convolutional neural network architectures (Resnet-18, EfficientNet-B0, and EfficientNet-B1). The networks were trained and tested on a dataset comprising 9,719 spike images.

Results

For segmentation, the U-Net model with EfficientNet-B1 encoder was chosen, achieving the segmentation accuracy IoU = 0.947 for the spike body and 0.777 for awns. The classification model for glume pubescence with the highest performance utilized the EfficientNet-B1 architecture. On the test sample, the model exhibited prediction accuracy parameters of F1 = 0.85 and AUC = 0.96, while on the holdout sample it showed F1 = 0.84 and AUC = 0.89. Additionally, the study investigated the relationship between image scale, artificial distortions, and model prediction performance, revealing that higher magnification and smaller distortions yielded a more accurate prediction of glume pubescence.

Salinity-specific stomatal conductance model parameters are reduced by stomatal saturation conductance and area via leaf nitrogen

Modeling stomatal behavior is necessary for accurate stomatal simulation and predicting the terrestrial water‑carbon cycle. Although the Ball-Berry and Medlyn stomatal conductance (g_s) models have been widely used, variations and the drivers of their key slope parameters (m and g₁) remain poorly understood under salinity stress. We measured leaf gas exchange, physiological and biochemical traits, soil water content and electrical conductivity of saturation extract (EC_e), and fitted slope parameters of two genotypes of maize growing in two water and two salinity levels. We found m was different between the genotypes, but no difference in g₁. Salinity stress reduced m and g₁, saturated stomatal conductance (g_sat), the fraction of leaf epidermis area allocation to stomata (f_s), and leaf nitrogen (N) content, and increased EC_e, but no marked decrease in slope parameters under drought. Both m and g₁ were positively correlated with g_sat, f_s, and leaf N content, and negatively correlated with EC_e in the same fashion among the two genotypes. Salinity stress altered m and g₁ by modulating g_sat and f_s via leaf N content. The prediction accuracy of g_s was improved using salinity-specific slope parameters, with root mean square error (RMSE) being decreased from 0.056 to 0.046 and 0.066 to 0.025 mol m^-2 s^-1 for the Ball-Berry and Medlyn models, respectively. This study provides a modeling approach to improving the simulation of stomatal conductance under salinity.

StomaAI: an efficient and user-friendly tool for measurement of stomatal pores and density using deep computer vision

Using microscopy to investigate stomatal behaviour is common in plant physiology research. Manual inspection and measurement of stomatal pore features is low throughput, relies upon expert knowledge to record stomatal features accurately, requires significant researcher time and investment, and can represent a significant bottleneck to research pipelines. To alleviate this, we introduce StomaAI (SAI): a reliable, user-friendly and adaptable tool for stomatal pore and density measurements via the application of deep computer vision, which has been initially calibrated and deployed for the model plant Arabidopsis (dicot) and the crop plant barley (monocot grass). SAI is capable of producing measurements consistent with human experts and successfully reproduced conclusions of published datasets. SAI boosts the number of images that can be evaluated in a fraction of the time, so can obtain a more accurate representation of stomatal traits than is routine through manual measurement. An online demonstration of SAI is hosted at https://sai.aiml.team, and the full local application is publicly available for free on GitHub through https://github.com/xdynames/sai-app.