ChronoRoot: High-throughput phenotyping by deep segmentation networks reveals novel temporal parameters of plant root system architecture

The transcription factor NF-YA10 determines the area explored by Arabidopsis thaliana roots and directly regulates LAZY genes

Root developmental plasticity relies on transcriptional reprogramming, which largely depends on the activity of transcription factors (TFs). NF-YA2 and NF-YA10 (nuclear factor A2 and A10) are downregulated by the specific miRNA isoform miR169defg. Here, we analyzed the role of the Arabidopsis thaliana TF NF-YA10 in the regulation of lateral root (LR) development. Plants expressing a version of NF-YA10 resistant to miR169 cleavage showed a perturbation in the LR gravitropic response. By extracting several features of root architecture using an improved version of the ChronoRoot deep-learning-based phenotyping system, we uncovered that these plants showed a differential angle of LRs over time when compared to Col-0. Detailed phenotyping of root growth dynamics revealed that NF-YA10 misregulation modulates the area explored by Arabidopsis roots. Furthermore, we found that NF-YA10 directly regulates LAZY genes, which were previously linked to gravitropism, by targeting their promoter regions. Hence, the TF NF-YA10 is a new element in the control of LR bending and root system architecture.

Research on Fine-Grained Phenotypic Analysis of Temporal Root Systems - Improved YoloV8seg Applied for Fine-Grained Analysis of In Situ Root Temporal Phenotypes

Root systems are crucial organs for crops to absorb water and nutrients. Conducting phenotypic analysis on roots is of great importance. To date, methods for root system phenotypic analysis have predominantly focused on semantic segmentation, integrating phenotypic extraction software to achieve comprehensive root phenotype analysis. This study demonstrates the feasibility of instance segmentation tasks on in situ root system images. An improved YoloV8n-seg network tailored for detecting elongated roots is proposed, which outperforms the original YoloV8seg in all network performance metrics. Additionally, the post-processing method introduced reduces root identification errors, ensuring a one-to-one correspondence between each root system and its detection box. The experiment yields phenotypic parameters for fine-grained roots, such as fine-grained root length, diameter, and curvature. Compared to traditional parameters like total root length and average root diameter, these detailed phenotypic analyses enable more precise phenotyping and facilitate accurate artificial intervention during crop cultivation.

Variation in forest root image annotation by experts, novices, and AI

BACKGROUND

The manual study of root dynamics using images requires huge investments of time and resources and is prone to previously poorly quantified annotator bias. Artificial intelligence (AI) image-processing tools have been successful in overcoming limitations of manual annotation in homogeneous soils, but their efficiency and accuracy is yet to be widely tested on less homogenous, non-agricultural soil profiles, e.g., that of forests, from which data on root dynamics are key to understanding the carbon cycle. Here, we quantify variance in root length measured by human annotators with varying experience levels. We evaluate the application of a convolutional neural network (CNN) model, trained on a software accessible to researchers without a machine learning background, on a heterogeneous minirhizotron image dataset taken in a multispecies, mature, deciduous temperate forest.

RESULTS

Less experienced annotators consistently identified more root length than experienced annotators. Root length annotation also varied between experienced annotators. The CNN root length results were neither precise nor accurate, taking ~ 10% of the time but significantly overestimating root length compared to expert manual annotation (p = 0.01). The CNN net root length change results were closer to manual (p = 0.08) but there remained substantial variation.

CONCLUSIONS

Manual root length annotation is contingent on the individual annotator. The only accessible CNN model cannot yet produce root data of sufficient accuracy and precision for ecological applications when applied to a complex, heterogeneous forest image dataset. A continuing evaluation and development of accessible CNNs for natural ecosystems is required.

Rice breeding for low input agriculture

A low-input-based farming system can reduce the adverse effects of modern agriculture through proper utilization of natural resources. Modern varieties often need to improve in low-input settings since they are not adapted to these systems. In addition, rice is one of the most widely cultivated crops worldwide. Enhancing rice performance under a low input system will significantly reduce the environmental concerns related to rice cultivation. Traits that help rice to maintain yield performance under minimum inputs like seedling vigor, appropriate root architecture for nutrient use efficiency should be incorporated into varieties for low input systems through integrated breeding approaches. Genes or QTLs controlling nutrient uptake, nutrient assimilation, nutrient remobilization, and root morphology need to be properly incorporated into the rice breeding pipeline. Also, genes/QTLs controlling suitable rice cultivars for sustainable farming. Since several variables influence performance under low input conditions, conventional breeding techniques make it challenging to work on many traits. However, recent advances in omics technologies have created enormous opportunities for rapidly improving multiple characteristics. This review highlights current research on features pertinent to low-input agriculture and provides an overview of alternative genomics-based breeding strategies for enhancing genetic gain in rice suitable for low-input farming practices.

Convolutional neural networks combined with conventional filtering to semantically segment plant roots in rapidly scanned X-ray computed tomography volumes with high noise levels

BACKGROUND

X-ray computed tomography (CT) is a powerful tool for measuring plant root growth in soil. However, a rapid scan with larger pots, which is required for throughput-prioritized crop breeding, results in high noise levels, low resolution, and blurred root segments in the CT volumes. Moreover, while plant root segmentation is essential for root quantification, detailed conditional studies on segmenting noisy root segments are scarce. The present study aimed to investigate the effects of scanning time and deep learning-based restoration of image quality on semantic segmentation of blurry rice (Oryza sativa) root segments in CT volumes.

RESULTS

VoxResNet, a convolutional neural network-based voxel-wise residual network, was used as the segmentation model. The training efficiency of the model was compared using CT volumes obtained at scan times of 33, 66, 150, 300, and 600 s. The learning efficiencies of the samples were similar, except for scan times of 33 and 66 s. In addition, The noise levels of predicted volumes differd among scanning conditions, indicating that the noise level of a scan time ≥ 150 s does not affect the model training efficiency. Conventional filtering methods, such as median filtering and edge detection, increased the training efficiency by approximately 10% under any conditions. However, the training efficiency of 33 and 66 s-scanned samples remained relatively low. We concluded that scan time must be at least 150 s to not affect segmentation. Finally, we constructed a semantic segmentation model for 150 s-scanned CT volumes, for which the Dice loss reached 0.093. This model could not predict the lateral roots, which were not included in the training data. This limitation will be addressed by preparing appropriate training data.

CONCLUSIONS

A semantic segmentation model can be constructed even with rapidly scanned CT volumes with high noise levels. Given that scanning times ≥ 150 s did not affect the segmentation results, this technique holds promise for rapid and low-dose scanning. This study offers insights into images other than CT volumes with high noise levels that are challenging to determine when annotating.

Improved Transformer for Time Series Senescence Root Recognition

The root is an important organ for plants to obtain nutrients and water, and its phenotypic characteristics are closely related to its functions. Deep-learning-based high-throughput in situ root senescence feature extraction has not yet been published. In light of this, this paper suggests a technique based on the transformer neural network for retrieving cotton's in situ root senescence properties. High-resolution in situ root pictures with various levels of senescence are the main subject of the investigation. By comparing the semantic segmentation of the root system by general convolutional neural networks and transformer neural networks, SegFormer-UN (large) achieves the optimal evaluation metrics with mIoU, mRecall, mPrecision, and mF1 metric values of 81.52%, 86.87%, 90.98%, and 88.81%, respectively. The segmentation results indicate more accurate predictions at the connections of root systems in the segmented images. In contrast to 2 algorithms for cotton root senescence extraction based on deep learning and image processing, the in situ root senescence recognition algorithm using the SegFormer-UN model has a parameter count of 5.81 million and operates at a fast speed, approximately 4 min per image. It can accurately identify senescence roots in the image. We propose that the SegFormer-UN model can rapidly and nondestructively identify senescence root in in situ root images, providing important methodological support for efficient crop senescence research.

In Situ Root Dataset Expansion Strategy Based on an Improved CycleGAN Generator

The root system plays a vital role in plants' ability to absorb water and nutrients. In situ root research offers an intuitive approach to exploring root phenotypes and their dynamics. Deep-learning-based root segmentation methods have gained popularity, but they require large labeled datasets for training. This paper presents an expansion method for in situ root datasets using an improved CycleGAN generator. In addition, spatial-coordinate-based target background separation method is proposed, which solves the issue of background pixel variations caused by generator errors. Compared to traditional threshold segmentation methods, this approach demonstrates superior speed, accuracy, and stability. Moreover, through time-division soil image acquisition, diverse culture medium can be replaced in in situ root images, thereby enhancing dataset versatility. After validating the performance of the Improved_UNet network on the augmented dataset, the optimal results show a 0.63% increase in mean intersection over union, 0.41% in F1, and 0.04% in accuracy. In terms of generalization performance, the optimal results show a 33.6% increase in mean intersection over union, 28.11% in F1, and 2.62% in accuracy. The experimental results confirm the feasibility and practicality of the proposed dataset augmentation strategy. In the future, we plan to combine normal mapping with rendering software to achieve more accurate shading simulations of in situ roots. In addition, we aim to create a broader range of images that encompass various crop varieties and soil types.

Tiller estimation method using deep neural networks

This paper describes a method based on a deep neural network (DNN) for estimating the number of tillers on a plant. A tiller is a branch on a grass plant, and the number of tillers is one of the most important determinants of yield. Traditionally, the tiller number is usually counted by hand, and so an automated approach is necessary for high-throughput phenotyping. Conventional methods use heuristic features to estimate the tiller number. Based on the successful application of DNNs in the field of computer vision, the use of DNN-based features instead of heuristic features is expected to improve the estimation accuracy. However, as DNNs generally require large volumes of data for training, it is difficult to apply them to estimation problems for which large training datasets are unavailable. In this paper, we use two strategies to overcome the problem of insufficient training data: the use of a pretrained DNN model and the use of pretext tasks for learning the feature representation. We extract features using the resulting DNNs and estimate the tiller numbers through a regression technique. We conducted experiments using side-view whole plant images taken with plan backgroud. The experimental results show that the proposed methods using a pretrained model and specific pretext tasks achieve better performance than the conventional method.

Plant Root Phenotyping Using Deep Conditional GANs and Binary Semantic Segmentation

This paper develops an approach to perform binary semantic segmentation on Arabidopsis thaliana root images for plant root phenotyping using a conditional generative adversarial network (cGAN) to address pixel-wise class imbalance. Specifically, we use Pix2PixHD, an image-to-image translation cGAN, to generate realistic and high resolution images of plant roots and annotations similar to the original dataset. Furthermore, we use our trained cGAN to triple the size of our original root dataset to reduce pixel-wise class imbalance. We then feed both the original and generated datasets into SegNet to semantically segment the root pixels from the background. Furthermore, we postprocess our segmentation results to close small, apparent gaps along the main and lateral roots. Lastly, we present a comparison of our binary semantic segmentation approach with the state-of-the-art in root segmentation. Our efforts demonstrate that cGAN can produce realistic and high resolution root images, reduce pixel-wise class imbalance, and our segmentation model yields high testing accuracy (of over 99%), low cross entropy error (of less than 2%), high Dice Score (of near 0.80), and low inference time for near real-time processing.

Root system architecture and environmental flux analysis in mature crops using 3D root mesocosms

Current methods of root sampling typically only obtain small or incomplete sections of root systems and do not capture their true complexity. To facilitate the visualization and analysis of full-sized plant root systems in 3-dimensions, we developed customized mesocosm growth containers. While highly scalable, the design presented here uses an internal volume of 45 ft³ (1.27 m³), suitable for large crop and bioenergy grass root systems to grow largely unconstrained. Furthermore, they allow for the excavation and preservation of 3-dimensional root system architecture (RSA), and facilitate the collection of time-resolved subterranean environmental data. Sensor arrays monitoring matric potential, temperature and CO₂ levels are buried in a grid formation at various depths to assess environmental fluxes at regular intervals. Methods of 3D data visualization of fluxes were developed to allow for comparison with root system architectural traits. Following harvest, the recovered root system can be digitally reconstructed in 3D through photogrammetry, which is an inexpensive method requiring only an appropriate studio space and a digital camera. We developed a pipeline to extract features from the 3D point clouds, or from derived skeletons that include point cloud voxel number as a proxy for biomass, total root system length, volume, depth, convex hull volume and solidity as a function of depth. Ground-truthing these features with biomass measurements from manually dissected root systems showed a high correlation. We evaluated switchgrass, maize, and sorghum root systems to highlight the capability for species wide comparisons. We focused on two switchgrass ecotypes, upland (VS16) and lowland (WBC3), in identical environments to demonstrate widely different root system architectures that may be indicative of core differences in their rhizoeconomic foraging strategies. Finally, we imposed a strong physiological water stress and manipulated the growth medium to demonstrate whole root system plasticity in response to environmental stimuli. Hence, these new "3D Root Mesocosms" and accompanying computational analysis provides a new paradigm for study of mature crop systems and the environmental fluxes that shape them.

High-throughput and automatic structural and developmental root phenotyping on Arabidopsis seedlings

BACKGROUND

High-throughput phenotyping is crucial for the genetic and molecular understanding of adaptive root system development. In recent years, imaging automata have been developed to acquire the root system architecture of many genotypes grown in Petri dishes to explore the Genetic x Environment (GxE) interaction. There is now an increasing interest in understanding the dynamics of the adaptive responses, such as the organ apparition or the growth rate. However, due to the increasing complexity of root architectures in development, the accurate description of the topology, geometry, and dynamics of a growing root system remains a challenge.

RESULTS

We designed a high-throughput phenotyping method, combining an imaging device and an automatic analysis pipeline based on registration and topological tracking, capable of accurately describing the topology and geometry of observed root systems in 2D + t. The method was tested on a challenging Arabidopsis seedling dataset, including numerous root occlusions and crossovers. Static phenes are estimated with high accuracy ([Formula: see text] and [Formula: see text] for primary and second-order roots length, respectively). These performances are similar to state-of-the-art results obtained on root systems of equal or lower complexity. In addition, our pipeline estimates dynamic phenes accurately between two successive observations ([Formula: see text] for lateral root growth).

CONCLUSIONS

We designed a novel method of root tracking that accurately and automatically measures both static and dynamic parameters of the root system architecture from a novel high-throughput root phenotyping platform. It has been used to characterise developing patterns of root systems grown under various environmental conditions. It provides a solid basis to explore the GxE interaction controlling the dynamics of root system architecture adaptive responses. In future work, our approach will be adapted to a wider range of imaging configurations and species.

RootPainter: deep learning segmentation of biological images with corrective annotation

Convolutional neural networks (CNNs) are a powerful tool for plant image analysis, but challenges remain in making them more accessible to researchers without a machine-learning background. We present RootPainter, an open-source graphical user interface based software tool for the rapid training of deep neural networks for use in biological image analysis. We evaluate RootPainter by training models for root length extraction from chicory (Cichorium intybus L.) roots in soil, biopore counting, and root nodule counting. We also compare dense annotations with corrective ones that are added during the training process based on the weaknesses of the current model. Five out of six times the models trained using RootPainter with corrective annotations created within 2 h produced measurements strongly correlating with manual measurements. Model accuracy had a significant correlation with annotation duration, indicating further improvements could be obtained with extended annotation. Our results show that a deep-learning model can be trained to a high accuracy for the three respective datasets of varying target objects, background, and image quality with < 2 h of annotation time. They indicate that, when using RootPainter, for many datasets it is possible to annotate, train, and complete data processing within 1 d.

Machine Learning and 3D Reconstruction of Materials Surface for Nondestructive Inspection

During the steel pipeline installation, special attention is paid to the butt weld control performed by fusion welding. The operation of the currently popular automated X-ray and ultrasonic testing complexes is associated with high resource and monetary costs. In this regard, this work is devoted to the development of alternative and cost-effective means of preliminary quality control of the work performed based on the visual testing method. To achieve this goal, a hardware platform based on a single board Raspberry Pi4 minicomputer and a set of available modules and expansion cards is proposed, and software whose main functionality is implemented based on the systemic application of computer vision algorithms and machine learning methods. The YOLOv5 object detection algorithm and the random forest machine learning model were used as a defect detection and classification system. The mean average precision (mAP) of the trained YOLOv5 algorithm based on extracted weld contours is 86.9%. A copy of YOLOv5 trained on the images of control objects showed a mAP result of 96.8%. Random forest identifying of the defect precursor based on the point clouds of the weld surface achieved a mAP of 87.5%.

ChronoRoot: High-throughput phenotyping by deep segmentation networks reveals novel temporal parameters of plant root system architecture

BACKGROUND

Deep learning methods have outperformed previous techniques in most computer vision tasks, including image-based plant phenotyping. However, massive data collection of root traits and the development of associated artificial intelligence approaches have been hampered by the inaccessibility of the rhizosphere. Here we present ChronoRoot, a system that combines 3D-printed open-hardware with deep segmentation networks for high temporal resolution phenotyping of plant roots in agarized medium.

RESULTS

We developed a novel deep learning-based root extraction method that leverages the latest advances in convolutional neural networks for image segmentation and incorporates temporal consistency into the root system architecture reconstruction process. Automatic extraction of phenotypic parameters from sequences of images allowed a comprehensive characterization of the root system growth dynamics. Furthermore, novel time-associated parameters emerged from the analysis of spectral features derived from temporal signals.

CONCLUSIONS

Our work shows that the combination of machine intelligence methods and a 3D-printed device expands the possibilities of root high-throughput phenotyping for genetics and natural variation studies, as well as the screening of clock-related mutants, revealing novel root traits.