1
|
Farooq MA, Gao S, Hassan MA, Huang Z, Rasheed A, Hearne S, Prasanna B, Li X, Li H. Artificial intelligence in plant breeding. Trends Genet 2024:S0168-9525(24)00167-7. [PMID: 39117482 DOI: 10.1016/j.tig.2024.07.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2024] [Revised: 07/06/2024] [Accepted: 07/12/2024] [Indexed: 08/10/2024]
Abstract
Harnessing cutting-edge technologies to enhance crop productivity is a pivotal goal in modern plant breeding. Artificial intelligence (AI) is renowned for its prowess in big data analysis and pattern recognition, and is revolutionizing numerous scientific domains including plant breeding. We explore the wider potential of AI tools in various facets of breeding, including data collection, unlocking genetic diversity within genebanks, and bridging the genotype-phenotype gap to facilitate crop breeding. This will enable the development of crop cultivars tailored to the projected future environments. Moreover, AI tools also hold promise for refining crop traits by improving the precision of gene-editing systems and predicting the potential effects of gene variants on plant phenotypes. Leveraging AI-enabled precision breeding can augment the efficiency of breeding programs and holds promise for optimizing cropping systems at the grassroots level. This entails identifying optimal inter-cropping and crop-rotation models to enhance agricultural sustainability and productivity in the field.
Collapse
Affiliation(s)
- Muhammad Amjad Farooq
- State Key Laboratory of Crop Gene Resources and Breeding, Institute of Crop Sciences, Chinese Academy of Agricultural Sciences (CAAS), International Maize and Wheat Improvement Center (CIMMYT) China office, Beijing 100081, China; Nanfan Research Institute, CAAS, Sanya, Hainan 572024, China
| | - Shang Gao
- State Key Laboratory of Crop Gene Resources and Breeding, Institute of Crop Sciences, Chinese Academy of Agricultural Sciences (CAAS), International Maize and Wheat Improvement Center (CIMMYT) China office, Beijing 100081, China; Nanfan Research Institute, CAAS, Sanya, Hainan 572024, China
| | - Muhammad Adeel Hassan
- Adaptive Cropping Systems Laboratory, Beltsville Agricultural Research Center, US Department of Agriculture, Beltsville, MD 20705, USA; Oak Ridge Institute for Science and Education, Oak Ridge, TN 37830, USA
| | - Zhangping Huang
- State Key Laboratory of Crop Gene Resources and Breeding, Institute of Crop Sciences, Chinese Academy of Agricultural Sciences (CAAS), International Maize and Wheat Improvement Center (CIMMYT) China office, Beijing 100081, China; Nanfan Research Institute, CAAS, Sanya, Hainan 572024, China
| | - Awais Rasheed
- Department of Plant Sciences, Quaid-i-Azam University, Islamabad 45320, Pakistan
| | - Sarah Hearne
- CIMMYT, KM 45 Carretera Mexico-Veracruz, El Batan, Texcoco 56237, Mexico
| | - Boddupalli Prasanna
- CIMMYT, International Centre for Research in Agroforestry (ICRAF) House, Nairobi 00100, Kenya
| | - Xinhai Li
- State Key Laboratory of Crop Gene Resources and Breeding, Institute of Crop Sciences, Chinese Academy of Agricultural Sciences (CAAS), International Maize and Wheat Improvement Center (CIMMYT) China office, Beijing 100081, China
| | - Huihui Li
- State Key Laboratory of Crop Gene Resources and Breeding, Institute of Crop Sciences, Chinese Academy of Agricultural Sciences (CAAS), International Maize and Wheat Improvement Center (CIMMYT) China office, Beijing 100081, China; Nanfan Research Institute, CAAS, Sanya, Hainan 572024, China.
| |
Collapse
|
2
|
Teramoto S, Uga Y. Convolutional neural networks combined with conventional filtering to semantically segment plant roots in rapidly scanned X-ray computed tomography volumes with high noise levels. PLANT METHODS 2024; 20:73. [PMID: 38773503 PMCID: PMC11106967 DOI: 10.1186/s13007-024-01208-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/09/2023] [Accepted: 05/15/2024] [Indexed: 05/23/2024]
Abstract
BACKGROUND X-ray computed tomography (CT) is a powerful tool for measuring plant root growth in soil. However, a rapid scan with larger pots, which is required for throughput-prioritized crop breeding, results in high noise levels, low resolution, and blurred root segments in the CT volumes. Moreover, while plant root segmentation is essential for root quantification, detailed conditional studies on segmenting noisy root segments are scarce. The present study aimed to investigate the effects of scanning time and deep learning-based restoration of image quality on semantic segmentation of blurry rice (Oryza sativa) root segments in CT volumes. RESULTS VoxResNet, a convolutional neural network-based voxel-wise residual network, was used as the segmentation model. The training efficiency of the model was compared using CT volumes obtained at scan times of 33, 66, 150, 300, and 600 s. The learning efficiencies of the samples were similar, except for scan times of 33 and 66 s. In addition, The noise levels of predicted volumes differd among scanning conditions, indicating that the noise level of a scan time ≥ 150 s does not affect the model training efficiency. Conventional filtering methods, such as median filtering and edge detection, increased the training efficiency by approximately 10% under any conditions. However, the training efficiency of 33 and 66 s-scanned samples remained relatively low. We concluded that scan time must be at least 150 s to not affect segmentation. Finally, we constructed a semantic segmentation model for 150 s-scanned CT volumes, for which the Dice loss reached 0.093. This model could not predict the lateral roots, which were not included in the training data. This limitation will be addressed by preparing appropriate training data. CONCLUSIONS A semantic segmentation model can be constructed even with rapidly scanned CT volumes with high noise levels. Given that scanning times ≥ 150 s did not affect the segmentation results, this technique holds promise for rapid and low-dose scanning. This study offers insights into images other than CT volumes with high noise levels that are challenging to determine when annotating.
Collapse
Affiliation(s)
- Shota Teramoto
- Institute of Crop Sciences, National Agriculture & Food Research Organization, Tsukuba, Ibaraki, 305-8602, Japan.
| | - Yusaku Uga
- Institute of Crop Sciences, National Agriculture & Food Research Organization, Tsukuba, Ibaraki, 305-8602, Japan
| |
Collapse
|
3
|
Clark HP, Smith AG, McKay Fletcher D, Larsson AI, Jaspars M, De Clippele LH. New interactive machine learning tool for marine image analysis. ROYAL SOCIETY OPEN SCIENCE 2024; 11:231678. [PMID: 39157716 PMCID: PMC11328963 DOI: 10.1098/rsos.231678] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Revised: 03/28/2024] [Accepted: 04/02/2024] [Indexed: 08/20/2024]
Abstract
Advancing imaging technologies are drastically increasing the rate of marine video and image data collection. Often these datasets are not analysed to their full potential as extracting information for multiple species is incredibly time-consuming. This study demonstrates the capability of the open-source interactive machine learning tool, RootPainter, to analyse large marine image datasets quickly and accurately. The ability of RootPainter to extract the presence and surface area of the cold-water coral reef associate sponge species, Mycale lingua, was tested in two datasets: 18 346 time-lapse images and 1420 remotely operated vehicle video frames. New corrective annotation metrics integrated with RootPainter allow objective assessment of when to stop model training and reduce the need for manual model validation. Three highly accurate M. lingua models were created using RootPainter, with an average dice score of 0.94 ± 0.06. Transfer learning aided the production of two of the models, increasing analysis efficiency from 6 to 16 times faster than manual annotation for time-lapse images. Surface area measurements were extracted from both datasets allowing future investigation of sponge behaviours and distributions. Moving forward, interactive machine learning tools and model sharing could dramatically increase image analysis speeds, collaborative research and our understanding of spatiotemporal patterns in biodiversity.
Collapse
Affiliation(s)
- H. Poppy Clark
- Marine Biodiscovery Centre, Department of Chemistry, University of Aberdeen, AberdeenAB24 3UE, UK
| | - Abraham George Smith
- Department of Computer Science, University of Copenhagen, Copenhagen2100, Denmark
| | - Daniel McKay Fletcher
- Rural Economy, Environment and Society, Scotland’s Rural College, EdinburghEH9 3JG, UK
| | - Ann I. Larsson
- Tjärnö Marine Laboratory, Department of Marine Sciences, University of Gothenburg, Sweden
| | - Marcel Jaspars
- Marine Biodiscovery Centre, Department of Chemistry, University of Aberdeen, AberdeenAB24 3UE, UK
| | - Laurence H. De Clippele
- School of Biodiversity, One Health & Veterinary Medicine, University of Glasgow, GlasgowG61 1QH, UK
| |
Collapse
|
4
|
Weihs BJ, Heuschele DJ, Tang Z, York LM, Zhang Z, Xu Z. The State of the Art in Root System Architecture Image Analysis Using Artificial Intelligence: A Review. PLANT PHENOMICS (WASHINGTON, D.C.) 2024; 6:0178. [PMID: 38711621 PMCID: PMC11070851 DOI: 10.34133/plantphenomics.0178] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 09/23/2023] [Accepted: 03/27/2024] [Indexed: 05/08/2024]
Abstract
Roots are essential for acquiring water and nutrients to sustain and support plant growth and anchorage. However, they have been studied less than the aboveground traits in phenotyping and plant breeding until recent decades. In modern times, root properties such as morphology and root system architecture (RSA) have been recognized as increasingly important traits for creating more and higher quality food in the "Second Green Revolution". To address the paucity in RSA and other root research, new technologies are being investigated to fill the increasing demand to improve plants via root traits and overcome currently stagnated genetic progress in stable yields. Artificial intelligence (AI) is now a cutting-edge technology proving to be highly successful in many applications, such as crop science and genetic research to improve crop traits. A burgeoning field in crop science is the application of AI to high-resolution imagery in analyses that aim to answer questions related to crops and to better and more speedily breed desired plant traits such as RSA into new cultivars. This review is a synopsis concerning the origins, applications, challenges, and future directions of RSA research regarding image analyses using AI.
Collapse
Affiliation(s)
- Brandon J. Weihs
- United States Department of Agriculture–Agricultural Research Service–Plant Science Research, St. Paul, MN 55108, USA
- Department of Agronomy and Plant Genetics,
University of Minnesota, St. Paul, MN, 55108, USA
| | - Deborah-Jo Heuschele
- United States Department of Agriculture–Agricultural Research Service–Plant Science Research, St. Paul, MN 55108, USA
- Department of Agronomy and Plant Genetics,
University of Minnesota, St. Paul, MN, 55108, USA
| | - Zhou Tang
- Department of Crop and Soil Sciences,
Washington State University, Pullman, WA 99164, USA
| | - Larry M. York
- Biosciences Division and Center for Bioenergy Innovation,
Oak Ridge National Laboratory, Oak Ridge, TN 37830, USA
| | - Zhiwu Zhang
- Department of Crop and Soil Sciences,
Washington State University, Pullman, WA 99164, USA
| | - Zhanyou Xu
- United States Department of Agriculture–Agricultural Research Service–Plant Science Research, St. Paul, MN 55108, USA
| |
Collapse
|
5
|
Khoroshevsky F, Zhou K, Chemweno S, Edan Y, Bar-Hillel A, Hadar O, Rewald B, Baykalov P, Ephrath JE, Lazarovitch N. Automatic Root Length Estimation from Images Acquired In Situ without Segmentation. PLANT PHENOMICS (WASHINGTON, D.C.) 2024; 6:0132. [PMID: 38230354 PMCID: PMC10790720 DOI: 10.34133/plantphenomics.0132] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/12/2023] [Accepted: 12/12/2023] [Indexed: 01/18/2024]
Abstract
Image-based root phenotyping technologies, including the minirhizotron (MR), have expanded our understanding of the in situ root responses to changing environmental conditions. The conventional manual methods used to analyze MR images are time-consuming, limiting their implementation. This study presents an adaptation of our previously developed convolutional neural network-based models to estimate the total (cumulative) root length (TRL) per MR image without requiring segmentation. Training data were derived from manual annotations in Rootfly, commonly used software for MR image analysis. We compared TRL estimation with 2 models, a regression-based model and a detection-based model that detects the annotated points along the roots. Notably, the detection-based model can assist in examining human annotations by providing a visual inspection of roots in MR images. The models were trained and tested with 4,015 images acquired using 2 MR system types (manual and automated) and from 4 crop species (corn, pepper, melon, and tomato) grown under various abiotic stresses. These datasets are made publicly available as part of this publication. The coefficients of determination (R2), between the measurements made using Rootfly and the suggested TRL estimation models were 0.929 to 0.986 for the main datasets, demonstrating that this tool is accurate and robust. Additional analyses were conducted to examine the effects of (a) the data acquisition system and thus the image quality on the models' performance, (b) automated differentiation between images with and without roots, and (c) the use of the transfer learning technique. These approaches can support precision agriculture by providing real-time root growth information.
Collapse
Affiliation(s)
- Faina Khoroshevsky
- Department of Industrial Engineering and Management,
Ben-Gurion University of the Negev, Beer Sheva, Israel
| | - Kaining Zhou
- The Jacob Blaustein Center for Scientific Cooperation,
The Jacob Blaustein Institutes for Desert Research, Ben-Gurion University of the Negev, Sede Boqer, Israel
- French Associates Institute for Agriculture and Biotechnology of Drylands, The Jacob Blaustein Institutes for Desert Research, Ben-Gurion University of the Negev, Sede Boqer, Israel
| | - Sharon Chemweno
- The Albert Katz International School for Desert Studies,
The Jacob Blaustein Institutes for Desert Research, Ben-Gurion University of the Negev, Sede Boqer, Israel
- French Associates Institute for Agriculture and Biotechnology of Drylands, The Jacob Blaustein Institutes for Desert Research, Ben-Gurion University of the Negev, Sede Boqer, Israel
| | - Yael Edan
- Department of Industrial Engineering and Management,
Ben-Gurion University of the Negev, Beer Sheva, Israel
| | - Aharon Bar-Hillel
- Department of Industrial Engineering and Management,
Ben-Gurion University of the Negev, Beer Sheva, Israel
| | - Ofer Hadar
- Department of Communication Systems Engineering, School of Electrical and Computer Engineering,
Ben-Gurion University of the Negev, Beer Sheva, Israel
| | - Boris Rewald
- Institute of Forest Ecology, Department of Forest and Soil Sciences,
University of Natural Resources and Life Sciences, Vienna (BOKU), Vienna, Austria
- Faculty of Forestry and Wood Technology,
Mendel University in Brno, Brno, Czech Republic
| | - Pavel Baykalov
- Institute of Forest Ecology, Department of Forest and Soil Sciences,
University of Natural Resources and Life Sciences, Vienna (BOKU), Vienna, Austria
- Vienna Scientific Instruments GmbH, Alland, Austria
| | - Jhonathan E. Ephrath
- French Associates Institute for Agriculture and Biotechnology of Drylands, The Jacob Blaustein Institutes for Desert Research, Ben-Gurion University of the Negev, Sede Boqer, Israel
| | - Naftali Lazarovitch
- French Associates Institute for Agriculture and Biotechnology of Drylands, The Jacob Blaustein Institutes for Desert Research, Ben-Gurion University of the Negev, Sede Boqer, Israel
| |
Collapse
|
6
|
Kulhánek M, Asrade DA, Suran P, Sedlář O, Černý J, Balík J. Plant Nutrition-New Methods Based on the Lessons of History: A Review. PLANTS (BASEL, SWITZERLAND) 2023; 12:4150. [PMID: 38140480 PMCID: PMC10747035 DOI: 10.3390/plants12244150] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/26/2023] [Revised: 12/08/2023] [Accepted: 12/10/2023] [Indexed: 12/24/2023]
Abstract
As with new technologies, plant nutrition has taken a big step forward in the last two decades. The main objective of this review is to briefly summarise the main pathways in modern plant nutrition and attract potential researchers and publishers to this area. First, this review highlights the importance of long-term field experiments, which provide us with valuable information about the effects of different applied strategies. The second part is dedicated to the new analytical technologies (tomography, spectrometry, and chromatography), intensively studied environments (rhizosphere, soil microbial communities, and enzymatic activity), nutrient relationship indexes, and the general importance of proper data evaluation. The third section is dedicated to the strategies of plant nutrition, i.e., (i) plant breeding, (ii) precision farming, (iii) fertiliser placement, (iv) biostimulants, (v) waste materials as a source of nutrients, and (vi) nanotechnologies. Finally, the increasing environmental risks related to plant nutrition, including biotic and abiotic stress, mainly the threat of soil salinity, are mentioned. In the 21st century, fertiliser application trends should be shifted to local application, precise farming, and nanotechnology; amended with ecofriendly organic fertilisers to ensure sustainable agricultural practices; and supported by new, highly effective crop varieties. To optimise agriculture, only the combination of the mentioned modern strategies supported by a proper analysis based on long-term observations seems to be a suitable pathway.
Collapse
Affiliation(s)
- Martin Kulhánek
- Department of Agro-Environmental Chemistry and Plant Nutrition, Faculty of Agrobiology, Food and Natural Resources, Czech University of Life Sciences, 165 00 Prague, Czech Republic; (D.A.A.); (P.S.); (O.S.); (J.Č.); (J.B.)
| | | | | | | | | | | |
Collapse
|
7
|
Baykalov P, Bussmann B, Nair R, Smith AG, Bodner G, Hadar O, Lazarovitch N, Rewald B. Semantic segmentation of plant roots from RGB (mini-) rhizotron images-generalisation potential and false positives of established methods and advanced deep-learning models. PLANT METHODS 2023; 19:122. [PMID: 37932745 PMCID: PMC10629126 DOI: 10.1186/s13007-023-01101-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/08/2022] [Accepted: 10/27/2023] [Indexed: 11/08/2023]
Abstract
BACKGROUND Manual analysis of (mini-)rhizotron (MR) images is tedious. Several methods have been proposed for semantic root segmentation based on homogeneous, single-source MR datasets. Recent advances in deep learning (DL) have enabled automated feature extraction, but comparisons of segmentation accuracy, false positives and transferability are virtually lacking. Here we compare six state-of-the-art methods and propose two improved DL models for semantic root segmentation using a large MR dataset with and without augmented data. We determine the performance of the methods on a homogeneous maize dataset, and a mixed dataset of > 8 species (mixtures), 6 soil types and 4 imaging systems. The generalisation potential of the derived DL models is determined on a distinct, unseen dataset. RESULTS The best performance was achieved by the U-Net models; the more complex the encoder the better the accuracy and generalisation of the model. The heterogeneous mixed MR dataset was a particularly challenging for the non-U-Net techniques. Data augmentation enhanced model performance. We demonstrated the improved performance of deep meta-architectures and feature extractors, and a reduction in the number of false positives. CONCLUSIONS Although correction factors are still required to match human labelled root lengths, neural network architectures greatly reduce the time required to compute the root length. The more complex architectures illustrate how future improvements in root segmentation within MR images can be achieved, particularly reaching higher segmentation accuracies and model generalisation when analysing real-world datasets with artefacts-limiting the need for model retraining.
Collapse
Affiliation(s)
- Pavel Baykalov
- Institute of Forest Ecology, Department of Forest and Soil Sciences, University of Natural Resources and Life Sciences, Vienna (BOKU), Vienna, Austria
- Vienna Scientific Instruments GmbH, Alland, Austria
| | - Bart Bussmann
- IDLab, Department of Computer Science, University of Antwerp - Imec, Antwerp, Belgium
| | - Richard Nair
- Dept. Biogeochemical Integration, Max Planck Institute for Biogeochemistry, Jena, Germany
- Discipline of Botany, School of Natural Sciences, Trinity College, Dublin, Ireland
| | | | - Gernot Bodner
- Institute of Agronomy, University of Natural Resources and Life Sciences, Vienna (BOKU), Vienna, Austria
| | - Ofer Hadar
- School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, Beer Sheva, Israel
| | - Naftali Lazarovitch
- Wyler Department for Dryland Agriculture, French Associates Institute for Agriculture and Biotechnology of Drylands, Jacob Blaustein Institutes for Desert Research, Ben-Gurion University of the Negev, Sede Boqer Campus, Beersheba, Israel
| | - Boris Rewald
- Institute of Forest Ecology, Department of Forest and Soil Sciences, University of Natural Resources and Life Sciences, Vienna (BOKU), Vienna, Austria.
- Faculty of Forestry and Wood Technology, Mendel University in Brno, Brno, Czech Republic.
| |
Collapse
|
8
|
Akiyama R, Goto T, Tameshige T, Sugisaka J, Kuroki K, Sun J, Akita J, Hatakeyama M, Kudoh H, Kenta T, Tonouchi A, Shimahara Y, Sese J, Kutsuna N, Shimizu-Inatsugi R, Shimizu KK. Seasonal pigment fluctuation in diploid and polyploid Arabidopsis revealed by machine learning-based phenotyping method PlantServation. Nat Commun 2023; 14:5792. [PMID: 37737204 PMCID: PMC10517152 DOI: 10.1038/s41467-023-41260-3] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/04/2022] [Accepted: 08/29/2023] [Indexed: 09/23/2023] Open
Abstract
Long-term field monitoring of leaf pigment content is informative for understanding plant responses to environments distinct from regulated chambers but is impractical by conventional destructive measurements. We developed PlantServation, a method incorporating robust image-acquisition hardware and deep learning-based software that extracts leaf color by detecting plant individuals automatically. As a case study, we applied PlantServation to examine environmental and genotypic effects on the pigment anthocyanin content estimated from leaf color. We processed >4 million images of small individuals of four Arabidopsis species in the field, where the plant shape, color, and background vary over months. Past radiation, coldness, and precipitation significantly affected the anthocyanin content. The synthetic allopolyploid A. kamchatica recapitulated the fluctuations of natural polyploids by integrating diploid responses. The data support a long-standing hypothesis stating that allopolyploids can inherit and combine the traits of progenitors. PlantServation facilitates the study of plant responses to complex environments termed "in natura".
Collapse
Affiliation(s)
- Reiko Akiyama
- Department of Evolutionary Biology and Environmental Studies, University of Zurich, Winterthurerstrasse 190, CH-8057, Zurich, Switzerland
| | - Takao Goto
- Research and Development Division, LPIXEL Inc., Chiyoda-ku, Tokyo, 100-0004, Japan
| | - Toshiaki Tameshige
- Kihara Institute for Biological Research (KIBR), Yokohama City University, 641-12 Maioka, Totsuka-ward, Yokohama, 244-0813, Japan
- Division of Biological Science, Graduate School of Science and Technology, Nara Institute of Science and Technology (NAIST), 8916-5 Takayama-Cho, Ikoma, Nara, 630-0192, Japan
| | - Jiro Sugisaka
- Kihara Institute for Biological Research (KIBR), Yokohama City University, 641-12 Maioka, Totsuka-ward, Yokohama, 244-0813, Japan
- Center for Ecological Research, Kyoto University, Hirano 2-509-3, Otsu, 520-2113, Japan
| | - Ken Kuroki
- Department of Biological Sciences, Graduate School of Science, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-0033, Japan
| | - Jianqiang Sun
- Research Center for Agricultural Information Technology, National Agriculture and Food Research Organization, 3-1-1 Kannondai, Tsukuba, Ibaraki, 305-8517, Japan
| | - Junichi Akita
- Department of Electric and Computer Engineering, Kanazawa University, Kakuma, Kanazawa, 920-1192, Japan
| | - Masaomi Hatakeyama
- Department of Evolutionary Biology and Environmental Studies, University of Zurich, Winterthurerstrasse 190, CH-8057, Zurich, Switzerland
- Functional Genomics Center Zurich, Winterthurerstrasse 190, CH-8057, Zurich, Switzerland
| | - Hiroshi Kudoh
- Center for Ecological Research, Kyoto University, Hirano 2-509-3, Otsu, 520-2113, Japan
| | - Tanaka Kenta
- Sugadaira Research Station, Mountain Science Center, University of Tsukuba, 1278-294 Sugadaira-kogen, Ueda, 386-2204, Japan
| | - Aya Tonouchi
- Research and Development Division, LPIXEL Inc., Chiyoda-ku, Tokyo, 100-0004, Japan
| | - Yuki Shimahara
- Research and Development Division, LPIXEL Inc., Chiyoda-ku, Tokyo, 100-0004, Japan
| | - Jun Sese
- Artificial Intelligence Research Center, AIST, 2-3-26 Aomi, Koto-ku, Tokyo, 135-0064, Japan
- Humanome Lab, Inc., L-HUB 3F, 1-4, Shumomiyabi-cho, Shinjuku, Tokyo, 162-0822, Japan
- AIST-Tokyo Tech RWBC-OIL, 2-12-1 O-okayama, Meguro-ku, Tokyo, 152-8550, Japan
| | - Natsumaro Kutsuna
- Research and Development Division, LPIXEL Inc., Chiyoda-ku, Tokyo, 100-0004, Japan
| | - Rie Shimizu-Inatsugi
- Department of Evolutionary Biology and Environmental Studies, University of Zurich, Winterthurerstrasse 190, CH-8057, Zurich, Switzerland.
| | - Kentaro K Shimizu
- Department of Evolutionary Biology and Environmental Studies, University of Zurich, Winterthurerstrasse 190, CH-8057, Zurich, Switzerland.
- Kihara Institute for Biological Research (KIBR), Yokohama City University, 641-12 Maioka, Totsuka-ward, Yokohama, 244-0813, Japan.
| |
Collapse
|
9
|
Selzner T, Horn J, Landl M, Pohlmeier A, Helmrich D, Huber K, Vanderborght J, Vereecken H, Behnke S, Schnepf A. 3D U-Net Segmentation Improves Root System Reconstruction from 3D MRI Images in Automated and Manual Virtual Reality Work Flows. PLANT PHENOMICS (WASHINGTON, D.C.) 2023; 5:0076. [PMID: 37519934 PMCID: PMC10381537 DOI: 10.34133/plantphenomics.0076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 10/20/2022] [Accepted: 07/10/2023] [Indexed: 08/01/2023]
Abstract
Magnetic resonance imaging (MRI) is used to image root systems grown in opaque soil. However, reconstruction of root system architecture (RSA) from 3-dimensional (3D) MRI images is challenging. Low resolution and poor contrast-to-noise ratios (CNRs) hinder automated reconstruction. Hence, manual reconstruction is still widely used. Here, we evaluate a novel 2-step work flow for automated RSA reconstruction. In the first step, a 3D U-Net segments MRI images into root and soil in super-resolution. In the second step, an automated tracing algorithm reconstructs the root systems from the segmented images. We evaluated the merits of both steps for an MRI dataset of 8 lupine root systems, by comparing the automated reconstructions to manual reconstructions of unaltered and segmented MRI images derived with a novel virtual reality system. We found that the U-Net segmentation offers profound benefits in manual reconstruction: reconstruction speed was doubled (+97%) for images with low CNR and increased by 27% for images with high CNR. Reconstructed root lengths were increased by 20% and 3%, respectively. Therefore, we propose to use U-Net segmentation as a principal image preprocessing step in manual work flows. The root length derived by the tracing algorithm was lower than in both manual reconstruction methods, but segmentation allowed automated processing of otherwise not readily usable MRI images. Nonetheless, model-based functional root traits revealed similar hydraulic behavior of automated and manual reconstructions. Future studies will aim to establish a hybrid work flow that utilizes automated reconstructions as scaffolds that can be manually corrected.
Collapse
Affiliation(s)
- Tobias Selzner
- Forschungszentrum Juelich GmbH, Agrosphere (IBG-3), Juelich, Germany
| | - Jannis Horn
- Autonomous Intelligence Systems Group,
University of Bonn, Bonn, Germany
| | - Magdalena Landl
- Forschungszentrum Juelich GmbH, Agrosphere (IBG-3), Juelich, Germany
| | - Andreas Pohlmeier
- Forschungszentrum Juelich GmbH, Agrosphere (IBG-3), Juelich, Germany
| | - Dirk Helmrich
- Forschungszentrum Juelich GmbH, Juelich Supercomputing Center, Juelich, Germany
| | - Katrin Huber
- Forschungszentrum Juelich GmbH, Agrosphere (IBG-3), Juelich, Germany
| | - Jan Vanderborght
- Forschungszentrum Juelich GmbH, Agrosphere (IBG-3), Juelich, Germany
| | - Harry Vereecken
- Forschungszentrum Juelich GmbH, Agrosphere (IBG-3), Juelich, Germany
| | - Sven Behnke
- Autonomous Intelligence Systems Group,
University of Bonn, Bonn, Germany
| | - Andrea Schnepf
- Forschungszentrum Juelich GmbH, Agrosphere (IBG-3), Juelich, Germany
| |
Collapse
|
10
|
Huang Y, Yan J, Zhang Y, Ye W, Zhang C, Gao P, Lv X. Automatic segmentation of cotton roots in high-resolution minirhizotron images based on improved OCRNet. FRONTIERS IN PLANT SCIENCE 2023; 14:1147034. [PMID: 37235030 PMCID: PMC10207899 DOI: 10.3389/fpls.2023.1147034] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/18/2023] [Accepted: 03/27/2023] [Indexed: 05/28/2023]
Abstract
Root phenotypic parameters are the important basis for studying the growth state of plants, and root researchers obtain root phenotypic parameters mainly by analyzing root images. With the development of image processing technology, automatic analysis of root phenotypic parameters has become possible. And the automatic segmentation of roots in images is the basis for the automatic analysis of root phenotypic parameters. We collected high-resolution images of cotton roots in a real soil environment using minirhizotrons. The background noise of the minirhizotron images is extremely complex and affects the accuracy of the automatic segmentation of the roots. In order to reduce the influence of the background noise, we improved OCRNet by adding a Global Attention Mechanism (GAM) module to OCRNet to enhance the focus of the model on the root targets. The improved OCRNet model in this paper achieved automatic segmentation of roots in the soil and performed well in the root segmentation of the high-resolution minirhizotron images, achieving an accuracy of 0.9866, a recall of 0.9419, a precision of 0.8887, an F1 score of 0.9146 and an Intersection over Union (IoU) of 0.8426. The method provided a new approach to automatic and accurate root segmentation of high-resolution minirhizotron images.
Collapse
Affiliation(s)
- Yuxian Huang
- College of Agriculture, Shihezi University, Shihezi, China
| | - Jingkun Yan
- College of Information Science and Technology, Shihezi University, Shihezi, China
| | - Yuan Zhang
- College of Information Science and Technology, Shihezi University, Shihezi, China
| | - Weixin Ye
- College of Information Science and Technology, Shihezi University, Shihezi, China
| | - Chu Zhang
- School of Information Engineering, Huzhou University, Huzhou, China
| | - Pan Gao
- College of Information Science and Technology, Shihezi University, Shihezi, China
| | - Xin Lv
- College of Agriculture, Shihezi University, Shihezi, China
| |
Collapse
|
11
|
Li Y, Huang Y, Wang M, Zhao Y. An improved U-Net-based in situ root system phenotype segmentation method for plants. FRONTIERS IN PLANT SCIENCE 2023; 14:1115713. [PMID: 36998695 PMCID: PMC10043420 DOI: 10.3389/fpls.2023.1115713] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/04/2022] [Accepted: 03/02/2023] [Indexed: 06/19/2023]
Abstract
The condition of plant root systems plays an important role in plant growth and development. The Minirhizotron method is an important tool to detect the dynamic growth and development of plant root systems. Currently, most researchers use manual methods or software to segment the root system for analysis and study. This method is time-consuming and requires a high level of operation. The complex background and variable environment in soils make traditional automated root system segmentation methods difficult to implement. Inspired by deep learning in medical imaging, which is used to segment pathological regions to help determine diseases, we propose a deep learning method for the root segmentation task. U-Net is chosen as the basis, and the encoder layer is replaced by the ResNet Block, which can reduce the training volume of the model and improve the feature utilization capability; the PSA module is added to the up-sampling part of U-Net to improve the segmentation accuracy of the object through multi-scale features and attention fusion; a new loss function is used to avoid the extreme imbalance and data imbalance problems of backgrounds such as root system and soil. After experimental comparison and analysis, the improved network demonstrates better performance. In the test set of the peanut root segmentation task, a pixel accuracy of 0.9917 and Intersection Over Union of 0.9548 were achieved, with an F1-score of 95.10. Finally, we used the Transfer Learning approach to conduct segmentation experiments on the corn in situ root system dataset. The experiments show that the improved network has a good learning effect and transferability.
Collapse
|
12
|
Harfouche AL, Nakhle F, Harfouche AH, Sardella OG, Dart E, Jacobson D. A primer on artificial intelligence in plant digital phenomics: embarking on the data to insights journey. TRENDS IN PLANT SCIENCE 2023; 28:154-184. [PMID: 36167648 DOI: 10.1016/j.tplants.2022.08.021] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/04/2022] [Revised: 08/22/2022] [Accepted: 08/25/2022] [Indexed: 06/16/2023]
Abstract
Artificial intelligence (AI) has emerged as a fundamental component of global agricultural research that is poised to impact on many aspects of plant science. In digital phenomics, AI is capable of learning intricate structure and patterns in large datasets. We provide a perspective and primer on AI applications to phenome research. We propose a novel human-centric explainable AI (X-AI) system architecture consisting of data architecture, technology infrastructure, and AI architecture design. We clarify the difference between post hoc models and 'interpretable by design' models. We include guidance for effectively using an interpretable by design model in phenomic analysis. We also provide directions to sources of tools and resources for making data analytics increasingly accessible. This primer is accompanied by an interactive online tutorial.
Collapse
Affiliation(s)
- Antoine L Harfouche
- Department for Innovation in Biological, Agro-Food, and Forest Systems, University of Tuscia, Viterbo, VT 01100, Italy.
| | - Farid Nakhle
- Department for Innovation in Biological, Agro-Food, and Forest Systems, University of Tuscia, Viterbo, VT 01100, Italy
| | - Antoine H Harfouche
- Unité de Formation et de Recherche en Sciences Économiques, Gestion, Mathématiques, et Informatique, Université Paris Nanterre, 92001 Nanterre, France
| | - Orlando G Sardella
- Department for Innovation in Biological, Agro-Food, and Forest Systems, University of Tuscia, Viterbo, VT 01100, Italy
| | - Eli Dart
- Energy Sciences Network (ESnet), Lawrence Berkeley National Laboratory, Berkeley, CA 94720, USA
| | - Daniel Jacobson
- Biosciences Division, Oak Ridge National Laboratory, Oak Ridge, TN 37831, USA
| |
Collapse
|
13
|
As good as human experts in detecting plant roots in minirhizotron images but efficient and reproducible: the convolutional neural network "RootDetector". Sci Rep 2023; 13:1399. [PMID: 36697423 PMCID: PMC9876992 DOI: 10.1038/s41598-023-28400-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2022] [Accepted: 01/18/2023] [Indexed: 01/26/2023] Open
Abstract
Plant roots influence many ecological and biogeochemical processes, such as carbon, water and nutrient cycling. Because of difficult accessibility, knowledge on plant root growth dynamics in field conditions, however, is fragmentary at best. Minirhizotrons, i.e. transparent tubes placed in the substrate into which specialized cameras or circular scanners are inserted, facilitate the capture of high-resolution images of root dynamics at the soil-tube interface with little to no disturbance after the initial installation. Their use, especially in field studies with multiple species and heterogeneous substrates, though, is limited by the amount of work that subsequent manual tracing of roots in the images requires. Furthermore, the reproducibility and objectivity of manual root detection is questionable. Here, we use a Convolutional Neural Network (CNN) for the automatic detection of roots in minirhizotron images and compare the performance of our RootDetector with human analysts with different levels of expertise. Our minirhizotron data come from various wetlands on organic soils, i.e. highly heterogeneous substrates consisting of dead plant material, often times mainly roots, in various degrees of decomposition. This may be seen as one of the most challenging soil types for root segmentation in minirhizotron images. RootDetector showed a high capability to correctly segment root pixels in minirhizotron images from field observations (F1 = 0.6044; r2 compared to a human expert = 0.99). Reproducibility among humans, however, depended strongly on expertise level, with novices showing drastic variation among individual analysts and annotating on average more than 13-times higher root length/cm2 per image compared to expert analysts. CNNs such as RootDetector provide a reliable and efficient method for the detection of roots and root length in minirhizotron images even from challenging field conditions. Analyses with RootDetector thus save resources, are reproducible and objective, and are as accurate as manual analyses performed by human experts.
Collapse
|
14
|
Zhou L, Xiao Q, Taha MF, Xu C, Zhang C. Phenotypic Analysis of Diseased Plant Leaves Using Supervised and Weakly Supervised Deep Learning. PLANT PHENOMICS (WASHINGTON, D.C.) 2023; 5:0022. [PMID: 37040509 PMCID: PMC10076051 DOI: 10.34133/plantphenomics.0022] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/20/2022] [Accepted: 12/13/2022] [Indexed: 05/10/2023]
Abstract
Deep learning and computer vision have become emerging tools for diseased plant phenotyping. Most previous studies focused on image-level disease classification. In this paper, pixel-level phenotypic feature (the distribution of spot) was analyzed by deep learning. Primarily, a diseased leaf dataset was collected and the corresponding pixel-level annotation was contributed. A dataset of apple leaves samples was used for training and optimization. Another set of grape and strawberry leaf samples was used as an extra testing dataset. Then, supervised convolutional neural networks were adopted for semantic segmentation. Moreover, the possibility of weakly supervised models for disease spot segmentation was also explored. Grad-CAM combined with ResNet-50 (ResNet-CAM), and that combined with a few-shot pretrained U-Net classifier for weakly supervised leaf spot segmentation (WSLSS), was designed. They were trained using image-level annotations (healthy versus diseased) to reduce the cost of annotation work. Results showed that the supervised DeepLab achieved the best performance (IoU = 0.829) on the apple leaf dataset. The weakly supervised WSLSS achieved an IoU of 0.434. When processing the extra testing dataset, WSLSS realized the best IoU of 0.511, which was even higher than fully supervised DeepLab (IoU = 0.458). Although there was a certain gap in IoU between the supervised models and weakly supervised ones, WSLSS showed stronger generalization ability than supervised models when processing the disease types not involved in the training procedure. Furthermore, the contributed dataset in this paper could help researchers get a quick start on designing their new segmentation methods in future studies.
Collapse
Affiliation(s)
- Lei Zhou
- College of Mechanical and Electronic Engineering, Nanjing Forestry University, Nanjing, China
| | - Qinlin Xiao
- College of Biosystems Engineering and Food Science, Zhejiang University, Zhejiang, China
| | - Mohanmed Farag Taha
- College of Biosystems Engineering and Food Science, Zhejiang University, Zhejiang, China
- Department of Soil and Water Sciences, Faculty of Environmental Agricultural Sciences, Arish University, North Sinai 45516, Egypt
| | - Chengjia Xu
- College of Biosystems Engineering and Food Science, Zhejiang University, Zhejiang, China
| | - Chu Zhang
- School of Information Engineering, Huzhou University, Huzhou, China
- Address correspondence to: (C.Z.)
| |
Collapse
|
15
|
Alle J, Gruber R, Wörlein N, Uhlmann N, Claußen J, Wittenberg T, Gerth S. 3D segmentation of plant root systems using spatial pyramid pooling and locally adaptive field-of-view inference. FRONTIERS IN PLANT SCIENCE 2023; 14:1120189. [PMID: 37082341 PMCID: PMC10110838 DOI: 10.3389/fpls.2023.1120189] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/12/2022] [Accepted: 03/13/2023] [Indexed: 05/03/2023]
Abstract
Background The non-invasive 3D-imaging and successive 3D-segmentation of plant root systems has gained interest within fundamental plant research and selectively breeding resilient crops. Currently the state of the art consists of computed tomography (CT) scans and reconstruction followed by an adequate 3D-segmentation process. Challenge Generating an exact 3D-segmentation of the roots becomes challenging due to inhomogeneous soil composition, as well as high scale variance in the root structures themselves. Approach (1) We address the challenge by combining deep convolutional neural networks (DCNNs) with a weakly supervised learning paradigm. Furthermore, (2) we apply a spatial pyramid pooling (SPP) layer to cope with the scale variance of roots. (3) We generate a fine-tuned training data set with a specialized sub-labeling technique. (4) Finally, to yield fast and high-quality segmentations, we propose a specialized iterative inference algorithm, which locally adapts the field of view (FoV) for the network. Experiments We compare our segmentation results against an analytical reference algorithm for root segmentation (RootForce) on a set of roots from Cassava plants and show qualitatively that an increased amount of root voxels and root branches can be segmented. Results Our findings show that with the proposed DCNN approach combined with the dynamic inference, much more, and especially fine, root structures can be detected than with a classical analytical reference method. Conclusion We show that the application of the proposed DCNN approach leads to better and more robust root segmentation, especially for very small and thin roots.
Collapse
Affiliation(s)
- Jonas Alle
- Fraunhofer Institut für Integrierte Schaltungen (IIS), Fraunhofer Institute for Integrated Circuits Institut für Integrierte Schaltungen (IIS), Division Development Center X-Ray Technology, Fürth, Germany
| | - Roland Gruber
- Fraunhofer Institut für Integrierte Schaltungen (IIS), Fraunhofer Institute for Integrated Circuits Institut für Integrierte Schaltungen (IIS), Division Development Center X-Ray Technology, Fürth, Germany
- Friedrich-Alexander-Universität Erlangen-Nürnberg, Chair for Visual Computing, Erlangen, Germany
| | - Norbert Wörlein
- Fraunhofer Institut für Integrierte Schaltungen (IIS), Fraunhofer Institute for Integrated Circuits Institut für Integrierte Schaltungen (IIS), Division Development Center X-Ray Technology, Fürth, Germany
| | - Norman Uhlmann
- Fraunhofer Institut für Integrierte Schaltungen (IIS), Fraunhofer Institute for Integrated Circuits Institut für Integrierte Schaltungen (IIS), Division Development Center X-Ray Technology, Fürth, Germany
| | - Joelle Claußen
- Fraunhofer Institut für Integrierte Schaltungen (IIS), Fraunhofer Institute for Integrated Circuits Institut für Integrierte Schaltungen (IIS), Division Development Center X-Ray Technology, Fürth, Germany
| | - Thomas Wittenberg
- Friedrich-Alexander-Universität Erlangen-Nürnberg, Chair for Visual Computing, Erlangen, Germany
- Fraunhofer Institut für Integrierte Schaltungen (IIS), Fraunhofer Institute for Integrated Circuits Institut für Integrierte Schaltungen (IIS), Division Smart Sensors and Electronics, Erlangen, Germany
| | - Stefan Gerth
- Fraunhofer Institut für Integrierte Schaltungen (IIS), Fraunhofer Institute for Integrated Circuits Institut für Integrierte Schaltungen (IIS), Division Development Center X-Ray Technology, Fürth, Germany
- *Correspondence: Stefan Gerth,
| |
Collapse
|
16
|
Thesma V, Mohammadpour Velni J. Plant Root Phenotyping Using Deep Conditional GANs and Binary Semantic Segmentation. SENSORS (BASEL, SWITZERLAND) 2022; 23:s23010309. [PMID: 36616905 PMCID: PMC9823511 DOI: 10.3390/s23010309] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/12/2022] [Revised: 12/20/2022] [Accepted: 12/21/2022] [Indexed: 05/05/2023]
Abstract
This paper develops an approach to perform binary semantic segmentation on Arabidopsis thaliana root images for plant root phenotyping using a conditional generative adversarial network (cGAN) to address pixel-wise class imbalance. Specifically, we use Pix2PixHD, an image-to-image translation cGAN, to generate realistic and high resolution images of plant roots and annotations similar to the original dataset. Furthermore, we use our trained cGAN to triple the size of our original root dataset to reduce pixel-wise class imbalance. We then feed both the original and generated datasets into SegNet to semantically segment the root pixels from the background. Furthermore, we postprocess our segmentation results to close small, apparent gaps along the main and lateral roots. Lastly, we present a comparison of our binary semantic segmentation approach with the state-of-the-art in root segmentation. Our efforts demonstrate that cGAN can produce realistic and high resolution root images, reduce pixel-wise class imbalance, and our segmentation model yields high testing accuracy (of over 99%), low cross entropy error (of less than 2%), high Dice Score (of near 0.80), and low inference time for near real-time processing.
Collapse
Affiliation(s)
- Vaishnavi Thesma
- School of Electrical and Computer Engineering, University of Georgia, Athens, GA 30602, USA
| | - Javad Mohammadpour Velni
- Department of Mechanical Engineering, Clemson University, Clemson, SC 29634, USA
- Correspondence: ; Tel.: +1-864-656-0139
| |
Collapse
|
17
|
Østerlund I, Persson S, Nikoloski Z. Tracing and tracking filamentous structures across scales: A systematic review. Comput Struct Biotechnol J 2022; 21:452-462. [PMID: 36618983 PMCID: PMC9804014 DOI: 10.1016/j.csbj.2022.12.023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2022] [Revised: 12/14/2022] [Accepted: 12/14/2022] [Indexed: 12/23/2022] Open
Abstract
Filamentous structures are ubiquitous in nature, are studied in diverse scientific fields, and span vastly different spatial scales. Filamentous structures in biological systems fulfill different functions and often form dynamic networks that respond to perturbations. Therefore, characterizing the properties of filamentous structures and the networks they form is important to gain better understanding of systems level functions and dynamics. Filamentous structures are captured by various imaging technologies, and analysis of the resulting imaging data addresses two problems: (i) identification (tracing) of filamentous structures in a single snapshot and (ii) characterizing the dynamics (i.e., tracking) of filamentous structures over time. Therefore, considerable research efforts have been made in developing automated methods for tracing and tracking of filamentous structures. Here, we provide a systematic review in which we present, categorize, and discuss the state-of-the-art methods for tracing and tracking of filamentous structures in sparse and dense networks. We highlight the mathematical approaches, assumptions, and constraints particular for each method, allowing us to pinpoint outstanding challenges and offer perspectives for future research aimed at gaining better understanding of filamentous structures in biological systems.
Collapse
Affiliation(s)
- Isabella Østerlund
- Department of Plant and Environmental Sciences, University of Copenhagen, 1871 Frederiksberg, Denmark
- Bioinformatics, Institute of Biochemistry and Biology, University of Potsdam, 14476 Potsdam, Germany
| | - Staffan Persson
- Department of Plant and Environmental Sciences, University of Copenhagen, 1871 Frederiksberg, Denmark
| | - Zoran Nikoloski
- Bioinformatics, Institute of Biochemistry and Biology, University of Potsdam, 14476 Potsdam, Germany
- Systems Biology and Mathematical Modeling, Max Planck Institute of Molecular Plant Physiology, 14476 Potsdam, Germany
| |
Collapse
|
18
|
Teramoto S, Uga Y. Four-dimensional measurement of root system development using time-series three-dimensional volumetric data analysis by backward prediction. PLANT METHODS 2022; 18:133. [PMID: 36494868 PMCID: PMC9733169 DOI: 10.1186/s13007-022-00968-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/13/2022] [Accepted: 12/03/2022] [Indexed: 06/17/2023]
Abstract
BACKGROUND Root system architecture (RSA) is an essential characteristic for efficient water and nutrient absorption in terrestrial plants; its plasticity enables plants to respond to different soil environments. Better understanding of root plasticity is important in developing stress-tolerant crops. Non-invasive techniques that can measure roots in soils nondestructively, such as X-ray computed tomography (CT), are useful to evaluate RSA plasticity. However, although RSA plasticity can be measured by tracking individual root growth, only a few methods are available for tracking individual roots from time-series three-dimensional (3D) images. RESULTS We developed a semi-automatic workflow that tracks individual root growth by vectorizing RSA from time-series 3D images via two major steps. The first step involves 3D alignment of the time-series RSA images by iterative closest point registration with point clouds generated by high-intensity particles in potted soils. This alignment ensures that the time-series RSA images overlap. The second step consists of backward prediction of vectorization, which is based on the phenomenon that the root length of the RSA vector at the earlier time point is shorter than that at the last time point. In other words, when CT scanning is performed at time point A and again at time point B for the same pot, the CT data and RSA vectors at time points A and B will almost overlap, but not where the roots have grown. We assumed that given a manually created RSA vector at the last time point of the time series, all RSA vectors except those at the last time point could be automatically predicted by referring to the corresponding RSA images. Using 21 time-series CT volumes of a potted plant of upland rice (Oryza sativa), this workflow revealed that the root elongation speed increased with age. Compared with a workflow that does not use backward prediction, the workflow with backward prediction reduced the manual labor time by 95%. CONCLUSIONS We developed a workflow to efficiently generate time-series RSA vectors from time-series X-ray CT volumes. We named this workflow 'RSAtrace4D' and are confident that it can be applied to the time-series analysis of RSA development and plasticity.
Collapse
Affiliation(s)
- Shota Teramoto
- Institute of Crop Sciences, National Agriculture & Food Research Organization, Tsukuba, Ibaraki, 305-8602, Japan
| | - Yusaku Uga
- Institute of Crop Sciences, National Agriculture & Food Research Organization, Tsukuba, Ibaraki, 305-8602, Japan.
| |
Collapse
|
19
|
Möhl P, von Büren RS, Hiltbrunner E. Growth of alpine grassland will start and stop earlier under climate warming. Nat Commun 2022; 13:7398. [PMID: 36456572 PMCID: PMC9715633 DOI: 10.1038/s41467-022-35194-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2022] [Accepted: 11/22/2022] [Indexed: 12/03/2022] Open
Abstract
Alpine plants have evolved a tight seasonal cycle of growth and senescence to cope with a short growing season. The potential growing season length (GSL) is increasing because of climate warming, possibly prolonging plant growth above- and belowground. We tested whether growth dynamics in typical alpine grassland are altered when the natural GSL (2-3 months) is experimentally advanced and thus, prolonged by 2-4 months. Additional summer months did not extend the growing period, as canopy browning started 34-41 days after the start of the season, even when GSL was more than doubled. Less than 10% of roots were produced during the added months, suggesting that root growth was as conservative as leaf growth. Few species showed a weak second greening under prolonged GSL, but not the dominant sedge. A longer growing season under future climate may therefore not extend growth in this widespread alpine community, but will foster species that follow a less strict phenology.
Collapse
Affiliation(s)
- Patrick Möhl
- Department of Environmental Sciences, University of Basel, Schönbeinstrasse 6, CH-4056, Basel, Switzerland.
| | - Raphael S von Büren
- Department of Environmental Sciences, University of Basel, Schönbeinstrasse 6, CH-4056, Basel, Switzerland
| | - Erika Hiltbrunner
- Department of Environmental Sciences, University of Basel, Schönbeinstrasse 6, CH-4056, Basel, Switzerland
| |
Collapse
|
20
|
Xu X, Qiu J, Zhang W, Zhou Z, Kang Y. Soybean Seedling Root Segmentation Using Improved U-Net Network. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22228904. [PMID: 36433500 PMCID: PMC9698826 DOI: 10.3390/s22228904] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Revised: 11/08/2022] [Accepted: 11/15/2022] [Indexed: 06/01/2023]
Abstract
Soybean seedling root morphology is important to genetic breeding. Root segmentation is a key technique for identifying root morphological characteristics. This paper proposed a semantic segmentation model of soybean seedling root images based on an improved U-Net network to address the problems of the over-segmentation phenomenon, unsmooth root edges and root disconnection, which are easily caused by background interference such as water stains and noise, as well as inconspicuous contrast in soybean seedling images. Soybean seedling root images in the hydroponic environment were collected for annotation and augmentation. A double attention mechanism was introduced in the downsampling process, and an Attention Gate mechanism was added in the skip connection part to enhance the weight of the root region and suppress the interference of background and noise. Then, the model prediction process was visually interpreted using feature maps and class activation mapping maps. The remaining background noise was removed by connected component analysis. The experimental results showed that the Accuracy, Precision, Recall, F1-Score and Intersection over Union of the model were 0.9962, 0.9883, 0.9794, 0.9837 and 0.9683, respectively. The processing time of an individual image was 0.153 s. A segmentation experiment on soybean root images was performed in the soil-culturing environment. The results showed that this proposed model could extract more complete detail information and had strong generalization ability. It can achieve accurate root segmentation in soybean seedlings and provide a theoretical basis and technical support for the quantitative evaluation of the root morphological characteristics in soybean seedlings.
Collapse
Affiliation(s)
- Xiuying Xu
- College of Engineering, Heilongjiang Bayi Agricultural University, Daqing 163319, China
- Heilongjiang Province Conservation Tillage Engineering Technology Research Center, Daqing 163319, China
| | - Jinkai Qiu
- College of Engineering, Heilongjiang Bayi Agricultural University, Daqing 163319, China
| | - Wei Zhang
- College of Engineering, Heilongjiang Bayi Agricultural University, Daqing 163319, China
- Heilongjiang Province Conservation Tillage Engineering Technology Research Center, Daqing 163319, China
| | - Zheng Zhou
- College of Engineering, Heilongjiang Bayi Agricultural University, Daqing 163319, China
| | - Ye Kang
- College of Engineering, Heilongjiang Bayi Agricultural University, Daqing 163319, China
| |
Collapse
|
21
|
Seidenthal K, Panjvani K, Chandnani R, Kochian L, Eramian M. Iterative image segmentation of plant roots for high-throughput phenotyping. Sci Rep 2022; 12:16563. [PMID: 36195610 PMCID: PMC9532414 DOI: 10.1038/s41598-022-19754-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2022] [Accepted: 09/02/2022] [Indexed: 11/24/2022] Open
Abstract
Accurate segmentation of root system architecture (RSA) from 2D images is an important step in studying phenotypic traits of root systems. Various approaches to image segmentation exist but many of them are not well suited to the thin and reticulated structures characteristic of root systems. The findings presented here describe an approach to RSA segmentation that takes advantage of the inherent structural properties of the root system, a segmentation network architecture we call ITErRoot. We have also generated a novel 2D root image dataset which utilizes an annotation tool developed for producing high quality ground truth segmentation of root systems. Our approach makes use of an iterative neural network architecture to leverage the thin and highly branched properties of root systems for accurate segmentation. Rigorous analysis of model properties was carried out to obtain a high-quality model for 2D root segmentation. Results show a significant improvement over other recent approaches to root segmentation. Validation results show that the model generalizes to plant species with fine and highly branched RSA’s, and performs particularly well in the presence of non-root objects.
Collapse
Affiliation(s)
- Kyle Seidenthal
- Department of Computer Science, University of Saskatchewan, 110 Science Place, Saskatoon, SK, S7N 5C9, Canada
| | - Karim Panjvani
- Global Institute for Food Security, University of Saskatchewan, 421 Downey Road, Saskatoon, SK, S7N 4L8, Canada
| | - Rahul Chandnani
- Global Institute for Food Security, University of Saskatchewan, 421 Downey Road, Saskatoon, SK, S7N 4L8, Canada
| | - Leon Kochian
- Global Institute for Food Security, University of Saskatchewan, 421 Downey Road, Saskatoon, SK, S7N 4L8, Canada
| | - Mark Eramian
- Department of Computer Science, University of Saskatchewan, 110 Science Place, Saskatoon, SK, S7N 5C9, Canada.
| |
Collapse
|
22
|
Smith AG, Han E, Petersen J, Olsen NAF, Giese C, Athmann M, Dresbøll DB, Thorup‐Kristensen K. RootPainter: deep learning segmentation of biological images with corrective annotation. THE NEW PHYTOLOGIST 2022; 236:774-791. [PMID: 35851958 PMCID: PMC9804377 DOI: 10.1111/nph.18387] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/08/2022] [Accepted: 06/30/2022] [Indexed: 05/27/2023]
Abstract
Convolutional neural networks (CNNs) are a powerful tool for plant image analysis, but challenges remain in making them more accessible to researchers without a machine-learning background. We present RootPainter, an open-source graphical user interface based software tool for the rapid training of deep neural networks for use in biological image analysis. We evaluate RootPainter by training models for root length extraction from chicory (Cichorium intybus L.) roots in soil, biopore counting, and root nodule counting. We also compare dense annotations with corrective ones that are added during the training process based on the weaknesses of the current model. Five out of six times the models trained using RootPainter with corrective annotations created within 2 h produced measurements strongly correlating with manual measurements. Model accuracy had a significant correlation with annotation duration, indicating further improvements could be obtained with extended annotation. Our results show that a deep-learning model can be trained to a high accuracy for the three respective datasets of varying target objects, background, and image quality with < 2 h of annotation time. They indicate that, when using RootPainter, for many datasets it is possible to annotate, train, and complete data processing within 1 d.
Collapse
Affiliation(s)
- Abraham George Smith
- Department of Plant and Environmental ScienceUniversity of CopenhagenHøjbakkegårds Alle 13Tåstrup2630Denmark
- Department of Computer ScienceUniversity of CopenhagenUniversitetsparken 12100CopenhagenDenmark
| | - Eusun Han
- Department of Plant and Environmental ScienceUniversity of CopenhagenHøjbakkegårds Alle 13Tåstrup2630Denmark
- CSIRO Agriculture and FoodPO Box 1700CanberraACT2601Australia
| | - Jens Petersen
- Department of Computer ScienceUniversity of CopenhagenUniversitetsparken 12100CopenhagenDenmark
| | - Niels Alvin Faircloth Olsen
- Department of Plant and Environmental ScienceUniversity of CopenhagenHøjbakkegårds Alle 13Tåstrup2630Denmark
| | - Christian Giese
- Department of Agroecology and Organic FarmingUniversity of BonnRegina‐Pacis‐Weg 353113BonnGermany
| | - Miriam Athmann
- Department of Organic Farming and Plant ProductionUniversity of KasselNordbahnhofstr. 1aD‐37213WitzenhausenGermany
| | - Dorte Bodin Dresbøll
- Department of Plant and Environmental ScienceUniversity of CopenhagenHøjbakkegårds Alle 13Tåstrup2630Denmark
| | - Kristian Thorup‐Kristensen
- Department of Plant and Environmental ScienceUniversity of CopenhagenHøjbakkegårds Alle 13Tåstrup2630Denmark
| |
Collapse
|
23
|
ELMGAN: A GAN-based efficient lightweight multi-scale-feature-fusion multi-task model. Knowl Based Syst 2022. [DOI: 10.1016/j.knosys.2022.109434] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
24
|
LaRue T, Lindner H, Srinivas A, Exposito-Alonso M, Lobet G, Dinneny JR. Uncovering natural variation in root system architecture and growth dynamics using a robotics-assisted phenomics platform. eLife 2022; 11:e76968. [PMID: 36047575 PMCID: PMC9499532 DOI: 10.7554/elife.76968] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Accepted: 08/28/2022] [Indexed: 11/29/2022] Open
Abstract
The plant kingdom contains a stunning array of complex morphologies easily observed above-ground, but more challenging to visualize below-ground. Understanding the magnitude of diversity in root distribution within the soil, termed root system architecture (RSA), is fundamental in determining how this trait contributes to species adaptation in local environments. Roots are the interface between the soil environment and the shoot system and therefore play a key role in anchorage, resource uptake, and stress resilience. Previously, we presented the GLO-Roots (Growth and Luminescence Observatory for Roots) system to study the RSA of soil-grown Arabidopsis thaliana plants from germination to maturity (Rellán-Álvarez et al., 2015). In this study, we present the automation of GLO-Roots using robotics and the development of image analysis pipelines in order to examine the temporal dynamic regulation of RSA and the broader natural variation of RSA in Arabidopsis, over time. These datasets describe the developmental dynamics of two independent panels of accessions and reveal highly complex and polygenic RSA traits that show significant correlation with climate variables of the accessions' respective origins.
Collapse
Affiliation(s)
- Therese LaRue
- Department of Biology, Stanford UniversityStanfordUnited States
- Department of Plant Biology, Carnegie Institution for ScienceStanfordUnited States
| | - Heike Lindner
- Department of Plant Biology, Carnegie Institution for ScienceStanfordUnited States
- Institute of Plant Sciences, University of BernBernSwitzerland
| | - Ankit Srinivas
- Department of Plant Biology, Carnegie Institution for ScienceStanfordUnited States
| | - Moises Exposito-Alonso
- Department of Biology, Stanford UniversityStanfordUnited States
- Department of Plant Biology, Carnegie Institution for ScienceStanfordUnited States
| | - Guillaume Lobet
- UCLouvain, Faculty of BioengineeringLouvain-la-NeuveBelgium
- Forschungszentrum Jülich, Agrosphere InstituteJuelichGermany
| | - José R Dinneny
- Department of Biology, Stanford UniversityStanfordUnited States
| |
Collapse
|
25
|
A Lightweight Semantic Segmentation Model of Wucai Seedlings Based on Attention Mechanism. PHOTONICS 2022. [DOI: 10.3390/photonics9060393] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Accurate wucai seedling segmentation is of great significance for growth detection, seedling location, and phenotype detection. To segment wucai seedlings accurately in a natural environment, this paper presents a lightweight segmentation model of wucai seedlings, where U-Net is used as the backbone network. Specifically, to improve the feature extraction ability of the model for wucai seedlings of different sizes, a multi-branch convolution block based on inception structure is proposed and used to design the encoder. In addition, the expectation “maximizationexpectation” maximization attention module is added to enhance the attention of the model to the segmentation object. In addition, because of the problem that a large number of parameters easily increase the difficulty of network training and computational cost, the depth-wise separable convolution is applied to replace the original convolution in the decoding stage to lighten the model. The experimental results show that the precision, recall, MIOU, and F1-score of the proposed model on the self-built wucai seedling dataset are 0.992, 0.973, 0.961, and 0.982, respectively, and the average recognition time of single frame image is 0.0066 s. Compared with several state-of-the-art models, the proposed model achieves better segmentation performance and has the characteristics of smaller-parameter scale and higher real-time performance. Therefore, the proposed model can achieve good segmentation effect for wucai seedlings in natural environment, which can provide important basis for target spraying, growth recognition, and other applications.
Collapse
|
26
|
Bauer FM, Lärm L, Morandage S, Lobet G, Vanderborght J, Vereecken H, Schnepf A. Development and Validation of a Deep Learning Based Automated Minirhizotron Image Analysis Pipeline. PLANT PHENOMICS (WASHINGTON, D.C.) 2022; 2022:9758532. [PMID: 35693120 PMCID: PMC9168891 DOI: 10.34133/2022/9758532] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/25/2022] [Accepted: 05/05/2022] [Indexed: 11/28/2022]
Abstract
Root systems of crops play a significant role in agroecosystems. The root system is essential for water and nutrient uptake, plant stability, symbiosis with microbes, and a good soil structure. Minirhizotrons have shown to be effective to noninvasively investigate the root system. Root traits, like root length, can therefore be obtained throughout the crop growing season. Analyzing datasets from minirhizotrons using common manual annotation methods, with conventional software tools, is time-consuming and labor-intensive. Therefore, an objective method for high-throughput image analysis that provides data for field root phenotyping is necessary. In this study, we developed a pipeline combining state-of-the-art software tools, using deep neural networks and automated feature extraction. This pipeline consists of two major components and was applied to large root image datasets from minirhizotrons. First, a segmentation by a neural network model, trained with a small image sample, is performed. Training and segmentation are done using "RootPainter." Then, an automated feature extraction from the segments is carried out by "RhizoVision Explorer." To validate the results of our automated analysis pipeline, a comparison of root length between manually annotated and automatically processed data was realized with more than 36,500 images. Mainly the results show a high correlation (r = 0.9) between manually and automatically determined root lengths. With respect to the processing time, our new pipeline outperforms manual annotation by 98.1-99.6%. Our pipeline, combining state-of-the-art software tools, significantly reduces the processing time for minirhizotron images. Thus, image analysis is no longer the bottle-neck in high-throughput phenotyping approaches.
Collapse
Affiliation(s)
- Felix Maximilian Bauer
- Institute of Bio-and Geosciences, Agrosphere (IBG-3), Forschungszentrum Jülich GmbH, 52425 Jülich, Germany
| | - Lena Lärm
- Institute of Bio-and Geosciences, Agrosphere (IBG-3), Forschungszentrum Jülich GmbH, 52425 Jülich, Germany
| | - Shehan Morandage
- Institute of Soil Science and Land Evaluation, University of Hohenheim, 70559 78 Stuttgart, Germany
| | - Guillaume Lobet
- Institute of Bio-and Geosciences, Agrosphere (IBG-3), Forschungszentrum Jülich GmbH, 52425 Jülich, Germany
| | - Jan Vanderborght
- Institute of Bio-and Geosciences, Agrosphere (IBG-3), Forschungszentrum Jülich GmbH, 52425 Jülich, Germany
| | - Harry Vereecken
- Institute of Bio-and Geosciences, Agrosphere (IBG-3), Forschungszentrum Jülich GmbH, 52425 Jülich, Germany
| | - Andrea Schnepf
- Institute of Bio-and Geosciences, Agrosphere (IBG-3), Forschungszentrum Jülich GmbH, 52425 Jülich, Germany
| |
Collapse
|
27
|
Chen G, Rasmussen CR, Dresbøll DB, Smith AG, Thorup-Kristensen K. Dynamics of Deep Water and N Uptake of Oilseed Rape ( Brassica napus L.) Under Varied N and Water Supply. FRONTIERS IN PLANT SCIENCE 2022; 13:866288. [PMID: 35574102 PMCID: PMC9100933 DOI: 10.3389/fpls.2022.866288] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 01/31/2022] [Accepted: 03/28/2022] [Indexed: 06/15/2023]
Abstract
Enhanced nitrogen (N) and water uptake from deep soil layers may increase resource use efficiency while maintaining yield under stressed conditions. Winter oilseed rape (Brassica napus L.) can develop deep roots and access deep-stored resources such as N and water to sustain its growth and productivity. Less is known of the performance of deep roots under varying water and N availability. In this study, we aimed to evaluate the effects of reduced N and water supply on deep N and water uptake for oilseed rape. Oilseed rape plants grown in outdoor rhizotrons were supplied with 240 and 80 kg N ha-1, respectively, in 2019 whereas a well-watered and a water-deficit treatment were established in 2020. To track deep water and N uptake, a mixture of 2H2O and Ca(15NO3)2 was injected into the soil column at 0.5- and 1.7-m depths. δ2H in transpiration water and δ15N in leaves were measured after injection. δ15N values in biomass samples were also measured. Differences in N or water supply had less effect on root growth. The low N treatment reduced water uptake throughout the soil profile and altered water uptake distribution. The low N supply doubled the 15N uptake efficiency at both 0.5 and 1.7 m. Similarly, water deficit in the upper soil layers led to compensatory deep water uptake. Our findings highlight the increasing importance of deep roots for water uptake, which is essential for maintaining an adequate water supply in the late growing stage. Our results further indicate the benefit of reducing N supply for mitigating N leaching and altering water uptake from deep soil layers, yet at a potential cost of biomass reduction.
Collapse
Affiliation(s)
- Guanying Chen
- Department of Plant and Environmental Sciences, University of Copenhagen, Copenhagen, Denmark
| | - Camilla Ruø Rasmussen
- Earth and Life Institute, Université Catholique de Louvain, Ottignies-Louvain-la-Neuve, Belgium
| | - Dorte Bodin Dresbøll
- Department of Plant and Environmental Sciences, University of Copenhagen, Copenhagen, Denmark
| | | | | |
Collapse
|
28
|
Lube V, Noyan MA, Przybysz A, Salama K, Blilou I. MultipleXLab: A high-throughput portable live-imaging root phenotyping platform using deep learning and computer vision. PLANT METHODS 2022; 18:38. [PMID: 35346267 PMCID: PMC8958799 DOI: 10.1186/s13007-022-00864-4] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 11/05/2021] [Accepted: 02/24/2022] [Indexed: 06/14/2023]
Abstract
BACKGROUND Profiling the plant root architecture is vital for selecting resilient crops that can efficiently take up water and nutrients. The high-performance imaging tools available to study root-growth dynamics with the optimal resolution are costly and stationary. In addition, performing nondestructive high-throughput phenotyping to extract the structural and morphological features of roots remains challenging. RESULTS We developed the MultipleXLab: a modular, mobile, and cost-effective setup to tackle these limitations. The system can continuously monitor thousands of seeds from germination to root development based on a conventional camera attached to a motorized multiaxis-rotational stage and custom-built 3D-printed plate holder with integrated light-emitting diode lighting. We also developed an image segmentation model based on deep learning that allows the users to analyze the data automatically. We tested the MultipleXLab to monitor seed germination and root growth of Arabidopsis developmental, cell cycle, and auxin transport mutants non-invasively at high-throughput and showed that the system provides robust data and allows precise evaluation of germination index and hourly growth rate between mutants. CONCLUSION MultipleXLab provides a flexible and user-friendly root phenotyping platform that is an attractive mobile alternative to high-end imaging platforms and stationary growth chambers. It can be used in numerous applications by plant biologists, the seed industry, crop scientists, and breeding companies.
Collapse
Affiliation(s)
- Vinicius Lube
- Laboratory of Plant Cell and Developmental Biology (LPCDB), Biological and Environmental Sciences and Engineering (BESE), King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Saudi Arabia
| | | | - Alexander Przybysz
- Sensors Lab, Advanced Membranes and Porous Materials Center (AMPMC), Computer, Electrical and Mathematical Science and Engineering (CEMSE), KAUST, Thuwal, Saudi Arabia
| | - Khaled Salama
- Sensors Lab, Advanced Membranes and Porous Materials Center (AMPMC), Computer, Electrical and Mathematical Science and Engineering (CEMSE), KAUST, Thuwal, Saudi Arabia
| | - Ikram Blilou
- Laboratory of Plant Cell and Developmental Biology (LPCDB), Biological and Environmental Sciences and Engineering (BESE), King Abdullah University of Science and Technology (KAUST), Thuwal, 23955-6900, Saudi Arabia.
| |
Collapse
|
29
|
Wacker TS, Popovic O, Olsen NAF, Markussen B, Smith AG, Svane SF, Thorup-Kristensen K. Semifield root phenotyping: Root traits for deep nitrate uptake. PLANT, CELL & ENVIRONMENT 2022; 45:823-836. [PMID: 34806183 DOI: 10.1111/pce.14227] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/26/2021] [Revised: 11/02/2021] [Accepted: 11/09/2021] [Indexed: 06/13/2023]
Abstract
Deep rooting winter wheat genotypes can reduce nitrate leaching losses and increase N uptake. We aimed to investigate which deep root traits are correlated to deep N uptake and to estimate genetic variation in root traits and deep 15 N tracer uptake. In 2 years, winter wheat genotypes were grown in RadiMax, a semifield root-screening facility. Minirhizotron root imaging was performed three times during the main growing season. At anthesis, 15 N was injected via subsurface drip irrigation at 1.8 m depth. Mature ears from above the injection area were analysed for 15 N content. From minirhizotron image-based root length data, 82 traits were constructed, describing root depth, density, distribution and growth aspects. Their ability to predict 15 N uptake was analysed with the least absolute shrinkage and selection operator (LASSO) regression. Root traits predicted 24% and 14% of tracer uptake variation in 2 years. Both root traits and genotype showed significant effects on tracer uptake. In 2018, genotype and the three LASSO-selected root traits predicted 41% of the variation in tracer uptake, in 2019 genotype and one root trait predicted 48%. In both years, one root trait significantly mediated the genotype effect on tracer uptake. Deep root traits from minirhizotron images can predict deep N uptake, indicating the potential to breed deep-N-uptake-genotypes.
Collapse
Affiliation(s)
- Tomke S Wacker
- Department of Plant and Environmental Sciences, Faculty of Science, University of Copenhagen, Copenhagen, Denmark
| | - Olga Popovic
- Department of Plant and Environmental Sciences, Faculty of Science, University of Copenhagen, Copenhagen, Denmark
| | - Niels A F Olsen
- Department of Plant and Environmental Sciences, Faculty of Science, University of Copenhagen, Copenhagen, Denmark
| | - Bo Markussen
- Data Science Laboratory, Department of Mathematical Sciences, Faculty of Science, University of Copenhagen, Copenhagen, Denmark
| | - Abraham G Smith
- Department of Computer Science, Faculty of Science, University of Copenhagen, Copenhagen, Denmark
| | - Simon F Svane
- Department of Plant and Environmental Sciences, Faculty of Science, University of Copenhagen, Copenhagen, Denmark
| | - Kristian Thorup-Kristensen
- Department of Plant and Environmental Sciences, Faculty of Science, University of Copenhagen, Copenhagen, Denmark
| |
Collapse
|
30
|
Teramoto S, Uga Y. Improving the efficiency of plant root system phenotyping through digitization and automation. BREEDING SCIENCE 2022; 72:48-55. [PMID: 36045896 PMCID: PMC8987843 DOI: 10.1270/jsbbs.21053] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/27/2021] [Accepted: 11/11/2021] [Indexed: 05/19/2023]
Abstract
Root system architecture (RSA) determines unevenly distributed water and nutrient availability in soil. Genetic improvement of RSA, therefore, is related to crop production. However, RSA phenotyping has been carried out less frequently than above-ground phenotyping because measuring roots in the soil is difficult and labor intensive. Recent advancements have led to the digitalization of plant measurements; this digital phenotyping has been widely used for measurements of both above-ground and RSA traits. Digital phenotyping for RSA is slower and more difficult than for above-ground traits because the roots are hidden underground. In this review, we summarized recent trends in digital phenotyping for RSA traits. We classified the sample types into three categories: soil block containing roots, section of soil block, and root sample. Examples of the use of digital phenotyping are presented for each category. We also discussed room for improvement in digital phenotyping in each category.
Collapse
Affiliation(s)
- Shota Teramoto
- Institute of Crop Science, National Agriculture and Food Research Organization, Tsukuba, Ibaraki 305-8518, Japan
| | - Yusaku Uga
- Institute of Crop Science, National Agriculture and Food Research Organization, Tsukuba, Ibaraki 305-8518, Japan
- Corresponding author (e-mail: )
| |
Collapse
|
31
|
Zenkl R, Timofte R, Kirchgessner N, Roth L, Hund A, Van Gool L, Walter A, Aasen H. Outdoor Plant Segmentation With Deep Learning for High-Throughput Field Phenotyping on a Diverse Wheat Dataset. FRONTIERS IN PLANT SCIENCE 2022; 12:774068. [PMID: 35058948 PMCID: PMC8765702 DOI: 10.3389/fpls.2021.774068] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/10/2021] [Accepted: 11/05/2021] [Indexed: 05/25/2023]
Abstract
Robust and automated segmentation of leaves and other backgrounds is a core prerequisite of most approaches in high-throughput field phenotyping. So far, the possibilities of deep learning approaches for this purpose have not been explored adequately, partly due to a lack of publicly available, appropriate datasets. This study presents a workflow based on DeepLab v3+ and on a diverse annotated dataset of 190 RGB (350 x 350 pixels) images. Images of winter wheat plants of 76 different genotypes and developmental stages have been acquired throughout multiple years at high resolution in outdoor conditions using nadir view, encompassing a wide range of imaging conditions. Inconsistencies of human annotators in complex images have been quantified, and metadata information of camera settings has been included. The proposed approach achieves an intersection over union (IoU) of 0.77 and 0.90 for plants and soil, respectively. This outperforms the benchmarked machine learning methods which use Support Vector Classifier and/or Random Forrest. The results show that a small but carefully chosen and annotated set of images can provide a good basis for a powerful segmentation pipeline. Compared to earlier methods based on machine learning, the proposed method achieves better performance on the selected dataset in spite of using a deep learning approach with limited data. Increasing the amount of publicly available data with high human agreement on annotations and further development of deep neural network architectures will provide high potential for robust field-based plant segmentation in the near future. This, in turn, will be a cornerstone of data-driven improvement in crop breeding and agricultural practices of global benefit.
Collapse
Affiliation(s)
- Radek Zenkl
- Group of Crop Science, Department of Environmental Systems Science, Institute of Agricultural Sciences, ETH Zurich, Zurich, Switzerland
| | - Radu Timofte
- Computer Vision Lab, Department of Information Technology and Electrical Engineering, ETH Zurich, Zurich, Switzerland
| | - Norbert Kirchgessner
- Group of Crop Science, Department of Environmental Systems Science, Institute of Agricultural Sciences, ETH Zurich, Zurich, Switzerland
| | - Lukas Roth
- Group of Crop Science, Department of Environmental Systems Science, Institute of Agricultural Sciences, ETH Zurich, Zurich, Switzerland
| | - Andreas Hund
- Group of Crop Science, Department of Environmental Systems Science, Institute of Agricultural Sciences, ETH Zurich, Zurich, Switzerland
| | - Luc Van Gool
- Computer Vision Lab, Department of Information Technology and Electrical Engineering, ETH Zurich, Zurich, Switzerland
| | - Achim Walter
- Group of Crop Science, Department of Environmental Systems Science, Institute of Agricultural Sciences, ETH Zurich, Zurich, Switzerland
| | - Helge Aasen
- Remote Sensing Team, Division of Agroecology and Environment, Agroscope, Zurich, Switzerland
| |
Collapse
|
32
|
Zeng D, Li M, Jiang N, Ju Y, Schreiber H, Chambers E, Letscher D, Ju T, Topp CN. TopoRoot: a method for computing hierarchy and fine-grained traits of maize roots from 3D imaging. PLANT METHODS 2021; 17:127. [PMID: 34903248 PMCID: PMC8667396 DOI: 10.1186/s13007-021-00829-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/24/2021] [Accepted: 11/30/2021] [Indexed: 06/14/2023]
Abstract
BACKGROUND 3D imaging, such as X-ray CT and MRI, has been widely deployed to study plant root structures. Many computational tools exist to extract coarse-grained features from 3D root images, such as total volume, root number and total root length. However, methods that can accurately and efficiently compute fine-grained root traits, such as root number and geometry at each hierarchy level, are still lacking. These traits would allow biologists to gain deeper insights into the root system architecture. RESULTS We present TopoRoot, a high-throughput computational method that computes fine-grained architectural traits from 3D images of maize root crowns or root systems. These traits include the number, length, thickness, angle, tortuosity, and number of children for the roots at each level of the hierarchy. TopoRoot combines state-of-the-art algorithms in computer graphics, such as topological simplification and geometric skeletonization, with customized heuristics for robustly obtaining the branching structure and hierarchical information. TopoRoot is validated on both CT scans of excavated field-grown root crowns and simulated images of root systems, and in both cases, it was shown to improve the accuracy of traits over existing methods. TopoRoot runs within a few minutes on a desktop workstation for images at the resolution range of 400^3, with minimal need for human intervention in the form of setting three intensity thresholds per image. CONCLUSIONS TopoRoot improves the state-of-the-art methods in obtaining more accurate and comprehensive fine-grained traits of maize roots from 3D imaging. The automation and efficiency make TopoRoot suitable for batch processing on large numbers of root images. Our method is thus useful for phenomic studies aimed at finding the genetic basis behind root system architecture and the subsequent development of more productive crops.
Collapse
Affiliation(s)
- Dan Zeng
- Department of Computer Science and Engineering, Washington University in St. Louis, Saint Louis, MO, 63130, USA.
| | - Mao Li
- Donald Danforth Plant Science Center, Saint Louis, MO, 63132, USA
| | - Ni Jiang
- Donald Danforth Plant Science Center, Saint Louis, MO, 63132, USA
| | - Yiwen Ju
- Department of Computer Science and Engineering, Washington University in St. Louis, Saint Louis, MO, 63130, USA
| | - Hannah Schreiber
- Department of Computer Science, Saint Louis University, Saint Louis, MO, 63103, USA
| | - Erin Chambers
- Department of Computer Science, Saint Louis University, Saint Louis, MO, 63103, USA
| | - David Letscher
- Department of Computer Science, Saint Louis University, Saint Louis, MO, 63103, USA
| | - Tao Ju
- Department of Computer Science and Engineering, Washington University in St. Louis, Saint Louis, MO, 63130, USA
| | | |
Collapse
|
33
|
Estimation of Plant Height and Aboveground Biomass of Toona sinensis under Drought Stress Using RGB-D Imaging. FORESTS 2021. [DOI: 10.3390/f12121747] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/06/2023]
Abstract
Rapid and accurate plant growth and biomass estimation is essential for formulating and implementing targeted forest cultivation measures. In this study, RGB-D imaging technology was used to obtain the RGB and depth imaging data for a Toona sinensis seedling canopy to estimate plant growth and aboveground biomass (AGB). Three hundred T. sinensis seedlings from 20 varieties were planted under five different drought stress treatments. The U-Net model was applied first to achieve highly accurate segmentation of plants from complex backgrounds. Simple linear regression (SLR) was used for plant height prediction, and the other three models, including multivariate linear (ML), random forest (RF) and multilayer perceptron (MLP) regression, were applied to predict the AGB and compared for optimal model selection. The results showed that the SLR model yields promising and reliable results for the prediction of plant height, with R2 and RMSE values of 0.72 and 1.89 cm, respectively. All three regression methods perform well in the prediction of AGB estimation. MLP yields the highest accuracy in predicting dry and fresh aboveground biomass compared to the other two regression models, with R2 values of 0.77 and 0.83, respectively. The combination of Gray, Green minus red (GMR) and Excess green index (ExG) was identified as the key predictor by RReliefF for predicting dry AGB. GMR was the most important in predicting fresh AGB. This study demonstrated that the merits of RGB-D and machine learning models are effective phenotyping techniques for plant height and AGB prediction, and can be used to assist dynamic responses to drought stress for breeding selection.
Collapse
|
34
|
Smith AG, Petersen J, Terrones-Campos C, Berthelsen AK, Forbes NJ, Darkner S, Specht L, Vogelius IR. RootPainter3D: Interactive-machine-learning enables rapid and accurate contouring for radiotherapy. Med Phys 2021; 49:461-473. [PMID: 34783028 DOI: 10.1002/mp.15353] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2021] [Revised: 09/22/2021] [Accepted: 10/28/2021] [Indexed: 11/07/2022] Open
Abstract
PURPOSE Organ-at-risk contouring is still a bottleneck in radiotherapy, with many deep learning methods falling short of promised results when evaluated on clinical data. We investigate the accuracy and time-savings resulting from the use of an interactive-machine-learning method for an organ-at-risk contouring task. METHODS We implement an open-source interactive-machine-learning software application that facilitates corrective-annotation for deep-learning generated contours on X-ray CT images. A trained-physician contoured 933 hearts using our software by delineating the first image, starting model training, and then correcting the model predictions for all subsequent images. These corrections were added into the training data, which was used for continuously training the assisting model. From the 933 hearts, the same physician also contoured the first 10 and last 10 in Eclipse (Varian) to enable comparison in terms of accuracy and duration. RESULTS We find strong agreement with manual delineations, with a dice score of 0.95. The annotations created using corrective-annotation also take less time to create as more images are annotated, resulting in substantial time savings compared to manual methods. After 923 images had been delineated, hearts took 2 min and 2 s to delineate on average, which includes time to evaluate the initial model prediction and assign the needed corrections, compared to 7 min and 1 s when delineating manually. CONCLUSIONS Our experiment demonstrates that interactive-machine-learning with corrective-annotation provides a fast and accessible way for non computer-scientists to train deep-learning models to segment their own structures of interest as part of routine clinical workflows.
Collapse
Affiliation(s)
- Abraham George Smith
- Department of Computer Science, University of Copenhagen, Copenhagen, Denmark.,Department of Oncology, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark
| | - Jens Petersen
- Department of Computer Science, University of Copenhagen, Copenhagen, Denmark.,Department of Oncology, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark
| | - Cynthia Terrones-Campos
- Department of Oncology, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark.,Department of Infectious Diseases, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark
| | - Anne Kiil Berthelsen
- Department of Oncology, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark.,Department of Clinical Physiology, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark
| | - Nora Jarrett Forbes
- Department of Computer Science, University of Copenhagen, Copenhagen, Denmark.,Department of Oncology, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark
| | - Sune Darkner
- Department of Computer Science, University of Copenhagen, Copenhagen, Denmark
| | - Lena Specht
- Department of Oncology, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark
| | - Ivan Richter Vogelius
- Department of Oncology, Rigshospitalet, University of Copenhagen, Copenhagen, Denmark.,Department of Health and Medical Sciences, University of Copenhagen, Copenhagen, Denmark
| |
Collapse
|
35
|
Automatic Asbestos Control Using Deep Learning Based Computer Vision System. APPLIED SCIENCES-BASEL 2021. [DOI: 10.3390/app112210532] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
The paper discusses the results of the research and development of an innovative deep learning-based computer vision system for the fully automatic asbestos content (productivity) estimation in rock chunk (stone) veins in an open pit and within the time comparable with the work of specialists (about 10 min per one open pit processing place). The discussed system is based on the applying of instance and semantic segmentation of artificial neural networks. The Mask R-CNN-based network architecture is applied to the asbestos-containing rock chunks searching images of an open pit. The U-Net-based network architecture is applied to the segmentation of asbestos veins in the images of selected rock chunks. The designed system allows an automatic search and takes images of the asbestos rocks in an open pit in the near-infrared range (NIR) and processes the obtained images. The result of the system work is the average asbestos content (productivity) estimation for each controlled open pit. It is validated to estimate asbestos content as the graduated average ratio of the vein area value to the selected rock chunk area value, both determined by the trained neural network. For both neural network training tasks the training, validation, and test datasets are collected. The designed system demonstrates an error of about 0.4% under different weather conditions in an open pit when the asbestos content is about 1.5–4%. The obtained accuracy is sufficient to use the system as a geological service tool instead of currently applied visual-based estimations.
Collapse
|
36
|
Han E, Smith AG, Kemper R, White R, Kirkegaard JA, Thorup-Kristensen K, Athmann M. Digging roots is easier with AI. JOURNAL OF EXPERIMENTAL BOTANY 2021; 72:4680-4690. [PMID: 33884416 DOI: 10.1093/jxb/erab174] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/05/2021] [Accepted: 04/19/2021] [Indexed: 06/12/2023]
Abstract
The scale of root quantification in research is often limited by the time required for sampling, measurement, and processing samples. Recent developments in convolutional neural networks (CNNs) have made faster and more accurate plant image analysis possible, which may significantly reduce the time required for root measurement, but challenges remain in making these methods accessible to researchers without an in-depth knowledge of machine learning. We analyzed root images acquired from three destructive root samplings using the RootPainter CNN software that features an interface for corrective annotation for easier use. Root scans with and without non-root debris were used to test if training a model (i.e. learning from labeled examples) can effectively exclude the debris by comparing the end results with measurements from clean images. Root images acquired from soil profile walls and the cross-section of soil cores were also used for training, and the derived measurements were compared with manual measurements. After 200 min of training on each dataset, significant relationships between manual measurements and RootPainter-derived data were noted for monolith (R2=0.99), profile wall (R2=0.76), and core-break (R2=0.57). The rooting density derived from images with debris was not significantly different from that derived from clean images after processing with RootPainter. Rooting density was also successfully calculated from both profile wall and soil core images, and in each case the gradient of root density with depth was not significantly different from manual counts. Differences in root-length density (RLD) between crops with contrasting root systems were captured using automatic segmentation at soil profiles with high RLD (1-5 cm cm-3) as well with low RLD (0.1-0.3 cm cm-3). Our results demonstrate that the proposed approach using CNN can lead to substantial reductions in root sample processing workloads, increasing the potential scale of future root investigations.
Collapse
Affiliation(s)
- Eusun Han
- Department of Plant and Environmental Sciences, University of Copenhagen, Højbakkegård Alle 13, 2630 Taastrup, Denmark
| | - Abraham George Smith
- Department of Computer Science, University of Copenhagen, Universitetsparken 1, 2100, Copenhagen Ø, Denmark
| | - Roman Kemper
- Department of Agroecology and Organic Farming, Faculty of Agriculture, University of Bonn, Auf dem Hügel 6, 53121 Bonn, Germany
| | - Rosemary White
- CSIRO Agriculture and Food, PO Box 1700, Canberra, ACT 2601, Australia
| | - John A Kirkegaard
- CSIRO Agriculture and Food, PO Box 1700, Canberra, ACT 2601, Australia
| | - Kristian Thorup-Kristensen
- Department of Plant and Environmental Sciences, University of Copenhagen, Højbakkegård Alle 13, 2630 Taastrup, Denmark
| | - Miriam Athmann
- Department of Organic Farming and Cropping Systems, University of Kassel, Nordbahnhofstr. 1a, 37213 Witzenhausen, Germany
| |
Collapse
|
37
|
Detection of foraging behavior from accelerometer data using U-Net type convolutional networks. ECOL INFORM 2021. [DOI: 10.1016/j.ecoinf.2021.101275] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/19/2022]
|
38
|
High-throughput image segmentation and machine learning approaches in the plant sciences across multiple scales. Emerg Top Life Sci 2021; 5:239-248. [DOI: 10.1042/etls20200273] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Revised: 02/09/2021] [Accepted: 02/11/2021] [Indexed: 01/12/2023]
Abstract
Agriculture has benefited greatly from the rise of big data and high-performance computing. The acquisition and analysis of data across biological scales have resulted in strategies modeling inter- actions between plant genotype and environment, models of root architecture that provide insight into resource utilization, and the elucidation of cell-to-cell communication mechanisms that are instrumental in plant development. Image segmentation and machine learning approaches for interpreting plant image data are among many of the computational methodologies that have evolved to address challenging agricultural and biological problems. These approaches have led to contributions such as the accelerated identification of gene that modulate stress responses in plants and automated high-throughput phenotyping for early detection of plant diseases. The continued acquisition of high throughput imaging across multiple biological scales provides opportunities to further push the boundaries of our understandings quicker than ever before. In this review, we explore the current state of the art methodologies in plant image segmentation and machine learning at the agricultural, organ, and cellular scales in plants. We show how the methodologies for segmentation and classification differ due to the diversity of physical characteristics found at these different scales. We also discuss the hardware technologies most commonly used at these different scales, the types of quantitative metrics that can be extracted from these images, and how the biological mechanisms by which plants respond to abiotic/biotic stresses or genotypic modifications can be extracted from these approaches.
Collapse
|
39
|
Gerth S, Claußen J, Eggert A, Wörlein N, Waininger M, Wittenberg T, Uhlmann N. Semiautomated 3D Root Segmentation and Evaluation Based on X-Ray CT Imagery. PLANT PHENOMICS (WASHINGTON, D.C.) 2021; 2021:8747930. [PMID: 33644765 PMCID: PMC7903318 DOI: 10.34133/2021/8747930] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/08/2020] [Accepted: 12/11/2020] [Indexed: 05/05/2023]
Abstract
BACKGROUND Computed X-ray tomography (CTX) is a high-end nondestructive approach for the visual assessment of root architecture in soil. Nevertheless, in order to evaluate high-resolution CTX data of root architectures, manual segmentation of the depicted root systems from large-scale volume data is currently necessary, which is both time consuming and error prone. The duration of such a segmentation is of importance, especially for time-resolved growth analysis, where several instances of a plant need to be segmented and evaluated. Specifically, in our application, the contrast between soil and root data varies due to different growth stages and watering situations at the time of scanning. Additionally, the root system itself is expanding in length and in the diameter of individual roots. OBJECTIVE For semiautomated and robust root system segmentation from CTX data, we propose the RootForce approach, which is an extension of Frangi's "multi-scale vesselness" method and integrates a 3D local variance. It allows a precise delineation of roots with diameters down to several μm in pots with varying diameters. Additionally, RootForce is not limited to the segmentation of small below-ground organs, but is also able to handle storage roots with a diameter larger than 40 voxels. RESULTS Using CTX volume data of full-grown bean plants as well as time-resolved (3D + time) growth studies of cassava plants, RootForce produces similar (and much faster) results compared to manual segmentation of the regarded root architectures. Furthermore, RootForce enables the user to obtain traits not possible to be calculated before, such as total root volume (V root), total root length (L root), root volume over depth, root growth angles (θ min, θ mean, and θ max), root surrounding soil density D soil, or form fraction F. Discussion. The proposed RootForce tool can provide a higher efficiency for the semiautomatic high-throughput assessment of the root architectures of different types of plants from large-scale CTX. Furthermore, for all datasets within a growth experiment, only a single set of parameters is needed. Thus, the proposed tool can be used for a wide range of growth experiments in the field of plant phenotyping.
Collapse
Affiliation(s)
- Stefan Gerth
- Development Center X-Ray Technology (EZRT), Fraunhofer Institute for Integrated Systems (IIS), Flugplatzstraße 75, 90768 Fürth, Germany
| | - Joelle Claußen
- Development Center X-Ray Technology (EZRT), Fraunhofer Institute for Integrated Systems (IIS), Flugplatzstraße 75, 90768 Fürth, Germany
| | - Anja Eggert
- Development Center X-Ray Technology (EZRT), Fraunhofer Institute for Integrated Systems (IIS), Flugplatzstraße 75, 90768 Fürth, Germany
| | - Norbert Wörlein
- Development Center X-Ray Technology (EZRT), Fraunhofer Institute for Integrated Systems (IIS), Flugplatzstraße 75, 90768 Fürth, Germany
| | - Michael Waininger
- Development Center X-Ray Technology (EZRT), Fraunhofer Institute for Integrated Systems (IIS), Flugplatzstraße 75, 90768 Fürth, Germany
| | - Thomas Wittenberg
- Development Center X-Ray Technology (EZRT), Fraunhofer Institute for Integrated Systems (IIS), Flugplatzstraße 75, 90768 Fürth, Germany
- Biomedical Engineering Department, Fraunhofer Institute for Integrated Systems (IIS), Am Wolfsmantel 33 11, 91058 Erlangen, Germany
| | - Norman Uhlmann
- Development Center X-Ray Technology (EZRT), Fraunhofer Institute for Integrated Systems (IIS), Flugplatzstraße 75, 90768 Fürth, Germany
| |
Collapse
|
40
|
Improved Intelligent Image Segmentation Algorithm for Mechanical Sensors in Industrial IoT: A Joint Learning Approach. ELECTRONICS 2021. [DOI: 10.3390/electronics10040446] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
The industrial Internet of Things (IoT) can monitor production in real-time by collecting the status of parts on the production line with cameras. It is easy to have bright and dark areas in the same image because of the smooth surfaces of mechanical parts and the unstable light source, which affects semantic segmentation’s performance. This paper proposes a joint learning method to eliminate the influence of illumination on semantic segmentation. Semantic image segmentation and image decomposition are jointly trained in the same model, and the reflectance image is used to guide the semantic segmentation task without the illumination component. Moreover, this paper adopts an enhanced convolution kernel to improve the pixel accuracy and BN fusion to enhance the inference speed, optimizing the model to meet real-time detection needs. In the experiments, a dataset of real gear parts was collected from industrial IoT cameras. The experimental results show that the proposed joint learning approach outperforms the state-of-the-art methods in the task of edge mechanical part detection, with about 4% pixel accuracy improvement.
Collapse
|
41
|
Kellenberger B, Tuia D, Morris D. AIDE: Accelerating image‐based ecological surveys with interactive machine learning. Methods Ecol Evol 2020. [DOI: 10.1111/2041-210x.13489] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/20/2023]
Affiliation(s)
- Benjamin Kellenberger
- Laboratory of Geo‐Information Science and Remote Sensing Wageningen University & Research Wageningen The Netherlands
- Microsoft AI for Earth Seattle WA USA
| | - Devis Tuia
- Laboratory of Geo‐Information Science and Remote Sensing Wageningen University & Research Wageningen The Netherlands
- Environmental Computational Science and Earth Observation Laboratory Ecole Polytechnique Fédérale de Lausanne (EPFL) Sion Switzerland
| | | |
Collapse
|
42
|
Jiang Y, Li C. Convolutional Neural Networks for Image-Based High-Throughput Plant Phenotyping: A Review. PLANT PHENOMICS (WASHINGTON, D.C.) 2020; 2020:4152816. [PMID: 33313554 PMCID: PMC7706326 DOI: 10.34133/2020/4152816] [Citation(s) in RCA: 107] [Impact Index Per Article: 26.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/30/2019] [Accepted: 03/12/2020] [Indexed: 05/19/2023]
Abstract
Plant phenotyping has been recognized as a bottleneck for improving the efficiency of breeding programs, understanding plant-environment interactions, and managing agricultural systems. In the past five years, imaging approaches have shown great potential for high-throughput plant phenotyping, resulting in more attention paid to imaging-based plant phenotyping. With this increased amount of image data, it has become urgent to develop robust analytical tools that can extract phenotypic traits accurately and rapidly. The goal of this review is to provide a comprehensive overview of the latest studies using deep convolutional neural networks (CNNs) in plant phenotyping applications. We specifically review the use of various CNN architecture for plant stress evaluation, plant development, and postharvest quality assessment. We systematically organize the studies based on technical developments resulting from imaging classification, object detection, and image segmentation, thereby identifying state-of-the-art solutions for certain phenotyping applications. Finally, we provide several directions for future research in the use of CNN architecture for plant phenotyping purposes.
Collapse
Affiliation(s)
- Yu Jiang
- Horticulture Section, School of Integrative Plant Science, Cornell AgriTech, Cornell University, USA
- School of Electrical and Computer Engineering, College of Engineering, The University of Georgia, USA
- Phenomics and Plant Robotics Center, The University of Georgia, USA
| | - Changying Li
- School of Electrical and Computer Engineering, College of Engineering, The University of Georgia, USA
- Phenomics and Plant Robotics Center, The University of Georgia, USA
| |
Collapse
|
43
|
Shen C, Liu L, Zhu L, Kang J, Wang N, Shao L. High-Throughput in situ Root Image Segmentation Based on the Improved DeepLabv3+ Method. FRONTIERS IN PLANT SCIENCE 2020; 11:576791. [PMID: 33193519 PMCID: PMC7604297 DOI: 10.3389/fpls.2020.576791] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/27/2020] [Accepted: 09/22/2020] [Indexed: 05/19/2023]
Abstract
The Rhizotrons method is an important means of detecting dynamic growth and development phenotypes of plant roots. However, the segmentation of root images is a critical obstacle restricting further development of this method. At present, researchers mostly use direct manual drawings or software-assisted manual drawings to segment root systems for analysis. Root systems can be segmented from root images obtained by the Rhizotrons method, and then, root system lengths and diameters can be obtained with software. This type of image segmentation method is extremely inefficient and very prone to human error. Here, we investigate the effectiveness of an automated image segmentation method based on the DeepLabv3+ convolutional neural network (CNN) architecture to streamline such measurements. We have improved the upsampling portion of the DeepLabv3+ network and validated it using in situ images of cotton roots obtained with a micro root window root system monitoring system. Segmentation performance of the proposed method utilizing WinRHIZO Tron MF analysis was assessed using these images. After 80 epochs of training, the final verification set F1-score, recall, and precision were 0.9773, 0.9847, and 0.9702, respectively. The Spearman rank correlation between the manually obtained Rhizotrons manual segmentation root length and automated root length was 0.9667 (p < 10-8), with r 2 = 0.9449. Based on the comparison of our segmentation results with those of traditional manual and U-net segmentation methods, this novel method can more accurately segment root systems in complex soil environments. Thus, using the improved DeepLabv3+ to segment root systems based on micro-root images is an effective method for accurately and quickly segmenting root systems in a homogeneous soil environment and has clear advantages over traditional manual segmentation.
Collapse
Affiliation(s)
- Chen Shen
- State Key Laboratory of North China Crop Improvement and Regulation, College of Mechanical and Electrical Engineering, Hebei Agricultural University, Baoding, China
| | - Liantao Liu
- State Key Laboratory of North China Crop Improvement and Regulation, Key Laboratory of Crop Growth Regulation of Hebei Province, College of Agronomy, Hebei Agricultural University, Baoding, China
| | - Lingxiao Zhu
- State Key Laboratory of North China Crop Improvement and Regulation, Key Laboratory of Crop Growth Regulation of Hebei Province, College of Agronomy, Hebei Agricultural University, Baoding, China
| | - Jia Kang
- State Key Laboratory of North China Crop Improvement and Regulation, College of Mechanical and Electrical Engineering, Hebei Agricultural University, Baoding, China
| | - Nan Wang
- State Key Laboratory of North China Crop Improvement and Regulation, College of Mechanical and Electrical Engineering, Hebei Agricultural University, Baoding, China
- *Correspondence: Nan Wang,
| | - Limin Shao
- State Key Laboratory of North China Crop Improvement and Regulation, College of Mechanical and Electrical Engineering, Hebei Agricultural University, Baoding, China
- Limin Shao,
| |
Collapse
|
44
|
Teramoto S, Uga Y. A Deep Learning-Based Phenotypic Analysis of Rice Root Distribution from Field Images. PLANT PHENOMICS (WASHINGTON, D.C.) 2020; 2020:3194308. [PMID: 33313548 PMCID: PMC7706345 DOI: 10.34133/2020/3194308] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/15/2020] [Accepted: 09/02/2020] [Indexed: 05/10/2023]
Abstract
Root distribution in the soil determines plants' nutrient and water uptake capacity. Therefore, root distribution is one of the most important factors in crop production. The trench profile method is used to observe the root distribution underground by making a rectangular hole close to the crop, providing informative images of the root distribution compared to other root phenotyping methods. However, much effort is required to segment the root area for quantification. In this study, we present a promising approach employing a convolutional neural network for root segmentation in trench profile images. We defined two parameters, Depth50 and Width50, representing the vertical and horizontal centroid of root distribution, respectively. Quantified parameters for root distribution in rice (Oryza sativa L.) predicted by the trained model were highly correlated with parameters calculated by manual tracing. These results indicated that this approach is useful for rapid quantification of the root distribution from the trench profile images. Using the trained model, we quantified the root distribution parameters among 60 rice accessions, revealing the phenotypic diversity of root distributions. We conclude that employing the trench profile method and a convolutional neural network is reliable for root phenotyping and it will furthermore facilitate the study of crop roots in the field.
Collapse
Affiliation(s)
- S. Teramoto
- Institute of Crop Science, National Agriculture and Food Research Organization, 2-1-2 Kannondai, Tsukuba, Ibaraki 305-8518, Japan
| | - Y. Uga
- Institute of Crop Science, National Agriculture and Food Research Organization, 2-1-2 Kannondai, Tsukuba, Ibaraki 305-8518, Japan
| |
Collapse
|
45
|
Guo X, Svane SF, Füchtbauer WS, Andersen JR, Jensen J, Thorup-Kristensen K. Genomic prediction of yield and root development in wheat under changing water availability. PLANT METHODS 2020; 16:90. [PMID: 32625241 PMCID: PMC7329460 DOI: 10.1186/s13007-020-00634-0] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 04/18/2020] [Accepted: 06/24/2020] [Indexed: 05/16/2023]
Abstract
BACKGROUND Deeper roots help plants take up available resources in deep soil ensuring better growth and higher yields under conditions of drought. A large-scale semi-field root phenotyping facility was developed to allow a water availability gradient and detect potential interaction of genotype by water availability gradient. Genotyped winter wheat lines were grown as rows in four beds of this facility, where indirect genetic effects from neighbors could be important to trait variation. The objective was to explore the possibility of genomic prediction for grain-related traits and deep root traits collected via images taken in a minirhizotron tube under each row of winter wheat measured. RESULTS The analysis comprised four grain-related traits: grain yield, thousand-kernel weight, protein concentration, and total nitrogen content measured on each half row that were harvested separately. Two root traits, total root length between 1.2 and 2 m depth and root length in four intervals on each tube were also analyzed. Two sets of models with or without the effects of neighbors from both sides of each row were applied. No interaction between genotypes and changing water availability were detected for any trait. Estimated genomic heritabilities ranged from 0.263 to 0.680 for grain-related traits and from 0.030 to 0.055 for root traits. The coefficients of genetic variation were similar for grain-related and root traits. The prediction accuracy of breeding values ranged from 0.440 to 0.598 for grain-related traits and from 0.264 to 0.334 for root traits. Including neighbor effects in the model generally increased the estimated genomic heritabilities and accuracy of predicted breeding values for grain yield and nitrogen content. CONCLUSIONS Similar relative amounts of additive genetic variance were found for both yield traits and root traits but no interaction between genotypes and water availability were detected. It is possible to obtain accurate genomic prediction of breeding values for grain-related traits and reasonably accurate predicted breeding values for deep root traits using records from the semi-field facility. Including neighbor effects increased the estimated additive genetic variance of grain-related traits and accuracy of predicting breeding values. High prediction accuracy can be obtained although heritability is low.
Collapse
Affiliation(s)
- Xiangyu Guo
- Center for Quantitative Genetics and Genomics, Aarhus University, 8830 Tjele, Denmark
| | - Simon F. Svane
- Department of Plant and Environmental Science, University of Copenhagen, 1871 Frederiksberg, Denmark
| | | | | | - Just Jensen
- Center for Quantitative Genetics and Genomics, Aarhus University, 8830 Tjele, Denmark
| | | |
Collapse
|