1
|
Shi Y, Ma Y, Geng L. Apple Detection via Near-Field MIMO-SAR Imaging: A Multi-Scale and Context-Aware Approach. SENSORS (BASEL, SWITZERLAND) 2025; 25:1536. [PMID: 40096394 PMCID: PMC11902657 DOI: 10.3390/s25051536] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 12/24/2024] [Revised: 02/11/2025] [Accepted: 02/20/2025] [Indexed: 03/19/2025]
Abstract
Accurate fruit detection is of great importance for yield assessment, timely harvesting, and orchard management strategy optimization in precision agriculture. Traditional optical imaging methods are limited by lighting and meteorological conditions, making it difficult to obtain stable, high-quality data. Therefore, this study utilizes near-field millimeter-wave MIMO-SAR (Multiple Input Multiple Output Synthetic Aperture Radar) technology, which is capable of all-day and all-weather imaging, to perform high-precision detection of apple targets in orchards. This paper first constructs a near-field millimeter-wave MIMO-SAR imaging system and performs multi-angle imaging on real fruit tree samples, obtaining about 150 sets of SAR-optical paired data, covering approximately 2000 accurately annotated apple targets. Addressing challenges such as weak scattering, low texture contrast, and complex backgrounds in SAR images, we propose an innovative detection framework integrating Dynamic Spatial Pyramid Pooling (DSPP), Recursive Feature Fusion Network (RFN), and Context-Aware Feature Enhancement (CAFE) modules. DSPP employs a learnable adaptive mechanism to dynamically adjust multi-scale feature representations, enhancing sensitivity to apple targets of varying sizes and distributions; RFN uses a multi-round iterative feature fusion strategy to gradually refine semantic consistency and stability, improving the robustness of feature representation under weak texture and high noise scenarios; and the CAFE module, based on attention mechanisms, explicitly models global and local associations, fully utilizing the scene context in texture-poor SAR conditions to enhance the discriminability of apple targets. Experimental results show that the proposed method achieves significant improvements in average precision (AP), recall rate, and F1 score on the constructed near-field millimeter-wave SAR apple dataset compared to various classic and mainstream detectors. Ablation studies confirm the synergistic effect of DSPP, RFN, and CAFE. Qualitative analysis demonstrates that the detection framework proposed in this paper can still stably locate apple targets even under conditions of leaf occlusion, complex backgrounds, and weak scattering. This research provides a beneficial reference and technical basis for using SAR data in fruit detection and yield estimation in precision agriculture.
Collapse
Affiliation(s)
- Yuanping Shi
- Department of UAV Engineering, Shijiazhuang Campus, Army Engineering University, Shijiazhuang 050003, China;
- College of Mechanical and Electrical Engineering, Shijiazhuang University, Shijiazhuang 050035, China;
- Shijiazhuang Key Laboratory of Agricultural Robotics Intelligent Perception, Shijiazhuang 050035, China
| | - Yanheng Ma
- Department of UAV Engineering, Shijiazhuang Campus, Army Engineering University, Shijiazhuang 050003, China;
| | - Liang Geng
- College of Mechanical and Electrical Engineering, Shijiazhuang University, Shijiazhuang 050035, China;
- Shijiazhuang Key Laboratory of Agricultural Robotics Intelligent Perception, Shijiazhuang 050035, China
| |
Collapse
|
2
|
Xi R, Gu Y, Zhang X, Ren Z. Nitrogen monitoring and inversion algorithms of fruit trees based on spectral remote sensing: a deep review. FRONTIERS IN PLANT SCIENCE 2024; 15:1489151. [PMID: 39687315 PMCID: PMC11648862 DOI: 10.3389/fpls.2024.1489151] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/31/2024] [Accepted: 10/29/2024] [Indexed: 12/18/2024]
Abstract
Nitrogen, as one of the important elements affecting the growth and development of fruit trees, leads to slowed protein synthesis and reduced photosynthesis, resulting in yellowing of the leaves, poor tree growth, and decreased yield under nitrogen-deficient conditions. In order to minimize losses and maximize fruit yield, there is often an occurrence of excessive fertilization, soil structure degradation, and water pollution. Therefore, accurate and real-time monitoring of nitrogen content in fruit trees has become the fundamental prerequisite for precision management of orchards. Furthermore, precision orchard management is crucial for enhancing fruit quality by maintaining the optimal growth conditions necessary for trees. Moreover, it plays a vital role in safeguarding the ecological environment by mitigating the overuse of fertilizers and pesticides. With the continuous development and application of spectral remote sensing technology in agricultural monitoring and land management, this technology can provide an effective method for monitoring nitrogen content. Based on a review of relevant literature, this paper summarizes a research framework for monitoring and inversion of nitrogen content in fruit trees, which provides help for further research. Firstly, based on different remote sensing platforms, the application was discussed, on spectral remote sensing technology in the acquisition of nitrogen content in fruit trees. Secondly, the index parameters that can reflect the nitrogen content of fruit trees are summarized, which provides practical guidance for remote sensing monitoring. Additionally, the regression algorithms and application situations based on spectral data for nitrogen content were introduced. In conclusion, in response to the current issues and technological limitations, future research should focus on studying the nitrogen content characteristics of fruit trees during different phenological periods, integrating multi-type data information, and thereby improving the universality of the nitrogen content inversion model for fruit trees.
Collapse
Affiliation(s)
- Ruiqian Xi
- College of Mechanical and Electrical Engineering, Hebei Agricultural University, Baoding, China
| | - Yanxia Gu
- College of Science, Hebei Agricultural University, Baoding, China
| | - Xiaoqian Zhang
- College of Mechanical and Electrical Engineering, Hebei Agricultural University, Baoding, China
| | - Zhenhui Ren
- College of Mechanical and Electrical Engineering, Hebei Agricultural University, Baoding, China
| |
Collapse
|
3
|
Pii Y, Orzes G, Mazzetto F, Sambo P, Cesco S. Advances in viticulture via smart phenotyping: current progress and future directions in tackling soil copper accumulation. FRONTIERS IN PLANT SCIENCE 2024; 15:1459670. [PMID: 39559771 PMCID: PMC11570286 DOI: 10.3389/fpls.2024.1459670] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 07/04/2024] [Accepted: 10/14/2024] [Indexed: 11/20/2024]
Abstract
Modern viticulture faces significant challenges including climate change and increasing crop diseases, necessitating sustainable solutions to reduce fungicide use and mitigate soil health risks, particularly from copper accumulation. Advances in plant phenomics are essential for evaluating and tracking phenotypic traits under environmental stress, aiding in selecting resilient vine varieties. However, current methods are limited, hindering effective integration with genomic data for breeding purposes. Remote sensing technologies provide efficient, non-destructive methods for measuring biophysical and biochemical traits of plants, offering detailed insights into their physiological and nutritional state, surpassing traditional methods. Smart phenotyping is essential for selecting crop varieties with desired traits, such as pathogen-resilient vine varieties, tolerant to altered soil fertility including copper toxicity. Identifying plants with typical copper toxicity symptoms under high soil copper levels is straightforward, but it becomes complex with supra-optimal, already toxic, copper levels common in vineyard soils. This can induce multiple stress responses and interferes with nutrient acquisition, leading to ambiguous visual symptoms. Characterizing resilience to copper toxicity in vine plants via smart phenotyping is feasible by relating smart data with physiological assessments, supported by trained professionals who can identify primary stressors. However, complexities increase with more data sources and uncertainties in symptom interpretations. This suggests that artificial intelligence could be valuable in enhancing decision support in viticulture. While smart technologies, powered by artificial intelligence, provide significant benefits in evaluating traits and response times, the uncertainties in interpreting complex symptoms (e.g., copper toxicity) still highlight the need for human oversight in making final decisions.
Collapse
Affiliation(s)
- Youry Pii
- Faculty of Agricultural, Environmental and Food Sciences, Free University of Bolzano, Bolzano, Italy
| | - Guido Orzes
- Faculty of Engineering, Free University of Bolzano, Bolzano, Italy
- Competence Center for Plant Health, Free University of Bolzano, Bolzano, Italy
| | - Fabrizio Mazzetto
- Faculty of Agricultural, Environmental and Food Sciences, Free University of Bolzano, Bolzano, Italy
- Competence Center for Plant Health, Free University of Bolzano, Bolzano, Italy
| | - Paolo Sambo
- Department of Agronomy, Food, Natural Resources, Animals and Environment (DAFNAE), University of Padova, Legnaro, Italy
| | - Stefano Cesco
- Faculty of Agricultural, Environmental and Food Sciences, Free University of Bolzano, Bolzano, Italy
| |
Collapse
|
4
|
Giannetti D, Patelli N, Palazzetti L, Betti Sorbelli F, Pinotti CM, Maistrello L. First use of unmanned aerial vehicles to monitor Halyomorpha halys and recognize it using artificial intelligence. PEST MANAGEMENT SCIENCE 2024; 80:4074-4084. [PMID: 38563560 DOI: 10.1002/ps.8115] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/23/2024] [Revised: 03/15/2024] [Accepted: 03/31/2024] [Indexed: 04/04/2024]
Abstract
BACKGROUND Halyomorpha halys is one of the most damaging invasive agricultural pests in North America and southern Europe. It is commonly monitored using pheromone traps, which are not very effective because few bugs are caught and some escape and/or remain outside the trap on surrounding plants where they feed, increasing the damage. Other monitoring techniques are based on visual sampling, sweep-netting and tree-beating. However, all these methods require several hours of human labor and are difficult to apply to large areas. The aim of this work is to develop an automated monitoring system that integrates image acquisition through the use of drones with H. halys detection through the use of artificial intelligence (AI). RESULTS The study results allowed the development of an automated flight protocol using a mobile app to capture high-resolution images. The drone caused only low levels of disturbance in both adult and intermediate instars, inducing freezing behavior in adults. Each of the AI models used achieved very good performance, with a detection accuracy of up to 97% and recall of up to 87% for the X-TL model. CONCLUSION The first application of this novel monitoring system demonstrated the potential of drones and AI to detect and quantify the presence of H. halys. The ability to capture high-altitude, high-resolution images makes this method potentially suitable for use with a range of crops and pests. © 2024 Society of Chemical Industry.
Collapse
Affiliation(s)
- Daniele Giannetti
- Department of Life Sciences, University of Modena and Reggio Emilia, Reggio Emilia, Italy
- Department of Chemistry, Life Sciences and Environmental Sustainability, University of Parma, Parma, Italy
| | - Niccolò Patelli
- Department of Life Sciences, University of Modena and Reggio Emilia, Reggio Emilia, Italy
| | - Lorenzo Palazzetti
- Department of Computer Science and Mathematics, University of Perugia, Perugia, Italy
| | | | - Cristina M Pinotti
- Department of Computer Science and Mathematics, University of Perugia, Perugia, Italy
| | - Lara Maistrello
- Department of Life Sciences, University of Modena and Reggio Emilia, Reggio Emilia, Italy
- NBFC, National Biodiversity Future Center, Palermo, Italy
| |
Collapse
|