1
|
Nie F, Liu M, Zhang P. Multilevel thresholding with divergence measure and improved particle swarm optimization algorithm for crack image segmentation. Sci Rep 2024; 14:7642. [PMID: 38561478 PMCID: PMC10984966 DOI: 10.1038/s41598-024-58456-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2023] [Accepted: 03/29/2024] [Indexed: 04/04/2024] Open
Abstract
Crack formation is a common phenomenon in engineering structures, which can cause serious damage to the safety and health of these structures. An important method of ensuring the safety and health of engineered structures is the prompt detection of cracks. Image threshold segmentation based on machine vision is a crucial technology for crack detection. Threshold segmentation can separate the crack area from the background, providing convenience for more accurate measurement and evaluation of the crack condition and location. The segmentation of cracks in complex scenes is a challenging task, and this goal can be achieved by means of multilevel thresholding. The arithmetic-geometric divergence combines the advantages of the arithmetic mean and the geometric mean in probability measures, enabling a more precise capture of the local features of an image in image processing. In this paper, a multilevel thresholding method for crack image segmentation based on the minimum arithmetic-geometric divergence is proposed. To address the issue of time complexity in multilevel thresholding, an enhanced particle swarm optimization algorithm with local stochastic perturbation is proposed. In crack detection, the thresholding criterion function based on the minimum arithmetic-geometric divergence can adaptively determine the thresholds according to the distribution characteristics of pixel values in the image. The proposed enhanced particle swarm optimization algorithm can increase the diversity of candidate solutions and enhance the global convergence performance of the algorithm. The proposed method for crack image segmentation is compared with seven state-of-the-art multilevel thresholding methods based on several metrics, including RMSE, PSNR, SSIM, FSIM, and computation time. The experimental results show that the proposed method outperforms several competing methods in terms of these metrics.
Collapse
Affiliation(s)
- Fangyan Nie
- Computer and Information Engineering College, Guizhou University of Commerce, Guiyang, 550014, China.
| | - Mengzhu Liu
- Computer and Information Engineering College, Guizhou University of Commerce, Guiyang, 550014, China
| | - Pingfeng Zhang
- College of Marxism, Guizhou University of Commerce, Guiyang, 550014, China
| |
Collapse
|
2
|
Ye G, Dai W, Tao J, Qu J, Zhu L, Jin Q. An improved transformer-based concrete crack classification method. Sci Rep 2024; 14:6226. [PMID: 38485707 PMCID: PMC10940720 DOI: 10.1038/s41598-024-54835-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2023] [Accepted: 02/16/2024] [Indexed: 03/18/2024] Open
Abstract
In concrete structures, surface cracks are an important indicator for assessing the durability and serviceability of the structure. Existing convolutional neural networks for concrete crack identification are inefficient and computationally costly. Therefore, a new Cross Swin transformer-skip (CSW-S) is proposed to classify concrete cracks. The method is optimized by adding residual links to the existing Cross Swin transformer network and then trained and tested using a dataset with 17,000 images. The experimental results show that the improved CSW-S network has an extended range of extracted image features, which improves the accuracy of crack recognition. A detection accuracy of 96.92% is obtained using the trained CSW-S without pretraining. The improved transformer model has higher recognition efficiency and accuracy than the traditional transformer model and the classical CNN model.
Collapse
Affiliation(s)
- Guanting Ye
- College of Hydraulic and Civil Engineering, Xinjiang Agricultural University, Urumqi, 830052, China
- College of International Education, Xinjiang Agricultural University, Urumqi, 830052, China
| | - Wei Dai
- College of International Education, Xinjiang Agricultural University, Urumqi, 830052, China
| | - Jintai Tao
- College of International Education, Xinjiang Agricultural University, Urumqi, 830052, China
| | - Jinsheng Qu
- College of International Education, Xinjiang Agricultural University, Urumqi, 830052, China
| | - Lin Zhu
- College of Hydraulic and Civil Engineering, Xinjiang Agricultural University, Urumqi, 830052, China
| | - Qiang Jin
- College of Hydraulic and Civil Engineering, Xinjiang Agricultural University, Urumqi, 830052, China.
| |
Collapse
|
3
|
Moreh F, Lyu H, Rizvi ZH, Wuttke F. Deep neural networks for crack detection inside structures. Sci Rep 2024; 14:4439. [PMID: 38396171 PMCID: PMC10891073 DOI: 10.1038/s41598-024-54494-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2023] [Accepted: 02/13/2024] [Indexed: 02/25/2024] Open
Abstract
Crack detection is a long-standing topic in structural health monitoring. Conventional damage detection techniques rely on intensive, time-consuming, resource-intensive intervention. The current trend of crack detection emphasizes using deep neural networks to build an automated pipeline from measured signals to damaged areas. This work focuses on the seismic-wave-based technique of crack detection for plate structures. Previous work proposed an encoder-decoder network to extract crack-related wave patterns from measured wave signals and predict crack existence on the plate. We extend previous work with extensive experiments on different network components and a data preprocessing strategy. The proposed methods are tested on an expanded crack detection dataset. We found that a robust backbone network, such as Densely Connected Convolutional Network (DenseNet) can effectively extract the features characterizing cracks of wave signals, and by using the reference wave field for normalization, the accuracy of detecting small cracks can be further improved.
Collapse
Affiliation(s)
- Fatahlla Moreh
- Geomechanics and Geotechnics, Kiel University, Kiel, 24118, Germany
| | - Hao Lyu
- Geomechanics and Geotechnics, Kiel University, Kiel, 24118, Germany.
- Competence Centre for Geo-Energy, Kiel University, Kiel, 24118, Germany.
| | - Zarghaam Haider Rizvi
- Geomechanics and Geotechnics, Kiel University, Kiel, 24118, Germany
- GeoAnalysis Engineering GmbH, Kiel, 24118, Germany
| | - Frank Wuttke
- Geomechanics and Geotechnics, Kiel University, Kiel, 24118, Germany
| |
Collapse
|
4
|
Midtbø SH, Måsøy SE, Aanes M. The higher order leaky Lamb wave sensitivity of a notch in a fluid-immersed plate. Ultrasonics 2023; 138:107215. [PMID: 38103353 DOI: 10.1016/j.ultras.2023.107215] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/18/2023] [Revised: 11/28/2023] [Accepted: 12/04/2023] [Indexed: 12/19/2023]
Abstract
We present an ultrasonic method of detecting cracks in pipelines based on using normally incident transducers in a pitch-catch setup, which can only excite Lamb modes of higher order than the fundamental modes A0 and S0 commonly used in crack detection applications. By excitation and measurements of the Lamb modes S1, S2, and A3, in a steel plate immersed in fluid with and without a notch (to emulate a crack), the performance of the modes towards crack detection is quantified by assessing whether it returns a high leaky component and whether the notch has a large impact on the leaky component. In order to narrow the scope of measurements necessary to investigate notch sensitivity for different system parameters, and to potentially optimize the system setup, we present a computationally efficient theoretical model based on angular spectrum method (ASM) and the theoretical sensitivity kernel formulation from the field of seismology that accounts for a scatterer in the wave path between the transmitter and receiver. The model is compared against measurements, which show that the frequency components of the S2 mode has both the largest leaky frequency component in the given setup and the largest sensitivity at a frequency close to the maximum leaky frequency such that a difference caused by the notch is easily measured. By using the measurements and the validation calculation as baseline reference, we calculate the expected S2 mode sensitivity and leaky components for larger plate thicknesses and larger standoffs, which exemplifies how the model can be applied in measurement system design and optimization.
Collapse
Affiliation(s)
| | | | - Magne Aanes
- NDT Global, Glasskaret 1, Bergen, 5106, Norway
| |
Collapse
|
5
|
Zaki YA, Abouhussien AA, A A Hassan A, Ismail MK, AbdelAleem BH. Crack detection and classification of repaired concrete beams by acoustic emission monitoring. Ultrasonics 2023; 134:107068. [PMID: 37348360 DOI: 10.1016/j.ultras.2023.107068] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Revised: 03/24/2023] [Accepted: 06/04/2023] [Indexed: 06/24/2023]
Abstract
In this study, acoustic emission (AE) monitoring was used to investigate the cracking behavior of normal concrete beams repaired with fiber-reinforced cementitious composites (FRCC). The investigated beams were strengthened at two locations: tension side and compression side of the beam. Two different fibers were used in FRCC strengthening material: steel fibers and polyvinyl alcohol fibers. One normal concrete beam and two fully cast FRCC beams were also tested for comparison. All beams were tested under four-point loading until failure. The investigation considered the variations in several AE parameters such as number of hits, cumulative signal strength, signal amplitude, peak frequency, absolute energy, and b-value analysis. In addition, rise time/amplitude analysis was successfully utilized in this study to classify the failure modes (flexural or shear/debonding failure between the repair layer and existing beam) for all beams. The impact of the fiber type, strengthening location, and sensor location on the aforementioned parameters was clearly highlighted. Varying the fiber type of the FRCC or changing the repair location of the beam seemed to have a significant impact on the resulting AE parameters. A good correlation was found in repaired and unrepaired beams between AE parameters and the progression of cracks beyond the first crack until failure. The results also indicated that the AE analysis carried out in this study led to the identification of the first crack in repaired and unrepaired beams.
Collapse
Affiliation(s)
- Yara A Zaki
- Department of Civil Engineering, Faculty of Engineering and Applied Science, Memorial University of Newfoundland, St. John's, Newfoundland and Labrador, A1B 3X5, Canada
| | - Ahmed A Abouhussien
- GEH SMR Technologies Canada, Ltd., GE Hitachi Nuclear Energy, Markham, Ontario L6C 0MI, Canada.
| | - Assem A A Hassan
- Department of Civil Engineering, Faculty of Engineering and Applied Science, Memorial University of Newfoundland, St. John's, Newfoundland and Labrador, A1B 3X5, Canada
| | - Mohamed K Ismail
- Department of Structural Engineering, Faculty of Engineering, Cairo University, Giza, Egypt
| | - Basem H AbdelAleem
- Department of Civil Engineering, Faculty of Engineering and Applied Science, Memorial University of Newfoundland, St. John's, Newfoundland and Labrador, A1B 3X5, Canada; Department of Structural Engineering, Faculty of Engineering, Cairo University, Giza, Egypt
| |
Collapse
|
6
|
Wan C, Xiong X, Wen B, Gao S, Fang D, Yang C, Xue S. Crack detection for concrete bridges with imaged based deep learning. Sci Prog 2022; 105:368504221128487. [PMID: 36177737 PMCID: PMC10450596 DOI: 10.1177/00368504221128487] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Within the framework of intelligent bridge detection, a number of crack detection methods based on image processing techniques have been implemented. In this study, a combined novel approach with deep learning of a single shot multibox detector (SSD) and the eight neighborhood algorithm is proposed and applied to bridge crack image identification to provide an automatic method for crack detection. First, a large number of concrete crack images collected from the site were segmented and preprocessed for the establishment of a crack image dataset. Deep learning of the SSD algorithm was introduced on the training set to establish the detection model, where the model parameters were adjusted by the validation set. Sliding window technology was integrated to identify the cracks in the test set. The effects of the sliding window size and dataset size on the crack detection results were discussed. Moreover, the eight neighborhood algorithm was adopted for further crack detection correction. The results show that the configuration achieves good crack detection by the deep learning of the SSD algorithm with high precision and recall. The introduction of the eight neighborhood correction algorithm further improves the detection results by eliminating some misjudged results. Finally, the developed algorithm was placed into a portable device, with which cracks were effectively identified. The introduced method shows significantly better performance in crack detection, and the system installed on the portable device provides a way to broaden its application in the automatic crack detection of concrete bridges.
Collapse
Affiliation(s)
- Chunfeng Wan
- Southeast University, Key Laboratory of concrete and prestressed concrete structure of Ministry of Education, Nanjing 210096, P. R. China
| | - Xiaobing Xiong
- Southeast University, Key Laboratory of concrete and prestressed concrete structure of Ministry of Education, Nanjing 210096, P. R. China
| | - Bo Wen
- School of Engineering Audit, Nanjing Audit University, Nanjing 211815, China
| | - Shuai Gao
- Southeast University, Key Laboratory of concrete and prestressed concrete structure of Ministry of Education, Nanjing 210096, P. R. China
| | - Da Fang
- Southeast University, Key Laboratory of concrete and prestressed concrete structure of Ministry of Education, Nanjing 210096, P. R. China
| | - Caiqian Yang
- Southeast University, Key Laboratory of concrete and prestressed concrete structure of Ministry of Education, Nanjing 210096, P. R. China
| | - Songtao Xue
- Department of Disaster Mitigation for Structures, Tongji University, Shanghai 200092, P. R. China
- Department of Architecture, Tohoku Institute of Technology, Sendai, Japan
| |
Collapse
|
7
|
Agathos K, Chatzi E, Bordas SPA. Multiple crack detection in 3D using a stable XFEM and global optimization. Comput Mech 2018; 62:835-852. [PMID: 30220758 PMCID: PMC6132880 DOI: 10.1007/s00466-017-1532-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/24/2017] [Accepted: 12/18/2017] [Indexed: 06/08/2023]
Abstract
A numerical scheme is proposed for the detection of multiple cracks in three dimensional (3D) structures. The scheme is based on a variant of the extended finite element method (XFEM) and a hybrid optimizer solution. The proposed XFEM variant is particularly well-suited for the simulation of 3D fracture problems, and as such serves as an efficient solution to the so-called forward problem. A set of heuristic optimization algorithms are recombined into a multiscale optimization scheme. The introduced approach proves effective in tackling the complex inverse problem involved, where identification of multiple flaws is sought on the basis of sparse measurements collected near the structural boundary. The potential of the scheme is demonstrated through a set of numerical case studies of varying complexity.
Collapse
Affiliation(s)
- Konstantinos Agathos
- Research Unit in Engineering Science, Luxembourg University, 6 rue Richard Coudenhove-Kalergi, 1359 Luxembourg, Luxembourg
| | - Eleni Chatzi
- Institute of Structural Engineering, ETH Zürich, Stefano-Franscini-Platz 5, 8093 Zurich, Switzerland
| | - Stéphane P. A. Bordas
- Institute of Theoretical, Applied and Computational Mechanics, Cardiff University, Cardiff, CF24 3AA UK
- Research Unit in Engineering Science, Luxembourg University, 6 rue Richard Coudenhove-Kalergi, 1359 Luxembourg, Luxembourg
| |
Collapse
|
8
|
Bao Y, Hoehler MS, Smith CM, Bundy M, Chen G. Temperature Measurement and Damage Detection in Concrete Beams Exposed to Fire Using PPP-BOTDA Based Fiber Optic Sensors. Smart Mater Struct 2017; 26:105034. [PMID: 29230083 PMCID: PMC5721354 DOI: 10.1088/1361-665x/aa89a9] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
In this study, distributed fiber optic sensors based on pulse pre-pump Brillouin optical time domain analysis (PPP-BODTA) are characterized and deployed to measure spatially-distributed temperatures in reinforced concrete specimens exposed to fire. Four beams were tested to failure in a natural gas fueled compartment fire, each instrumented with one fused silica, single-mode optical fiber as a distributed sensor and four thermocouples. Prior to concrete cracking, the distributed temperature was validated at locations of the thermocouples by a relative difference of less than 9 %. The cracks in concrete can be identified as sharp peaks in the temperature distribution since the cracks are locally filled with hot air. Concrete cracking did not affect the sensitivity of the distributed sensor but concrete spalling broke the optical fiber loop required for PPP-BOTDA measurements.
Collapse
Affiliation(s)
- Yi Bao
- Department of Civil, Architectural, and Environmental Engineering, Missouri University of Science and Technology, 1401 N. Pine Street, Rolla, MO 65409
| | - Matthew S. Hoehler
- National Fire Research Laboratory, National Institute of Standards and Technology, 100 Bureau Drive, Gaithersburg, MD 20899
| | - Christopher M. Smith
- National Fire Research Laboratory, National Institute of Standards and Technology, 100 Bureau Drive, Gaithersburg, MD 20899
| | - Matthew Bundy
- National Fire Research Laboratory, National Institute of Standards and Technology, 100 Bureau Drive, Gaithersburg, MD 20899
| | - Genda Chen
- Department of Civil, Architectural, and Environmental Engineering, Missouri University of Science and Technology, 1401 N. Pine Street, Rolla, MO 65409
| |
Collapse
|
9
|
Yu L, Tian Z, Leckey CAC. Crack imaging and quantification in aluminum plates with guided wave wavenumber analysis methods. Ultrasonics 2015; 62:203-212. [PMID: 26049731 DOI: 10.1016/j.ultras.2015.05.019] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 11/26/2014] [Revised: 04/12/2015] [Accepted: 05/21/2015] [Indexed: 06/04/2023]
Abstract
Guided wavefield analysis methods for detection and quantification of crack damage in an aluminum plate are presented in this paper. New wavenumber components created by abrupt wave changes at the structural discontinuity are identified in the frequency-wavenumber spectra. It is shown that the new wavenumbers can be used to detect and characterize the crack dimensions. Two imaging based approaches, filter reconstructed imaging and spatial wavenumber imaging, are used to demonstrate how the cracks can be evaluated with wavenumber analysis. The filter reconstructed imaging is shown to be a rapid method to map the plate and any existing damage, but with less precision in estimating crack dimensions; while the spatial wavenumber imaging provides an intensity image of spatial wavenumber values with enhanced resolution of crack dimensions. These techniques are applied to simulated wavefield data, and the simulation based studies show that spatial wavenumber imaging method is able to distinguish cracks of different severities. Laboratory experimental validation is performed for a single crack case to confirm the methods' capabilities for imaging cracks in plates.
Collapse
Affiliation(s)
- Lingyu Yu
- University of South Carolina, Department of Mechanical Engineering, Columbia, SC, United States
| | - Zhenhua Tian
- University of South Carolina, Department of Mechanical Engineering, Columbia, SC, United States.
| | - Cara A C Leckey
- Nondestructive Evaluation Sciences Branch, NASA Langley Research Center, Hampton, VA, United States
| |
Collapse
|