Title:
Visual Inspection of Precast Concrete Bridge Using UAS Technologies
Author(s):
Junwon Seo, Euiseok Jeong, and James P. Wacker
Publication:
Symposium Paper
Volume:
351
Issue:
Appears on pages(s):
83-96
Keywords:
bridge, inspection, image processing, image enhancement, machine learning, pretrained denoising neural network
DOI:
10.14359/51734676
Date:
4/1/2022
Abstract:
This paper proposes that Unmanned Aerial System (UAS) technologies integrated with image visibility enhancement algorithms and machine learning are an efficient yet supplementary concrete bridge inspection tool. Two different image enhancement algorithms, i.e., denoise algorithm and image property adjustment, were considered in this study. To assess the adequacy of the proposed UAS technologies in the bridge inspections, the technologies were applied to identify and quantify defects on an existing concrete double-tee bridge located in the state of South Dakota using a Matrice 210 unit. During the inspections, Matrice 210 recorded videos to extract numerous UAS inspection images throughout the bridge. Machine learning was applied to categorize each of the UAS inspection images into certain defect types such as rust and spalling. The denoise algorithm was used to reduce the noise on the categorized defect images based on the pretrained denoising neural network, while the image property adjustment algorithm was employed to improve the visibility of the images by filtering the images’ brightness, contrast, and sharpness. Through these algorithms, defects on the filtered images initially presented with low visibility, were detected. Furthermore, quantification of the defects was able to be completed using pixel-based image analysis with the filtered images. From the UAS-assisted inspections, concrete spalling and rust on railings of the bridge were observed, detected, and quantified successfully. The quantification of spalling showed only a 6.00% difference compared against the inspection report data provided by the South Dakota Department of Transportation (SDDOT).
Related References:
1. American Society of Civil Engineers (ASCE). (2017). Infrastructure Report CardWashington, D.C., American Society of Civil Engineers (ASCE)
2. Jeong, E.; Seo, J.; Wacker, J. P. (2020). Literature Review and Technical Survey on Bridge Inspection Using Unmanned Aerial Vehicles, Journal of Performance of Constructed Facilities, Vol. 34, No. 6, 04020113. doi: 10.1061/(ASCE)CF.1943-5509.0001519
3. Duque, L.; Seo, J.; Wacker, J. P. (2018). Timber Bridge Inspection Using UAV, Structures Congress 2018Presented at the Structures Congress 2018: Bridges, Transportation Structures, and Nonbuilding Structures, , Fort Worth, TX, 186–196. doi: 10.1061/9780784481332.017
4. Duque, L.; Seo, J.; Wacker, J. P. (2018). Bridge Deterioration Quantification Protocol Using UAV, Journal of Bridge Engineering, Vol. 23, No. 10, 04018080. doi: 10.1061/(ASCE)BE.1943-5592.0001289
5. Jeong, E.; Seo, J.; Wacker, J. P. (2020). New Bridge Inspection Approach with Joint UAV and DIC System, Structures Congress 2020Presented at the Structures Congress 2020, , St. Louis, MO, 349–359. doi: doi/abs/10.1061/9780784482896.033
6. Jeong, E.; Seo, J.; Wacker, J. P. (2021). Grayscale Drone Inspection Image Enhancement Framework for Advanced Bridge Defect Measurement, Transportation Research Board 100th Annual Meeting – Virtual Event
7. Kim, H.; Lee, J.; Ahn, E.; Cho, S.; Shin, M.; Sim, S.-H. (2017). Concrete Crack Identification Using a UAV Incorporating Hybrid Image Processing, Sensors, Vol. 17, No. 9, 2052. doi: 10.3390/s17092052
8. Lei, B.; Wang, N.; Xu, P.; Song, G. (2018). New Crack Detection Method for Bridge Inspection Using UAV Incorporating Image Processing, Journal of Aerospace Engineering, Vol. 31, No. 5, 04018058. doi: 10.1061/(ASCE)AS.1943-5525.0000879
9. Seo, J.; Duque, L.; Wacker, J. P. (2018). Drone-enabled bridge inspection methodology and application, Automation in Construction, Vol. 94, 112–126. doi: 10.1016/j.autcon.2018.06.006
10. Seo, J.; Wacker, J. P.; Duque, L. (2018). Evaluating the use of drones for timber bridge inspection (General Technical Report FPL-GTR- 258)Madison, WI, U.S. Department of Agriculture, Forest Service, Forest Products Laboratory
11. Seo, J.; Jeong, E.; Wacker, J. P. (2020). Drone-Aided Bridge Inspection Coupled with Image Quality Improvement Processing Technique, NDE/NDT Structural Materials Technology for Highways and Bridges 2020Presented at the NDE/NDT Structural Materials Technology for Highways and Bridges 2020, , Online Only, OH
12. Seo, J.; Jeong, E.; Wacker, J. P. (2021). Visual Bridge Damage Measurement Using Drone-Captured Image Quality Optimization, P. Rizzo; A. Milazzo (Eds.), European Workshop on Structural Health Monitoring, Springer International Publishing, Cham, 503–513
13. Sony, S.; Laventure, S.; Sadhu, A. (2019). A literature review of next-generation smart sensing technology in structural health monitoring, Structural Control and Health Monitoring, Vol. 26, No. 3, e2321. doi: 10.1002/stc.2321
14. Goessens, S.; Mueller, C.; Latteur, P. (2018). Feasibility study for drone-based masonry construction of realscale structures, Automation in Construction, Vol. 94, 458–480. doi: 10.1016/j.autcon.2018.06.015
15. Perry, B. J.; Guo, Y.; Atadero, R.; van de Lindt, J. W. (2020). Streamlined bridge inspection system utilizing unmanned aerial vehicles (UAVs) and machine learning, Measurement, Vol. 164, 108048. doi: 10.1016/j.measurement.2020.108048
16. Reagan, D. (2014). Unmanned Aerial Vehicle Measurement Using Three - Dimensional Digital Image Correlation to Perform Bridge Structural Health MonitoringUniversity of Massachuestts Lowell, Ann Arbor, MI
17. Reagan, D.; Sabato, A.; Niezrecki, C. (2017). Feasibility of using digital image correlation for unmanned aerial vehicle structural health monitoring of bridges, Structural Health Monitoring, Vol. 17, No. 5, 1056–1072. doi: 10.1177/1475921717735326
18. Reagan, D.; Sabato, A.; Niezrecki, C.; Reagan, D.; Sabato, A.; Niezrecki, C. (2017). Unmanned aerial vehicle acquisition of three-dimensional digital image correlation measurements for structural health monitoring of bridges, T.-Y. Yu (Ed.), Presented at the SPIE Smart Structures and Materials + Nondestructive Evaluation and Health Monitoring, , Portland, Oregon, United States, 1016909. doi: 10.1117/12.2259985
19. Bridge, J. A.; Ifju, P. G.; Whitley, T. J.; Tomiczek, A. P. (2018). Use of Small Unmanned Aerial Vehicles (sUAV) for Structural Inspection (BDV31-977–55)Florida Department of Transportation, Tallahassee, FL
20. Hallermann, N.; Morgenthal, G. (2014). Visual inspection strategies for large bridges using Unmanned Aerial Vehicles (UAV), In Proc. of 7th IABMASPresented at the International Conference on Bridge Maintenance, Safety and Management, , International Conference on Bridge Maintenance, Safety and Management, 661–667
21. Rakha, T.; Gorodetsky, A. (2018). Review of Unmanned Aerial System (UAS) applications in the built environment: Towards automated building inspection procedures using drones, Automation in Construction, Vol. 93, 252–264. doi: 10.1016/j.autcon.2018.05.002
22. Cheyne, D.; Merrill, B.; Boggs, J. (2019). Use of Small Unmanned Aerial Systems for Bridge Inspection (FHWA-HIF-19-056)Washington, DC, U.S. Department of Transportation Federal Highway Administration (FHWA)
23. Brill, F.; Erukhimov, V.; Giduthuri, R.; Ramm, S. (2020). Chapter 1 - Introduction, F. Brill; V. Erukhimov; R. Giduthuri; S. Ramm (Eds.), OpenVX Programming Guide, Academic Press, 1–13. doi: 10.1016/B978-0-12-816425-9.00007-3
24. Dong, W.; Wang, P.; Yin, W.; Shi, G.; Wu, F.; Lu, X. (2019). Denoising Prior Driven Deep Neural Network for Image Restoration, IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 41, No. 10, 2305–2318. doi: 10.1109/TPAMI.2018.2873610
25. Gai, S.; Bao, Z. (2019). New image denoising algorithm via improved deep convolutional neural network with perceptive loss, Expert Systems with Applications, Vol. 138, 112815. doi: 10.1016/j.eswa.2019.07.032
26. Gong, K.; Guan, J.; Liu, C.-C.; Qi, J. (2019). PET Image Denoising Using a Deep Neural Network Through Fine Tuning, IEEE Transactions on Radiation and Plasma Medical Sciences, Vol. 3, No. 2, 153–161. doi: 10.1109/TRPMS.2018.2877644
27. You, C.; Yang, Q.; Shan, H.; Gjesteby, L.; Li, G.; Ju, S.; Zhang, Z.; Zhao, Z.; Zhang, Y.; Cong, W.; Wang, G. (2018). Structurally-Sensitive Multi-Scale Deep Neural Network for Low-Dose CT Denoising, IEEE Access, Vol. 6, 41839–41855. doi: 10.1109/ACCESS.2018.2858196
28. Cha, Y.-J.; Choi, W.; Büyüköztürk, O. (2017). Deep Learning-Based Crack Damage Detection Using Convolutional Neural Networks, Computer-Aided Civil and Infrastructure Engineering, Vol. 32, No. 5, 361–378. doi: 10.1111/mice.12263
29. Chen, F.; Jahanshahi, M. R. (2018). NB-CNN: Deep Learning-Based Crack Detection Using Convolutional Neural Network and Naïve Bayes Data Fusion, IEEE Transactions on Industrial Electronics, Vol. 65, No. 5, 4392–4400. doi: 10.1109/TIE.2017.2764844
30. Makantasis, K.; Protopapadakis, E.; Doulamis, A.; Doulamis, N.; Loupos, C. (2015). Deep Convolutional Neural Networks for efficient vision based tunnel inspection, 2015 IEEE International Conference on Intelligent Computer Communication and Processing (ICCP)Presented at the 2015 IEEE International Conference on Intelligent Computer Communication and Processing (ICCP), , 335–342. doi: 10.1109/ICCP.2015.7312681
31. Park, S.; Bang, S.; Kim, H.; Kim, H. (2019). Patch-Based Crack Detection in Black Box Images Using Convolutional Neural Networks, Journal of Computing in Civil Engineering, Vol. 33, No. 3, 04019017. doi: 10.1061/(ASCE)CP.1943-5487.0000831
32. Xue, Y.; Li, Y. (2018). A Fast Detection Method via Region-Based Fully Convolutional Neural Networks for Shield Tunnel Lining Defects, Computer-Aided Civil and Infrastructure Engineering, Vol. 33, No. 8, 638–654. doi: 10.1111/mice.12367
33. Federal Highway Administration (FHWA). (1995). Recording and Coding Guide for the Structure Inventory and Appraisal of the Nation’s Bridges (FHWA-PD-96-001)Washington, DC, U.S. DOT FHWA
34. Federal Highway Administration (FHWA). (2012). Recording and Coding Guide for the Structure Inventory and Appraisal of the Nation’s Bridges (FHWA-PD-96-001)Washington, DC, U.S. DOT FHWA
35. Federal Highway Administration (FHWA). (2018). Recording and Coding Guide for the Structure Inventory and Appraisal of the Nation’s Bridges (FHWA-PD-96-001)Washington, DC, U.S. DOT FHWA
36. MATLAB & Simulink. (2021). ResNet-50 convolutional neural network - MATLAB resnet50, from https://www.mathworks.com/help/deeplearning/ref/resnet50.html;jsessionid=43a5026dc71f385e628fc595ade6, accessed 26-7-2021
37. Myer, S.; Prather, J. (2018). Bridge inspection report for structure number 42-165-153Clark engineering