改进YOLOv5的复杂场景下水泥路面病害检测

张在岩, 宋伟东, 邬嘉晨

PDF(2178 KB)
PDF(2178 KB)
辽宁工程技术大学学报(自然科学版) ›› 2025, Vol. 44 ›› Issue (01) : 102-112. DOI: 10.11956/j.issn.1008-0562.20240026
图像识别与处理

改进YOLOv5的复杂场景下水泥路面病害检测

作者信息 +

Disease detection of cement pavement based on improved YOLOv5 in complex scenarios

Author information +
History +

摘要

针对国内水泥路面病害检测数据集缺乏、规模小、场景单一,以及深度学习算法在复杂场景下泛化能力不足的问题,提出一种基于改进YOLOv5的路面病害检测算法。收集并构建包含11 862张图像的水泥路面病害检测数据集,覆盖9类场景下的3类最常见病害类型;通过融合以IoU度量的 K-Means 聚类算法和遗传算法获取模型训练的先验锚框;在特征增强阶段,引入轻量级上采样模块(CARAFE),减少特征重组过程中的信息损失;引入顾及通道、高度和宽度维度的多维协同注意力模块(MCA),增强多尺度病害特征的辨别力。实验结果表明:所提算法在保持较快推理速度的前提下,F 1分数和平均精确率(mAP)分别达到75.5%和81.6%,优于5种主流的目标检测算法。实例分析表明:基于改进YOLOv5的路面病害检测算法能够满足大规模水泥路面病害智能检测与破损状况评价的实际需求。

Abstract

Aiming at the problems of lack of domestic cement pavement disease detection data sets, small scale, single scene, and insufficient generalization ability of deep learning algorithms in complex scenes, a pavement disease detection algorithm based on improved YOLOv5 is proposed. A cement pavement disease detection dataset containing 11 862 images was collected and constructed, covering 3 most common disease types in 9 scenarios. The prior anchor frame of model training is obtained by combining the K-Means clustering algorithm measured by IoU and genetic algorithm. In the feature enhancement stage, a lightweight upsampling module (CARAFE) is introduced to reduce the information loss in the feature recombination process. A multi-dimensional collaborative attention module (MCA) considering channel, height and width dimensions is introduced to enhance the discrimination of multi-scale disease features. The experimental results show that under the premise of maintaining fast inference speed, the average of F 1 score and average precision (mAP) of the proposed algorithm reach 75.5% and 81.6%, respectively, which are better than the five mainstream target detection algorithms. The example analysis shows that the pavement disease detection algorithm based on improved YOLOv5 can meet the actual needs of large-scale cement pavement disease intelligent detection and damage condition evaluation.

关键词

水泥路面 / 深度学习 / ISTD-PDD3数据集 / 病害检测 / ISTD-YOLO模型

Key words

cement pavement / deep learning / ISTD-PDD3 data set / disease detection / ISTD-YOLO model

中图分类号

P258

引用本文

导出引用
张在岩 , 宋伟东 , 邬嘉晨. 改进YOLOv5的复杂场景下水泥路面病害检测. 辽宁工程技术大学学报(自然科学版). 2025, 44(01): 102-112 https://doi.org/10.11956/j.issn.1008-0562.20240026
ZHANG Zaiyan, SONG Weidong, WU Jiachen. Disease detection of cement pavement based on improved YOLOv5 in complex scenarios[J]. Journal of Liaoning Technical University (Natural Science). 2025, 44(01): 102-112 https://doi.org/10.11956/j.issn.1008-0562.20240026

参考文献

1
HAO X L, SHA A M, SUN Z Y,et al.Laser-based measuring method for mean joint faulting value of concrete pavement[J].Optik,2016,127(1):274-278.
2
晏班夫,徐观亚,栾健,等.基于Faster R-CNN与形态法的路面病害识别[J].中国公路学报,2021,34(9):181-193.
YAN Banfu, XU Guanya, LUAN Jian,et al.Pavement distress detection based on faster R-CNN and morphological operations[J].China Journal of Highway and Transport,2021,34(9):181-193.
3
CHENG H D, SHI X J, GLAZIER C.Real-time image thresholding based on sample space reduction and interpolation approach[J].Journal of Computing in Civil Engineering,2003,17(4):264-272.
4
AYENU-PRAH A, ATTOH-OKINE N.Evaluating pavement cracks with bidimensional empirical mode decomposition[J].EURASIP Journal on Advances in Signal Processing,2008,2008(1):861701.
5
HE Y Q, QIU H X, WANG J,et al.Studying of road crack image detection method based on the mathematical morphology[C]//2011 4th International Congress on Image and Signal Processing. October 15-17,2011,Shanghai,China.IEEE,2011:967-969.
6
AMHAZ R, CHAMBON S, IDIER J,et al.Automatic crack detection on two-dimensional pavement images:an algorithm based on minimal path selection[J].IEEE Transactions on Intelligent Transportation Systems,2016,17(10):2718-2729.
7
ZHANG D J, LI Q Q, CHEN Y,et al.An efficient and reliable coarse-to-fine approach for asphalt pavement crack detection[J].Image and Vision Computing,2017,57:130-146.
8
LI N N, HOU X D, YANG X Y,et al.Automation recognition of pavement surface distress based on support vector machine[C]//2009 Second International Conference on Intelligent Networks and Intelligent Systems.November 1-3,2009,Tianjian,China.IEEE,2009:346-349.
9
HOANG N D.An artificial intelligence method for asphalt pavement pothole detection using least squares support vector machine and neural network with steerable filter-based feature extraction[J].Advances in Civil Engineering,2018(1):7419058.
10
李章维,胡安顺,王晓飞.基于视觉的目标检测方法综述[J].计算机工程与应用,2020,56(8):1-9.
LI Zhangwei, HU Anshun, WANG Xiaofei.Survey of vision-based object detection methods[J].Computer Engineering and Applications,2020,56(8):1-9.
11
DU Z Y, YUAN J, XIAO F P,et al.Application of image technology on pavement distress detection:a review[J].Measurement,2021,184:109900.
12
RAJESHWARI P, ABHISHEK P, VINOD P S,et al.Object detection:an overview[J].International Journal of Trend in Scientific Research and Development,2019,3(3):1663-1665.
13
LIU Y C, LIU F, LIU W,et al.Pavement distress detection using street view images captured via action camera[J].IEEE Transactions on Intelligent Transportation Systems,2024,25(1):738-747.
14
LI J Q, ZHAO X F, LI H W.Method for detecting road pavement damage based on deep learning[C]//Health Monitoring of Structural and Biological Systems XIII. April 4-7,2019,Denver,Colorado,United States. Bellingham.Washingtion:SPIE,2019:517-526.
15
罗晖,贾晨,李健.基于改进YOLOv4的公路路面病害检测算法[J].激光与光电子学进展,2021,58(14):336-344.
LUO Hui, JIA Chen, LI Jian.Road surface disease detection algorithm based on improved YOLOv4[J].Laser & Optoelectronics Progress,2021,58(14):336-344.
16
MANDAL V, MUSSAH A R, ADU-GYAMFI Y.Deep learning frameworks for pavement distress classification: a comparative analysis[C]//2020 IEEE International Conference on Big Data.December 10-13,2020.Atlanta,GA,USA.IEEE,2020:5577-5583.
17
GAO M X, WANG X, ZHU S L,et al.Detection and segmentation of cement concrete pavement pothole based on image processing technology[J]. Mathematical Problems in Engineering,2020,2020:1360832.
18
SADATI S, CHAGAS BRITO DA SILVA L E, WUNSCH D C I I,et al.Artificial intelligence to investigate modulus of elasticity of recycled aggregate concrete[J].ACI Materials Journal,2019,116(1):51-62.
19
惠冰,郭牧,王洲,等.基于三维激光技术的路面坑槽多维度指标检测[J].同济大学学报(自然科学版),2018,46(1):60-66.
HUI Bing, GUO Mu, WANG Zhou,et al.Multi-dimensional index detection of potholes based on 3D laser technology[J].Journal of Tongji University(Natural Science),2018,46(1):60-66.
20
郭小英,李文书,钱宇华,等.可计算图像复杂度评价方法综述[J].电子学报,2020,48(4):819-826.
GUO Xiaoying, LI Wenshu, QIAN Yuhua,et al.Computational evaluation methods of visual complexity perception for images[J].Acta Electronica Sinica,2020,48(4):819-826.
21
SU B Y, ZHANG H, WU Z H,et al.FSRDD:an efficient few-shot detector for rare city road damage detection[J].IEEE Transactions on Intelligent Transportation Systems,2022,23(2):24379-24388.
22
MAJIDIFARD H, JIN P, ADU-GYAMFI Y,et al.Pavement image datasets:a new benchmark dataset to classify and densify pavement distresses[J].Transportation Research Record: Journal of the Transportation Research Board,2020,2674(2): 328-339.
23
REDMON J, FARHADI A.YOLO9000:better, faster, stronger[C]//2017 IEEE Conference on Computer Vision and Pattern Recognition.July 21-26,2017,Honolulu,HI,USA.IEEE,2017:6517-6525.
24
WANG J Q, CHEN K, XU R,et al.CARAFE:content-aware ReAssembly of FEatures[C]//2019 IEEE/CVF International Conference on Computer Vision.October 27- November 2,2019,Seoul,Korea.IEEE,2019:3007-3016.
25
CAO Y, XU J R, LIN S,et al.GCNet:non-local networks meet squeeze-excitation networks and beyond[C]//2019 IEEE/CVF International Conference on Computer Vision Workshop. October 27-28, 2019, Seoul, Korea. IEEE, 2019: 1971-1980.
26
YAO H, LIU Y H, LI X,et al.A detection method for pavement cracks combining object detection and attention mechanism[J].IEEE Transactions on Intelligent Transportation Systems,2022,23(11): 22179-22189.
27
YU Y, ZHANG Y, CHENG Z Y,et al.MCA: multidimensional collaborative attention in deep convolutional neural networks for image recognition[J]. Engineering Applications of Artificial Intelligence,2020, 126: 107079.
28
REN S Q, HE K M, GIRSHICK R,et al.Faster R-CNN: towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2017, 39(6): 1137-1149.
29
LIU W, ANGUELOV D, ERHAN D,et al.SSD:single shot MultiBox detector[C]//2016 European Conference on Computer Vision, October 8-16,2016,Amsterdam,Netherlands.Berlin:Springer International Publishing,2016:21-37.
30
DUAN K W, BAI S, XIE L X,et al.CenterNet:keypoint triplets for object detection[C]//2019 IEEE/CVF International Conference on Computer Vision. October 27-November 2,2019,Seoul,Korea. IEEE,2019:6568-6577.
31
WANG C Y, BOCHKOVSKIY A, LIAO H M.YOLOv7:trainable bag-of-freebies sets new state-of-the-art for real-time object detectors[C]//2023 IEEE/CVF Conference on Computer Vision and Pattern Recognition. June 17-24,2023,Vancouver,BC,Canada.IEEE,2023:7464-7475.
32
徐鹏,祝轩,姚丁,等.沥青路面养护智能检测与决策综述[J].中南大学学报(自然科学版),2021,52(7):2099-2117.
XU Peng, ZHU Xuan, YAO Ding,et al.Review on intelligent detection and decision-making of asphalt pavement maintenance[J].Journal of Central South University (Science and Technology),2021,52(7): 2099-2117.

基金

国家自然科学基金项目(42071343)
黑龙江省省属本科高校基本科研业务费(2020-KYYWF-0690)

评论

PDF(2178 KB)

Accesses

Citation

Detail

段落导航
相关文章

/