Research on defect target identification of high pixel wire image based on semantic information patching
Author:
Clc Number:

TM755

  • Article
  • | |
  • Metrics
  • |
  • Reference [20]
  • | | | |
  • Comments
    Abstract:

    As an important component of overhead transmission lines, transmission wires may cause major power accidents if they are found to be defective during the inspection process. The identification of wire defects in high-pixel UAV inspection images requires a large amount of calculation and the target area of defects is small. If real-time high-precision identification is realized in the UAV inspection process, the inspection efficiency can be greatly accelerated. This paper proposes a method to identify wire defects by using the on-board computer of UAV to process high-resolution wire images collected by high-definition cameras in real time. The method firstly uses semantic information patching to sub-sample the wire image, and then uses the segmentation network to obtain the low-pixel wire segmentation areas and mesh them. Multiple wire areas are cropped out and mapped back to the high-pixel original image at a down-sampling ratio. Then a number of high-resolution wire areas are cut out and enter the yolov3 network in batch for wire defect recognition. Finally the defect recognition target area is produced according to the input high-precision attention area in the relative position of the original image. The experimental results show that the identification method proposed in this paper can realize the real-time identification of high frame rate defects in the high-resolution wire images collected by the camera in the process of UAV patrolling, which provides a new idea for the intelligent patrolling of UAV.

    Reference
    [1] 全国输配电技术协作组,输电线路无人机技术组.无人机输电线路巡检应用发展报告[M].北京:中国电力出版社,2016:3-5.
    [2] 李映国,杨宏,徐郁,等.基于Alexnet网络的绝缘子自爆无人机巡检技术研究[J].智慧电力,2021,49(8):104-109.LI Yingguo,YANG Hong,XU Yu,et al.Insulator Self-explosive inspection technology based on alexnet network in UAV grid inspection[J].Smart Power,2021,49(8):104-109.
    [3] 许保瑜,赵毅林,陈庆宁,等.输电线路移动式不间断自主智能巡检技术研究[J].电测与仪表,2021,58(11):157-163.XU Baoyu,ZHAO Yili,CHEN Qingning,et al.Research on mobile uninterrupted autonomous intelligent inspection echnology for transmission lin[J].Electrical Measurement & Instrumentation,2021,58(11):157-163.
    [4] 唐睿,张铭予,徐宏,等.基于深度学习的输电线路巡检图像绝缘子识别[J].电网与清洁能源,2021,37(4):41-46.TANG Rui,ZHANG Mingyu,XU Hong,et al.Insulator recognition in transmission line inspection image based on deep learning[J].Power System and Clean Energy,2021,37(4):41-46.
    [5] 宋耐超,王瑞琦,李明明,等.多自然灾害下的架空输电线路运行风险评估[J].电力系统保护与控制,2021,49(19):65-71.SONG Naichao,WANG Ruiqi,LI Mingming,et al.Risk assessment of overhead transmission lines under multiple natural disasters[J].Power System Protection and Control,2021,49(19):65-71.
    [6] 黄郑,王永强,王红星,等.基于云雾边异构协同的无人机智慧巡检系统[J].中国电力,2020,53(4):161-168.HUANG Zheng,WANG Yongqiang,WANG Hongxing,et al.Design and application of UAV intelligent inspection system for transmission lines based on cloud and fog-edge heterogeneous collaborative computing architecture[J].Electric Power,2020,53(4):161-168.
    [7] 冯敏,罗旺,余磊,等.适用于无人机巡检图像的输电线路螺栓检测方法[J].电力科学与技术学报,2018,33(4):135-140.FENG Min,LUO Wang,YU Lei,et al.A bolt detection method for pictures captured form an unmanned aerial vehicle in power transmission line inspection[J].Journal of Electric Power Science and Technology,2018,33(4):135-140.
    [8] 唐波,覃乔,黄力.基于色彩模型和纹理特征的输电线路绝缘子串航拍图像识别[J].电力科学与技术学报,2020,35(4):13-19.TANG Bo,QIN Qiao,HUANG Li.Transmission line aerial image recognition of insulator strings based on color model and texture feature[J].Journal of Electric Power Science and Technology,2020,35(4):13-19.
    [9] 孙凤杰,杨镇澴,李媛媛,等.输电导线图像目标识别方法[J].中国图象图形学报,2012,17(3):349-356.SUN Fengjie,YANG Zhenhuan,LI Yuanyuan,et al.Methods of transmission line target recognition[J].Journal of Image and Graphics,2012,17(3):349-356.
    [10] 王万国,张晶晶,韩军,等.基于无人机图像的输电线断股与异物缺陷检测方法[J].计算机应用,2015,35(8):2404-2408.WANG Wanguo,ZHANG Jingjing,HAN Jun,et al.Broken strand and foreign body fault detection method for power transmission line based on unmanned aerial vehicle image[J].Journal of Computer Applications,2015,35(8):2404-2408.
    [11] 蒋兴良,夏云峰,张志劲,等.基于优化Gabor滤波器的输电导线断股图像检测[J].电力系统自动化,2011,35(15):78-83.JIANG Xingliang,XIA Yunfeng,ZHANG Zhijin,et al.Image detection of broken strand faults of transmission conductor based on optimized Gabor filter[J].Automation of Electric Power Systems,2011,35(15):78-83.
    [12] 张成,王卫东,杨延滨,等.新型电缆多参量带电检测装置设计与应用[J].中国电力,2021,54(10):144-151.ZHANG Cheng,WANG Weidong,YANG Yanbin,et al.Design and application of a new-type power cable multi-parameter live detection device[J].Electric Power,2021,54(10):144-151.
    [13] 黄新波,章小玲,张烨,等.基于径向基概率神经网络的输电导线缺陷状态识别[J].电力系统自动化,2020,44(3):201-214.HUANG Xinbo,ZHANG Xiaoling,ZHANG Ye,et al.Fault state identification of transmission wires based on radial basis probabilistic neural network[J].Automation of Electric Power System,2020,44(3):201-214.
    [14] 王井利,阎鑫.基于Faster R-CNN的高分二号遥感影像特定目标识别[J].中国科技论文,2019,14(9):985-990.WANG Jingli,YAN Xin.Faster R-CNN based specific target recognition of GF2 remote sensing images[J].China Sciencepaper,2019,14(9):985-990.
    [15] 郑志强,刘妍妍,潘长城,等.改进YOLO V3遥感图像飞机识别应用[J].电光与控制,2019,26(4):28-32.ZHENG Zhiqiang,LIU Yanyan,PAN Changcheng,et al.Application of improved YOLO V3 in aircraft recognition of remote sensing images[J].Electronics Optics & Control,2019,26(4):28-32.
    [16] HOU L,SAMARAS D,KURC T M,et al.Patch-based convolutional neural network for whole slide tissue image classification[C]//Proceedings of the IEEE conference on computer vision and pattern recognition,Las Vegas,USA:IEEE,2016:2424-2433.
    [17] HE K,ZHANG X,REN S,et al.Deep residual learning for image recognition[C]//Proceedings of the IEEE conference on computer vision and pattern recognition,Las Vegas,USA:IEEE,2016:770-778.
    [18] LONG J,SHELHAMER E,DARRELL T.Fully convolutional networks for semantic segmentation[C]//Proceedings of the IEEE conference on computer vision and pattern recognition,Boston,USA:IEEE,2015:3431-3440.
    [19] RONNEBERGER O,FISCHER P,BROX T.U-net:Convolutional networks for biomedical image segmentation[C]//International Conference on Medical image computing and computer-assisted intervention,Munich,Germany,2015:234-241.
    [20] SANDLER M,HOWARD A,ZHU M,et al.MobileNetV2:Inverted residuals and linear bottlenecks[C]//Proceedings of the IEEE conference on computer vision and pattern recognition,Salt Lake City,USA:IEEE,2018:4510-4520.
    Related
    Cited by
    Comments
    Comments
    分享到微博
    Submit
Get Citation

廖如超,张英,廖建东,袁新星,康泰钟.基于语义信息分块的高像素导线缺陷目标识别[J].电力科学与技术学报英文版,2022,37(3):206-212. LIAO Ruchao, ZHANG Ying, LIAO Jiandong, YUAN Xinxing, KANG Taizhong. Research on defect target identification of high pixel wire image based on semantic information patching[J]. Journal of Electric Power Science and Technology,2022,37(3):206-212.

Copy
Share
Article Metrics
  • Abstract:185
  • PDF: 940
  • HTML: 0
  • Cited by: 0
History
  • Online: July 24,2022
Article QR Code