基于红外/可见光双模态融合的无轨胶轮车运行前方人员检测方法

    Identification method for personnel in front of underground trackless tyred vehicle based on infrared/visible dual-mode fusion

    • 摘要: 无轨胶轮车以其卓越的适应性、灵活性、高效性逐渐成为现代煤矿辅助运输中的核心组成部分。煤矿井下辅助运输沿线光照条件差、场景信息复杂,导致无轨胶轮车事故频发,严重威胁辅助运输沿线作业人员的生命安全。针对煤矿井下辅助运输沿线无轨胶轮车运行前方侵入人员的可靠识别问题,提出了基于红外/可见光双模态融合技术的辅助运输沿线人员可靠识别方法,构建了基于多尺度特征交互模块红外/可见光双模融合网络,采用多级同尺度融合与跨尺度融合相结合的方式,设计了基于窗口多头自注意机制和基于滑动窗口多头自注意机制,有效保留了红外图像与可见光图像的结构细节特征。仿真结果表明:在处理红外/可见光融合方面,所提双模融合网络在峰值信噪比、结构特征相似指数、均方误差、相关度指标均高于Dif−Fusion、SwinFusion 2种常用图像融合网络;优化了YOLOv8目标识别网络后处理方式,采用DIoU−NMS结构提升了目标定位的精度,并降低了算法漏检率,实现了辅助运输巷道作业人员的可靠识别。此外,基于煤矿井下场景实拍图像并在基础上进行处理扩展,建成了面向煤矿井下辅助运输沿线人员检测任务的有效数据集。中煤华晋集团有限公司王家岭矿开展的工业性试验结果表明:所构建的无轨胶轮车运行前方侵入人员可靠识别方法的人员检测精确率可达97.58%,召回率可达98.54%。

       

      Abstract: With the excellent adaptability, flexibility and efficiency, trackless tyred vehicle has gradually become the core component of modern coal mine auxiliary transportation. Due to the poor lighting conditions and complex scene along the auxiliary transportation line in coal mine, the accidents of the trackless tyred vehicle occur frequently, seriously threatening the life safety of operators along the auxiliary transportation line. Aiming at the problem of reliable identification of intruders in front of underground trackless tyred running along the auxiliary transportation line of coal mine, a reliable identification method of personnel along the auxiliary transportation line based on infrared/visible light dual-mode fusion technology was proposed. In the improved method, an infrared/visible dual-mode fusion network based on multi-scale feature interaction module is constructed, which combines multi-scale fusion and cross-scale fusion to effectively preserve the structural details of infrared images and visible images by designing the window-based multi-head self-attention and shifed window-based multi-head self-atention. The simulation results show that in processing infrared/visible light fusion, the proposed dual-mode fusion technology has higher peak signal-to-noise ratio, structural feature similarity index, mean square error and correlation index than two commonly used image fusion networks such as the Dif-Fusion and SwinFusion. The post-processing method of YOLOv8 target recognition network is optimized, the DIoU-NMS structure is used to improve the accuracy of target positioning, reduce the missed detection rate of the algorithm, and realize the reliable identification of auxiliary transportation tunnel operators. With the improvements, the reliable identification of auxiliary transportation roadway operators is realized. Based on the actual images of the coal mine scene and the processing expansion, an effective data set for the detection task of personnel along the auxiliary transportation in the coal mine is established. The industrial experiment were carried out in Wangjialing Mine of China Coal Huajin Group Co., LTD., and the results show that the accuracy rate of personnel detection and the recall rate of intruders can reach 97.58% and 98.53% respectively.

       

    /

    返回文章
    返回