井下移动装备运行前方侵入人员可靠识别方法

    Reliable identification method of intrusion personnel in front of underground moving equipment

    • 摘要: 无轨胶轮车以其机动性好、效率高的优势目前被广泛应用于煤矿井下辅助运输系统。然而,由于煤矿井下光照条件差、场景信息复杂,导致无轨胶轮车等井下移动装备事故频发,严重威胁到井下工作空间内作业人员的生命安全。面向煤矿矿井昏暗复杂场景,针对煤矿井下移动装备运行前方侵入人员的可靠识别问题,设计并提出了红外与可见光双模图像可靠配准方法,并通过引入Sobel残差块结构,构建了基于改进STDFusionNet网络架构的红外与可见光图像融合模型,实现了融合后图像的特征表征增强;进而提出了基于YOLOv5s的煤矿井下人员可靠识别方法,结合可见光与红外双模态特征进行融合互补,构建了端到端的单阶段井下移动装备运行前方侵入人员目标检测模型,实现了井下移动装备运行前方侵入人员的可靠检测;最后,对煤矿井下实采场景进行了人员目标标注,并进行了样本扩充,建立了辅助运输沿线人员样本集,通过工业性试验验证了所提人员目标检测算法的工业适用性。试验结果表明:与目前常用的DenseFuse、FusionGAN和STDFusionNet模型相比,改进后的融合模型可有效提升目标检测的精确度,且使其与YOLOv5s目标检测架构相结合,所构建的井下移动装备运行前方侵入人员可靠识别方法的人员检测精确率可达96.43%,召回率可达98.18%,并且在检测帧率方面也表现出明显优势。

       

      Abstract: The trackless tyred vehicle is widely used in coal mine auxiliary transportation system because of its good mobility and high efficiency. Facing the dim and complex scene of coal mine, due to the poor lighting conditions and complex scene in coal mine, the accidents of the underground moving equipment like the trackless tyred vehicle occur frequently, seriously threatening the life safety of operators in the underground coal mine. A reliable registration method of infrared and visible dual-modal images is designed and proposed to solve the problem of reliable identification of intruders in front of the moving equipment in underground coal mines. By introducing the Sobel residual block structure, a fusion model of infrared and visible images based on improved STDFusionNet network architecture is constructed to enhance the feature representation of the fused image. Then, a reliable identification method of underground personnel based on YOLOv5s is proposed, and the visible light and infrared dual-modal features are combined to fuse and complement each other, and an end-to-end single-stage detection model of intrusive personnel in front of underground moving equipment is constructed, which realizes the reliable detection of intrusive personnel in front of underground moving equipment. Finally, after the work that the personnel targets are labeled in the actual mining scene of coal mine and the sample expansion is carried out, the personnel sample set along the auxiliary transportation is established. The industrial applicability of the proposed personnel target detection algorithm is verified through industrial experiments. The experimental results show that the improved fusion model can effectively improve the accuracy of object detection compared with the commonly used DenseFuse, FusionGAN and STDFusionNet models. When it is combined with the YOLOv5s object detection architecture, the constructed reliable identification method for intruded personnel in front of underground mobile equipment operation has the accuracy rate of 96.43% and the recall rate of 98.18%, and it also shows obvious advantages in the detection frame rate.

       

    /

    返回文章
    返回