煤矿井下巡检机器人多模态感知协同控制研究

    Research on multimodal perception and cooperative control of underground coal mine inspection robots

    • 摘要: 为解决煤矿井下复杂环境中巡检机器人单一感知易失效、控制与感知协同不足的问题,提升自主巡检的精准性与高效性,开展了多模态感知协同控制研究。首先,分析了井下狭长巷道、高粉尘、强电磁干扰等环境特征及设备状态监测、环境参数监测等核心需求,设计了适配的硬件架构,包括履带式移动平台与多模态感知模块,构建了多通道同步数据采集与预处理系统;提出了涵盖数据输入层、特征提取层、融合决策层的3层融合框架,采用时间戳对齐与动态权重融合策略,结合注意力机制实现跨模态特征级融合,优化特征维度并增强鲁棒性;设计了感知−控制协同策略,建立了基于紧急度、影响范围、持续时间的任务优先级量化机制,提出了引入环境风险值的改进A*算法用于运动规划,采用模型预测控制框架构建感知反馈与执行器联动的协同控制算法。试验结果显示,多模态融合方法的设备故障识别准确率达95.7%(较单一视觉方法提升了23.4%),气体浓度检测误差仅4.8%,障碍物漏检率1.2%;改进A*算法在复杂障碍场景中平均路径长度为115.8 m,避障成功率97.5%,规划耗时68 ms,较传统A*算法路径缩短了12.8 m,避障成功率提升了20.8%;协同控制算法在应急响应场景中的任务切换时间为1.5 s,异常处理准确率96.7%,目标定位误差±5.3 cm,平均能耗229 W。

       

      Abstract: To address the issues of single-modal perception failure and insufficient coordination between control and perception in inspection robots under the complex underground coal mine environment, and to improve the accuracy and efficiency of autonomous inspection, a study on multi-modal perception collaborative control was carried out. Firstly, the environmental characteristics such as narrow and long roadways, high dust concentration, and strong electromagnetic interference in underground coal mines, as well as the core requirements including equipment condition monitoring and environmental parameter monitoring, were analyzed. An adaptive hardware architecture was designed, including a tracked mobile platform and a multi-modal perception module, and a multi-channel synchronous data acquisition and preprocessing system was constructed. A three-layer fusion framework covering the data input layer, feature extraction layer, and fusion decision layer was proposed. A timestamp alignment and dynamic weight fusion strategy was adopted, combined with an attention mechanism to achieve cross-modal feature-level fusion, optimizing feature dimensions and enhancing robustness. A perception-control collaboration strategy was designed, a task priority quantification mechanism based on urgency, influence scope, and duration was established, an improved A* algorithm introducing environmental risk values was proposed for motion planning, and a collaborative control algorithm linking perception feedback with actuators was constructed using a model predictive control framework. The experimental results show that the equipment fault recognition accuracy of the multi-modal fusion method reaches 95.7% (23.4% higher than that of the single-vision method); the gas concentration detection error is only 4.8%, and the obstacle missed detection rate is 1.2%. The improved A* algorithm has an average path length of 115.8 m, an obstacle avoidance success rate of 97.5%, and a planning time of 68 ms in complex obstacle scenarios, with the path shortened by 12.8 m and the obstacle avoidance success rate increased by 20.8% compared with the traditional A* algorithm. The collaborative control algorithm has a task switching time of 1.5 s, an abnormal handling accuracy of 96.7%, a target positioning error of ±5.3 cm, and an average energy consumption of 229 W in emergency response scenarios.

       

    /

    返回文章
    返回