欢迎您访问《智慧农业(中英文)》官方网站! English

Smart Agriculture ›› 2024, Vol. 6 ›› Issue (6): 23-43.doi: 10.12133/j.smartag.SA202406005

• 专题--农业知识智能服务和智慧无人农场(上) • 上一篇    下一篇

农业复杂场景下多机器人协同SLAM研究进展与展望

马楠1,2,4,5(), 曹姗姗2,3, 白涛1,4,5, 孔繁涛6, 孙伟2,3()   

  1. 1. 新疆农业大学 计算机与信息工程学院,新疆 乌鲁木齐 830052
    2. 中国农业科学院农业信息研究所,北京 100081
    3. 国家农业科学数据中心,北京 100081
    4. 智能农业教育部工程研究中心,新疆 乌鲁木齐 830052
    5. 新疆农业信息化工程技术研究中心,新疆 乌鲁木齐 830052
    6. 中国农业科学院农业经济与发展研究所,北京 100081
  • 收稿日期:2024-06-11 出版日期:2024-11-30
  • 基金项目:
    中国农业科学院科技创新工程(10-IAED-RC-09-2024); 新疆维吾尔自治区重点研发任务专项(2022B02049-1-3); 国家重点研发计划项目(2023YFD200080503); 新疆维吾尔自治区高校基本科研业务费科研项目(XJEDU2022J009); 科技部科技创新 2030重大项目(2022ZD0115800)
  • 作者简介:
    马 楠,研究方向为农业信息技术。E-mail:
  • 通信作者:
    孙 伟,博士,研究员,研究方向为智慧畜牧和时空信息分析。E-mail:

Research Progress and Prospect of Multi-robot Collaborative SLAM in Complex Agricultural Scenarios

MA Nan1,2,4,5(), CAO Shanshan2,3, BAI Tao1,4,5, KONG Fantao6, SUN Wei2,3()   

  1. 1. College of Computer and Information Engineering, Xinjiang Agricultural University, Urumqi 830052, China
    2. Agricultural Information Institute of CAAS, Beijing 100081, China
    3. National Agriculture Science Data Center, Beijing 100081, China
    4. Engineering Research Center of Intelligent Agriculture Ministry of Education, Urumqi 830052, China
    5. Xinjiang Agricultural Informatization Engineering Technology Research Center, Urumqi 830052, China
    6. Institute of Agricultural Economics and development, Beijing 100081, China
  • Received:2024-06-11 Online:2024-11-30
  • Foundation items:Science and Technology Innovation Program of the Chinese Academy of Agricultural Sciences(10-IAED-RC-09-2024); Key Research and Development Task Project of the Xinjiang Uygur Autonomous Region(2022B02049-1-3); National Key Research and Development Program of China(2023YFD200080503); Basic Research Project Fund for Universities in Xinjiang Uygur Autonomous Region(XJEDU2022J009); Major Project of the Science and Technology Innovation 2030 Initiative by the Ministry of Science and Technology(2022ZD0115800)
  • About author:
    MA Nan, E-mail:
  • Corresponding author:
    SUN Wei, E-mail:

摘要:

[目的/意义] 在大田作业、野外放牧、果园采收等典型农业应用场景下,多机器人(包括移动式智能农机装备等)高精度快速协同同步定位与建图(Simultaneous Localization and Mapping, SLAM)是智慧农业乃至无人农场的关键基础和核心支撑。与单机器人SLAM相比,多机器人协同SLAM具有精度高、范围广、实时性强、扩展性好等优势,但在农业种植和养殖等自然复杂环境下,由于场景动态可变、地形复杂多变、环境丰富多样、通信约束受限等多重因素叠加影响,尚存在诸多问题与挑战。 [进展] 现有研究主要是从通用基础技术的视角对多机器人SLAM的研究脉络、优缺点、适用条件和关键核心问题等方面进行总结归纳,但缺乏针对农业复杂场景特性的剖析。本研究面向农业复杂场景的主要特征,以“多传感器数据融合—协同定位—协同建图—回环检测”为关键技术主线,分析了多机器人协同SLAM的优缺点及其在农业领域的适用性;从多机器人协同作业的视角,明晰了集中式、分布式和混合式三种主要协同框架的优势、局限性及适用的典型农业应用场景;进而探讨了农业复杂场景下多机器人SLAM存在的多传感器融合精度偏低、协同通信环境受限、相对位姿估计准确性不高等突出问题。 [结论/展望] 从优化数据融合底层算法、融合深度学习和强化学习、引入大语言模型、应用数字孪生技术等方面,对农业复杂环境下多机器人SLAM的未来发展方向和趋势进行了展望。

关键词: 农业复杂场景, 多机器人SLAM, 协同定位, 协同建图, 协同框架

Abstract:

[Significance] The rapid development of artificial intelligence and automation has greatly expanded the scope of agricultural automation, with applications such as precision farming using unmanned machinery, robotic grazing in outdoor environments, and automated harvesting by orchard-picking robots. Collaborative operations among multiple agricultural robots enhance production efficiency and reduce labor costs, driving the development of smart agriculture. Multi-robot simultaneous localization and mapping (SLAM) plays a pivotal role by ensuring accurate mapping and localization, which are essential for the effective management of unmanned farms. Compared to single-robot SLAM, multi-robot systems offer several advantages, including higher localization accuracy, larger sensing ranges, faster response times, and improved real-time performance. These capabilities are particularly valuable for completing complex tasks efficiently. However, deploying multi-robot SLAM in agricultural settings presents significant challenges. Dynamic environmental factors, such as crop growth, changing weather patterns, and livestock movement, increase system uncertainty. Additionally, agricultural terrains vary from open fields to irregular greenhouses, requiring robots to adjust their localization and path-planning strategies based on environmental conditions. Communication constraints, such as unstable signals or limited transmission range, further complicate coordination between robots. These combined challenges make it difficult to implement multi-robot SLAM effectively in agricultural environments. To unlock the full potential of multi-robot SLAM in agriculture, it is essential to develop optimized solutions that address the specific technical demands of these scenarios. [Progress] Existing review studies on multi-robot SLAM mainly focus on a general technological perspective, summarizing trends in the development of multi-robot SLAM, the advantages and limitations of algorithms, universally applicable conditions, and core issues of key technologies. However, there is a lack of analysis specifically addressing multi-robot SLAM under the characteristics of complex agricultural scenarios. This study focuses on the main features and applications of multi-robot SLAM in complex agricultural scenarios. The study analyzes the advantages and limitations of multi-robot SLAM, as well as its applicability and application scenarios in agriculture, focusing on four key components: multi-sensor data fusion, collaborative localization, collaborative map building, and loopback detection. From the perspective of collaborative operations in multi-robot SLAM, the study outlines the classification of SLAM frameworks, including three main collaborative types: centralized, distributed, and hybrid. Based on this, the study summarizes the advantages and limitations of mainstream multi-robot SLAM frameworks, along with typical scenarios in robotic agricultural operations where they are applicable. Additionally, it discusses key issues faced by multi-robot SLAM in complex agricultural scenarios, such as low accuracy in mapping and localization during multi-sensor fusion, restricted communication environments during multi-robot collaborative operations, and low accuracy in relative pose estimation between robots. [Conclusions and Prospects] To enhance the applicability and efficiency of multi-robot SLAM in complex agricultural scenarios, future research needs to focus on solving these critical technological issues. Firstly, the development of enhanced data fusion algorithms will facilitate improved integration of sensor information, leading to greater accuracy and robustness of the system. Secondly, the combination of deep learning and reinforcement learning techniques is expected to empower robots to better interpret environmental patterns, adapt to dynamic changes, and make more effective real-time decisions. Thirdly, large language models will enhance human-robot interaction by enabling natural language commands, improving collaborative operations. Finally, the integration of digital twin technology will support more intelligent path planning and decision-making processes, especially in unmanned farms and livestock management systems. The convergence of digital twin technology with SLAM is projected to yield innovative solutions for intelligent perception and is likely to play a transformative role in the realm of agricultural automation. This synergy is anticipated to revolutionize the approach to agricultural tasks, enhancing their efficiency and reducing the reliance on labor.

Key words: agricultural complex scene, multi-robot SLAM algorithm, collaborative positioning, collaborative mapping, collaborative framework

中图分类号: