Autonomous Navigation and Automatic Target Spraying Robot for Orchards

doi:10.12133/j.smartag.SA202207008

Abstract

Abstract:

To realize the autonomous navigation and automatic target spraying of intelligent plant protect machinery in orchard, in this study, an autonomous navigation and automatic target spraying robot for orchards was developed. Firstly, a single 3D light detection and ranging (LiDAR) was used to collect fruit trees and other information around the robot. The region of interest (ROI) was determined using information on the fruit trees in the orchard (plant spacing, plant height, and row spacing), as well as the fundamental LiDAR parameters. Additionally, it must be ensured that LiDAR was used to detect the canopy information of a whole fruit tree in the ROI. Secondly, the point clouds within the ROI was two-dimension processing to obtain the fruit tree center of mass coordinates. The coordinate was the location of the fruit trees. Based on the location of the fruit trees, the row lines of fruit tree were obtained by random sample consensus (RANSAC) algorithm. The center line (navigation line) of the fruit tree row within ROI was obtained through the fruit tree row lines. The robot was controlled to drive along the center line by the angular velocity signal transmitted from the computer. Next, the ATRS's body speed and position were determined by encoders and the inertial measurement unit (IMU). And the collected fruit tree zoned canopy information was corrected by IMU. The presence or absence of fruit tree zoned canopy was judged by the logical algorithm designed. Finally, the nozzles were controlled to spray or not according to the presence or absence of corresponding zoned canopy. The conclusions were obtained. The maximum lateral deviation of the robot during autonomous navigation was 21.8 cm, and the maximum course deviation angle was 4.02°. Compared with traditional spraying, the automatic target spraying designed in this study reduced pesticide volume, air drift and ground loss by 20.06%, 38.68% and 51.40%, respectively. There was no significant difference between the automatic target spraying and the traditional spraying in terms of the percentage of air drift. In terms of the percentage of ground loss, automatic target spraying had 43% at the bottom of the test fruit trees and 29% and 28% at the middle of the test fruit trees and the left and right neighboring fruit trees. But in traditional spraying, the percentage of ground loss was, in that sequence, 25%, 38%, and 37%. The robot developted can realize autonomous navigation while ensuring the spraying effect, reducing the pesticides volume and loss.

Key words: automatic navigation, automatic target spraying, LiDAR, random sample consensus algorithm, robot, IMU

CLC Number:

TP242

LIU Limin, HE Xiongkui, LIU Weihong, LIU Ziyan, HAN Hu, LI Yangfan. Autonomous Navigation and Automatic Target Spraying Robot for Orchards[J]. Smart Agriculture, 2022, 4(3): 63-74.

Figures/Tables 14

Fig. 1

Fig. 2

Fig. 3

Fig. 4

Fig. 5

Fig. 6

Fig. 7

Fig. 8

Fig. 9

Fig. 1

Fig. 11

Fig. 12

Fig. 13

Fig. 14

References 26

1	刘理民, 何雄奎, 刘亚佳. 多功能果园作业平台安全性研究进展[J]. 农业工程, 2020, 10(12): 7-13.
	LIU L, HE X, LIU Y. Research progress on safety of multifunctional orchard operating platform[J]. Agricultural Engineering, 2020, 10(12): 7-13.
2	周良富, 薛新宇, 周立新, 等. 果园变量喷雾技术研究现状与前景分析[J]. 农业工程学报, 2017, 33(23): 80-92.
	ZHOU L, XUE X, ZHOU L, et al. Research situation and progress analysis on orchard variable rate spraying technology[J]. Transactions of the CSAE, 2017, 33(23): 80-92.
3	MAO W, LIU H, HAO W, et al. Development of a combined orchard harvesting robot navigation system[J]. Remote Sensing, 2022, 14(3): ID 675.
4	PEREZ-RUIZ M, UPADHYAYA K S. GNSS in precision agricultural operations[M]. London: IntechOpen, 2012.
5	何雄奎. 高效植保机械与精准施药技术进展[J]. 植物保护学报, 2022, 49(1): 389-397.
	HE X. Research and development of efficient plant protection equipment and precision spraying technology in China: A review[J]. Journal of Plant Protection, 2022, 49(1): 389-397.
6	何雄奎. 中国精准施药技术和装备研究现状及发展建议[J]. 智慧农业(中英文), 2020, 2(1):133-146.
	HE X. Research progress and developmental recommendations on precision spraying technology and equipment in China[J]. Smart Agriculture, 2020, 2(1): 133-146.
7	郭成洋. 果园智能车辆自动导航系统关键技术研究[D]. 杨凌: 西北农林科技大学, 2020.
	GUO C. Key technologies of automatic vehicles navigation system in orchard[D]. Yangling: Northwest A&F University, 2020.
8	LI M, IMOU K, WAKABAYASHI K, et al. Review of research on agricultural vehicle autonomous guidance[J]. International Journal of Agricultural and Biological Engineering, 2009, 2(3): 1-16.
9	VROCHIDOU E, OUSTADAKIS D, KEFALAS A, et al. Computer vision in self-steering tractors[J]. Machines, 2022, 10(2): ID 129.
10	RADCLIFFE J, COX J, BULANON D M, et al. Machine vision for orchard navigation[J]. Computers in Industry, 2018, 98: 165-171.
11	闫成功, 徐丽明, 袁全春, 等. 基于双目视觉的葡萄园变量喷雾控制系统设计与试验[J]. 农业工程学报, 2021, 37(11): 13-22.
	YAN C, XU L, YUAN Q, et al. Design and experiments of vineyard variable spraying control system based on binocular vision[J]. Transactions of the CSAE, 2021, 37(11): 13-22.
12	HESS W, KOHLER D, RAPP H, et al. Real-time loop closure in 2D LIDAR SLAM. Proceedings[C]// IEEE International Conference on Robotics and Automation. Piscataway, New York, USA: IEEE, 2016.
13	SANTOS L C, AGUIAR A S, SANTOS F N, et al. Navigation stack for robots working in steep slope vineyard[M]. Berlin, Germany: Springer Publisher, 2021.
14	JIANG S, WANG S, YI Z, et al. Autonomous navigation system of greenhouse mobile robot based on 3D LiDAR and 2D LiDAR SLAM[J]. Frontiers in Plant Science, 2022, 13: ID 815218.
15	刘伟洪, 何雄奎, 刘亚佳, 等. 果园行间3D LiDAR导航方法[J]. 农业工程学报, 2021, 37(9): 165-174.
	LIU W, HE X, LIU Y, et al. Navigation method between rows for orchard based on 3D LiDAR[J]. Transactions of the CSAE, 2021, 37(9): 165-174.
16	FRANK D L, STARCHER S, CHANDRAN R S. Comparison of mating disruption and insecticide application for control of peach tree borer and lesser peachtree borer (Lepidoptera: Sesiidae) in Peach[J]. Insects, 2020, 11(10): ID 658.
17	姜红花, 白鹏, 刘理民, 等. 履带自走式果园自动对靶风送喷雾机研究[J]. 农业机械学报, 2016, 47(S1): 189-195.
	JIANG H, BAI P, LIU L, et al. Caterpillar self-propelled and air-assisted orchard sprayer with automatic target spray system[J]. Transactions of the CSAM, 2016, 47(S1): 189-195.
18	姜红花, 刘理民, 柳平增, 等. 面向精准喷雾的果树冠层体积在线计算方法[J]. 农业机械学报, 2019, 50(7): 120-129.
	JIANG H, LIU L, LIU P, et al. Online calculation method of fruit trees canopy volume for precision spray[J]. Transactions of the CSAM, 2019, 50(7): 120-129.
19	刘理民. 基于果树冠层探测的变量喷雾技术研究与试验[D]. 泰安: 山东农业大学, 2019.
	LIU L. Research and experiment of variable spray technology based on fruit trees canopy detecting[D]. Taian: Shanong Agricultural University, 2019.
20	李龙龙, 何雄奎, 宋坚利, 等. 基于变量喷雾的果园自动仿形喷雾机的设计与试验[J]. 农业工程学报, 2017, 33(1): 70-76.
	LI L, HE X, SONG J, et al. Design and experiment of automatic profiling orchard sprayer based on variable air volume and flow rate[J]. Transactions of the CSAE, 2017, 33(1): 70-76.
21	ZHANG S, GUO C, GAO Z, et al. Research on 2D laser automatic navigation control for standardized orchard[J]. Applied Sciences (Switzerland), 2020, 10(8): ID 2763.
22	窦汉杰, 翟长远, 王秀, 等. 基于LiDAR的果园对靶变量喷药控制系统设计与试验[J]. 农业工程学报, 2022, 38(3): 11-21.
	DOU H, ZHAI C, WANG X, et al. Design and experiment of the orchard target variable spraying control system based on LiDAR[J]. Transactions of the CASE, 2022, 38(3): 11-21.
23	刘理民, 张晓辉, 石光智, 等. 多态自动对靶风送式喷雾试验台的设计与试验[J]. 江苏农业科学, 2019, 47(13): 260-263.
24	刘理民, 王金宇, 毛文华, 等. 基于传感器融合阵列的果树冠层信息采集方法[J]. 农业机械学报, 2018, 49(S1): 347-353, 359.
	LIU L, WANG J, MAO W, et al. Canopy information acquisition method of fruit trees based on fused sensor array[J]. Transactions of the CSAM, 2018, 49(S1): 347-353, 359.
25	李龙龙, 何雄奎, 宋坚利, 等. 果园仿形变量喷雾与常规风送喷雾性能对比试验[J]. 农业工程学报, 2017, 33(16): 56-63.
	LI L, HE X, SONG J, et al. Comparative experiment on profile variable rate spray and conventional air assisted spray in orchards[J]. Transactions of the CSAE, 2017, 33(16): 56-63.
26	GIL E, ESCOLÀ A, ROSELL J R, et al. Variable rate application of plant protection products in vineyard using ultrasonic sensors[J]. Crop Protection, 2007, 26(8): 1287-1297.

[1]	GUO Jiangpeng, WANG Pengfei, LI Xinhao, YANG Xin, LI Jianping, BIAN Yongliang, XUE Chunlin. Design Optimization and Test of Air Supply System for Multi-Duct Sprayer [J]. Smart Agriculture, 2022, 4(3): 75-85.
[2]	DUAN Luojia, YANG Fuzeng, YAN Bin, SHI shuaiqi, QIN jifeng. Research Progress of Apple Production Intelligent Chassis and Weeding and Harvesting Equipment Technology [J]. Smart Agriculture, 2022, 4(3): 24-41.
[3]	FENG Han, ZHANG Hao, WANG Zi, JIANG Shijie, LIU Weihong, ZHOU Linghui, WANG Yaxiong, KANG Feng, LIU Xingxing, ZHENG Yongjun. Three-Dimensional Virtual Orchard Construction Method Based on Laser Point Cloud [J]. Smart Agriculture, 2022, 4(3): 12-23.
[4]	YANG Liang, XIONG Benhai, WANG Hui, CHEN Ruipeng, ZHAO Yiguang. Research Progress and Outlook of Livestock Feeding Robot [J]. Smart Agriculture, 2022, 4(2): 86-98.
[5]	HUANG Zichen, SUGIYAMA Saki. Research Progress and Enlightenment of Japanese Harvesting Robot in Facility Agriculture [J]. Smart Agriculture, 2022, 4(2): 135-149.
[6]	ZHANG Wenhan, DU Keming, SUN Yankun, LIU Buchun, SUN Zhongfu, MA Juncheng, ZHENG Feixiang. Monitoring Specified Depth Soil Moisture in Field Scale with Ground Penetrating Radar [J]. Smart Agriculture, 2022, 4(1): 84-96.
[7]	FAN Daoquan, ZHANG Meina, PAN Jian, LYU Xiaolan. Development and Performance Test of Variable Spray Control System Based on Target Leaf Area Density Parameter [J]. Smart Agriculture, 2021, 3(3): 60-69.
[8]	WANG Fang, TENG Guifa, YAO Jingfa. Multi-Objective Vegetable Transportation and Distribution Path Optimization with Time Windows [J]. Smart Agriculture, 2021, 3(3): 152-161.
[9]	TANG Qing, ZHANG Ruirui, CHEN Liping, LI Longlong, XU Gang. Research Progress of Key Technologies and Verification Methods of Numerical Modeling for Plant Protection Unmanned Aerial Vehicle Application [J]. Smart Agriculture, 2021, 3(3): 1-21.
[10]	HU Yanan, LIANG Ju, LIANG Shefang, LI Shijuan, ZHU Yeping, E Yue. Optimum Sowing Date of Winter Wheat in Next 40 Years Based on DSSAT-CERES-Wheat Model [J]. Smart Agriculture, 2021, 3(2): 68-76.
[11]	YANG Xu, HU Songtao, WANG Yinghua, YANG Wanneng, ZHAI Ruifang. Cotton Phenotypic Trait Extraction Using Multi-Temporal Laser Point Clouds [J]. Smart Agriculture, 2021, 3(1): 51-62.
[12]	MAO Wenju, LIU Heng, WANG Dongfei, YANG Fuzeng, LIU Zhijie. Improved AODV Routing Protocol for Multi-Robot Communication in Orchard [J]. Smart Agriculture, 2021, 3(1): 96-108.
[13]	ZHANG Jian, XIE Tianjin, YANG Wanneng, ZHOU Guangsheng. Research Status and Prospect on Height Estimation of Field Crop Using Near-Field Remote Sensing Technology [J]. Smart Agriculture, 2021, 3(1): 1-15.
[14]	WANG Chunlei, LI Hongwen, HE Jin, WANG Qingjie, LU Caiyun, CHEN Liping. State-of-the-Art and Prospect of Automatic Navigation and Measurement Techniques Application in Conservation Tillage [J]. Smart Agriculture, 2020, 2(4): 41-55.
[15]	ZHOU Hang, ZHANG Shunlu, ZHAI Yihao, WANG Song, ZHANG Chunlong, ZHANG Junxiong, LI Wei. Vision Servo Control Method and Tapping Experiment of Natural Rubber Tapping Robot [J]. Smart Agriculture, 2020, 2(4): 56-64.