Welcome to Smart Agriculture 中文

Smart Agriculture ›› 2020, Vol. 2 ›› Issue (4): 65-78.doi: 10.12133/j.smartag.2020.2.4.202009-SA003

• Special Issue--Agricultural Robot and Smart Equipment • Previous Articles     Next Articles

Visual Positioning and Harvesting Path Optimization of White Asparagus Harvesting Robot

LI Yang1,2(), ZHANG Ping4, YUAN Jin1,3(), LIU Xuemei1,2   

  1. 1.School of Mechanical and Electronic Engineering, Shandong Agricultural University, Tai'an 271018, China
    2.Shandong Provincial Key Laboratory of Horticultural Machinery and Equipment, Tai'an 271018, China
    3.Shandong Agricultural Equipment Intelligent Engineering Laboratory, Tai'an 271018, China
    4.School of Information Science and Engineering, Shandong Agricultural University, Tai'an 271018, China
  • Received:2020-09-28 Revised:2020-10-28 Online:2020-12-30
  • Foundation items:
    National Natural Science Foundation of China(51675317); Shandong Province Key Research and Development Program Project (2017GNC12110)
  • About author:LI Yang, E-mail:mtlyab@sdau.edu.cn
  • corresponding author: YUAN Jin, E-mail:

Abstract:

For white asparagus selective harvesting is the best harvesting method determined by its growth characteristics. Focusing on the difficulties that the texture and the color of shoot tips are similar with ridge surface under machine vision, the recognition method of asparagus shoots and precise positioning were studied in this research. A changeable scale ROI detection method was proposed, with the fusion of color transformation, histogram averaging, morphology and texture filtering. After that, a harvesting path optimization method of multiple asparaguses was proposed, which solved the problem of harvesting efficiency reduction caused by unreasonable harvesting paths. Firstly, real-time acquisition of the image and individual RGB channel Gaussian filtering were implemented. Based on the HSV color transformation and histogram averaging processing, the asparagus shoot and soil feature clustering analysis were carried out. According to the sprout degrees of asparaguses, the changeable scale ROI detection method was studied. The morphology and the texture of the shoot, and soil were statistically analyzed. According to the texture feature parameters, the position of shoot was determined and its geometric center was calculated. Secondly, in order to improve harvesting efficiency, a path optimization algorithm based on multiple asparaguses was designed according to the locations of the asparaguses and the bins to obtain the optimal harvesting path. Finally, in order to verify the reliability of the proposed methods, asparagus shoot location and harvest verification tests were carried out on the established harvesting test platform. The results showed that the recognition rate of white asparagus in the visual system was more than 98.04%, the maximum positioning error of the center coordinate of the white asparagus shoot was 0.879 mm in X direction and 0.882 mm in Y direction, and the average reduction of end-effector motion distance could be 43.89% after path optimization under different circumstances, the success rate of end-effector localization was 100% and the harvest rate of white asparagus in the laboratory test was 88.13%. The research verified the feasibility of the visual positioning and harvesting path optimization of the white asparagus selective harvesting robot.

Key words: white asparagus, harvesting robot, selective harvesting, visual positioning, harvesting path optimization, asparagus shoot recognition

CLC Number: