Recognition and localization method of occluded apples based on K-means clustering segmentation algorithm and convex hull theory

doi:10.12133/j.smartag.2019.1.2.201903-SA003

Abstract

Abstract:

Accurate segmentation and localization of apple objects in natural scenes is an important part of wisdom agriculture research for information perception and acquisition. In order to solve the problem that apples recognition and positioning are susceptible to occlusion of leaves in natural scenes, based on the K-means clustering segmentation algorithm, the object recognition algorithm based on convex hull theory was proposed. And the algorithm was compared with the object recognition algorithm based on removing false contours and the full-contour points fitting object recognition algorithm. The object recognition algorithm based on convex hull theory utilized that apples were like circle, combining K-means algorithm with Otsu algorithm to separate fruit from background. The convex polygon was obtained by convex hull theory and fit it circle to determine the position of the fruit. To verify the effectiveness of the algorithm, 157 apple images in natural scenes were tested. The average overlap rates of the object recognition algorithm based on convex hull theory, the object recognition algorithm based on removing false contour points and the full-contour points fitting object recognition algorithm were 83.7%, 79.5% and 70.3% respectively, the average false positive rates were 2.9%, 1.7% and 1.2% respectively, and the average false negative rates were 16.3%, 20.5% and 29.7% respectively. The experimental results showed that the object recognition algorithm based on convex hull theory had better localization performance and environmental adaptability compared to the other two algorithms and had no recognition error, which can provide reference for occluded fruits segmentation and localization in the natural scenes.

Key words: apple recognition, occluded object, convex hull theory, false contour points, K-means clustering algorithm

CLC Number:

TP391.4

Jiang Mei, Sun Sashuang, He Dongjian, Song Huaibo. Recognition and localization method of occluded apples based on K-means clustering segmentation algorithm and convex hull theory[J]. Smart Agriculture, 2019, 1(2): 45-54.

References

[1]	Xu L, Lv J . Recognition method for apple fruit based on SUSAN and PCNN[J]. Multimedia Tools and Applications, 2018,77(6):7205-7219.
[2]	Rizon M, Yusri N A N, Kadir M F A , et al. Determination of mango fruit from binary image using randomized Hough transform[C]. Eighth International Conference on Machine Vision. International Society for Optics and Photonics, 2015,9875(3):1-5.
[3]	Preter De A, Anthonis J, Baerdemaeker De J . Development of a robot for harvesting strawberries[J]. IFAC-Papers On Line, 2018,51(17):14-19.
[4]	He Z, Xiong J, Lin R , et al. A method of green litchi recognition in natural environment based on improved LDA classifier[J]. Computers and Electronics in Agriculture, 2017,140(8):159-167
[5]	Pothen Z S, Nuske S . Texture-based fruit detection via images using the smooth patterns on the fruit[C]. IEEE International Conference on Robotics and Automation, 2016: 5171-5176.
[6]	黄小玉, 李光林, 马驰 , 等. 基于改进判别区域特征融合算法的近色背景绿色桃子识别[J]. 农业工程学报, 2018,34(23):142-148.
[6]	Huang X, Li G, Ma C , et al. Green peach recognition based on improved discriminative regional feature integration algorithm in similar background[J]. Transactions of the CSAE, 2018,34(23):142-148.
[7]	钱建平, 杨信廷, 吴晓明 , 等. 自然场景下基于混合颜色空间的成熟期苹果识别方法[J]. 农业工程学报, 2012,28(17):137-142.
[7]	Qian J, Yang X, Wu X , et al. Mature apple recognition based on hybrid color space in natural scene[J]. Transactions of the CSAE, 2012,28(17):137-142.
[8]	Wang D, Song H, Tie Z , et al. Recognition and localization of occluded apples using K-means clustering algorithm and convex hull theory: a comparison[J]. Multimedia Tools and Applications, 2016,75(6):3177-3198.
[9]	司永胜, 刘刚, 高瑞 , 等. 苹果采摘机器人果实识别与定位方法[J]. 农业机械学报, 2010,41(9):148-153.
[9]	Si Y, Liu G, Gao R , et al. Recognition and location of fruits for apple harvesting robot[J]. Transactions of the CSAM, 2010,41(9):148-153.
[10]	熊俊涛, 邹湘军, 王红军 , 等. 基于Retinex 图像增强的不同光照条件下的成熟荔枝识别[J]. 农业工程学报, 2013,29(12):170-178.
[10]	Xiong J, Zou X, Wang H , et al. Recognition of ripe litchi in different illumination conditions based on Retinex image enhancement[J]. Transactions of the CSAE, 2013,29(12):170-178.
[11]	李寒, 张漫, 高宇 , 等. 温室绿熟番茄机器视觉检测方法[J]. 农业工程学报, 2017,33(增刊1):328-334.
[11]	Li H, Zhang M , Gao Y et al. Green ripe tomato detection method based on machine vision in greenhouse[J]. Transactions of the CSAE, 2017,33(Supp.1):328-334.
[12]	Sun S, Wu Q, Jiao L , et al. Recognition of green apples based on fuzzy set theory and manifold ranking algorithm[J]. Optik, 2018,165, 395-407.
[13]	Seng W C, Mirisaee S H . 2009 International Conference on Electrical Engineering and Informatics-A new method for fruits recognition system[J]. IEEE 2009 International Conference on Electrical Engineering and Informatics (ICEEI) - Bangi, Malaysia (2009.08.5-2009.08.7), 2009: 130-134.
[14]	Rakun J, Stajnko D, Zazula D . Detecting fruits in natural scenes by using spatial-frequency based texture analysis and multiview geometry[J]. Computers and Electronics in Agriculture, 2011,76(1):80-88.
[15]	宋怀波, 何东健, 潘景朋 . 基于凸壳理论的遮挡苹果目标识别与定位方法[J]. 农业工程学报, 2012,28(22):174-180.
[15]	Song H, He D, Pan J . Recognition and localization methods of occluded apples based on convex hull theory[J]. Transactions of the CSAE, 2012,28(22):174-180.
[16]	杨庆华, 刘灿, 荀一 , 等. 葡萄套袋机器人目标识别方法[J]. 农业机械学报, 2013,44(8):234-239.
[16]	Yang Q, Liu C, Xun Y , et al. Target recognition for grape bagging robot[J]. Transactions of the CSAM, 2013,44(8):234-239.
[17]	Zheng X, Lei Q, Yao R , et al. Image segmentation based on adaptive K-means algorithm[J]. EURASIP Journal on Image and Video Processing, 2018,2018(1):68.
[18]	赵军, 曲仕茹 . 平面点集凸壳的快速算法[J]. 计算机工程与应用, 2009,45(1):56-58.
[18]	Zhao J, Qu S . Efficient convex hull algorithm for plane point set[J]. Computer Engineering and Applications, 2009,45(1):56-58.
[19]	周启海 . 论二维点集或线段集凸壳生成算法改进与优化的同构化方向[J]. 计算机科学, 2007,34(7):216-218, 247.
[19]	Zhou Q . On an isomorphic direction of improving and optimizing an algorithm for determining the convex hull of 2D point set or line segment set[J]. Computer Science, 2007,34(7):216-218, 247.
[20]	宋怀波, 张传栋, 潘景朋 , 等. 基于凸壳的重叠苹果目标分割与重建算法[J]. 农业工程学报, 2013,29(3):163-168.
[20]	Song H, Zhang C, Pan J , et al. Segmentation and reconstruction of overlapped apple images based on convex hull[J]. Transactions of the CSAE, 2013,29(3):163-168.