改进YOLOv4的温室环境下草莓生育期识别方法

doi:10.12133/j.smartag.2021.3.4.202109-SA006

摘要/Abstract

摘要：

针对目前设施农业数字化栽培调控技术中对作物的生育期实时检测与分类问题，提出一种改进YOLOv4的温室环境下草莓生育期识别方法。该方法将注意力机制引入到YOLOv4主干网络的跨阶段局部残差模块（Cross Stage Partial Residual，CSPRes）中，融合草莓不同生长时期的目标特征信息，同时降低复杂背景的干扰，提高模型检测精度的同时保证实时检测效率。以云南地区的智能设施草莓为试验对象，结果表明，本研究提出的YOLOv4-CBAM（YOLOv4-Convolutional Block Attention Module）模型对开花期、果实膨大期、绿果期和成熟期草莓的检测平均精度（Average Precision，AP）分别为92.38%、82.45%、68.01%和92.31%，平均精度均值（Mean Average Precision，mAP）为83.79%，平均交并比（Mean Inetersection over Union，mIoU）为77.88%，检测单张图像时间为26.13 ms。YOLOv4-CBAM模型检测草莓生育期的mAP相比YOLOv4、YOLOv4-SE、YOLOv4-SC模型分别提高8.7%、4.82%和1.63%。该方法可对草莓各生育期目标进行精准识别和分类，并为设施草莓栽培的信息化、规模化调控提供有效的理论依据。

关键词: 目标检测, 草莓, 生育期识别, YOLOv4, 残差模块, 注意力机制, 损失函数

Abstract:

Aiming at the real-time detection and classification of the growth period of crops in the current digital cultivation and regulation technology of facility agriculture, an improved YOLOv4 method for identifying the growth period of strawberries in a greenhouse environment was proposed. The attention mechanism into the Cross Stage Partial Residual (CSPRes) module of the YOLOv4 backbone network was introduced, and the target feature information of different growth periods of strawberries while reducing the interference of complex backgrounds was integrated, the detection accuracy while ensured real-time detection efficiency was improved. Took the smart facility strawberry in Yunnan province as the test object, the results showed that the detection accuracy (AP) of the YOLOv4-CBAM model during flowering, fruit expansion, green and mature period were 92.38%, 82.45%, 68.01% and 92.31%, respectively, the mean average precision (mAP) was 83.78%, the mean inetersection over union (mIoU) was 77.88%, and the detection time for a single image was 26.13 ms. Compared with the YOLOv4-SC model, mAP and mIoU were increased by 1.62% and 2.73%, respectively. Compared with the YOLOv4-SE model, mAP and mIOU increased by 4.81% and 3.46%, respectively. Compared with the YOLOv4 model, mAP and mIOU increased by 8.69% and 5.53%, respectively. As the attention mechanism was added to the improved YOLOv4 model, the amount of parameters increased, but the detection time of improved YOLOv4 models only slightly increased. At the same time, the number of fruit expansion period recognized by YOLOv4 was less than that of YOLOv4-CBAM, YOLOv4-SC and YOLOv4-SE, because the color characteristics of fruit expansion period were similar to those of leaf background, which made YOLOv4 recognition susceptible to leaf background interference, and added attention mechanism could reduce background information interference. YOLOv4-CBAM had higher confidence and number of identifications in identifying strawberry growth stages than YOLOv4-SC, YOLOv4-SE and YOLOv4 models, indicated that YOLOv4-CBAM model can extract more comprehensive and rich features and focus more on identifying targets, thereby improved detection accuracy. YOLOv4-CBAM model can meet the demand for real-time detection of strawberry growth period status.

Key words: object detection, strawberry, growth period recognition, YOLOv4, residual module, attention mechanism, loss function

中图分类号:

S126

龙洁花, 郭文忠, 林森, 文朝武, 张宇, 赵春江. 改进YOLOv4的温室环境下草莓生育期识别方法[J]. 智慧农业(中英文), 2021, 3(4): 99-110.

LONG Jiehua, GUO Wenzhong, LIN Sen, WEN Chaowu, ZHANG Yu, ZHAO Chunjiang. Strawberry Growth Period Recognition Method Under Greenhouse Environment Based on Improved YOLOv4[J]. Smart Agriculture, 2021, 3(4): 99-110.

参考文献

1	张更, 颜志明, 王全智, 等. 我国设施草莓无土栽培技术的研究进展与发展建议[J]. 江苏农业科学, 2019, 47(18): 58-61.
1	ZHANG G, YAN Z, WANG Q, et al. Research progress and development suggestions of soilless culture techniques of China's facility strawberry[J]. Jiangsu Agricultural Sciences, 2019, 47(18): 58-61.
2	林森, 郭文忠, 郑建锋, 等. 基于知识图谱和机器视觉的智慧草莓生产托管服务系统实践[J]. 农业工程技术, 2021, 41(4): 17-20.
2	LIN S, GUO W, ZHENG J, et al. Practice of smart strawberry production hosting service system based on knowledge graph and machine vision[J]. Agricultural Engineering Technology, 2021, 41(4): 17-20.
3	徐建鹏, 王杰, 徐祥, 等. 基于 RAdam 卷积神经网络的水稻生育期图像识别[J]. 农业工程学报, 2021, 37(8): 143-150.
3	XU J, WANG J, XU X, et al. Image recognition for different developmental stages of rice by RAdam deep convolutional neural networks[J]. Transactions of the CSAE, 2021, 37(8): 143-150.
4	CHEN W, LU S, LIU B, et al. Detecting citrus in orchard environment by using improved YOLOv4[J]. Scientific Programming, 2020(1): 1-13.
5	PéREZ-BORRERO I,MARíN-SANTOS D, GEGúNDE-ARIAS M E, et al. A fast and accurate deep learning method for strawberry instance segmentation[J]. Computers and Electronics in Agriculture, 2020, 178(6): 105736-105748.
6	刘芳, 刘玉坤, 林森, 等. 基于改进型YOLO的复杂环境下番茄果实快速识别方法[J]. 农业机械学报, 2020, 51(6): 229-237.
6	LIU F, LIU Y, LIN S, et al. Fast recognition method for tomatoes under complex environments based on improved YOLO[J]. Transactions of the CSAM, 2020, 51(6): 229-237.
7	LIN P, CHEN Y. Detection of strawberry flowers in outdoor field by deep neural network[C]// 2018 IEEE 3rd International Conference on Image, Vision and Computing (ICIVC). Piscataway, New York, USA: IEEE, 2018: 482-486.
8	YU Y, ZHANG K, YANG L, et al. Fruit detection for strawberry harvesting robot in non-structural environment based on Mask-RCNN[J]. Computers and Electronics in Agriculture, 2019(163): 104846-104855.
9	李志军, 杨圣慧, 史德帅, 等. 基于轻量化改进YOLOv5的苹果树产量测定方法[J]. 智慧农业, 2021, 3(2): 100-114.
9	LI Z, YANG S, SHI D, et al. Yield estimation method of apple tree based on improved lightweight YOLOv5[J]. Smart Agriculture, 2021, 3(2): 100-114.
10	刘小刚, 范诚, 李加念, 等. 基于卷积神经网络的草莓识别方法[J]. 农业机械学报, 2020, 51(2): 237-244.
10	LIU X, FANG C, LI J, et al. Identification method of strawberry based on convolutional neural network[J]. Transactions of the CSAM, 2020, 51(2): 237-244.
11	赵春江, 文朝武, 林森, 等. 基于级联卷积神经网络的番茄花期识别检测方法[J]. 农业工程学报, 2020, 36(24): 143-152.
11	ZHAO C, WEN C, LIN S, et al. Tomato florescence recognition and detection method based on cascaded neural network[J]. Transactions of the CSAE, 2020, 36(24): 143-152.
12	刘天真, 滕桂法, 苑迎春, 等. 基于改进YOLOv3的自然场景下冬枣果实识别方法[J]. 农业机械学报, 2021, 52(5): 17-25.
12	LIU T, TENG G, YUAN Y, et al. Winter jujube fruit recognition method based on improved YOLOv3 under natural scene[J]. Transactions of the CSAM, 2021, 52(5): 17-25.
13	刘立波, 程晓龙, 赖军臣. 基于改进全卷积网络的棉田冠层图像分割方法[J]. 农业工程学报, 2018, 34(12): 193-201.
13	LIU L, CHENG X, LAI J, et al. Segmentation method for cotton canopy image based on improved fully convolutional network model[J]. Transactions of the CSAE, 2018, 34(12): 193-201.
14	朱逢乐, 郑增威. 基于图像和卷积神经网络的蝴蝶兰种苗生长势评估[J]. 农业工程学报, 2020, 36(9): 185-194.
14	ZHU F, ZHENG Z. Image-based assessment of growth vigor for Phalaenopsis aphrodite seedlings using convolutional neural network[J]. Transactions of the CSAE, 2020, 36(9): 185-194.
15	CHAUDHARI S, MITHAL V, POLATKAN G, et al. An attentive survey of attention models[J/OL]. arXiv: 1904.02874v
15	3[cs.Lg]. 2021.
16	徐诚极, 王晓峰, 杨亚东. Attention-YOLO: 引入注意力机制的YOLO检测算法[J]. 计算机工程与应用, 2019, 55(6): 13-23.
16	XU C, WANG X, YANG Y. Attention-YOLO: YOLO detection algorithm that introduces attention mechanism[J]. Computer Engineering and Applications, 2019, 55(6): 13-23.
17	HU J, SHEN L, SUN G, et al. Squeeze-and-excitation networks[C]// The IEEE conference on computer vision and pattern recognition. Piscataway, New York, USA: IEEE, 2018: 2011-2023.
18	汶茂宁. 基于轮廓波CNN和选择性注意机制的高分辨SAR目标检测和分类[D]. 西安: 西安电子科技大学, 2018.
18	WEN M. Target detection and classification for high-resolution SAR image based on contourlet CNN and selective attention mechanism[D]. Xi'an: Xidian University, 2018.
19	WOO S, PARK J, LEE J-Y, et al. CBAM: Convolutional block attention module[C]// The European Conference on Computer Vision(ECCV). Berlin, German: Springer, 2018: 3-19.
20	BOCHKOVSKIY A, WANG C, LIAO H M. YOLOv4: Optimal speed and accuracy of object detection[J/OL]. arXiv:2004.
20	10934 [cs.CV]. 2020.
21	REDMON J, FARHAD A. YOLOv3: An incremental improvement[J/OL]. arXiv:1804.
21	02767 [cs.CV]. 2018.
22	蒋镕圻, 彭月平, 谢文宣, 等. 嵌入scSE模块的改进YOLOv4小目标检测算法[J]. 图学学报, 2021, 42(4): 546-555.
22	JIANG R, PENG Y, XIE W, et al. Improved YOLOv4 small target detection algorithm with embedded scSE module[J]. Journal of Graphics, 2021, 42(4): 546-555.
23	李文涛, 张岩, 莫锦秋, 等. 基于改进YOLOv3-tiny的田间行人与农机障碍物检测[J]. 农业机械学报, 2020, 51(S1):8-15, 40.
23	LI W, ZHANG Y, MO J, et al. Detection of pedestrian and agricultural vehicles in field based on improved YOLOv3 tiny[J]. Transactions of the CSAM, 2020, 51(S1): 8-15, 40.
24	WANG C, LIAO H M, WU Y, et al. CSPNet: A new backbone that can enhance learning capability of CNN[C]// 2020 IEEE/CVF Conference on Computer Vision and Pattern Recognition Workshops. Piscataway, New York, USA: IEEE, 2020: 1571-1580.
25	温长吉, 娄月, 张笑然, 等. 基于改进稠密胶囊网络模型的植物识别方法[J]. 农业工程学报, 2020, 36(8): 143-155.
25	WEN C, LOU Y, ZHANG X, et al. Plant recognition method based on an improved dense CapsNet[J]. Transactions of the CSAE, 2020, 36(8): 143-155.
26	HE K, ZHANG X, REN S, et al. Deep residual Learning for image recognition[C]// The IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, New York, USA: IEEE, 2016: 770-778.
27	HE K, ZHANG X, REN S, et al. Spatial pyramid pooling in deep convolutional networks for visual recognition[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2014, 37(9): 1904-1916.
28	LIU S, QI L, QIN H, et al. Path aggregation network for instance segmentation[C]// 2018 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). Piscataway, New York, USA: IEEE, 2018: 8759-8768.

[1]	赵毓, 任艺平, 朴欣茹, 郑丹阳, 李东明. 基于改进ShuffleNet V2的轻量级防风药材道地性智能识别[J]. 智慧农业(中英文), 2023, 5(2): 104-114.
[2]	潘晨露, 张正华, 桂文豪, 马家俊, 严晨曦, 张晓敏. 融合ECA机制与DenseNet201的水稻病虫害识别方法[J]. 智慧农业(中英文), 2023, 5(2): 45-55.
[3]	李阳德, 马晓慧, 王骥. 基于轻量级MobileNet V3-YOLOv4的生长期菠萝成熟度分析[J]. 智慧农业(中英文), 2023, 5(2): 35-44.
[4]	朱海鹏, 张玉安, 李欢欢, 王建文, 杨英魁, 宋仁德. 基于改进残差网络模型的不同部位牦牛肉分类识别方法[J]. 智慧农业(中英文), 2023, 5(2): 115-125.
[5]	张文景, 蒋泽中, 秦立峰. 基于弱监督下改进的CBAM-ResNet18模型识别苹果多种叶部病害[J]. 智慧农业(中英文), 2023, 5(1): 111-121.
[6]	王辉, 陈睿鹏, 余志雪, 贺越, 张帆, 熊本海. 基于卟啉和半导体单壁碳纳米管的场效应气体传感器检测草莓恶疫霉[J]. 智慧农业(中英文), 2022, 4(3): 143-151.
[7]	商枫楠, 周学成, 梁英凯, 肖明玮, 陈桥, 罗陈迪. 基于改进YOLOX的自然环境中火龙果检测方法[J]. 智慧农业(中英文), 2022, 4(3): 120-131.
[8]	耿闻轩, 赵俊晔, 阮继伟, 侯跃辉. 人工智能辅助种植策略对温室草莓生产调控效果对比研究[J]. 智慧农业(中英文), 2022, 4(2): 183-193.
[9]	郭秀明, 诸叶平, 李世娟, 张杰, 吕纯阳, 刘升平. 农业复杂环境下尺度自适应小目标识别算法——以蜜蜂为研究对象[J]. 智慧农业(中英文), 2022, 4(1): 140-149.
[10]	张宇, 赵春江, 林森, 郭文忠, 文朝武, 龙洁花. 基于Penman-Monteith模型和路径排序算法相结合的草莓灌溉方法与验证[J]. 智慧农业(中英文), 2021, 3(3): 116-128.
[11]	郝王丽, 尉培岩, 郝飞, 韩猛, 韩冀皖, 孙玮蓉, 李富忠. 基于YOLOv4和自适应锚框调整的谷穗检测方法[J]. 智慧农业(中英文), 2021, 3(1): 63-74.
[12]	朱南阳, 吴昊, 尹达恒, 王志强, 蒋永年, 郭亚. 基于长短时记忆网络（LSTM）的蟹塘溶解氧估算优化方法[J]. 智慧农业, 2019, 1(3): 67-76.