田间玉米苗期高通量动态监测方法

doi:10.12133/j.smartag.2021.3.2.202103-SA003

Smart Agriculture ›› 2021, Vol. 3 ›› Issue (2): 88-99.doi: 10.12133/j.smartag.2021.3.2.202103-SA003

田间玉米苗期高通量动态监测方法

张小青^1,^2,³(), 邵松^1,², 郭新宇^1,², 樊江川^1,²()

^1.北京农业信息技术研究中心，北京 100097
^2.国家农业信息化工程技术研究中心/数字植物北京市重点实验室，北京 100097
^3.上海海洋大学信息学院，上海 201306

收稿日期:2021-03-11 修回日期:2021-05-17 出版日期:2021-06-30
基金资助:
国家自然科学基金面上项目(31871519);现代农业产业技术体系专项资金资助(CARS-02);北京市农林科学院院改革与发展项目
作者简介:张小青（1995－），女，硕士研究生，研究方向为深度学习与图像处理。E-mail：15151935830@163.com。
通信作者:

High-Throughput Dynamic Monitoring Method of Field Maize Seedling

ZHANG Xiaoqing^1,^2,³(), SHAO Song^1,², GUO Xinyu^1,², FAN Jiangchuan^1,²()

^1.Beijing Research Center for Information Technology in Agriculture, Beijing 100097, China
^2.Beijing Key Lab of Digital Plant, National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China
^3.College of Information Technology, Shanghai Ocean University, Shanghai 201306, China

Received:2021-03-11 Revised:2021-05-17 Online:2021-06-30

摘要/Abstract

摘要：

目前对玉米出苗动态检测监测主要是依靠人工观测，耗时耗力且只能选择小的样方估算整体出苗情况。为解决人工出苗动态管理不精准的问题，实现田间精细化管理，本研究以田间作物表型高通量采集平台获取的高时序可见光图像和无人机平台获取的可见光图像两种数据源构建了不同光照条件下的玉米出苗过程图像数据集。考虑到田间存在环境背景复杂、光照不均等因素，在传统Faster R-CNN的基础上构建残差单元，使用ResNet50作为新的特征提取网络来对Faster R-CNN进行优化，首先实现对复杂田间环境下玉米出苗识别和计数；进而基于表型平台所获取的高时序图像数据，对不同品种、不同密度的玉米植株进行出苗动态连续监测，对各玉米品种的出苗持续时间和出苗整齐度进行评价分析。试验结果表明，本研究提出的方法应用于田间作物高通量表型平台出苗检测时，晴天和阴天的识别精度分别为95.67%和91.36%；应用于无人机平台出苗检测时晴天和阴天的识别精度分别91.43%和89.77%，可以满足实际应用场景下玉米出苗自动检测的需求。利用表型平台可获取时序数据的优势，进一步进行了玉米动态出苗检测分析，结果表明利用本模型得到的动态出苗结果与人工实际观测具有一致性，说明本研究提出的模型的具有鲁棒性和泛化性。

关键词: 玉米苗期, Faster R-CNN, 识别, 计数, 出苗动态监测

Abstract:

At present, the dynamic detection and monitoring of maize seedling mainly rely on manual observation, which is time-consuming and laborious, and only small quadrats can be selected to estimate the overall emergence situation. In this research, two kinds of data sources, the high-time-series RGB images obtained by the plant high-throughput phenotypic platform (HTPP) and the RGB images obtained by the unmanned aerial vehicle (UAV) platform, were used to construct the image data set of maize seedling process under different light conditions. Considering the complex background and uneven illumination in the field environment, a residual unit based on the Faster R-CNN was built and ResNet50 was used as a new feature extraction network to optimize Faster R-CNN to realize the detection and counting of maize seedlings in complex field environment. Then, based on the high time series image data obtained by the HTPP, the dynamic continuous monitoring of maize seedlings of different varieties and densities was carried out, and the seedling duration and uniformity of each maize variety were evaluated and analyzed. The experimental results showed that the recognition accuracy of the proposed method was 95.67% in sunny days and 91.36% in cloudy days when it was applied to the phenotypic platform in the field. When applied to the UAV platform to monitor the emergence of maize, the recognition accuracy of sunny and cloudy days was 91.43% and 89.77% respectively. The detection accuracy of the phenotyping platform image was higher, which could meet the needs of automatic detection of maize emergence in actual application scenarios. In order to further verify the robustness and generalization of the model, HTPP was used to obtain time series data, and the dynamic emergence of maize was analyzed. The results showed that the dynamic emergence results obtained by HTPP were consistent with the manual observation results, which shows that the model proposed in this research is robust and generalizable.

Key words: field maize, Faster R-CNN, recognition, counting, dynamic seedling detection

中图分类号:

张小青, 邵松, 郭新宇, 樊江川. 田间玉米苗期高通量动态监测方法[J]. 智慧农业（中英文）, 2021, 3(2): 88-99.

ZHANG Xiaoqing, SHAO Song, GUO Xinyu, FAN Jiangchuan. High-Throughput Dynamic Monitoring Method of Field Maize Seedling[J]. Smart Agriculture, 2021, 3(2): 88-99.

参考文献

1	JIM S. New systems enhance seed and product-placement at planting[J]. Cotton Grower, 2021, 57(1): 16-18.
2	WILES L J, SCHWEIZER E E. The cost of counting and identifying weed seeds and seedlings[J]. Weed Science, 1999, 47(6): 667-673.
3	ZHAO W, YAMADA W, Li T, et al. Augmenting crop detection for precision agriculture with deep visual transfer learning: A case study of bale detection[J]. Remote Sensing, 2021, 13: ID 23.
4	SAKO Y, MCDONALD M, FUJIMURA K, et al. A system for automated seed vigour assessment[J]. Seed Science and Technology, 2001, 29(3): 625-636.
5	HOFMASTER A, FUJIMURA K, MCDONALD M, et al. An automated system for vigor testing three-day-old soybean seedlings[J]. Seed Science and Technology, 2003, 31(3): 701-713.
6	MARCOS-FILHO J, BENNETT M, MCDONALD M, et al. Assessment of melon seed vigour by an automated computer imaging system compared to traditional procedures[J]. Seed Science and Technology, 2006, 34(2): 485-497.
7	FORCELLA F, ARNOLD R L B, SANCHEZ R, et al. Modeling seedling emergence[J]. Field Crops Research, 2000, 67(2): 123-139.
8	FENG A, ZHOU J, VORIES E, et al. Evaluation of cotton emergence using UAV-based narrow-band spectral imagery with customized image alignment and stitching algorithms[J]. Remote Sensing, 2020, 12(11): ID 1764.
9	GNADINGER F, SCHMIDHALTER U. Digital counts of maize plants by unmanned aerial vehicles (UAVs)[J]. Remote sensing, 2017, 9(6): ID 544.
10	REUZEAU C, FRANKARD V, HATZEELD Y, et al. Traitmill?: A functional genomics platform for the phenotypic analysis of cereals[J]. Plant Genetic Resources: Characterisation and Utilisation, 2006, 4: 20-24.
11	VIRLET N, SABERMANESH K, SADEGHI - TEHRAN P, et al. Field scanalyzer: An automated robotic field phenotyping platform for detailed crop monitoring[J]. Functional Plant Biology, 2017, 44(1): 143-153.
12	李寒冰. 基于深度学习的舆情监测系统[D]. 北京: 北京交通大学, 2019.
12	LI H. Public opinion monitoring system based on deep learning[D]. Beijing: Beijing Jiaotong University, 2019.
13	李卫. 深度学习在图像识别中的研究及应用[D]. 武汉: 武汉理工大学, 2014.
13	LI W. The research and application of deep learning in image recognition[D]. Wuhan: WuhanUniversity of Technology, 2014.
14	史璐璐. 深度学习及其在视频目标跟踪中的应用研究[D]. 南京: 南京邮电大学, 2019.
14	SHI L. Research on deep learning and its applications in video object tracking[D]. Nanjing: Nanjing University of Posts and Telecommunications, 2019.
15	GRINBLAT G L, UZAL L, GLARESE M. Deep learning for plant identification using vein morphological patterns[J]. Computers and Electronics in Agriculture, 2016, 127: 418-424.
16	杨建宇, 周振旭, 杜贞容, 等. 基于SegNet语义模型的高分辨率遥感影像农村建设用地提取[J]. 农业工程学报, 2019, 35(5): 251-258.
16	YANG J, ZHOU Z, DU Z, et al. Rural construction land extraction from high spatial resolution remote sensing image based on SegNet semantic segmentation model[J]. Transactions of the CSAE, 2019, 35(5): 251-258.
17	HUMPHREY E J, BELLO J P, LECUN Y. Moving beyond feature design: Deep architectures and automatic feature learning in music informatics[C]// The 13th International Society for Music Information Retrieval Conference. Piscataway, New York, USA: IEEE, 2012: 403-408.
18	NANNI L, GHIDONI S, BRAHNAM S. Handcrafted vs. non-handcrafted features for computer vision classification[J]. Pattern Recognition, 2017, 71: 158-172.
19	KRIZHEVSKY A. One weird trick for parallelizing convolutional neural networks[EB/OL]. 2014. .
20	SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[EB/OL]. 2014. arXiv:1409.1556 [cs.CV].
21	SZEGEDY C, LIU W, JIA Y, et al. Going deeper with convolutions[C]// The IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, New York, USA: IEEE, 2015: 1-9.
22	HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]// The IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, DC, USA: IEEE Computer Society, 2016: 770-778.
23	REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once: Unified, real-time object detection[C]// The IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Piscataway, New York, USA: IEEE, 2016: 779-788.
24	LIU W, ANGUELOV D, ERHAN D, et al. SSD: Single shot multibox detector[C]// European Conference on Computer Vision. Springer, Cham, Switzerland: 2016: 21-37.
25	REN S, HE K, GIRSHICK R, et al. Faster R-CNN: Towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 39(6): 1137-1149.
26	MADEC S, JIN X, LU H, et al. Ear density estimation from high resolution RGB imagery using deep learning technique[J]. Agricultural and Forest Meteorology, 2019, 264: 225-234.
27	ZOU H, LU H, LI Y, et al. Maize tassels detection: A benchmark of the state of the art[J]. Plant Methods, 2020, 16(1): 1-15.

[1]	刘永波, 高文波, 何鹏, 唐江云, 胡亮. 基于改进ResNet50模型的自然环境下苹果物候期识别[J]. 智慧农业(中英文), 2023, 5(2): 13-22.
[2]	赵毓, 任艺平, 朴欣茹, 郑丹阳, 李东明. 基于改进ShuffleNet V2的轻量级防风药材道地性智能识别[J]. 智慧农业(中英文), 2023, 5(2): 104-114.
[3]	潘晨露, 张正华, 桂文豪, 马家俊, 严晨曦, 张晓敏. 融合ECA机制与DenseNet201的水稻病虫害识别方法[J]. 智慧农业(中英文), 2023, 5(2): 45-55.
[4]	李阳德, 马晓慧, 王骥. 基于轻量级MobileNet V3-YOLOv4的生长期菠萝成熟度分析[J]. 智慧农业(中英文), 2023, 5(2): 35-44.
[5]	王亚鹏, 曹姗姗, 李全胜, 孙伟. 融合迁移学习和集成学习的自然背景下荒漠植物识别方法[J]. 智慧农业(中英文), 2023, 5(2): 93-103.
[6]	郭阳阳, 杜书增, 乔永亮, 梁栋. 深度学习在家畜智慧养殖中研究应用进展[J]. 智慧农业(中英文), 2023, 5(1): 52-65.
[7]	张文景, 蒋泽中, 秦立峰. 基于弱监督下改进的CBAM-ResNet18模型识别苹果多种叶部病害[J]. 智慧农业(中英文), 2023, 5(1): 111-121.
[8]	计洁, 金洲, 王儒敬, 刘海燕, 李志远. 基于递进式卷积网络的农业命名实体识别方法[J]. 智慧农业(中英文), 2023, 5(1): 122-131.
[9]	刘晓航, 张昭, 刘嘉滢, 张漫, 李寒, FLORES Paulo, 韩雄哲. 基于多种深度学习算法的田间玉米籽粒检测与计数[J]. 智慧农业(中英文), 2022, 4(4): 49-60.
[10]	夏烨, 雷哓晖, 祁雁楠, 徐陶, 袁全春, 潘健, 姜赛珂, 吕晓兰. 基于改进Ghost-YOLOv5s-BiFPN算法检测梨树花序[J]. 智慧农业(中英文), 2022, 4(3): 108-119.
[11]	纪楠, 尹艳玲, 沈维政, 寇胜利, 戴百生, 王国维. 叫声在生猪福利监测中的研究进展与挑战[J]. 智慧农业(中英文), 2022, 4(2): 19-35.
[12]	黄梓宸, SUGIYAMA Saki. 日本设施农业采收机器人研究应用进展及对中国的启示[J]. 智慧农业(中英文), 2022, 4(2): 135-149.
[13]	陈占琦, 张玉安, 王文志, 李丹, 何杰, 宋仁德. 基于迁移学习的多尺度特征融合牦牛脸部识别算法[J]. 智慧农业(中英文), 2022, 4(2): 77-85.
[14]	张燕燕, 李灿, 苏睿, 李林泽, 位文涛, 李保磊, 胡建东. 利用表面增强拉曼光谱定量检测植物激素脱落酸[J]. 智慧农业(中英文), 2022, 4(1): 121-129.
[15]	邵明月, 张建华, 冯全, 柴秀娟, 张凝, 张文蓉. 深度学习在植物叶部病害检测与识别的研究进展[J]. 智慧农业(中英文), 2022, 4(1): 29-46.

田间玉米苗期高通量动态监测方法

High-Throughput Dynamic Monitoring Method of Field Maize Seedling

在线阅读

知网下载

本地下载

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价