田间玉米苗期高通量动态监测方法

doi:10.12133/j.smartag.2021.3.2.202103-SA003

Smart Agriculture ›› 2021, Vol. 3 ›› Issue (2): 88-99.doi: 10.12133/j.smartag.2021.3.2.202103-SA003

田间玉米苗期高通量动态监测方法

张小青^1,^2,³(), 邵松^1,², 郭新宇^1,², 樊江川^1,²()

^1.北京农业信息技术研究中心，北京 100097
^2.国家农业信息化工程技术研究中心/数字植物北京市重点实验室，北京 100097
^3.上海海洋大学信息学院，上海 201306

收稿日期:2021-03-11 修回日期:2021-05-17 出版日期:2021-06-30
基金资助:
国家自然科学基金面上项目(31871519);现代农业产业技术体系专项资金资助(CARS-02);北京市农林科学院院改革与发展项目
作者简介:张小青（1995－），女，硕士研究生，研究方向为深度学习与图像处理。E-mail：15151935830@163.com。
通信作者: 樊江川（1988－），男，硕士，工程师，研究方向为植物表型组学、农业遥感。电话：13381125869。E-mail：fanjc@ nercita.org.cn

High-Throughput Dynamic Monitoring Method of Field Maize Seedling

ZHANG Xiaoqing^1,^2,³(), SHAO Song^1,², GUO Xinyu^1,², FAN Jiangchuan^1,²()

^1.Beijing Research Center for Information Technology in Agriculture, Beijing 100097, China
^2.Beijing Key Lab of Digital Plant, National Engineering Research Center for Information Technology in Agriculture, Beijing 100097, China
^3.College of Information Technology, Shanghai Ocean University, Shanghai 201306, China

Received:2021-03-11 Revised:2021-05-17 Online:2021-06-30
corresponding author: FAN Jiangchuan, E-mail：fanjc@ nercita.org.cn
About author:ZHANG Xiaoqing, E-mail：15151935830@163.com
Supported by:
National Natural Science Foundation of China(31871519);Special Fund Project for the Construction of Modern Agriculture Industry Technology System(CARS-02);Beijing Academy of Agriculture and Forestry Sciences Reform and Development Project

摘要/Abstract

摘要：

目前对玉米出苗动态检测监测主要是依靠人工观测，耗时耗力且只能选择小的样方估算整体出苗情况。为解决人工出苗动态管理不精准的问题，实现田间精细化管理，本研究以田间作物表型高通量采集平台获取的高时序可见光图像和无人机平台获取的可见光图像两种数据源构建了不同光照条件下的玉米出苗过程图像数据集。考虑到田间存在环境背景复杂、光照不均等因素，在传统Faster R-CNN的基础上构建残差单元，使用ResNet50作为新的特征提取网络来对Faster R-CNN进行优化，首先实现对复杂田间环境下玉米出苗识别和计数；进而基于表型平台所获取的高时序图像数据，对不同品种、不同密度的玉米植株进行出苗动态连续监测，对各玉米品种的出苗持续时间和出苗整齐度进行评价分析。试验结果表明，本研究提出的方法应用于田间作物高通量表型平台出苗检测时，晴天和阴天的识别精度分别为95.67%和91.36%；应用于无人机平台出苗检测时晴天和阴天的识别精度分别91.43%和89.77%，可以满足实际应用场景下玉米出苗自动检测的需求。利用表型平台可获取时序数据的优势，进一步进行了玉米动态出苗检测分析，结果表明利用本模型得到的动态出苗结果与人工实际观测具有一致性，说明本研究提出的模型的具有鲁棒性和泛化性。

关键词: 玉米苗期, Faster R-CNN, 识别, 计数, 出苗动态监测

Abstract:

At present, the dynamic detection and monitoring of maize seedling mainly rely on manual observation, which is time-consuming and laborious, and only small quadrats can be selected to estimate the overall emergence situation. In this research, two kinds of data sources, the high-time-series RGB images obtained by the plant high-throughput phenotypic platform (HTPP) and the RGB images obtained by the unmanned aerial vehicle (UAV) platform, were used to construct the image data set of maize seedling process under different light conditions. Considering the complex background and uneven illumination in the field environment, a residual unit based on the Faster R-CNN was built and ResNet50 was used as a new feature extraction network to optimize Faster R-CNN to realize the detection and counting of maize seedlings in complex field environment. Then, based on the high time series image data obtained by the HTPP, the dynamic continuous monitoring of maize seedlings of different varieties and densities was carried out, and the seedling duration and uniformity of each maize variety were evaluated and analyzed. The experimental results showed that the recognition accuracy of the proposed method was 95.67% in sunny days and 91.36% in cloudy days when it was applied to the phenotypic platform in the field. When applied to the UAV platform to monitor the emergence of maize, the recognition accuracy of sunny and cloudy days was 91.43% and 89.77% respectively. The detection accuracy of the phenotyping platform image was higher, which could meet the needs of automatic detection of maize emergence in actual application scenarios. In order to further verify the robustness and generalization of the model, HTPP was used to obtain time series data, and the dynamic emergence of maize was analyzed. The results showed that the dynamic emergence results obtained by HTPP were consistent with the manual observation results, which shows that the model proposed in this research is robust and generalizable.

Key words: field maize, Faster R-CNN, recognition, counting, dynamic seedling detection

中图分类号:

张小青, 邵松, 郭新宇, 樊江川. 田间玉米苗期高通量动态监测方法[J]. 智慧农业(中英文), 2021, 3(2): 88-99.

ZHANG Xiaoqing, SHAO Song, GUO Xinyu, FAN Jiangchuan. High-Throughput Dynamic Monitoring Method of Field Maize Seedling[J]. Smart Agriculture, 2021, 3(2): 88-99.

参考文献

1	JIM S. New systems enhance seed and product-placement at planting[J]. Cotton Grower, 2021, 57(1): 16-18.
2	WILES L J, SCHWEIZER E E. The cost of counting and identifying weed seeds and seedlings[J]. Weed Science, 1999, 47(6): 667-673.
3	ZHAO W, YAMADA W, Li T, et al. Augmenting crop detection for precision agriculture with deep visual transfer learning: A case study of bale detection[J]. Remote Sensing, 2021, 13: ID 23.
4	SAKO Y, MCDONALD M, FUJIMURA K, et al. A system for automated seed vigour assessment[J]. Seed Science and Technology, 2001, 29(3): 625-636.
5	HOFMASTER A, FUJIMURA K, MCDONALD M, et al. An automated system for vigor testing three-day-old soybean seedlings[J]. Seed Science and Technology, 2003, 31(3): 701-713.
6	MARCOS-FILHO J, BENNETT M, MCDONALD M, et al. Assessment of melon seed vigour by an automated computer imaging system compared to traditional procedures[J]. Seed Science and Technology, 2006, 34(2): 485-497.
7	FORCELLA F, ARNOLD R L B, SANCHEZ R, et al. Modeling seedling emergence[J]. Field Crops Research, 2000, 67(2): 123-139.
8	FENG A, ZHOU J, VORIES E, et al. Evaluation of cotton emergence using UAV-based narrow-band spectral imagery with customized image alignment and stitching algorithms[J]. Remote Sensing, 2020, 12(11): ID 1764.
9	GNADINGER F, SCHMIDHALTER U. Digital counts of maize plants by unmanned aerial vehicles (UAVs)[J]. Remote sensing, 2017, 9(6): ID 544.
10	REUZEAU C, FRANKARD V, HATZEELD Y, et al. Traitmill?: A functional genomics platform for the phenotypic analysis of cereals[J]. Plant Genetic Resources: Characterisation and Utilisation, 2006, 4: 20-24.
11	VIRLET N, SABERMANESH K, SADEGHI - TEHRAN P, et al. Field scanalyzer: An automated robotic field phenotyping platform for detailed crop monitoring[J]. Functional Plant Biology, 2017, 44(1): 143-153.
12	李寒冰. 基于深度学习的舆情监测系统[D]. 北京: 北京交通大学, 2019.
12	LI H. Public opinion monitoring system based on deep learning[D]. Beijing: Beijing Jiaotong University, 2019.
13	李卫. 深度学习在图像识别中的研究及应用[D]. 武汉: 武汉理工大学, 2014.
13	LI W. The research and application of deep learning in image recognition[D]. Wuhan: WuhanUniversity of Technology, 2014.
14	史璐璐. 深度学习及其在视频目标跟踪中的应用研究[D]. 南京: 南京邮电大学, 2019.
14	SHI L. Research on deep learning and its applications in video object tracking[D]. Nanjing: Nanjing University of Posts and Telecommunications, 2019.
15	GRINBLAT G L, UZAL L, GLARESE M. Deep learning for plant identification using vein morphological patterns[J]. Computers and Electronics in Agriculture, 2016, 127: 418-424.
16	杨建宇, 周振旭, 杜贞容, 等. 基于SegNet语义模型的高分辨率遥感影像农村建设用地提取[J]. 农业工程学报, 2019, 35(5): 251-258.
16	YANG J, ZHOU Z, DU Z, et al. Rural construction land extraction from high spatial resolution remote sensing image based on SegNet semantic segmentation model[J]. Transactions of the CSAE, 2019, 35(5): 251-258.
17	HUMPHREY E J, BELLO J P, LECUN Y. Moving beyond feature design: Deep architectures and automatic feature learning in music informatics[C]// The 13th International Society for Music Information Retrieval Conference. Piscataway, New York, USA: IEEE, 2012: 403-408.
18	NANNI L, GHIDONI S, BRAHNAM S. Handcrafted vs. non-handcrafted features for computer vision classification[J]. Pattern Recognition, 2017, 71: 158-172.
19	KRIZHEVSKY A. One weird trick for parallelizing convolutional neural networks[EB/OL]. 2014. .
20	SIMONYAN K, ZISSERMAN A. Very deep convolutional networks for large-scale image recognition[EB/OL]. 2014. arXiv:1409.1556 [cs.CV].
21	SZEGEDY C, LIU W, JIA Y, et al. Going deeper with convolutions[C]// The IEEE Conference on Computer Vision and Pattern Recognition. Piscataway, New York, USA: IEEE, 2015: 1-9.
22	HE K, ZHANG X, REN S, et al. Deep residual learning for image recognition[C]// The IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Washington, DC, USA: IEEE Computer Society, 2016: 770-778.
23	REDMON J, DIVVALA S, GIRSHICK R, et al. You only look once: Unified, real-time object detection[C]// The IEEE Computer Society Conference on Computer Vision and Pattern Recognition. Piscataway, New York, USA: IEEE, 2016: 779-788.
24	LIU W, ANGUELOV D, ERHAN D, et al. SSD: Single shot multibox detector[C]// European Conference on Computer Vision. Springer, Cham, Switzerland: 2016: 21-37.
25	REN S, HE K, GIRSHICK R, et al. Faster R-CNN: Towards real-time object detection with region proposal networks[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2016, 39(6): 1137-1149.
26	MADEC S, JIN X, LU H, et al. Ear density estimation from high resolution RGB imagery using deep learning technique[J]. Agricultural and Forest Meteorology, 2019, 264: 225-234.
27	ZOU H, LU H, LI Y, et al. Maize tassels detection: A benchmark of the state of the art[J]. Plant Methods, 2020, 16(1): 1-15.

[1]	李豪, 杜雨秋, 肖星竹, 陈彦羲. 基于深度学习的四川盆地丘陵区县域耕地遥感识别研究[J]. 智慧农业(中英文), 2024, 6(3): 34-45.
[2]	朱轶萍, 吴华瑞, 郭旺, 吴小燕. 基于改进UperNet的结球甘蓝叶球识别方法[J]. 智慧农业(中英文), 2024, 6(3): 128-137.
[3]	李强, 余秋丽, 李浩鹏, 徐春保, 丁幼春. 油菜播种机除尘式播量监测系统设计与试验[J]. 智慧农业(中英文), 2024, 6(3): 107-117.
[4]	王彤, 王春山, 李久熙, 朱华吉, 缪祎晟, 吴华瑞. 基于RoFormer预训练模型的指针网络农业病害命名实体识别[J]. 智慧农业(中英文), 2024, 6(2): 85-94.
[5]	李天俊, 杨信廷, 陈晓, 胡焕, 周子洁, 李文勇. 基于生成对抗网络和视觉-语义对齐的零样本害虫识别方法[J]. 智慧农业(中英文), 2024, 6(2): 72-84.
[6]	沈艳艳, 赵玉涛, 陈庚申, 吕振刚, 赵峰, 杨万能, 孟冉. 玉米典型叶部病害高光谱识别及其烈度分类[J]. 智慧农业(中英文), 2024, 6(2): 28-39.
[7]	张建华, 姚琼, 周国民, 吴雯迪, 修晓杰, 王健. 作物农艺性状与形态结构表型智能识别技术综述[J]. 智慧农业(中英文), 2024, 6(2): 14-27.
[8]	唐超礼, 李浩, 王儒敬, 王乐, 黄青, 王大朋, 张家宝, 陈翔宇. 非接触电导检测土壤养分离子的谱峰自动识别方法[J]. 智慧农业(中英文), 2024, 6(1): 36-45.
[9]	王婷, 王娜, 崔运鹏, 刘娟. 基于人工智能大模型技术的果蔬农技知识智能问答系统[J]. 智慧农业(中英文), 2023, 5(4): 105-116.
[10]	张淦, 严海峰, 胡根生, 张东彦, 程涛, 潘正高, 许海峰, 沈书豪, 朱科宇. 基于深度学习语义分割和迁移学习策略的麦田倒伏面积识别方法[J]. 智慧农业(中英文), 2023, 5(3): 75-85.
[11]	刘永波, 高文波, 何鹏, 唐江云, 胡亮. 基于改进ResNet50模型的自然环境下苹果物候期识别[J]. 智慧农业(中英文), 2023, 5(2): 13-22.
[12]	赵毓, 任艺平, 朴欣茹, 郑丹阳, 李东明. 基于改进ShuffleNet V2的轻量级防风药材道地性智能识别[J]. 智慧农业(中英文), 2023, 5(2): 104-114.
[13]	潘晨露, 张正华, 桂文豪, 马家俊, 严晨曦, 张晓敏. 融合ECA机制与DenseNet201的水稻病虫害识别方法[J]. 智慧农业(中英文), 2023, 5(2): 45-55.
[14]	李阳德, 马晓慧, 王骥. 基于轻量级MobileNet V3-YOLOv4的生长期菠萝成熟度分析[J]. 智慧农业(中英文), 2023, 5(2): 35-44.
[15]	王亚鹏, 曹姗姗, 李全胜, 孙伟. 融合迁移学习和集成学习的自然背景下荒漠植物识别方法[J]. 智慧农业(中英文), 2023, 5(2): 93-103.

田间玉米苗期高通量动态监测方法

High-Throughput Dynamic Monitoring Method of Field Maize Seedling

在线阅读

知网下载

本地下载

可视化

摘要/Abstract

引用本文

使用本文

参考文献

相关文章 15

编辑推荐

Metrics

本文评价