欢迎您访问《智慧农业(中英文)》官方网站! English

Smart Agriculture ›› 2023, Vol. 5 ›› Issue (3): 110-120.doi: 10.12133/j.smartag.SA202304006

• 专刊--作物信息监测技术 • 上一篇    下一篇

基于深度学习ImCascade R-CNN的小麦籽粒表形鉴定方法

泮玮婷(), 孙梦丽, 员琰, 刘平()   

  1. 山东农业大学 机械与电子工程学院/智能化农业机械与装备实验室,山东 泰安 271000
  • 收稿日期:2023-04-11 出版日期:2023-09-30
  • 基金资助:
    山东省重点研发计划项目(2022LZGCQY002); 山东省自然科学基金重点项目(ZR2020KF002)
  • 作者简介:
    泮玮婷,研究方向为农业信息化与智能检测技术。E-mail:
  • 通信作者:
    刘 平,博士,教授,研究方向为智能农机装备研发及作物表型解析技术。E-mail:

Identification Method of Wheat Grain Phenotype Based on Deep Learning of ImCascade R-CNN

PAN Weiting(), SUN Mengli, YUN Yan, LIU Ping()   

  1. College of Mechanical and Electronic Engineering/ Intelligent Agricultural Machinery and Equipment Laboratory, Shandong Agricultural University, Taian 271000, China
  • Received:2023-04-11 Online:2023-09-30
  • corresponding author: LIU  Ping, E-mail:
  • About author:PAN Weiting, E-mail:2021110438@sdau.edu.cn
  • Supported by:
    Shandong Provincial Key Research and Development Program(2022LZGCQY002); The Natural Science Foundation of Shandong Province(ZR2020KF002)

摘要:

[目的/意义] 培育优质高产的小麦品种是小麦育种的主要目标,而小麦籽粒完整性直接影响小麦育种进程。完整籽粒与破损籽粒的部分特征差异较小,是限制基于深度学习识别破损小麦籽粒精准度的关键因素。 [方法] 为解决小麦籽粒检测精度低的问题,本研究建立ImCascade R-CNN模型,提出小麦籽粒表形鉴定方法,精准检测小麦籽粒完整性、分割籽粒并获取完整籽粒表形参数。 [结果和讨论] ImCascade R-CNN模型检测小麦籽粒完整性的平均精度为90.2%,与Cascade Mask R-CNN、Deeplabv3+模型相比,能更好地识别、定位、分割小麦籽粒,为籽粒表形参数的获取提供基础。该方法测量粒长、粒宽的平均误差率分别为2.15%和3.74%,测量长宽比的标准误差为0.15,与人工测量值具有较高的一致性。 [结论] 研究结果可快速精准检测籽粒完整性、获取完整籽粒表形数据,加速培育优质高产小麦品种。

关键词: 小麦育种, ImCascade R-CNN模型, 籽粒完整性, 语义分割, 籽粒表形参数, 深度学习

Abstract:

[Objective] Wheat serves as the primary source of dietary carbohydrates for the human population, supplying 20% of the required caloric intake. Currently, the primary objective of wheat breeding is to develop wheat varieties that exhibit both high quality and high yield, ensuring an overall increase in wheat production. Additionally, the consideration of phenotype parameters, such as grain length and width, holds significant importance in the introduction, screening, and evaluation of germplasm resources. Notably, a noteworthy positive association has been observed between grain size, grain shape, and grain weight. Simultaneously, within the scope of wheat breeding, the occurrence of inadequate harvest and storage practices can readily result in damage to wheat grains, consequently leading to a direct reduction in both emergence rate and yield. In essence, the integrity of wheat grains directly influences the wheat breeding process. Nevertheless, distinguishing between intact and damaged grains remains challenging due to the minimal disparities in certain characteristics, thereby impeding the accurate identification of damaged wheat grains through manual means. Consequently, this study aims to address this issue by focusing on the detection of wheat kernel integrity and completing the attainment of grain phenotype parameters. [Methods] This study presented an enhanced approach for addressing the challenges of low detection accuracy, unclear segmentation of wheat grain contour, and missing detection. The proposed strategy involves utilizing the Cascade Mask R-CNN model and replacing the backbone network with ResNeXt to mitigate gradient dispersion and minimize the model's parameter count. Furthermore, the inclusion of Mish as an activation function enhanced the efficiency and versatility of the detection model. Additionally, a multilayer convolutional structure was introduced in the detector to thoroughly investigate the latent features of wheat grains. The Soft-NMS algorithm was employed to identify the candidate frame and achieve accurate segmentation of the wheat kernel adhesion region. Additionally, the ImCascade R-CNN model was developed. Simultaneously, to address the issue of low accuracy in obtaining grain contour parameters due to disordered grain arrangement, a grain contour-based algorithm for parameter acquisition was devised. Wheat grain could be approximated as an oval shape, and the grain edge contour could be obtained according to the mask, the distance between the farthest points could be iteratively obtained as the grain length, and the grain width could be obtained according to the area. Ultimately, a method for wheat kernel phenotype identification was put forth. The ImCascade R-CNN model was utilized to analyze wheat kernel images, extracting essential features and determining the integrity of the kernels through classification and boundary box regression branches. The mask generation branch was employed to generate a mask map for individual wheat grains, enabling segmentation of the grain contours. Subsequently, the number of grains in the image was determined, and the length and width parameters of the entire wheat grain were computed. [Results and Discussions] In the experiment on wheat kernel phenotype recognition, a comparison and improvement were conducted on the identification results of the Cascade Mask R-CNN model and the ImCascade R-CNN model across various modules. Additionally, the efficacy of the model modification scheme was verified. The comparison of results between the Cascade Mask R-CNN model and the ImCascade R-CNN model served to validate the proposed model's ability to significantly decrease the missed detection rate. The effectiveness and advantages of the ImCascade R-CNN model were verified by comparing its loss value, P-R value, and mAP_50 value with those of the Cascade Mask R-CNN model. In the context of wheat grain identification and segmentation, the detection results of the ImCascade R-CNN model were compared to those of the Cascade Mask R-CNN and Deeplabv3+ models. The comparison confirmed that the ImCascade R-CNN model exhibited superior performance in identifying and locating wheat grains, accurately segmenting wheat grain contours, and achieving an average accuracy of 90.2% in detecting wheat grain integrity. These findings serve as a foundation for obtaining kernel contour parameters. The grain length and grain width exhibited average error rates of 2.15% and 3.74%, respectively, while the standard error of the aspect ratio was 0.15. The statistical analysis and fitting of the grain length and width, as obtained through the proposed wheat grain shape identification method, yielded determination coefficients of 0.9351 and 0.8217, respectively. These coefficients demonstrated a strong agreement with the manually measured values, indicating that the method is capable of meeting the demands of wheat seed testing and providing precise data support for wheat breeding. [Conclusions] The findings of this study can be utilized for the rapid and precise detection of wheat grain integrity and the acquisition of comprehensive grain contour data. In contrast to current wheat kernel recognition technology, this research capitalizes on enhanced grain contour segmentation to furnish data support for the acquisition of wheat kernel contour parameters. Additionally, the refined contour parameter acquisition algorithm effectively mitigates the impact of disordered wheat kernel arrangement, resulting in more accurate parameter data compared to existing kernel appearance detectors available in the market, providing data support for wheat breeding and accelerating the cultivation of high-quality and high-yield wheat varieties.

Key words: wheat breeding, ImCascade R-CNN model, grain integrity, semantic segmentation, grain phenotype parameters, deep learning