Method for identifying crop disease based on CNN and transfer learning

doi:10.12133/j.smartag.2019.1.3.201903-SA005

Abstract

Abstract:

The internet is a huge resource base and a rich knowledge base. Aiming at the problem of small agricultural samples, the utilization technology of network resources was studied in the research, which would provide an idea and method for the research and application of crop disease identification and diagnosis. The knowledge transfer and deep learning methods to carry out research and experiments on public data sets (ImageNet, PlantVillage) and laboratory small sample disease data (AES-IMAGE) were introduced: first the batch normalization algorithm was applied to the AlexNet and VGG of Convolutional Neural Network (CNN) models to improve the over-fitting problem of the network; second the transfer learning strategy using parameter fine-tuning: The PlantVillage large-scale plant disease dataset was used to obtain the pre-trained model. On the improved network (AlexNet, VGG model), the pre-trained model was adjusted by our small sample dataset AES-IMAGE to obtain the disease identification model of cucumber and rice; third the transfer learning strategy was used for the bottleneck feature extraction: using the ImageNet big dataset to obtain the network parameters, CNN model (Inception-v3 and Mobilenet) was used as feature extractor to extract disease features. This method requires only a quick identification of the disease on the CPU and does not require a lot of training time, which can quickly complete the process of disease identification on the CPU. The experimental results show that: first in the transfer learning strategy of parameter fine-tuning: the highest accuracy rate was 98.33%, by using the VGG network parameter fine-tuning strategy; second in the transfer learning strategy of bottleneck feature extraction, using the Mobilenet model for bottleneck layer feature extraction and identification could obtain 96.8% validation accuracy. The results indicate that the combination of CNN and transfer learning is effective for the identification of small sample crop diseases.

Key words: CNN, crop diseases, overfitting, transfer learning, parameter fine-tuning, feature extractor

CLC Number:

Li Miao, Wang Jingxian, Li Hualong, Hu Zelin, Yang XuanJiang, Huang Xiaoping, Zeng Weihui, Zhang Jian, Fang Sisi. Method for identifying crop disease based on CNN and transfer learning[J]. Smart Agriculture, 2019, 1(3): 46-55.

References

[1]	Mutka A M, Bart R S . Image-based phenotyping of plant disease symptom[J]. Frontiers in Plant Science, 2015, 5, article no. 734.
[2]	Pydipati R, Burks T F, Lee W S . Identification of citrus disease using color texture features and discriminant analysis[J]. Computers and Electronics in Agriculture, 2006, ( 52):49-59.
[3]	Lee W S, Burks T F, Pydipati R . Statistical and neural network classifiers for citrus disease detection using machine vision[J]. Transactions of the ASAE, 2005,48(48):2007-2010.
[4]	Krizhevsky A, Sutskever I, Hinton G E. ImageNet classification with deep convolutional neural networks [C]. International Conference on Neural Information Processing Systems. Curran Associates Inc. 2012: 1097-1105.
[5]	Brahimi M, Boukhalfa K, Moussaoui A . Deep learning for tomato diseases: classification and symptoms visualization[J]. Applied Artificial Intelligence, 2017: 1-17.
[6]	Mohanty S P, Hughes D P, Salathé Marcel . Using deep learning for image-based plant disease detection[J]. Frontiers in Plant Science, 2016,7:1-10.
[7]	Lee H, Eum S, Kwon H . Cross-domain CNN for hyperspectral image classification[J]. arXiv:1802.00093v2 [cs.CV] 2 May 2018.
[8]	Lee H, Kwon H . Going deeper with contextual CNN for hyperspectral image classification[J]. IEEE Trans Image Process, 2017,26(10):4843.
[9]	Khamparia A, Saini G, Gupta D, et al. Seasonal crops disease prediction and classification using deep convolutional encoder network[J]. Circuits Systems and Signal Processing , 2019(May).
[10]	Sun X, Mu S, Xu Y , et al. Image recognition of tea leaf diseases based on convolutional neural network[J]. 2019: arXiv: 1901. 02694.
[11]	Pan S J, Yang Q . A survey on transfer learning[J]. IEEE Transactions on Knowledge & Data Engineering, 2010,22(10):1345-1359.
[12]	Sladojevic S, Arsenovic M, Anderla A , et al. Deep neural networks based recognition of plant diseases by leaf image classification[J]. Computational Intelligence and Neuroscience, 2016, ( 6):1-11.
[13]	Srdjan S, Marko A, Andras A , et al. Deep neural networks based recognition of plant diseases by leaf image classification[J]. Computational Intelligence and Neuroscience, 2016,2016:1-11.
[14]	Torrey L, Shavlik J , Transfer learning[M]. Machine Learning Applications and Trends, 2009, 242-264. http://dx.doi.org/10.4018/978-1-60566-766-9.ch011.
[15]	Ioffe S, Szegedy C. Batch normalization: accelerating deep network training by reducing internal covariate shift [C]. International Conference on International Conference on Machine Learning. JMLR.org, 2015: 448-456.
[16]	Lecun Y, Boser B, Denker J S , et al. Backpropagation applied to handwritten zip code recognition[J]. Neural Computation, 1989,1(4):541-551.
[17]	Simonyan K, Zisserman A . Very deep convolutional networks for large-scale image recognition[J/OL]. ( 2015 -4-10)[2019-3-29]. https://arxiv.org/abs/1409.1556, 2014.
[18]	Deng J, Dong W, Socher R, et al. Imagenet: A large-scale hierarchical image database [C]. 2009 IEEE Computer Society Conference on Computer Vision and Pattern Recognition(CVPR), 2009: 248-255.
[19]	Szegedy C, Vanhoucke V, Ioffe S, et al. Rethinking the inception architecture for computer vision [C]. Computer Vision and Pattern Recognition. IEEE, 2016: 2818-2826.
[20]	Howard A G, Zhu M, Chen B , et al. MobileNets: Efficient convolutional neural networks for mobile vision applications[J]. 2017: arXiv:1704. 04861v1 [cs.CV], 2818-2826.