Development of a deep-learning based system for disease symptoms detection over crop leaves images

Detalhes bibliográficos
Ano de defesa: 2021
Autor(a) principal: BARROS, Mariana da Silva
Orientador(a): BLAWID, Stefan Michael
Banca de defesa: Não Informado pela instituição
Tipo de documento: Dissertação
Tipo de acesso: Acesso aberto
Idioma: eng
Instituição de defesa: Universidade Federal de Pernambuco
Programa de Pós-Graduação: Programa de Pos Graduacao em Ciencia da Computacao
Departamento: Não Informado pela instituição
País: Brasil
Palavras-chave em Português:
CNN
Link de acesso: https://repositorio.ufpe.br/handle/123456789/44958
Resumo: Family farming represents a critical segment of Brazilian agriculture, involving more than 5 million properties and generating 74% of rural jobs in the country. Yield losses caused by crop diseases and pests can be devastating for small-scale producers. However, successful disease control requires correct identification, which challenges smallholders, who often lack technical assistance. The present work proposes a system that alerts smallholder farmers and phytopathology experts about possible crop disease outbreaks, enabling a faster diagnosis and intervention. To this extent, we detect disease symptoms in images of plant leaves taken by farmers directly in the field using a mobile phone app developed for this purpose. The implemented module is part of a service platform connecting producers and experts, designed in partnership with phytopathology professionals from the Federal Rural University of Pernambuco (UFRPE). The work uses deep learning and Convolutional Neural Networks to perform the image classification. The classification experiments were applied over a dataset composed of leaf images of grape crops cultivated in the state of Pernambuco, whose image collection was also part of the present work. Therefore, pictures taken under field conditions sometimes present low quality, which decreases the classification performance. Thus, we also classify the images regarding their quality, to exclude challenging images from disease detection and reduce the number of erroneously classified images entering the database. The multi-label technique is employed in this scenario, enabling a single neural network model to classify whether a leaf picture reveals crop disease symptoms and whether they present good enough quality to do so reliably. The multi-label mechanism is also a promising approach to include additional picture properties in the future, like disease agents. The developed classification system achieves a recall value of 97.6% for symptom detection and a precision value of 94.8% for image quality classification.
id UFPE_6b6e101deecca1cd9e50ee1718a6f769
oai_identifier_str oai:repositorio.ufpe.br:123456789/44958
network_acronym_str UFPE
network_name_str Repositório Institucional da UFPE
repository_id_str
spelling BARROS, Mariana da Silvahttp://lattes.cnpq.br/0171498393282139http://lattes.cnpq.br/3740757562716147BLAWID, Stefan Michael2022-07-04T16:33:07Z2022-07-04T16:33:07Z2021-12-22BARROS, Mariana da Silva. Development of a deep-learning based system for disease symptoms detection over crop leaves images. 2021. Dissertação (Mestrado em Ciência da Computação) - Universidade Federal de Pernambuco, Recife, 2021.https://repositorio.ufpe.br/handle/123456789/44958Family farming represents a critical segment of Brazilian agriculture, involving more than 5 million properties and generating 74% of rural jobs in the country. Yield losses caused by crop diseases and pests can be devastating for small-scale producers. However, successful disease control requires correct identification, which challenges smallholders, who often lack technical assistance. The present work proposes a system that alerts smallholder farmers and phytopathology experts about possible crop disease outbreaks, enabling a faster diagnosis and intervention. To this extent, we detect disease symptoms in images of plant leaves taken by farmers directly in the field using a mobile phone app developed for this purpose. The implemented module is part of a service platform connecting producers and experts, designed in partnership with phytopathology professionals from the Federal Rural University of Pernambuco (UFRPE). The work uses deep learning and Convolutional Neural Networks to perform the image classification. The classification experiments were applied over a dataset composed of leaf images of grape crops cultivated in the state of Pernambuco, whose image collection was also part of the present work. Therefore, pictures taken under field conditions sometimes present low quality, which decreases the classification performance. Thus, we also classify the images regarding their quality, to exclude challenging images from disease detection and reduce the number of erroneously classified images entering the database. The multi-label technique is employed in this scenario, enabling a single neural network model to classify whether a leaf picture reveals crop disease symptoms and whether they present good enough quality to do so reliably. The multi-label mechanism is also a promising approach to include additional picture properties in the future, like disease agents. The developed classification system achieves a recall value of 97.6% for symptom detection and a precision value of 94.8% for image quality classification.CAPESAgricultura familiar representa um segmento crítico da agricultura brasileira, envolvendo mais de 5 milhões de propriedades e gerando 74% dos empregos rurais no país. As perdas de rendimento causadas por pragas e doenças na colheita podem ser devastadoras para os pe- quenos produtores. No entanto, o controle de doenças bem-sucedido requer uma classificação correta, o que desafia os pequenos proprietários, que muitas vezes carecem de assistência téc- nica. O presente trabalho propõe um sistema que alerta pequenos produtores e especialistas em fitopatologia sobre possíveis surtos de doenças em plantas, permitindo um diagnóstico e inter- venção mais rápidos. Nesse sentido, nós detectamos sintomas de doenças em imagens de folhas de plantas tiradas diretamente por agricultores no campo usando um aplicativo de celular de- senvolvido com esse propósito. O módulo implementado é parte de uma plataforma de serviços que conecta produtores e especialistas, projetado em parceria com profissionais de fitopato- logia da Universidade Federal Rural de Pernambuco (UFRPE). O trabalho usa aprendizagem profunda (“deep learning”) e redes neurais convolucionais (CNNs) para realizar a classificação das imagens. Os experimentos de classificação foram aplicados sobre um conjunto de dados composto por imagens de folhas de videira cultivadas no estado de Pernambuco, cuja coleta também foi parte do presente trabalho. Portanto, algumas imagens coletadas sob as condições do campo apresentam baixa qualidade, o que diminui o desempenho da classificação. Assim, nós também classificamos as imagens com relação à sua qualidade, para excluir imagens de- safiadoras da detecção de doenças e reduzir o número de fotos classificadas erroneamente entrando na base de dados. A técnica de “multi-label” é aplicada neste cenário, permitindo a um único modelo classificar se as imagens mostram sintomas e se elas apresentam qualidade suficiente para que isso seja feito de maneira confiável. O mecanismo “multi-label” também é uma abordagem promissora para incluir futuramente propriedades adicionais da imagem, como agentes causadores de doenças. O sistema de classificação desenvolvido alcança um valor de “recall” de 97.6% para detecção de sintomas e um valor de precisão de 94.8% para classificação de qualidade das imagens.engUniversidade Federal de PernambucoPrograma de Pos Graduacao em Ciencia da ComputacaoUFPEBrasilAttribution-NonCommercial-NoDerivs 3.0 Brazilhttp://creativecommons.org/licenses/by-nc-nd/3.0/br/info:eu-repo/semantics/openAccessEngenharia da computaçãoDeep learningCNNMulti-labelDoenças de plantasDevelopment of a deep-learning based system for disease symptoms detection over crop leaves imagesinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesismestradoreponame:Repositório Institucional da UFPEinstname:Universidade Federal de Pernambuco (UFPE)instacron:UFPELICENSElicense.txtlicense.txttext/plain; charset=utf-82142https://repositorio.ufpe.br/bitstream/123456789/44958/3/license.txt6928b9260b07fb2755249a5ca9903395MD53TEXTDISSERTAÇÃO Mariana da Silva Barros.pdf.txtDISSERTAÇÃO Mariana da Silva Barros.pdf.txtExtracted texttext/plain203013https://repositorio.ufpe.br/bitstream/123456789/44958/4/DISSERTA%c3%87%c3%83O%20Mariana%20da%20Silva%20Barros.pdf.txtca7ebe5310fd69c86e988254850efbfdMD54THUMBNAILDISSERTAÇÃO Mariana da Silva Barros.pdf.jpgDISSERTAÇÃO Mariana da Silva Barros.pdf.jpgGenerated Thumbnailimage/jpeg1235https://repositorio.ufpe.br/bitstream/123456789/44958/5/DISSERTA%c3%87%c3%83O%20Mariana%20da%20Silva%20Barros.pdf.jpg999394f20b5c20bd628f68e0e6c44906MD55CC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-8811https://repositorio.ufpe.br/bitstream/123456789/44958/2/license_rdfe39d27027a6cc9cb039ad269a5db8e34MD52ORIGINALDISSERTAÇÃO Mariana da Silva Barros.pdfDISSERTAÇÃO Mariana da Silva Barros.pdfapplication/pdf2656314https://repositorio.ufpe.br/bitstream/123456789/44958/1/DISSERTA%c3%87%c3%83O%20Mariana%20da%20Silva%20Barros.pdfe81f40b5e417f2d2bbf625da073715b1MD51123456789/449582022-07-05 02:18:49.006oai:repositorio.ufpe.br:123456789/44958VGVybW8gZGUgRGVww7NzaXRvIExlZ2FsIGUgQXV0b3JpemHDp8OjbyBwYXJhIFB1YmxpY2HDp8OjbyBkZSBEb2N1bWVudG9zIG5vIFJlcG9zaXTDs3JpbyBEaWdpdGFsIGRhIFVGUEUKIAoKRGVjbGFybyBlc3RhciBjaWVudGUgZGUgcXVlIGVzdGUgVGVybW8gZGUgRGVww7NzaXRvIExlZ2FsIGUgQXV0b3JpemHDp8OjbyB0ZW0gbyBvYmpldGl2byBkZSBkaXZ1bGdhw6fDo28gZG9zIGRvY3VtZW50b3MgZGVwb3NpdGFkb3Mgbm8gUmVwb3NpdMOzcmlvIERpZ2l0YWwgZGEgVUZQRSBlIGRlY2xhcm8gcXVlOgoKSSAtICBvIGNvbnRlw7pkbyBkaXNwb25pYmlsaXphZG8gw6kgZGUgcmVzcG9uc2FiaWxpZGFkZSBkZSBzdWEgYXV0b3JpYTsKCklJIC0gbyBjb250ZcO6ZG8gw6kgb3JpZ2luYWwsIGUgc2UgbyB0cmFiYWxobyBlL291IHBhbGF2cmFzIGRlIG91dHJhcyBwZXNzb2FzIGZvcmFtIHV0aWxpemFkb3MsIGVzdGFzIGZvcmFtIGRldmlkYW1lbnRlIHJlY29uaGVjaWRhczsKCklJSSAtIHF1YW5kbyB0cmF0YXItc2UgZGUgVHJhYmFsaG8gZGUgQ29uY2x1c8OjbyBkZSBDdXJzbywgRGlzc2VydGHDp8OjbyBvdSBUZXNlOiBvIGFycXVpdm8gZGVwb3NpdGFkbyBjb3JyZXNwb25kZSDDoCB2ZXJzw6NvIGZpbmFsIGRvIHRyYWJhbGhvOwoKSVYgLSBxdWFuZG8gdHJhdGFyLXNlIGRlIFRyYWJhbGhvIGRlIENvbmNsdXPDo28gZGUgQ3Vyc28sIERpc3NlcnRhw6fDo28gb3UgVGVzZTogZXN0b3UgY2llbnRlIGRlIHF1ZSBhIGFsdGVyYcOnw6NvIGRhIG1vZGFsaWRhZGUgZGUgYWNlc3NvIGFvIGRvY3VtZW50byBhcMOzcyBvIGRlcMOzc2l0byBlIGFudGVzIGRlIGZpbmRhciBvIHBlcsOtb2RvIGRlIGVtYmFyZ28sIHF1YW5kbyBmb3IgZXNjb2xoaWRvIGFjZXNzbyByZXN0cml0bywgc2Vyw6EgcGVybWl0aWRhIG1lZGlhbnRlIHNvbGljaXRhw6fDo28gZG8gKGEpIGF1dG9yIChhKSBhbyBTaXN0ZW1hIEludGVncmFkbyBkZSBCaWJsaW90ZWNhcyBkYSBVRlBFIChTSUIvVUZQRSkuCgogClBhcmEgdHJhYmFsaG9zIGVtIEFjZXNzbyBBYmVydG86CgpOYSBxdWFsaWRhZGUgZGUgdGl0dWxhciBkb3MgZGlyZWl0b3MgYXV0b3JhaXMgZGUgYXV0b3IgcXVlIHJlY2FlbSBzb2JyZSBlc3RlIGRvY3VtZW50bywgZnVuZGFtZW50YWRvIG5hIExlaSBkZSBEaXJlaXRvIEF1dG9yYWwgbm8gOS42MTAsIGRlIDE5IGRlIGZldmVyZWlybyBkZSAxOTk4LCBhcnQuIDI5LCBpbmNpc28gSUlJLCBhdXRvcml6byBhIFVuaXZlcnNpZGFkZSBGZWRlcmFsIGRlIFBlcm5hbWJ1Y28gYSBkaXNwb25pYmlsaXphciBncmF0dWl0YW1lbnRlLCBzZW0gcmVzc2FyY2ltZW50byBkb3MgZGlyZWl0b3MgYXV0b3JhaXMsIHBhcmEgZmlucyBkZSBsZWl0dXJhLCBpbXByZXNzw6NvIGUvb3UgZG93bmxvYWQgKGFxdWlzacOnw6NvKSBhdHJhdsOpcyBkbyBzaXRlIGRvIFJlcG9zaXTDs3JpbyBEaWdpdGFsIGRhIFVGUEUgbm8gZW5kZXJlw6dvIGh0dHA6Ly93d3cucmVwb3NpdG9yaW8udWZwZS5iciwgYSBwYXJ0aXIgZGEgZGF0YSBkZSBkZXDDs3NpdG8uCgogClBhcmEgdHJhYmFsaG9zIGVtIEFjZXNzbyBSZXN0cml0bzoKCk5hIHF1YWxpZGFkZSBkZSB0aXR1bGFyIGRvcyBkaXJlaXRvcyBhdXRvcmFpcyBkZSBhdXRvciBxdWUgcmVjYWVtIHNvYnJlIGVzdGUgZG9jdW1lbnRvLCBmdW5kYW1lbnRhZG8gbmEgTGVpIGRlIERpcmVpdG8gQXV0b3JhbCBubyA5LjYxMCBkZSAxOSBkZSBmZXZlcmVpcm8gZGUgMTk5OCwgYXJ0LiAyOSwgaW5jaXNvIElJSSwgYXV0b3Jpem8gYSBVbml2ZXJzaWRhZGUgRmVkZXJhbCBkZSBQZXJuYW1idWNvIGEgZGlzcG9uaWJpbGl6YXIgZ3JhdHVpdGFtZW50ZSwgc2VtIHJlc3NhcmNpbWVudG8gZG9zIGRpcmVpdG9zIGF1dG9yYWlzLCBwYXJhIGZpbnMgZGUgbGVpdHVyYSwgaW1wcmVzc8OjbyBlL291IGRvd25sb2FkIChhcXVpc2nDp8OjbykgYXRyYXbDqXMgZG8gc2l0ZSBkbyBSZXBvc2l0w7NyaW8gRGlnaXRhbCBkYSBVRlBFIG5vIGVuZGVyZcOnbyBodHRwOi8vd3d3LnJlcG9zaXRvcmlvLnVmcGUuYnIsIHF1YW5kbyBmaW5kYXIgbyBwZXLDrW9kbyBkZSBlbWJhcmdvIGNvbmRpemVudGUgYW8gdGlwbyBkZSBkb2N1bWVudG8sIGNvbmZvcm1lIGluZGljYWRvIG5vIGNhbXBvIERhdGEgZGUgRW1iYXJnby4KRepositório InstitucionalPUBhttps://repositorio.ufpe.br/oai/requestattena@ufpe.bropendoar:22212022-07-05T05:18:49Repositório Institucional da UFPE - Universidade Federal de Pernambuco (UFPE)false
dc.title.pt_BR.fl_str_mv Development of a deep-learning based system for disease symptoms detection over crop leaves images
title Development of a deep-learning based system for disease symptoms detection over crop leaves images
spellingShingle Development of a deep-learning based system for disease symptoms detection over crop leaves images
BARROS, Mariana da Silva
Engenharia da computação
Deep learning
CNN
Multi-label
Doenças de plantas
title_short Development of a deep-learning based system for disease symptoms detection over crop leaves images
title_full Development of a deep-learning based system for disease symptoms detection over crop leaves images
title_fullStr Development of a deep-learning based system for disease symptoms detection over crop leaves images
title_full_unstemmed Development of a deep-learning based system for disease symptoms detection over crop leaves images
title_sort Development of a deep-learning based system for disease symptoms detection over crop leaves images
author BARROS, Mariana da Silva
author_facet BARROS, Mariana da Silva
author_role author
dc.contributor.authorLattes.pt_BR.fl_str_mv http://lattes.cnpq.br/0171498393282139
dc.contributor.advisorLattes.pt_BR.fl_str_mv http://lattes.cnpq.br/3740757562716147
dc.contributor.author.fl_str_mv BARROS, Mariana da Silva
dc.contributor.advisor1.fl_str_mv BLAWID, Stefan Michael
contributor_str_mv BLAWID, Stefan Michael
dc.subject.por.fl_str_mv Engenharia da computação
Deep learning
CNN
Multi-label
Doenças de plantas
topic Engenharia da computação
Deep learning
CNN
Multi-label
Doenças de plantas
description Family farming represents a critical segment of Brazilian agriculture, involving more than 5 million properties and generating 74% of rural jobs in the country. Yield losses caused by crop diseases and pests can be devastating for small-scale producers. However, successful disease control requires correct identification, which challenges smallholders, who often lack technical assistance. The present work proposes a system that alerts smallholder farmers and phytopathology experts about possible crop disease outbreaks, enabling a faster diagnosis and intervention. To this extent, we detect disease symptoms in images of plant leaves taken by farmers directly in the field using a mobile phone app developed for this purpose. The implemented module is part of a service platform connecting producers and experts, designed in partnership with phytopathology professionals from the Federal Rural University of Pernambuco (UFRPE). The work uses deep learning and Convolutional Neural Networks to perform the image classification. The classification experiments were applied over a dataset composed of leaf images of grape crops cultivated in the state of Pernambuco, whose image collection was also part of the present work. Therefore, pictures taken under field conditions sometimes present low quality, which decreases the classification performance. Thus, we also classify the images regarding their quality, to exclude challenging images from disease detection and reduce the number of erroneously classified images entering the database. The multi-label technique is employed in this scenario, enabling a single neural network model to classify whether a leaf picture reveals crop disease symptoms and whether they present good enough quality to do so reliably. The multi-label mechanism is also a promising approach to include additional picture properties in the future, like disease agents. The developed classification system achieves a recall value of 97.6% for symptom detection and a precision value of 94.8% for image quality classification.
publishDate 2021
dc.date.issued.fl_str_mv 2021-12-22
dc.date.accessioned.fl_str_mv 2022-07-04T16:33:07Z
dc.date.available.fl_str_mv 2022-07-04T16:33:07Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv BARROS, Mariana da Silva. Development of a deep-learning based system for disease symptoms detection over crop leaves images. 2021. Dissertação (Mestrado em Ciência da Computação) - Universidade Federal de Pernambuco, Recife, 2021.
dc.identifier.uri.fl_str_mv https://repositorio.ufpe.br/handle/123456789/44958
identifier_str_mv BARROS, Mariana da Silva. Development of a deep-learning based system for disease symptoms detection over crop leaves images. 2021. Dissertação (Mestrado em Ciência da Computação) - Universidade Federal de Pernambuco, Recife, 2021.
url https://repositorio.ufpe.br/handle/123456789/44958
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv Attribution-NonCommercial-NoDerivs 3.0 Brazil
http://creativecommons.org/licenses/by-nc-nd/3.0/br/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Attribution-NonCommercial-NoDerivs 3.0 Brazil
http://creativecommons.org/licenses/by-nc-nd/3.0/br/
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Universidade Federal de Pernambuco
dc.publisher.program.fl_str_mv Programa de Pos Graduacao em Ciencia da Computacao
dc.publisher.initials.fl_str_mv UFPE
dc.publisher.country.fl_str_mv Brasil
publisher.none.fl_str_mv Universidade Federal de Pernambuco
dc.source.none.fl_str_mv reponame:Repositório Institucional da UFPE
instname:Universidade Federal de Pernambuco (UFPE)
instacron:UFPE
instname_str Universidade Federal de Pernambuco (UFPE)
instacron_str UFPE
institution UFPE
reponame_str Repositório Institucional da UFPE
collection Repositório Institucional da UFPE
bitstream.url.fl_str_mv https://repositorio.ufpe.br/bitstream/123456789/44958/3/license.txt
https://repositorio.ufpe.br/bitstream/123456789/44958/4/DISSERTA%c3%87%c3%83O%20Mariana%20da%20Silva%20Barros.pdf.txt
https://repositorio.ufpe.br/bitstream/123456789/44958/5/DISSERTA%c3%87%c3%83O%20Mariana%20da%20Silva%20Barros.pdf.jpg
https://repositorio.ufpe.br/bitstream/123456789/44958/2/license_rdf
https://repositorio.ufpe.br/bitstream/123456789/44958/1/DISSERTA%c3%87%c3%83O%20Mariana%20da%20Silva%20Barros.pdf
bitstream.checksum.fl_str_mv 6928b9260b07fb2755249a5ca9903395
ca7ebe5310fd69c86e988254850efbfd
999394f20b5c20bd628f68e0e6c44906
e39d27027a6cc9cb039ad269a5db8e34
e81f40b5e417f2d2bbf625da073715b1
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
MD5
MD5
repository.name.fl_str_mv Repositório Institucional da UFPE - Universidade Federal de Pernambuco (UFPE)
repository.mail.fl_str_mv attena@ufpe.br
_version_ 1862742037763194880