Leveraging automated web tests into model-based testing

Detalhes bibliográficos
Ano de defesa: 2020
Autor(a) principal: Mattiello, Guilherme Ricken
Orientador(a): Não Informado pela instituição
Banca de defesa: Não Informado pela instituição
Tipo de documento: Dissertação
Tipo de acesso: Acesso aberto
Idioma: eng
Instituição de defesa: Universidade Tecnológica Federal do Paraná
Cornelio Procopio
Brasil
Programa de Pós-Graduação em Informática
UTFPR
Programa de Pós-Graduação: Não Informado pela instituição
Departamento: Não Informado pela instituição
País: Não Informado pela instituição
Palavras-chave em Português:
Link de acesso: http://repositorio.utfpr.edu.br/jspui/handle/1/5434
Resumo: Background: Agile methods have driven automated execution of test cases, which have been adopted at different test levels, from unit testing to GUI testing. However, the tools that support automated testing focus on execution, leaving the generation of test cases as a manual task. In this way, the model-based testing (MBT) approach studies the generation of automated test cases through models, which are used to derive the test cases in a top-down workflow, where the model is created and from it are extracted the test cases that are subsequently executed. However, since testing implementation is currently the developer’s own responsibility, the tester may come across a scenario where there is already a test suite that must be reused to produce new model-based tests. Objective: This work aims to present an approach that uses existing automated tests to facilitate the adoption of MBT in this scenario, allowing the reuse of GUI tests to derive new test cases. To support the evaluation of the approach, we developed a tool that uses the PageObjects pattern for the abstraction and structuring of existing test cases in event-based models. Method: The tool developed to evaluate the approach, called MoLeWe, supports the three steps of the approach: model inference, model extension and test case generation. The experiment was conducted with 18 students, who developed test cases in Java with the PageObjects pattern for 9 web applications. The tool generated models for the developed test projects, which were extended and used to generate new test cases. Results: The experimental study collected data such as line coverage of the new test cases, execution time, effort spent to generate new tests and information that gave evidence of the feasibility of the approach and reuse of the existing test suites. On average, line coverage increased by 38.97% with the new test cases, the execution time gave evidence of linear growth in relation to the size of the projects and the approach proved feasible, reusing most of the existing test suites, since, on average, 70.54% of the new events created were already concretized.
id UTFPR-12_055347bffae5c94e9d320ecf1ecfe59f
oai_identifier_str oai:repositorio.utfpr.edu.br:1/5434
network_acronym_str UTFPR-12
network_name_str Repositório Institucional da UTFPR (da Universidade Tecnológica Federal do Paraná (RIUT))
repository_id_str
spelling Leveraging automated web tests into model-based testingSoftware - TestesInterface gráfica com o usuário (Sistemas de computação)Banco de dados orientado a objetosComputer software - TestingGraphical user interfaces (Computer systems)Object-oriented databasesCNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAOCiência da ComputaçãoBackground: Agile methods have driven automated execution of test cases, which have been adopted at different test levels, from unit testing to GUI testing. However, the tools that support automated testing focus on execution, leaving the generation of test cases as a manual task. In this way, the model-based testing (MBT) approach studies the generation of automated test cases through models, which are used to derive the test cases in a top-down workflow, where the model is created and from it are extracted the test cases that are subsequently executed. However, since testing implementation is currently the developer’s own responsibility, the tester may come across a scenario where there is already a test suite that must be reused to produce new model-based tests. Objective: This work aims to present an approach that uses existing automated tests to facilitate the adoption of MBT in this scenario, allowing the reuse of GUI tests to derive new test cases. To support the evaluation of the approach, we developed a tool that uses the PageObjects pattern for the abstraction and structuring of existing test cases in event-based models. Method: The tool developed to evaluate the approach, called MoLeWe, supports the three steps of the approach: model inference, model extension and test case generation. The experiment was conducted with 18 students, who developed test cases in Java with the PageObjects pattern for 9 web applications. The tool generated models for the developed test projects, which were extended and used to generate new test cases. Results: The experimental study collected data such as line coverage of the new test cases, execution time, effort spent to generate new tests and information that gave evidence of the feasibility of the approach and reuse of the existing test suites. On average, line coverage increased by 38.97% with the new test cases, the execution time gave evidence of linear growth in relation to the size of the projects and the approach proved feasible, reusing most of the existing test suites, since, on average, 70.54% of the new events created were already concretized.Contexto: Os métodos ágeis têm impulsionado práticas de execução automática de casos de teste, as quais tem sido adotadas em diferentes níveis de teste, desde testes de unidade até os testes de sistemas em interface gráfica (GUI). Porém, as ferramentas que apoiam o teste automatizado focam na execução, deixando a geração dos casos testes como uma tarefa manual. Desta forma, a abordagem de Teste Baseado em Modelo (TBM) estuda a geração de casos de teste automatizada por meio de modelos, os quais são utilizados para derivar os casos de teste em um fluxo top-down, onde o modelo é criado e dele são extraídos os casos de teste que posteriormente são executados. Entretanto, considerando que a implementação de testes e, atualmente, responsabilidade do próprio desenvolvedor, o testador pode se deparar com um cenário onde já exista uma suíte de testes que deva ser reutilizada para produzir novos testes baseados em modelo. Objetivo: Este trabalho tem como objetivo apresentar uma abordagem que utiliza testes automatizados existentes para facilitar a adoção de TBM neste cenário, permitindo a reutilização de testes GUI para derivar novos casos de teste. Para apoiar a avaliação da abordagem foi desenvolvida uma ferramenta que utiliza o padrão PageObjects para a abstração e estruturação dos casos de teste existentes, e modelos baseados em eventos. Método: A ferramenta desenvolvida para avaliar a abordagem, chamada MoLeWe, suporta as três etapas da abordagem: inferência do modelo, extensão do modelo e geração dos casos de teste. O experimento conduzido contou com a participação de 18 estudantes, os quais desenvolveram casos de teste em Java com o padrão PageObjects, para 9 aplicações web. A ferramenta gerou modelos para os projetos de teste desenvolvidos, os quais foram estendidos e utilizados para gerar novos casos de teste. Resultados: O estudo experimental coletou dados como cobertura de linha dos novos casos de teste gerados, tempo de execução, esforço gasto para gerar novos casos de teste e informações que atestaram a viabilidade da abordagem e reuso das suítes de teste existentes. Em média, a cobertura de linha aumentou 38,97% com os novos casos de teste, os tempos de execução de inferência do modelo e geração dos casos de teste forneceram evidências de crescimento linear em relação ao tamanho dos projetos e a abordagem se mostrou viável, reaproveitando grande parte das suítes de teste existentes, visto que, em media, 70,54% dos novos eventos criados já estavam concretizados.Universidade Tecnológica Federal do ParanáCornelio ProcopioBrasilPrograma de Pós-Graduação em InformáticaUTFPREndo, André Takeshihttp://lattes.cnpq.br/4221336619791961Simão, Adenilso da Silvahttp://lattes.cnpq.br/9836776931160228Endo, André Takeshihttp://lattes.cnpq.br/4221336619791961Silva, Marco Aurelio Graciottohttp://lattes.cnpq.br/9383290036853173Mattiello, Guilherme Ricken2020-11-03T18:47:44Z2020-11-03T18:47:44Z2020-04-29info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfMATTIELLO, Guilherme Ricken. Leveraging automated web tests into model-based testing. 2020. Dissertação (Mestrado em Informática) - Universidade Tecnológica Federal do Paraná, Cornélio Procópio, 2020.http://repositorio.utfpr.edu.br/jspui/handle/1/5434enginfo:eu-repo/semantics/openAccessreponame:Repositório Institucional da UTFPR (da Universidade Tecnológica Federal do Paraná (RIUT))instname:Universidade Tecnológica Federal do Paraná (UTFPR)instacron:UTFPR2021-12-16T20:42:45Zoai:repositorio.utfpr.edu.br:1/5434Repositório InstitucionalPUBhttp://repositorio.utfpr.edu.br:8080/oai/requestriut@utfpr.edu.br || sibi@utfpr.edu.bropendoar:2021-12-16T20:42:45Repositório Institucional da UTFPR (da Universidade Tecnológica Federal do Paraná (RIUT)) - Universidade Tecnológica Federal do Paraná (UTFPR)false
dc.title.none.fl_str_mv Leveraging automated web tests into model-based testing
title Leveraging automated web tests into model-based testing
spellingShingle Leveraging automated web tests into model-based testing
Mattiello, Guilherme Ricken
Software - Testes
Interface gráfica com o usuário (Sistemas de computação)
Banco de dados orientado a objetos
Computer software - Testing
Graphical user interfaces (Computer systems)
Object-oriented databases
CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
Ciência da Computação
title_short Leveraging automated web tests into model-based testing
title_full Leveraging automated web tests into model-based testing
title_fullStr Leveraging automated web tests into model-based testing
title_full_unstemmed Leveraging automated web tests into model-based testing
title_sort Leveraging automated web tests into model-based testing
author Mattiello, Guilherme Ricken
author_facet Mattiello, Guilherme Ricken
author_role author
dc.contributor.none.fl_str_mv Endo, André Takeshi
http://lattes.cnpq.br/4221336619791961
Simão, Adenilso da Silva
http://lattes.cnpq.br/9836776931160228
Endo, André Takeshi
http://lattes.cnpq.br/4221336619791961
Silva, Marco Aurelio Graciotto
http://lattes.cnpq.br/9383290036853173
dc.contributor.author.fl_str_mv Mattiello, Guilherme Ricken
dc.subject.por.fl_str_mv Software - Testes
Interface gráfica com o usuário (Sistemas de computação)
Banco de dados orientado a objetos
Computer software - Testing
Graphical user interfaces (Computer systems)
Object-oriented databases
CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
Ciência da Computação
topic Software - Testes
Interface gráfica com o usuário (Sistemas de computação)
Banco de dados orientado a objetos
Computer software - Testing
Graphical user interfaces (Computer systems)
Object-oriented databases
CNPQ::CIENCIAS EXATAS E DA TERRA::CIENCIA DA COMPUTACAO
Ciência da Computação
description Background: Agile methods have driven automated execution of test cases, which have been adopted at different test levels, from unit testing to GUI testing. However, the tools that support automated testing focus on execution, leaving the generation of test cases as a manual task. In this way, the model-based testing (MBT) approach studies the generation of automated test cases through models, which are used to derive the test cases in a top-down workflow, where the model is created and from it are extracted the test cases that are subsequently executed. However, since testing implementation is currently the developer’s own responsibility, the tester may come across a scenario where there is already a test suite that must be reused to produce new model-based tests. Objective: This work aims to present an approach that uses existing automated tests to facilitate the adoption of MBT in this scenario, allowing the reuse of GUI tests to derive new test cases. To support the evaluation of the approach, we developed a tool that uses the PageObjects pattern for the abstraction and structuring of existing test cases in event-based models. Method: The tool developed to evaluate the approach, called MoLeWe, supports the three steps of the approach: model inference, model extension and test case generation. The experiment was conducted with 18 students, who developed test cases in Java with the PageObjects pattern for 9 web applications. The tool generated models for the developed test projects, which were extended and used to generate new test cases. Results: The experimental study collected data such as line coverage of the new test cases, execution time, effort spent to generate new tests and information that gave evidence of the feasibility of the approach and reuse of the existing test suites. On average, line coverage increased by 38.97% with the new test cases, the execution time gave evidence of linear growth in relation to the size of the projects and the approach proved feasible, reusing most of the existing test suites, since, on average, 70.54% of the new events created were already concretized.
publishDate 2020
dc.date.none.fl_str_mv 2020-11-03T18:47:44Z
2020-11-03T18:47:44Z
2020-04-29
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv MATTIELLO, Guilherme Ricken. Leveraging automated web tests into model-based testing. 2020. Dissertação (Mestrado em Informática) - Universidade Tecnológica Federal do Paraná, Cornélio Procópio, 2020.
http://repositorio.utfpr.edu.br/jspui/handle/1/5434
identifier_str_mv MATTIELLO, Guilherme Ricken. Leveraging automated web tests into model-based testing. 2020. Dissertação (Mestrado em Informática) - Universidade Tecnológica Federal do Paraná, Cornélio Procópio, 2020.
url http://repositorio.utfpr.edu.br/jspui/handle/1/5434
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Universidade Tecnológica Federal do Paraná
Cornelio Procopio
Brasil
Programa de Pós-Graduação em Informática
UTFPR
publisher.none.fl_str_mv Universidade Tecnológica Federal do Paraná
Cornelio Procopio
Brasil
Programa de Pós-Graduação em Informática
UTFPR
dc.source.none.fl_str_mv reponame:Repositório Institucional da UTFPR (da Universidade Tecnológica Federal do Paraná (RIUT))
instname:Universidade Tecnológica Federal do Paraná (UTFPR)
instacron:UTFPR
instname_str Universidade Tecnológica Federal do Paraná (UTFPR)
instacron_str UTFPR
institution UTFPR
reponame_str Repositório Institucional da UTFPR (da Universidade Tecnológica Federal do Paraná (RIUT))
collection Repositório Institucional da UTFPR (da Universidade Tecnológica Federal do Paraná (RIUT))
repository.name.fl_str_mv Repositório Institucional da UTFPR (da Universidade Tecnológica Federal do Paraná (RIUT)) - Universidade Tecnológica Federal do Paraná (UTFPR)
repository.mail.fl_str_mv riut@utfpr.edu.br || sibi@utfpr.edu.br
_version_ 1850498252899614720