Investigation of similarity-based test case selection for specification-based regression testing.

Detalhes bibliográficos
Ano de defesa: 2014
Autor(a) principal: OLIVEIRA NETO, Francisco Gomes de. lattes
Orientador(a): MACHADO, Patrícia Duarte de Lima. lattes
Banca de defesa: CARTAXO, Emanuela Gadelha., ARANHA, Eduardo Henrique da Silva., MASSONI, Tiago Lima., SIMÃO, Adenildo da Silva.
Tipo de documento: Tese
Tipo de acesso: Acesso aberto
Idioma: eng
Instituição de defesa: Universidade Federal de Campina Grande
Programa de Pós-Graduação: PÓS-GRADUAÇÃO EM CIÊNCIA DA COMPUTAÇÃO
Departamento: Centro de Engenharia Elétrica e Informática - CEEI
País: Brasil
Palavras-chave em Português:
Área do conhecimento CNPq:
Link de acesso: https://dspace.sti.ufcg.edu.br/handle/riufcg/360
Resumo: uring software maintenance, several modifications can be performed in a specification model in order to satisfy new requirements. Perform regression testing on modified software is known to be a costly and laborious task. Test case selection, test case prioritization, test suite minimisation,among other methods,aim to reduce these costs by selecting or prioritizing a subset of test cases so that less time, effort and thus money are involved in performing regression testing. In this doctorate research, we explore the general problem of automatically selecting test cases in a model-based testing (MBT) process where specification models were modified. Our technique, named Similarity Approach for Regression Testing (SART), selects subset of test cases traversing modified regions of a software system’s specification model. That strategy relies on similarity-based test case selection where similarities between test cases from different software versions are analysed to identify modified elements in a model. In addition, we propose an evaluation approach named Search Based Model Generation for Technology Evaluation (SBMTE) that is based on stochastic model generation and search-based techniques to generate large samples of realistic models to allow experiments with model-based techniques. Based on SBMTE,researchers are able to develop model generator tools to create a space of models based on statistics from real industrial models, and eventually generate samples from that space in order to perform experiments. Here we developed a generator to create instances of Annotated Labelled Transitions Systems (ALTS), to be used as input for our MBT process and then perform an experiment with SART.In this experiment, we were able to conclude that SART’s percentage of test suite size reduction is robust and able to select a sub set with an average of 92% less test cases, while ensuring coverage of all model modification and revealing defects linked to model modifications. Both SART and our experiment are executable through the LTS-BT tool, enabling researchers to use our selections trategy andr eproduce our experiment.
id UFCG_c8fdd1e29253dd42297a9030f4b9dd3b
oai_identifier_str oai:dspace.sti.ufcg.edu.br:riufcg/360
network_acronym_str UFCG
network_name_str Biblioteca Digital de Teses e Dissertações da UFCG
repository_id_str
spelling MACHADO, Patrícia Duarte de Lima.MACHADO, P. D. L.http://lattes.cnpq.br/2495918356675019CARTAXO, Emanuela Gadelha.ARANHA, Eduardo Henrique da Silva.MASSONI, Tiago Lima.SIMÃO, Adenildo da Silva.OLIVEIRA NETO, F. G.http://lattes.cnpq.br/4052914754332243OLIVEIRA NETO, Francisco Gomes de.uring software maintenance, several modifications can be performed in a specification model in order to satisfy new requirements. Perform regression testing on modified software is known to be a costly and laborious task. Test case selection, test case prioritization, test suite minimisation,among other methods,aim to reduce these costs by selecting or prioritizing a subset of test cases so that less time, effort and thus money are involved in performing regression testing. In this doctorate research, we explore the general problem of automatically selecting test cases in a model-based testing (MBT) process where specification models were modified. Our technique, named Similarity Approach for Regression Testing (SART), selects subset of test cases traversing modified regions of a software system’s specification model. That strategy relies on similarity-based test case selection where similarities between test cases from different software versions are analysed to identify modified elements in a model. In addition, we propose an evaluation approach named Search Based Model Generation for Technology Evaluation (SBMTE) that is based on stochastic model generation and search-based techniques to generate large samples of realistic models to allow experiments with model-based techniques. Based on SBMTE,researchers are able to develop model generator tools to create a space of models based on statistics from real industrial models, and eventually generate samples from that space in order to perform experiments. Here we developed a generator to create instances of Annotated Labelled Transitions Systems (ALTS), to be used as input for our MBT process and then perform an experiment with SART.In this experiment, we were able to conclude that SART’s percentage of test suite size reduction is robust and able to select a sub set with an average of 92% less test cases, while ensuring coverage of all model modification and revealing defects linked to model modifications. Both SART and our experiment are executable through the LTS-BT tool, enabling researchers to use our selections trategy andr eproduce our experiment.During software maintenance, several modifications can be performed in a specification model in order to satisfy new requirements. Perform regression testing on modified software is known to be a costly and laborious task. Test case selection, test case prioritization, test suite minimisation,among other methods,aim to reduce these costs by selecting or prioritizing a subset of test cases so that less time, effort and thus money are involved in performing regression testing. In this doctorate research, we explore the general problem of automatically selecting test cases in a model-based testing (MBT) process where specification models were modified. Our technique, named Similarity Approach for Regression Testing (SART), selects subset of test cases traversing modified regions of a software system’s specification model. That strategy relies on similarity-based test case selection where similarities between test cases from different software versions are analysed to identify modified elements in a model. In addition, we propose an evaluation approach named Search Based Model Generation for Technology Evaluation (SBMTE) that is based on stochastic model generation and search-based techniques to generate large samples of realistic models to allow experiments with model-based techniques. Based on SBMTE,researchers are able to develop model generator tools to create a space of models based on statistics from real industrial models, and eventually generate samples from that space in order to perform experiments. Here we developed a generator to create instances of Annotated Labelled Transitions Systems (ALTS), to be used as input for our MBT process and then perform an experiment with SART.In this experiment, we were able to conclude that SART’s percentage of test suite size reduction is robust and able to select a sub set with an average of 92% less test cases, while ensuring coverage of all model modification and revealing defects linked to model modifications. Both SART and our experiment are executable through the LTS-BT tool, enabling researchers to use our selections trategy andr eproduce our experiment.Submitted by Johnny Rodrigues (johnnyrodrigues@ufcg.edu.br) on 2018-04-10T20:00:05Z No. of bitstreams: 1 FRANCISCO GOMES DE OLIVEIRA NETO - TESE PPGCC 2014..pdf: 5163454 bytes, checksum: 228c1fc4f2dc9aad01698011238cfde1 (MD5)Made available in DSpace on 2018-04-10T20:00:05Z (GMT). No. of bitstreams: 1 FRANCISCO GOMES DE OLIVEIRA NETO - TESE PPGCC 2014..pdf: 5163454 bytes, checksum: 228c1fc4f2dc9aad01698011238cfde1 (MD5) Previous issue date: 2014-07-30Universidade Federal de Campina GrandePÓS-GRADUAÇÃO EM CIÊNCIA DA COMPUTAÇÃOUFCGBrasilCentro de Engenharia Elétrica e Informática - CEEICiência da Computação.Engenharia de softwareModel-Based Testing (MBT)Automatic Model GenerationSpecification-Based Regression TestingSimilarityApproachforRegression TestingTeste de regressãoTeste de softwareInvestigation of similarity-based test case selection for specification-based regression testing.2014-07-302018-04-10T20:00:05Z2018-04-102018-04-10T20:00:05Zhttps://dspace.sti.ufcg.edu.br/handle/riufcg/360OLIVEIRA NETO, Francisoc Gomes de. Investigation of similarity-based test case selection for specification-based regression testing. 2014. 149f. (Tese de Doutorado), Programa de Pós-graduação em Ciência da Computação, Centro de Engenharia elétrica e Informática, Universidade Federal de Campina Grande - Paraíba - Brasil, 2014. (Tese redigida em língua inglesa). Disponível em: https://dspace.sti.ufcg.edu.br/handle/riufcg/360info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisenginfo:eu-repo/semantics/openAccessreponame:Biblioteca Digital de Teses e Dissertações da UFCGinstname:Universidade Federal de Campina Grande (UFCG)instacron:UFCGTEXTFRANCISCO GOMES DE OLIVEIRA NETO - TESE PPGCC 2014..pdf.txtFRANCISCO GOMES DE OLIVEIRA NETO - TESE PPGCC 2014..pdf.txttext/plain283827https://dspace.sti.ufcg.edu.br/bitstream/riufcg/360/4/FRANCISCO+GOMES+DE+OLIVEIRA+NETO+-+TESE+PPGCC+2014..pdf.txt2f4c15d9a6176cc7b9cecadc49f41a19MD54ORIGINALFRANCISCO GOMES DE OLIVEIRA NETO - TESE PPGCC 2014..pdfFRANCISCO GOMES DE OLIVEIRA NETO - TESE PPGCC 2014..pdfapplication/pdf5272507https://dspace.sti.ufcg.edu.br/bitstream/riufcg/360/3/FRANCISCO+GOMES+DE+OLIVEIRA+NETO+-+TESE+PPGCC+2014..pdfdc8ffdebc17e6797fa1ad946d331a917MD53LICENSElicense.txtlicense.txttext/plain; charset=utf-81748https://dspace.sti.ufcg.edu.br/bitstream/riufcg/360/2/license.txt8a4605be74aa9ea9d79846c1fba20a33MD52riufcg/3602025-07-24 03:05:51.744oai:dspace.sti.ufcg.edu.br:riufcg/360Tk9URTogUExBQ0UgWU9VUiBPV04gTElDRU5TRSBIRVJFClRoaXMgc2FtcGxlIGxpY2Vuc2UgaXMgcHJvdmlkZWQgZm9yIGluZm9ybWF0aW9uYWwgcHVycG9zZXMgb25seS4KCk5PTi1FWENMVVNJVkUgRElTVFJJQlVUSU9OIExJQ0VOU0UKCkJ5IHNpZ25pbmcgYW5kIHN1Ym1pdHRpbmcgdGhpcyBsaWNlbnNlLCB5b3UgKHRoZSBhdXRob3Iocykgb3IgY29weXJpZ2h0Cm93bmVyKSBncmFudHMgdG8gRFNwYWNlIFVuaXZlcnNpdHkgKERTVSkgdGhlIG5vbi1leGNsdXNpdmUgcmlnaHQgdG8gcmVwcm9kdWNlLAp0cmFuc2xhdGUgKGFzIGRlZmluZWQgYmVsb3cpLCBhbmQvb3IgZGlzdHJpYnV0ZSB5b3VyIHN1Ym1pc3Npb24gKGluY2x1ZGluZwp0aGUgYWJzdHJhY3QpIHdvcmxkd2lkZSBpbiBwcmludCBhbmQgZWxlY3Ryb25pYyBmb3JtYXQgYW5kIGluIGFueSBtZWRpdW0sCmluY2x1ZGluZyBidXQgbm90IGxpbWl0ZWQgdG8gYXVkaW8gb3IgdmlkZW8uCgpZb3UgYWdyZWUgdGhhdCBEU1UgbWF5LCB3aXRob3V0IGNoYW5naW5nIHRoZSBjb250ZW50LCB0cmFuc2xhdGUgdGhlCnN1Ym1pc3Npb24gdG8gYW55IG1lZGl1bSBvciBmb3JtYXQgZm9yIHRoZSBwdXJwb3NlIG9mIHByZXNlcnZhdGlvbi4KCllvdSBhbHNvIGFncmVlIHRoYXQgRFNVIG1heSBrZWVwIG1vcmUgdGhhbiBvbmUgY29weSBvZiB0aGlzIHN1Ym1pc3Npb24gZm9yCnB1cnBvc2VzIG9mIHNlY3VyaXR5LCBiYWNrLXVwIGFuZCBwcmVzZXJ2YXRpb24uCgpZb3UgcmVwcmVzZW50IHRoYXQgdGhlIHN1Ym1pc3Npb24gaXMgeW91ciBvcmlnaW5hbCB3b3JrLCBhbmQgdGhhdCB5b3UgaGF2ZQp0aGUgcmlnaHQgdG8gZ3JhbnQgdGhlIHJpZ2h0cyBjb250YWluZWQgaW4gdGhpcyBsaWNlbnNlLiBZb3UgYWxzbyByZXByZXNlbnQKdGhhdCB5b3VyIHN1Ym1pc3Npb24gZG9lcyBub3QsIHRvIHRoZSBiZXN0IG9mIHlvdXIga25vd2xlZGdlLCBpbmZyaW5nZSB1cG9uCmFueW9uZSdzIGNvcHlyaWdodC4KCklmIHRoZSBzdWJtaXNzaW9uIGNvbnRhaW5zIG1hdGVyaWFsIGZvciB3aGljaCB5b3UgZG8gbm90IGhvbGQgY29weXJpZ2h0LAp5b3UgcmVwcmVzZW50IHRoYXQgeW91IGhhdmUgb2J0YWluZWQgdGhlIHVucmVzdHJpY3RlZCBwZXJtaXNzaW9uIG9mIHRoZQpjb3B5cmlnaHQgb3duZXIgdG8gZ3JhbnQgRFNVIHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdApzdWNoIHRoaXJkLXBhcnR5IG93bmVkIG1hdGVyaWFsIGlzIGNsZWFybHkgaWRlbnRpZmllZCBhbmQgYWNrbm93bGVkZ2VkCndpdGhpbiB0aGUgdGV4dCBvciBjb250ZW50IG9mIHRoZSBzdWJtaXNzaW9uLgoKSUYgVEhFIFNVQk1JU1NJT04gSVMgQkFTRUQgVVBPTiBXT1JLIFRIQVQgSEFTIEJFRU4gU1BPTlNPUkVEIE9SIFNVUFBPUlRFRApCWSBBTiBBR0VOQ1kgT1IgT1JHQU5JWkFUSU9OIE9USEVSIFRIQU4gRFNVLCBZT1UgUkVQUkVTRU5UIFRIQVQgWU9VIEhBVkUKRlVMRklMTEVEIEFOWSBSSUdIVCBPRiBSRVZJRVcgT1IgT1RIRVIgT0JMSUdBVElPTlMgUkVRVUlSRUQgQlkgU1VDSApDT05UUkFDVCBPUiBBR1JFRU1FTlQuCgpEU1Ugd2lsbCBjbGVhcmx5IGlkZW50aWZ5IHlvdXIgbmFtZShzKSBhcyB0aGUgYXV0aG9yKHMpIG9yIG93bmVyKHMpIG9mIHRoZQpzdWJtaXNzaW9uLCBhbmQgd2lsbCBub3QgbWFrZSBhbnkgYWx0ZXJhdGlvbiwgb3RoZXIgdGhhbiBhcyBhbGxvd2VkIGJ5IHRoaXMKbGljZW5zZSwgdG8geW91ciBzdWJtaXNzaW9uLgo=Biblioteca Digital de Teses e Dissertaçõeshttp://bdtd.ufcg.edu.br/PUBhttp://dspace.sti.ufcg.edu.br:8080/oai/requestbdtd@setor.ufcg.edu.br || bdtd@setor.ufcg.edu.bropendoar:48512025-07-24T06:05:51Biblioteca Digital de Teses e Dissertações da UFCG - Universidade Federal de Campina Grande (UFCG)false
dc.title.pt_BR.fl_str_mv Investigation of similarity-based test case selection for specification-based regression testing.
title Investigation of similarity-based test case selection for specification-based regression testing.
spellingShingle Investigation of similarity-based test case selection for specification-based regression testing.
OLIVEIRA NETO, Francisco Gomes de.
Ciência da Computação.
Engenharia de software
Model-Based Testing (MBT)
Automatic Model Generation
Specification-Based Regression Testing
SimilarityApproachforRegression Testing
Teste de regressão
Teste de software
title_short Investigation of similarity-based test case selection for specification-based regression testing.
title_full Investigation of similarity-based test case selection for specification-based regression testing.
title_fullStr Investigation of similarity-based test case selection for specification-based regression testing.
title_full_unstemmed Investigation of similarity-based test case selection for specification-based regression testing.
title_sort Investigation of similarity-based test case selection for specification-based regression testing.
author OLIVEIRA NETO, Francisco Gomes de.
author_facet OLIVEIRA NETO, Francisco Gomes de.
author_role author
dc.contributor.advisor1.fl_str_mv MACHADO, Patrícia Duarte de Lima.
dc.contributor.advisor1ID.fl_str_mv MACHADO, P. D. L.
dc.contributor.advisor1Lattes.fl_str_mv http://lattes.cnpq.br/2495918356675019
dc.contributor.referee1.fl_str_mv CARTAXO, Emanuela Gadelha.
dc.contributor.referee2.fl_str_mv ARANHA, Eduardo Henrique da Silva.
dc.contributor.referee3.fl_str_mv MASSONI, Tiago Lima.
dc.contributor.referee4.fl_str_mv SIMÃO, Adenildo da Silva.
dc.contributor.authorID.fl_str_mv OLIVEIRA NETO, F. G.
dc.contributor.authorLattes.fl_str_mv http://lattes.cnpq.br/4052914754332243
dc.contributor.author.fl_str_mv OLIVEIRA NETO, Francisco Gomes de.
contributor_str_mv MACHADO, Patrícia Duarte de Lima.
CARTAXO, Emanuela Gadelha.
ARANHA, Eduardo Henrique da Silva.
MASSONI, Tiago Lima.
SIMÃO, Adenildo da Silva.
dc.subject.cnpq.fl_str_mv Ciência da Computação.
topic Ciência da Computação.
Engenharia de software
Model-Based Testing (MBT)
Automatic Model Generation
Specification-Based Regression Testing
SimilarityApproachforRegression Testing
Teste de regressão
Teste de software
dc.subject.por.fl_str_mv Engenharia de software
Model-Based Testing (MBT)
Automatic Model Generation
Specification-Based Regression Testing
SimilarityApproachforRegression Testing
Teste de regressão
Teste de software
description uring software maintenance, several modifications can be performed in a specification model in order to satisfy new requirements. Perform regression testing on modified software is known to be a costly and laborious task. Test case selection, test case prioritization, test suite minimisation,among other methods,aim to reduce these costs by selecting or prioritizing a subset of test cases so that less time, effort and thus money are involved in performing regression testing. In this doctorate research, we explore the general problem of automatically selecting test cases in a model-based testing (MBT) process where specification models were modified. Our technique, named Similarity Approach for Regression Testing (SART), selects subset of test cases traversing modified regions of a software system’s specification model. That strategy relies on similarity-based test case selection where similarities between test cases from different software versions are analysed to identify modified elements in a model. In addition, we propose an evaluation approach named Search Based Model Generation for Technology Evaluation (SBMTE) that is based on stochastic model generation and search-based techniques to generate large samples of realistic models to allow experiments with model-based techniques. Based on SBMTE,researchers are able to develop model generator tools to create a space of models based on statistics from real industrial models, and eventually generate samples from that space in order to perform experiments. Here we developed a generator to create instances of Annotated Labelled Transitions Systems (ALTS), to be used as input for our MBT process and then perform an experiment with SART.In this experiment, we were able to conclude that SART’s percentage of test suite size reduction is robust and able to select a sub set with an average of 92% less test cases, while ensuring coverage of all model modification and revealing defects linked to model modifications. Both SART and our experiment are executable through the LTS-BT tool, enabling researchers to use our selections trategy andr eproduce our experiment.
publishDate 2014
dc.date.issued.fl_str_mv 2014-07-30
dc.date.accessioned.fl_str_mv 2018-04-10T20:00:05Z
dc.date.available.fl_str_mv 2018-04-10
2018-04-10T20:00:05Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/doctoralThesis
format doctoralThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://dspace.sti.ufcg.edu.br/handle/riufcg/360
dc.identifier.citation.fl_str_mv OLIVEIRA NETO, Francisoc Gomes de. Investigation of similarity-based test case selection for specification-based regression testing. 2014. 149f. (Tese de Doutorado), Programa de Pós-graduação em Ciência da Computação, Centro de Engenharia elétrica e Informática, Universidade Federal de Campina Grande - Paraíba - Brasil, 2014. (Tese redigida em língua inglesa). Disponível em: https://dspace.sti.ufcg.edu.br/handle/riufcg/360
url https://dspace.sti.ufcg.edu.br/handle/riufcg/360
identifier_str_mv OLIVEIRA NETO, Francisoc Gomes de. Investigation of similarity-based test case selection for specification-based regression testing. 2014. 149f. (Tese de Doutorado), Programa de Pós-graduação em Ciência da Computação, Centro de Engenharia elétrica e Informática, Universidade Federal de Campina Grande - Paraíba - Brasil, 2014. (Tese redigida em língua inglesa). Disponível em: https://dspace.sti.ufcg.edu.br/handle/riufcg/360
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Universidade Federal de Campina Grande
dc.publisher.program.fl_str_mv PÓS-GRADUAÇÃO EM CIÊNCIA DA COMPUTAÇÃO
dc.publisher.initials.fl_str_mv UFCG
dc.publisher.country.fl_str_mv Brasil
dc.publisher.department.fl_str_mv Centro de Engenharia Elétrica e Informática - CEEI
publisher.none.fl_str_mv Universidade Federal de Campina Grande
dc.source.none.fl_str_mv reponame:Biblioteca Digital de Teses e Dissertações da UFCG
instname:Universidade Federal de Campina Grande (UFCG)
instacron:UFCG
instname_str Universidade Federal de Campina Grande (UFCG)
instacron_str UFCG
institution UFCG
reponame_str Biblioteca Digital de Teses e Dissertações da UFCG
collection Biblioteca Digital de Teses e Dissertações da UFCG
bitstream.url.fl_str_mv https://dspace.sti.ufcg.edu.br/bitstream/riufcg/360/4/FRANCISCO+GOMES+DE+OLIVEIRA+NETO+-+TESE+PPGCC+2014..pdf.txt
https://dspace.sti.ufcg.edu.br/bitstream/riufcg/360/3/FRANCISCO+GOMES+DE+OLIVEIRA+NETO+-+TESE+PPGCC+2014..pdf
https://dspace.sti.ufcg.edu.br/bitstream/riufcg/360/2/license.txt
bitstream.checksum.fl_str_mv 2f4c15d9a6176cc7b9cecadc49f41a19
dc8ffdebc17e6797fa1ad946d331a917
8a4605be74aa9ea9d79846c1fba20a33
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
repository.name.fl_str_mv Biblioteca Digital de Teses e Dissertações da UFCG - Universidade Federal de Campina Grande (UFCG)
repository.mail.fl_str_mv bdtd@setor.ufcg.edu.br || bdtd@setor.ufcg.edu.br
_version_ 1863363375934734336