Investigation of similarity-based test case selection for specification-based regression testing.
| Ano de defesa: | 2014 |
|---|---|
| Autor(a) principal: | |
| Orientador(a): | |
| Banca de defesa: | , , , |
| Tipo de documento: | Tese |
| Tipo de acesso: | Acesso aberto |
| Idioma: | eng |
| Instituição de defesa: |
Universidade Federal de Campina Grande
|
| Programa de Pós-Graduação: |
PÓS-GRADUAÇÃO EM CIÊNCIA DA COMPUTAÇÃO
|
| Departamento: |
Centro de Engenharia Elétrica e Informática - CEEI
|
| País: |
Brasil
|
| Palavras-chave em Português: | |
| Área do conhecimento CNPq: | |
| Link de acesso: | https://dspace.sti.ufcg.edu.br/handle/riufcg/360 |
Resumo: | uring software maintenance, several modifications can be performed in a specification model in order to satisfy new requirements. Perform regression testing on modified software is known to be a costly and laborious task. Test case selection, test case prioritization, test suite minimisation,among other methods,aim to reduce these costs by selecting or prioritizing a subset of test cases so that less time, effort and thus money are involved in performing regression testing. In this doctorate research, we explore the general problem of automatically selecting test cases in a model-based testing (MBT) process where specification models were modified. Our technique, named Similarity Approach for Regression Testing (SART), selects subset of test cases traversing modified regions of a software system’s specification model. That strategy relies on similarity-based test case selection where similarities between test cases from different software versions are analysed to identify modified elements in a model. In addition, we propose an evaluation approach named Search Based Model Generation for Technology Evaluation (SBMTE) that is based on stochastic model generation and search-based techniques to generate large samples of realistic models to allow experiments with model-based techniques. Based on SBMTE,researchers are able to develop model generator tools to create a space of models based on statistics from real industrial models, and eventually generate samples from that space in order to perform experiments. Here we developed a generator to create instances of Annotated Labelled Transitions Systems (ALTS), to be used as input for our MBT process and then perform an experiment with SART.In this experiment, we were able to conclude that SART’s percentage of test suite size reduction is robust and able to select a sub set with an average of 92% less test cases, while ensuring coverage of all model modification and revealing defects linked to model modifications. Both SART and our experiment are executable through the LTS-BT tool, enabling researchers to use our selections trategy andr eproduce our experiment. |
| id |
UFCG_c8fdd1e29253dd42297a9030f4b9dd3b |
|---|---|
| oai_identifier_str |
oai:dspace.sti.ufcg.edu.br:riufcg/360 |
| network_acronym_str |
UFCG |
| network_name_str |
Biblioteca Digital de Teses e Dissertações da UFCG |
| repository_id_str |
|
| spelling |
MACHADO, Patrícia Duarte de Lima.MACHADO, P. D. L.http://lattes.cnpq.br/2495918356675019CARTAXO, Emanuela Gadelha.ARANHA, Eduardo Henrique da Silva.MASSONI, Tiago Lima.SIMÃO, Adenildo da Silva.OLIVEIRA NETO, F. G.http://lattes.cnpq.br/4052914754332243OLIVEIRA NETO, Francisco Gomes de.uring software maintenance, several modifications can be performed in a specification model in order to satisfy new requirements. Perform regression testing on modified software is known to be a costly and laborious task. Test case selection, test case prioritization, test suite minimisation,among other methods,aim to reduce these costs by selecting or prioritizing a subset of test cases so that less time, effort and thus money are involved in performing regression testing. In this doctorate research, we explore the general problem of automatically selecting test cases in a model-based testing (MBT) process where specification models were modified. Our technique, named Similarity Approach for Regression Testing (SART), selects subset of test cases traversing modified regions of a software system’s specification model. That strategy relies on similarity-based test case selection where similarities between test cases from different software versions are analysed to identify modified elements in a model. In addition, we propose an evaluation approach named Search Based Model Generation for Technology Evaluation (SBMTE) that is based on stochastic model generation and search-based techniques to generate large samples of realistic models to allow experiments with model-based techniques. Based on SBMTE,researchers are able to develop model generator tools to create a space of models based on statistics from real industrial models, and eventually generate samples from that space in order to perform experiments. Here we developed a generator to create instances of Annotated Labelled Transitions Systems (ALTS), to be used as input for our MBT process and then perform an experiment with SART.In this experiment, we were able to conclude that SART’s percentage of test suite size reduction is robust and able to select a sub set with an average of 92% less test cases, while ensuring coverage of all model modification and revealing defects linked to model modifications. Both SART and our experiment are executable through the LTS-BT tool, enabling researchers to use our selections trategy andr eproduce our experiment.During software maintenance, several modifications can be performed in a specification model in order to satisfy new requirements. Perform regression testing on modified software is known to be a costly and laborious task. Test case selection, test case prioritization, test suite minimisation,among other methods,aim to reduce these costs by selecting or prioritizing a subset of test cases so that less time, effort and thus money are involved in performing regression testing. In this doctorate research, we explore the general problem of automatically selecting test cases in a model-based testing (MBT) process where specification models were modified. Our technique, named Similarity Approach for Regression Testing (SART), selects subset of test cases traversing modified regions of a software system’s specification model. That strategy relies on similarity-based test case selection where similarities between test cases from different software versions are analysed to identify modified elements in a model. In addition, we propose an evaluation approach named Search Based Model Generation for Technology Evaluation (SBMTE) that is based on stochastic model generation and search-based techniques to generate large samples of realistic models to allow experiments with model-based techniques. Based on SBMTE,researchers are able to develop model generator tools to create a space of models based on statistics from real industrial models, and eventually generate samples from that space in order to perform experiments. Here we developed a generator to create instances of Annotated Labelled Transitions Systems (ALTS), to be used as input for our MBT process and then perform an experiment with SART.In this experiment, we were able to conclude that SART’s percentage of test suite size reduction is robust and able to select a sub set with an average of 92% less test cases, while ensuring coverage of all model modification and revealing defects linked to model modifications. Both SART and our experiment are executable through the LTS-BT tool, enabling researchers to use our selections trategy andr eproduce our experiment.Submitted by Johnny Rodrigues (johnnyrodrigues@ufcg.edu.br) on 2018-04-10T20:00:05Z No. of bitstreams: 1 FRANCISCO GOMES DE OLIVEIRA NETO - TESE PPGCC 2014..pdf: 5163454 bytes, checksum: 228c1fc4f2dc9aad01698011238cfde1 (MD5)Made available in DSpace on 2018-04-10T20:00:05Z (GMT). No. of bitstreams: 1 FRANCISCO GOMES DE OLIVEIRA NETO - TESE PPGCC 2014..pdf: 5163454 bytes, checksum: 228c1fc4f2dc9aad01698011238cfde1 (MD5) Previous issue date: 2014-07-30Universidade Federal de Campina GrandePÓS-GRADUAÇÃO EM CIÊNCIA DA COMPUTAÇÃOUFCGBrasilCentro de Engenharia Elétrica e Informática - CEEICiência da Computação.Engenharia de softwareModel-Based Testing (MBT)Automatic Model GenerationSpecification-Based Regression TestingSimilarityApproachforRegression TestingTeste de regressãoTeste de softwareInvestigation of similarity-based test case selection for specification-based regression testing.2014-07-302018-04-10T20:00:05Z2018-04-102018-04-10T20:00:05Zhttps://dspace.sti.ufcg.edu.br/handle/riufcg/360OLIVEIRA NETO, Francisoc Gomes de. Investigation of similarity-based test case selection for specification-based regression testing. 2014. 149f. (Tese de Doutorado), Programa de Pós-graduação em Ciência da Computação, Centro de Engenharia elétrica e Informática, Universidade Federal de Campina Grande - Paraíba - Brasil, 2014. (Tese redigida em língua inglesa). Disponível em: https://dspace.sti.ufcg.edu.br/handle/riufcg/360info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisenginfo:eu-repo/semantics/openAccessreponame:Biblioteca Digital de Teses e Dissertações da UFCGinstname:Universidade Federal de Campina Grande (UFCG)instacron:UFCGTEXTFRANCISCO GOMES DE OLIVEIRA NETO - TESE PPGCC 2014..pdf.txtFRANCISCO GOMES DE OLIVEIRA NETO - TESE PPGCC 2014..pdf.txttext/plain283827https://dspace.sti.ufcg.edu.br/bitstream/riufcg/360/4/FRANCISCO+GOMES+DE+OLIVEIRA+NETO+-+TESE+PPGCC+2014..pdf.txt2f4c15d9a6176cc7b9cecadc49f41a19MD54ORIGINALFRANCISCO GOMES DE OLIVEIRA NETO - TESE PPGCC 2014..pdfFRANCISCO GOMES DE OLIVEIRA NETO - TESE PPGCC 2014..pdfapplication/pdf5272507https://dspace.sti.ufcg.edu.br/bitstream/riufcg/360/3/FRANCISCO+GOMES+DE+OLIVEIRA+NETO+-+TESE+PPGCC+2014..pdfdc8ffdebc17e6797fa1ad946d331a917MD53LICENSElicense.txtlicense.txttext/plain; charset=utf-81748https://dspace.sti.ufcg.edu.br/bitstream/riufcg/360/2/license.txt8a4605be74aa9ea9d79846c1fba20a33MD52riufcg/3602025-07-24 03:05:51.744oai:dspace.sti.ufcg.edu.br:riufcg/360Tk9URTogUExBQ0UgWU9VUiBPV04gTElDRU5TRSBIRVJFClRoaXMgc2FtcGxlIGxpY2Vuc2UgaXMgcHJvdmlkZWQgZm9yIGluZm9ybWF0aW9uYWwgcHVycG9zZXMgb25seS4KCk5PTi1FWENMVVNJVkUgRElTVFJJQlVUSU9OIExJQ0VOU0UKCkJ5IHNpZ25pbmcgYW5kIHN1Ym1pdHRpbmcgdGhpcyBsaWNlbnNlLCB5b3UgKHRoZSBhdXRob3Iocykgb3IgY29weXJpZ2h0Cm93bmVyKSBncmFudHMgdG8gRFNwYWNlIFVuaXZlcnNpdHkgKERTVSkgdGhlIG5vbi1leGNsdXNpdmUgcmlnaHQgdG8gcmVwcm9kdWNlLAp0cmFuc2xhdGUgKGFzIGRlZmluZWQgYmVsb3cpLCBhbmQvb3IgZGlzdHJpYnV0ZSB5b3VyIHN1Ym1pc3Npb24gKGluY2x1ZGluZwp0aGUgYWJzdHJhY3QpIHdvcmxkd2lkZSBpbiBwcmludCBhbmQgZWxlY3Ryb25pYyBmb3JtYXQgYW5kIGluIGFueSBtZWRpdW0sCmluY2x1ZGluZyBidXQgbm90IGxpbWl0ZWQgdG8gYXVkaW8gb3IgdmlkZW8uCgpZb3UgYWdyZWUgdGhhdCBEU1UgbWF5LCB3aXRob3V0IGNoYW5naW5nIHRoZSBjb250ZW50LCB0cmFuc2xhdGUgdGhlCnN1Ym1pc3Npb24gdG8gYW55IG1lZGl1bSBvciBmb3JtYXQgZm9yIHRoZSBwdXJwb3NlIG9mIHByZXNlcnZhdGlvbi4KCllvdSBhbHNvIGFncmVlIHRoYXQgRFNVIG1heSBrZWVwIG1vcmUgdGhhbiBvbmUgY29weSBvZiB0aGlzIHN1Ym1pc3Npb24gZm9yCnB1cnBvc2VzIG9mIHNlY3VyaXR5LCBiYWNrLXVwIGFuZCBwcmVzZXJ2YXRpb24uCgpZb3UgcmVwcmVzZW50IHRoYXQgdGhlIHN1Ym1pc3Npb24gaXMgeW91ciBvcmlnaW5hbCB3b3JrLCBhbmQgdGhhdCB5b3UgaGF2ZQp0aGUgcmlnaHQgdG8gZ3JhbnQgdGhlIHJpZ2h0cyBjb250YWluZWQgaW4gdGhpcyBsaWNlbnNlLiBZb3UgYWxzbyByZXByZXNlbnQKdGhhdCB5b3VyIHN1Ym1pc3Npb24gZG9lcyBub3QsIHRvIHRoZSBiZXN0IG9mIHlvdXIga25vd2xlZGdlLCBpbmZyaW5nZSB1cG9uCmFueW9uZSdzIGNvcHlyaWdodC4KCklmIHRoZSBzdWJtaXNzaW9uIGNvbnRhaW5zIG1hdGVyaWFsIGZvciB3aGljaCB5b3UgZG8gbm90IGhvbGQgY29weXJpZ2h0LAp5b3UgcmVwcmVzZW50IHRoYXQgeW91IGhhdmUgb2J0YWluZWQgdGhlIHVucmVzdHJpY3RlZCBwZXJtaXNzaW9uIG9mIHRoZQpjb3B5cmlnaHQgb3duZXIgdG8gZ3JhbnQgRFNVIHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdApzdWNoIHRoaXJkLXBhcnR5IG93bmVkIG1hdGVyaWFsIGlzIGNsZWFybHkgaWRlbnRpZmllZCBhbmQgYWNrbm93bGVkZ2VkCndpdGhpbiB0aGUgdGV4dCBvciBjb250ZW50IG9mIHRoZSBzdWJtaXNzaW9uLgoKSUYgVEhFIFNVQk1JU1NJT04gSVMgQkFTRUQgVVBPTiBXT1JLIFRIQVQgSEFTIEJFRU4gU1BPTlNPUkVEIE9SIFNVUFBPUlRFRApCWSBBTiBBR0VOQ1kgT1IgT1JHQU5JWkFUSU9OIE9USEVSIFRIQU4gRFNVLCBZT1UgUkVQUkVTRU5UIFRIQVQgWU9VIEhBVkUKRlVMRklMTEVEIEFOWSBSSUdIVCBPRiBSRVZJRVcgT1IgT1RIRVIgT0JMSUdBVElPTlMgUkVRVUlSRUQgQlkgU1VDSApDT05UUkFDVCBPUiBBR1JFRU1FTlQuCgpEU1Ugd2lsbCBjbGVhcmx5IGlkZW50aWZ5IHlvdXIgbmFtZShzKSBhcyB0aGUgYXV0aG9yKHMpIG9yIG93bmVyKHMpIG9mIHRoZQpzdWJtaXNzaW9uLCBhbmQgd2lsbCBub3QgbWFrZSBhbnkgYWx0ZXJhdGlvbiwgb3RoZXIgdGhhbiBhcyBhbGxvd2VkIGJ5IHRoaXMKbGljZW5zZSwgdG8geW91ciBzdWJtaXNzaW9uLgo=Biblioteca Digital de Teses e Dissertaçõeshttp://bdtd.ufcg.edu.br/PUBhttp://dspace.sti.ufcg.edu.br:8080/oai/requestbdtd@setor.ufcg.edu.br || bdtd@setor.ufcg.edu.bropendoar:48512025-07-24T06:05:51Biblioteca Digital de Teses e Dissertações da UFCG - Universidade Federal de Campina Grande (UFCG)false |
| dc.title.pt_BR.fl_str_mv |
Investigation of similarity-based test case selection for specification-based regression testing. |
| title |
Investigation of similarity-based test case selection for specification-based regression testing. |
| spellingShingle |
Investigation of similarity-based test case selection for specification-based regression testing. OLIVEIRA NETO, Francisco Gomes de. Ciência da Computação. Engenharia de software Model-Based Testing (MBT) Automatic Model Generation Specification-Based Regression Testing SimilarityApproachforRegression Testing Teste de regressão Teste de software |
| title_short |
Investigation of similarity-based test case selection for specification-based regression testing. |
| title_full |
Investigation of similarity-based test case selection for specification-based regression testing. |
| title_fullStr |
Investigation of similarity-based test case selection for specification-based regression testing. |
| title_full_unstemmed |
Investigation of similarity-based test case selection for specification-based regression testing. |
| title_sort |
Investigation of similarity-based test case selection for specification-based regression testing. |
| author |
OLIVEIRA NETO, Francisco Gomes de. |
| author_facet |
OLIVEIRA NETO, Francisco Gomes de. |
| author_role |
author |
| dc.contributor.advisor1.fl_str_mv |
MACHADO, Patrícia Duarte de Lima. |
| dc.contributor.advisor1ID.fl_str_mv |
MACHADO, P. D. L. |
| dc.contributor.advisor1Lattes.fl_str_mv |
http://lattes.cnpq.br/2495918356675019 |
| dc.contributor.referee1.fl_str_mv |
CARTAXO, Emanuela Gadelha. |
| dc.contributor.referee2.fl_str_mv |
ARANHA, Eduardo Henrique da Silva. |
| dc.contributor.referee3.fl_str_mv |
MASSONI, Tiago Lima. |
| dc.contributor.referee4.fl_str_mv |
SIMÃO, Adenildo da Silva. |
| dc.contributor.authorID.fl_str_mv |
OLIVEIRA NETO, F. G. |
| dc.contributor.authorLattes.fl_str_mv |
http://lattes.cnpq.br/4052914754332243 |
| dc.contributor.author.fl_str_mv |
OLIVEIRA NETO, Francisco Gomes de. |
| contributor_str_mv |
MACHADO, Patrícia Duarte de Lima. CARTAXO, Emanuela Gadelha. ARANHA, Eduardo Henrique da Silva. MASSONI, Tiago Lima. SIMÃO, Adenildo da Silva. |
| dc.subject.cnpq.fl_str_mv |
Ciência da Computação. |
| topic |
Ciência da Computação. Engenharia de software Model-Based Testing (MBT) Automatic Model Generation Specification-Based Regression Testing SimilarityApproachforRegression Testing Teste de regressão Teste de software |
| dc.subject.por.fl_str_mv |
Engenharia de software Model-Based Testing (MBT) Automatic Model Generation Specification-Based Regression Testing SimilarityApproachforRegression Testing Teste de regressão Teste de software |
| description |
uring software maintenance, several modifications can be performed in a specification model in order to satisfy new requirements. Perform regression testing on modified software is known to be a costly and laborious task. Test case selection, test case prioritization, test suite minimisation,among other methods,aim to reduce these costs by selecting or prioritizing a subset of test cases so that less time, effort and thus money are involved in performing regression testing. In this doctorate research, we explore the general problem of automatically selecting test cases in a model-based testing (MBT) process where specification models were modified. Our technique, named Similarity Approach for Regression Testing (SART), selects subset of test cases traversing modified regions of a software system’s specification model. That strategy relies on similarity-based test case selection where similarities between test cases from different software versions are analysed to identify modified elements in a model. In addition, we propose an evaluation approach named Search Based Model Generation for Technology Evaluation (SBMTE) that is based on stochastic model generation and search-based techniques to generate large samples of realistic models to allow experiments with model-based techniques. Based on SBMTE,researchers are able to develop model generator tools to create a space of models based on statistics from real industrial models, and eventually generate samples from that space in order to perform experiments. Here we developed a generator to create instances of Annotated Labelled Transitions Systems (ALTS), to be used as input for our MBT process and then perform an experiment with SART.In this experiment, we were able to conclude that SART’s percentage of test suite size reduction is robust and able to select a sub set with an average of 92% less test cases, while ensuring coverage of all model modification and revealing defects linked to model modifications. Both SART and our experiment are executable through the LTS-BT tool, enabling researchers to use our selections trategy andr eproduce our experiment. |
| publishDate |
2014 |
| dc.date.issued.fl_str_mv |
2014-07-30 |
| dc.date.accessioned.fl_str_mv |
2018-04-10T20:00:05Z |
| dc.date.available.fl_str_mv |
2018-04-10 2018-04-10T20:00:05Z |
| dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
| dc.type.driver.fl_str_mv |
info:eu-repo/semantics/doctoralThesis |
| format |
doctoralThesis |
| status_str |
publishedVersion |
| dc.identifier.uri.fl_str_mv |
https://dspace.sti.ufcg.edu.br/handle/riufcg/360 |
| dc.identifier.citation.fl_str_mv |
OLIVEIRA NETO, Francisoc Gomes de. Investigation of similarity-based test case selection for specification-based regression testing. 2014. 149f. (Tese de Doutorado), Programa de Pós-graduação em Ciência da Computação, Centro de Engenharia elétrica e Informática, Universidade Federal de Campina Grande - Paraíba - Brasil, 2014. (Tese redigida em língua inglesa). Disponível em: https://dspace.sti.ufcg.edu.br/handle/riufcg/360 |
| url |
https://dspace.sti.ufcg.edu.br/handle/riufcg/360 |
| identifier_str_mv |
OLIVEIRA NETO, Francisoc Gomes de. Investigation of similarity-based test case selection for specification-based regression testing. 2014. 149f. (Tese de Doutorado), Programa de Pós-graduação em Ciência da Computação, Centro de Engenharia elétrica e Informática, Universidade Federal de Campina Grande - Paraíba - Brasil, 2014. (Tese redigida em língua inglesa). Disponível em: https://dspace.sti.ufcg.edu.br/handle/riufcg/360 |
| dc.language.iso.fl_str_mv |
eng |
| language |
eng |
| dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
| eu_rights_str_mv |
openAccess |
| dc.publisher.none.fl_str_mv |
Universidade Federal de Campina Grande |
| dc.publisher.program.fl_str_mv |
PÓS-GRADUAÇÃO EM CIÊNCIA DA COMPUTAÇÃO |
| dc.publisher.initials.fl_str_mv |
UFCG |
| dc.publisher.country.fl_str_mv |
Brasil |
| dc.publisher.department.fl_str_mv |
Centro de Engenharia Elétrica e Informática - CEEI |
| publisher.none.fl_str_mv |
Universidade Federal de Campina Grande |
| dc.source.none.fl_str_mv |
reponame:Biblioteca Digital de Teses e Dissertações da UFCG instname:Universidade Federal de Campina Grande (UFCG) instacron:UFCG |
| instname_str |
Universidade Federal de Campina Grande (UFCG) |
| instacron_str |
UFCG |
| institution |
UFCG |
| reponame_str |
Biblioteca Digital de Teses e Dissertações da UFCG |
| collection |
Biblioteca Digital de Teses e Dissertações da UFCG |
| bitstream.url.fl_str_mv |
https://dspace.sti.ufcg.edu.br/bitstream/riufcg/360/4/FRANCISCO+GOMES+DE+OLIVEIRA+NETO+-+TESE+PPGCC+2014..pdf.txt https://dspace.sti.ufcg.edu.br/bitstream/riufcg/360/3/FRANCISCO+GOMES+DE+OLIVEIRA+NETO+-+TESE+PPGCC+2014..pdf https://dspace.sti.ufcg.edu.br/bitstream/riufcg/360/2/license.txt |
| bitstream.checksum.fl_str_mv |
2f4c15d9a6176cc7b9cecadc49f41a19 dc8ffdebc17e6797fa1ad946d331a917 8a4605be74aa9ea9d79846c1fba20a33 |
| bitstream.checksumAlgorithm.fl_str_mv |
MD5 MD5 MD5 |
| repository.name.fl_str_mv |
Biblioteca Digital de Teses e Dissertações da UFCG - Universidade Federal de Campina Grande (UFCG) |
| repository.mail.fl_str_mv |
bdtd@setor.ufcg.edu.br || bdtd@setor.ufcg.edu.br |
| _version_ |
1863363375934734336 |