Evaluating feedback tools in introductory programming classes.
| Ano de defesa: | 2019 |
|---|---|
| Autor(a) principal: | |
| Orientador(a): | , |
| Banca de defesa: | , |
| Tipo de documento: | Dissertação |
| Tipo de acesso: | Acesso aberto |
| Idioma: | eng |
| Instituição de defesa: |
Universidade Federal de Campina Grande
|
| Programa de Pós-Graduação: |
PÓS-GRADUAÇÃO EM CIÊNCIA DA COMPUTAÇÃO
|
| Departamento: |
Centro de Engenharia Elétrica e Informática - CEEI
|
| País: |
Brasil
|
| Palavras-chave em Português: | |
| Área do conhecimento CNPq: | |
| Link de acesso: | https://dspace.sti.ufcg.edu.br/handle/riufcg/8217 |
Resumo: | Learning to program is a challenge faced by students in most introductory programming courses. Recently, several tools have been proposed in order to provide guidance and help students overcome conceptual difficulties in programming education. Some tools leverage clustering algorithms and program repair techniques to automatically generate personalized hints for students’ incorrect programs. In contrast, some teachers choose to present students with program visualization tools to help them understand the dynamic execution of a source code. These tools are used to help students get correct solutions for programming assignments. However, due to limitations in assessments, it is still unclear how effective the feedback provided by these tools is. In this study, we analyzed the effectiveness of a tool for generating personalized hints and a tool for visualizing programs. To do so, we conducted a user study in which students, assisted by these tools, implemented solutions for three programming problems. Our results show that personalized hints can significantly reduce student’s effort to get correct solutions. In addition, personalized hints can provide students with an understanding of problem solving similar to when using test cases. On the other hand, students who used the program visualization tool got lower performance than using other approaches. |
| id |
UFCG_dc16d36cff611fb570cd21312f3020a0 |
|---|---|
| oai_identifier_str |
oai:dspace.sti.ufcg.edu.br:riufcg/8217 |
| network_acronym_str |
UFCG |
| network_name_str |
Biblioteca Digital de Teses e Dissertações da UFCG |
| repository_id_str |
|
| spelling |
SOARES, Gustavo Araújo.SOARES, G.http://lattes.cnpq.br/6215732726947926SABINO, Melina Mongiovi Cunha Lima.MONGIOVI, M.http://lattes.cnpq.br/7535849756393864GHEYI , Rohit.BITTENCOURT, Roberto Almeida.http://lattes.cnpq.br/8460962053427361AMORIM, Ruan Victor Bertoldo Reis de.Learning to program is a challenge faced by students in most introductory programming courses. Recently, several tools have been proposed in order to provide guidance and help students overcome conceptual difficulties in programming education. Some tools leverage clustering algorithms and program repair techniques to automatically generate personalized hints for students’ incorrect programs. In contrast, some teachers choose to present students with program visualization tools to help them understand the dynamic execution of a source code. These tools are used to help students get correct solutions for programming assignments. However, due to limitations in assessments, it is still unclear how effective the feedback provided by these tools is. In this study, we analyzed the effectiveness of a tool for generating personalized hints and a tool for visualizing programs. To do so, we conducted a user study in which students, assisted by these tools, implemented solutions for three programming problems. Our results show that personalized hints can significantly reduce student’s effort to get correct solutions. In addition, personalized hints can provide students with an understanding of problem solving similar to when using test cases. On the other hand, students who used the program visualization tool got lower performance than using other approaches.Aprender a programar é um desafio enfrentado pelos alunos na maioria dos cursos de introdução à programação. Por este motivo, diversas ferramentas têm sido propostas com o propósito de ajudar os alunos a superar dificuldades conceituais durante o seu aprendizado. Existem ferramentas que utilizam algoritmos de agrupamento e técnicas de reparo de programas para gerar feedback personalizado para os alunos. Em contraste, alguns professores optam por apresentar aos alunos alguma ferramenta de visualização de programas com o intuito de ajudá-los a entender a execução dinâmica de um código-fonte. Estas ferramentas são utilizadas para auxiliar alunos na obtenção de soluções para problemas de programação. No entanto, devido à limitações nas avaliações, ainda não está claro o quão efetivo é o feedback fornecido por elas. Neste estudo, analisamos a eficácia de duas ferramentas, uma de geração de dicas personalizadas e outra de visualização de programas. Para tanto, realizamos um estudo de usuários em que os alunos, auxiliados por essas ferramentas, implementaram soluções para três problemas de programação. Nossos resultados mostram que dicas personalizadas podem reduzir significativamente o esforço do aluno para obter soluções corretas. Além disso, dicas personalizadas podem fornecer aos alunos uma compreensão da solução de problemas semelhante ao uso de casos de teste. Em contrapartida, os alunos que usaram a ferramenta de visualização de programas obtiveram desempenho inferior comparado ao uso de outras abordagens.Submitted by Maria Medeiros (maria.dilva1@ufcg.edu.br) on 2019-10-18T11:29:07Z No. of bitstreams: 1 RUAN VICTOR BERTOLDO REIS DE AMORIM - DISSERTAÇÃO (PPGCC) 2019.pdf: 991425 bytes, checksum: d71dd392e5fb19bb6e6fb1b26faee51d (MD5)Made available in DSpace on 2019-10-18T11:29:07Z (GMT). No. of bitstreams: 1 RUAN VICTOR BERTOLDO REIS DE AMORIM - DISSERTAÇÃO (PPGCC) 2019.pdf: 991425 bytes, checksum: d71dd392e5fb19bb6e6fb1b26faee51d (MD5) Previous issue date: 2019-08-19CapesUniversidade Federal de Campina GrandePÓS-GRADUAÇÃO EM CIÊNCIA DA COMPUTAÇÃOUFCGBrasilCentro de Engenharia Elétrica e Informática - CEEICiência da ComputaçãoComputação – Estudo e EnsinoProgramação de ComputadoresFerramentas de FeedbackEducaçãoComputing - Study and TeachingComputer ProgrammingFeedback ToolsEducationEvaluating feedback tools in introductory programming classes.Avaliação das ferramentas de feedback em introdução aulas de programação.2019-08-192019-10-18T11:29:07Z2019-10-182019-10-18T11:29:07Zhttps://dspace.sti.ufcg.edu.br/handle/riufcg/8217AMORIM, R. V. B. R. de. Evaluating feedback tools in introductory programming classes. 2019. 45 f. Dissertação (Mestrado em Ciência da Computação) – Pós-Graduação em Ciência da Computação, Centro de Engenharia Elétrica e Informática, Universidade Federal de Campina Grande, Paraíba, Brasil, 2019. Disponível em: https://dspace.sti.ufcg.edu.br/handle/riufcg/8217info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisenginfo:eu-repo/semantics/openAccessreponame:Biblioteca Digital de Teses e Dissertações da UFCGinstname:Universidade Federal de Campina Grande (UFCG)instacron:UFCGTEXTRUAN VICTOR BERTOLDO REIS DE AMORIM - DISSERTAÇÃO (PPGCC) 2019.pdf.txtRUAN VICTOR BERTOLDO REIS DE AMORIM - DISSERTAÇÃO (PPGCC) 2019.pdf.txttext/plain109319https://dspace.sti.ufcg.edu.br/bitstream/riufcg/8217/4/RUAN+VICTOR+BERTOLDO+REIS+DE+AMORIM+-+DISSERTA%C3%87%C3%83O+%28PPGCC%29+2019.pdf.txt285a093290f49db09c47fcd64f943e4dMD54ORIGINALRUAN VICTOR BERTOLDO REIS DE AMORIM - DISSERTAÇÃO (PPGCC) 2019.pdfRUAN VICTOR BERTOLDO REIS DE AMORIM - DISSERTAÇÃO (PPGCC) 2019.pdfapplication/pdf764764https://dspace.sti.ufcg.edu.br/bitstream/riufcg/8217/3/RUAN+VICTOR+BERTOLDO+REIS+DE+AMORIM+-+DISSERTA%C3%87%C3%83O+%28PPGCC%29+2019.pdf6d90175d39cd9d426bd950311dac36f7MD53LICENSElicense.txtlicense.txttext/plain; charset=utf-81748https://dspace.sti.ufcg.edu.br/bitstream/riufcg/8217/2/license.txt8a4605be74aa9ea9d79846c1fba20a33MD52riufcg/82172025-07-24 04:57:23.547oai:dspace.sti.ufcg.edu.br:riufcg/8217Tk9URTogUExBQ0UgWU9VUiBPV04gTElDRU5TRSBIRVJFClRoaXMgc2FtcGxlIGxpY2Vuc2UgaXMgcHJvdmlkZWQgZm9yIGluZm9ybWF0aW9uYWwgcHVycG9zZXMgb25seS4KCk5PTi1FWENMVVNJVkUgRElTVFJJQlVUSU9OIExJQ0VOU0UKCkJ5IHNpZ25pbmcgYW5kIHN1Ym1pdHRpbmcgdGhpcyBsaWNlbnNlLCB5b3UgKHRoZSBhdXRob3Iocykgb3IgY29weXJpZ2h0Cm93bmVyKSBncmFudHMgdG8gRFNwYWNlIFVuaXZlcnNpdHkgKERTVSkgdGhlIG5vbi1leGNsdXNpdmUgcmlnaHQgdG8gcmVwcm9kdWNlLAp0cmFuc2xhdGUgKGFzIGRlZmluZWQgYmVsb3cpLCBhbmQvb3IgZGlzdHJpYnV0ZSB5b3VyIHN1Ym1pc3Npb24gKGluY2x1ZGluZwp0aGUgYWJzdHJhY3QpIHdvcmxkd2lkZSBpbiBwcmludCBhbmQgZWxlY3Ryb25pYyBmb3JtYXQgYW5kIGluIGFueSBtZWRpdW0sCmluY2x1ZGluZyBidXQgbm90IGxpbWl0ZWQgdG8gYXVkaW8gb3IgdmlkZW8uCgpZb3UgYWdyZWUgdGhhdCBEU1UgbWF5LCB3aXRob3V0IGNoYW5naW5nIHRoZSBjb250ZW50LCB0cmFuc2xhdGUgdGhlCnN1Ym1pc3Npb24gdG8gYW55IG1lZGl1bSBvciBmb3JtYXQgZm9yIHRoZSBwdXJwb3NlIG9mIHByZXNlcnZhdGlvbi4KCllvdSBhbHNvIGFncmVlIHRoYXQgRFNVIG1heSBrZWVwIG1vcmUgdGhhbiBvbmUgY29weSBvZiB0aGlzIHN1Ym1pc3Npb24gZm9yCnB1cnBvc2VzIG9mIHNlY3VyaXR5LCBiYWNrLXVwIGFuZCBwcmVzZXJ2YXRpb24uCgpZb3UgcmVwcmVzZW50IHRoYXQgdGhlIHN1Ym1pc3Npb24gaXMgeW91ciBvcmlnaW5hbCB3b3JrLCBhbmQgdGhhdCB5b3UgaGF2ZQp0aGUgcmlnaHQgdG8gZ3JhbnQgdGhlIHJpZ2h0cyBjb250YWluZWQgaW4gdGhpcyBsaWNlbnNlLiBZb3UgYWxzbyByZXByZXNlbnQKdGhhdCB5b3VyIHN1Ym1pc3Npb24gZG9lcyBub3QsIHRvIHRoZSBiZXN0IG9mIHlvdXIga25vd2xlZGdlLCBpbmZyaW5nZSB1cG9uCmFueW9uZSdzIGNvcHlyaWdodC4KCklmIHRoZSBzdWJtaXNzaW9uIGNvbnRhaW5zIG1hdGVyaWFsIGZvciB3aGljaCB5b3UgZG8gbm90IGhvbGQgY29weXJpZ2h0LAp5b3UgcmVwcmVzZW50IHRoYXQgeW91IGhhdmUgb2J0YWluZWQgdGhlIHVucmVzdHJpY3RlZCBwZXJtaXNzaW9uIG9mIHRoZQpjb3B5cmlnaHQgb3duZXIgdG8gZ3JhbnQgRFNVIHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdApzdWNoIHRoaXJkLXBhcnR5IG93bmVkIG1hdGVyaWFsIGlzIGNsZWFybHkgaWRlbnRpZmllZCBhbmQgYWNrbm93bGVkZ2VkCndpdGhpbiB0aGUgdGV4dCBvciBjb250ZW50IG9mIHRoZSBzdWJtaXNzaW9uLgoKSUYgVEhFIFNVQk1JU1NJT04gSVMgQkFTRUQgVVBPTiBXT1JLIFRIQVQgSEFTIEJFRU4gU1BPTlNPUkVEIE9SIFNVUFBPUlRFRApCWSBBTiBBR0VOQ1kgT1IgT1JHQU5JWkFUSU9OIE9USEVSIFRIQU4gRFNVLCBZT1UgUkVQUkVTRU5UIFRIQVQgWU9VIEhBVkUKRlVMRklMTEVEIEFOWSBSSUdIVCBPRiBSRVZJRVcgT1IgT1RIRVIgT0JMSUdBVElPTlMgUkVRVUlSRUQgQlkgU1VDSApDT05UUkFDVCBPUiBBR1JFRU1FTlQuCgpEU1Ugd2lsbCBjbGVhcmx5IGlkZW50aWZ5IHlvdXIgbmFtZShzKSBhcyB0aGUgYXV0aG9yKHMpIG9yIG93bmVyKHMpIG9mIHRoZQpzdWJtaXNzaW9uLCBhbmQgd2lsbCBub3QgbWFrZSBhbnkgYWx0ZXJhdGlvbiwgb3RoZXIgdGhhbiBhcyBhbGxvd2VkIGJ5IHRoaXMKbGljZW5zZSwgdG8geW91ciBzdWJtaXNzaW9uLgo=Biblioteca Digital de Teses e Dissertaçõeshttp://bdtd.ufcg.edu.br/PUBhttp://dspace.sti.ufcg.edu.br:8080/oai/requestbdtd@setor.ufcg.edu.br || bdtd@setor.ufcg.edu.bropendoar:48512025-07-24T07:57:23Biblioteca Digital de Teses e Dissertações da UFCG - Universidade Federal de Campina Grande (UFCG)false |
| dc.title.pt_BR.fl_str_mv |
Evaluating feedback tools in introductory programming classes. |
| dc.title.alternative.pt_BR.fl_str_mv |
Avaliação das ferramentas de feedback em introdução aulas de programação. |
| title |
Evaluating feedback tools in introductory programming classes. |
| spellingShingle |
Evaluating feedback tools in introductory programming classes. AMORIM, Ruan Victor Bertoldo Reis de. Ciência da Computação Computação – Estudo e Ensino Programação de Computadores Ferramentas de Feedback Educação Computing - Study and Teaching Computer Programming Feedback Tools Education |
| title_short |
Evaluating feedback tools in introductory programming classes. |
| title_full |
Evaluating feedback tools in introductory programming classes. |
| title_fullStr |
Evaluating feedback tools in introductory programming classes. |
| title_full_unstemmed |
Evaluating feedback tools in introductory programming classes. |
| title_sort |
Evaluating feedback tools in introductory programming classes. |
| author |
AMORIM, Ruan Victor Bertoldo Reis de. |
| author_facet |
AMORIM, Ruan Victor Bertoldo Reis de. |
| author_role |
author |
| dc.contributor.advisor2ID.pt_BR.fl_str_mv |
MONGIOVI, M. |
| dc.contributor.advisor1.fl_str_mv |
SOARES, Gustavo Araújo. |
| dc.contributor.advisor1ID.fl_str_mv |
SOARES, G. |
| dc.contributor.advisor1Lattes.fl_str_mv |
http://lattes.cnpq.br/6215732726947926 |
| dc.contributor.advisor2.fl_str_mv |
SABINO, Melina Mongiovi Cunha Lima. |
| dc.contributor.advisor2Lattes.fl_str_mv |
http://lattes.cnpq.br/7535849756393864 |
| dc.contributor.referee1.fl_str_mv |
GHEYI , Rohit. |
| dc.contributor.referee2.fl_str_mv |
BITTENCOURT, Roberto Almeida. |
| dc.contributor.authorLattes.fl_str_mv |
http://lattes.cnpq.br/8460962053427361 |
| dc.contributor.author.fl_str_mv |
AMORIM, Ruan Victor Bertoldo Reis de. |
| contributor_str_mv |
SOARES, Gustavo Araújo. SABINO, Melina Mongiovi Cunha Lima. GHEYI , Rohit. BITTENCOURT, Roberto Almeida. |
| dc.subject.cnpq.fl_str_mv |
Ciência da Computação |
| topic |
Ciência da Computação Computação – Estudo e Ensino Programação de Computadores Ferramentas de Feedback Educação Computing - Study and Teaching Computer Programming Feedback Tools Education |
| dc.subject.por.fl_str_mv |
Computação – Estudo e Ensino Programação de Computadores Ferramentas de Feedback Educação Computing - Study and Teaching Computer Programming Feedback Tools Education |
| description |
Learning to program is a challenge faced by students in most introductory programming courses. Recently, several tools have been proposed in order to provide guidance and help students overcome conceptual difficulties in programming education. Some tools leverage clustering algorithms and program repair techniques to automatically generate personalized hints for students’ incorrect programs. In contrast, some teachers choose to present students with program visualization tools to help them understand the dynamic execution of a source code. These tools are used to help students get correct solutions for programming assignments. However, due to limitations in assessments, it is still unclear how effective the feedback provided by these tools is. In this study, we analyzed the effectiveness of a tool for generating personalized hints and a tool for visualizing programs. To do so, we conducted a user study in which students, assisted by these tools, implemented solutions for three programming problems. Our results show that personalized hints can significantly reduce student’s effort to get correct solutions. In addition, personalized hints can provide students with an understanding of problem solving similar to when using test cases. On the other hand, students who used the program visualization tool got lower performance than using other approaches. |
| publishDate |
2019 |
| dc.date.issued.fl_str_mv |
2019-08-19 |
| dc.date.accessioned.fl_str_mv |
2019-10-18T11:29:07Z |
| dc.date.available.fl_str_mv |
2019-10-18 2019-10-18T11:29:07Z |
| dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
| dc.type.driver.fl_str_mv |
info:eu-repo/semantics/masterThesis |
| format |
masterThesis |
| status_str |
publishedVersion |
| dc.identifier.uri.fl_str_mv |
https://dspace.sti.ufcg.edu.br/handle/riufcg/8217 |
| dc.identifier.citation.fl_str_mv |
AMORIM, R. V. B. R. de. Evaluating feedback tools in introductory programming classes. 2019. 45 f. Dissertação (Mestrado em Ciência da Computação) – Pós-Graduação em Ciência da Computação, Centro de Engenharia Elétrica e Informática, Universidade Federal de Campina Grande, Paraíba, Brasil, 2019. Disponível em: https://dspace.sti.ufcg.edu.br/handle/riufcg/8217 |
| url |
https://dspace.sti.ufcg.edu.br/handle/riufcg/8217 |
| identifier_str_mv |
AMORIM, R. V. B. R. de. Evaluating feedback tools in introductory programming classes. 2019. 45 f. Dissertação (Mestrado em Ciência da Computação) – Pós-Graduação em Ciência da Computação, Centro de Engenharia Elétrica e Informática, Universidade Federal de Campina Grande, Paraíba, Brasil, 2019. Disponível em: https://dspace.sti.ufcg.edu.br/handle/riufcg/8217 |
| dc.language.iso.fl_str_mv |
eng |
| language |
eng |
| dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
| eu_rights_str_mv |
openAccess |
| dc.publisher.none.fl_str_mv |
Universidade Federal de Campina Grande |
| dc.publisher.program.fl_str_mv |
PÓS-GRADUAÇÃO EM CIÊNCIA DA COMPUTAÇÃO |
| dc.publisher.initials.fl_str_mv |
UFCG |
| dc.publisher.country.fl_str_mv |
Brasil |
| dc.publisher.department.fl_str_mv |
Centro de Engenharia Elétrica e Informática - CEEI |
| publisher.none.fl_str_mv |
Universidade Federal de Campina Grande |
| dc.source.none.fl_str_mv |
reponame:Biblioteca Digital de Teses e Dissertações da UFCG instname:Universidade Federal de Campina Grande (UFCG) instacron:UFCG |
| instname_str |
Universidade Federal de Campina Grande (UFCG) |
| instacron_str |
UFCG |
| institution |
UFCG |
| reponame_str |
Biblioteca Digital de Teses e Dissertações da UFCG |
| collection |
Biblioteca Digital de Teses e Dissertações da UFCG |
| bitstream.url.fl_str_mv |
https://dspace.sti.ufcg.edu.br/bitstream/riufcg/8217/4/RUAN+VICTOR+BERTOLDO+REIS+DE+AMORIM+-+DISSERTA%C3%87%C3%83O+%28PPGCC%29+2019.pdf.txt https://dspace.sti.ufcg.edu.br/bitstream/riufcg/8217/3/RUAN+VICTOR+BERTOLDO+REIS+DE+AMORIM+-+DISSERTA%C3%87%C3%83O+%28PPGCC%29+2019.pdf https://dspace.sti.ufcg.edu.br/bitstream/riufcg/8217/2/license.txt |
| bitstream.checksum.fl_str_mv |
285a093290f49db09c47fcd64f943e4d 6d90175d39cd9d426bd950311dac36f7 8a4605be74aa9ea9d79846c1fba20a33 |
| bitstream.checksumAlgorithm.fl_str_mv |
MD5 MD5 MD5 |
| repository.name.fl_str_mv |
Biblioteca Digital de Teses e Dissertações da UFCG - Universidade Federal de Campina Grande (UFCG) |
| repository.mail.fl_str_mv |
bdtd@setor.ufcg.edu.br || bdtd@setor.ufcg.edu.br |
| _version_ |
1863363443023675392 |