Evaluating feedback tools in introductory programming classes.

Detalhes bibliográficos
Ano de defesa: 2019
Autor(a) principal: AMORIM, Ruan Victor Bertoldo Reis de. lattes
Orientador(a): SOARES, Gustavo Araújo. lattes, SABINO, Melina Mongiovi Cunha Lima. lattes
Banca de defesa: GHEYI , Rohit., BITTENCOURT, Roberto Almeida.
Tipo de documento: Dissertação
Tipo de acesso: Acesso aberto
Idioma: eng
Instituição de defesa: Universidade Federal de Campina Grande
Programa de Pós-Graduação: PÓS-GRADUAÇÃO EM CIÊNCIA DA COMPUTAÇÃO
Departamento: Centro de Engenharia Elétrica e Informática - CEEI
País: Brasil
Palavras-chave em Português:
Área do conhecimento CNPq:
Link de acesso: https://dspace.sti.ufcg.edu.br/handle/riufcg/8217
Resumo: Learning to program is a challenge faced by students in most introductory programming courses. Recently, several tools have been proposed in order to provide guidance and help students overcome conceptual difficulties in programming education. Some tools leverage clustering algorithms and program repair techniques to automatically generate personalized hints for students’ incorrect programs. In contrast, some teachers choose to present students with program visualization tools to help them understand the dynamic execution of a source code. These tools are used to help students get correct solutions for programming assignments. However, due to limitations in assessments, it is still unclear how effective the feedback provided by these tools is. In this study, we analyzed the effectiveness of a tool for generating personalized hints and a tool for visualizing programs. To do so, we conducted a user study in which students, assisted by these tools, implemented solutions for three programming problems. Our results show that personalized hints can significantly reduce student’s effort to get correct solutions. In addition, personalized hints can provide students with an understanding of problem solving similar to when using test cases. On the other hand, students who used the program visualization tool got lower performance than using other approaches.
id UFCG_dc16d36cff611fb570cd21312f3020a0
oai_identifier_str oai:dspace.sti.ufcg.edu.br:riufcg/8217
network_acronym_str UFCG
network_name_str Biblioteca Digital de Teses e Dissertações da UFCG
repository_id_str
spelling SOARES, Gustavo Araújo.SOARES, G.http://lattes.cnpq.br/6215732726947926SABINO, Melina Mongiovi Cunha Lima.MONGIOVI, M.http://lattes.cnpq.br/7535849756393864GHEYI , Rohit.BITTENCOURT, Roberto Almeida.http://lattes.cnpq.br/8460962053427361AMORIM, Ruan Victor Bertoldo Reis de.Learning to program is a challenge faced by students in most introductory programming courses. Recently, several tools have been proposed in order to provide guidance and help students overcome conceptual difficulties in programming education. Some tools leverage clustering algorithms and program repair techniques to automatically generate personalized hints for students’ incorrect programs. In contrast, some teachers choose to present students with program visualization tools to help them understand the dynamic execution of a source code. These tools are used to help students get correct solutions for programming assignments. However, due to limitations in assessments, it is still unclear how effective the feedback provided by these tools is. In this study, we analyzed the effectiveness of a tool for generating personalized hints and a tool for visualizing programs. To do so, we conducted a user study in which students, assisted by these tools, implemented solutions for three programming problems. Our results show that personalized hints can significantly reduce student’s effort to get correct solutions. In addition, personalized hints can provide students with an understanding of problem solving similar to when using test cases. On the other hand, students who used the program visualization tool got lower performance than using other approaches.Aprender a programar é um desafio enfrentado pelos alunos na maioria dos cursos de introdução à programação. Por este motivo, diversas ferramentas têm sido propostas com o propósito de ajudar os alunos a superar dificuldades conceituais durante o seu aprendizado. Existem ferramentas que utilizam algoritmos de agrupamento e técnicas de reparo de programas para gerar feedback personalizado para os alunos. Em contraste, alguns professores optam por apresentar aos alunos alguma ferramenta de visualização de programas com o intuito de ajudá-los a entender a execução dinâmica de um código-fonte. Estas ferramentas são utilizadas para auxiliar alunos na obtenção de soluções para problemas de programação. No entanto, devido à limitações nas avaliações, ainda não está claro o quão efetivo é o feedback fornecido por elas. Neste estudo, analisamos a eficácia de duas ferramentas, uma de geração de dicas personalizadas e outra de visualização de programas. Para tanto, realizamos um estudo de usuários em que os alunos, auxiliados por essas ferramentas, implementaram soluções para três problemas de programação. Nossos resultados mostram que dicas personalizadas podem reduzir significativamente o esforço do aluno para obter soluções corretas. Além disso, dicas personalizadas podem fornecer aos alunos uma compreensão da solução de problemas semelhante ao uso de casos de teste. Em contrapartida, os alunos que usaram a ferramenta de visualização de programas obtiveram desempenho inferior comparado ao uso de outras abordagens.Submitted by Maria Medeiros (maria.dilva1@ufcg.edu.br) on 2019-10-18T11:29:07Z No. of bitstreams: 1 RUAN VICTOR BERTOLDO REIS DE AMORIM - DISSERTAÇÃO (PPGCC) 2019.pdf: 991425 bytes, checksum: d71dd392e5fb19bb6e6fb1b26faee51d (MD5)Made available in DSpace on 2019-10-18T11:29:07Z (GMT). No. of bitstreams: 1 RUAN VICTOR BERTOLDO REIS DE AMORIM - DISSERTAÇÃO (PPGCC) 2019.pdf: 991425 bytes, checksum: d71dd392e5fb19bb6e6fb1b26faee51d (MD5) Previous issue date: 2019-08-19CapesUniversidade Federal de Campina GrandePÓS-GRADUAÇÃO EM CIÊNCIA DA COMPUTAÇÃOUFCGBrasilCentro de Engenharia Elétrica e Informática - CEEICiência da ComputaçãoComputação – Estudo e EnsinoProgramação de ComputadoresFerramentas de FeedbackEducaçãoComputing - Study and TeachingComputer ProgrammingFeedback ToolsEducationEvaluating feedback tools in introductory programming classes.Avaliação das ferramentas de feedback em introdução aulas de programação.2019-08-192019-10-18T11:29:07Z2019-10-182019-10-18T11:29:07Zhttps://dspace.sti.ufcg.edu.br/handle/riufcg/8217AMORIM, R. V. B. R. de. Evaluating feedback tools in introductory programming classes. 2019. 45 f. Dissertação (Mestrado em Ciência da Computação) – Pós-Graduação em Ciência da Computação, Centro de Engenharia Elétrica e Informática, Universidade Federal de Campina Grande, Paraíba, Brasil, 2019. Disponível em: https://dspace.sti.ufcg.edu.br/handle/riufcg/8217info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisenginfo:eu-repo/semantics/openAccessreponame:Biblioteca Digital de Teses e Dissertações da UFCGinstname:Universidade Federal de Campina Grande (UFCG)instacron:UFCGTEXTRUAN VICTOR BERTOLDO REIS DE AMORIM - DISSERTAÇÃO (PPGCC) 2019.pdf.txtRUAN VICTOR BERTOLDO REIS DE AMORIM - DISSERTAÇÃO (PPGCC) 2019.pdf.txttext/plain109319https://dspace.sti.ufcg.edu.br/bitstream/riufcg/8217/4/RUAN+VICTOR+BERTOLDO+REIS+DE+AMORIM+-+DISSERTA%C3%87%C3%83O+%28PPGCC%29+2019.pdf.txt285a093290f49db09c47fcd64f943e4dMD54ORIGINALRUAN VICTOR BERTOLDO REIS DE AMORIM - DISSERTAÇÃO (PPGCC) 2019.pdfRUAN VICTOR BERTOLDO REIS DE AMORIM - DISSERTAÇÃO (PPGCC) 2019.pdfapplication/pdf764764https://dspace.sti.ufcg.edu.br/bitstream/riufcg/8217/3/RUAN+VICTOR+BERTOLDO+REIS+DE+AMORIM+-+DISSERTA%C3%87%C3%83O+%28PPGCC%29+2019.pdf6d90175d39cd9d426bd950311dac36f7MD53LICENSElicense.txtlicense.txttext/plain; charset=utf-81748https://dspace.sti.ufcg.edu.br/bitstream/riufcg/8217/2/license.txt8a4605be74aa9ea9d79846c1fba20a33MD52riufcg/82172025-07-24 04:57:23.547oai:dspace.sti.ufcg.edu.br:riufcg/8217Tk9URTogUExBQ0UgWU9VUiBPV04gTElDRU5TRSBIRVJFClRoaXMgc2FtcGxlIGxpY2Vuc2UgaXMgcHJvdmlkZWQgZm9yIGluZm9ybWF0aW9uYWwgcHVycG9zZXMgb25seS4KCk5PTi1FWENMVVNJVkUgRElTVFJJQlVUSU9OIExJQ0VOU0UKCkJ5IHNpZ25pbmcgYW5kIHN1Ym1pdHRpbmcgdGhpcyBsaWNlbnNlLCB5b3UgKHRoZSBhdXRob3Iocykgb3IgY29weXJpZ2h0Cm93bmVyKSBncmFudHMgdG8gRFNwYWNlIFVuaXZlcnNpdHkgKERTVSkgdGhlIG5vbi1leGNsdXNpdmUgcmlnaHQgdG8gcmVwcm9kdWNlLAp0cmFuc2xhdGUgKGFzIGRlZmluZWQgYmVsb3cpLCBhbmQvb3IgZGlzdHJpYnV0ZSB5b3VyIHN1Ym1pc3Npb24gKGluY2x1ZGluZwp0aGUgYWJzdHJhY3QpIHdvcmxkd2lkZSBpbiBwcmludCBhbmQgZWxlY3Ryb25pYyBmb3JtYXQgYW5kIGluIGFueSBtZWRpdW0sCmluY2x1ZGluZyBidXQgbm90IGxpbWl0ZWQgdG8gYXVkaW8gb3IgdmlkZW8uCgpZb3UgYWdyZWUgdGhhdCBEU1UgbWF5LCB3aXRob3V0IGNoYW5naW5nIHRoZSBjb250ZW50LCB0cmFuc2xhdGUgdGhlCnN1Ym1pc3Npb24gdG8gYW55IG1lZGl1bSBvciBmb3JtYXQgZm9yIHRoZSBwdXJwb3NlIG9mIHByZXNlcnZhdGlvbi4KCllvdSBhbHNvIGFncmVlIHRoYXQgRFNVIG1heSBrZWVwIG1vcmUgdGhhbiBvbmUgY29weSBvZiB0aGlzIHN1Ym1pc3Npb24gZm9yCnB1cnBvc2VzIG9mIHNlY3VyaXR5LCBiYWNrLXVwIGFuZCBwcmVzZXJ2YXRpb24uCgpZb3UgcmVwcmVzZW50IHRoYXQgdGhlIHN1Ym1pc3Npb24gaXMgeW91ciBvcmlnaW5hbCB3b3JrLCBhbmQgdGhhdCB5b3UgaGF2ZQp0aGUgcmlnaHQgdG8gZ3JhbnQgdGhlIHJpZ2h0cyBjb250YWluZWQgaW4gdGhpcyBsaWNlbnNlLiBZb3UgYWxzbyByZXByZXNlbnQKdGhhdCB5b3VyIHN1Ym1pc3Npb24gZG9lcyBub3QsIHRvIHRoZSBiZXN0IG9mIHlvdXIga25vd2xlZGdlLCBpbmZyaW5nZSB1cG9uCmFueW9uZSdzIGNvcHlyaWdodC4KCklmIHRoZSBzdWJtaXNzaW9uIGNvbnRhaW5zIG1hdGVyaWFsIGZvciB3aGljaCB5b3UgZG8gbm90IGhvbGQgY29weXJpZ2h0LAp5b3UgcmVwcmVzZW50IHRoYXQgeW91IGhhdmUgb2J0YWluZWQgdGhlIHVucmVzdHJpY3RlZCBwZXJtaXNzaW9uIG9mIHRoZQpjb3B5cmlnaHQgb3duZXIgdG8gZ3JhbnQgRFNVIHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdApzdWNoIHRoaXJkLXBhcnR5IG93bmVkIG1hdGVyaWFsIGlzIGNsZWFybHkgaWRlbnRpZmllZCBhbmQgYWNrbm93bGVkZ2VkCndpdGhpbiB0aGUgdGV4dCBvciBjb250ZW50IG9mIHRoZSBzdWJtaXNzaW9uLgoKSUYgVEhFIFNVQk1JU1NJT04gSVMgQkFTRUQgVVBPTiBXT1JLIFRIQVQgSEFTIEJFRU4gU1BPTlNPUkVEIE9SIFNVUFBPUlRFRApCWSBBTiBBR0VOQ1kgT1IgT1JHQU5JWkFUSU9OIE9USEVSIFRIQU4gRFNVLCBZT1UgUkVQUkVTRU5UIFRIQVQgWU9VIEhBVkUKRlVMRklMTEVEIEFOWSBSSUdIVCBPRiBSRVZJRVcgT1IgT1RIRVIgT0JMSUdBVElPTlMgUkVRVUlSRUQgQlkgU1VDSApDT05UUkFDVCBPUiBBR1JFRU1FTlQuCgpEU1Ugd2lsbCBjbGVhcmx5IGlkZW50aWZ5IHlvdXIgbmFtZShzKSBhcyB0aGUgYXV0aG9yKHMpIG9yIG93bmVyKHMpIG9mIHRoZQpzdWJtaXNzaW9uLCBhbmQgd2lsbCBub3QgbWFrZSBhbnkgYWx0ZXJhdGlvbiwgb3RoZXIgdGhhbiBhcyBhbGxvd2VkIGJ5IHRoaXMKbGljZW5zZSwgdG8geW91ciBzdWJtaXNzaW9uLgo=Biblioteca Digital de Teses e Dissertaçõeshttp://bdtd.ufcg.edu.br/PUBhttp://dspace.sti.ufcg.edu.br:8080/oai/requestbdtd@setor.ufcg.edu.br || bdtd@setor.ufcg.edu.bropendoar:48512025-07-24T07:57:23Biblioteca Digital de Teses e Dissertações da UFCG - Universidade Federal de Campina Grande (UFCG)false
dc.title.pt_BR.fl_str_mv Evaluating feedback tools in introductory programming classes.
dc.title.alternative.pt_BR.fl_str_mv Avaliação das ferramentas de feedback em introdução aulas de programação.
title Evaluating feedback tools in introductory programming classes.
spellingShingle Evaluating feedback tools in introductory programming classes.
AMORIM, Ruan Victor Bertoldo Reis de.
Ciência da Computação
Computação – Estudo e Ensino
Programação de Computadores
Ferramentas de Feedback
Educação
Computing - Study and Teaching
Computer Programming
Feedback Tools
Education
title_short Evaluating feedback tools in introductory programming classes.
title_full Evaluating feedback tools in introductory programming classes.
title_fullStr Evaluating feedback tools in introductory programming classes.
title_full_unstemmed Evaluating feedback tools in introductory programming classes.
title_sort Evaluating feedback tools in introductory programming classes.
author AMORIM, Ruan Victor Bertoldo Reis de.
author_facet AMORIM, Ruan Victor Bertoldo Reis de.
author_role author
dc.contributor.advisor2ID.pt_BR.fl_str_mv MONGIOVI, M.
dc.contributor.advisor1.fl_str_mv SOARES, Gustavo Araújo.
dc.contributor.advisor1ID.fl_str_mv SOARES, G.
dc.contributor.advisor1Lattes.fl_str_mv http://lattes.cnpq.br/6215732726947926
dc.contributor.advisor2.fl_str_mv SABINO, Melina Mongiovi Cunha Lima.
dc.contributor.advisor2Lattes.fl_str_mv http://lattes.cnpq.br/7535849756393864
dc.contributor.referee1.fl_str_mv GHEYI , Rohit.
dc.contributor.referee2.fl_str_mv BITTENCOURT, Roberto Almeida.
dc.contributor.authorLattes.fl_str_mv http://lattes.cnpq.br/8460962053427361
dc.contributor.author.fl_str_mv AMORIM, Ruan Victor Bertoldo Reis de.
contributor_str_mv SOARES, Gustavo Araújo.
SABINO, Melina Mongiovi Cunha Lima.
GHEYI , Rohit.
BITTENCOURT, Roberto Almeida.
dc.subject.cnpq.fl_str_mv Ciência da Computação
topic Ciência da Computação
Computação – Estudo e Ensino
Programação de Computadores
Ferramentas de Feedback
Educação
Computing - Study and Teaching
Computer Programming
Feedback Tools
Education
dc.subject.por.fl_str_mv Computação – Estudo e Ensino
Programação de Computadores
Ferramentas de Feedback
Educação
Computing - Study and Teaching
Computer Programming
Feedback Tools
Education
description Learning to program is a challenge faced by students in most introductory programming courses. Recently, several tools have been proposed in order to provide guidance and help students overcome conceptual difficulties in programming education. Some tools leverage clustering algorithms and program repair techniques to automatically generate personalized hints for students’ incorrect programs. In contrast, some teachers choose to present students with program visualization tools to help them understand the dynamic execution of a source code. These tools are used to help students get correct solutions for programming assignments. However, due to limitations in assessments, it is still unclear how effective the feedback provided by these tools is. In this study, we analyzed the effectiveness of a tool for generating personalized hints and a tool for visualizing programs. To do so, we conducted a user study in which students, assisted by these tools, implemented solutions for three programming problems. Our results show that personalized hints can significantly reduce student’s effort to get correct solutions. In addition, personalized hints can provide students with an understanding of problem solving similar to when using test cases. On the other hand, students who used the program visualization tool got lower performance than using other approaches.
publishDate 2019
dc.date.issued.fl_str_mv 2019-08-19
dc.date.accessioned.fl_str_mv 2019-10-18T11:29:07Z
dc.date.available.fl_str_mv 2019-10-18
2019-10-18T11:29:07Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://dspace.sti.ufcg.edu.br/handle/riufcg/8217
dc.identifier.citation.fl_str_mv AMORIM, R. V. B. R. de. Evaluating feedback tools in introductory programming classes. 2019. 45 f. Dissertação (Mestrado em Ciência da Computação) – Pós-Graduação em Ciência da Computação, Centro de Engenharia Elétrica e Informática, Universidade Federal de Campina Grande, Paraíba, Brasil, 2019. Disponível em: https://dspace.sti.ufcg.edu.br/handle/riufcg/8217
url https://dspace.sti.ufcg.edu.br/handle/riufcg/8217
identifier_str_mv AMORIM, R. V. B. R. de. Evaluating feedback tools in introductory programming classes. 2019. 45 f. Dissertação (Mestrado em Ciência da Computação) – Pós-Graduação em Ciência da Computação, Centro de Engenharia Elétrica e Informática, Universidade Federal de Campina Grande, Paraíba, Brasil, 2019. Disponível em: https://dspace.sti.ufcg.edu.br/handle/riufcg/8217
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Universidade Federal de Campina Grande
dc.publisher.program.fl_str_mv PÓS-GRADUAÇÃO EM CIÊNCIA DA COMPUTAÇÃO
dc.publisher.initials.fl_str_mv UFCG
dc.publisher.country.fl_str_mv Brasil
dc.publisher.department.fl_str_mv Centro de Engenharia Elétrica e Informática - CEEI
publisher.none.fl_str_mv Universidade Federal de Campina Grande
dc.source.none.fl_str_mv reponame:Biblioteca Digital de Teses e Dissertações da UFCG
instname:Universidade Federal de Campina Grande (UFCG)
instacron:UFCG
instname_str Universidade Federal de Campina Grande (UFCG)
instacron_str UFCG
institution UFCG
reponame_str Biblioteca Digital de Teses e Dissertações da UFCG
collection Biblioteca Digital de Teses e Dissertações da UFCG
bitstream.url.fl_str_mv https://dspace.sti.ufcg.edu.br/bitstream/riufcg/8217/4/RUAN+VICTOR+BERTOLDO+REIS+DE+AMORIM+-+DISSERTA%C3%87%C3%83O+%28PPGCC%29+2019.pdf.txt
https://dspace.sti.ufcg.edu.br/bitstream/riufcg/8217/3/RUAN+VICTOR+BERTOLDO+REIS+DE+AMORIM+-+DISSERTA%C3%87%C3%83O+%28PPGCC%29+2019.pdf
https://dspace.sti.ufcg.edu.br/bitstream/riufcg/8217/2/license.txt
bitstream.checksum.fl_str_mv 285a093290f49db09c47fcd64f943e4d
6d90175d39cd9d426bd950311dac36f7
8a4605be74aa9ea9d79846c1fba20a33
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
MD5
repository.name.fl_str_mv Biblioteca Digital de Teses e Dissertações da UFCG - Universidade Federal de Campina Grande (UFCG)
repository.mail.fl_str_mv bdtd@setor.ufcg.edu.br || bdtd@setor.ufcg.edu.br
_version_ 1863363443023675392