A matriz gesto-sinais e a multimodalidade no processo de reconto de narrativas por crianças surdas e codas

Detalhes bibliográficos
Ano de defesa: 2025
Autor(a) principal: Sousa, Francisco Ebson Gomes
Orientador(a): Não Informado pela instituição
Banca de defesa: Não Informado pela instituição
Tipo de documento: Tese
Tipo de acesso: Acesso aberto
Idioma: por
Instituição de defesa: Universidade Federal da Paraíba
Brasil
Linguística
Programa de Pós-Graduação em Linguística
UFPB
Programa de Pós-Graduação: Não Informado pela instituição
Departamento: Não Informado pela instituição
País: Não Informado pela instituição
Palavras-chave em Português:
Link de acesso: https://repositorio.ufpb.br/jspui/handle/123456789/37226
Resumo: This thesis investigates the process of retelling narratives by deaf children and codas (Children of Deaf Adults). It uses a multimodal approach that encompasses language beyond the spoken word, incorporating signs, gestures, facial expressions, gaze, use of space, and other semiotic resources that shape the communicative complexity of these children. Within the field of language acquisition, the research begins with the central issue of how deaf children and codas, in the process of language acquisition, retell narratives. It seeks to understand the relationships established between signs and the gesture-speech matrix traditionally described in the literature, proposing the gesture-sign matrix as a contribution. The general objective was to understand the functioning of this gesture-sign matrix in the retellings produced in dialogic contexts by deaf children and codas, being operationalized by the specific objectives of (I) understanding the importance of retelling for the linguistic development of these children, (II) investigating the functions of gestures in the retelling of multimodal narratives and (III) observing the multimodal aspects triggered by them when retelling stories. The research has a qualitative and descriptive character, anchored in the analysis of video recordings of retellings carried out by deaf children and codas, in which the articulation between different multimodal resources was observed, such as Libras (Brazilian Sign Language) signs, iconic gestures, pantomimes, facial expressions, classifiers and the strategic use of discursive space. Theoretically based on prominent authors in the studies of multimodality, gestures and language acquisition, such as: Kendon (2000, 2009), McNeill (1992, 2000, 2013), Tomasello (2009, 2021), Goldin-Meadow (2003, 2009), Quadros (1997, 2003, 2006), Cavalcante (1994, 2018, 2019), McCleary and Viotti (2011), the study also dialogues with national and international perspectives that recognize gestures not only as complements to speech or signaling, but as constitutive elements of human language. The results show that, in the retelling process, deaf and coda children mobilize distinct multimodal repertoires, anchored in diverse linguistic experiences and different modalities, whether oral-auditory or gestural-visual, constructing rich and visually complex narratives. The main finding, the proposition of the gesture-sign matrix, expands the classic gesture-speech matrix model, considering the specificities of visual-spatial languages, such as Libras. This gesture-sign matrix reveals that linguistic signs, iconic gestures, pantomimes, and other gestural resources co-occur in an integrated and dynamic manner in the act of enunciation, functioning as co-participating elements in the production of meaning. Furthermore, it was found that retelling narratives constitutes a relevant practice for linguistic and cognitive development, fostering the construction of discursive memory, identity, and cultural belonging, especially in the case of deaf children. The central contribution of this research, therefore, lies in the systematization of the gesture-sign matrix as an analytical tool for studying language acquisition in children who use sign languages, fostering a more sensitive perspective on the multimodal specificities of these languages. This proposal broadens the field of research on multimodality and language acquisition, particularly regarding the need to consider the integration of signs and gestures in the analysis of children's linguistic development in bilingual and bimodal contexts.
id UFPB_a587c14c80b78b237a68937aa32bb12c
oai_identifier_str oai:repositorio.ufpb.br:123456789/37226
network_acronym_str UFPB
network_name_str Biblioteca Digital de Teses e Dissertações da UFPB
repository_id_str
spelling A matriz gesto-sinais e a multimodalidade no processo de reconto de narrativas por crianças surdas e codasSurdosMultimodalidade - CodasMatriz - Gesto-sinaisAquisição da linguagemLanguage acquisitionMultimodalityGesture-sgn matrixDeafsCNPQ::LINGUISTICA, LETRAS E ARTES::LINGUISTICAThis thesis investigates the process of retelling narratives by deaf children and codas (Children of Deaf Adults). It uses a multimodal approach that encompasses language beyond the spoken word, incorporating signs, gestures, facial expressions, gaze, use of space, and other semiotic resources that shape the communicative complexity of these children. Within the field of language acquisition, the research begins with the central issue of how deaf children and codas, in the process of language acquisition, retell narratives. It seeks to understand the relationships established between signs and the gesture-speech matrix traditionally described in the literature, proposing the gesture-sign matrix as a contribution. The general objective was to understand the functioning of this gesture-sign matrix in the retellings produced in dialogic contexts by deaf children and codas, being operationalized by the specific objectives of (I) understanding the importance of retelling for the linguistic development of these children, (II) investigating the functions of gestures in the retelling of multimodal narratives and (III) observing the multimodal aspects triggered by them when retelling stories. The research has a qualitative and descriptive character, anchored in the analysis of video recordings of retellings carried out by deaf children and codas, in which the articulation between different multimodal resources was observed, such as Libras (Brazilian Sign Language) signs, iconic gestures, pantomimes, facial expressions, classifiers and the strategic use of discursive space. Theoretically based on prominent authors in the studies of multimodality, gestures and language acquisition, such as: Kendon (2000, 2009), McNeill (1992, 2000, 2013), Tomasello (2009, 2021), Goldin-Meadow (2003, 2009), Quadros (1997, 2003, 2006), Cavalcante (1994, 2018, 2019), McCleary and Viotti (2011), the study also dialogues with national and international perspectives that recognize gestures not only as complements to speech or signaling, but as constitutive elements of human language. The results show that, in the retelling process, deaf and coda children mobilize distinct multimodal repertoires, anchored in diverse linguistic experiences and different modalities, whether oral-auditory or gestural-visual, constructing rich and visually complex narratives. The main finding, the proposition of the gesture-sign matrix, expands the classic gesture-speech matrix model, considering the specificities of visual-spatial languages, such as Libras. This gesture-sign matrix reveals that linguistic signs, iconic gestures, pantomimes, and other gestural resources co-occur in an integrated and dynamic manner in the act of enunciation, functioning as co-participating elements in the production of meaning. Furthermore, it was found that retelling narratives constitutes a relevant practice for linguistic and cognitive development, fostering the construction of discursive memory, identity, and cultural belonging, especially in the case of deaf children. The central contribution of this research, therefore, lies in the systematization of the gesture-sign matrix as an analytical tool for studying language acquisition in children who use sign languages, fostering a more sensitive perspective on the multimodal specificities of these languages. This proposal broadens the field of research on multimodality and language acquisition, particularly regarding the need to consider the integration of signs and gestures in the analysis of children's linguistic development in bilingual and bimodal contexts.NenhumaA presente tese investiga o processo de reconto de narrativas por crianças surdas e codas (Children of Deaf Adults), partindo de uma abordagem multimodal que compreende a linguagem para além da palavra falada, incorporando sinais, gestos, expressões faciais, olhar, uso do espaço e demais recursos semióticos que configuram a complexidade comunicativa dessas crianças. Inserida no campo da aquisição da linguagem, a pesquisa parte da problemática central sobre como crianças surdas e codas, em processo de aquisição da linguagem, recontam narrativas, buscando compreender as relações estabelecidas entre os sinais e a matriz gesto-fala tradicionalmente descrita na literatura, propondo como contribuição a matriz gesto-sinais. O objetivo geral consistiu em compreender o funcionamento dessa matriz gesto-sinais nos recontos produzidos em contextos dialógicos por crianças surdas e codas, sendo operacionalizado pelos objetivos específicos de (I) compreender a importância do reconto para o desenvolvimento linguístico dessas crianças, (II) investigar as funções dos gestos nos recontos de narrativas multimodais e (III) observar os aspectos multimodais acionados por elas ao recontar histórias. A pesquisa possui caráter qualitativo e descritivo, ancorada na análise de registros em vídeo de recontos realizados por crianças surdas e codas, nos quais se observou a articulação entre diferentes recursos multimodais, tais como sinais da Libras (Língua Brasileira de Sinais), gestos icônicos, pantomimas, expressões faciais, classificadores e o uso estratégico do espaço discursivo. Fundamentada teoricamente em autores de destaque nos estudos de multimodalidade, gestualidade e aquisição da linguagem, como: Kendon (2000, 2009), McNeill (1992, 2000, 2013), Tomasello (2009, 2021), Goldin-Meadow (2003, 2009), Quadros (1997, 2003, 2006), Cavalcante (1994, 2018, 2019) e McCleary e Viotti (2011), o estudo dialoga ainda com perspectivas nacionais e internacionais que reconhecem os gestos não apenas como complementos da fala ou sinalização, mas como elementos constitutivos da linguagem humana. Os resultados evidenciam que, no processo de reconto, crianças surdas e codas mobilizam repertórios multimodais distintos, ancorados em experiências linguísticas diversas e em diferentes modalidades, seja oral-auditiva ou gestual-visual, construindo narrativas ricas e visualmente complexas. O principal achado, a proposição da matriz gesto-sinais, amplia o modelo clássico da matriz gesto-fala, considerando as especificidades das línguas visuais-espaciais, como a Libras. Essa matriz gesto-sinais revela que sinais linguísticos, gestos icônicos, pantomimas e outros recursos gestuais coocorrem de forma integrada e dinâmica no ato enunciativo, funcionando como elementos coparticipantes na produção de sentido no contexto dialógico. Além disso, constatou-se que o reconto de narrativas constitui prática relevante para o desenvolvimento linguístico e cognitivo, favorecendo a construção de memória discursiva, identidade e pertencimento cultural, especialmente no caso das crianças surdas. A contribuição central da pesquisa reside, portanto, na sistematização da matriz gesto-sinais como ferramenta analítica voltada para os estudos da aquisição da linguagem em crianças que utilizam línguas de sinais, promovendo um olhar mais sensível às especificidades multimodais dessas línguas. Essa proposta amplia o campo de investigação sobre multimodalidade e aquisição da linguagem, principalmente sobre a necessidade de considerar a integração entre sinais e gestos na análise do desenvolvimento linguístico infantil em contextos bilíngues e bimodais.Universidade Federal da ParaíbaBrasilLinguísticaPrograma de Pós-Graduação em LinguísticaUFPBCavalcante, Marianne Carvalho Bezerrahttp://lattes.cnpq.br/8916191109480157Del Ré, Alessandrahttp://lattes.cnpq.br/4188483346917822Faria, Evangelina Maria Brito dehttp://lattes.cnpq.br/1042071001002488Leite, Jan Edson Rodrigueshttp://lattes.cnpq.br/6349030710525621Vieira, Alessandra Jacquelinehttp://lattes.cnpq.br/3470757521359273Lima-Neto, Vicente dehttp://lattes.cnpq.br/7236640942719268Sousa, Francisco Ebson Gomes2026-01-03T21:39:49Z2025-09-292026-01-03T21:39:49Z2025-07-29info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesishttps://repositorio.ufpb.br/jspui/handle/123456789/37226porAttribution-NoDerivs 3.0 Brazilhttp://creativecommons.org/licenses/by-nd/3.0/br/info:eu-repo/semantics/openAccessreponame:Biblioteca Digital de Teses e Dissertações da UFPBinstname:Universidade Federal da Paraíba (UFPB)instacron:UFPB2026-01-04T06:05:50Zoai:repositorio.ufpb.br:123456789/37226Biblioteca Digital de Teses e Dissertaçõeshttps://repositorio.ufpb.br/PUBhttp://tede.biblioteca.ufpb.br:8080/oai/requestdiretoria@ufpb.br|| bdtd@biblioteca.ufpb.bropendoar:2026-01-04T06:05:50Biblioteca Digital de Teses e Dissertações da UFPB - Universidade Federal da Paraíba (UFPB)false
dc.title.none.fl_str_mv A matriz gesto-sinais e a multimodalidade no processo de reconto de narrativas por crianças surdas e codas
title A matriz gesto-sinais e a multimodalidade no processo de reconto de narrativas por crianças surdas e codas
spellingShingle A matriz gesto-sinais e a multimodalidade no processo de reconto de narrativas por crianças surdas e codas
Sousa, Francisco Ebson Gomes
Surdos
Multimodalidade - Codas
Matriz - Gesto-sinais
Aquisição da linguagem
Language acquisition
Multimodality
Gesture-sgn matrix
Deafs
CNPQ::LINGUISTICA, LETRAS E ARTES::LINGUISTICA
title_short A matriz gesto-sinais e a multimodalidade no processo de reconto de narrativas por crianças surdas e codas
title_full A matriz gesto-sinais e a multimodalidade no processo de reconto de narrativas por crianças surdas e codas
title_fullStr A matriz gesto-sinais e a multimodalidade no processo de reconto de narrativas por crianças surdas e codas
title_full_unstemmed A matriz gesto-sinais e a multimodalidade no processo de reconto de narrativas por crianças surdas e codas
title_sort A matriz gesto-sinais e a multimodalidade no processo de reconto de narrativas por crianças surdas e codas
author Sousa, Francisco Ebson Gomes
author_facet Sousa, Francisco Ebson Gomes
author_role author
dc.contributor.none.fl_str_mv Cavalcante, Marianne Carvalho Bezerra
http://lattes.cnpq.br/8916191109480157
Del Ré, Alessandra
http://lattes.cnpq.br/4188483346917822
Faria, Evangelina Maria Brito de
http://lattes.cnpq.br/1042071001002488
Leite, Jan Edson Rodrigues
http://lattes.cnpq.br/6349030710525621
Vieira, Alessandra Jacqueline
http://lattes.cnpq.br/3470757521359273
Lima-Neto, Vicente de
http://lattes.cnpq.br/7236640942719268
dc.contributor.author.fl_str_mv Sousa, Francisco Ebson Gomes
dc.subject.por.fl_str_mv Surdos
Multimodalidade - Codas
Matriz - Gesto-sinais
Aquisição da linguagem
Language acquisition
Multimodality
Gesture-sgn matrix
Deafs
CNPQ::LINGUISTICA, LETRAS E ARTES::LINGUISTICA
topic Surdos
Multimodalidade - Codas
Matriz - Gesto-sinais
Aquisição da linguagem
Language acquisition
Multimodality
Gesture-sgn matrix
Deafs
CNPQ::LINGUISTICA, LETRAS E ARTES::LINGUISTICA
description This thesis investigates the process of retelling narratives by deaf children and codas (Children of Deaf Adults). It uses a multimodal approach that encompasses language beyond the spoken word, incorporating signs, gestures, facial expressions, gaze, use of space, and other semiotic resources that shape the communicative complexity of these children. Within the field of language acquisition, the research begins with the central issue of how deaf children and codas, in the process of language acquisition, retell narratives. It seeks to understand the relationships established between signs and the gesture-speech matrix traditionally described in the literature, proposing the gesture-sign matrix as a contribution. The general objective was to understand the functioning of this gesture-sign matrix in the retellings produced in dialogic contexts by deaf children and codas, being operationalized by the specific objectives of (I) understanding the importance of retelling for the linguistic development of these children, (II) investigating the functions of gestures in the retelling of multimodal narratives and (III) observing the multimodal aspects triggered by them when retelling stories. The research has a qualitative and descriptive character, anchored in the analysis of video recordings of retellings carried out by deaf children and codas, in which the articulation between different multimodal resources was observed, such as Libras (Brazilian Sign Language) signs, iconic gestures, pantomimes, facial expressions, classifiers and the strategic use of discursive space. Theoretically based on prominent authors in the studies of multimodality, gestures and language acquisition, such as: Kendon (2000, 2009), McNeill (1992, 2000, 2013), Tomasello (2009, 2021), Goldin-Meadow (2003, 2009), Quadros (1997, 2003, 2006), Cavalcante (1994, 2018, 2019), McCleary and Viotti (2011), the study also dialogues with national and international perspectives that recognize gestures not only as complements to speech or signaling, but as constitutive elements of human language. The results show that, in the retelling process, deaf and coda children mobilize distinct multimodal repertoires, anchored in diverse linguistic experiences and different modalities, whether oral-auditory or gestural-visual, constructing rich and visually complex narratives. The main finding, the proposition of the gesture-sign matrix, expands the classic gesture-speech matrix model, considering the specificities of visual-spatial languages, such as Libras. This gesture-sign matrix reveals that linguistic signs, iconic gestures, pantomimes, and other gestural resources co-occur in an integrated and dynamic manner in the act of enunciation, functioning as co-participating elements in the production of meaning. Furthermore, it was found that retelling narratives constitutes a relevant practice for linguistic and cognitive development, fostering the construction of discursive memory, identity, and cultural belonging, especially in the case of deaf children. The central contribution of this research, therefore, lies in the systematization of the gesture-sign matrix as an analytical tool for studying language acquisition in children who use sign languages, fostering a more sensitive perspective on the multimodal specificities of these languages. This proposal broadens the field of research on multimodality and language acquisition, particularly regarding the need to consider the integration of signs and gestures in the analysis of children's linguistic development in bilingual and bimodal contexts.
publishDate 2025
dc.date.none.fl_str_mv 2025-09-29
2025-07-29
2026-01-03T21:39:49Z
2026-01-03T21:39:49Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/doctoralThesis
format doctoralThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://repositorio.ufpb.br/jspui/handle/123456789/37226
url https://repositorio.ufpb.br/jspui/handle/123456789/37226
dc.language.iso.fl_str_mv por
language por
dc.rights.driver.fl_str_mv Attribution-NoDerivs 3.0 Brazil
http://creativecommons.org/licenses/by-nd/3.0/br/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Attribution-NoDerivs 3.0 Brazil
http://creativecommons.org/licenses/by-nd/3.0/br/
eu_rights_str_mv openAccess
dc.publisher.none.fl_str_mv Universidade Federal da Paraíba
Brasil
Linguística
Programa de Pós-Graduação em Linguística
UFPB
publisher.none.fl_str_mv Universidade Federal da Paraíba
Brasil
Linguística
Programa de Pós-Graduação em Linguística
UFPB
dc.source.none.fl_str_mv reponame:Biblioteca Digital de Teses e Dissertações da UFPB
instname:Universidade Federal da Paraíba (UFPB)
instacron:UFPB
instname_str Universidade Federal da Paraíba (UFPB)
instacron_str UFPB
institution UFPB
reponame_str Biblioteca Digital de Teses e Dissertações da UFPB
collection Biblioteca Digital de Teses e Dissertações da UFPB
repository.name.fl_str_mv Biblioteca Digital de Teses e Dissertações da UFPB - Universidade Federal da Paraíba (UFPB)
repository.mail.fl_str_mv diretoria@ufpb.br|| bdtd@biblioteca.ufpb.br
_version_ 1854304289405534208