Sincronização Eficiente de CRDTs em Escala utilizando VCube-PS

Detalhes bibliográficos
Ano de defesa: 2023
Autor(a) principal: Galesky, Leonardo de Freitas lattes
Orientador(a): Rodrigues, Luiz Antonio
Banca de defesa: Rodrigues, Luiz Antonio, Camargo, Edson Tavares de, Arantes, Luciana
Tipo de documento: Dissertação
Tipo de acesso: Acesso aberto
Idioma: por
Instituição de defesa: Universidade Estadual do Oeste do Paraná
Cascavel
Programa de Pós-Graduação: Programa de Pós-Graduação em Ciência da Computação
Departamento: Centro de Ciências Exatas e Tecnológicas
País: Brasil
Palavras-chave em Português:
Palavras-chave em Inglês:
Área do conhecimento CNPq:
Link de acesso: https://tede.unioeste.br/handle/tede/6942
Resumo: Distributed systems are used to build large-scale services on the Internet. In this context, models with looser consistency guarantees allow for optimizing the availability of these systems in the form of scalability, latency, and fault tolerance. However, using more relaxed rules introduces the possibility of conflicts that need to be arbitrated by the participants. To carry out this process in a decentralized way, protocols often use ad-hoc strategies such as LWW (Last Writer Wins) or even blocking the system until the inconsistent state is resolved manually. Conflict Free Replicated Data Types (CRDT) define data structures that meet mathematical specifications that guarantee that operations can be performed independently and concurrently without any form of coordination, allowing conflict resolution rules to be defined with greater granularity and adapting to the specification of the domain where they are applied. This study presents VCube-Sync, a system that uses a topology of virtual hypercubes for replicating a data store based on CRDT (Conflict-free Replicated Data Types). Hypercubes have been previously employed as a structured overlay network for message distribution due to fault tolerance and logarithmic latency, while also allowing the development of optimization heuristics based on knowledge of the overlay configuration. The replication protocol presented in this study was based on the VCube-PS exploiting synergies between publication-subscription and replication systems. The protocol was tested under various load and network distributions using the Grid5000 testbed, and the results were compared with other replication protocols from recent research. The results of this study show that VCube-Sync provides good results in terms of latency, scalability and network usage.
id UNIOESTE-1_ce50817757d7be6abdde13e075244dc8
oai_identifier_str oai:tede.unioeste.br:tede/6942
network_acronym_str UNIOESTE-1
network_name_str Biblioteca Digital de Teses e Dissertações do UNIOESTE
repository_id_str
spelling Rodrigues, Luiz AntonioRodrigues, Luiz AntonioCamargo, Edson Tavares deArantes, Lucianahttp://lattes.cnpq.br/3207969753129029Galesky, Leonardo de Freitas2023-12-12T15:16:42Z2023-10-06Galesky, Leonardo de Freitas. Sincronização Eficiente de CRDTs em Escala utilizando VCube-PS. 2023. 53 f. Dissertação( Mestrado em Ciência da Computação) - Universidade Estadual do Oeste do Paraná, Cascavel.https://tede.unioeste.br/handle/tede/6942Distributed systems are used to build large-scale services on the Internet. In this context, models with looser consistency guarantees allow for optimizing the availability of these systems in the form of scalability, latency, and fault tolerance. However, using more relaxed rules introduces the possibility of conflicts that need to be arbitrated by the participants. To carry out this process in a decentralized way, protocols often use ad-hoc strategies such as LWW (Last Writer Wins) or even blocking the system until the inconsistent state is resolved manually. Conflict Free Replicated Data Types (CRDT) define data structures that meet mathematical specifications that guarantee that operations can be performed independently and concurrently without any form of coordination, allowing conflict resolution rules to be defined with greater granularity and adapting to the specification of the domain where they are applied. This study presents VCube-Sync, a system that uses a topology of virtual hypercubes for replicating a data store based on CRDT (Conflict-free Replicated Data Types). Hypercubes have been previously employed as a structured overlay network for message distribution due to fault tolerance and logarithmic latency, while also allowing the development of optimization heuristics based on knowledge of the overlay configuration. The replication protocol presented in this study was based on the VCube-PS exploiting synergies between publication-subscription and replication systems. The protocol was tested under various load and network distributions using the Grid5000 testbed, and the results were compared with other replication protocols from recent research. The results of this study show that VCube-Sync provides good results in terms of latency, scalability and network usage.Sistemas distribuídos são utilizados para construir serviços de grande escala na internet, nesse contexto modelos com menor rigor de consistência permitem otimizar a disponibili dade destes sistemas na forma de escalabilidade, latência e tolerância a falhas. Entretanto, o uso de regras mais relaxadas introduz a possibilidade de conflitos que precisam ser arbitrados pelos participantes. Para realizar esse processo de forma descentralizada os protocolos costumam usar de estratégias ad-hoc como LWW (Last Writer Wins) ou mesmo bloquear o sistema até que o estado inconsistente seja resolvido manualmente. Conflict Free Replicated Data Types (CRDTS) definem estruturas de dados que atendem a especificações matemáticas que garantem que operações podem ser realizadas de forma independente e concorrente sem qualquer forma de coordenação, permitindo ainda que regras de resolução de conflitos possam ser definidas com maior granularidade e se adaptando a especificação do domínio onde são aplicados. Este estudo apresenta o VCube-Sync, um sistema que utiliza de uma topologia de hipercubos virtuais como base para replicação de um data store baseado em Tipos de Dados Replicados e Livres de Conflitos - CRDT (Conflict-free Replicated Data Types). Hipercubos já foram empregados anteriormente como rede de sobreposição estruturada para a distribuição de mensagens devido à tolerância a falhas e latência logarítmica, permitindo ainda o desenvolvimento de heurísticas de otimização baseadas no conhecimento da configuração da sobreposição. O protocolo de replicação apresentado neste estudo foi baseado no VCube-PS explorando a sinergia entre sistemas publicação-subscrição e de replicação. O protocolo foi testado sob várias distribuições de carga e rede usando o testbed Grid5000, e os resultados foram comparados com os de outros protocolos de replicação de pesquisas recentes. Os resultados deste estudo mostram que o VCube-Sync fornece bons resultados em termos de latência, escalabilidade e uso de rede.Submitted by Edineia Teixeira (edineia.teixeira@unioeste.br) on 2023-12-12T15:16:42Z No. of bitstreams: 1 Leonardo de Freitas Galesky.pdf: 1639147 bytes, checksum: 2d39ac154662c3b223175a03e12eed78 (MD5)Made available in DSpace on 2023-12-12T15:16:42Z (GMT). No. of bitstreams: 1 Leonardo de Freitas Galesky.pdf: 1639147 bytes, checksum: 2d39ac154662c3b223175a03e12eed78 (MD5) Previous issue date: 2023-10-06application/pdfpor6588633818200016417500Universidade Estadual do Oeste do ParanáCascavelPrograma de Pós-Graduação em Ciência da ComputaçãoUNIOESTEBrasilCentro de Ciências Exatas e Tecnológicashttp://creativecommons.org/licenses/by/4.0/info:eu-repo/semantics/openAccessCRDTReplicaçãoSistemas distribuídosCRDTReplicationDistributed systemsSISTEMAS DE COMPUTAÇÃOSincronização Eficiente de CRDTs em Escala utilizando VCube-PSEfficient Synchronization of CRDTs at Scale using VCube-PSinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesis19749965330812744706006002214374442868382015reponame:Biblioteca Digital de Teses e Dissertações do UNIOESTEinstname:Universidade Estadual do Oeste do Paraná (UNIOESTE)instacron:UNIOESTEORIGINALLeonardo de Freitas Galesky.pdfLeonardo de Freitas Galesky.pdfapplication/pdf1639147http://tede.unioeste.br:8080/tede/bitstream/tede/6942/2/Leonardo+de+Freitas+Galesky.pdf2d39ac154662c3b223175a03e12eed78MD52LICENSElicense.txtlicense.txttext/plain; charset=utf-82165http://tede.unioeste.br:8080/tede/bitstream/tede/6942/1/license.txtbd3efa91386c1718a7f26a329fdcb468MD51tede/69422024-01-08 09:28:12.33oai:tede.unioeste.br:tede/6942Tk9UQTogQ09MT1FVRSBBUVVJIEEgU1VBIFBSw5NQUklBIExJQ0VOw4dBCkVzdGEgbGljZW7Dp2EgZGUgZXhlbXBsbyDDqSBmb3JuZWNpZGEgYXBlbmFzIHBhcmEgZmlucyBpbmZvcm1hdGl2b3MuCgpMSUNFTsOHQSBERSBESVNUUklCVUnDh8ODTyBOw4NPLUVYQ0xVU0lWQQoKQ29tIGEgYXByZXNlbnRhw6fDo28gZGVzdGEgbGljZW7Dp2EsIHZvY8OqIChvIGF1dG9yIChlcykgb3UgbyB0aXR1bGFyIGRvcyBkaXJlaXRvcyBkZSBhdXRvcikgY29uY2VkZSDDoCBVbml2ZXJzaWRhZGUgClhYWCAoU2lnbGEgZGEgVW5pdmVyc2lkYWRlKSBvIGRpcmVpdG8gbsOjby1leGNsdXNpdm8gZGUgcmVwcm9kdXppciwgIHRyYWR1emlyIChjb25mb3JtZSBkZWZpbmlkbyBhYmFpeG8pLCBlL291IApkaXN0cmlidWlyIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyAoaW5jbHVpbmRvIG8gcmVzdW1vKSBwb3IgdG9kbyBvIG11bmRvIG5vIGZvcm1hdG8gaW1wcmVzc28gZSBlbGV0csO0bmljbyBlIAplbSBxdWFscXVlciBtZWlvLCBpbmNsdWluZG8gb3MgZm9ybWF0b3Mgw6F1ZGlvIG91IHbDrWRlby4KClZvY8OqIGNvbmNvcmRhIHF1ZSBhIFNpZ2xhIGRlIFVuaXZlcnNpZGFkZSBwb2RlLCBzZW0gYWx0ZXJhciBvIGNvbnRlw7pkbywgdHJhbnNwb3IgYSBzdWEgdGVzZSBvdSBkaXNzZXJ0YcOnw6NvIApwYXJhIHF1YWxxdWVyIG1laW8gb3UgZm9ybWF0byBwYXJhIGZpbnMgZGUgcHJlc2VydmHDp8Ojby4KClZvY8OqIHRhbWLDqW0gY29uY29yZGEgcXVlIGEgU2lnbGEgZGUgVW5pdmVyc2lkYWRlIHBvZGUgbWFudGVyIG1haXMgZGUgdW1hIGPDs3BpYSBhIHN1YSB0ZXNlIG91IApkaXNzZXJ0YcOnw6NvIHBhcmEgZmlucyBkZSBzZWd1cmFuw6dhLCBiYWNrLXVwIGUgcHJlc2VydmHDp8Ojby4KClZvY8OqIGRlY2xhcmEgcXVlIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyDDqSBvcmlnaW5hbCBlIHF1ZSB2b2PDqiB0ZW0gbyBwb2RlciBkZSBjb25jZWRlciBvcyBkaXJlaXRvcyBjb250aWRvcyAKbmVzdGEgbGljZW7Dp2EuIFZvY8OqIHRhbWLDqW0gZGVjbGFyYSBxdWUgbyBkZXDDs3NpdG8gZGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyBuw6NvLCBxdWUgc2VqYSBkZSBzZXUgCmNvbmhlY2ltZW50bywgaW5mcmluZ2UgZGlyZWl0b3MgYXV0b3JhaXMgZGUgbmluZ3XDqW0uCgpDYXNvIGEgc3VhIHRlc2Ugb3UgZGlzc2VydGHDp8OjbyBjb250ZW5oYSBtYXRlcmlhbCBxdWUgdm9jw6ogbsOjbyBwb3NzdWkgYSB0aXR1bGFyaWRhZGUgZG9zIGRpcmVpdG9zIGF1dG9yYWlzLCB2b2PDqiAKZGVjbGFyYSBxdWUgb2J0ZXZlIGEgcGVybWlzc8OjbyBpcnJlc3RyaXRhIGRvIGRldGVudG9yIGRvcyBkaXJlaXRvcyBhdXRvcmFpcyBwYXJhIGNvbmNlZGVyIMOgIFNpZ2xhIGRlIFVuaXZlcnNpZGFkZSAKb3MgZGlyZWl0b3MgYXByZXNlbnRhZG9zIG5lc3RhIGxpY2Vuw6dhLCBlIHF1ZSBlc3NlIG1hdGVyaWFsIGRlIHByb3ByaWVkYWRlIGRlIHRlcmNlaXJvcyBlc3TDoSBjbGFyYW1lbnRlIAppZGVudGlmaWNhZG8gZSByZWNvbmhlY2lkbyBubyB0ZXh0byBvdSBubyBjb250ZcO6ZG8gZGEgdGVzZSBvdSBkaXNzZXJ0YcOnw6NvIG9yYSBkZXBvc2l0YWRhLgoKQ0FTTyBBIFRFU0UgT1UgRElTU0VSVEHDh8ODTyBPUkEgREVQT1NJVEFEQSBURU5IQSBTSURPIFJFU1VMVEFETyBERSBVTSBQQVRST0PDjU5JTyBPVSAKQVBPSU8gREUgVU1BIEFHw4pOQ0lBIERFIEZPTUVOVE8gT1UgT1VUUk8gT1JHQU5JU01PIFFVRSBOw4NPIFNFSkEgQSBTSUdMQSBERSAKVU5JVkVSU0lEQURFLCBWT0PDiiBERUNMQVJBIFFVRSBSRVNQRUlUT1UgVE9ET1MgRSBRVUFJU1FVRVIgRElSRUlUT1MgREUgUkVWSVPDg08gQ09NTyAKVEFNQsOJTSBBUyBERU1BSVMgT0JSSUdBw4fDlUVTIEVYSUdJREFTIFBPUiBDT05UUkFUTyBPVSBBQ09SRE8uCgpBIFNpZ2xhIGRlIFVuaXZlcnNpZGFkZSBzZSBjb21wcm9tZXRlIGEgaWRlbnRpZmljYXIgY2xhcmFtZW50ZSBvIHNldSBub21lIChzKSBvdSBvKHMpIG5vbWUocykgZG8ocykgCmRldGVudG9yKGVzKSBkb3MgZGlyZWl0b3MgYXV0b3JhaXMgZGEgdGVzZSBvdSBkaXNzZXJ0YcOnw6NvLCBlIG7Do28gZmFyw6EgcXVhbHF1ZXIgYWx0ZXJhw6fDo28sIGFsw6ltIGRhcXVlbGFzIApjb25jZWRpZGFzIHBvciBlc3RhIGxpY2Vuw6dhLgo=Biblioteca Digital de Teses e Dissertaçõeshttp://tede.unioeste.br/PUBhttp://tede.unioeste.br/oai/requestbiblioteca.repositorio@unioeste.bropendoar:2024-01-08T12:28:12Biblioteca Digital de Teses e Dissertações do UNIOESTE - Universidade Estadual do Oeste do Paraná (UNIOESTE)false
dc.title.por.fl_str_mv Sincronização Eficiente de CRDTs em Escala utilizando VCube-PS
dc.title.alternative.eng.fl_str_mv Efficient Synchronization of CRDTs at Scale using VCube-PS
title Sincronização Eficiente de CRDTs em Escala utilizando VCube-PS
spellingShingle Sincronização Eficiente de CRDTs em Escala utilizando VCube-PS
Galesky, Leonardo de Freitas
CRDT
Replicação
Sistemas distribuídos
CRDT
Replication
Distributed systems
SISTEMAS DE COMPUTAÇÃO
title_short Sincronização Eficiente de CRDTs em Escala utilizando VCube-PS
title_full Sincronização Eficiente de CRDTs em Escala utilizando VCube-PS
title_fullStr Sincronização Eficiente de CRDTs em Escala utilizando VCube-PS
title_full_unstemmed Sincronização Eficiente de CRDTs em Escala utilizando VCube-PS
title_sort Sincronização Eficiente de CRDTs em Escala utilizando VCube-PS
author Galesky, Leonardo de Freitas
author_facet Galesky, Leonardo de Freitas
author_role author
dc.contributor.advisor1.fl_str_mv Rodrigues, Luiz Antonio
dc.contributor.referee1.fl_str_mv Rodrigues, Luiz Antonio
dc.contributor.referee2.fl_str_mv Camargo, Edson Tavares de
dc.contributor.referee3.fl_str_mv Arantes, Luciana
dc.contributor.authorLattes.fl_str_mv http://lattes.cnpq.br/3207969753129029
dc.contributor.author.fl_str_mv Galesky, Leonardo de Freitas
contributor_str_mv Rodrigues, Luiz Antonio
Rodrigues, Luiz Antonio
Camargo, Edson Tavares de
Arantes, Luciana
dc.subject.por.fl_str_mv CRDT
Replicação
Sistemas distribuídos
topic CRDT
Replicação
Sistemas distribuídos
CRDT
Replication
Distributed systems
SISTEMAS DE COMPUTAÇÃO
dc.subject.eng.fl_str_mv CRDT
Replication
Distributed systems
dc.subject.cnpq.fl_str_mv SISTEMAS DE COMPUTAÇÃO
description Distributed systems are used to build large-scale services on the Internet. In this context, models with looser consistency guarantees allow for optimizing the availability of these systems in the form of scalability, latency, and fault tolerance. However, using more relaxed rules introduces the possibility of conflicts that need to be arbitrated by the participants. To carry out this process in a decentralized way, protocols often use ad-hoc strategies such as LWW (Last Writer Wins) or even blocking the system until the inconsistent state is resolved manually. Conflict Free Replicated Data Types (CRDT) define data structures that meet mathematical specifications that guarantee that operations can be performed independently and concurrently without any form of coordination, allowing conflict resolution rules to be defined with greater granularity and adapting to the specification of the domain where they are applied. This study presents VCube-Sync, a system that uses a topology of virtual hypercubes for replicating a data store based on CRDT (Conflict-free Replicated Data Types). Hypercubes have been previously employed as a structured overlay network for message distribution due to fault tolerance and logarithmic latency, while also allowing the development of optimization heuristics based on knowledge of the overlay configuration. The replication protocol presented in this study was based on the VCube-PS exploiting synergies between publication-subscription and replication systems. The protocol was tested under various load and network distributions using the Grid5000 testbed, and the results were compared with other replication protocols from recent research. The results of this study show that VCube-Sync provides good results in terms of latency, scalability and network usage.
publishDate 2023
dc.date.accessioned.fl_str_mv 2023-12-12T15:16:42Z
dc.date.issued.fl_str_mv 2023-10-06
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv Galesky, Leonardo de Freitas. Sincronização Eficiente de CRDTs em Escala utilizando VCube-PS. 2023. 53 f. Dissertação( Mestrado em Ciência da Computação) - Universidade Estadual do Oeste do Paraná, Cascavel.
dc.identifier.uri.fl_str_mv https://tede.unioeste.br/handle/tede/6942
identifier_str_mv Galesky, Leonardo de Freitas. Sincronização Eficiente de CRDTs em Escala utilizando VCube-PS. 2023. 53 f. Dissertação( Mestrado em Ciência da Computação) - Universidade Estadual do Oeste do Paraná, Cascavel.
url https://tede.unioeste.br/handle/tede/6942
dc.language.iso.fl_str_mv por
language por
dc.relation.program.fl_str_mv 1974996533081274470
dc.relation.confidence.fl_str_mv 600
600
dc.relation.department.fl_str_mv 2214374442868382015
dc.rights.driver.fl_str_mv http://creativecommons.org/licenses/by/4.0/
info:eu-repo/semantics/openAccess
rights_invalid_str_mv http://creativecommons.org/licenses/by/4.0/
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.publisher.none.fl_str_mv Universidade Estadual do Oeste do Paraná
Cascavel
dc.publisher.program.fl_str_mv Programa de Pós-Graduação em Ciência da Computação
dc.publisher.initials.fl_str_mv UNIOESTE
dc.publisher.country.fl_str_mv Brasil
dc.publisher.department.fl_str_mv Centro de Ciências Exatas e Tecnológicas
publisher.none.fl_str_mv Universidade Estadual do Oeste do Paraná
Cascavel
dc.source.none.fl_str_mv reponame:Biblioteca Digital de Teses e Dissertações do UNIOESTE
instname:Universidade Estadual do Oeste do Paraná (UNIOESTE)
instacron:UNIOESTE
instname_str Universidade Estadual do Oeste do Paraná (UNIOESTE)
instacron_str UNIOESTE
institution UNIOESTE
reponame_str Biblioteca Digital de Teses e Dissertações do UNIOESTE
collection Biblioteca Digital de Teses e Dissertações do UNIOESTE
bitstream.url.fl_str_mv http://tede.unioeste.br:8080/tede/bitstream/tede/6942/2/Leonardo+de+Freitas+Galesky.pdf
http://tede.unioeste.br:8080/tede/bitstream/tede/6942/1/license.txt
bitstream.checksum.fl_str_mv 2d39ac154662c3b223175a03e12eed78
bd3efa91386c1718a7f26a329fdcb468
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
repository.name.fl_str_mv Biblioteca Digital de Teses e Dissertações do UNIOESTE - Universidade Estadual do Oeste do Paraná (UNIOESTE)
repository.mail.fl_str_mv biblioteca.repositorio@unioeste.br
_version_ 1851949236416937984