Main memory database instant recovery

Detalhes bibliográficos
Ano de defesa: 2022
Autor(a) principal: Araújo, Arlino Henrique Magalhães de
Orientador(a): Monteiro Filho, José Maria da Silva
Banca de defesa: Não Informado pela instituição
Tipo de documento: Tese
Tipo de acesso: Acesso aberto
Idioma: eng
Instituição de defesa: Não Informado pela instituição
Programa de Pós-Graduação: Não Informado pela instituição
Departamento: Não Informado pela instituição
País: Não Informado pela instituição
Palavras-chave em Português:
Link de acesso: http://www.repositorio.ufc.br/handle/riufc/66902
Resumo: Main Memory Databases (MMDBs) technology handles the primary database in Random Access Memory (RAM) to provide high throughput and low latency. However, volatile memory makes MMDBs much more sensitive to system failures. The contents of the database are lost in these failures, and, as a result, systems may be unavailable for a long time until database recovery process has been finished. Therefore, novel recovery techniques are needed to repair crashed MMDBs as quickly as possible. This thesis presents MM-DIRECT (Main Memory Database Instant RECovery with Tuple consistent checkpoint), an MMDBs recovery technique able to schedule transactions simultaneously with the database recovery process at system startup. Thus it is giving the impression that the database is instantly restored. The approach implements a tuple-level consistent checkpoint to reduce the recovery time. In order to validate the proposed approach, experiments have been performed in a prototype implemented on the Redis database. The results show that the instant recovery technique effectively provides high transaction throughput rates even during both the recovery process and normal database processing.
id UFC-7_be27654510588817eb6a2d1535d69467
oai_identifier_str oai:repositorio.ufc.br:riufc/66902
network_acronym_str UFC-7
network_name_str Repositório Institucional da Universidade Federal do Ceará (UFC)
repository_id_str
spelling Araújo, Arlino Henrique Magalhães deBrayner, Angelo Roncalli AlencarMonteiro Filho, José Maria da Silva2022-07-04T19:17:47Z2022-07-04T19:17:47Z2022ARAÚJO, Arlino Henrique Magalhães de. Main memory database instant recovery. 2022. 135 f. Tese (Doutorado em Ciência da Computação) - Universidade Federal do Ceará, Fortaleza, 2022.http://www.repositorio.ufc.br/handle/riufc/66902Main Memory Databases (MMDBs) technology handles the primary database in Random Access Memory (RAM) to provide high throughput and low latency. However, volatile memory makes MMDBs much more sensitive to system failures. The contents of the database are lost in these failures, and, as a result, systems may be unavailable for a long time until database recovery process has been finished. Therefore, novel recovery techniques are needed to repair crashed MMDBs as quickly as possible. This thesis presents MM-DIRECT (Main Memory Database Instant RECovery with Tuple consistent checkpoint), an MMDBs recovery technique able to schedule transactions simultaneously with the database recovery process at system startup. Thus it is giving the impression that the database is instantly restored. The approach implements a tuple-level consistent checkpoint to reduce the recovery time. In order to validate the proposed approach, experiments have been performed in a prototype implemented on the Redis database. The results show that the instant recovery technique effectively provides high transaction throughput rates even during both the recovery process and normal database processing.A tecnologia de Bancos de Dados em Memória manipulam o banco de dados primário em memória principal para prover alta vazão de dados e baixa latência. Entretanto, a volatilidade da memória faz os bancos de dados em memória muito mais sensíveis a falhas. O conteúdo do banco de dados é perdido em tais falhas e, como resultado, o sistema deve ficar indisponível por um longo tempo até o processo de recuperação ter sido terminado. Assim, novas técnicas de recuperação são necessárias para recuperar bancos de dados falhados o mais rápido possível. Esta tese apresenta MM-DIRECT (Main Memory Database Instant RECovery with Tuple consistent checkpoint), uma técnica para recuperação de bancos de dados em memória capaz de escalonar transações simultaneamente ao processo de recuperação do banco de dados desde o reinício do sistema. Dessa maneira, é dada a impressão de que o banco de dados foi recuperado instantaneamente. Além disso, essa abordagem de recuperação implementa um checkpoint consistente a nível de tupla para reduzir o tempo de recuperação. Para validar a abordagem proposta, experimentos foram executados em um protótipo implementado no banco de dados Redis. Os resultados mostram que a técnica de recuperação instantânea efetivamente provê altas taxas de vazão de transações durante o processo de recuperação e durante a processamento normal do banco de dados.DatabaseIn-memory databaseMain memory databaseSystem failureInstant recoveryMain memory database instant recoveryMain memory database instant recoveryinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisengreponame:Repositório Institucional da Universidade Federal do Ceará (UFC)instname:Universidade Federal do Ceará (UFC)instacron:UFCinfo:eu-repo/semantics/openAccessORIGINAL2022_tese_ahmaraujo.pdf2022_tese_ahmaraujo.pdfapplication/pdf7063407http://repositorio.ufc.br/bitstream/riufc/66902/3/2022_tese_ahmaraujo.pdfd06de825adf18fe3e50e2e9080a1bb23MD53LICENSElicense.txtlicense.txttext/plain; charset=utf-82152http://repositorio.ufc.br/bitstream/riufc/66902/4/license.txtfb3ad2d23d9790966439580114baefafMD54riufc/669022022-07-04 16:17:47.438oai:repositorio.ufc.br:riufc/66902TElDRU7Dh0EgREUgQVJNQVpFTkFNRU5UTyBFIERJU1RSSUJVScOHw4NPIE7Dg08tRVhDTFVTSVZBIAoKQW8gY29uY29yZGFyIGNvbSBlc3RhIGxpY2Vuw6dhLCB2b2PDqihzKSBhdXRvcihlcykgb3UgdGl0dWxhcihlcykgZG9zIGRpcmVpdG9zIGF1dG9yYWlzIGRhIG9icmEgYXF1aSBkZXNjcml0YSBjb25jZWRlKG0pIMOgIFVuaXZlcnNpZGFkZSBGZWRlcmFsIGRvIENlYXLDoSwgZ2VzdG9yYSBkbyBSZXBvc2l0w7NyaW8gSW5zdGl0dWNpb25hbCBkYSBVRkMgLSBSSS9VRkMsIG8gZGlyZWl0byBuw6NvLWV4Y2x1c2l2byBkZSByZXByb2R1emlyLCBjb252ZXJ0ZXIgKGNvbW8gZGVmaW5pZG8gYWJhaXhvKSBlL291IGRpc3RyaWJ1aXIgbyBkb2N1bWVudG8gZGVwb3NpdGFkbyBlbSBmb3JtYXRvIGltcHJlc3NvLCBlbGV0csO0bmljbyBvdSBlbSBxdWFscXVlciBvdXRybyBtZWlvLiBWb2PDqiBjb25jb3JkYShtKSBxdWUgYSBVbml2ZXJzaWRhZGUgRmVkZXJhbCBkbyBDZWFyw6EsIGdlc3RvcmEgZG8gUmVwb3NpdMOzcmlvIEluc3RpdHVjaW9uYWwgZGEgVUZDIC0gUkkvVUZDLCBwb2RlLCBzZW0gYWx0ZXJhciBvIGNvbnRlw7pkbywgY29udmVydGVyIG8gYXJxdWl2byBkZXBvc2l0YWRvIGEgcXVhbHF1ZXIgbWVpbyBvdSBmb3JtYXRvIGNvbSBmaW5zIGRlIHByZXNlcnZhw6fDo28uIFZvY8OqKHMpIHRhbWLDqW0gY29uY29yZGEobSkgcXVlIGEgVW5pdmVyc2lkYWRlIEZlZGVyYWwgZG8gQ2VhcsOhLCBnZXN0b3JhIGRvIFJlcG9zaXTDs3JpbyBJbnN0aXR1Y2lvbmFsIGRhIFVGQyAtIFJJL1VGQywgcG9kZSBtYW50ZXIgbWFpcyBkZSB1bWEgY8OzcGlhIGRlc3RlIGRlcMOzc2l0byBwYXJhIGZpbnMgZGUgc2VndXJhbsOnYSwgYmFjay11cCBlL291IHByZXNlcnZhw6fDo28uIFZvY8OqIGRlY2xhcmEgcXVlIGEgYXByZXNlbnRhw6fDo28gZG8gc2V1IHRyYWJhbGhvIMOpIG9yaWdpbmFsIGUgcXVlIHZvY8OqKHMpIHBvZGUobSkgY29uY2VkZXIgb3MgZGlyZWl0b3MgY29udGlkb3MgbmVzdGEgbGljZW7Dp2EuIFZvY8OqIHRhbWLDqW0gZGVjbGFyYShtKSBxdWUgbyBlbnZpbyDDqSBkZSBzZXUgY29uaGVjaW1lbnRvIGUgbsOjbyBpbmZyaW5nZSBvcyBkaXJlaXRvcyBhdXRvcmFpcyBkZSBvdXRyYSBwZXNzb2Egb3UgaW5zdGl0dWnDp8Ojby4gQ2FzbyBvIGRvY3VtZW50byBhIHNlciBkZXBvc2l0YWRvIGNvbnRlbmhhIG1hdGVyaWFsIHBhcmEgbyBxdWFsIHZvY8OqKHMpIG7Do28gZGV0w6ltIGEgdGl0dWxhcmlkYWRlIGRvcyBkaXJlaXRvcyBkZSBhdXRvcmFpcywgdm9jw6oocykgZGVjbGFyYShtKSBxdWUgb2J0ZXZlIGEgcGVybWlzc8OjbyBpcnJlc3RyaXRhIGRvIHRpdHVsYXIgZG9zIGRpcmVpdG9zIGF1dG9yYWlzIGRlIGNvbmNlZGVyIMOgIFVuaXZlcnNpZGFkZSBGZWRlcmFsIGRvIENlYXLDoSwgZ2VzdG9yYSBkbyBSZXBvc2l0w7NyaW8gSW5zdGl0dWNpb25hbCBkYSBVRkMgLSBSSS9VRkMsIG9zIGRpcmVpdG9zIHJlcXVlcmlkb3MgcG9yIGVzdGEgbGljZW7Dp2EgZSBxdWUgb3MgbWF0ZXJpYWlzIGRlIHByb3ByaWVkYWRlIGRlIHRlcmNlaXJvcywgZXN0w6NvIGRldmlkYW1lbnRlIGlkZW50aWZpY2Fkb3MgZSByZWNvbmhlY2lkb3Mgbm8gdGV4dG8gb3UgY29udGXDumRvIGRhIGFwcmVzZW50YcOnw6NvLgogQ0FTTyBPIFRSQUJBTEhPIERFUE9TSVRBRE8gVEVOSEEgU0lETyBGSU5BTkNJQURPIE9VIEFQT0lBRE8gUE9SIFVNIMOTUkfDg08sIFFVRSBOw4NPIEEgSU5TVElUVUnDh8ODTyBERVNURSBSRVBPU0lUw5NSSU86IFZPQ8OKIERFQ0xBUkEgVEVSIENVTVBSSURPIFRPRE9TIE9TIERJUkVJVE9TIERFIFJFVklTw4NPIEUgUVVBSVNRVUVSIE9VVFJBUyBPQlJJR0HDh8OVRVMgUkVRVUVSSURBUyBQRUxPIENPTlRSQVRPIE9VIEFDT1JETy4gCk8gcmVwb3NpdMOzcmlvIGlkZW50aWZpY2Fyw6EgY2xhcmFtZW50ZSBvIHNldShzKSBub21lKHMpIGNvbW8gYXV0b3IoZXMpIG91IHRpdHVsYXIoZXMpIGRvIGRpcmVpdG8gZGUgYXV0b3IoZXMpIGRvIGRvY3VtZW50byBzdWJtZXRpZG8gZSBkZWNsYXJhIHF1ZSBuw6NvIGZhcsOhIHF1YWxxdWVyIGFsdGVyYcOnw6NvIGFsw6ltIGRhcyBwZXJtaXRpZGFzIHBvciBlc3RhIGxpY2Vuw6dhLgpSZXBvc2l0w7NyaW8gSW5zdGl0dWNpb25hbCBkYSBVRkMuCg==Repositório InstitucionalPUBhttp://www.repositorio.ufc.br/ri-oai/requestbu@ufc.br || repositorio@ufc.bropendoar:2022-07-04T19:17:47Repositório Institucional da Universidade Federal do Ceará (UFC) - Universidade Federal do Ceará (UFC)false
dc.title.pt_BR.fl_str_mv Main memory database instant recovery
dc.title.en.pt_BR.fl_str_mv Main memory database instant recovery
title Main memory database instant recovery
spellingShingle Main memory database instant recovery
Araújo, Arlino Henrique Magalhães de
Database
In-memory database
Main memory database
System failure
Instant recovery
title_short Main memory database instant recovery
title_full Main memory database instant recovery
title_fullStr Main memory database instant recovery
title_full_unstemmed Main memory database instant recovery
title_sort Main memory database instant recovery
author Araújo, Arlino Henrique Magalhães de
author_facet Araújo, Arlino Henrique Magalhães de
author_role author
dc.contributor.co-advisor.none.fl_str_mv Brayner, Angelo Roncalli Alencar
dc.contributor.author.fl_str_mv Araújo, Arlino Henrique Magalhães de
dc.contributor.advisor1.fl_str_mv Monteiro Filho, José Maria da Silva
contributor_str_mv Monteiro Filho, José Maria da Silva
dc.subject.por.fl_str_mv Database
In-memory database
Main memory database
System failure
Instant recovery
topic Database
In-memory database
Main memory database
System failure
Instant recovery
description Main Memory Databases (MMDBs) technology handles the primary database in Random Access Memory (RAM) to provide high throughput and low latency. However, volatile memory makes MMDBs much more sensitive to system failures. The contents of the database are lost in these failures, and, as a result, systems may be unavailable for a long time until database recovery process has been finished. Therefore, novel recovery techniques are needed to repair crashed MMDBs as quickly as possible. This thesis presents MM-DIRECT (Main Memory Database Instant RECovery with Tuple consistent checkpoint), an MMDBs recovery technique able to schedule transactions simultaneously with the database recovery process at system startup. Thus it is giving the impression that the database is instantly restored. The approach implements a tuple-level consistent checkpoint to reduce the recovery time. In order to validate the proposed approach, experiments have been performed in a prototype implemented on the Redis database. The results show that the instant recovery technique effectively provides high transaction throughput rates even during both the recovery process and normal database processing.
publishDate 2022
dc.date.accessioned.fl_str_mv 2022-07-04T19:17:47Z
dc.date.available.fl_str_mv 2022-07-04T19:17:47Z
dc.date.issued.fl_str_mv 2022
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/doctoralThesis
format doctoralThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv ARAÚJO, Arlino Henrique Magalhães de. Main memory database instant recovery. 2022. 135 f. Tese (Doutorado em Ciência da Computação) - Universidade Federal do Ceará, Fortaleza, 2022.
dc.identifier.uri.fl_str_mv http://www.repositorio.ufc.br/handle/riufc/66902
identifier_str_mv ARAÚJO, Arlino Henrique Magalhães de. Main memory database instant recovery. 2022. 135 f. Tese (Doutorado em Ciência da Computação) - Universidade Federal do Ceará, Fortaleza, 2022.
url http://www.repositorio.ufc.br/handle/riufc/66902
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.source.none.fl_str_mv reponame:Repositório Institucional da Universidade Federal do Ceará (UFC)
instname:Universidade Federal do Ceará (UFC)
instacron:UFC
instname_str Universidade Federal do Ceará (UFC)
instacron_str UFC
institution UFC
reponame_str Repositório Institucional da Universidade Federal do Ceará (UFC)
collection Repositório Institucional da Universidade Federal do Ceará (UFC)
bitstream.url.fl_str_mv http://repositorio.ufc.br/bitstream/riufc/66902/3/2022_tese_ahmaraujo.pdf
http://repositorio.ufc.br/bitstream/riufc/66902/4/license.txt
bitstream.checksum.fl_str_mv d06de825adf18fe3e50e2e9080a1bb23
fb3ad2d23d9790966439580114baefaf
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
repository.name.fl_str_mv Repositório Institucional da Universidade Federal do Ceará (UFC) - Universidade Federal do Ceará (UFC)
repository.mail.fl_str_mv bu@ufc.br || repositorio@ufc.br
_version_ 1847793040052191232