Exportação concluída — 

A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloud

Detalhes bibliográficos
Ano de defesa: 2025
Autor(a) principal: Freire, Gustavo Mota
Orientador(a): Não Informado pela instituição
Banca de defesa: Não Informado pela instituição
Tipo de documento: Dissertação
Tipo de acesso: Acesso aberto
Idioma: eng
Instituição de defesa: Biblioteca Digitais de Teses e Dissertações da USP
Programa de Pós-Graduação: Não Informado pela instituição
Departamento: Não Informado pela instituição
País: Não Informado pela instituição
Palavras-chave em Português:
Link de acesso: https://www.teses.usp.br/teses/disponiveis/55/55134/tde-09092025-191832/
Resumo: Reactive architectures represent a design paradigm centered on responsiveness, resilience, elasticity, and message-driven communicationqualities essential for handling high concurrency in modern distributed systems. This work addressed the design, implementation, and evaluation of a reactive distributed software architecture for high-concurrency scenarios, combining microservices, container orchestration with Kubernetes, cloud design patterns, and asynchronous event streams. Deployed on a local cloud data center (LaSDPC/ICMC/USP), the architecture leveraged well-known design patterns (e.g., Singleton, Bulkhead, Circuit Breaker) and explored optimized topologies to support read-intensive workloads at scale. To address limitations inherent in non-reactive approaches, multiple load-balancing algorithms were tested, and an AI-based observability service was developed to augment real-time orchestration insights. The principal contributions of this work are fourfold: (i) an in-depth analysis of resilience and elasticity scenarios where the orchestrator dynamically expands or reduces infrastructure resources, demonstrating increased reactivity, minimal downtime, and faster recovery in both the messaging subsystem and service nodes; (ii) a systematic performance evaluation of multiple load-balancing strategies (e.g., Round Robin, EWMA) under intense workloads of up to 50,000 concurrent requests, quantifying how reactive design principles can maintain low-latency communication and high throughput; (iii) a read-intensive framework comprising database read replicas, connection pooling, and distributed network/service layers to support large volumes of read operations without linearly increasing hardware demands and (iv) a specialized AI-based observability service that integrates log and telemetry analysis to suggest real-time adjustments for distinct load distributions. Conclusions emphasized the architectures robustness and scalability, highlighting the critical role of load-balancing strategies. Overall, this work offered a concrete foundation for building modern, highly flexible distributed systems that aligned with reactive principles and leveraged intelligent observability to meet evolving operational demands.
id USP_7a90274dc2175343ccf65d3f90159919
oai_identifier_str oai:teses.usp.br:tde-09092025-191832
network_acronym_str USP
network_name_str Biblioteca Digital de Teses e Dissertações da USP
repository_id_str
spelling A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloudUma arquitetura distribuída de microsserviços reativos orquestrados pelo kubernetes estudo de caso sobre balanceamento de carga em nuvem localAI-driven load distributionArquitetura reativaCloud-native microservicesDistribuição de carga orientada por IADistributed systemsKubernetes orchestrationMicrosserviços nativos em nuvemOrquestração com kubernetesReactive architectureSistemas distribuídosReactive architectures represent a design paradigm centered on responsiveness, resilience, elasticity, and message-driven communicationqualities essential for handling high concurrency in modern distributed systems. This work addressed the design, implementation, and evaluation of a reactive distributed software architecture for high-concurrency scenarios, combining microservices, container orchestration with Kubernetes, cloud design patterns, and asynchronous event streams. Deployed on a local cloud data center (LaSDPC/ICMC/USP), the architecture leveraged well-known design patterns (e.g., Singleton, Bulkhead, Circuit Breaker) and explored optimized topologies to support read-intensive workloads at scale. To address limitations inherent in non-reactive approaches, multiple load-balancing algorithms were tested, and an AI-based observability service was developed to augment real-time orchestration insights. The principal contributions of this work are fourfold: (i) an in-depth analysis of resilience and elasticity scenarios where the orchestrator dynamically expands or reduces infrastructure resources, demonstrating increased reactivity, minimal downtime, and faster recovery in both the messaging subsystem and service nodes; (ii) a systematic performance evaluation of multiple load-balancing strategies (e.g., Round Robin, EWMA) under intense workloads of up to 50,000 concurrent requests, quantifying how reactive design principles can maintain low-latency communication and high throughput; (iii) a read-intensive framework comprising database read replicas, connection pooling, and distributed network/service layers to support large volumes of read operations without linearly increasing hardware demands and (iv) a specialized AI-based observability service that integrates log and telemetry analysis to suggest real-time adjustments for distinct load distributions. Conclusions emphasized the architectures robustness and scalability, highlighting the critical role of load-balancing strategies. Overall, this work offered a concrete foundation for building modern, highly flexible distributed systems that aligned with reactive principles and leveraged intelligent observability to meet evolving operational demands.Arquiteturas reativas representam um paradigma de design centrado em responsividade, resiliência, elasticidade e comunicação orientada a mensagensqualidades essenciais para lidar com alta concorrência em sistemas distribuídos modernos. Este trabalho abordou o design, a implementação e a avaliação de uma arquitetura de software distribuída e reativa voltada para cenários de alta concorrência, combinando microsserviços, orquestração de contêineres com Kubernetes, padrões de design em nuvem e fluxos de eventos assíncronos. Implantada em um datacenter de nuvem local (LaSDPC/ICMC/USP), a arquitetura utilizou padrões de projeto consagrados (por exemplo, Singleton, Bulkhead, Circuit Breaker) e explorou topologias otimizadas para suportar cargas de leitura intensiva em escala. Para superar limitações inerentes a abordagens não reativas, múltiplos algoritmos de balanceamento de carga foram testados, e um serviço de observabilidade baseado em IA foi desenvolvido para aprimorar a visibilidade da orquestração em tempo real. As principais contribuições deste trabalho são quatro: (i) uma análise aprofundada de cenários de resiliência e elasticidade, nos quais o orquestrador expande ou reduz dinamicamente os recursos de infraestrutura, demonstrando maior reatividade, tempo de inatividade mínimo e recuperação mais rápida tanto no subsistema de mensagens quanto nos nós de serviço; (ii) uma avaliação sistemática de desempenho de diversas estratégias de balanceamento de carga (por exemplo, Round Robin, EWMA) sob cargas intensas de até 50.000 requisições concorrentes, quantificando como os princípios do design reativo mantêm baixa latência e alto throughput; (iii) um framework otimizado para leitura intensiva, composto por réplicas de leitura de banco de dados, pooling de conexões e camadas distribuídas de rede e serviços, capaz de sustentar grandes volumes de operações de leitura sem aumento linear de demanda por hardware; e (iv) um serviço especializado de observabilidade com IA, que integra análises de logs e telemetria para sugerir ajustes em tempo real na distribuição de carga. As conclusões ressaltaram a robustez e a escalabilidade da arquitetura, destacando o papel fundamental das estratégias de balanceamento de carga. De forma geral, este trabalho ofereceu uma base concreta para a construção de sistemas distribuídos modernos e altamente flexíveis, alinhados aos princípios reativos e aprimorados por observabilidade inteligente para atender às crescentes demandas operacionais.Biblioteca Digitais de Teses e Dissertações da USPEstrella, Júlio CezarFreire, Gustavo Mota2025-06-12info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfhttps://www.teses.usp.br/teses/disponiveis/55/55134/tde-09092025-191832/reponame:Biblioteca Digital de Teses e Dissertações da USPinstname:Universidade de São Paulo (USP)instacron:USPLiberar o conteúdo para acesso público.info:eu-repo/semantics/openAccesseng2025-09-10T09:06:02Zoai:teses.usp.br:tde-09092025-191832Biblioteca Digital de Teses e Dissertaçõeshttp://www.teses.usp.br/PUBhttp://www.teses.usp.br/cgi-bin/mtd2br.plvirginia@if.usp.br|| atendimento@aguia.usp.br||virginia@if.usp.bropendoar:27212025-09-10T09:06:02Biblioteca Digital de Teses e Dissertações da USP - Universidade de São Paulo (USP)false
dc.title.none.fl_str_mv A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloud
Uma arquitetura distribuída de microsserviços reativos orquestrados pelo kubernetes estudo de caso sobre balanceamento de carga em nuvem local
title A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloud
spellingShingle A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloud
Freire, Gustavo Mota
AI-driven load distribution
Arquitetura reativa
Cloud-native microservices
Distribuição de carga orientada por IA
Distributed systems
Kubernetes orchestration
Microsserviços nativos em nuvem
Orquestração com kubernetes
Reactive architecture
Sistemas distribuídos
title_short A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloud
title_full A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloud
title_fullStr A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloud
title_full_unstemmed A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloud
title_sort A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloud
author Freire, Gustavo Mota
author_facet Freire, Gustavo Mota
author_role author
dc.contributor.none.fl_str_mv Estrella, Júlio Cezar
dc.contributor.author.fl_str_mv Freire, Gustavo Mota
dc.subject.por.fl_str_mv AI-driven load distribution
Arquitetura reativa
Cloud-native microservices
Distribuição de carga orientada por IA
Distributed systems
Kubernetes orchestration
Microsserviços nativos em nuvem
Orquestração com kubernetes
Reactive architecture
Sistemas distribuídos
topic AI-driven load distribution
Arquitetura reativa
Cloud-native microservices
Distribuição de carga orientada por IA
Distributed systems
Kubernetes orchestration
Microsserviços nativos em nuvem
Orquestração com kubernetes
Reactive architecture
Sistemas distribuídos
description Reactive architectures represent a design paradigm centered on responsiveness, resilience, elasticity, and message-driven communicationqualities essential for handling high concurrency in modern distributed systems. This work addressed the design, implementation, and evaluation of a reactive distributed software architecture for high-concurrency scenarios, combining microservices, container orchestration with Kubernetes, cloud design patterns, and asynchronous event streams. Deployed on a local cloud data center (LaSDPC/ICMC/USP), the architecture leveraged well-known design patterns (e.g., Singleton, Bulkhead, Circuit Breaker) and explored optimized topologies to support read-intensive workloads at scale. To address limitations inherent in non-reactive approaches, multiple load-balancing algorithms were tested, and an AI-based observability service was developed to augment real-time orchestration insights. The principal contributions of this work are fourfold: (i) an in-depth analysis of resilience and elasticity scenarios where the orchestrator dynamically expands or reduces infrastructure resources, demonstrating increased reactivity, minimal downtime, and faster recovery in both the messaging subsystem and service nodes; (ii) a systematic performance evaluation of multiple load-balancing strategies (e.g., Round Robin, EWMA) under intense workloads of up to 50,000 concurrent requests, quantifying how reactive design principles can maintain low-latency communication and high throughput; (iii) a read-intensive framework comprising database read replicas, connection pooling, and distributed network/service layers to support large volumes of read operations without linearly increasing hardware demands and (iv) a specialized AI-based observability service that integrates log and telemetry analysis to suggest real-time adjustments for distinct load distributions. Conclusions emphasized the architectures robustness and scalability, highlighting the critical role of load-balancing strategies. Overall, this work offered a concrete foundation for building modern, highly flexible distributed systems that aligned with reactive principles and leveraged intelligent observability to meet evolving operational demands.
publishDate 2025
dc.date.none.fl_str_mv 2025-06-12
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://www.teses.usp.br/teses/disponiveis/55/55134/tde-09092025-191832/
url https://www.teses.usp.br/teses/disponiveis/55/55134/tde-09092025-191832/
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv
dc.rights.driver.fl_str_mv Liberar o conteúdo para acesso público.
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Liberar o conteúdo para acesso público.
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.coverage.none.fl_str_mv
dc.publisher.none.fl_str_mv Biblioteca Digitais de Teses e Dissertações da USP
publisher.none.fl_str_mv Biblioteca Digitais de Teses e Dissertações da USP
dc.source.none.fl_str_mv
reponame:Biblioteca Digital de Teses e Dissertações da USP
instname:Universidade de São Paulo (USP)
instacron:USP
instname_str Universidade de São Paulo (USP)
instacron_str USP
institution USP
reponame_str Biblioteca Digital de Teses e Dissertações da USP
collection Biblioteca Digital de Teses e Dissertações da USP
repository.name.fl_str_mv Biblioteca Digital de Teses e Dissertações da USP - Universidade de São Paulo (USP)
repository.mail.fl_str_mv virginia@if.usp.br|| atendimento@aguia.usp.br||virginia@if.usp.br
_version_ 1848370481925718016