A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloud
| Ano de defesa: | 2025 |
|---|---|
| Autor(a) principal: | |
| Orientador(a): | |
| Banca de defesa: | |
| Tipo de documento: | Dissertação |
| Tipo de acesso: | Acesso aberto |
| Idioma: | eng |
| Instituição de defesa: |
Biblioteca Digitais de Teses e Dissertações da USP
|
| Programa de Pós-Graduação: |
Não Informado pela instituição
|
| Departamento: |
Não Informado pela instituição
|
| País: |
Não Informado pela instituição
|
| Palavras-chave em Português: | |
| Link de acesso: | https://www.teses.usp.br/teses/disponiveis/55/55134/tde-09092025-191832/ |
Resumo: | Reactive architectures represent a design paradigm centered on responsiveness, resilience, elasticity, and message-driven communicationqualities essential for handling high concurrency in modern distributed systems. This work addressed the design, implementation, and evaluation of a reactive distributed software architecture for high-concurrency scenarios, combining microservices, container orchestration with Kubernetes, cloud design patterns, and asynchronous event streams. Deployed on a local cloud data center (LaSDPC/ICMC/USP), the architecture leveraged well-known design patterns (e.g., Singleton, Bulkhead, Circuit Breaker) and explored optimized topologies to support read-intensive workloads at scale. To address limitations inherent in non-reactive approaches, multiple load-balancing algorithms were tested, and an AI-based observability service was developed to augment real-time orchestration insights. The principal contributions of this work are fourfold: (i) an in-depth analysis of resilience and elasticity scenarios where the orchestrator dynamically expands or reduces infrastructure resources, demonstrating increased reactivity, minimal downtime, and faster recovery in both the messaging subsystem and service nodes; (ii) a systematic performance evaluation of multiple load-balancing strategies (e.g., Round Robin, EWMA) under intense workloads of up to 50,000 concurrent requests, quantifying how reactive design principles can maintain low-latency communication and high throughput; (iii) a read-intensive framework comprising database read replicas, connection pooling, and distributed network/service layers to support large volumes of read operations without linearly increasing hardware demands and (iv) a specialized AI-based observability service that integrates log and telemetry analysis to suggest real-time adjustments for distinct load distributions. Conclusions emphasized the architectures robustness and scalability, highlighting the critical role of load-balancing strategies. Overall, this work offered a concrete foundation for building modern, highly flexible distributed systems that aligned with reactive principles and leveraged intelligent observability to meet evolving operational demands. |
| id |
USP_7a90274dc2175343ccf65d3f90159919 |
|---|---|
| oai_identifier_str |
oai:teses.usp.br:tde-09092025-191832 |
| network_acronym_str |
USP |
| network_name_str |
Biblioteca Digital de Teses e Dissertações da USP |
| repository_id_str |
|
| spelling |
A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloudUma arquitetura distribuída de microsserviços reativos orquestrados pelo kubernetes estudo de caso sobre balanceamento de carga em nuvem localAI-driven load distributionArquitetura reativaCloud-native microservicesDistribuição de carga orientada por IADistributed systemsKubernetes orchestrationMicrosserviços nativos em nuvemOrquestração com kubernetesReactive architectureSistemas distribuídosReactive architectures represent a design paradigm centered on responsiveness, resilience, elasticity, and message-driven communicationqualities essential for handling high concurrency in modern distributed systems. This work addressed the design, implementation, and evaluation of a reactive distributed software architecture for high-concurrency scenarios, combining microservices, container orchestration with Kubernetes, cloud design patterns, and asynchronous event streams. Deployed on a local cloud data center (LaSDPC/ICMC/USP), the architecture leveraged well-known design patterns (e.g., Singleton, Bulkhead, Circuit Breaker) and explored optimized topologies to support read-intensive workloads at scale. To address limitations inherent in non-reactive approaches, multiple load-balancing algorithms were tested, and an AI-based observability service was developed to augment real-time orchestration insights. The principal contributions of this work are fourfold: (i) an in-depth analysis of resilience and elasticity scenarios where the orchestrator dynamically expands or reduces infrastructure resources, demonstrating increased reactivity, minimal downtime, and faster recovery in both the messaging subsystem and service nodes; (ii) a systematic performance evaluation of multiple load-balancing strategies (e.g., Round Robin, EWMA) under intense workloads of up to 50,000 concurrent requests, quantifying how reactive design principles can maintain low-latency communication and high throughput; (iii) a read-intensive framework comprising database read replicas, connection pooling, and distributed network/service layers to support large volumes of read operations without linearly increasing hardware demands and (iv) a specialized AI-based observability service that integrates log and telemetry analysis to suggest real-time adjustments for distinct load distributions. Conclusions emphasized the architectures robustness and scalability, highlighting the critical role of load-balancing strategies. Overall, this work offered a concrete foundation for building modern, highly flexible distributed systems that aligned with reactive principles and leveraged intelligent observability to meet evolving operational demands.Arquiteturas reativas representam um paradigma de design centrado em responsividade, resiliência, elasticidade e comunicação orientada a mensagensqualidades essenciais para lidar com alta concorrência em sistemas distribuídos modernos. Este trabalho abordou o design, a implementação e a avaliação de uma arquitetura de software distribuída e reativa voltada para cenários de alta concorrência, combinando microsserviços, orquestração de contêineres com Kubernetes, padrões de design em nuvem e fluxos de eventos assíncronos. Implantada em um datacenter de nuvem local (LaSDPC/ICMC/USP), a arquitetura utilizou padrões de projeto consagrados (por exemplo, Singleton, Bulkhead, Circuit Breaker) e explorou topologias otimizadas para suportar cargas de leitura intensiva em escala. Para superar limitações inerentes a abordagens não reativas, múltiplos algoritmos de balanceamento de carga foram testados, e um serviço de observabilidade baseado em IA foi desenvolvido para aprimorar a visibilidade da orquestração em tempo real. As principais contribuições deste trabalho são quatro: (i) uma análise aprofundada de cenários de resiliência e elasticidade, nos quais o orquestrador expande ou reduz dinamicamente os recursos de infraestrutura, demonstrando maior reatividade, tempo de inatividade mínimo e recuperação mais rápida tanto no subsistema de mensagens quanto nos nós de serviço; (ii) uma avaliação sistemática de desempenho de diversas estratégias de balanceamento de carga (por exemplo, Round Robin, EWMA) sob cargas intensas de até 50.000 requisições concorrentes, quantificando como os princípios do design reativo mantêm baixa latência e alto throughput; (iii) um framework otimizado para leitura intensiva, composto por réplicas de leitura de banco de dados, pooling de conexões e camadas distribuídas de rede e serviços, capaz de sustentar grandes volumes de operações de leitura sem aumento linear de demanda por hardware; e (iv) um serviço especializado de observabilidade com IA, que integra análises de logs e telemetria para sugerir ajustes em tempo real na distribuição de carga. As conclusões ressaltaram a robustez e a escalabilidade da arquitetura, destacando o papel fundamental das estratégias de balanceamento de carga. De forma geral, este trabalho ofereceu uma base concreta para a construção de sistemas distribuídos modernos e altamente flexíveis, alinhados aos princípios reativos e aprimorados por observabilidade inteligente para atender às crescentes demandas operacionais.Biblioteca Digitais de Teses e Dissertações da USPEstrella, Júlio CezarFreire, Gustavo Mota2025-06-12info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisapplication/pdfhttps://www.teses.usp.br/teses/disponiveis/55/55134/tde-09092025-191832/reponame:Biblioteca Digital de Teses e Dissertações da USPinstname:Universidade de São Paulo (USP)instacron:USPLiberar o conteúdo para acesso público.info:eu-repo/semantics/openAccesseng2025-09-10T09:06:02Zoai:teses.usp.br:tde-09092025-191832Biblioteca Digital de Teses e Dissertaçõeshttp://www.teses.usp.br/PUBhttp://www.teses.usp.br/cgi-bin/mtd2br.plvirginia@if.usp.br|| atendimento@aguia.usp.br||virginia@if.usp.bropendoar:27212025-09-10T09:06:02Biblioteca Digital de Teses e Dissertações da USP - Universidade de São Paulo (USP)false |
| dc.title.none.fl_str_mv |
A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloud Uma arquitetura distribuída de microsserviços reativos orquestrados pelo kubernetes estudo de caso sobre balanceamento de carga em nuvem local |
| title |
A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloud |
| spellingShingle |
A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloud Freire, Gustavo Mota AI-driven load distribution Arquitetura reativa Cloud-native microservices Distribuição de carga orientada por IA Distributed systems Kubernetes orchestration Microsserviços nativos em nuvem Orquestração com kubernetes Reactive architecture Sistemas distribuídos |
| title_short |
A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloud |
| title_full |
A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloud |
| title_fullStr |
A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloud |
| title_full_unstemmed |
A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloud |
| title_sort |
A distributed architecture of reactive microservices orchestrated by kubernetes case study on load balancing in local cloud |
| author |
Freire, Gustavo Mota |
| author_facet |
Freire, Gustavo Mota |
| author_role |
author |
| dc.contributor.none.fl_str_mv |
Estrella, Júlio Cezar |
| dc.contributor.author.fl_str_mv |
Freire, Gustavo Mota |
| dc.subject.por.fl_str_mv |
AI-driven load distribution Arquitetura reativa Cloud-native microservices Distribuição de carga orientada por IA Distributed systems Kubernetes orchestration Microsserviços nativos em nuvem Orquestração com kubernetes Reactive architecture Sistemas distribuídos |
| topic |
AI-driven load distribution Arquitetura reativa Cloud-native microservices Distribuição de carga orientada por IA Distributed systems Kubernetes orchestration Microsserviços nativos em nuvem Orquestração com kubernetes Reactive architecture Sistemas distribuídos |
| description |
Reactive architectures represent a design paradigm centered on responsiveness, resilience, elasticity, and message-driven communicationqualities essential for handling high concurrency in modern distributed systems. This work addressed the design, implementation, and evaluation of a reactive distributed software architecture for high-concurrency scenarios, combining microservices, container orchestration with Kubernetes, cloud design patterns, and asynchronous event streams. Deployed on a local cloud data center (LaSDPC/ICMC/USP), the architecture leveraged well-known design patterns (e.g., Singleton, Bulkhead, Circuit Breaker) and explored optimized topologies to support read-intensive workloads at scale. To address limitations inherent in non-reactive approaches, multiple load-balancing algorithms were tested, and an AI-based observability service was developed to augment real-time orchestration insights. The principal contributions of this work are fourfold: (i) an in-depth analysis of resilience and elasticity scenarios where the orchestrator dynamically expands or reduces infrastructure resources, demonstrating increased reactivity, minimal downtime, and faster recovery in both the messaging subsystem and service nodes; (ii) a systematic performance evaluation of multiple load-balancing strategies (e.g., Round Robin, EWMA) under intense workloads of up to 50,000 concurrent requests, quantifying how reactive design principles can maintain low-latency communication and high throughput; (iii) a read-intensive framework comprising database read replicas, connection pooling, and distributed network/service layers to support large volumes of read operations without linearly increasing hardware demands and (iv) a specialized AI-based observability service that integrates log and telemetry analysis to suggest real-time adjustments for distinct load distributions. Conclusions emphasized the architectures robustness and scalability, highlighting the critical role of load-balancing strategies. Overall, this work offered a concrete foundation for building modern, highly flexible distributed systems that aligned with reactive principles and leveraged intelligent observability to meet evolving operational demands. |
| publishDate |
2025 |
| dc.date.none.fl_str_mv |
2025-06-12 |
| dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
| dc.type.driver.fl_str_mv |
info:eu-repo/semantics/masterThesis |
| format |
masterThesis |
| status_str |
publishedVersion |
| dc.identifier.uri.fl_str_mv |
https://www.teses.usp.br/teses/disponiveis/55/55134/tde-09092025-191832/ |
| url |
https://www.teses.usp.br/teses/disponiveis/55/55134/tde-09092025-191832/ |
| dc.language.iso.fl_str_mv |
eng |
| language |
eng |
| dc.relation.none.fl_str_mv |
|
| dc.rights.driver.fl_str_mv |
Liberar o conteúdo para acesso público. info:eu-repo/semantics/openAccess |
| rights_invalid_str_mv |
Liberar o conteúdo para acesso público. |
| eu_rights_str_mv |
openAccess |
| dc.format.none.fl_str_mv |
application/pdf |
| dc.coverage.none.fl_str_mv |
|
| dc.publisher.none.fl_str_mv |
Biblioteca Digitais de Teses e Dissertações da USP |
| publisher.none.fl_str_mv |
Biblioteca Digitais de Teses e Dissertações da USP |
| dc.source.none.fl_str_mv |
reponame:Biblioteca Digital de Teses e Dissertações da USP instname:Universidade de São Paulo (USP) instacron:USP |
| instname_str |
Universidade de São Paulo (USP) |
| instacron_str |
USP |
| institution |
USP |
| reponame_str |
Biblioteca Digital de Teses e Dissertações da USP |
| collection |
Biblioteca Digital de Teses e Dissertações da USP |
| repository.name.fl_str_mv |
Biblioteca Digital de Teses e Dissertações da USP - Universidade de São Paulo (USP) |
| repository.mail.fl_str_mv |
virginia@if.usp.br|| atendimento@aguia.usp.br||virginia@if.usp.br |
| _version_ |
1848370481925718016 |