Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped Environments

Detalhes bibliográficos
Ano de defesa: 2024
Autor(a) principal: Rosero, Luis Alberto Rosero
Orientador(a): Não Informado pela instituição
Banca de defesa: Não Informado pela instituição
Tipo de documento: Tese
Tipo de acesso: Acesso aberto
Idioma: eng
Instituição de defesa: Biblioteca Digitais de Teses e Dissertações da USP
Programa de Pós-Graduação: Não Informado pela instituição
Departamento: Não Informado pela instituição
País: Não Informado pela instituição
Palavras-chave em Português:
Link de acesso: https://www.teses.usp.br/teses/disponiveis/55/55134/tde-09082024-163642/
Resumo: Autonomous driving promises a revolution in transportation, unlocking significant social and economic benefits. Despite notable advancements in autonomous vehicle technology tailored for mapped environments, navigating in unmapped areas remains a persistent challenge. The limited utilization of developments in modular pipelines exacerbates this issue, impeding progress towards map-free navigation. This thesis delves into the development of autonomous driving architectures for real-time navigation, both with and without maps. Three approaches are proposed, implemented, compared, and evaluated to create new and robust methodologies: Modular Pipeline: A custom agent performs data collection and serves as a baseline for mapbased navigation. Traditional algorithms and new modules for perception, decision-making, and prediction are integrated to ensure safe navigation in mapped environments. This agent acts as the \"teacher\" for the mapless navigation agents. End-to-End Learning: Neural networks learn driving policies from data through imitation learning techniques. Simplicity is prioritized for real-time operation in map-free environments. Different sensor types and fusion methods are explored to enhance performance. Hybrid Architecture: Combining the interpretability of modular systems with the learning capabilities of end-to-end models, this approach integrates data-driven path planning with modular perception and control modules. It offers robustness, flexibility, and adaptability. Furthermore, a ROS-based framework named \"CaRINA agent\" is developed to implement modular pipelines and facilitate incorporating end-to-end methods and constructing hybrid architectures. To comprehensively evaluate our methodologies, we leverage the CARLA Leaderboards, achieving competitive results in both Leaderboard 1 and Leaderboard 2, specifically ranking among the top in the SENSORS and MAP categories. Moreover, our modular architecture and hybrid agent secured 1st and 2nd place in the 2023 CARLA Autonomous Driving Challenge (CADCH), underscoring the effectiveness of our proposed approaches.
id USP_453bd6de5c87c5cfb4c6a0a28ad91ac3
oai_identifier_str oai:teses.usp.br:tde-09082024-163642
network_acronym_str USP
network_name_str Biblioteca Digital de Teses e Dissertações da USP
repository_id_str
spelling Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped EnvironmentsNavegando pelo desconhecido: utilizando arquiteturas modulares e aprendizado para direção autônoma em ambientes não mapeadosArquitetura híbridaArquitetura modularAutonomous drivingCARLA simulatorCondução autônomaDecision-makingDisparidadeDisparityEnd-to-endEnd-to-endHybrid architectureIntelligent and autonomous vehiclesModular architecturePath planningPercepçãoPerceptionPlanejamento de trajetóriaPrediçãoPredictionSimulador CARLATomada de decisãoVeículos autônomos e inteligentesAutonomous driving promises a revolution in transportation, unlocking significant social and economic benefits. Despite notable advancements in autonomous vehicle technology tailored for mapped environments, navigating in unmapped areas remains a persistent challenge. The limited utilization of developments in modular pipelines exacerbates this issue, impeding progress towards map-free navigation. This thesis delves into the development of autonomous driving architectures for real-time navigation, both with and without maps. Three approaches are proposed, implemented, compared, and evaluated to create new and robust methodologies: Modular Pipeline: A custom agent performs data collection and serves as a baseline for mapbased navigation. Traditional algorithms and new modules for perception, decision-making, and prediction are integrated to ensure safe navigation in mapped environments. This agent acts as the \"teacher\" for the mapless navigation agents. End-to-End Learning: Neural networks learn driving policies from data through imitation learning techniques. Simplicity is prioritized for real-time operation in map-free environments. Different sensor types and fusion methods are explored to enhance performance. Hybrid Architecture: Combining the interpretability of modular systems with the learning capabilities of end-to-end models, this approach integrates data-driven path planning with modular perception and control modules. It offers robustness, flexibility, and adaptability. Furthermore, a ROS-based framework named \"CaRINA agent\" is developed to implement modular pipelines and facilitate incorporating end-to-end methods and constructing hybrid architectures. To comprehensively evaluate our methodologies, we leverage the CARLA Leaderboards, achieving competitive results in both Leaderboard 1 and Leaderboard 2, specifically ranking among the top in the SENSORS and MAP categories. Moreover, our modular architecture and hybrid agent secured 1st and 2nd place in the 2023 CARLA Autonomous Driving Challenge (CADCH), underscoring the effectiveness of our proposed approaches.A condução autônoma promete uma revolução na área de transportes, proporcionando benefícios sociais e econômicos significativos. Apesar dos avanços notáveis na tecnologia de veículos autônomos em ambientes mapeados, a navegação em áreas não mapeadas continua a ser um desafio persistente. Esta tese investiga o desenvolvimento de arquiteturas de condução autônoma para navegação em tempo real, com e sem mapas. Três abordagens são propostas, implementadas, comparadas e avaliadas: Arquitetura modular: Um agente personalizado realiza a coleta de dados e serve como linha de base para navegação baseada em mapa. Algoritmos tradicionais e novos módulos para percepção, tomada de decisão e previsão são integrados para garantir uma navegação segura em ambientes mapeados. Este agente atua como professor para os agentes de navegação sem mapa. Aprendizagem end-to-end: As redes neurais aprendem políticas a partir de dados por meio de técnicas de aprendizagem por imitação. A simplicidade é priorizada para operação em tempo real em ambientes sem mapas. Diferentes tipos de sensores e métodos de fusão são explorados para melhorar o desempenho. Arquitetura Híbrida: Combinando a interpretabilidade de sistemas modulares com a capacidade de aprendizagem de modelos end-to-end, esta abordagem integra o planejamento de trajetória baseado em dados com módulos de percepção, localizacao, tomada de decisao e controle. Oferece robustez, flexibilidade e adaptabilidade. Além disso, um framework baseado em ROS denominada \"CaRINA agent\" é desenvolvido para implementar pipelines modulares e facilitar a incorporação de métodos end-to-end e a construção de arquiteturas híbridas. Para avaliar de forma abrangente nossas metodologias, aproveitamos os Leaderboards do CARLA, alcançando resultados competitivos tanto no Leaderboard 1 quanto no Leaderboard 2, classificando as nossas abordagens especificamente entre os primeiros nas categorias SENSORES e MAP. Além disso, a nossa arquitetura modular e agente híbrido garantiram o 1º e o 2º lugar no CARLA Autonomous Driving Challenge (CADCH) 2023, mostrando a eficácia das abordagens propostas.Biblioteca Digitais de Teses e Dissertações da USPOsório, Fernando SantosRosero, Luis Alberto Rosero2024-05-06info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisapplication/pdfhttps://www.teses.usp.br/teses/disponiveis/55/55134/tde-09082024-163642/reponame:Biblioteca Digital de Teses e Dissertações da USPinstname:Universidade de São Paulo (USP)instacron:USPLiberar o conteúdo para acesso público.info:eu-repo/semantics/openAccesseng2024-08-09T19:57:02Zoai:teses.usp.br:tde-09082024-163642Biblioteca Digital de Teses e Dissertaçõeshttp://www.teses.usp.br/PUBhttp://www.teses.usp.br/cgi-bin/mtd2br.plvirginia@if.usp.br|| atendimento@aguia.usp.br||virginia@if.usp.bropendoar:27212024-08-09T19:57:02Biblioteca Digital de Teses e Dissertações da USP - Universidade de São Paulo (USP)false
dc.title.none.fl_str_mv Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped Environments
Navegando pelo desconhecido: utilizando arquiteturas modulares e aprendizado para direção autônoma em ambientes não mapeados
title Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped Environments
spellingShingle Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped Environments
Rosero, Luis Alberto Rosero
Arquitetura híbrida
Arquitetura modular
Autonomous driving
CARLA simulator
Condução autônoma
Decision-making
Disparidade
Disparity
End-to-end
End-to-end
Hybrid architecture
Intelligent and autonomous vehicles
Modular architecture
Path planning
Percepção
Perception
Planejamento de trajetória
Predição
Prediction
Simulador CARLA
Tomada de decisão
Veículos autônomos e inteligentes
title_short Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped Environments
title_full Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped Environments
title_fullStr Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped Environments
title_full_unstemmed Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped Environments
title_sort Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped Environments
author Rosero, Luis Alberto Rosero
author_facet Rosero, Luis Alberto Rosero
author_role author
dc.contributor.none.fl_str_mv Osório, Fernando Santos
dc.contributor.author.fl_str_mv Rosero, Luis Alberto Rosero
dc.subject.por.fl_str_mv Arquitetura híbrida
Arquitetura modular
Autonomous driving
CARLA simulator
Condução autônoma
Decision-making
Disparidade
Disparity
End-to-end
End-to-end
Hybrid architecture
Intelligent and autonomous vehicles
Modular architecture
Path planning
Percepção
Perception
Planejamento de trajetória
Predição
Prediction
Simulador CARLA
Tomada de decisão
Veículos autônomos e inteligentes
topic Arquitetura híbrida
Arquitetura modular
Autonomous driving
CARLA simulator
Condução autônoma
Decision-making
Disparidade
Disparity
End-to-end
End-to-end
Hybrid architecture
Intelligent and autonomous vehicles
Modular architecture
Path planning
Percepção
Perception
Planejamento de trajetória
Predição
Prediction
Simulador CARLA
Tomada de decisão
Veículos autônomos e inteligentes
description Autonomous driving promises a revolution in transportation, unlocking significant social and economic benefits. Despite notable advancements in autonomous vehicle technology tailored for mapped environments, navigating in unmapped areas remains a persistent challenge. The limited utilization of developments in modular pipelines exacerbates this issue, impeding progress towards map-free navigation. This thesis delves into the development of autonomous driving architectures for real-time navigation, both with and without maps. Three approaches are proposed, implemented, compared, and evaluated to create new and robust methodologies: Modular Pipeline: A custom agent performs data collection and serves as a baseline for mapbased navigation. Traditional algorithms and new modules for perception, decision-making, and prediction are integrated to ensure safe navigation in mapped environments. This agent acts as the \"teacher\" for the mapless navigation agents. End-to-End Learning: Neural networks learn driving policies from data through imitation learning techniques. Simplicity is prioritized for real-time operation in map-free environments. Different sensor types and fusion methods are explored to enhance performance. Hybrid Architecture: Combining the interpretability of modular systems with the learning capabilities of end-to-end models, this approach integrates data-driven path planning with modular perception and control modules. It offers robustness, flexibility, and adaptability. Furthermore, a ROS-based framework named \"CaRINA agent\" is developed to implement modular pipelines and facilitate incorporating end-to-end methods and constructing hybrid architectures. To comprehensively evaluate our methodologies, we leverage the CARLA Leaderboards, achieving competitive results in both Leaderboard 1 and Leaderboard 2, specifically ranking among the top in the SENSORS and MAP categories. Moreover, our modular architecture and hybrid agent secured 1st and 2nd place in the 2023 CARLA Autonomous Driving Challenge (CADCH), underscoring the effectiveness of our proposed approaches.
publishDate 2024
dc.date.none.fl_str_mv 2024-05-06
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/doctoralThesis
format doctoralThesis
status_str publishedVersion
dc.identifier.uri.fl_str_mv https://www.teses.usp.br/teses/disponiveis/55/55134/tde-09082024-163642/
url https://www.teses.usp.br/teses/disponiveis/55/55134/tde-09082024-163642/
dc.language.iso.fl_str_mv eng
language eng
dc.relation.none.fl_str_mv
dc.rights.driver.fl_str_mv Liberar o conteúdo para acesso público.
info:eu-repo/semantics/openAccess
rights_invalid_str_mv Liberar o conteúdo para acesso público.
eu_rights_str_mv openAccess
dc.format.none.fl_str_mv application/pdf
dc.coverage.none.fl_str_mv
dc.publisher.none.fl_str_mv Biblioteca Digitais de Teses e Dissertações da USP
publisher.none.fl_str_mv Biblioteca Digitais de Teses e Dissertações da USP
dc.source.none.fl_str_mv
reponame:Biblioteca Digital de Teses e Dissertações da USP
instname:Universidade de São Paulo (USP)
instacron:USP
instname_str Universidade de São Paulo (USP)
instacron_str USP
institution USP
reponame_str Biblioteca Digital de Teses e Dissertações da USP
collection Biblioteca Digital de Teses e Dissertações da USP
repository.name.fl_str_mv Biblioteca Digital de Teses e Dissertações da USP - Universidade de São Paulo (USP)
repository.mail.fl_str_mv virginia@if.usp.br|| atendimento@aguia.usp.br||virginia@if.usp.br
_version_ 1865491980450004992