Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped Environments
| Ano de defesa: | 2024 |
|---|---|
| Autor(a) principal: | |
| Orientador(a): | |
| Banca de defesa: | |
| Tipo de documento: | Tese |
| Tipo de acesso: | Acesso aberto |
| Idioma: | eng |
| Instituição de defesa: |
Biblioteca Digitais de Teses e Dissertações da USP
|
| Programa de Pós-Graduação: |
Não Informado pela instituição
|
| Departamento: |
Não Informado pela instituição
|
| País: |
Não Informado pela instituição
|
| Palavras-chave em Português: | |
| Link de acesso: | https://www.teses.usp.br/teses/disponiveis/55/55134/tde-09082024-163642/ |
Resumo: | Autonomous driving promises a revolution in transportation, unlocking significant social and economic benefits. Despite notable advancements in autonomous vehicle technology tailored for mapped environments, navigating in unmapped areas remains a persistent challenge. The limited utilization of developments in modular pipelines exacerbates this issue, impeding progress towards map-free navigation. This thesis delves into the development of autonomous driving architectures for real-time navigation, both with and without maps. Three approaches are proposed, implemented, compared, and evaluated to create new and robust methodologies: Modular Pipeline: A custom agent performs data collection and serves as a baseline for mapbased navigation. Traditional algorithms and new modules for perception, decision-making, and prediction are integrated to ensure safe navigation in mapped environments. This agent acts as the \"teacher\" for the mapless navigation agents. End-to-End Learning: Neural networks learn driving policies from data through imitation learning techniques. Simplicity is prioritized for real-time operation in map-free environments. Different sensor types and fusion methods are explored to enhance performance. Hybrid Architecture: Combining the interpretability of modular systems with the learning capabilities of end-to-end models, this approach integrates data-driven path planning with modular perception and control modules. It offers robustness, flexibility, and adaptability. Furthermore, a ROS-based framework named \"CaRINA agent\" is developed to implement modular pipelines and facilitate incorporating end-to-end methods and constructing hybrid architectures. To comprehensively evaluate our methodologies, we leverage the CARLA Leaderboards, achieving competitive results in both Leaderboard 1 and Leaderboard 2, specifically ranking among the top in the SENSORS and MAP categories. Moreover, our modular architecture and hybrid agent secured 1st and 2nd place in the 2023 CARLA Autonomous Driving Challenge (CADCH), underscoring the effectiveness of our proposed approaches. |
| id |
USP_453bd6de5c87c5cfb4c6a0a28ad91ac3 |
|---|---|
| oai_identifier_str |
oai:teses.usp.br:tde-09082024-163642 |
| network_acronym_str |
USP |
| network_name_str |
Biblioteca Digital de Teses e Dissertações da USP |
| repository_id_str |
|
| spelling |
Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped EnvironmentsNavegando pelo desconhecido: utilizando arquiteturas modulares e aprendizado para direção autônoma em ambientes não mapeadosArquitetura híbridaArquitetura modularAutonomous drivingCARLA simulatorCondução autônomaDecision-makingDisparidadeDisparityEnd-to-endEnd-to-endHybrid architectureIntelligent and autonomous vehiclesModular architecturePath planningPercepçãoPerceptionPlanejamento de trajetóriaPrediçãoPredictionSimulador CARLATomada de decisãoVeículos autônomos e inteligentesAutonomous driving promises a revolution in transportation, unlocking significant social and economic benefits. Despite notable advancements in autonomous vehicle technology tailored for mapped environments, navigating in unmapped areas remains a persistent challenge. The limited utilization of developments in modular pipelines exacerbates this issue, impeding progress towards map-free navigation. This thesis delves into the development of autonomous driving architectures for real-time navigation, both with and without maps. Three approaches are proposed, implemented, compared, and evaluated to create new and robust methodologies: Modular Pipeline: A custom agent performs data collection and serves as a baseline for mapbased navigation. Traditional algorithms and new modules for perception, decision-making, and prediction are integrated to ensure safe navigation in mapped environments. This agent acts as the \"teacher\" for the mapless navigation agents. End-to-End Learning: Neural networks learn driving policies from data through imitation learning techniques. Simplicity is prioritized for real-time operation in map-free environments. Different sensor types and fusion methods are explored to enhance performance. Hybrid Architecture: Combining the interpretability of modular systems with the learning capabilities of end-to-end models, this approach integrates data-driven path planning with modular perception and control modules. It offers robustness, flexibility, and adaptability. Furthermore, a ROS-based framework named \"CaRINA agent\" is developed to implement modular pipelines and facilitate incorporating end-to-end methods and constructing hybrid architectures. To comprehensively evaluate our methodologies, we leverage the CARLA Leaderboards, achieving competitive results in both Leaderboard 1 and Leaderboard 2, specifically ranking among the top in the SENSORS and MAP categories. Moreover, our modular architecture and hybrid agent secured 1st and 2nd place in the 2023 CARLA Autonomous Driving Challenge (CADCH), underscoring the effectiveness of our proposed approaches.A condução autônoma promete uma revolução na área de transportes, proporcionando benefícios sociais e econômicos significativos. Apesar dos avanços notáveis na tecnologia de veículos autônomos em ambientes mapeados, a navegação em áreas não mapeadas continua a ser um desafio persistente. Esta tese investiga o desenvolvimento de arquiteturas de condução autônoma para navegação em tempo real, com e sem mapas. Três abordagens são propostas, implementadas, comparadas e avaliadas: Arquitetura modular: Um agente personalizado realiza a coleta de dados e serve como linha de base para navegação baseada em mapa. Algoritmos tradicionais e novos módulos para percepção, tomada de decisão e previsão são integrados para garantir uma navegação segura em ambientes mapeados. Este agente atua como professor para os agentes de navegação sem mapa. Aprendizagem end-to-end: As redes neurais aprendem políticas a partir de dados por meio de técnicas de aprendizagem por imitação. A simplicidade é priorizada para operação em tempo real em ambientes sem mapas. Diferentes tipos de sensores e métodos de fusão são explorados para melhorar o desempenho. Arquitetura Híbrida: Combinando a interpretabilidade de sistemas modulares com a capacidade de aprendizagem de modelos end-to-end, esta abordagem integra o planejamento de trajetória baseado em dados com módulos de percepção, localizacao, tomada de decisao e controle. Oferece robustez, flexibilidade e adaptabilidade. Além disso, um framework baseado em ROS denominada \"CaRINA agent\" é desenvolvido para implementar pipelines modulares e facilitar a incorporação de métodos end-to-end e a construção de arquiteturas híbridas. Para avaliar de forma abrangente nossas metodologias, aproveitamos os Leaderboards do CARLA, alcançando resultados competitivos tanto no Leaderboard 1 quanto no Leaderboard 2, classificando as nossas abordagens especificamente entre os primeiros nas categorias SENSORES e MAP. Além disso, a nossa arquitetura modular e agente híbrido garantiram o 1º e o 2º lugar no CARLA Autonomous Driving Challenge (CADCH) 2023, mostrando a eficácia das abordagens propostas.Biblioteca Digitais de Teses e Dissertações da USPOsório, Fernando SantosRosero, Luis Alberto Rosero2024-05-06info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisapplication/pdfhttps://www.teses.usp.br/teses/disponiveis/55/55134/tde-09082024-163642/reponame:Biblioteca Digital de Teses e Dissertações da USPinstname:Universidade de São Paulo (USP)instacron:USPLiberar o conteúdo para acesso público.info:eu-repo/semantics/openAccesseng2024-08-09T19:57:02Zoai:teses.usp.br:tde-09082024-163642Biblioteca Digital de Teses e Dissertaçõeshttp://www.teses.usp.br/PUBhttp://www.teses.usp.br/cgi-bin/mtd2br.plvirginia@if.usp.br|| atendimento@aguia.usp.br||virginia@if.usp.bropendoar:27212024-08-09T19:57:02Biblioteca Digital de Teses e Dissertações da USP - Universidade de São Paulo (USP)false |
| dc.title.none.fl_str_mv |
Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped Environments Navegando pelo desconhecido: utilizando arquiteturas modulares e aprendizado para direção autônoma em ambientes não mapeados |
| title |
Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped Environments |
| spellingShingle |
Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped Environments Rosero, Luis Alberto Rosero Arquitetura híbrida Arquitetura modular Autonomous driving CARLA simulator Condução autônoma Decision-making Disparidade Disparity End-to-end End-to-end Hybrid architecture Intelligent and autonomous vehicles Modular architecture Path planning Percepção Perception Planejamento de trajetória Predição Prediction Simulador CARLA Tomada de decisão Veículos autônomos e inteligentes |
| title_short |
Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped Environments |
| title_full |
Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped Environments |
| title_fullStr |
Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped Environments |
| title_full_unstemmed |
Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped Environments |
| title_sort |
Leveraging Modular Architectures and End-to-End Learning for Autonomous Driving in Unmapped Environments |
| author |
Rosero, Luis Alberto Rosero |
| author_facet |
Rosero, Luis Alberto Rosero |
| author_role |
author |
| dc.contributor.none.fl_str_mv |
Osório, Fernando Santos |
| dc.contributor.author.fl_str_mv |
Rosero, Luis Alberto Rosero |
| dc.subject.por.fl_str_mv |
Arquitetura híbrida Arquitetura modular Autonomous driving CARLA simulator Condução autônoma Decision-making Disparidade Disparity End-to-end End-to-end Hybrid architecture Intelligent and autonomous vehicles Modular architecture Path planning Percepção Perception Planejamento de trajetória Predição Prediction Simulador CARLA Tomada de decisão Veículos autônomos e inteligentes |
| topic |
Arquitetura híbrida Arquitetura modular Autonomous driving CARLA simulator Condução autônoma Decision-making Disparidade Disparity End-to-end End-to-end Hybrid architecture Intelligent and autonomous vehicles Modular architecture Path planning Percepção Perception Planejamento de trajetória Predição Prediction Simulador CARLA Tomada de decisão Veículos autônomos e inteligentes |
| description |
Autonomous driving promises a revolution in transportation, unlocking significant social and economic benefits. Despite notable advancements in autonomous vehicle technology tailored for mapped environments, navigating in unmapped areas remains a persistent challenge. The limited utilization of developments in modular pipelines exacerbates this issue, impeding progress towards map-free navigation. This thesis delves into the development of autonomous driving architectures for real-time navigation, both with and without maps. Three approaches are proposed, implemented, compared, and evaluated to create new and robust methodologies: Modular Pipeline: A custom agent performs data collection and serves as a baseline for mapbased navigation. Traditional algorithms and new modules for perception, decision-making, and prediction are integrated to ensure safe navigation in mapped environments. This agent acts as the \"teacher\" for the mapless navigation agents. End-to-End Learning: Neural networks learn driving policies from data through imitation learning techniques. Simplicity is prioritized for real-time operation in map-free environments. Different sensor types and fusion methods are explored to enhance performance. Hybrid Architecture: Combining the interpretability of modular systems with the learning capabilities of end-to-end models, this approach integrates data-driven path planning with modular perception and control modules. It offers robustness, flexibility, and adaptability. Furthermore, a ROS-based framework named \"CaRINA agent\" is developed to implement modular pipelines and facilitate incorporating end-to-end methods and constructing hybrid architectures. To comprehensively evaluate our methodologies, we leverage the CARLA Leaderboards, achieving competitive results in both Leaderboard 1 and Leaderboard 2, specifically ranking among the top in the SENSORS and MAP categories. Moreover, our modular architecture and hybrid agent secured 1st and 2nd place in the 2023 CARLA Autonomous Driving Challenge (CADCH), underscoring the effectiveness of our proposed approaches. |
| publishDate |
2024 |
| dc.date.none.fl_str_mv |
2024-05-06 |
| dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
| dc.type.driver.fl_str_mv |
info:eu-repo/semantics/doctoralThesis |
| format |
doctoralThesis |
| status_str |
publishedVersion |
| dc.identifier.uri.fl_str_mv |
https://www.teses.usp.br/teses/disponiveis/55/55134/tde-09082024-163642/ |
| url |
https://www.teses.usp.br/teses/disponiveis/55/55134/tde-09082024-163642/ |
| dc.language.iso.fl_str_mv |
eng |
| language |
eng |
| dc.relation.none.fl_str_mv |
|
| dc.rights.driver.fl_str_mv |
Liberar o conteúdo para acesso público. info:eu-repo/semantics/openAccess |
| rights_invalid_str_mv |
Liberar o conteúdo para acesso público. |
| eu_rights_str_mv |
openAccess |
| dc.format.none.fl_str_mv |
application/pdf |
| dc.coverage.none.fl_str_mv |
|
| dc.publisher.none.fl_str_mv |
Biblioteca Digitais de Teses e Dissertações da USP |
| publisher.none.fl_str_mv |
Biblioteca Digitais de Teses e Dissertações da USP |
| dc.source.none.fl_str_mv |
reponame:Biblioteca Digital de Teses e Dissertações da USP instname:Universidade de São Paulo (USP) instacron:USP |
| instname_str |
Universidade de São Paulo (USP) |
| instacron_str |
USP |
| institution |
USP |
| reponame_str |
Biblioteca Digital de Teses e Dissertações da USP |
| collection |
Biblioteca Digital de Teses e Dissertações da USP |
| repository.name.fl_str_mv |
Biblioteca Digital de Teses e Dissertações da USP - Universidade de São Paulo (USP) |
| repository.mail.fl_str_mv |
virginia@if.usp.br|| atendimento@aguia.usp.br||virginia@if.usp.br |
| _version_ |
1865491980450004992 |