Link adaptation solutions based on reinforcement learning for 5G new radio

Detalhes bibliográficos
Ano de defesa: 2020
Autor(a) principal: Mota, Mateus Pontes
Orientador(a): Almeida, André Lima Férrer de
Banca de defesa: Não Informado pela instituição
Tipo de documento: Dissertação
Tipo de acesso: Acesso aberto
Idioma: eng
Instituição de defesa: Não Informado pela instituição
Programa de Pós-Graduação: Não Informado pela instituição
Departamento: Não Informado pela instituição
País: Não Informado pela instituição
Palavras-chave em Português:
Link de acesso: http://www.repositorio.ufc.br/handle/riufc/51771
Resumo: In this work we propose two self-exploratory frameworks, based on reinforcement learning (RL) for link adaptation in fifth generation (5G) wireless communication systems. Firstly, a Q-learning solution for adaptive modulation and coding (AMC) is presented that allows the base station to learn the mapping between the modulation and coding scheme (MCS) and the channel quality indicator (CQI), in order to maximize the spectral efficiency of the system. Compared to classic AMC solutions, the proposed solution achieves superior performances in terms of spectral efficiency and block error rate (BLER). In the second part of this work, a broader problem is considered in the context of multiple-input multiple-output (MIMO) systems with spatial multiplexing. For this system, a solution based on Q-learning is presented for the joint selection of the MCS and the number of spatial transmission layers (spatial multiplexing factor), as well as the precoding scheme. In this case, the mapping is learned based on the information from the CQI and the rank indicator (RI). According to our simulation results, the proposed solution achieves a performance similar to that of the reference (genie-aided) solution, but with less signaling compared to the one specified in the 5G standard.
id UFC-7_7a7776a1c93763a2793a2685f83f2ae8
oai_identifier_str oai:repositorio.ufc.br:riufc/51771
network_acronym_str UFC-7
network_name_str Repositório Institucional da Universidade Federal do Ceará (UFC)
repository_id_str
spelling Mota, Mateus PontesCavalcanti, Francisco Rodrigo PortoAlmeida, André Lima Férrer de2020-05-18T00:18:17Z2020-05-18T00:18:17Z2020MOTA, M. P. Link adaptation solutions based on reinforcement learning for 5G new radio. 2020. 62 f. Dissertação (Mestrado em Engenharia de Teleinformática) – Centro de Tecnologia, Universidade Federal do Ceará, Fortaleza, 2020.http://www.repositorio.ufc.br/handle/riufc/51771In this work we propose two self-exploratory frameworks, based on reinforcement learning (RL) for link adaptation in fifth generation (5G) wireless communication systems. Firstly, a Q-learning solution for adaptive modulation and coding (AMC) is presented that allows the base station to learn the mapping between the modulation and coding scheme (MCS) and the channel quality indicator (CQI), in order to maximize the spectral efficiency of the system. Compared to classic AMC solutions, the proposed solution achieves superior performances in terms of spectral efficiency and block error rate (BLER). In the second part of this work, a broader problem is considered in the context of multiple-input multiple-output (MIMO) systems with spatial multiplexing. For this system, a solution based on Q-learning is presented for the joint selection of the MCS and the number of spatial transmission layers (spatial multiplexing factor), as well as the precoding scheme. In this case, the mapping is learned based on the information from the CQI and the rank indicator (RI). According to our simulation results, the proposed solution achieves a performance similar to that of the reference (genie-aided) solution, but with less signaling compared to the one specified in the 5G standard.Neste trabalho são propostos dois frameworks auto-exploratórios, baseados em aprendizado por reforço para a adaptação de enlace em sistemas de comunicações sem fio 5G. Primeiramente, é apresentada uma solução baseada em Q-learning para modulação e codificação adaptativa que permite a estação base aprender o mapeamento entre o esquema de modulação e codificação e o indicador de qualidade do canal (do inglês CQI- channel quality indicator), visando maximizar a eficiência espectral do sistema. Comparada às soluções clássicas de modulação e codificação adaptativa, a solução proposta alcança desempenho superior em termos de eficiência espectral e taxa de erro de blocos. Na segunda parte deste trabalho, considera-se um problema mais amplo no contexto de sistemas com múltiplas entradas e múltiplas saídas (do inglês, MIMO - multiple-input multiple-output), em que a estação base e o usuário são equipados com arranjos de antenas. Para este sistema, é apresentada uma solução baseada em Q-learning para a seleção conjunta do esquema de modulação e codificação e do número de camadas espaciais de transmissão (fator de multiplexação espacial), bem como o esquema de precodificação. Neste caso, o mapeamento é aprendido baseado nas informações de CQI e do indicador de posto da tramissão (do inglês, RI - rank indicator). De acordo com resultados de simulação, a solução proposta atinge um desempenho similar ao da solução de referência (genie-aided) porém com menor quantidade de sinalização necessária quando comparada à sinalização especificada no padrão do 5G.TeleinformáticaInteligência artificialAprendizado do computadorReinforcement learningLink adaptationRank adaptationLink adaptation solutions based on reinforcement learning for 5G new radioinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisengreponame:Repositório Institucional da Universidade Federal do Ceará (UFC)instname:Universidade Federal do Ceará (UFC)instacron:UFCinfo:eu-repo/semantics/openAccessORIGINAL2020_dis_mpmota.pdf2020_dis_mpmota.pdfapplication/pdf3300911http://repositorio.ufc.br/bitstream/riufc/51771/3/2020_dis_mpmota.pdf7d1f0942cf5a3cc82934e887e6e21fe9MD53LICENSElicense.txtlicense.txttext/plain; charset=utf-81748http://repositorio.ufc.br/bitstream/riufc/51771/4/license.txt8a4605be74aa9ea9d79846c1fba20a33MD54riufc/517712020-11-26 17:33:23.296oai:repositorio.ufc.br:riufc/51771Tk9URTogUExBQ0UgWU9VUiBPV04gTElDRU5TRSBIRVJFClRoaXMgc2FtcGxlIGxpY2Vuc2UgaXMgcHJvdmlkZWQgZm9yIGluZm9ybWF0aW9uYWwgcHVycG9zZXMgb25seS4KCk5PTi1FWENMVVNJVkUgRElTVFJJQlVUSU9OIExJQ0VOU0UKCkJ5IHNpZ25pbmcgYW5kIHN1Ym1pdHRpbmcgdGhpcyBsaWNlbnNlLCB5b3UgKHRoZSBhdXRob3Iocykgb3IgY29weXJpZ2h0Cm93bmVyKSBncmFudHMgdG8gRFNwYWNlIFVuaXZlcnNpdHkgKERTVSkgdGhlIG5vbi1leGNsdXNpdmUgcmlnaHQgdG8gcmVwcm9kdWNlLAp0cmFuc2xhdGUgKGFzIGRlZmluZWQgYmVsb3cpLCBhbmQvb3IgZGlzdHJpYnV0ZSB5b3VyIHN1Ym1pc3Npb24gKGluY2x1ZGluZwp0aGUgYWJzdHJhY3QpIHdvcmxkd2lkZSBpbiBwcmludCBhbmQgZWxlY3Ryb25pYyBmb3JtYXQgYW5kIGluIGFueSBtZWRpdW0sCmluY2x1ZGluZyBidXQgbm90IGxpbWl0ZWQgdG8gYXVkaW8gb3IgdmlkZW8uCgpZb3UgYWdyZWUgdGhhdCBEU1UgbWF5LCB3aXRob3V0IGNoYW5naW5nIHRoZSBjb250ZW50LCB0cmFuc2xhdGUgdGhlCnN1Ym1pc3Npb24gdG8gYW55IG1lZGl1bSBvciBmb3JtYXQgZm9yIHRoZSBwdXJwb3NlIG9mIHByZXNlcnZhdGlvbi4KCllvdSBhbHNvIGFncmVlIHRoYXQgRFNVIG1heSBrZWVwIG1vcmUgdGhhbiBvbmUgY29weSBvZiB0aGlzIHN1Ym1pc3Npb24gZm9yCnB1cnBvc2VzIG9mIHNlY3VyaXR5LCBiYWNrLXVwIGFuZCBwcmVzZXJ2YXRpb24uCgpZb3UgcmVwcmVzZW50IHRoYXQgdGhlIHN1Ym1pc3Npb24gaXMgeW91ciBvcmlnaW5hbCB3b3JrLCBhbmQgdGhhdCB5b3UgaGF2ZQp0aGUgcmlnaHQgdG8gZ3JhbnQgdGhlIHJpZ2h0cyBjb250YWluZWQgaW4gdGhpcyBsaWNlbnNlLiBZb3UgYWxzbyByZXByZXNlbnQKdGhhdCB5b3VyIHN1Ym1pc3Npb24gZG9lcyBub3QsIHRvIHRoZSBiZXN0IG9mIHlvdXIga25vd2xlZGdlLCBpbmZyaW5nZSB1cG9uCmFueW9uZSdzIGNvcHlyaWdodC4KCklmIHRoZSBzdWJtaXNzaW9uIGNvbnRhaW5zIG1hdGVyaWFsIGZvciB3aGljaCB5b3UgZG8gbm90IGhvbGQgY29weXJpZ2h0LAp5b3UgcmVwcmVzZW50IHRoYXQgeW91IGhhdmUgb2J0YWluZWQgdGhlIHVucmVzdHJpY3RlZCBwZXJtaXNzaW9uIG9mIHRoZQpjb3B5cmlnaHQgb3duZXIgdG8gZ3JhbnQgRFNVIHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdApzdWNoIHRoaXJkLXBhcnR5IG93bmVkIG1hdGVyaWFsIGlzIGNsZWFybHkgaWRlbnRpZmllZCBhbmQgYWNrbm93bGVkZ2VkCndpdGhpbiB0aGUgdGV4dCBvciBjb250ZW50IG9mIHRoZSBzdWJtaXNzaW9uLgoKSUYgVEhFIFNVQk1JU1NJT04gSVMgQkFTRUQgVVBPTiBXT1JLIFRIQVQgSEFTIEJFRU4gU1BPTlNPUkVEIE9SIFNVUFBPUlRFRApCWSBBTiBBR0VOQ1kgT1IgT1JHQU5JWkFUSU9OIE9USEVSIFRIQU4gRFNVLCBZT1UgUkVQUkVTRU5UIFRIQVQgWU9VIEhBVkUKRlVMRklMTEVEIEFOWSBSSUdIVCBPRiBSRVZJRVcgT1IgT1RIRVIgT0JMSUdBVElPTlMgUkVRVUlSRUQgQlkgU1VDSApDT05UUkFDVCBPUiBBR1JFRU1FTlQuCgpEU1Ugd2lsbCBjbGVhcmx5IGlkZW50aWZ5IHlvdXIgbmFtZShzKSBhcyB0aGUgYXV0aG9yKHMpIG9yIG93bmVyKHMpIG9mIHRoZQpzdWJtaXNzaW9uLCBhbmQgd2lsbCBub3QgbWFrZSBhbnkgYWx0ZXJhdGlvbiwgb3RoZXIgdGhhbiBhcyBhbGxvd2VkIGJ5IHRoaXMKbGljZW5zZSwgdG8geW91ciBzdWJtaXNzaW9uLgo=Repositório InstitucionalPUBhttp://www.repositorio.ufc.br/ri-oai/requestbu@ufc.br || repositorio@ufc.bropendoar:2020-11-26T20:33:23Repositório Institucional da Universidade Federal do Ceará (UFC) - Universidade Federal do Ceará (UFC)false
dc.title.pt_BR.fl_str_mv Link adaptation solutions based on reinforcement learning for 5G new radio
title Link adaptation solutions based on reinforcement learning for 5G new radio
spellingShingle Link adaptation solutions based on reinforcement learning for 5G new radio
Mota, Mateus Pontes
Teleinformática
Inteligência artificial
Aprendizado do computador
Reinforcement learning
Link adaptation
Rank adaptation
title_short Link adaptation solutions based on reinforcement learning for 5G new radio
title_full Link adaptation solutions based on reinforcement learning for 5G new radio
title_fullStr Link adaptation solutions based on reinforcement learning for 5G new radio
title_full_unstemmed Link adaptation solutions based on reinforcement learning for 5G new radio
title_sort Link adaptation solutions based on reinforcement learning for 5G new radio
author Mota, Mateus Pontes
author_facet Mota, Mateus Pontes
author_role author
dc.contributor.co-advisor.none.fl_str_mv Cavalcanti, Francisco Rodrigo Porto
dc.contributor.author.fl_str_mv Mota, Mateus Pontes
dc.contributor.advisor1.fl_str_mv Almeida, André Lima Férrer de
contributor_str_mv Almeida, André Lima Férrer de
dc.subject.por.fl_str_mv Teleinformática
Inteligência artificial
Aprendizado do computador
Reinforcement learning
Link adaptation
Rank adaptation
topic Teleinformática
Inteligência artificial
Aprendizado do computador
Reinforcement learning
Link adaptation
Rank adaptation
description In this work we propose two self-exploratory frameworks, based on reinforcement learning (RL) for link adaptation in fifth generation (5G) wireless communication systems. Firstly, a Q-learning solution for adaptive modulation and coding (AMC) is presented that allows the base station to learn the mapping between the modulation and coding scheme (MCS) and the channel quality indicator (CQI), in order to maximize the spectral efficiency of the system. Compared to classic AMC solutions, the proposed solution achieves superior performances in terms of spectral efficiency and block error rate (BLER). In the second part of this work, a broader problem is considered in the context of multiple-input multiple-output (MIMO) systems with spatial multiplexing. For this system, a solution based on Q-learning is presented for the joint selection of the MCS and the number of spatial transmission layers (spatial multiplexing factor), as well as the precoding scheme. In this case, the mapping is learned based on the information from the CQI and the rank indicator (RI). According to our simulation results, the proposed solution achieves a performance similar to that of the reference (genie-aided) solution, but with less signaling compared to the one specified in the 5G standard.
publishDate 2020
dc.date.accessioned.fl_str_mv 2020-05-18T00:18:17Z
dc.date.available.fl_str_mv 2020-05-18T00:18:17Z
dc.date.issued.fl_str_mv 2020
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv MOTA, M. P. Link adaptation solutions based on reinforcement learning for 5G new radio. 2020. 62 f. Dissertação (Mestrado em Engenharia de Teleinformática) – Centro de Tecnologia, Universidade Federal do Ceará, Fortaleza, 2020.
dc.identifier.uri.fl_str_mv http://www.repositorio.ufc.br/handle/riufc/51771
identifier_str_mv MOTA, M. P. Link adaptation solutions based on reinforcement learning for 5G new radio. 2020. 62 f. Dissertação (Mestrado em Engenharia de Teleinformática) – Centro de Tecnologia, Universidade Federal do Ceará, Fortaleza, 2020.
url http://www.repositorio.ufc.br/handle/riufc/51771
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.source.none.fl_str_mv reponame:Repositório Institucional da Universidade Federal do Ceará (UFC)
instname:Universidade Federal do Ceará (UFC)
instacron:UFC
instname_str Universidade Federal do Ceará (UFC)
instacron_str UFC
institution UFC
reponame_str Repositório Institucional da Universidade Federal do Ceará (UFC)
collection Repositório Institucional da Universidade Federal do Ceará (UFC)
bitstream.url.fl_str_mv http://repositorio.ufc.br/bitstream/riufc/51771/3/2020_dis_mpmota.pdf
http://repositorio.ufc.br/bitstream/riufc/51771/4/license.txt
bitstream.checksum.fl_str_mv 7d1f0942cf5a3cc82934e887e6e21fe9
8a4605be74aa9ea9d79846c1fba20a33
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
repository.name.fl_str_mv Repositório Institucional da Universidade Federal do Ceará (UFC) - Universidade Federal do Ceará (UFC)
repository.mail.fl_str_mv bu@ufc.br || repositorio@ufc.br
_version_ 1847793133373358080