Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes

Detalhes bibliográficos
Ano de defesa: 2012
Autor(a) principal: Menezes Júnior, José Maria Pires de
Orientador(a): Barreto, Guilherme de Alencar
Banca de defesa: Não Informado pela instituição
Tipo de documento: Tese
Tipo de acesso: Acesso aberto
Idioma: por
Instituição de defesa: Não Informado pela instituição
Programa de Pós-Graduação: Não Informado pela instituição
Departamento: Não Informado pela instituição
País: Não Informado pela instituição
Palavras-chave em Português:
Link de acesso: http://www.repositorio.ufc.br/handle/riufc/22982
Resumo: In this thesis, we tackle the problem of recursive prediction of univariate time series, also known as long-term prediction, using recurrent neural networks. This type of problem often emerges from nonlinear dynamical systems modelling and prediction tasks, particularly from those producing signals of chaotic nature, where one can observe the presence of long-term temporal dependencies. In recursive prediction, differently from the one-step-ahead prediction task, predicted values are fed back to the input of the neural model, a feature that makes time series with long-term temporal dependencies more difficult to deal with due to the propagation of prediction errors. That being said, in order to handle the problem of recursive prediction of univariate time series, extensions of the neural NARX (Nonlinear AutoRegressive model with eXogenous inputs) model ar eintroduced in this thesis. These extensions result from attempts to embed into the NARX model different strategies to capture temporal information, either of short-term or long-term nature. Among such strategies, we highlight the following ones: (i) simultaneous prediction of several steps ahead, also known as MIMO (multi-input, multi-output model) prediction, (ii) prediction via dynamical random projections, as in the ESN (echo state network) model, (iii) prediction via static random projections, as in the ELM (extreme learning machine) network, and (iv) prediction via hybrid recurrent models based the NARX and ELMAN networks. Additionally, a novel methodology for the design (i.e. parameter selection) and performance comparison of the proposed models is also introduced in this model with the aim of evaluating them under similar conditions and to serve as reference for further studies. For this purpose, synthetic and real-world benchmarking time series are used. The obtained results suggest that the proposed neural models present themselves as efficient alternatives to the state of the art in recursive prediction of univariate time series using recurrent neural architectures.
id UFC-7_ba10504e54edd222bdaccb6e499f3abe
oai_identifier_str oai:repositorio.ufc.br:riufc/22982
network_acronym_str UFC-7
network_name_str Repositório Institucional da Universidade Federal do Ceará (UFC)
repository_id_str
spelling Menezes Júnior, José Maria Pires deBarreto, Guilherme de Alencar2017-06-02T13:54:13Z2017-06-02T13:54:13Z2012MENEZES JÚNIOR, J. M. P. Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes. 2012. 186 f. Tese (Doutorado em Engenharia de Teleinformática)–Centro de Tecnologia, Universidade Federal do Ceará, Fortaleza, 2012.http://www.repositorio.ufc.br/handle/riufc/22982In this thesis, we tackle the problem of recursive prediction of univariate time series, also known as long-term prediction, using recurrent neural networks. This type of problem often emerges from nonlinear dynamical systems modelling and prediction tasks, particularly from those producing signals of chaotic nature, where one can observe the presence of long-term temporal dependencies. In recursive prediction, differently from the one-step-ahead prediction task, predicted values are fed back to the input of the neural model, a feature that makes time series with long-term temporal dependencies more difficult to deal with due to the propagation of prediction errors. That being said, in order to handle the problem of recursive prediction of univariate time series, extensions of the neural NARX (Nonlinear AutoRegressive model with eXogenous inputs) model ar eintroduced in this thesis. These extensions result from attempts to embed into the NARX model different strategies to capture temporal information, either of short-term or long-term nature. Among such strategies, we highlight the following ones: (i) simultaneous prediction of several steps ahead, also known as MIMO (multi-input, multi-output model) prediction, (ii) prediction via dynamical random projections, as in the ESN (echo state network) model, (iii) prediction via static random projections, as in the ELM (extreme learning machine) network, and (iv) prediction via hybrid recurrent models based the NARX and ELMAN networks. Additionally, a novel methodology for the design (i.e. parameter selection) and performance comparison of the proposed models is also introduced in this model with the aim of evaluating them under similar conditions and to serve as reference for further studies. For this purpose, synthetic and real-world benchmarking time series are used. The obtained results suggest that the proposed neural models present themselves as efficient alternatives to the state of the art in recursive prediction of univariate time series using recurrent neural architectures.Nesta tese aborda-se o problema de predição recursiva de séries temporais univariadas, também chamado de predição de longo prazo, usando redes neurais recorrentes. Este tipo de problema surge, com frequência, em tarefas de modelagem e predição de sistemas dinâmicos não-lineares, principalmente os que produzem sinais de natureza caótica, em que se observa a presença de dependência temporal (memória) de longa duração. Na predição recursiva, diferentemente da predição de um passo à frente (one-step-ahead prediction), as predições são realimentadas para a entrada do modelo neural, característica esta que dificulta a predição de séries com dependência temporal longa devido à propagação do erro de predição. Isto posto, para tratar o problema de predição recursiva de séries temporais, extensões do modelo neural NARX (Nonlinear AutoRegressive model with eXogenous inputs) são propostas nesta tese. Estas extensões resultam da tentativa de incorporar à rede NARX diferentes estratégias de modelagem da informação temporal, tanto de curto quanto de longo prazo. Dentre estas estratégias, destacamse: (i) predição (simultânea) de vários passos à frente, também chamada de predição MIMO (multi-input, multi-output model), (ii) predição via projeções aleatórias dinâmicas, tal como na rede ESN (echo state network), (iii) predição via projeções aleatórias estáticas, tal como na rede ELM(extreme learning machine), e (iv) predição via modelos recorrentes híbridos baseados nas redes NARX e ELMAN. Além disso, uma metodologia para projeto (i.e. seleção de parâmetros) e comparação dos desempenhos dos modelos propostos é também desenvolvida nesta tese com o objetivo de avaliá-los sob as mesmas condições e servir de referência para estudos futuros. Para este fim, são utilizadas séries temporais sintéticas e reais comumente presentes em benchmarks de desempenho. Os resultados obtidos sugerem que os modelos propostos apresentam-se como alternativas eficientes ao estado da arte em modelos de redes neurais recorrentes para predição de séries temporais univariadas, principalmente aqueles baseados em projeções aleatórias devido ao baixo custo computacional.TeleinformáticaEstudos de séries temporaisRedes neurais (Computação)Máquina de aprendizagem extremaContribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentesContributions to the problem of recursive prediction of univariate time series using recurrent neural networksinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisporreponame:Repositório Institucional da Universidade Federal do Ceará (UFC)instname:Universidade Federal do Ceará (UFC)instacron:UFCinfo:eu-repo/semantics/openAccessORIGINAL2012_tese_jmpmenezesjúnior.pdf2012_tese_jmpmenezesjúnior.pdfapplication/pdf8865921http://repositorio.ufc.br/bitstream/riufc/22982/1/2012_tese_jmpmenezesj%c3%banior.pdf029824a1fa5ffbf3ffe36c81c0b8f5f5MD51LICENSElicense.txtlicense.txttext/plain; charset=utf-81748http://repositorio.ufc.br/bitstream/riufc/22982/2/license.txt8a4605be74aa9ea9d79846c1fba20a33MD52riufc/229822022-11-21 13:57:16.505oai:repositorio.ufc.br:riufc/22982Tk9URTogUExBQ0UgWU9VUiBPV04gTElDRU5TRSBIRVJFClRoaXMgc2FtcGxlIGxpY2Vuc2UgaXMgcHJvdmlkZWQgZm9yIGluZm9ybWF0aW9uYWwgcHVycG9zZXMgb25seS4KCk5PTi1FWENMVVNJVkUgRElTVFJJQlVUSU9OIExJQ0VOU0UKCkJ5IHNpZ25pbmcgYW5kIHN1Ym1pdHRpbmcgdGhpcyBsaWNlbnNlLCB5b3UgKHRoZSBhdXRob3Iocykgb3IgY29weXJpZ2h0Cm93bmVyKSBncmFudHMgdG8gRFNwYWNlIFVuaXZlcnNpdHkgKERTVSkgdGhlIG5vbi1leGNsdXNpdmUgcmlnaHQgdG8gcmVwcm9kdWNlLAp0cmFuc2xhdGUgKGFzIGRlZmluZWQgYmVsb3cpLCBhbmQvb3IgZGlzdHJpYnV0ZSB5b3VyIHN1Ym1pc3Npb24gKGluY2x1ZGluZwp0aGUgYWJzdHJhY3QpIHdvcmxkd2lkZSBpbiBwcmludCBhbmQgZWxlY3Ryb25pYyBmb3JtYXQgYW5kIGluIGFueSBtZWRpdW0sCmluY2x1ZGluZyBidXQgbm90IGxpbWl0ZWQgdG8gYXVkaW8gb3IgdmlkZW8uCgpZb3UgYWdyZWUgdGhhdCBEU1UgbWF5LCB3aXRob3V0IGNoYW5naW5nIHRoZSBjb250ZW50LCB0cmFuc2xhdGUgdGhlCnN1Ym1pc3Npb24gdG8gYW55IG1lZGl1bSBvciBmb3JtYXQgZm9yIHRoZSBwdXJwb3NlIG9mIHByZXNlcnZhdGlvbi4KCllvdSBhbHNvIGFncmVlIHRoYXQgRFNVIG1heSBrZWVwIG1vcmUgdGhhbiBvbmUgY29weSBvZiB0aGlzIHN1Ym1pc3Npb24gZm9yCnB1cnBvc2VzIG9mIHNlY3VyaXR5LCBiYWNrLXVwIGFuZCBwcmVzZXJ2YXRpb24uCgpZb3UgcmVwcmVzZW50IHRoYXQgdGhlIHN1Ym1pc3Npb24gaXMgeW91ciBvcmlnaW5hbCB3b3JrLCBhbmQgdGhhdCB5b3UgaGF2ZQp0aGUgcmlnaHQgdG8gZ3JhbnQgdGhlIHJpZ2h0cyBjb250YWluZWQgaW4gdGhpcyBsaWNlbnNlLiBZb3UgYWxzbyByZXByZXNlbnQKdGhhdCB5b3VyIHN1Ym1pc3Npb24gZG9lcyBub3QsIHRvIHRoZSBiZXN0IG9mIHlvdXIga25vd2xlZGdlLCBpbmZyaW5nZSB1cG9uCmFueW9uZSdzIGNvcHlyaWdodC4KCklmIHRoZSBzdWJtaXNzaW9uIGNvbnRhaW5zIG1hdGVyaWFsIGZvciB3aGljaCB5b3UgZG8gbm90IGhvbGQgY29weXJpZ2h0LAp5b3UgcmVwcmVzZW50IHRoYXQgeW91IGhhdmUgb2J0YWluZWQgdGhlIHVucmVzdHJpY3RlZCBwZXJtaXNzaW9uIG9mIHRoZQpjb3B5cmlnaHQgb3duZXIgdG8gZ3JhbnQgRFNVIHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdApzdWNoIHRoaXJkLXBhcnR5IG93bmVkIG1hdGVyaWFsIGlzIGNsZWFybHkgaWRlbnRpZmllZCBhbmQgYWNrbm93bGVkZ2VkCndpdGhpbiB0aGUgdGV4dCBvciBjb250ZW50IG9mIHRoZSBzdWJtaXNzaW9uLgoKSUYgVEhFIFNVQk1JU1NJT04gSVMgQkFTRUQgVVBPTiBXT1JLIFRIQVQgSEFTIEJFRU4gU1BPTlNPUkVEIE9SIFNVUFBPUlRFRApCWSBBTiBBR0VOQ1kgT1IgT1JHQU5JWkFUSU9OIE9USEVSIFRIQU4gRFNVLCBZT1UgUkVQUkVTRU5UIFRIQVQgWU9VIEhBVkUKRlVMRklMTEVEIEFOWSBSSUdIVCBPRiBSRVZJRVcgT1IgT1RIRVIgT0JMSUdBVElPTlMgUkVRVUlSRUQgQlkgU1VDSApDT05UUkFDVCBPUiBBR1JFRU1FTlQuCgpEU1Ugd2lsbCBjbGVhcmx5IGlkZW50aWZ5IHlvdXIgbmFtZShzKSBhcyB0aGUgYXV0aG9yKHMpIG9yIG93bmVyKHMpIG9mIHRoZQpzdWJtaXNzaW9uLCBhbmQgd2lsbCBub3QgbWFrZSBhbnkgYWx0ZXJhdGlvbiwgb3RoZXIgdGhhbiBhcyBhbGxvd2VkIGJ5IHRoaXMKbGljZW5zZSwgdG8geW91ciBzdWJtaXNzaW9uLgo=Repositório InstitucionalPUBhttp://www.repositorio.ufc.br/ri-oai/requestbu@ufc.br || repositorio@ufc.bropendoar:2022-11-21T16:57:16Repositório Institucional da Universidade Federal do Ceará (UFC) - Universidade Federal do Ceará (UFC)false
dc.title.pt_BR.fl_str_mv Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes
dc.title.en.pt_BR.fl_str_mv Contributions to the problem of recursive prediction of univariate time series using recurrent neural networks
title Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes
spellingShingle Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes
Menezes Júnior, José Maria Pires de
Teleinformática
Estudos de séries temporais
Redes neurais (Computação)
Máquina de aprendizagem extrema
title_short Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes
title_full Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes
title_fullStr Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes
title_full_unstemmed Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes
title_sort Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes
author Menezes Júnior, José Maria Pires de
author_facet Menezes Júnior, José Maria Pires de
author_role author
dc.contributor.author.fl_str_mv Menezes Júnior, José Maria Pires de
dc.contributor.advisor1.fl_str_mv Barreto, Guilherme de Alencar
contributor_str_mv Barreto, Guilherme de Alencar
dc.subject.por.fl_str_mv Teleinformática
Estudos de séries temporais
Redes neurais (Computação)
Máquina de aprendizagem extrema
topic Teleinformática
Estudos de séries temporais
Redes neurais (Computação)
Máquina de aprendizagem extrema
description In this thesis, we tackle the problem of recursive prediction of univariate time series, also known as long-term prediction, using recurrent neural networks. This type of problem often emerges from nonlinear dynamical systems modelling and prediction tasks, particularly from those producing signals of chaotic nature, where one can observe the presence of long-term temporal dependencies. In recursive prediction, differently from the one-step-ahead prediction task, predicted values are fed back to the input of the neural model, a feature that makes time series with long-term temporal dependencies more difficult to deal with due to the propagation of prediction errors. That being said, in order to handle the problem of recursive prediction of univariate time series, extensions of the neural NARX (Nonlinear AutoRegressive model with eXogenous inputs) model ar eintroduced in this thesis. These extensions result from attempts to embed into the NARX model different strategies to capture temporal information, either of short-term or long-term nature. Among such strategies, we highlight the following ones: (i) simultaneous prediction of several steps ahead, also known as MIMO (multi-input, multi-output model) prediction, (ii) prediction via dynamical random projections, as in the ESN (echo state network) model, (iii) prediction via static random projections, as in the ELM (extreme learning machine) network, and (iv) prediction via hybrid recurrent models based the NARX and ELMAN networks. Additionally, a novel methodology for the design (i.e. parameter selection) and performance comparison of the proposed models is also introduced in this model with the aim of evaluating them under similar conditions and to serve as reference for further studies. For this purpose, synthetic and real-world benchmarking time series are used. The obtained results suggest that the proposed neural models present themselves as efficient alternatives to the state of the art in recursive prediction of univariate time series using recurrent neural architectures.
publishDate 2012
dc.date.issued.fl_str_mv 2012
dc.date.accessioned.fl_str_mv 2017-06-02T13:54:13Z
dc.date.available.fl_str_mv 2017-06-02T13:54:13Z
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/doctoralThesis
format doctoralThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv MENEZES JÚNIOR, J. M. P. Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes. 2012. 186 f. Tese (Doutorado em Engenharia de Teleinformática)–Centro de Tecnologia, Universidade Federal do Ceará, Fortaleza, 2012.
dc.identifier.uri.fl_str_mv http://www.repositorio.ufc.br/handle/riufc/22982
identifier_str_mv MENEZES JÚNIOR, J. M. P. Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes. 2012. 186 f. Tese (Doutorado em Engenharia de Teleinformática)–Centro de Tecnologia, Universidade Federal do Ceará, Fortaleza, 2012.
url http://www.repositorio.ufc.br/handle/riufc/22982
dc.language.iso.fl_str_mv por
language por
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.source.none.fl_str_mv reponame:Repositório Institucional da Universidade Federal do Ceará (UFC)
instname:Universidade Federal do Ceará (UFC)
instacron:UFC
instname_str Universidade Federal do Ceará (UFC)
instacron_str UFC
institution UFC
reponame_str Repositório Institucional da Universidade Federal do Ceará (UFC)
collection Repositório Institucional da Universidade Federal do Ceará (UFC)
bitstream.url.fl_str_mv http://repositorio.ufc.br/bitstream/riufc/22982/1/2012_tese_jmpmenezesj%c3%banior.pdf
http://repositorio.ufc.br/bitstream/riufc/22982/2/license.txt
bitstream.checksum.fl_str_mv 029824a1fa5ffbf3ffe36c81c0b8f5f5
8a4605be74aa9ea9d79846c1fba20a33
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
repository.name.fl_str_mv Repositório Institucional da Universidade Federal do Ceará (UFC) - Universidade Federal do Ceará (UFC)
repository.mail.fl_str_mv bu@ufc.br || repositorio@ufc.br
_version_ 1847793002563502080