Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes
| Ano de defesa: | 2012 |
|---|---|
| Autor(a) principal: | |
| Orientador(a): | |
| Banca de defesa: | |
| Tipo de documento: | Tese |
| Tipo de acesso: | Acesso aberto |
| Idioma: | por |
| Instituição de defesa: |
Não Informado pela instituição
|
| Programa de Pós-Graduação: |
Não Informado pela instituição
|
| Departamento: |
Não Informado pela instituição
|
| País: |
Não Informado pela instituição
|
| Palavras-chave em Português: | |
| Link de acesso: | http://www.repositorio.ufc.br/handle/riufc/22982 |
Resumo: | In this thesis, we tackle the problem of recursive prediction of univariate time series, also known as long-term prediction, using recurrent neural networks. This type of problem often emerges from nonlinear dynamical systems modelling and prediction tasks, particularly from those producing signals of chaotic nature, where one can observe the presence of long-term temporal dependencies. In recursive prediction, differently from the one-step-ahead prediction task, predicted values are fed back to the input of the neural model, a feature that makes time series with long-term temporal dependencies more difficult to deal with due to the propagation of prediction errors. That being said, in order to handle the problem of recursive prediction of univariate time series, extensions of the neural NARX (Nonlinear AutoRegressive model with eXogenous inputs) model ar eintroduced in this thesis. These extensions result from attempts to embed into the NARX model different strategies to capture temporal information, either of short-term or long-term nature. Among such strategies, we highlight the following ones: (i) simultaneous prediction of several steps ahead, also known as MIMO (multi-input, multi-output model) prediction, (ii) prediction via dynamical random projections, as in the ESN (echo state network) model, (iii) prediction via static random projections, as in the ELM (extreme learning machine) network, and (iv) prediction via hybrid recurrent models based the NARX and ELMAN networks. Additionally, a novel methodology for the design (i.e. parameter selection) and performance comparison of the proposed models is also introduced in this model with the aim of evaluating them under similar conditions and to serve as reference for further studies. For this purpose, synthetic and real-world benchmarking time series are used. The obtained results suggest that the proposed neural models present themselves as efficient alternatives to the state of the art in recursive prediction of univariate time series using recurrent neural architectures. |
| id |
UFC-7_ba10504e54edd222bdaccb6e499f3abe |
|---|---|
| oai_identifier_str |
oai:repositorio.ufc.br:riufc/22982 |
| network_acronym_str |
UFC-7 |
| network_name_str |
Repositório Institucional da Universidade Federal do Ceará (UFC) |
| repository_id_str |
|
| spelling |
Menezes Júnior, José Maria Pires deBarreto, Guilherme de Alencar2017-06-02T13:54:13Z2017-06-02T13:54:13Z2012MENEZES JÚNIOR, J. M. P. Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes. 2012. 186 f. Tese (Doutorado em Engenharia de Teleinformática)–Centro de Tecnologia, Universidade Federal do Ceará, Fortaleza, 2012.http://www.repositorio.ufc.br/handle/riufc/22982In this thesis, we tackle the problem of recursive prediction of univariate time series, also known as long-term prediction, using recurrent neural networks. This type of problem often emerges from nonlinear dynamical systems modelling and prediction tasks, particularly from those producing signals of chaotic nature, where one can observe the presence of long-term temporal dependencies. In recursive prediction, differently from the one-step-ahead prediction task, predicted values are fed back to the input of the neural model, a feature that makes time series with long-term temporal dependencies more difficult to deal with due to the propagation of prediction errors. That being said, in order to handle the problem of recursive prediction of univariate time series, extensions of the neural NARX (Nonlinear AutoRegressive model with eXogenous inputs) model ar eintroduced in this thesis. These extensions result from attempts to embed into the NARX model different strategies to capture temporal information, either of short-term or long-term nature. Among such strategies, we highlight the following ones: (i) simultaneous prediction of several steps ahead, also known as MIMO (multi-input, multi-output model) prediction, (ii) prediction via dynamical random projections, as in the ESN (echo state network) model, (iii) prediction via static random projections, as in the ELM (extreme learning machine) network, and (iv) prediction via hybrid recurrent models based the NARX and ELMAN networks. Additionally, a novel methodology for the design (i.e. parameter selection) and performance comparison of the proposed models is also introduced in this model with the aim of evaluating them under similar conditions and to serve as reference for further studies. For this purpose, synthetic and real-world benchmarking time series are used. The obtained results suggest that the proposed neural models present themselves as efficient alternatives to the state of the art in recursive prediction of univariate time series using recurrent neural architectures.Nesta tese aborda-se o problema de predição recursiva de séries temporais univariadas, também chamado de predição de longo prazo, usando redes neurais recorrentes. Este tipo de problema surge, com frequência, em tarefas de modelagem e predição de sistemas dinâmicos não-lineares, principalmente os que produzem sinais de natureza caótica, em que se observa a presença de dependência temporal (memória) de longa duração. Na predição recursiva, diferentemente da predição de um passo à frente (one-step-ahead prediction), as predições são realimentadas para a entrada do modelo neural, característica esta que dificulta a predição de séries com dependência temporal longa devido à propagação do erro de predição. Isto posto, para tratar o problema de predição recursiva de séries temporais, extensões do modelo neural NARX (Nonlinear AutoRegressive model with eXogenous inputs) são propostas nesta tese. Estas extensões resultam da tentativa de incorporar à rede NARX diferentes estratégias de modelagem da informação temporal, tanto de curto quanto de longo prazo. Dentre estas estratégias, destacamse: (i) predição (simultânea) de vários passos à frente, também chamada de predição MIMO (multi-input, multi-output model), (ii) predição via projeções aleatórias dinâmicas, tal como na rede ESN (echo state network), (iii) predição via projeções aleatórias estáticas, tal como na rede ELM(extreme learning machine), e (iv) predição via modelos recorrentes híbridos baseados nas redes NARX e ELMAN. Além disso, uma metodologia para projeto (i.e. seleção de parâmetros) e comparação dos desempenhos dos modelos propostos é também desenvolvida nesta tese com o objetivo de avaliá-los sob as mesmas condições e servir de referência para estudos futuros. Para este fim, são utilizadas séries temporais sintéticas e reais comumente presentes em benchmarks de desempenho. Os resultados obtidos sugerem que os modelos propostos apresentam-se como alternativas eficientes ao estado da arte em modelos de redes neurais recorrentes para predição de séries temporais univariadas, principalmente aqueles baseados em projeções aleatórias devido ao baixo custo computacional.TeleinformáticaEstudos de séries temporaisRedes neurais (Computação)Máquina de aprendizagem extremaContribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentesContributions to the problem of recursive prediction of univariate time series using recurrent neural networksinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisporreponame:Repositório Institucional da Universidade Federal do Ceará (UFC)instname:Universidade Federal do Ceará (UFC)instacron:UFCinfo:eu-repo/semantics/openAccessORIGINAL2012_tese_jmpmenezesjúnior.pdf2012_tese_jmpmenezesjúnior.pdfapplication/pdf8865921http://repositorio.ufc.br/bitstream/riufc/22982/1/2012_tese_jmpmenezesj%c3%banior.pdf029824a1fa5ffbf3ffe36c81c0b8f5f5MD51LICENSElicense.txtlicense.txttext/plain; charset=utf-81748http://repositorio.ufc.br/bitstream/riufc/22982/2/license.txt8a4605be74aa9ea9d79846c1fba20a33MD52riufc/229822022-11-21 13:57:16.505oai:repositorio.ufc.br:riufc/22982Tk9URTogUExBQ0UgWU9VUiBPV04gTElDRU5TRSBIRVJFClRoaXMgc2FtcGxlIGxpY2Vuc2UgaXMgcHJvdmlkZWQgZm9yIGluZm9ybWF0aW9uYWwgcHVycG9zZXMgb25seS4KCk5PTi1FWENMVVNJVkUgRElTVFJJQlVUSU9OIExJQ0VOU0UKCkJ5IHNpZ25pbmcgYW5kIHN1Ym1pdHRpbmcgdGhpcyBsaWNlbnNlLCB5b3UgKHRoZSBhdXRob3Iocykgb3IgY29weXJpZ2h0Cm93bmVyKSBncmFudHMgdG8gRFNwYWNlIFVuaXZlcnNpdHkgKERTVSkgdGhlIG5vbi1leGNsdXNpdmUgcmlnaHQgdG8gcmVwcm9kdWNlLAp0cmFuc2xhdGUgKGFzIGRlZmluZWQgYmVsb3cpLCBhbmQvb3IgZGlzdHJpYnV0ZSB5b3VyIHN1Ym1pc3Npb24gKGluY2x1ZGluZwp0aGUgYWJzdHJhY3QpIHdvcmxkd2lkZSBpbiBwcmludCBhbmQgZWxlY3Ryb25pYyBmb3JtYXQgYW5kIGluIGFueSBtZWRpdW0sCmluY2x1ZGluZyBidXQgbm90IGxpbWl0ZWQgdG8gYXVkaW8gb3IgdmlkZW8uCgpZb3UgYWdyZWUgdGhhdCBEU1UgbWF5LCB3aXRob3V0IGNoYW5naW5nIHRoZSBjb250ZW50LCB0cmFuc2xhdGUgdGhlCnN1Ym1pc3Npb24gdG8gYW55IG1lZGl1bSBvciBmb3JtYXQgZm9yIHRoZSBwdXJwb3NlIG9mIHByZXNlcnZhdGlvbi4KCllvdSBhbHNvIGFncmVlIHRoYXQgRFNVIG1heSBrZWVwIG1vcmUgdGhhbiBvbmUgY29weSBvZiB0aGlzIHN1Ym1pc3Npb24gZm9yCnB1cnBvc2VzIG9mIHNlY3VyaXR5LCBiYWNrLXVwIGFuZCBwcmVzZXJ2YXRpb24uCgpZb3UgcmVwcmVzZW50IHRoYXQgdGhlIHN1Ym1pc3Npb24gaXMgeW91ciBvcmlnaW5hbCB3b3JrLCBhbmQgdGhhdCB5b3UgaGF2ZQp0aGUgcmlnaHQgdG8gZ3JhbnQgdGhlIHJpZ2h0cyBjb250YWluZWQgaW4gdGhpcyBsaWNlbnNlLiBZb3UgYWxzbyByZXByZXNlbnQKdGhhdCB5b3VyIHN1Ym1pc3Npb24gZG9lcyBub3QsIHRvIHRoZSBiZXN0IG9mIHlvdXIga25vd2xlZGdlLCBpbmZyaW5nZSB1cG9uCmFueW9uZSdzIGNvcHlyaWdodC4KCklmIHRoZSBzdWJtaXNzaW9uIGNvbnRhaW5zIG1hdGVyaWFsIGZvciB3aGljaCB5b3UgZG8gbm90IGhvbGQgY29weXJpZ2h0LAp5b3UgcmVwcmVzZW50IHRoYXQgeW91IGhhdmUgb2J0YWluZWQgdGhlIHVucmVzdHJpY3RlZCBwZXJtaXNzaW9uIG9mIHRoZQpjb3B5cmlnaHQgb3duZXIgdG8gZ3JhbnQgRFNVIHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdApzdWNoIHRoaXJkLXBhcnR5IG93bmVkIG1hdGVyaWFsIGlzIGNsZWFybHkgaWRlbnRpZmllZCBhbmQgYWNrbm93bGVkZ2VkCndpdGhpbiB0aGUgdGV4dCBvciBjb250ZW50IG9mIHRoZSBzdWJtaXNzaW9uLgoKSUYgVEhFIFNVQk1JU1NJT04gSVMgQkFTRUQgVVBPTiBXT1JLIFRIQVQgSEFTIEJFRU4gU1BPTlNPUkVEIE9SIFNVUFBPUlRFRApCWSBBTiBBR0VOQ1kgT1IgT1JHQU5JWkFUSU9OIE9USEVSIFRIQU4gRFNVLCBZT1UgUkVQUkVTRU5UIFRIQVQgWU9VIEhBVkUKRlVMRklMTEVEIEFOWSBSSUdIVCBPRiBSRVZJRVcgT1IgT1RIRVIgT0JMSUdBVElPTlMgUkVRVUlSRUQgQlkgU1VDSApDT05UUkFDVCBPUiBBR1JFRU1FTlQuCgpEU1Ugd2lsbCBjbGVhcmx5IGlkZW50aWZ5IHlvdXIgbmFtZShzKSBhcyB0aGUgYXV0aG9yKHMpIG9yIG93bmVyKHMpIG9mIHRoZQpzdWJtaXNzaW9uLCBhbmQgd2lsbCBub3QgbWFrZSBhbnkgYWx0ZXJhdGlvbiwgb3RoZXIgdGhhbiBhcyBhbGxvd2VkIGJ5IHRoaXMKbGljZW5zZSwgdG8geW91ciBzdWJtaXNzaW9uLgo=Repositório InstitucionalPUBhttp://www.repositorio.ufc.br/ri-oai/requestbu@ufc.br || repositorio@ufc.bropendoar:2022-11-21T16:57:16Repositório Institucional da Universidade Federal do Ceará (UFC) - Universidade Federal do Ceará (UFC)false |
| dc.title.pt_BR.fl_str_mv |
Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes |
| dc.title.en.pt_BR.fl_str_mv |
Contributions to the problem of recursive prediction of univariate time series using recurrent neural networks |
| title |
Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes |
| spellingShingle |
Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes Menezes Júnior, José Maria Pires de Teleinformática Estudos de séries temporais Redes neurais (Computação) Máquina de aprendizagem extrema |
| title_short |
Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes |
| title_full |
Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes |
| title_fullStr |
Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes |
| title_full_unstemmed |
Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes |
| title_sort |
Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes |
| author |
Menezes Júnior, José Maria Pires de |
| author_facet |
Menezes Júnior, José Maria Pires de |
| author_role |
author |
| dc.contributor.author.fl_str_mv |
Menezes Júnior, José Maria Pires de |
| dc.contributor.advisor1.fl_str_mv |
Barreto, Guilherme de Alencar |
| contributor_str_mv |
Barreto, Guilherme de Alencar |
| dc.subject.por.fl_str_mv |
Teleinformática Estudos de séries temporais Redes neurais (Computação) Máquina de aprendizagem extrema |
| topic |
Teleinformática Estudos de séries temporais Redes neurais (Computação) Máquina de aprendizagem extrema |
| description |
In this thesis, we tackle the problem of recursive prediction of univariate time series, also known as long-term prediction, using recurrent neural networks. This type of problem often emerges from nonlinear dynamical systems modelling and prediction tasks, particularly from those producing signals of chaotic nature, where one can observe the presence of long-term temporal dependencies. In recursive prediction, differently from the one-step-ahead prediction task, predicted values are fed back to the input of the neural model, a feature that makes time series with long-term temporal dependencies more difficult to deal with due to the propagation of prediction errors. That being said, in order to handle the problem of recursive prediction of univariate time series, extensions of the neural NARX (Nonlinear AutoRegressive model with eXogenous inputs) model ar eintroduced in this thesis. These extensions result from attempts to embed into the NARX model different strategies to capture temporal information, either of short-term or long-term nature. Among such strategies, we highlight the following ones: (i) simultaneous prediction of several steps ahead, also known as MIMO (multi-input, multi-output model) prediction, (ii) prediction via dynamical random projections, as in the ESN (echo state network) model, (iii) prediction via static random projections, as in the ELM (extreme learning machine) network, and (iv) prediction via hybrid recurrent models based the NARX and ELMAN networks. Additionally, a novel methodology for the design (i.e. parameter selection) and performance comparison of the proposed models is also introduced in this model with the aim of evaluating them under similar conditions and to serve as reference for further studies. For this purpose, synthetic and real-world benchmarking time series are used. The obtained results suggest that the proposed neural models present themselves as efficient alternatives to the state of the art in recursive prediction of univariate time series using recurrent neural architectures. |
| publishDate |
2012 |
| dc.date.issued.fl_str_mv |
2012 |
| dc.date.accessioned.fl_str_mv |
2017-06-02T13:54:13Z |
| dc.date.available.fl_str_mv |
2017-06-02T13:54:13Z |
| dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
| dc.type.driver.fl_str_mv |
info:eu-repo/semantics/doctoralThesis |
| format |
doctoralThesis |
| status_str |
publishedVersion |
| dc.identifier.citation.fl_str_mv |
MENEZES JÚNIOR, J. M. P. Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes. 2012. 186 f. Tese (Doutorado em Engenharia de Teleinformática)–Centro de Tecnologia, Universidade Federal do Ceará, Fortaleza, 2012. |
| dc.identifier.uri.fl_str_mv |
http://www.repositorio.ufc.br/handle/riufc/22982 |
| identifier_str_mv |
MENEZES JÚNIOR, J. M. P. Contribuições ao problema de predição recursiva de séries temporais univariadas usando redes neurais recorrentes. 2012. 186 f. Tese (Doutorado em Engenharia de Teleinformática)–Centro de Tecnologia, Universidade Federal do Ceará, Fortaleza, 2012. |
| url |
http://www.repositorio.ufc.br/handle/riufc/22982 |
| dc.language.iso.fl_str_mv |
por |
| language |
por |
| dc.rights.driver.fl_str_mv |
info:eu-repo/semantics/openAccess |
| eu_rights_str_mv |
openAccess |
| dc.source.none.fl_str_mv |
reponame:Repositório Institucional da Universidade Federal do Ceará (UFC) instname:Universidade Federal do Ceará (UFC) instacron:UFC |
| instname_str |
Universidade Federal do Ceará (UFC) |
| instacron_str |
UFC |
| institution |
UFC |
| reponame_str |
Repositório Institucional da Universidade Federal do Ceará (UFC) |
| collection |
Repositório Institucional da Universidade Federal do Ceará (UFC) |
| bitstream.url.fl_str_mv |
http://repositorio.ufc.br/bitstream/riufc/22982/1/2012_tese_jmpmenezesj%c3%banior.pdf http://repositorio.ufc.br/bitstream/riufc/22982/2/license.txt |
| bitstream.checksum.fl_str_mv |
029824a1fa5ffbf3ffe36c81c0b8f5f5 8a4605be74aa9ea9d79846c1fba20a33 |
| bitstream.checksumAlgorithm.fl_str_mv |
MD5 MD5 |
| repository.name.fl_str_mv |
Repositório Institucional da Universidade Federal do Ceará (UFC) - Universidade Federal do Ceará (UFC) |
| repository.mail.fl_str_mv |
bu@ufc.br || repositorio@ufc.br |
| _version_ |
1847793002563502080 |