Independent vector analysis using semi-parametric density estimation via multivariate entropy maximization

Detalhes bibliográficos
Ano de defesa: 2021
Autor(a) principal: Damasceno, Lucas de Paula
Orientador(a): Cavalcante, Charles Casimiro
Banca de defesa: Não Informado pela instituição
Tipo de documento: Dissertação
Tipo de acesso: Acesso aberto
Idioma: eng
Instituição de defesa: Não Informado pela instituição
Programa de Pós-Graduação: Não Informado pela instituição
Departamento: Não Informado pela instituição
País: Não Informado pela instituição
Palavras-chave em Português:
Link de acesso: http://www.repositorio.ufc.br/handle/riufc/59717
Resumo: Blind source separation (BSS) is an active area of research in statistical signal processing due to its numerous applications, such as analysis of medical imaging data, wireless communications, and image processing. Due to the wide use of multi-sensor technology, analysis of multiple datasets is at the heart of many challenging engineering problems. This motivates the development of the field of joint blind source separation (JBSS), which extends the classical BSS to simultaneously resolve several BSS problems by assuming statistical dependence between latent sources across mixtures. Independent component analysis (ICA) is a widely used BSS method that can uniquely achieve source recovery, subject to only scaling and permutation ambiguities, through the assumption of statistical independence on the part of the latent sources. Although ICA is one of the most commonly used, it can only decompose a single dataset. This has driven the development of independent vector analysis (IVA), a recent generalization of ICA to multiple datasets that can achieve improved performance over performing ICA on each dataset separately by exploiting dependencies across datasets. Though both ICA and IVA algorithms cast in the maximum likelihood (ML) framework such that all available types of diversity are taken into account simultaneously through the use of general density models for the latent multivariate sources, they often deviate from their theoretical optimality properties due to improper estimation of the probability density function (PDF). Therefore, in order to guarantee the effectiveness of IVA algorithms, an efficient density estimation method is required. In this dissertation, we present a multivariate density estimation technique based on the maximum entropy principle (MEP) that jointly uses global and local multidimensional measuring functions to provide flexible PDFs while keeping the complexity low by integrating into the proposed algorithm a multidimensional Monte-Carlo (MC) integration technique. Finally, we derive a new IVA algorithm, which takes advantage of the accurate estimation capability of the proposed density estimation method to greatly improve separation performance from a wide range of distributions. We use numerical experiments to demonstrate the superior performance over widely used algorithms.
id UFC-7_6022eb01e47f92ec35be34b062c35856
oai_identifier_str oai:repositorio.ufc.br:riufc/59717
network_acronym_str UFC-7
network_name_str Repositório Institucional da Universidade Federal do Ceará (UFC)
repository_id_str
spelling Damasceno, Lucas de PaulaBoukouvalas, ZoisCavalcante, Charles Casimiro2021-07-23T18:04:46Z2021-07-23T18:04:46Z2021DAMASCENO, Lucas de Paula. Independent vector analysis using semi-parametric density estimation via multivariate entropy maximization. 2021. 46f. Dissertação (Mestrado em Engenharia de Teleinformática) – Universidade Federal do Ceará, Centro de Tecnologia, Programa de Pós-Graduação em Engenharia de Teleinformática, Fortaleza, 2021.http://www.repositorio.ufc.br/handle/riufc/59717Blind source separation (BSS) is an active area of research in statistical signal processing due to its numerous applications, such as analysis of medical imaging data, wireless communications, and image processing. Due to the wide use of multi-sensor technology, analysis of multiple datasets is at the heart of many challenging engineering problems. This motivates the development of the field of joint blind source separation (JBSS), which extends the classical BSS to simultaneously resolve several BSS problems by assuming statistical dependence between latent sources across mixtures. Independent component analysis (ICA) is a widely used BSS method that can uniquely achieve source recovery, subject to only scaling and permutation ambiguities, through the assumption of statistical independence on the part of the latent sources. Although ICA is one of the most commonly used, it can only decompose a single dataset. This has driven the development of independent vector analysis (IVA), a recent generalization of ICA to multiple datasets that can achieve improved performance over performing ICA on each dataset separately by exploiting dependencies across datasets. Though both ICA and IVA algorithms cast in the maximum likelihood (ML) framework such that all available types of diversity are taken into account simultaneously through the use of general density models for the latent multivariate sources, they often deviate from their theoretical optimality properties due to improper estimation of the probability density function (PDF). Therefore, in order to guarantee the effectiveness of IVA algorithms, an efficient density estimation method is required. In this dissertation, we present a multivariate density estimation technique based on the maximum entropy principle (MEP) that jointly uses global and local multidimensional measuring functions to provide flexible PDFs while keeping the complexity low by integrating into the proposed algorithm a multidimensional Monte-Carlo (MC) integration technique. Finally, we derive a new IVA algorithm, which takes advantage of the accurate estimation capability of the proposed density estimation method to greatly improve separation performance from a wide range of distributions. We use numerical experiments to demonstrate the superior performance over widely used algorithms.A separação cega de fontes (BSS) é uma ativa área de pesquisa em processamento estatístico de sinais devido às suas inúmeras aplicações, como análise de dados de imagens médicas, comunicações sem fio e processamento de imagens. Devido ao amplo uso da tecnologia de multi-sensores, a análise de múltiplos conjuntos de dados está no centro de muitos problemas desafiadores na engenharia. Isso motiva o desenvolvimento de modelos de separação cega de fontes para múltiplos conjunto de dados (JBSS) assumindo dependência estatística entre fontes latentes através de misturas. A análise de componentes independentes (ICA) é um método de BSS amplamente utilizado que pode alcançar a recuperação da fonte de forma exclusiva, sujeito apenas a ambigüidades de escala e permutação, por meio da suposição de independência estatística por parte das fontes latentes. Embora o ICA seja um dos algoritmos mais comumente usados, ele só pode decompor um único conjunto de dados. Isso tem impulsionado o desenvolvimento da análise de vetores independentes (IVA) uma generalização recente do ICA para múltiplos conjuntos de dados que pode alcançar um desempenho aprimorado em relação ao desempenho do ICA em cada conjunto separadamente, explorando dependências entre os conjuntos de dados. Embora os algoritmos ICA e IVA possam ser modelados com base na estrutura de máxima verossimilhança de modo que todos os tipos de diversidade disponíveis sejam levados em consideração simultaneamente por meio do uso de modelos de densidade geral para as fontes multivariadas latentes, eles frequentemente se desviam de suas propriedades de otimização devido à estimação inadequada da função densidade de probabilidade. Portanto, para garantir a eficiência dos algoritmos de IVA, é necessário um método de estimação de densidade eficiente. Nesta dissertação, apresentamos uma técnica de estimação de densidade multivariada com base no princípio da máxima entropia que utiliza conjuntamente funções de medição multidimensionais globais e locais para fornecer funções densidade de probabilidade flexíveis e além disso, integramos no algoritmo proposto uma técnica de integração multidimensional baseada no método de Monte Carlo. Então, derivamos um novo algoritmo de IVA, que aproveita a capacidade do método proposto de estimação de densidade para aprimorar o desempenho de separação de fontes em uma ampla gama de distribuições. Utilizamos experimentos numéricos para demonstrar o desempenho superior sobre algoritmos amplamente utilizados.Análise de vetores independentesEstimação de função densidade de probabilidade multivariadaPrincípio da máxima entropiaMétodos de Monte CarloIndependent vector analysis using semi-parametric density estimation via multivariate entropy maximizationinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesisengreponame:Repositório Institucional da Universidade Federal do Ceará (UFC)instname:Universidade Federal do Ceará (UFC)instacron:UFCinfo:eu-repo/semantics/openAccessLICENSElicense.txtlicense.txttext/plain; charset=utf-81748http://repositorio.ufc.br/bitstream/riufc/59717/2/license.txt8a4605be74aa9ea9d79846c1fba20a33MD52ORIGINAL2021_dis_lpdamasceno.pdf2021_dis_lpdamasceno.pdfapplication/pdf6390939http://repositorio.ufc.br/bitstream/riufc/59717/1/2021_dis_lpdamasceno.pdfe735f6fd892b45fcf92e7434e8171d5eMD51riufc/597172022-05-05 11:00:26.355oai:repositorio.ufc.br:riufc/59717Tk9URTogUExBQ0UgWU9VUiBPV04gTElDRU5TRSBIRVJFClRoaXMgc2FtcGxlIGxpY2Vuc2UgaXMgcHJvdmlkZWQgZm9yIGluZm9ybWF0aW9uYWwgcHVycG9zZXMgb25seS4KCk5PTi1FWENMVVNJVkUgRElTVFJJQlVUSU9OIExJQ0VOU0UKCkJ5IHNpZ25pbmcgYW5kIHN1Ym1pdHRpbmcgdGhpcyBsaWNlbnNlLCB5b3UgKHRoZSBhdXRob3Iocykgb3IgY29weXJpZ2h0Cm93bmVyKSBncmFudHMgdG8gRFNwYWNlIFVuaXZlcnNpdHkgKERTVSkgdGhlIG5vbi1leGNsdXNpdmUgcmlnaHQgdG8gcmVwcm9kdWNlLAp0cmFuc2xhdGUgKGFzIGRlZmluZWQgYmVsb3cpLCBhbmQvb3IgZGlzdHJpYnV0ZSB5b3VyIHN1Ym1pc3Npb24gKGluY2x1ZGluZwp0aGUgYWJzdHJhY3QpIHdvcmxkd2lkZSBpbiBwcmludCBhbmQgZWxlY3Ryb25pYyBmb3JtYXQgYW5kIGluIGFueSBtZWRpdW0sCmluY2x1ZGluZyBidXQgbm90IGxpbWl0ZWQgdG8gYXVkaW8gb3IgdmlkZW8uCgpZb3UgYWdyZWUgdGhhdCBEU1UgbWF5LCB3aXRob3V0IGNoYW5naW5nIHRoZSBjb250ZW50LCB0cmFuc2xhdGUgdGhlCnN1Ym1pc3Npb24gdG8gYW55IG1lZGl1bSBvciBmb3JtYXQgZm9yIHRoZSBwdXJwb3NlIG9mIHByZXNlcnZhdGlvbi4KCllvdSBhbHNvIGFncmVlIHRoYXQgRFNVIG1heSBrZWVwIG1vcmUgdGhhbiBvbmUgY29weSBvZiB0aGlzIHN1Ym1pc3Npb24gZm9yCnB1cnBvc2VzIG9mIHNlY3VyaXR5LCBiYWNrLXVwIGFuZCBwcmVzZXJ2YXRpb24uCgpZb3UgcmVwcmVzZW50IHRoYXQgdGhlIHN1Ym1pc3Npb24gaXMgeW91ciBvcmlnaW5hbCB3b3JrLCBhbmQgdGhhdCB5b3UgaGF2ZQp0aGUgcmlnaHQgdG8gZ3JhbnQgdGhlIHJpZ2h0cyBjb250YWluZWQgaW4gdGhpcyBsaWNlbnNlLiBZb3UgYWxzbyByZXByZXNlbnQKdGhhdCB5b3VyIHN1Ym1pc3Npb24gZG9lcyBub3QsIHRvIHRoZSBiZXN0IG9mIHlvdXIga25vd2xlZGdlLCBpbmZyaW5nZSB1cG9uCmFueW9uZSdzIGNvcHlyaWdodC4KCklmIHRoZSBzdWJtaXNzaW9uIGNvbnRhaW5zIG1hdGVyaWFsIGZvciB3aGljaCB5b3UgZG8gbm90IGhvbGQgY29weXJpZ2h0LAp5b3UgcmVwcmVzZW50IHRoYXQgeW91IGhhdmUgb2J0YWluZWQgdGhlIHVucmVzdHJpY3RlZCBwZXJtaXNzaW9uIG9mIHRoZQpjb3B5cmlnaHQgb3duZXIgdG8gZ3JhbnQgRFNVIHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdApzdWNoIHRoaXJkLXBhcnR5IG93bmVkIG1hdGVyaWFsIGlzIGNsZWFybHkgaWRlbnRpZmllZCBhbmQgYWNrbm93bGVkZ2VkCndpdGhpbiB0aGUgdGV4dCBvciBjb250ZW50IG9mIHRoZSBzdWJtaXNzaW9uLgoKSUYgVEhFIFNVQk1JU1NJT04gSVMgQkFTRUQgVVBPTiBXT1JLIFRIQVQgSEFTIEJFRU4gU1BPTlNPUkVEIE9SIFNVUFBPUlRFRApCWSBBTiBBR0VOQ1kgT1IgT1JHQU5JWkFUSU9OIE9USEVSIFRIQU4gRFNVLCBZT1UgUkVQUkVTRU5UIFRIQVQgWU9VIEhBVkUKRlVMRklMTEVEIEFOWSBSSUdIVCBPRiBSRVZJRVcgT1IgT1RIRVIgT0JMSUdBVElPTlMgUkVRVUlSRUQgQlkgU1VDSApDT05UUkFDVCBPUiBBR1JFRU1FTlQuCgpEU1Ugd2lsbCBjbGVhcmx5IGlkZW50aWZ5IHlvdXIgbmFtZShzKSBhcyB0aGUgYXV0aG9yKHMpIG9yIG93bmVyKHMpIG9mIHRoZQpzdWJtaXNzaW9uLCBhbmQgd2lsbCBub3QgbWFrZSBhbnkgYWx0ZXJhdGlvbiwgb3RoZXIgdGhhbiBhcyBhbGxvd2VkIGJ5IHRoaXMKbGljZW5zZSwgdG8geW91ciBzdWJtaXNzaW9uLgo=Repositório InstitucionalPUBhttp://www.repositorio.ufc.br/ri-oai/requestbu@ufc.br || repositorio@ufc.bropendoar:2022-05-05T14:00:26Repositório Institucional da Universidade Federal do Ceará (UFC) - Universidade Federal do Ceará (UFC)false
dc.title.pt_BR.fl_str_mv Independent vector analysis using semi-parametric density estimation via multivariate entropy maximization
title Independent vector analysis using semi-parametric density estimation via multivariate entropy maximization
spellingShingle Independent vector analysis using semi-parametric density estimation via multivariate entropy maximization
Damasceno, Lucas de Paula
Análise de vetores independentes
Estimação de função densidade de probabilidade multivariada
Princípio da máxima entropia
Métodos de Monte Carlo
title_short Independent vector analysis using semi-parametric density estimation via multivariate entropy maximization
title_full Independent vector analysis using semi-parametric density estimation via multivariate entropy maximization
title_fullStr Independent vector analysis using semi-parametric density estimation via multivariate entropy maximization
title_full_unstemmed Independent vector analysis using semi-parametric density estimation via multivariate entropy maximization
title_sort Independent vector analysis using semi-parametric density estimation via multivariate entropy maximization
author Damasceno, Lucas de Paula
author_facet Damasceno, Lucas de Paula
author_role author
dc.contributor.co-advisor.none.fl_str_mv Boukouvalas, Zois
dc.contributor.author.fl_str_mv Damasceno, Lucas de Paula
dc.contributor.advisor1.fl_str_mv Cavalcante, Charles Casimiro
contributor_str_mv Cavalcante, Charles Casimiro
dc.subject.por.fl_str_mv Análise de vetores independentes
Estimação de função densidade de probabilidade multivariada
Princípio da máxima entropia
Métodos de Monte Carlo
topic Análise de vetores independentes
Estimação de função densidade de probabilidade multivariada
Princípio da máxima entropia
Métodos de Monte Carlo
description Blind source separation (BSS) is an active area of research in statistical signal processing due to its numerous applications, such as analysis of medical imaging data, wireless communications, and image processing. Due to the wide use of multi-sensor technology, analysis of multiple datasets is at the heart of many challenging engineering problems. This motivates the development of the field of joint blind source separation (JBSS), which extends the classical BSS to simultaneously resolve several BSS problems by assuming statistical dependence between latent sources across mixtures. Independent component analysis (ICA) is a widely used BSS method that can uniquely achieve source recovery, subject to only scaling and permutation ambiguities, through the assumption of statistical independence on the part of the latent sources. Although ICA is one of the most commonly used, it can only decompose a single dataset. This has driven the development of independent vector analysis (IVA), a recent generalization of ICA to multiple datasets that can achieve improved performance over performing ICA on each dataset separately by exploiting dependencies across datasets. Though both ICA and IVA algorithms cast in the maximum likelihood (ML) framework such that all available types of diversity are taken into account simultaneously through the use of general density models for the latent multivariate sources, they often deviate from their theoretical optimality properties due to improper estimation of the probability density function (PDF). Therefore, in order to guarantee the effectiveness of IVA algorithms, an efficient density estimation method is required. In this dissertation, we present a multivariate density estimation technique based on the maximum entropy principle (MEP) that jointly uses global and local multidimensional measuring functions to provide flexible PDFs while keeping the complexity low by integrating into the proposed algorithm a multidimensional Monte-Carlo (MC) integration technique. Finally, we derive a new IVA algorithm, which takes advantage of the accurate estimation capability of the proposed density estimation method to greatly improve separation performance from a wide range of distributions. We use numerical experiments to demonstrate the superior performance over widely used algorithms.
publishDate 2021
dc.date.accessioned.fl_str_mv 2021-07-23T18:04:46Z
dc.date.available.fl_str_mv 2021-07-23T18:04:46Z
dc.date.issued.fl_str_mv 2021
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/masterThesis
format masterThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv DAMASCENO, Lucas de Paula. Independent vector analysis using semi-parametric density estimation via multivariate entropy maximization. 2021. 46f. Dissertação (Mestrado em Engenharia de Teleinformática) – Universidade Federal do Ceará, Centro de Tecnologia, Programa de Pós-Graduação em Engenharia de Teleinformática, Fortaleza, 2021.
dc.identifier.uri.fl_str_mv http://www.repositorio.ufc.br/handle/riufc/59717
identifier_str_mv DAMASCENO, Lucas de Paula. Independent vector analysis using semi-parametric density estimation via multivariate entropy maximization. 2021. 46f. Dissertação (Mestrado em Engenharia de Teleinformática) – Universidade Federal do Ceará, Centro de Tecnologia, Programa de Pós-Graduação em Engenharia de Teleinformática, Fortaleza, 2021.
url http://www.repositorio.ufc.br/handle/riufc/59717
dc.language.iso.fl_str_mv eng
language eng
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.source.none.fl_str_mv reponame:Repositório Institucional da Universidade Federal do Ceará (UFC)
instname:Universidade Federal do Ceará (UFC)
instacron:UFC
instname_str Universidade Federal do Ceará (UFC)
instacron_str UFC
institution UFC
reponame_str Repositório Institucional da Universidade Federal do Ceará (UFC)
collection Repositório Institucional da Universidade Federal do Ceará (UFC)
bitstream.url.fl_str_mv http://repositorio.ufc.br/bitstream/riufc/59717/2/license.txt
http://repositorio.ufc.br/bitstream/riufc/59717/1/2021_dis_lpdamasceno.pdf
bitstream.checksum.fl_str_mv 8a4605be74aa9ea9d79846c1fba20a33
e735f6fd892b45fcf92e7434e8171d5e
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
repository.name.fl_str_mv Repositório Institucional da Universidade Federal do Ceará (UFC) - Universidade Federal do Ceará (UFC)
repository.mail.fl_str_mv bu@ufc.br || repositorio@ufc.br
_version_ 1847793318001377280