Analysis and evaluation of optimization techniques for tracking in augmented reality applications
Ano de defesa: | 2013 |
---|---|
Autor(a) principal: | |
Orientador(a): | |
Banca de defesa: | |
Tipo de documento: | Tese |
Tipo de acesso: | Acesso aberto |
Idioma: | eng |
Instituição de defesa: |
Universidade Federal de Pernambuco
|
Programa de Pós-Graduação: |
Não Informado pela instituição
|
Departamento: |
Não Informado pela instituição
|
País: |
Não Informado pela instituição
|
Palavras-chave em Português: | |
Link de acesso: | https://repositorio.ufpe.br/handle/123456789/12268 |
Resumo: | Real-time computer vision applications that run on the field and make frequent use of wearable computers have a critical restriction on the amount of processing they can perform, because of the fact that most (if not all) of the application runs on the wearable platform. A balancing scheme capable of allowing the application to use more processing power is fundamental both when input scenarios present more visual restrictions regarding, for example, the object to be tracked, and also to reduce processing in order to save battery and CPU time for other applications when the captured video is better controlled (more accessible). The fact that computer vision applications may run on a variety of platforms justifies the need for defining a model that automatically adjusts the tracker being used in applications with hard performance constraints. Performance degradation in wearable platforms can be greater than expected, as desktop and mobile platforms present different levels of hardware capabilities, and consequently, different performance restrictions. This doctoral thesis addresses the object tracking problem using a decision model, in such a way that prioritizes using the least computationally intensive algorithm whenever possible. It has the following specific objectives: to investigate and implement different tracking techniques, to choose/define a reference metric that can be used to detect image interference (occlusion, image noise, etc.), to propose a decision model that allows automatic switching of different trackers in order to balance the application's performance, and to reduce the application's workload without compromising tracking quality. The effectiveness of the system will be verified by synthetic case studies that comprise different object classes that can be tracked, focusing on augmented reality applications that can run on wearable platforms. Different tracking algorithms will be part of the proposed decision model. It will be shown that by switching among these algorithms, it is possible to reach a performance improvement of a factor of three, while keeping a minimum quality defined by a reprojection error of 10 pixels when compared to the use of only the best algorithm independent of its computational cost. This work results in better performance of applications with memory and battery restrictions. |
id |
UFPE_af9260c5c3972ce4d84b62c836491703 |
---|---|
oai_identifier_str |
oai:repositorio.ufpe.br:123456789/12268 |
network_acronym_str |
UFPE |
network_name_str |
Repositório Institucional da UFPE |
repository_id_str |
|
spelling |
Teixeira, João Marcelo Xavier NatárioKelner, Judith Teichrieb, Veronica 2015-03-12T19:02:48Z2015-03-12T19:02:48Z2013-03-01TEIXEIRA, João Marcelo Xavier Natário. Analysis and evaluation of optmization techniques for tracking in augmentes reality applications. Recife, 2013. 93 f. Tese (doutorado) - UFPE, Centro de Informática, Programa de Pós-graduação em Ciência da Computação, 2013..https://repositorio.ufpe.br/handle/123456789/12268Real-time computer vision applications that run on the field and make frequent use of wearable computers have a critical restriction on the amount of processing they can perform, because of the fact that most (if not all) of the application runs on the wearable platform. A balancing scheme capable of allowing the application to use more processing power is fundamental both when input scenarios present more visual restrictions regarding, for example, the object to be tracked, and also to reduce processing in order to save battery and CPU time for other applications when the captured video is better controlled (more accessible). The fact that computer vision applications may run on a variety of platforms justifies the need for defining a model that automatically adjusts the tracker being used in applications with hard performance constraints. Performance degradation in wearable platforms can be greater than expected, as desktop and mobile platforms present different levels of hardware capabilities, and consequently, different performance restrictions. This doctoral thesis addresses the object tracking problem using a decision model, in such a way that prioritizes using the least computationally intensive algorithm whenever possible. It has the following specific objectives: to investigate and implement different tracking techniques, to choose/define a reference metric that can be used to detect image interference (occlusion, image noise, etc.), to propose a decision model that allows automatic switching of different trackers in order to balance the application's performance, and to reduce the application's workload without compromising tracking quality. The effectiveness of the system will be verified by synthetic case studies that comprise different object classes that can be tracked, focusing on augmented reality applications that can run on wearable platforms. Different tracking algorithms will be part of the proposed decision model. It will be shown that by switching among these algorithms, it is possible to reach a performance improvement of a factor of three, while keeping a minimum quality defined by a reprojection error of 10 pixels when compared to the use of only the best algorithm independent of its computational cost. This work results in better performance of applications with memory and battery restrictions.Aplicações de visão computacional em tempo real executadas em campo fazem uso frequente de computadores vestíveis, os quais apresentam uma restrição crítica na quantidade de processamento que podem suportar, uma vez que a maior parte da aplicação (se não sua totalidade) deverá executar na plataforma vestível. É fundamental um esquema de balanceamento de carga capaz de permitir que a aplicação utilize mais poder de processamento quando os cenários de entrada apresentam mais restrições visuais, por exemplo, referentes ao objeto a ser rastreado, e diminua tal processamento com o objetivo de economizar bateria e tempo de CPU em aplicações quando o vídeo capturado é mais controlado (mais acessível). O fato de aplicações de visão computacional executarem em uma variedade de plataformas justifica se definir um modelo que ajuste automaticamente o rastreador em uso em aplicações com restrições de recursos computacionais. A degradação de desempenho em plataformas vestíveis pode ser maior do que a esperada, uma vez que plataformas desktop e móvel apresentam diferentes níveis de configurações de hardware, e consequentemente, diferentes restrições de desempenho. Esta tese de doutorado soluciona o problema do rastreamento de objetos usando um modelo de decisão, objetivando utilizar o algoritmo menos custoso sempre que possível. Como objetivos específicos têm-se: investigar e implementar diferentes técnicas de rastreamento, para escolher/definir uma métrica de referência que possa ser usada para detectar interferência na imagem (oclusão, ruído, etc.), propor um modelo de decisão que permita chaveamento automático entre diferentes rastreadores visando balancear o desempenho da aplicação baseado na métrica escolhida, e diminuir a quantidade de processamento requerida pela aplicação sem comprometer a qualidade do rastreamento envolvido. A eficiência do sistema será verificada através de estudos de caso sintéticos que compreendem diferentes classes de objetos que podem ser rastreados, focando em aplicações de realidade aumentada que executam em plataformas vestíveis. Diferentes algoritmos de rastreamento farão parte do modelo de decisão e através do chaveamento entre eles, será demonstrado que é possível atingir uma melhoria no desempenho de até três vezes, mantendo uma qualidade mínima definida como erro de reprojeção de até 10 pixels quando comparado à utilização apenas do algoritmo que gera a melhor qualidade de rastreamento, independente do seu custo computacional. O impacto desse trabalho implicará em uma melhor qualidade de aplicações com restrições de quantidade de memória, carga de baterias, entre outras.CAPES e CNPqengUniversidade Federal de PernambucoAttribution-NonCommercial-NoDerivs 3.0 Brazilhttp://creativecommons.org/licenses/by-nc-nd/3.0/br/info:eu-repo/semantics/openAccessRealidade aumentadaVisão computacionalAlto desempenhoAugmented realityComputer visionHigh performanceAnalysis and evaluation of optimization techniques for tracking in augmented reality applicationsinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisreponame:Repositório Institucional da UFPEinstname:Universidade Federal de Pernambuco (UFPE)instacron:UFPETHUMBNAILTese Joao Teixeira.pdf.jpgTese Joao Teixeira.pdf.jpgGenerated Thumbnailimage/jpeg1290https://repositorio.ufpe.br/bitstream/123456789/12268/5/Tese%20Joao%20Teixeira.pdf.jpgd2ecc3e6b33b599ed250f229ffedd425MD55ORIGINALTese Joao Teixeira.pdfTese Joao Teixeira.pdfapplication/pdf5813706https://repositorio.ufpe.br/bitstream/123456789/12268/1/Tese%20Joao%20Teixeira.pdf85ed76e5022129077b181bca61f92678MD51CC-LICENSElicense_rdflicense_rdfapplication/rdf+xml; charset=utf-81232https://repositorio.ufpe.br/bitstream/123456789/12268/2/license_rdf66e71c371cc565284e70f40736c94386MD52LICENSElicense.txtlicense.txttext/plain; charset=utf-82311https://repositorio.ufpe.br/bitstream/123456789/12268/3/license.txt4b8a02c7f2818eaf00dcf2260dd5eb08MD53TEXTTese Joao Teixeira.pdf.txtTese Joao Teixeira.pdf.txtExtracted texttext/plain187995https://repositorio.ufpe.br/bitstream/123456789/12268/4/Tese%20Joao%20Teixeira.pdf.txtdc5bae23f0330fb3b051965d607e2873MD54123456789/122682019-10-25 17:24:18.454oai:repositorio.ufpe.br:123456789/12268TGljZW7Dp2EgZGUgRGlzdHJpYnVpw6fDo28gTsOjbyBFeGNsdXNpdmEKClRvZG8gZGVwb3NpdGFudGUgZGUgbWF0ZXJpYWwgbm8gUmVwb3NpdMOzcmlvIEluc3RpdHVjaW9uYWwgKFJJKSBkZXZlIGNvbmNlZGVyLCDDoCBVbml2ZXJzaWRhZGUgRmVkZXJhbCBkZSBQZXJuYW1idWNvIChVRlBFKSwgdW1hIExpY2Vuw6dhIGRlIERpc3RyaWJ1acOnw6NvIE7Do28gRXhjbHVzaXZhIHBhcmEgbWFudGVyIGUgdG9ybmFyIGFjZXNzw612ZWlzIG9zIHNldXMgZG9jdW1lbnRvcywgZW0gZm9ybWF0byBkaWdpdGFsLCBuZXN0ZSByZXBvc2l0w7NyaW8uCgpDb20gYSBjb25jZXNzw6NvIGRlc3RhIGxpY2Vuw6dhIG7Do28gZXhjbHVzaXZhLCBvIGRlcG9zaXRhbnRlIG1hbnTDqW0gdG9kb3Mgb3MgZGlyZWl0b3MgZGUgYXV0b3IuCl9fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fXwoKTGljZW7Dp2EgZGUgRGlzdHJpYnVpw6fDo28gTsOjbyBFeGNsdXNpdmEKCkFvIGNvbmNvcmRhciBjb20gZXN0YSBsaWNlbsOnYSBlIGFjZWl0w6EtbGEsIHZvY8OqIChhdXRvciBvdSBkZXRlbnRvciBkb3MgZGlyZWl0b3MgYXV0b3JhaXMpOgoKYSkgRGVjbGFyYSBxdWUgY29uaGVjZSBhIHBvbMOtdGljYSBkZSBjb3B5cmlnaHQgZGEgZWRpdG9yYSBkbyBzZXUgZG9jdW1lbnRvOwpiKSBEZWNsYXJhIHF1ZSBjb25oZWNlIGUgYWNlaXRhIGFzIERpcmV0cml6ZXMgcGFyYSBvIFJlcG9zaXTDs3JpbyBJbnN0aXR1Y2lvbmFsIGRhIFVGUEU7CmMpIENvbmNlZGUgw6AgVUZQRSBvIGRpcmVpdG8gbsOjbyBleGNsdXNpdm8gZGUgYXJxdWl2YXIsIHJlcHJvZHV6aXIsIGNvbnZlcnRlciAoY29tbyBkZWZpbmlkbyBhIHNlZ3VpciksIGNvbXVuaWNhciBlL291IGRpc3RyaWJ1aXIsIG5vIFJJLCBvIGRvY3VtZW50byBlbnRyZWd1ZSAoaW5jbHVpbmRvIG8gcmVzdW1vL2Fic3RyYWN0KSBlbSBmb3JtYXRvIGRpZ2l0YWwgb3UgcG9yIG91dHJvIG1laW87CmQpIERlY2xhcmEgcXVlIGF1dG9yaXphIGEgVUZQRSBhIGFycXVpdmFyIG1haXMgZGUgdW1hIGPDs3BpYSBkZXN0ZSBkb2N1bWVudG8gZSBjb252ZXJ0w6otbG8sIHNlbSBhbHRlcmFyIG8gc2V1IGNvbnRlw7pkbywgcGFyYSBxdWFscXVlciBmb3JtYXRvIGRlIGZpY2hlaXJvLCBtZWlvIG91IHN1cG9ydGUsIHBhcmEgZWZlaXRvcyBkZSBzZWd1cmFuw6dhLCBwcmVzZXJ2YcOnw6NvIChiYWNrdXApIGUgYWNlc3NvOwplKSBEZWNsYXJhIHF1ZSBvIGRvY3VtZW50byBzdWJtZXRpZG8gw6kgbyBzZXUgdHJhYmFsaG8gb3JpZ2luYWwgZSBxdWUgZGV0w6ltIG8gZGlyZWl0byBkZSBjb25jZWRlciBhIHRlcmNlaXJvcyBvcyBkaXJlaXRvcyBjb250aWRvcyBuZXN0YSBsaWNlbsOnYS4gRGVjbGFyYSB0YW1iw6ltIHF1ZSBhIGVudHJlZ2EgZG8gZG9jdW1lbnRvIG7Do28gaW5mcmluZ2Ugb3MgZGlyZWl0b3MgZGUgb3V0cmEgcGVzc29hIG91IGVudGlkYWRlOwpmKSBEZWNsYXJhIHF1ZSwgbm8gY2FzbyBkbyBkb2N1bWVudG8gc3VibWV0aWRvIGNvbnRlciBtYXRlcmlhbCBkbyBxdWFsIG7Do28gZGV0w6ltIG9zIGRpcmVpdG9zIGRlCmF1dG9yLCBvYnRldmUgYSBhdXRvcml6YcOnw6NvIGlycmVzdHJpdGEgZG8gcmVzcGVjdGl2byBkZXRlbnRvciBkZXNzZXMgZGlyZWl0b3MgcGFyYSBjZWRlciDDoApVRlBFIG9zIGRpcmVpdG9zIHJlcXVlcmlkb3MgcG9yIGVzdGEgTGljZW7Dp2EgZSBhdXRvcml6YXIgYSB1bml2ZXJzaWRhZGUgYSB1dGlsaXrDoS1sb3MgbGVnYWxtZW50ZS4gRGVjbGFyYSB0YW1iw6ltIHF1ZSBlc3NlIG1hdGVyaWFsIGN1am9zIGRpcmVpdG9zIHPDo28gZGUgdGVyY2Vpcm9zIGVzdMOhIGNsYXJhbWVudGUgaWRlbnRpZmljYWRvIGUgcmVjb25oZWNpZG8gbm8gdGV4dG8gb3UgY29udGXDumRvIGRvIGRvY3VtZW50byBlbnRyZWd1ZTsKZykgU2UgbyBkb2N1bWVudG8gZW50cmVndWUgw6kgYmFzZWFkbyBlbSB0cmFiYWxobyBmaW5hbmNpYWRvIG91IGFwb2lhZG8gcG9yIG91dHJhIGluc3RpdHVpw6fDo28gcXVlIG7Do28gYSBVRlBFLMKgZGVjbGFyYSBxdWUgY3VtcHJpdSBxdWFpc3F1ZXIgb2JyaWdhw6fDtWVzIGV4aWdpZGFzIHBlbG8gcmVzcGVjdGl2byBjb250cmF0byBvdSBhY29yZG8uCgpBIFVGUEUgaWRlbnRpZmljYXLDoSBjbGFyYW1lbnRlIG8ocykgbm9tZShzKSBkbyhzKSBhdXRvciAoZXMpIGRvcyBkaXJlaXRvcyBkbyBkb2N1bWVudG8gZW50cmVndWUgZSBuw6NvIGZhcsOhIHF1YWxxdWVyIGFsdGVyYcOnw6NvLCBwYXJhIGFsw6ltIGRvIHByZXZpc3RvIG5hIGFsw61uZWEgYykuCg==Repositório InstitucionalPUBhttps://repositorio.ufpe.br/oai/requestattena@ufpe.bropendoar:22212019-10-25T20:24:18Repositório Institucional da UFPE - Universidade Federal de Pernambuco (UFPE)false |
dc.title.pt_BR.fl_str_mv |
Analysis and evaluation of optimization techniques for tracking in augmented reality applications |
title |
Analysis and evaluation of optimization techniques for tracking in augmented reality applications |
spellingShingle |
Analysis and evaluation of optimization techniques for tracking in augmented reality applications Teixeira, João Marcelo Xavier Natário Realidade aumentada Visão computacional Alto desempenho Augmented reality Computer vision High performance |
title_short |
Analysis and evaluation of optimization techniques for tracking in augmented reality applications |
title_full |
Analysis and evaluation of optimization techniques for tracking in augmented reality applications |
title_fullStr |
Analysis and evaluation of optimization techniques for tracking in augmented reality applications |
title_full_unstemmed |
Analysis and evaluation of optimization techniques for tracking in augmented reality applications |
title_sort |
Analysis and evaluation of optimization techniques for tracking in augmented reality applications |
author |
Teixeira, João Marcelo Xavier Natário |
author_facet |
Teixeira, João Marcelo Xavier Natário |
author_role |
author |
dc.contributor.author.fl_str_mv |
Teixeira, João Marcelo Xavier Natário |
dc.contributor.advisor1.fl_str_mv |
Kelner, Judith |
dc.contributor.advisor-co1.fl_str_mv |
Teichrieb, Veronica |
contributor_str_mv |
Kelner, Judith Teichrieb, Veronica |
dc.subject.por.fl_str_mv |
Realidade aumentada Visão computacional Alto desempenho Augmented reality Computer vision High performance |
topic |
Realidade aumentada Visão computacional Alto desempenho Augmented reality Computer vision High performance |
description |
Real-time computer vision applications that run on the field and make frequent use of wearable computers have a critical restriction on the amount of processing they can perform, because of the fact that most (if not all) of the application runs on the wearable platform. A balancing scheme capable of allowing the application to use more processing power is fundamental both when input scenarios present more visual restrictions regarding, for example, the object to be tracked, and also to reduce processing in order to save battery and CPU time for other applications when the captured video is better controlled (more accessible). The fact that computer vision applications may run on a variety of platforms justifies the need for defining a model that automatically adjusts the tracker being used in applications with hard performance constraints. Performance degradation in wearable platforms can be greater than expected, as desktop and mobile platforms present different levels of hardware capabilities, and consequently, different performance restrictions. This doctoral thesis addresses the object tracking problem using a decision model, in such a way that prioritizes using the least computationally intensive algorithm whenever possible. It has the following specific objectives: to investigate and implement different tracking techniques, to choose/define a reference metric that can be used to detect image interference (occlusion, image noise, etc.), to propose a decision model that allows automatic switching of different trackers in order to balance the application's performance, and to reduce the application's workload without compromising tracking quality. The effectiveness of the system will be verified by synthetic case studies that comprise different object classes that can be tracked, focusing on augmented reality applications that can run on wearable platforms. Different tracking algorithms will be part of the proposed decision model. It will be shown that by switching among these algorithms, it is possible to reach a performance improvement of a factor of three, while keeping a minimum quality defined by a reprojection error of 10 pixels when compared to the use of only the best algorithm independent of its computational cost. This work results in better performance of applications with memory and battery restrictions. |
publishDate |
2013 |
dc.date.issued.fl_str_mv |
2013-03-01 |
dc.date.accessioned.fl_str_mv |
2015-03-12T19:02:48Z |
dc.date.available.fl_str_mv |
2015-03-12T19:02:48Z |
dc.type.status.fl_str_mv |
info:eu-repo/semantics/publishedVersion |
dc.type.driver.fl_str_mv |
info:eu-repo/semantics/doctoralThesis |
format |
doctoralThesis |
status_str |
publishedVersion |
dc.identifier.citation.fl_str_mv |
TEIXEIRA, João Marcelo Xavier Natário. Analysis and evaluation of optmization techniques for tracking in augmentes reality applications. Recife, 2013. 93 f. Tese (doutorado) - UFPE, Centro de Informática, Programa de Pós-graduação em Ciência da Computação, 2013.. |
dc.identifier.uri.fl_str_mv |
https://repositorio.ufpe.br/handle/123456789/12268 |
identifier_str_mv |
TEIXEIRA, João Marcelo Xavier Natário. Analysis and evaluation of optmization techniques for tracking in augmentes reality applications. Recife, 2013. 93 f. Tese (doutorado) - UFPE, Centro de Informática, Programa de Pós-graduação em Ciência da Computação, 2013.. |
url |
https://repositorio.ufpe.br/handle/123456789/12268 |
dc.language.iso.fl_str_mv |
eng |
language |
eng |
dc.rights.driver.fl_str_mv |
Attribution-NonCommercial-NoDerivs 3.0 Brazil http://creativecommons.org/licenses/by-nc-nd/3.0/br/ info:eu-repo/semantics/openAccess |
rights_invalid_str_mv |
Attribution-NonCommercial-NoDerivs 3.0 Brazil http://creativecommons.org/licenses/by-nc-nd/3.0/br/ |
eu_rights_str_mv |
openAccess |
dc.publisher.none.fl_str_mv |
Universidade Federal de Pernambuco |
publisher.none.fl_str_mv |
Universidade Federal de Pernambuco |
dc.source.none.fl_str_mv |
reponame:Repositório Institucional da UFPE instname:Universidade Federal de Pernambuco (UFPE) instacron:UFPE |
instname_str |
Universidade Federal de Pernambuco (UFPE) |
instacron_str |
UFPE |
institution |
UFPE |
reponame_str |
Repositório Institucional da UFPE |
collection |
Repositório Institucional da UFPE |
bitstream.url.fl_str_mv |
https://repositorio.ufpe.br/bitstream/123456789/12268/5/Tese%20Joao%20Teixeira.pdf.jpg https://repositorio.ufpe.br/bitstream/123456789/12268/1/Tese%20Joao%20Teixeira.pdf https://repositorio.ufpe.br/bitstream/123456789/12268/2/license_rdf https://repositorio.ufpe.br/bitstream/123456789/12268/3/license.txt https://repositorio.ufpe.br/bitstream/123456789/12268/4/Tese%20Joao%20Teixeira.pdf.txt |
bitstream.checksum.fl_str_mv |
d2ecc3e6b33b599ed250f229ffedd425 85ed76e5022129077b181bca61f92678 66e71c371cc565284e70f40736c94386 4b8a02c7f2818eaf00dcf2260dd5eb08 dc5bae23f0330fb3b051965d607e2873 |
bitstream.checksumAlgorithm.fl_str_mv |
MD5 MD5 MD5 MD5 MD5 |
repository.name.fl_str_mv |
Repositório Institucional da UFPE - Universidade Federal de Pernambuco (UFPE) |
repository.mail.fl_str_mv |
attena@ufpe.br |
_version_ |
1813709277804625920 |