A abstração de contratos contextuais para alocação de recursos de sistemas de computação paralela orientados a componentes em nuvens

Detalhes bibliográficos
Ano de defesa: 2019
Autor(a) principal: Al-Alam, Wagner Guimarães
Orientador(a): Carvalho Junior, Francisco Heron de
Banca de defesa: Não Informado pela instituição
Tipo de documento: Tese
Tipo de acesso: Acesso aberto
Idioma: por
Instituição de defesa: Não Informado pela instituição
Programa de Pós-Graduação: Não Informado pela instituição
Departamento: Não Informado pela instituição
País: Não Informado pela instituição
Palavras-chave em Português:
HPC
Link de acesso: http://www.repositorio.ufc.br/handle/riufc/49047
Resumo: High performance computing has been employing techniques and tools to build solutions for performing tasks that demand high performance in both programs and execution platforms. In the evolution of these techniques, the use of high performance computational clouds is still a challenge, since several users of this area are being reluctant to adopt this model, remaining with the execution of their applications in their own computational resource parks. Among the problems reported by these users are restrictions on the choices users can make in their resources, such as the geographic location of execution platforms, the use of specific computational accelerator, and the added overhead of virtualized hardware execution and communication network. In order to promote access to cloud computing environments to meet the requirements of users in this area, as well as to provide access to heterogeneous resources on demand, it was proposed by the HPC group of the Universidade Federal do Ceará, an environment of cloud computing called HPC-Shelf. HPC-Shelf is based on the component orientation paradigm, using component abstraction to represent programs and execution platforms. In this scenario, this thesis introduces Alite, a method for choosing Computer Systems, formed by pairs of components that represent the programs and their respective execution platforms. Alite, through a series of abstractions, is able to treat the universe of components, registered in a database, using its characteristics that can be represented hierarchically, or through numerical values that can be set by users or automatically calculated from the valuations of other numerical characteristics. An Alite implementation prototype was developed with the purpose of evaluating the contextual contracting system with respect to aspects of expressiveness, performance and effectiveness, evidencing its applicability in real scenarios. Regarding expressiveness, a virtual platform framework was designed for HPC Shelf, which constitute heterogeneous cluster computing platforms with some features considered common in modern cluster design. From this framework, a virtual platform framework on Amazon’s EC2 service is presented. Finally, a matrix multiplication computing component framework was developed based on the BLAS library’s level 3 interface, demonstrating how features of widespread scientific libraries can encapsulated and reused through components at HPC Shelf. User contract resolution time was considered satisfactory for a large number of registered platforms, as well as the result of the classification was aligned with the objectives defined by HPC-Shelf.
id UFC-7_c1716d7db6db0f1ebc8f68b5fe51fc29
oai_identifier_str oai:repositorio.ufc.br:riufc/49047
network_acronym_str UFC-7
network_name_str Repositório Institucional da Universidade Federal do Ceará (UFC)
repository_id_str
spelling Al-Alam, Wagner GuimarãesCarvalho Junior, Francisco Heron de2019-12-26T12:26:01Z2019-12-26T12:26:01Z2019AL ALAM, Wagner Guimarães. A abstração de contratos contextuais para alocação de recursos de sistemas de computação paralela orientados a componentes em nuvens. 2019. 213 f. Tese (Doutorado em Ciência da Computação) - Universidade Federal do Ceará, Fortaleza, 2019.http://www.repositorio.ufc.br/handle/riufc/49047High performance computing has been employing techniques and tools to build solutions for performing tasks that demand high performance in both programs and execution platforms. In the evolution of these techniques, the use of high performance computational clouds is still a challenge, since several users of this area are being reluctant to adopt this model, remaining with the execution of their applications in their own computational resource parks. Among the problems reported by these users are restrictions on the choices users can make in their resources, such as the geographic location of execution platforms, the use of specific computational accelerator, and the added overhead of virtualized hardware execution and communication network. In order to promote access to cloud computing environments to meet the requirements of users in this area, as well as to provide access to heterogeneous resources on demand, it was proposed by the HPC group of the Universidade Federal do Ceará, an environment of cloud computing called HPC-Shelf. HPC-Shelf is based on the component orientation paradigm, using component abstraction to represent programs and execution platforms. In this scenario, this thesis introduces Alite, a method for choosing Computer Systems, formed by pairs of components that represent the programs and their respective execution platforms. Alite, through a series of abstractions, is able to treat the universe of components, registered in a database, using its characteristics that can be represented hierarchically, or through numerical values that can be set by users or automatically calculated from the valuations of other numerical characteristics. An Alite implementation prototype was developed with the purpose of evaluating the contextual contracting system with respect to aspects of expressiveness, performance and effectiveness, evidencing its applicability in real scenarios. Regarding expressiveness, a virtual platform framework was designed for HPC Shelf, which constitute heterogeneous cluster computing platforms with some features considered common in modern cluster design. From this framework, a virtual platform framework on Amazon’s EC2 service is presented. Finally, a matrix multiplication computing component framework was developed based on the BLAS library’s level 3 interface, demonstrating how features of widespread scientific libraries can encapsulated and reused through components at HPC Shelf. User contract resolution time was considered satisfactory for a large number of registered platforms, as well as the result of the classification was aligned with the objectives defined by HPC-Shelf.A Computação de Alto Desempenho (HPC) vem empregando técnicas e ferramentas para construção de soluções para execução de tarefas que demandam alto poder de processamento, tanto nos programas quanto nas plataformas de execução. Nesse contexto, o uso de nuvens computacionais como plataforma de serviços de HPC ainda é um desafio, pois muitos usuários mostram-se receosos em adotar esse modelo, permanecendo com a execução de suas aplicações em seus próprios parques de recursos computacionais. Dentre os problemas relatados por parte desses usuários, destacam-se as restrições quanto às escolhas que os usuários podem fazer nos seus recursos, como a localização geográfica das plataformas de execução, uso de acelerador computacional específico, além da sobrecarga adicionada pela execução virtualizada de hardware e rede de comunicação. A fim de promover o acesso aos ambientes de nuvens computacionais de modo a satisfazer os requisitos dos usuários dessa área, bem como prover acesso aos recursos heterogêneos sob demanda, foi proposto pelo grupo de HPC da Universidade Federal do Ceará, um ambiente de computação em nuvens chamado HPC Shelf. A HPC Shelf tem como base o paradigma de orientação à componentes, utilizando a abstração de componentes tanto para representar os programas quanto as plataformas de execução. Nesse cenário, esta tese introduz o Alite, um arcabouço para seleção de componentes de sistemas de computação paralela, notadamente com requisitos HPC, onde tais componentes representam tanto o software quanto o hardware que o hospeda para execução, as plataformas de computação paralela. O Alite permite a abstração de componentes através de contratos contextuais, os quais determinam propriedades que influenciam na implementação de componentes. Além de requisitos da aplicação e características da plataforma de execução alvo, são tratados requisitos de qualidade de serviço (QoS) e de custo de execução, considerados importantes dentro do novo contexto imposto pela HPC em nuvens. Neste trabalho, são aplicados técnicas de tomadas de decisão baseadas em múltiplos critérios para validação do arcabouço. Um protótipo de implementação do Alite foi desenvolvido com propósito de avaliar o sistema de contratos contextuais com respeito a aspectos de expressividade, desempenho e eficácia, evidenciando a sua aplicabilidade em cenários reais. Com relação à expressividade, foi projetado um arcabouço de plataformas virtuais para a HPC Shelf, as quais constituem plataformas heterogêneas de computação em clusters com algumas características consideradas comuns no projeto dessas plataformas. A partir desse arcabouço, é apresentado um arcabouço de plataformas virtuais sobre o serviço EC2 da Amazon. Finalmente, foi desenvolvido um arcabouço de componentes de computação para multiplicação de matrizes com base na interface de nível 3 da biblioteca BLAS, demonstrando como funcionalidades de bibliotecas científicas de uso disseminado podem ser encapsuladas e reutilizadas por meio de componentes na HPC Shelf. O estudo experimental mostra que o tempo de resolução de contratos dos usuários foi considerado satisfatório para uma quantidade extensa de plataformas registradas, assim como o resultado da classificação mostrou-se alinhado com os objetivos delimitados pela HPC Shelf.Computação em nuvemProgramação paralelaContratos contextuaisCBSEHPCA abstração de contratos contextuais para alocação de recursos de sistemas de computação paralela orientados a componentes em nuvensThe abstraction of contextual contracts for resource allocation in component-oriented parallel computing systems in cloudsinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisporreponame:Repositório Institucional da Universidade Federal do Ceará (UFC)instname:Universidade Federal do Ceará (UFC)instacron:UFCinfo:eu-repo/semantics/openAccessLICENSElicense.txtlicense.txttext/plain; charset=utf-81748http://repositorio.ufc.br/bitstream/riufc/49047/2/license.txt8a4605be74aa9ea9d79846c1fba20a33MD52ORIGINAL2019_tese_wgalalam.pdf2019_tese_wgalalam.pdfapplication/pdf1873149http://repositorio.ufc.br/bitstream/riufc/49047/1/2019_tese_wgalalam.pdf5c95a0d1c4a08a9ce78c7778bd8cfff8MD51riufc/490472020-11-20 16:12:44.941oai:repositorio.ufc.br:riufc/49047Tk9URTogUExBQ0UgWU9VUiBPV04gTElDRU5TRSBIRVJFClRoaXMgc2FtcGxlIGxpY2Vuc2UgaXMgcHJvdmlkZWQgZm9yIGluZm9ybWF0aW9uYWwgcHVycG9zZXMgb25seS4KCk5PTi1FWENMVVNJVkUgRElTVFJJQlVUSU9OIExJQ0VOU0UKCkJ5IHNpZ25pbmcgYW5kIHN1Ym1pdHRpbmcgdGhpcyBsaWNlbnNlLCB5b3UgKHRoZSBhdXRob3Iocykgb3IgY29weXJpZ2h0Cm93bmVyKSBncmFudHMgdG8gRFNwYWNlIFVuaXZlcnNpdHkgKERTVSkgdGhlIG5vbi1leGNsdXNpdmUgcmlnaHQgdG8gcmVwcm9kdWNlLAp0cmFuc2xhdGUgKGFzIGRlZmluZWQgYmVsb3cpLCBhbmQvb3IgZGlzdHJpYnV0ZSB5b3VyIHN1Ym1pc3Npb24gKGluY2x1ZGluZwp0aGUgYWJzdHJhY3QpIHdvcmxkd2lkZSBpbiBwcmludCBhbmQgZWxlY3Ryb25pYyBmb3JtYXQgYW5kIGluIGFueSBtZWRpdW0sCmluY2x1ZGluZyBidXQgbm90IGxpbWl0ZWQgdG8gYXVkaW8gb3IgdmlkZW8uCgpZb3UgYWdyZWUgdGhhdCBEU1UgbWF5LCB3aXRob3V0IGNoYW5naW5nIHRoZSBjb250ZW50LCB0cmFuc2xhdGUgdGhlCnN1Ym1pc3Npb24gdG8gYW55IG1lZGl1bSBvciBmb3JtYXQgZm9yIHRoZSBwdXJwb3NlIG9mIHByZXNlcnZhdGlvbi4KCllvdSBhbHNvIGFncmVlIHRoYXQgRFNVIG1heSBrZWVwIG1vcmUgdGhhbiBvbmUgY29weSBvZiB0aGlzIHN1Ym1pc3Npb24gZm9yCnB1cnBvc2VzIG9mIHNlY3VyaXR5LCBiYWNrLXVwIGFuZCBwcmVzZXJ2YXRpb24uCgpZb3UgcmVwcmVzZW50IHRoYXQgdGhlIHN1Ym1pc3Npb24gaXMgeW91ciBvcmlnaW5hbCB3b3JrLCBhbmQgdGhhdCB5b3UgaGF2ZQp0aGUgcmlnaHQgdG8gZ3JhbnQgdGhlIHJpZ2h0cyBjb250YWluZWQgaW4gdGhpcyBsaWNlbnNlLiBZb3UgYWxzbyByZXByZXNlbnQKdGhhdCB5b3VyIHN1Ym1pc3Npb24gZG9lcyBub3QsIHRvIHRoZSBiZXN0IG9mIHlvdXIga25vd2xlZGdlLCBpbmZyaW5nZSB1cG9uCmFueW9uZSdzIGNvcHlyaWdodC4KCklmIHRoZSBzdWJtaXNzaW9uIGNvbnRhaW5zIG1hdGVyaWFsIGZvciB3aGljaCB5b3UgZG8gbm90IGhvbGQgY29weXJpZ2h0LAp5b3UgcmVwcmVzZW50IHRoYXQgeW91IGhhdmUgb2J0YWluZWQgdGhlIHVucmVzdHJpY3RlZCBwZXJtaXNzaW9uIG9mIHRoZQpjb3B5cmlnaHQgb3duZXIgdG8gZ3JhbnQgRFNVIHRoZSByaWdodHMgcmVxdWlyZWQgYnkgdGhpcyBsaWNlbnNlLCBhbmQgdGhhdApzdWNoIHRoaXJkLXBhcnR5IG93bmVkIG1hdGVyaWFsIGlzIGNsZWFybHkgaWRlbnRpZmllZCBhbmQgYWNrbm93bGVkZ2VkCndpdGhpbiB0aGUgdGV4dCBvciBjb250ZW50IG9mIHRoZSBzdWJtaXNzaW9uLgoKSUYgVEhFIFNVQk1JU1NJT04gSVMgQkFTRUQgVVBPTiBXT1JLIFRIQVQgSEFTIEJFRU4gU1BPTlNPUkVEIE9SIFNVUFBPUlRFRApCWSBBTiBBR0VOQ1kgT1IgT1JHQU5JWkFUSU9OIE9USEVSIFRIQU4gRFNVLCBZT1UgUkVQUkVTRU5UIFRIQVQgWU9VIEhBVkUKRlVMRklMTEVEIEFOWSBSSUdIVCBPRiBSRVZJRVcgT1IgT1RIRVIgT0JMSUdBVElPTlMgUkVRVUlSRUQgQlkgU1VDSApDT05UUkFDVCBPUiBBR1JFRU1FTlQuCgpEU1Ugd2lsbCBjbGVhcmx5IGlkZW50aWZ5IHlvdXIgbmFtZShzKSBhcyB0aGUgYXV0aG9yKHMpIG9yIG93bmVyKHMpIG9mIHRoZQpzdWJtaXNzaW9uLCBhbmQgd2lsbCBub3QgbWFrZSBhbnkgYWx0ZXJhdGlvbiwgb3RoZXIgdGhhbiBhcyBhbGxvd2VkIGJ5IHRoaXMKbGljZW5zZSwgdG8geW91ciBzdWJtaXNzaW9uLgo=Repositório InstitucionalPUBhttp://www.repositorio.ufc.br/ri-oai/requestbu@ufc.br || repositorio@ufc.bropendoar:2020-11-20T19:12:44Repositório Institucional da Universidade Federal do Ceará (UFC) - Universidade Federal do Ceará (UFC)false
dc.title.pt_BR.fl_str_mv A abstração de contratos contextuais para alocação de recursos de sistemas de computação paralela orientados a componentes em nuvens
dc.title.en.pt_BR.fl_str_mv The abstraction of contextual contracts for resource allocation in component-oriented parallel computing systems in clouds
title A abstração de contratos contextuais para alocação de recursos de sistemas de computação paralela orientados a componentes em nuvens
spellingShingle A abstração de contratos contextuais para alocação de recursos de sistemas de computação paralela orientados a componentes em nuvens
Al-Alam, Wagner Guimarães
Computação em nuvem
Programação paralela
Contratos contextuais
CBSE
HPC
title_short A abstração de contratos contextuais para alocação de recursos de sistemas de computação paralela orientados a componentes em nuvens
title_full A abstração de contratos contextuais para alocação de recursos de sistemas de computação paralela orientados a componentes em nuvens
title_fullStr A abstração de contratos contextuais para alocação de recursos de sistemas de computação paralela orientados a componentes em nuvens
title_full_unstemmed A abstração de contratos contextuais para alocação de recursos de sistemas de computação paralela orientados a componentes em nuvens
title_sort A abstração de contratos contextuais para alocação de recursos de sistemas de computação paralela orientados a componentes em nuvens
author Al-Alam, Wagner Guimarães
author_facet Al-Alam, Wagner Guimarães
author_role author
dc.contributor.author.fl_str_mv Al-Alam, Wagner Guimarães
dc.contributor.advisor1.fl_str_mv Carvalho Junior, Francisco Heron de
contributor_str_mv Carvalho Junior, Francisco Heron de
dc.subject.por.fl_str_mv Computação em nuvem
Programação paralela
Contratos contextuais
CBSE
HPC
topic Computação em nuvem
Programação paralela
Contratos contextuais
CBSE
HPC
description High performance computing has been employing techniques and tools to build solutions for performing tasks that demand high performance in both programs and execution platforms. In the evolution of these techniques, the use of high performance computational clouds is still a challenge, since several users of this area are being reluctant to adopt this model, remaining with the execution of their applications in their own computational resource parks. Among the problems reported by these users are restrictions on the choices users can make in their resources, such as the geographic location of execution platforms, the use of specific computational accelerator, and the added overhead of virtualized hardware execution and communication network. In order to promote access to cloud computing environments to meet the requirements of users in this area, as well as to provide access to heterogeneous resources on demand, it was proposed by the HPC group of the Universidade Federal do Ceará, an environment of cloud computing called HPC-Shelf. HPC-Shelf is based on the component orientation paradigm, using component abstraction to represent programs and execution platforms. In this scenario, this thesis introduces Alite, a method for choosing Computer Systems, formed by pairs of components that represent the programs and their respective execution platforms. Alite, through a series of abstractions, is able to treat the universe of components, registered in a database, using its characteristics that can be represented hierarchically, or through numerical values that can be set by users or automatically calculated from the valuations of other numerical characteristics. An Alite implementation prototype was developed with the purpose of evaluating the contextual contracting system with respect to aspects of expressiveness, performance and effectiveness, evidencing its applicability in real scenarios. Regarding expressiveness, a virtual platform framework was designed for HPC Shelf, which constitute heterogeneous cluster computing platforms with some features considered common in modern cluster design. From this framework, a virtual platform framework on Amazon’s EC2 service is presented. Finally, a matrix multiplication computing component framework was developed based on the BLAS library’s level 3 interface, demonstrating how features of widespread scientific libraries can encapsulated and reused through components at HPC Shelf. User contract resolution time was considered satisfactory for a large number of registered platforms, as well as the result of the classification was aligned with the objectives defined by HPC-Shelf.
publishDate 2019
dc.date.accessioned.fl_str_mv 2019-12-26T12:26:01Z
dc.date.available.fl_str_mv 2019-12-26T12:26:01Z
dc.date.issued.fl_str_mv 2019
dc.type.status.fl_str_mv info:eu-repo/semantics/publishedVersion
dc.type.driver.fl_str_mv info:eu-repo/semantics/doctoralThesis
format doctoralThesis
status_str publishedVersion
dc.identifier.citation.fl_str_mv AL ALAM, Wagner Guimarães. A abstração de contratos contextuais para alocação de recursos de sistemas de computação paralela orientados a componentes em nuvens. 2019. 213 f. Tese (Doutorado em Ciência da Computação) - Universidade Federal do Ceará, Fortaleza, 2019.
dc.identifier.uri.fl_str_mv http://www.repositorio.ufc.br/handle/riufc/49047
identifier_str_mv AL ALAM, Wagner Guimarães. A abstração de contratos contextuais para alocação de recursos de sistemas de computação paralela orientados a componentes em nuvens. 2019. 213 f. Tese (Doutorado em Ciência da Computação) - Universidade Federal do Ceará, Fortaleza, 2019.
url http://www.repositorio.ufc.br/handle/riufc/49047
dc.language.iso.fl_str_mv por
language por
dc.rights.driver.fl_str_mv info:eu-repo/semantics/openAccess
eu_rights_str_mv openAccess
dc.source.none.fl_str_mv reponame:Repositório Institucional da Universidade Federal do Ceará (UFC)
instname:Universidade Federal do Ceará (UFC)
instacron:UFC
instname_str Universidade Federal do Ceará (UFC)
instacron_str UFC
institution UFC
reponame_str Repositório Institucional da Universidade Federal do Ceará (UFC)
collection Repositório Institucional da Universidade Federal do Ceará (UFC)
bitstream.url.fl_str_mv http://repositorio.ufc.br/bitstream/riufc/49047/2/license.txt
http://repositorio.ufc.br/bitstream/riufc/49047/1/2019_tese_wgalalam.pdf
bitstream.checksum.fl_str_mv 8a4605be74aa9ea9d79846c1fba20a33
5c95a0d1c4a08a9ce78c7778bd8cfff8
bitstream.checksumAlgorithm.fl_str_mv MD5
MD5
repository.name.fl_str_mv Repositório Institucional da Universidade Federal do Ceará (UFC) - Universidade Federal do Ceará (UFC)
repository.mail.fl_str_mv bu@ufc.br || repositorio@ufc.br
_version_ 1847793278165975040