Assessing irace for automated machine and deep learning in computer vision

Página do item simplificado Estatísticas
dc.contributor.advisorBezerra, Leonardo César Teonacio
dc.contributor.advisor-co1Cáceres, Leslie Pérez
dc.contributor.advisor-co1ID00000000000pt_BR
dc.contributor.authorVieira, Carlos Eduardo Morais
dc.contributor.referees1Araújo, Daniel Sabino Amorim de
dc.date.accessioned2021-10-08T23:20:34Z
dc.date.available2021-10-08T23:20:34Z
dc.date.issued2021-06-29
dc.description.resumoAutomated machine learning (AutoML) is a field of great interest to both industry and academia. AutoML has allowed developers working on machine learning (ML) applications to achieve satisfactory results with little to no ML expertise. More recently, AutoML tools focused on deep learning (DL) models have proven especially useful to applications where domain-specific algorithms are predominant, as in computer vision (CV) tasks. Still, AutoML tools focused on simpler ML pipelines remain a relevant alternative, since DL models have high computational resource requirements and offer reduced model interpretability. Among the main AutoML approaches, AutoML based on algorithm configurators (AC) is commonly used to produce simpler pipelines, whereas neural architecture search (NAS) is used to produce deep learning models. These two approaches also intersect, since an AC can be used as a NAS algorithm. In this work, we study the application of the irace AC to both these AutoML methods. The irace configurator has been successfully applied to design effective algorithms for optimization problems, but it has not yet been applied to AutoML. Our assessment is performed in two stages. First, we propose an irace-based AutoML tool to produce simple and effective ML pipelines. The tool is dubbed iSklearn, for which we define a configuration space and setup. We demonstrate that iSklearn is able to produce effective ML pipelines using irace as its AC, with comparable performance to more complex ensembles produced by AutoSklearn, an established configuration-based AutoML tool. Moreover, we show the benefits of using the configuration space and setup proposed for iSklearn, even when coupled with another AC. In the second part of our work, we assess irace as a NAS algorithm. To do so, we evaluate irace on NAS-Bench-101, a recent NAS benchmark for the CIFAR-10 CV dataset. We benchmark irace not only through final-quality assessment, but also as to anytime performance through a bi-objective formulation. Results demonstrate that irace can be used as a NAS algorithm, obtaining comparable results to the best NAS algorithms included in NAS-Bench-101 in terms of final quality. However, further work is required to improve its anytime performance in this context. Finally, we discuss other design choices made in the NAS-Bench-101 benchmark, showing how they affect the relative performance of NAS algorithms, and provide guidelines for improving the assessment of NAS algorithms through the use of NAS-Bench-101.pt_BR
dc.identifier.citationVIEIRA, Carlos Eduardo Morais. Assessing irace for automated machine and deep learning in computer vision. 2021. 90f. Dissertação (Mestrado Profissional em Tecnologia da Informação) - Instituto Metrópole Digital, Universidade Federal do Rio Grande do Norte, Natal, 2021.pt_BR
dc.identifier.urihttps://repositorio.ufrn.br/handle/123456789/43771
dc.languagept_BRpt_BR
dc.publisherUniversidade Federal do Rio Grande do Nortept_BR
dc.publisher.countryBrasilpt_BR
dc.publisher.initialsUFRNpt_BR
dc.publisher.programPROGRAMA DE PÓS-GRADUAÇÃO EM TECNOLOGIA DA INFORMAÇÃOpt_BR
dc.rightsAcesso Abertopt_BR
dc.subjectAutomated machine learningpt_BR
dc.subjectAlgorithm configurationpt_BR
dc.subjectComputer visionpt_BR
dc.subjectDeep learningpt_BR
dc.subjectNeural architectural searchpt_BR
dc.titleAssessing irace for automated machine and deep learning in computer visionpt_BR
dc.title.alternativeAvaliando o irace para aprendizado de máquina automatizado e profundo em visão computacionalpt_BR
dc.typemasterThesispt_BR

Arquivos

Pacote Original

Agora exibindo 1 - 1 de 1
Nenhuma Miniatura disponível
Nome:
Assessingiraceautomated_Vieira_2021.pdf
Tamanho:
6.03 MB
Formato:
Adobe Portable Document Format
Nenhuma Miniatura disponível
Baixar

Coleções

MPPGTI - Mestrado Profissional em Tecnologia da Informação
Repositório Institucional - UFRN Campus Universitário Lagoa NovaCEP 59078-970 Caixa postal 1524 Natal/RN - BrasilUniversidade Federal do Rio Grande do Norte© Copyright 2025. Todos os direitos reservados.
Contato+55 (84) 3342-2260 - R232Setor de Repositórios Digitaisrepositorio@bczm.ufrn.br
DSpaceIBICT
OasisBR
LAReferencia
Customizado pela CAT - BCZM