Please use this identifier to cite or link to this item:
http://hdl.handle.net/1942/39347
Title: | A survey on multi-objective hyperparameter optimization algorithms for machine learning | Authors: | MORALES HERNANDEZ, Alejandro VAN NIEUWENHUYSE, Inneke ROJAS GONZALEZ, Sebastian |
Issue Date: | 2023 | Publisher: | SPRINGER | Source: | ARTIFICIAL INTELLIGENCE REVIEW, 56 (8) , p. 8043-8093 | Abstract: | Hyperparameter optimization (HPO) is a necessary step to ensure the best possible performance of Machine Learning (ML) algorithms. Several methods have been developed to perform HPO; most of these are focused on optimizing one performance measure (usually an error-based measure), and the literature on such single-objective HPO problems is vast. Recently, though, algorithms have appeared that focus on optimizing multiple conflicting objectives simultaneously. This article presents a systematic survey of the literature published between 2014 and 2020 on multi-objective HPO algorithms, distinguishing between metaheuristic-based algorithms, metamodel-based algorithms and approaches using a mixture of both. We also discuss the quality metrics used to compare multi-objective HPO procedures and present future research directions. | Notes: | Morales-Hernandez, A (corresponding author), Hasselt Univ, Fac Sci, Hasselt, Belgium.; Morales-Hernandez, A (corresponding author), Hasselt Univ, VCCM Core Lab & Data Sci Inst, Hasselt, Belgium. alejandro.moraleshernandez@uhasselt.be; inneke.vannieuwenhuyse@uhasselt.be; sebastian.rojasgonzalez@uhasselt.be |
Keywords: | Hyperparameter optimization;Multi-objective optimization;Metamodel;Meta-heuristic;Machine learning | Document URI: | http://hdl.handle.net/1942/39347 | ISSN: | 0269-2821 | e-ISSN: | 1573-7462 | DOI: | 10.1007/s10462-022-10359-2 | ISI #: | 000903579100001 | Rights: | Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article’s Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article’s Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. | Category: | A1 | Type: | Journal Contribution |
Appears in Collections: | Research publications |
Files in This Item:
File | Description | Size | Format | |
---|---|---|---|---|
A survey on multi-objective hyperparameter optimization algorithms for machine learning.pdf | Published version | 3.24 MB | Adobe PDF | View/Open |
Items in DSpace are protected by copyright, with all rights reserved, unless otherwise indicated.