Skip to Main content Skip to Navigation
Journal articles

Online Deep Learning Hyperparameter Tuning based on Provenance Analysis

Liliane Kunstmann 1 Débora Pina 1 Filipe Silva 1 Aline Paes 1 Patrick Valduriez 2 Daniel de Oliveira 3 Marta Mattoso 1
2 ZENITH - Scientific Data Management
LIRMM - Laboratoire d'Informatique de Robotique et de Microélectronique de Montpellier, CRISAM - Inria Sophia Antipolis - Méditerranée
Abstract : Training Deep Learning (DL) models require adjusting a series of hyperparameters. Although there are several tools to automatically choose the best hyperparameter configuration, the user is still the main actor to take the final decision. To decide whether the training should continue or try different configurations, the user needs to analyze online the hyperparameters most adequate to the training dataset, observing metrics such as accuracy and loss values. Provenance naturally represents data derivation relationships (i.e., transformations, parameter values, etc.), which provide important support in this data analysis. Most of the existing provenance solutions define their own and proprietary data representations to support DL users in choosing the best hyperparameter configuration, which makes data analysis and interoperability difficult. We present Keras-Prov and its extension, named Keras-Prov++, which provides an analytical dashboard to support online hyperparameter fine-tuning. Different from the current mainstream solutions, Keras-Prov automatically captures the provenance data of DL applications using the W3C PROV recommendation, allowing for hyperparameter online analysis to help the user deciding on changing hyperparameters' values after observing the performance of the models on a validation set. We provide an experimental evaluation of Keras-Prov++ using AlexNet and a real case study, named DenseED, that acts as a surrogate model for solving equations. During the online analysis, the users identify scenarios that suggest reducing the number of epochs to avoid unnecessary executions and fine-tuning the learning rate to improve the model accuracy.
Document type :
Journal articles
Complete list of metadata

https://hal-lirmm.ccsd.cnrs.fr/lirmm-03443660
Contributor : Patrick Valduriez Connect in order to contact the contributor
Submitted on : Tuesday, November 23, 2021 - 3:26:51 PM
Last modification on : Friday, November 26, 2021 - 3:45:43 AM

File

JIDM_SBBD_2020__Special_Issue_...
Files produced by the author(s)

Identifiers

Collections

Citation

Liliane Kunstmann, Débora Pina, Filipe Silva, Aline Paes, Patrick Valduriez, et al.. Online Deep Learning Hyperparameter Tuning based on Provenance Analysis. Journal of Information and Data Management, Brazilian Computer Society, 2021, 12 (5), pp.396-414. ⟨10.5753/jidm.2021.1924⟩. ⟨lirmm-03443660⟩

Share

Metrics

Record views

6

Files downloads

6