A conceptual vision toward the management of Machine Learning models

Authors: Daniel N. R. da Silva, Yania Souto, Adolfo Simões, Carlos Cardoso, João N. Rittmeyer, Hermano Lustosa, Luciana E. G. Vignoli, Rebecca Salles, Eduardo Ogasawara, Flavia C. Delicato, Paulo de F. Pires, Artur Ziviani and Fabio Porto
Published: 14-08-2019
Abstract:
To turn big data into actionable knowledge, the adoption of machine learning (ML) methods has proven to be one of the de facto approaches.
When elaborating an appropriate ML model for a given task, one typically builds many models and generates several data artifacts.
Given the amount of information associated with the developed models performance, their appropriate selection is often difficult. Therefore, appropriately comparing a set of competitive ML models and choosing one according to an arbitrary set of user metrics require systematic solutions.
In particular, ML model management is a promising research direction for a more systematic and comprehensive approach for machine learning model selection. Therefore, in this paper, we introduce a conceptual model for ML development. Based on this conceptualization, we introduce our vision toward a knowledge-based model management system oriented to model selection.

DEXL Members

Participant Institutions