no code implementations • 12 Feb 2024 • Francisco Durán, Silverio Martínez-Fernández, Matias Martinez, Patricia Lago
The aim is to analyze ML serving architectural design decisions for the purpose of understanding and identifying them with respect to quality characteristics from the point of view of researchers and practitioners in the context of ML serving literature.
no code implementations • 11 Feb 2024 • Joel Castaño, Silverio Martínez-Fernández, Xavier Franch
Our objective is to provide a practical guide for future researchers embarking on mining software repository studies within the HF ecosystem to enhance the quality of these studies.
no code implementations • 19 Jul 2023 • Silverio Martínez-Fernández, Xavier Franch, Francisco Durán
Nowadays, AI-based systems have achieved outstanding results and have outperformed humans in different domains.
1 code implementation • 7 Jul 2023 • Santiago del Rey, Silverio Martínez-Fernández, Luís Cruz, Xavier Franch
This study aims to analyze the impact of the model architecture and training environment when training greener computer vision models.
no code implementations • 18 May 2023 • Joel Castaño, Silverio Martínez-Fernández, Xavier Franch, Justus Bogner
This study seeks to answer two research questions: (1) how do ML model creators measure and report carbon emissions on Hugging Face Hub?, and (2) what aspects impact the carbon emissions of training ML models?
no code implementations • 2 Feb 2023 • Yinlena Xu, Silverio Martínez-Fernández, Matias Martinez, Xavier Franch
The evaluation of Deep Learning models has traditionally focused on criteria such as accuracy, F1 score, and related measures.
no code implementations • 2 Feb 2023 • Filippo Lanubile, Silverio Martínez-Fernández, Luigi Quaranta
Building and maintaining production-grade ML-enabled components is a complex endeavor that goes beyond the current approach of academic education, focused on the optimization of ML model performance in the lab.
no code implementations • 8 Jul 2022 • Francisco Durán López, Silverio Martínez-Fernández, Michael Felderer, Xavier Franch
Our goal is to improve the models against adversarial inputs regarding accuracy, resource utilization and time from the point of view of a data scientist in the context of image classification.
no code implementations • 28 Sep 2021 • Roger Creus Castanyer, Silverio Martínez-Fernández, Xavier Franch
Overall, we plan to model the accuracy and complexity of AI-enabled applications in operation with respect to their design decisions and will provide tools for allowing practitioners to gain consciousness of the quantitative relationship between the design decisions and the green characteristics of study.
1 code implementation • 5 May 2021 • Silverio Martínez-Fernández, Justus Bogner, Xavier Franch, Marc Oriol, Julien Siebert, Adam Trendowicz, Anna Maria Vollmer, Stefan Wagner
Our results are valuable for: researchers, to quickly understand the state of the art and learn which topics need more research; practitioners, to learn about the approaches and challenges that SE entails for AI-based systems; and, educators, to bridge the gap among SE and AI in their curricula.
1 code implementation • 11 Mar 2021 • Roger Creus Castanyer, Silverio Martínez-Fernández, Xavier Franch
In this paper, we study the performance of a system that integrates a DL model as a trade-off between the accuracy and the complexity.
no code implementations • 11 Mar 2020 • Silverio Martínez-Fernández, Xavier Franch, Andreas Jedlitschka, Marc Oriol, Adam Trendowicz
Companies dealing with Artificial Intelligence (AI) models in Autonomous Systems (AS) face several problems, such as users' lack of trust in adverse or unknown conditions, gaps between software engineering and AI model development, and operation in a continuously changing operational environment.