Search Results for author: Zhen Ming

Found 13 papers, 6 papers with code

Studying the Practices of Testing Machine Learning Software in the Wild

1 code implementation19 Dec 2023 Moses Openja, Foutse khomh, Armstrong Foundjem, Zhen Ming, Jiang, Mouna Abidi, Ahmed E. Hassan

Aims: To fill this gap, we perform the first fine-grained empirical study on ML testing practices in the wild, to identify the ML properties being tested, the followed testing strategies, and their implementation throughout the ML workflow.

Autonomous Driving Fairness

Bug Characterization in Machine Learning-based Systems

1 code implementation26 Jul 2023 Mohammad Mehdi Morovati, Amin Nikanjam, Florian Tambon, Foutse khomh, Zhen Ming, Jiang

Based on our results, fixing ML bugs are more costly and ML components are more error-prone, compared to non-ML bugs and non-ML components respectively.

Bug fixing

GitHub Copilot AI pair programmer: Asset or Liability?

1 code implementation30 Jun 2022 Arghavan Moradi Dakhel, Vahid Majdinasab, Amin Nikanjam, Foutse khomh, Michel C. Desmarais, Zhen Ming, Jiang

In this paper, we study the capabilities of Copilot in two different programming tasks: (i) generating (and reproducing) correct and efficient solutions for fundamental algorithmic problems, and (ii) comparing Copilot's proposed solutions with those of human programmers on a set of programming tasks.

Program Synthesis

An Empirical Study of Challenges in Converting Deep Learning Models

1 code implementation28 Jun 2022 Moses Openja, Amin Nikanjam, Ahmed Haj Yahmed, Foutse khomh, Zhen Ming, Jiang

Usually DL models are developed and trained using DL frameworks that have their own internal mechanisms/formats to represent and train DL models, and usually those formats cannot be recognized by other frameworks.

Bugs in Machine Learning-based Systems: A Faultload Benchmark

no code implementations24 Jun 2022 Mohammad Mehdi Morovati, Amin Nikanjam, Foutse khomh, Zhen Ming, Jiang

Although most of these tools use bugs' lifecycle, there is no standard benchmark of bugs to assess their performance, compare them and discuss their advantages and weaknesses.

BIG-bench Machine Learning Fairness

Towards a Change Taxonomy for Machine Learning Systems

no code implementations21 Mar 2022 Aaditya Bhatia, Ellis E. Eghan, Manel Grichi, William G. Cavanagh, Zhen Ming, Jiang, Bram Adams

However, thus far little is known about the degree of collaboration activity happening on such ML research repositories, in particular regarding (1) the degree to which such repositories receive contributions from forks, (2) the nature of such contributions (i. e., the types of changes), and (3) the nature of changes that are not contributed back to forks, which might represent missed opportunities.

BIG-bench Machine Learning

Towards Training Reproducible Deep Learning Models

1 code implementation4 Feb 2022 Boyuan Chen, Mingzhi Wen, Yong Shi, Dayi Lin, Gopi Krishnan Rajbahadur, Zhen Ming, Jiang

However, DL models are challenging to be reproduced due to issues like randomness in the software (e. g., DL algorithms) and non-determinism in the hardware (e. g., GPU).

Towards a consistent interpretation of AIOps models

no code implementations4 Feb 2022 Yingzhe Lyu, Gopi Krishnan Rajbahadur, Dayi Lin, Boyuan Chen, Zhen Ming, Jiang

Artificial Intelligence for IT Operations (AIOps) has been adopted in organizations in various tasks, including interpreting models to identify indicators of service failures.

Feature Importance

Empirical Study on the Software Engineering Practices in Open Source ML Package Repositories

no code implementations2 Dec 2020 Minke Xiu, Ellis E. Eghan, Zhen Ming, Jiang, Bram Adams

Recent advances in Artificial Intelligence (AI), especially in Machine Learning (ML), have introduced various practical applications (e. g., virtual personal assistants and autonomous cars) that enhance the experience of everyday users.

Transfer Learning

An Exploratory Study on Machine Learning Model Stores

no code implementations25 May 2019 Minke Xiu, Zhen Ming, Jiang, Bram Adams

Recent advances in Artificial Intelligence, especially in Machine Learning (ML), have brought applications previously considered as science fiction (e. g., virtual personal assistants and autonomous cars) into the reach of millions of everyday users.

Software Engineering

Cannot find the paper you are looking for? You can Submit a new open access paper.