Search Results for author:
Found 9 papers, 3 papers with code
Fairness Improvement with Multiple Protected Attributes: How Far Are We?
Existing research mostly improves the fairness of Machine Learning (ML) software regarding a single protected attribute at a time, but this is unrealistic given that many users have multiple protected attributes.
Bias Mitigation for Machine Learning Classifiers: A Comprehensive Survey
How many datasets are used for evaluating bias mitigation methods?
A Comprehensive Empirical Study of Bias Mitigation Methods for Machine Learning Classifiers
We find that (1) the bias mitigation methods significantly decrease ML performance in 53% of the studied scenarios (ranging between 42%~66% according to different ML performance metrics); (2) the bias mitigation methods significantly improve fairness measured by the 4 used metrics in 46% of all the scenarios (ranging between 24%~59% according to different fairness metrics); (3) the bias mitigation methods even lead to decrease in both fairness and ML performance in 25% of the scenarios; (4) the effectiveness of the bias mitigation methods depends on tasks, models, the choice of protected attributes, and the set of metrics used to assess fairness and ML performance; (5) there is no bias mitigation method that can achieve the best trade-off in all the scenarios.
Leveraging Automated Unit Tests for Unsupervised Code Translation
With little to no parallel data available for programming languages, unsupervised methods are well-suited to source code translation.
FrUITeR: A Framework for Evaluating UI Test Reuse
UI testing is tedious and time-consuming due to the manual effort required.
Software Engineering
Ownership at Large -- Open Problems and Challenges in Ownership Management
Software-intensive organizations rely on large numbers of software assets of different types, e. g., source-code files, tables in the data warehouse, and software configurations.
WES: Agent-based User Interaction Simulation on Real Infrastructure
We introduce the Web-Enabled Simulation (WES) research agenda, and describe FACEBOOK's WW system.
Machine Learning Testing: Survey, Landscapes and Horizons
This paper provides a comprehensive survey of Machine Learning Testing (ML testing) research.
Model Validation Using Mutated Training Labels: An Exploratory Study
MV mutates training data labels, retrains the model against the mutated data, then uses the metamorphic relation that captures the consequent training performance changes to assess model fit.
