Search Results for author: Hadi Hemmati

Found 15 papers, 5 papers with code

Can ChatGPT Support Developers? An Empirical Evaluation of Large Language Models for Code Generation

no code implementations18 Feb 2024 Kailun Jin, Chung-Yu Wang, Hung Viet Pham, Hadi Hemmati

Large language models (LLMs) have demonstrated notable proficiency in code generation, with numerous prior studies showing their promising capabilities in various development scenarios.

Code Generation

I came, I saw, I certified: some perspectives on the safety assurance of cyber-physical systems

no code implementations30 Jan 2024 Mithila Sivakumar, Alvine B. Belle, Kimya Khakzad Shahandashti, Oluwafemi Odu, Hadi Hemmati, Segla Kpodjedo, Song Wang, Opeyemi O. Adesina

In such contexts, detecting assurance deficits, relying on patterns to improve the structure of assurance cases, improving existing assurance case notations, and (semi-)automating the generation of assurance cases are key to develop compelling assurance cases and foster consumer acceptance.

Autonomous Driving

Log-based Anomaly Detection of Enterprise Software: An Empirical Study

no code implementations31 Oct 2023 Nadun Wijesinghe, Hadi Hemmati

In addition, the studied open-source datasets are typically very large in size with logging statements that do not change much over time, which may not be the case with a dataset from an industrial service that is relatively new.

Anomaly Detection

Assessing Evaluation Metrics for Neural Test Oracle Generation

no code implementations11 Oct 2023 Jiho Shin, Hadi Hemmati, Moshi Wei, Song Wang

We apply two different correlation analyses between these two different sets of metrics.

Gray-box Adversarial Attack of Deep Reinforcement Learning-based Trading Agents

no code implementations26 Sep 2023 Foozhan Ataiefard, Hadi Hemmati

In this research, we demonstrate that a "gray-box" approach for attacking a Deep RL-based trading agent is possible by trading in the same stock market, with no extra access to the trading agent.

Adversarial Attack reinforcement-learning +1

Domain Adaptation for Deep Unit Test Case Generation

no code implementations15 Aug 2023 Jiho Shin, Sepehr Hashtroudi, Hadi Hemmati, Song Wang

We compare our approach with (a) CodeT5 fine-tuned on the test generation without DA, (b) the A3Test tool, and (c) GPT-4, on 5 projects from the Defects4j dataset.

Domain Adaptation Language Modelling

FlakyFix: Using Large Language Models for Predicting Flaky Test Fix Categories and Test Code Repair

no code implementations21 Jun 2023 Sakina Fatima, Hadi Hemmati, Lionel Briand

To address this gap, in this paper, we focus on predicting the type of fix that is required to remove flakiness and then repair the test code on that basis.

Code Repair Few-Shot Learning +2

MDA: Availability-Aware Federated Learning Client Selection

1 code implementation25 Nov 2022 Amin Eslami Abyane, Steve Drew, Hadi Hemmati

Since many devices may be unavailable in cross-device FL, and communication between the server and all clients is extremely costly, only a fraction of clients gets selected for training at each round.

Federated Learning

Improving the Performance of DNN-based Software Services using Automated Layer Caching

no code implementations18 Sep 2022 Mohammadamin Abedi, Yanni Iouannou, Pooyan Jamshidi, Hadi Hemmati

The proposed solution is an automated online layer caching mechanism that allows early exiting of a large model during inference time if the cache model in one of the early exits is confident enough for final prediction.

Test2Vec: An Execution Trace Embedding for Test Case Prioritization

no code implementations28 Jun 2022 Emad Jabbar, Soheila Zangeneh, Hadi Hemmati, Robert Feldt

In this paper, we hypothesize that execution traces of the test cases can be a good alternative to abstract their behavior for automated testing tasks.

Towards Understanding Quality Challenges of the Federated Learning for Neural Networks: A First Look from the Lens of Robustness

1 code implementation5 Jan 2022 Amin Eslami Abyane, Derui Zhu, Roberto Souza, Lei Ma, Hadi Hemmati

Therefore, to better understand the current quality status and challenges of these SOTA FL techniques in the presence of attacks and faults, we perform a large-scale empirical study to investigate the SOTA FL's quality from multiple angles of attacks, simulated faults (via mutation operators), and aggregation (defense) methods.

Data Poisoning Federated Learning +2

Robustness Analysis of Deep Learning Frameworks on Mobile Platforms

1 code implementation20 Sep 2021 Amin Eslami Abyane, Hadi Hemmati

This requires frameworks to execute machine learning models (e. g., Deep Neural Networks) on mobile devices.

BIG-bench Machine Learning Face Detection +3

A Pragmatic Approach for Hyper-Parameter Tuning in Search-based Test Case Generation

no code implementations14 Jan 2021 Shayan Zamani, Hadi Hemmati

To evaluate our approach, we exhaustively analyze 1, 200 hyper-parameter configurations of a well-known search-based test generation tool (EvoSuite) for 250 classes of 19 projects from benchmarks such as SF110 and SBST2018 tool competition.

Software Engineering

Deep State Inference: Toward Behavioral Model Inference of Black-box Software Systems

1 code implementation13 Jan 2021 Foozhan Ataiefard, Mohammad Jafar Mashhadi, Hadi Hemmati, Niel Walkinshaw

Many software engineering tasks, such as testing, and anomaly detection can benefit from the ability to infer a behavioral model of the software. Most existing inference approaches assume access to code to collect execution sequences.

Anomaly Detection Change Point Detection +3

Hybrid Deep Neural Networks to Infer State Models of Black-Box Systems

1 code implementation26 Aug 2020 Mohammad Jafar Mashhadi, Hadi Hemmati

Our comparison with several traditional time series change point detection techniques showed that our approach improves their performance by up to 102%, in terms of finding state change points, measured by F1 score.

Anomaly Detection C++ code +3

Cannot find the paper you are looking for? You can Submit a new open access paper.