Search Results for author: Kexin Pei

Found 12 papers, 7 papers with code

SWE-bench: Can Language Models Resolve Real-World GitHub Issues?

no code implementations10 Oct 2023 Carlos E. Jimenez, John Yang, Alexander Wettig, Shunyu Yao, Kexin Pei, Ofir Press, Karthik Narasimhan

We find real-world software engineering to be a rich, sustainable, and challenging testbed for evaluating the next generation of language models.

Bug fixing Code Generation +1

Exploiting Code Symmetries for Learning Program Semantics

no code implementations7 Aug 2023 Kexin Pei, Weichen Li, Qirui Jin, Shuyang Liu, Scott Geng, Lorenzo Cavallaro, Junfeng Yang, Suman Jana

This paper tackles the challenge of teaching code semantics to Large Language Models (LLMs) for program analysis by incorporating code symmetries into the model architecture.

Trex: Learning Execution Semantics from Micro-Traces for Binary Similarity

1 code implementation16 Dec 2020 Kexin Pei, Zhou Xuan, Junfeng Yang, Suman Jana, Baishakhi Ray

We thus train the model to learn execution semantics from the functions' micro-traces, without any manual labeling effort.

Transfer Learning Vulnerability Detection

XDA: Accurate, Robust Disassembly with Transfer Learning

1 code implementation2 Oct 2020 Kexin Pei, Jonas Guan, David Williams-King, Junfeng Yang, Suman Jana

We present XDA, a transfer-learning-based disassembly framework that learns different contextual dependencies present in machine code and transfers this knowledge for accurate and robust disassembly.

Language Modelling Masked Language Modeling +2

Efficient Formal Safety Analysis of Neural Networks

2 code implementations NeurIPS 2018 Shiqi Wang, Kexin Pei, Justin Whitehouse, Junfeng Yang, Suman Jana

Our approach can check different safety properties and find concrete counterexamples for networks that are 10$\times$ larger than the ones supported by existing analysis techniques.

Adversarial Attack Adversarial Defense +3

NEUZZ: Efficient Fuzzing with Neural Program Smoothing

1 code implementation15 Jul 2018 Dongdong She, Kexin Pei, Dave Epstein, Junfeng Yang, Baishakhi Ray, Suman Jana

However, even state-of-the-art fuzzers are not very efficient at finding hard-to-trigger software bugs.

Evolutionary Algorithms

Formal Security Analysis of Neural Networks using Symbolic Intervals

3 code implementations28 Apr 2018 Shiqi Wang, Kexin Pei, Justin Whitehouse, Junfeng Yang, Suman Jana

In this paper, we present a new direction for formally checking security properties of DNNs without using SMT solvers.

Autonomous Vehicles Collision Avoidance

Towards Practical Verification of Machine Learning: The Case of Computer Vision Systems

no code implementations5 Dec 2017 Kexin Pei, Linjie Zhu, Yinzhi Cao, Junfeng Yang, Carl Vondrick, Suman Jana

Finally, we show that retraining using the safety violations detected by VeriVis can reduce the average number of violations up to 60. 2%.

BIG-bench Machine Learning Medical Diagnosis

DeepTest: Automated Testing of Deep-Neural-Network-driven Autonomous Cars

1 code implementation28 Aug 2017 Yuchi Tian, Kexin Pei, Suman Jana, Baishakhi Ray

Most existing testing techniques for DNN-driven vehicles are heavily dependent on the manual collection of test data under different driving conditions which become prohibitively expensive as the number of test conditions increases.

Autonomous Vehicles

DeepXplore: Automated Whitebox Testing of Deep Learning Systems

3 code implementations18 May 2017 Kexin Pei, Yinzhi Cao, Junfeng Yang, Suman Jana

First, we introduce neuron coverage for systematically measuring the parts of a DL system exercised by test inputs.

Malware Detection Self-Driving Cars

Cannot find the paper you are looking for? You can Submit a new open access paper.