Shellcode_IA32: A Dataset for Automatic Shellcode Generation

27 Apr 2021  ·  Pietro Liguori, Erfan Al-Hossami, Domenico Cotroneo, Roberto Natella, Bojan Cukic, Samira Shaikh ·

We take the first step to address the task of automatically generating shellcodes, i.e., small pieces of code used as a payload in the exploitation of a software vulnerability, starting from natural language comments. We assemble and release a novel dataset (Shellcode_IA32), consisting of challenging but common assembly instructions with their natural language descriptions... We experiment with standard methods in neural machine translation (NMT) to establish baseline performance levels on this task. read more

PDF Abstract

Datasets


Introduced in the Paper:

Shellcode_IA32

Used in the Paper:

CoNaLa

Results from the Paper


Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Code Generation Shellcode_IA32 LSTM-based Sequence to Sequence BLEU-4 62.97 # 1
Exact Match Accuracy 51.55 # 1

Methods