Classification of Malware by Using Structural Entropy on Convolutional Neural Networks

27 Apr 2018  ·  Daniel Gibert, Carles Mateu, Jordi Planes, Ramon Vicens ·

he number of malicious programs has grown both in number and in sophistication. Analyzing the malicious intent of vast amounts of data requires huge resources and thus, effective categorization of malware is required. In this paper, the content of a malicious program is represented as an entropy stream, where each value describes the amount of entropy of a small chunk of code in a specific location of the file. Wavelet transforms are then applied to this entropy signal to describe the variation in the entropic energy. Motivated by the visual similarity between streams of entropy of malicious software belonging to the same family, we propose a file agnostic deep learning approach for categorization of malware. Our method exploits the fact that most variants are generated by using common obfuscation techniques and that compression and encryption algorithms retain some properties present in the original code. This allows us to find discriminative patterns that almost all variants in a family share. Our method has been evaluated using the data provided by Microsoft for the BigData Innovators Gathering Anti-Malware Prediction Challenge, and achieved promising results in comparison with the State of the Art.

PDF Abstract
Task Dataset Model Metric Name Metric Value Global Rank Benchmark
Malware Classification Microsoft Malware Classification Challenge Multiresolution CNN + Bagging LogLoss 0.075081 # 5
Malware Classification Microsoft Malware Classification Challenge Structural entropy CNN Accuracy (10-fold) 0.9708 # 18
LogLoss 0.134624 # 9
Macro F1 (10-fold) 0.9314 # 16
Malware Classification Microsoft Malware Classification Challenge Multiresolution CNN Accuracy (10-fold) 0.9828 # 11
LogLoss 0.124431 # 8
Macro F1 (10-fold) 0.9636 # 12
Malware Classification Microsoft Malware Classification Challenge Dynamic Time Wrapping + K-NN Accuracy (10-fold) 0.9894 # 8
LogLoss 0.367724 # 13
Macro F1 (10-fold) 0.9813 # 8

Methods


No methods listed for this paper. Add relevant methods here