Exploring the Limits of Simple Learners in Knowledge Distillation for Document Classification with DocBERT

no code implementations • WS 2020 • Ashutosh Adhikari, Achyudh Ram, Raphael Tang, William L. Hamilton, Jimmy Lin

Fine-tuned variants of BERT are able to achieve state-of-the-art accuracy on many natural language processing tasks, although at significant computational costs.

Document Classification General Classification +2

Exploiting Token and Path-based Representations of Code for Identifying Security-Relevant Commits

no code implementations • 15 Nov 2019 • Achyudh Ram, Ji Xin, Meiyappan Nagappan, Yao-Liang Yu, Rocío Cabrera Lozoya, Antonino Sabetta, Jimmy Lin

Public vulnerability databases such as CVE and NVD account for only 60% of security vulnerabilities present in open-source projects, and are known to suffer from inconsistent quality.

Rethinking Complex Neural Network Architectures for Document Classification

1 code implementation • NAACL 2019 • Ashutosh Adhikari, Achyudh Ram, Raphael Tang, Jimmy Lin

Neural network models for many NLP tasks have grown increasingly complex in recent years, making training and deployment more difficult.

Classification Document Classification +2

DocBERT: BERT for Document Classification

3 code implementations • 17 Apr 2019 • Ashutosh Adhikari, Achyudh Ram, Raphael Tang, Jimmy Lin

We present, to our knowledge, the first application of BERT to document classification.

Document Classification General Classification +1

Supervised Sentiment Classification with CNNs for Diverse SE Datasets

1 code implementation • 23 Dec 2018 • Achyudh Ram, Meiyappan Nagappan

Sentiment analysis, a popular technique for opinion mining, has been used by the software engineering research community for tasks such as assessing app reviews, developer emotions in issue trackers and developer opinions on APIs.

Classification General Classification +3