Search Results for author:
Found 30 papers, 24 papers with code
CoCoMIC: Code Completion By Jointly Modeling In-file and Cross-file Context
While pre-trained language models (LM) for code have achieved great success in code completion, they generate code conditioned only on the contents within the file, i. e., in-file context, but ignore the rich semantics in other files within the same project, i. e., cross-file context, a critical source of information that is especially useful in modern modular software development.
PLUE: Language Understanding Evaluation Benchmark for Privacy Policies in English
To this end, we introduce the Privacy Policy Language Understanding Evaluation (PLUE) benchmark, a multi-task benchmark for evaluating the privacy policy language understanding across various tasks.
Pre-trained Language Models for Keyphrase Generation: A Thorough Empirical Study
However, there lacks a systematic study of how the two types of approaches compare and how different design choices can affect the performance of PLM-based models.
Multi-lingual Evaluation of Code Generation Models
Using these benchmarks, we are able to assess the performance of code generation models in a multi-lingual fashion, and discovered generalization ability of language models on out-of-domain languages, advantages of multi-lingual models over mono-lingual, the ability of few-shot prompting to teach the model new languages, and zero-shot translation abilities even on mono-lingual settings.
ContraGen: Effective Contrastive Learning For Causal Language Model
Despite exciting progress in large-scale language generation, the expressiveness of its representations is severely limited by the \textit{anisotropy} issue where the hidden representations are distributed into a narrow cone in the vector space.
FixEval: Execution-based Evaluation of Program Fixes for Programming Problems
To address this issue, we introduce FixEval, a benchmark comprising of buggy code submissions to competitive programming problems and their corresponding fixes.
BanglaNLG and BanglaT5: Benchmarks and Resources for Evaluating Low-Resource Natural Language Generation in Bangla
This work presents BanglaNLG, a comprehensive benchmark for evaluating natural language generation (NLG) models in Bangla, a widely spoken yet low-resource language.
Summarize and Generate to Back-translate: Unsupervised Translation of Programming Languages
In code generation, the model learns to do the opposite.
Retrieval Enhanced Data Augmentation for Question Answering on Privacy Policies
Prior studies in privacy policies frame the question answering (QA) tasks as identifying the most relevant text segment or a list of sentences from the policy document for a user query.
Representation Learning for Resource-Constrained Keyphrase Generation
State-of-the-art keyphrase generation methods generally depend on large annotated datasets, limiting their performance in domains with limited annotated data.
CrossSum: Beyond English-Centric Cross-Lingual Abstractive Text Summarization for 1500+ Language Pairs
We present CrossSum, a large-scale cross-lingual abstractive summarization dataset comprising 1. 7 million article-summary samples in 1500+ language pairs.
Abstractive Text Summarization
Cross-Lingual Abstractive Summarization
+1
Retrieval Augmented Code Generation and Summarization
To mimic developers' code or summary generation behavior, we propose a retrieval augmented framework, REDCODER, that retrieves relevant code or summaries from a retrieval database and provides them as a supplement to code generation or summarization models.
Ranked #1 on
Code Generation
on CodeXGLUE - CodeSearchNet
(using extra training data)
AVATAR: A Parallel Corpus for Java-Python Program Translation
Program translation refers to migrating source code from one programming language to another.
Syntax-augmented Multilingual BERT for Cross-lingual Transfer
In recent years, we have seen a colossal effort in pre-training multilingual text encoders using large-scale corpora in many languages to facilitate cross-lingual transfer learning.
CoDesc: A Large Code-Description Parallel Dataset
In this study, we present CoDesc -- a large parallel dataset composed of 4. 2 million Java methods and natural language descriptions.
Ranked #1 on
Code Search
on CoDesc
Improving Zero-Shot Cross-Lingual Transfer Learning via Robust Training
Pre-trained multilingual language encoders, such as multilingual BERT and XLM-R, show great potential for zero-shot cross-lingual transfer.
Text2App: A Framework for Creating Android Apps from Text Descriptions
We overcome this limitation by transforming natural language into an abstract intermediate formal language representing an application with a substantially smaller number of tokens.
Unified Pre-training for Program Understanding and Generation
Experiments on code summarization in the English language, code generation, and code translation in seven programming languages show that PLBART outperforms or rivals state-of-the-art models.
BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Bangla
In this work, we introduce BanglaBERT, a BERT-based Natural Language Understanding (NLU) model pretrained in Bangla, a widely spoken yet low-resource language in the NLP literature.
Intent Classification and Slot Filling for Privacy Policies
We refer to predicting the privacy practice explained in a sentence as intent classification and identifying the text spans sharing specific information as slot filling.
Simple or Complex? Learning to Predict Readability of Bengali Texts
Determining the readability of a text is the first step to its simplification.
GATE: Graph Attention Transformer Encoder for Cross-lingual Relation and Event Extraction
Recent progress in cross-lingual relation and event extraction use graph convolutional networks (GCNs) with universal dependency parses to learn language-agnostic sentence representations such that models trained on one language can be applied to other languages.
PolicyQA: A Reading Comprehension Dataset for Privacy Policies
Prior studies in this domain frame the QA task as retrieving the most relevant text segment or a list of sentences from the policy document given a question.
Select, Extract and Generate: Neural Keyphrase Generation with Layer-wise Coverage Attention
Natural language processing techniques have demonstrated promising results in keyphrase generation.
A Transformer-based Approach for Source Code Summarization
Generating a readable summary that describes the functionality of a program is known as source code summarization.
Cross-lingual Dependency Parsing with Unlabeled Auxiliary Languages
We conduct experiments on cross-lingual dependency parsing where we train a dependency parser on a source language and transfer it to a wide range of target languages.
Context Attentive Document Ranking and Query Suggestion
We present a context-aware neural ranking model to exploit users' on-task search activities and enhance retrieval performance.
On Difficulties of Cross-Lingual Transfer with Order Differences: A Case Study on Dependency Parsing
Different languages might have different word orders.
Multi-task Learning for Universal Sentence Embeddings: A Thorough Evaluation using Transfer and Auxiliary Tasks
Learning distributed sentence representations is one of the key challenges in natural language processing.
Multi-Task Learning for Document Ranking and Query Suggestion
We propose a multi-task learning framework to jointly learn document ranking and query suggestion for web search.
