Search Results for author:
Found 107 papers, 55 papers with code
A Unified Encoding of Structures in Transition Systems
Transition systems usually contain various dynamic structures (e. g., stacks, buffers).
Word Reordering for Zero-shot Cross-lingual Structured Prediction
Adapting word order from one language to another is a key problem in cross-lingual structured prediction.
WFTNet: Exploiting Global and Local Periodicity in Long-term Time Series Forecasting
Recent CNN and Transformer-based models tried to utilize frequency and periodicity information for long-term time series forecasting.
Do PLMs Know and Understand Ontological Knowledge?
In this paper, we focus on probing whether PLMs store ontological knowledge and have a semantic understanding of the knowledge rather than rote memorization of the surface form.
SeqGPT: An Out-of-the-box Large Language Model for Open Domain Sequence Understanding
However, LLMs are sometimes too footloose for natural language understanding (NLU) tasks which always have restricted output and input format.
EcomGPT: Instruction-tuning Large Language Models with Chain-of-Task Tasks for E-commerce
EcomInstruct scales up the data size and task diversity by constructing atomic tasks with E-commerce basic data types, such as product information, user reviews.
Improving Social Media Popularity Prediction with Multiple Post Dependencies
Social Media Popularity Prediction has drawn a lot of attention because of its profound impact on many different applications, such as recommendation systems and multimedia advertising.
On the (In)Effectiveness of Large Language Models for Chinese Text Correction
Recently, the development and progress of Large Language Models (LLMs) have amazed the entire Artificial Intelligence community.
Improving Text Matching in E-Commerce Search with A Rationalizable, Intervenable and Fast Entity-Based Relevance Model
We also show that pretraining the QE module with auto-generated QE data from user logs can further improve the overall performance.
AOG-LSTM: An adaptive attention neural network for visual storytelling
Moreover, the existing method of alleviating error accumulation based on replacing reference words does not take into account the different effects of each word.
Ranked #20 on
Visual Storytelling
on VIST
Bidirectional End-to-End Learning of Retriever-Reader Paradigm for Entity Linking
Entity Linking (EL) is a fundamental task for Information Extraction and Knowledge Graphs.
Assisting Language Learners: Automated Trans-Lingual Definition Generation via Contrastive Prompt Learning
The standard definition generation task requires to automatically produce mono-lingual definitions (e. g., English definitions for English words), but ignores that the generated definitions may also consist of unfamiliar words for language learners.
DAMO-NLP at SemEval-2023 Task 2: A Unified Retrieval-augmented System for Multilingual Named Entity Recognition
Also, we discover that the limited context length causes the retrieval knowledge to be invisible to the model.
Multilingual Named Entity Recognition
named-entity-recognition
+3
Investigating Graph Structure Information for Entity Alignment with Dangling Cases
To improve the exploitation of the structural information, we propose a novel entity alignment framework called Weakly-Optimal Graph Contrastive Learning (WOGCL), which is refined on three dimensions : (i) Model.
From Retrieval to Generation: Efficient and Effective Entity Set Expansion
The experimental results indicate that the time consumed by the retrieval-based ESE methods increases linearly with entity vocabulary and corpus size.
Zero-Shot Information Extraction via Chatting with ChatGPT
Zero-shot information extraction (IE) aims to build IE systems from the unannotated text.
COMBO: A Complete Benchmark for Open KG Canonicalization
The subject and object noun phrases and the relation in open KG have severe redundancy and ambiguity and need to be canonicalized.
BackdoorBox: A Python Toolbox for Backdoor Learning
Third-party resources ($e. g.$, samples, backbones, and pre-trained models) are usually involved in the training of deep neural networks (DNNs), which brings backdoor attacks as a new training-phase threat.
One Model for All Domains: Collaborative Domain-Prefix Tuning for Cross-Domain NER
Previous typical solutions mainly obtain a NER model by pre-trained language models (PLMs) with data from a rich-resource domain and adapt it to the target domain.
Recall, Expand and Multi-Candidate Cross-Encode: Fast and Accurate Ultra-Fine Entity Typing
We also found MCCE is very effective in fine-grained (130 types) and coarse-grained (9 types) entity typing.
Ranked #2 on
Entity Typing
on Open Entity
Modeling Label Correlations for Ultra-Fine Entity Typing with Neural Pairwise Conditional Random Field
We use mean-field variational inference for efficient type inference on very large type sets and unfold it as a neural network module to enable end-to-end training.
Ranked #3 on
Entity Typing
on Open Entity
Named Entity and Relation Extraction with Multi-Modal Retrieval
MoRe contains a text retrieval module and an image-based retrieval module, which retrieve related knowledge of the input text and image in the knowledge corpus respectively.
Ranked #1 on
Multi-modal Named Entity Recognition
on SNAP (MNER)
Multi-modal Named Entity Recognition
Named Entity Recognition
+3
BATT: Backdoor Attack with Transformation-based Triggers
The backdoor adversaries intend to maliciously control the predictions of attacked DNNs by injecting hidden backdoors that can be activated by adversary-specified trigger patterns during the training process.
Backdoor Defense via Suppressing Model Shortcuts
Recent studies have demonstrated that deep neural networks (DNNs) are vulnerable to backdoor attacks during the training process.
Untargeted Backdoor Attack against Object Detection
The backdoored model has promising performance in predicting benign samples, whereas its predictions can be maliciously manipulated by adversaries based on activating its backdoors with pre-defined trigger patterns.
Entity-to-Text based Data Augmentation for various Named Entity Recognition Tasks
Data augmentation techniques have been used to alleviate the problem of scarce labeled data in various NER tasks (flat, nested, and discontinuous NER tasks).
DAMO-NLP at NLPCC-2022 Task 2: Knowledge Enhanced Robust NER for Speech Entity Linking
Speech Entity Linking aims to recognize and disambiguate named entities in spoken languages.
Untargeted Backdoor Watermark: Towards Harmless and Stealthy Dataset Copyright Protection
In this paper, we revisit dataset ownership verification.
Domain-Specific NER via Retrieving Correlated Samples
Successful Machine Learning based Named Entity Recognition models could fail on texts from some special domains, for instance, Chinese addresses and e-commerce titles, where requires adequate background knowledge.
MOVE: Effective and Harmless Ownership Verification via Embedded External Features
In general, we conduct the ownership verification by verifying whether a suspicious model contains the knowledge of defender-specified external features.
Black-box Dataset Ownership Verification via Backdoor Watermarking
The rapid development of DNNs has benefited from the existence of some high-quality datasets ($e. g.$, ImageNet), which allow researchers and developers to easily verify the performance of their methods.
Adaptive Frequency Learning in Two-branch Face Forgery Detection
Face forgery has attracted increasing attention in recent applications of computer vision.
DAMO-NLP at SemEval-2022 Task 11: A Knowledge-based System for Multilingual Named Entity Recognition
Our system wins 10 out of 13 tracks in the MultiCoNER shared task.
Multilingual Named Entity Recognition
Named Entity Recognition
CausPref: Causal Preference Learning for Out-of-Distribution Recommendation
In spite of the tremendous development of recommender system owing to the progressive capability of machine learning recently, the current recommender system is still vulnerable to the distribution shift of users and items in realistic scenarios, leading to the sharp decline of performance in testing environments.
Few-Shot Backdoor Attacks on Visual Object Tracking
Visual object tracking (VOT) has been widely adopted in mission-critical applications, such as autonomous driving and intelligent surveillance systems.
ITA: Image-Text Alignments for Multi-Modal Named Entity Recognition
As text representations take the most important role in MNER, in this paper, we propose {\bf I}mage-{\bf t}ext {\bf A}lignments (ITA) to align image features into the textual space, so that the attention mechanism in transformer-based pretrained textual embeddings can be better utilized.
Ranked #1 on
Multi-modal Named Entity Recognition
on Twitter-17
Multi-modal Named Entity Recognition
named-entity-recognition
+1
Defending against Model Stealing via Verifying Embedded External Features
In this paper, we explore the defense from another angle by verifying whether a suspicious model contains the knowledge of defender-specified \emph{external features}.
Clustering Effect of Adversarial Robust Models
Adversarial robustness has received increasing attention along with the study of adversarial examples.
Clustering Effect of (Linearized) Adversarial Robust Models
Adversarial robustness has received increasing attention along with the study of adversarial examples.
Semantic Role Labeling as Dependency Parsing: Exploring Latent Tree Structures Inside Arguments
Semantic role labeling (SRL) is a fundamental yet challenging task in the NLP community.
Dependency Parsing
Semantic Role Labeling (predicted predicates)
Maximize the Exploration of Congeneric Semantics for Weakly Supervised Semantic Segmentation
The graph network that is established with patches as the nodes can maximize the mutual learning of similar objects.
Weakly-supervised Learning
Weakly supervised Semantic Segmentation
+1
Deep Dirichlet Process Mixture Models
In this paper we propose the deep Dirichlet process mixture (DDPM) model, which is an unsupervised method that simultaneously performs clustering and feature learning.
MuVER: Improving First-Stage Entity Retrieval with Multi-View Entity Representations
Entity retrieval, which aims at disambiguating mentions to canonical entities from massive KBs, is essential for many tasks in natural language processing.
Ranked #1 on
Entity Retrieval
on ZESHEL
DGEM: A New Dual-modal Graph Embedding Method in Recommendation System
In the current deep learning based recommendation system, the embedding method is generally employed to complete the conversion from the high-dimensional sparse feature vector to the low-dimensional dense feature vector.
Risk Minimization for Zero-shot Sequence Labeling
In this paper, we propose a novel unified framework for zero-shot sequence labeling with minimum risk training and design a new decomposable risk function that models the relations between the predicted labels from the source models and the true labels.
Multi-View Cross-Lingual Structured Prediction with Minimum Supervision
In structured prediction problems, cross-lingual transfer learning is an efficient way to train quality models for low-resource languages, and further improvement can be obtained by learning from multiple source languages.
WeClick: Weakly-Supervised Video Semantic Segmentation with Click Annotations
In this work, we propose an effective weakly-supervised video semantic segmentation pipeline with click annotations, called WeClick, for saving laborious annotating effort by segmenting an instance of the semantic class with only a single click.
Enhanced Universal Dependency Parsing with Automated Concatenation of Embeddings
This paper describes the system used in submission from SHANGHAITECH team to the IWPT 2021 Shared Task.
Towards Emotional Support Dialog Systems
Emotional support is a crucial ability for many conversation scenarios, including social interactions, mental health support, and customer service chats.
Diversifying Dialog Generation via Adaptive Label Smoothing
Neural dialogue generation models trained with the one-hot target distribution suffer from the over-confidence issue, which leads to poor generation diversity as widely reported in the literature.
Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning
We find empirically that the contextual representations computed on the retrieval-based input view, constructed through the concatenation of a sentence and its external contexts, can achieve significantly improved performance compared to the original input view based only on the sentence.
Ranked #1 on
Named Entity Recognition (NER)
on CMeEE
Backdoor Attack in the Physical World
We demonstrate that this attack paradigm is vulnerable when the trigger in testing images is not consistent with the one used for training.
Unsupervised Natural Language Parsing (Introductory Tutorial)
Unsupervised parsing learns a syntactic parser from training sentences without parse tree annotations.
A Benchmark and Comprehensive Survey on Knowledge Graph Entity Alignment via Representation Learning
In the last few years, the interest in knowledge bases has grown exponentially in both the research community and the industry due to their essential role in AI applications.
Improving Adversarial Robustness via Channel-wise Activation Suppressing
The study of adversarial examples and their activation has attracted significant attention for secure and robust learning with deep neural networks (DNNs).
Hidden Backdoor Attack against Semantic Segmentation Models
Deep neural networks (DNNs) are vulnerable to the \emph{backdoor attack}, which intends to embed hidden backdoors in DNNs by poisoning training data.
Loss Function Discovery for Object Detection via Convergence-Simulation Driven Search
For object detection, the well-established classification and regression loss functions have been carefully designed by considering diverse learning challenges.
FenceBox: A Platform for Defeating Adversarial Examples with Data Augmentation Techniques
With more and more advanced adversarial attack methods have been developed, a quantity of corresponding defense solutions were designed to enhance the robustness of DNN models.
Stochastic Deep Gaussian Processes over Graphs
In this paper we propose Stochastic Deep Gaussian Processes over Graphs (DGPG), which are deep structure models that learn the mappings between input and output signals in graph domains.
Optimistic Dual Extrapolation for Coherent Non-monotone Variational Inequalities
The optimization problems associated with training generative adversarial neural networks can be largely reduced to certain {\em non-monotone} variational inequality problems (VIPs), whereas existing convergence results are mostly based on monotone or strongly monotone assumptions.
An Investigation of Potential Function Designs for Neural CRF
The neural linear-chain CRF model is one of the most widely-used approach to sequence labeling.
Neural Latent Dependency Model for Sequence Labeling
One limitation of linear chain CRFs is their inability to model long-range dependencies between labels.
Reducing the Annotation Effort for Video Object Segmentation Datasets
We use a deep convolutional network to automatically create pseudo-labels on a pixel level from much cheaper bounding box annotations and investigate how far such pseudo-labels can carry us for training state-of-the-art VOS approaches.
Second-Order Unsupervised Neural Dependency Parsing
Inspired by second-order supervised dependency parsing, we proposed a second-order extension of unsupervised neural dependency models that incorporate grandparent-child or sibling information.
Ranked #1 on
Dependency Grammar Induction
on WSJ10
Backdoor Attack against Speaker Verification
We also demonstrate that existing backdoor attacks cannot be directly adopted in attacking speaker verification.
Open-sourced Dataset Protection via Backdoor Watermarking
Based on the proposed backdoor-based watermarking, we use a hypothesis test guided method for dataset verification based on the posterior probability generated by the suspicious third-party model of the benign samples and their correspondingly watermarked samples ($i. e.$, images with trigger) on the target class.
Structural Knowledge Distillation: Tractably Distilling Information for Structured Predictor
The objective function of knowledge distillation is typically the cross-entropy between the teacher and the student's output distributions.
Automated Concatenation of Embeddings for Structured Prediction
Pretrained contextualized embeddings are powerful word representations for structured prediction tasks.
Ranked #1 on
Part-Of-Speech Tagging
on ARK
Adversarial Attack and Defense of Structured Prediction Models
To address these problems, we propose a novel and unified framework that learns to attack a structured prediction model using a sequence-to-sequence model with feedbacks from multiple reference models of the same structured prediction task.
A Survey of Unsupervised Dependency Parsing
Syntactic dependency parsing is an important task in natural language processing.
Improving Query Efficiency of Black-box Adversarial Attack
Deep neural networks (DNNs) have demonstrated excellent performance on various tasks, however they are under the risk of adversarial examples that can be easily generated when the target model is accessible to an attacker (white-box setting).
AIN: Fast and Accurate Sequence Labeling with Approximate Inference Network
The linear-chain Conditional Random Field (CRF) model is one of the most widely-used neural sequence labeling approaches.
Ranked #3 on
Chunking
on CoNLL 2003 (German)
More Embeddings, Better Sequence Labelers?
Recent work proposes a family of contextual embeddings that significantly improves the accuracy of sequence labelers over non-contextual embeddings.
Ranked #2 on
Chunking
on CoNLL 2003 (German)
Rectified Decision Trees: Exploring the Landscape of Interpretable and Effective Machine Learning
Interpretability and effectiveness are two essential and indispensable requirements for adopting machine learning methods in reality.
Neural Network-based Automatic Factor Construction
This paper proposes Neural Network-based Automatic Factor Construction (NNAFC), a tailored neural network framework that can automatically construct diversified financial factors based on financial domain knowledge and a variety of neural network structures.
A Large-Scale Chinese Short-Text Conversation Dataset
The cleaned dataset and the pre-training models will facilitate the research of short-text conversation modeling.
Backdoor Learning: A Survey
Backdoor attack intends to embed hidden backdoor into deep neural networks (DNNs), so that the attacked models perform well on benign samples, whereas their predictions will be maliciously changed if the hidden backdoor is activated by attacker-specified triggers.
An Empirical Comparison of Unsupervised Constituency Parsing Methods
Unsupervised constituency parsing aims to learn a constituency parser from a training corpus without parse tree annotations.
Variance Reduction via Accelerated Dual Averaging for Finite-Sum Optimization
Meanwhile, VRADA matches the lower bound of the general convex setting up to a $\log\log n$ factor and matches the lower bounds in both regimes $n\le \Theta(\kappa)$ and $n\gg \kappa$ of the strongly convex setting, where $\kappa$ denotes the condition number.
Enhanced Universal Dependency Parsing with Second-Order Inference and Mixture of Training Data
This paper presents the system used in our submission to the \textit{IWPT 2020 Shared Task}.
Rethinking the Trigger of Backdoor Attack
Backdoor attack intends to inject hidden backdoor into the deep neural networks (DNNs), such that the prediction of the infected model will be maliciously changed if the hidden backdoor is activated by the attacker-defined trigger, while it performs well on benign samples.
Structure-Level Knowledge Distillation For Multilingual Sequence Labeling
Multilingual sequence labeling is a task of predicting label sequences using a single unified model for multiple languages.
Toward Adversarial Robustness via Semi-supervised Robust Training
In this work, we propose a novel defense method, the robust training (RT), by jointly minimizing two separated risks ($R_{stand}$ and $R_{rob}$), which is with respect to the benign example and its neighborhoods respectively.
Alpha Discovery Neural Network based on Prior Knowledge
This paper proposes Alpha Discovery Neural Network (ADNN), a tailored neural network structure which can automatically construct diversified financial technical indicators based on prior knowledge.
Automatic Financial Feature Construction
According to neural network universal approximation theorem, pre-training can conduct a more effective and explainable evolution process.
Deep Flow Collaborative Network for Online Visual Tracking
The deep learning-based visual tracking algorithms such as MDNet achieve high performance leveraging to the feature extraction ability of a deep neural network.
Visual Privacy Protection via Mapping Distortion
To a large extent, the privacy of visual classification data is mainly in the mapping between the image and its corresponding label, since this relation provides a great amount of information and can be used in other scenarios.
Multilingual Grammar Induction with Continuous Language Identification
The key to multilingual grammar induction is to couple grammar parameters of different languages together by exploiting the similarity between languages.
A Regularization-based Framework for Bilingual Grammar Induction
Grammar induction aims to discover syntactic structures from unannotated sentences.
Adversarial Defense via Local Flatness Regularization
In this paper, we define the local flatness of the loss surface as the maximum value of the chosen norm of the gradient regarding to the input within a neighborhood centered on the benign sample, and discuss the relationship between the local flatness and adversarial vulnerability.
$t$-$k$-means: A Robust and Stable $k$-means Variant
$k$-means algorithm is one of the most classical clustering methods, which has been widely and successfully used in signal processing.
Bidirectional Transition-Based Dependency Parsing
Traditionally, a transitionbased dependency parser processes an input sentence and predicts a sequence of parsing actions in a left-to-right manner.
Enhancing Unsupervised Generative Dependency Parser with Contextual Information
In this paper, we propose a novel probabilistic model called discriminative neural dependency model with valence (D-NDMV) that generates a sentence and its parse from a continuous latent representation, which encodes global contextual information of the generated sentence.
Ranked #2 on
Dependency Grammar Induction
on WSJ10
Constituency Grammar Induction
Dependency Grammar Induction
+1
DAL: Dual Adversarial Learning for Dialogue Generation
DAL is the first work to innovatively utilizes the duality between query generation and response generation to avoid safe responses and increase the diversity of the generated responses.
Unified Acceleration of High-Order Algorithms under Hölder Continuity and Uniform Convexity
In this general convex setting, we propose a concise unified acceleration framework (UAF), which reconciles the two different high-order acceleration approaches, one by Nesterov and Baes [29, 3, 33] and one by Monteiro and Svaiter [25].
Rectified Decision Trees: Towards Interpretability, Compression and Empirical Soundness
How to obtain a model with good interpretability and performance has always been an important research topic.
Multinomial Random Forest: Toward Consistency and Privacy-Preservation
Despite the impressive performance of random forests (RF), its theoretical properties have not been thoroughly understood.
Fully Implicit Online Learning
Regularized online learning is widely used in machine learning applications.
Generative Stock Question Answering
We study the problem of stock related question answering (StockQA): automatically generating answers to stock related questions, just like professional stock analysts providing action recommendations to stocks upon user's requests.
Semi-supervised Structured Prediction with Neural CRF Autoencoder
In this paper we propose an end-to-end neural CRF autoencoder (NCRF-AE) model for semi-supervised learning of sequential structured prediction problems.
Maximum A Posteriori Inference in Sum-Product Networks
For the theoretical part, we reduce general MAP inference to its special case without evidence and hidden variables; we also show that it is NP-hard to approximate the MAP problem to $2^{n^\epsilon}$ for fixed $0 \leq \epsilon < 1$, where $n$ is the input size.
CRF Autoencoder for Unsupervised Dependency Parsing
The encoder part of our model is discriminative and globally normalized which allows us to use rich features as well as universal linguistic priors.
Dependency Grammar Induction
Unsupervised Dependency Parsing
Dependency Grammar Induction with Neural Lexicalization and Big Training Data
We study the impact of big models (in terms of the degree of lexicalization) and big data (in terms of the training corpus size) on dependency grammar induction.
Combining Generative and Discriminative Approaches to Unsupervised Dependency Parsing via Dual Decomposition
Unsupervised dependency parsing aims to learn a dependency parser from unannotated sentences.
Latent Dependency Forest Models
Probabilistic modeling is one of the foundations of modern machine learning and artificial intelligence.
