1 code implementation • Findings (EMNLP) 2021 • Jiangnan Li, Zheng Lin, Peng Fu, Weiping Wang
Furthermore, we utilize CSK to enrich edges with knowledge representations and process the SKAIG with a graph transformer.
Ranked #8 on
Emotion Recognition in Conversation
on EmoryNLP
1 code implementation • COLING 2022 • Rui Liu, Zheng Lin, Huishan Ji, Jiangnan Li, Peng Fu, Weiping Wang
Despite the significant progress on this task, it is extremely time-consuming and budget-unfriendly to collect sufficient high-quality labeled data for every new target under fully-supervised learning, whereas unlabeled data can be collected easier.
1 code implementation • COLING 2022 • Chenxu Yang, Zheng Lin, Jiangnan Li, Fandong Meng, Weiping Wang, Lanrui Wang, Jie zhou
The knowledge selector generally constructs a query based on the dialogue context and selects the most appropriate knowledge to help response generation.
no code implementations • 25 May 2023 • Xiaomeng Yang, Zhi Qiao, Jin Wei, Yu Zhou, Ye Yuan, Zhilong Ji, Dongbao Yang, Weiping Wang
Scene Text Recognition (STR) is a challenging task due to variations in text style, shape, and background.
1 code implementation • 10 May 2023 • Qingyi Si, Yuchen Mo, Zheng Lin, Huishan Ji, Weiping Wang
Some existing solutions draw external knowledge into the cross-modality space which overlooks the much vaster textual knowledge in natural-language space, while others transform the image into a text that further fuses with the textual knowledge into the natural-language space and completely abandons the use of visual features.
no code implementations • 6 Apr 2023 • Xunyu Zhu, Jian Li, Yong liu, Weiping Wang
Neural Architectures Search (NAS) becomes more and more popular over these years.
1 code implementation • 11 Feb 2023 • Xunyu Zhu, Jian Li, Yong liu, Weiping Wang
It can effectively alleviate the unfair competition between operations during the search phase of DARTS by offsetting the inherent unfair advantage of the skip connection over other operations.
no code implementations • 11 Feb 2023 • Xunyu Zhu, Jian Li, Yong liu, Weiping Wang
Differentiable Architecture Search (DARTS) is a simple yet efficient Neural Architecture Search (NAS) method.
no code implementations • 16 Jan 2023 • Bo Fang, Wenhao Wu, Chang Liu, Yu Zhou, Min Yang, Yuxin Song, Fu Li, Weiping Wang, Xiangyang Ji, Wanli Ouyang
In the refined embedding space, we represent text-video pairs as probabilistic distributions where prototypes are sampled for matching evaluation.
no code implementations • 2 Nov 2022 • Yifei Zhang, Chang Liu, Yu Zhou, Weiping Wang, Qixiang Ye, Xiangyang Ji
In this paper, we present relation-aware contrastive self-supervised learning (ReCo) to integrate instance relations, i. e., global distribution relation and local interpolation relation, into the CSL framework in a plug-and-play fashion.
1 code implementation • 27 Oct 2022 • Bowen Shen, Zheng Lin, Yuanxin Liu, Zhengxiao Liu, Lei Wang, Weiping Wang
Motivated by such considerations, we propose a collaborative optimization for PLMs that integrates static model compression and dynamic inference acceleration.
no code implementations • 26 Oct 2022 • Qingyi Si, Yuanxin Liu, Zheng Lin, Peng Fu, Weiping Wang
To facilitate the application of VLP to VQA tasks, it is imperative to jointly study VLP compression and OOD robustness, which, however, has not yet been explored.
no code implementations • 26 Oct 2022 • Jiangnan Li, Mo Yu, Fandong Meng, Zheng Lin, Peng Fu, Weiping Wang, Jie zhou
Although these tasks are effective, there are still urging problems: (1) randomly masking speakers regardless of the question cannot map the speaker mentioned in the question to the corresponding speaker in the dialogue, and ignores the speaker-centric nature of utterances.
1 code implementation • 21 Oct 2022 • Lanrui Wang, Jiangnan Li, Zheng Lin, Fandong Meng, Chenxu Yang, Weiping Wang, Jie zhou
We use a fine-grained encoding strategy which is more sensitive to the emotion dynamics (emotion flow) in the conversations to predict the emotion-intent characteristic of response.
no code implementations • 17 Oct 2022 • Zexian Yang, Dayan Wu, Bo Li, Weiping Wang
This is challenging as the new data only have local supervision in new cameras with no access to the old data due to privacy issues, and they may also contain persons seen by previous cameras.
1 code implementation • 11 Oct 2022 • Yuanxin Liu, Fandong Meng, Zheng Lin, Jiangnan Li, Peng Fu, Yanan Cao, Weiping Wang, Jie zhou
In response to the efficiency problem, recent studies show that dense PLMs can be replaced with sparse subnetworks without hurting the performance.
1 code implementation • 10 Oct 2022 • Qingyi Si, Fandong Meng, Mingyu Zheng, Zheng Lin, Yuanxin Liu, Peng Fu, Yanan Cao, Weiping Wang, Jie zhou
To overcome this limitation, we propose a new dataset that considers varying types of shortcuts by constructing different distribution shifts in multiple OOD test sets.
1 code implementation • 10 Oct 2022 • Qingyi Si, Yuanxin Liu, Fandong Meng, Zheng Lin, Peng Fu, Yanan Cao, Weiping Wang, Jie zhou
However, these models reveal a trade-off that the improvements on OOD data severely sacrifice the performance on the in-distribution (ID) data (which is dominated by the biased samples).
no code implementations • 6 Jun 2022 • Yuzhe Li, Yong liu, Bo Li, Weiping Wang, Nan Liu
In this paper, we focus our attention on private Empirical Risk Minimization (ERM), which is one of the most commonly used data analysis method.
no code implementations • 10 May 2022 • Youhui Guo, Yu Zhou, Xugong Qin, Enze Xie, Weiping Wang
Recent scene text detection methods are almost based on deep learning and data-driven.
1 code implementation • 2 May 2022 • Jiangnan Li, Fandong Meng, Zheng Lin, Rui Liu, Peng Fu, Yanan Cao, Weiping Wang, Jie zhou
Conversational Causal Emotion Entailment aims to detect causal utterances for a non-neutral targeted utterance from a conversation.
Ranked #1 on
Causal Emotion Entailment
on RECCON
1 code implementation • NAACL 2022 • Yuanxin Liu, Fandong Meng, Zheng Lin, Peng Fu, Yanan Cao, Weiping Wang, Jie zhou
Firstly, we discover that the success of magnitude pruning can be attributed to the preserved pre-training performance, which correlates with the downstream transferability.
no code implementations • 22 Apr 2022 • Yilin Kang, Yong liu, Jian Li, Weiping Wang
In this paper, by introducing Generalized Bernstein condition, we propose the first $\mathcal{O}\big(\frac{\sqrt{p}}{n\epsilon}\big)$ high probability excess population risk bound for differentially private algorithms under the assumptions $G$-Lipschitz, $L$-smooth, and Polyak-{\L}ojasiewicz condition, based on gradient perturbation method.
no code implementations • 11 Apr 2022 • Yilin Kang, Yong liu, Jian Li, Weiping Wang
To the best of our knowledge, this is the first time to analyze the generalization performance of general minimax paradigm, taking differential privacy into account.
no code implementations • 24 Mar 2022 • Chengyang Fang, Gangyan Zeng, Yu Zhou, Daiqing Wu, Can Ma, Dayong Hu, Weiping Wang
Texts in scene images convey critical information for scene understanding and reasoning.
1 code implementation • 15 Dec 2021 • Xiaohua Chen, Yucan Zhou, Dayan Wu, Wanqian Zhang, Yu Zhou, Bo Li, Weiping Wang
Since the covariance matrix of each category represents the feature transformation directions, we can sample new directions from similar categories to generate definitely different instances.
Ranked #47 on
Long-tail Learning
on CIFAR-10-LT (ρ=10)
1 code implementation • 25 Oct 2021 • Wei Wang, Yu Zhou, Jiahao Lv, Dayan Wu, Guoqing Zhao, Ning Jiang, Weiping Wang
The research focus of scene text detection and recognition has shifted to arbitrary shape text in recent years, where the text shape representation is a fundamental problem.
no code implementations • 16 Sep 2021 • Xiaoni Li, Yu Zhou, Yifei Zhang, Aoting Zhang, Wei Wang, Ning Jiang, Haiying Wu, Weiping Wang
Concretely, these downstream tasks require more accurate representation, in other words, the pixels from the same object must belong to a shared semantic category, which is lacking in the previous methods.
1 code implementation • 9 Sep 2021 • Zhi Qiao, Yu Zhou, Jin Wei, Wei Wang, Yuan Zhang, Ning Jiang, Hongbin Wang, Weiping Wang
In this paper, we propose a Parallel, Iterative and Mimicking Network (PIMNet) to balance accuracy and efficiency.
no code implementations • 8 Sep 2021 • Xugong Qin, Yu Zhou, Youhui Guo, Dayan Wu, Zhihong Tian, Ning Jiang, Hongbin Wang, Weiping Wang
We propose to use an MLP decoder instead of the "deconv-conv" decoder in the mask head, which alleviates the issue and promotes robustness significantly.
no code implementations • 8 Sep 2021 • Youhui Guo, Yu Zhou, Xugong Qin, Weiping Wang
In this paper, we propose a simple yet effective method for accurate arbitrary-shaped nearby scene text detection.
1 code implementation • ACL 2021 • Qingyi Si, Zheng Lin, Ming yu Zheng, Peng Fu, Weiping Wang
Besides, they only explore the interaction between image and question, ignoring the semantics of candidate answers.
no code implementations • 8 Jul 2021 • Wei Li, Dezhao Luo, Bo Fang, Yu Zhou, Weiping Wang
As a result, we can leverage the spatial information (the size of objects), temporal information (the direction and magnitude of motions) as our learning target.
no code implementations • 5 Jul 2021 • Dongbao Yang, Yu Zhou, Weiping Wang
Due to the storage burden and the privacy of old data, sometimes it is impractical to train the model from scratch with both old and new data.
no code implementations • 2 Jul 2021 • Xiaoni Li, Yucan Zhou, Yu Zhou, Weiping Wang
Hierarchical classification is significant for complex tasks by providing multi-granular predictions and encouraging better mistakes.
1 code implementation • ACL 2021 • Yuanxin Liu, Fandong Meng, Zheng Lin, Weiping Wang, Jie zhou
In this paper, however, we observe that although distilling the teacher's hidden state knowledge (HSK) is helpful, the performance gain (marginal utility) diminishes quickly as more HSK is distilled.
1 code implementation • 8 Jun 2021 • Qingyi Si, Zheng Lin, Mingyu Zheng, Peng Fu, Weiping Wang
Besides, they only explore the interaction between image and question, ignoring the semantics of candidate answers.
1 code implementation • 7 May 2021 • Yifei Zhang, Yu Zhou, Weiping Wang
Despite the great progress achieved in unsupervised feature embedding, existing contrastive learning methods typically pursue view-invariant representations through attracting positive sample pairs and repelling negative sample pairs in the embedding space, while neglecting to systematically explore instance relations.
no code implementations • 7 May 2021 • Yilin Kang, Yong liu, Jian Li, Weiping Wang
Pairwise learning focuses on learning tasks with pairwise loss functions, depends on pairs of training instances, and naturally fits for modeling relationships between pairs of samples.
no code implementations • 1 Feb 2021 • Shu Zhao, Dayan Wu, Yucan Zhou, Bo Li, Weiping Wang
The proposed gradient amplifier and error-aware quantization loss are compatible with a variety of deep hashing methods.
no code implementations • 27 Jan 2021 • Wei Chen, Yu Liu, Weiping Wang, Erwin Bakker, Theodoros Georgiou, Paul Fieguth, Li Liu, Michael S. Lew
In recent years a vast amount of visual content has been generated and shared from many fields, such as social media platforms, medical imaging, and robotics.
1 code implementation • 29 Dec 2020 • Jiangnan Li, Zheng Lin, Peng Fu, Qingyi Si, Weiping Wang
It can be regarded as a personalized and interactive emotion recognition task, which is supposed to consider not only the semantic information of text but also the influences from speakers.
Ranked #22 on
Emotion Recognition in Conversation
on IEMOCAP
1 code implementation • 3 Dec 2020 • Qingyi Si, Yuanxin Liu, Peng Fu, Zheng Lin, Jiangnan Li, Weiping Wang
A critical problem behind these limitations is that the representations of unseen intents cannot be learned in the training stage.
no code implementations • Findings of the Association for Computational Linguistics 2020 • Hongliang Pan, Zheng Lin, Peng Fu, Yatao Qi, Weiping Wang
Inspired by this, we propose a BERT architecture-based model, which concentrates on both intra and inter-modality incongruity for multi-modal sarcasm detection.
1 code implementation • 19 Oct 2020 • Zhi Qiao, Xugong Qin, Yu Zhou, Fei Yang, Weiping Wang
In this paper, we propose Gaussian Constrained Attention Network to deal with this problem.
no code implementations • 16 Oct 2020 • Wei Chen, Weiping Wang, Li Liu, Michael S. Lew
The focus of this survey is on the analysis of two modalities of multimodal deep learning: image and text.
1 code implementation • 15 Oct 2020 • Wei Chen, Yu Liu, Weiping Wang, Tinne Tuytelaars, Erwin M. Bakker, Michael Lew
On the other hand, fine-tuning the learned representation only with the new classes leads to catastrophic forgetting.
no code implementations • 12 Sep 2020 • Weiping Wang, Ce Xu
In this paper, we study the alternating Euler $T$-sums and $\S$-sums, which are infinite series involving (alternating) odd harmonic numbers, and have similar forms and close relations to the Dirichlet beta functions.
Number Theory
no code implementations • 6 Aug 2020 • Dezhao Luo, Bo Fang, Yu Zhou, Yucan Zhou, Dayan Wu, Weiping Wang
Then a designed sampling strategy is used to model relations for video clips.
no code implementations • 27 Jul 2020 • Dongbao Yang, Yu Zhou, Dayan Wu, Can Ma, Fei Yang, Weiping Wang
Modern object detection methods based on convolutional neural network suffer from severe catastrophic forgetting in learning new classes without original data.
no code implementations • 13 Jul 2020 • Yucan Zhou, Yu Wang, Jianfei Cai, Yu Zhou, QinGhua Hu, Weiping Wang
Some works in the optimization of deep neural networks have shown that a better arrangement of training data can make the classifier converge faster and perform better.
no code implementations • 10 Jul 2020 • Xugong Qin, Yu Zhou, Dayan Wu, Yinliang Yue, Weiping Wang
Accurate detection of multi-oriented text with large variations of scales, orientations, and aspect ratios is of great significance.
1 code implementation • 6 Jul 2020 • Yifei Zhang, Chang Liu, Yu Zhou, Wei Wang, Weiping Wang, Qixiang Ye
In this work, we propose a novel clustering based method, which, by iteratively excluding class inconsistent samples during progressive cluster formation, alleviates the impact of noise samples in a simple-yet-effective manner.
no code implementations • 18 Jun 2020 • Jian Li, Yong liu, Jiankun Liu, Weiping Wang
The encoder and the decoder belong to a graph VAE, mapping architectures between continuous representations and network architectures.
no code implementations • 23 May 2020 • Yudi Chen, Wei Wang, Yu Zhou, Fei Yang, Dongbao Yang, Weiping Wang
To address this problem, we propose a self-training framework to automatically mine hard examples with pseudo-labels from unannotated videos or images.
2 code implementations • CVPR 2020 • Zhi Qiao, Yu Zhou, Dongbao Yang, Yucan Zhou, Weiping Wang
Scene text recognition is a hot research topic in computer vision.
no code implementations • 22 Apr 2020 • Rui Liu, Zheng Lin, Weiping Wang
Considering the different characteristics of extractive and generative methods, we propose to divide the keyphrase prediction into two subtasks, i. e., present keyphrase extraction (PKE) and absent keyphrase generation (AKG), to fully exploit their respective advantages.
no code implementations • 9 Mar 2020 • Yong Liu, Lizhong Ding, Weiping Wang
In this paper, we study the statistical properties of kernel $k$-means and obtain a nearly optimal excess clustering risk bound, substantially improving the state-of-art bounds in the existing clustering risk analyses.
no code implementations • 9 Mar 2020 • Yong Liu, Lizhong Ding, Weiping Wang
However, the studies on learning theory for general loss functions and hypothesis spaces remain limited.
no code implementations • 28 Feb 2020 • Jian Li, Yong liu, Weiping Wang
Recently, non-stationary spectral kernels have drawn much attention, owing to its powerful feature representation ability in revealing long-range correlations and input-dependent characteristics.
no code implementations • 20 Feb 2020 • Yilin Kang, Jian Li, Yong liu, Weiping Wang
Traditionally, the random noise is equally injected when training with different data instances in the field of differential privacy (DP).
1 code implementation • 20 Feb 2020 • Yilin Kang, Yong liu, Ben Niu, Xin-Yi Tong, Likun Zhang, Weiping Wang
By adding noise to the original training data and training with the `perturbed data', we achieve ($\epsilon$,$\delta$)-differential privacy on the final model, along with some kind of privacy on the original data.
1 code implementation • 2 Jan 2020 • Dezhao Luo, Chang Liu, Yu Zhou, Dongbao Yang, Can Ma, Qixiang Ye, Weiping Wang
As a proxy task, it converts rich self-supervised representations into video clip operations (options), which enhances the flexibility and reduces the complexity of representation learning.
Ranked #11 on
Self-supervised Video Retrieval
on HMDB51
no code implementations • IJCNLP 2019 • Yanfu Xu, Zheng Lin, Yuanxin Liu, Rui Liu, Weiping Wang, Dan Meng
Open-domain question answering (OpenQA) aims to answer questions based on a number of unlabeled paragraphs.
no code implementations • 23 Oct 2019 • Yilin Kang, Yong liu, Weiping Wang
By detailed theoretical analysis, we show that in distributed setting, the noise bound and the excess empirical risk bound can be improved by considering different weights held by multiple parties.
1 code implementation • 11 Sep 2019 • Jian Li, Yong liu, Weiping Wang
The generalization performance of kernel methods is largely determined by the kernel, but common kernels are stationary thus input-independent and output-independent, that limits their applications on complicated tasks.
1 code implementation • 11 Sep 2019 • Jian Li, Yong liu, Weiping Wang
Vector-valued learning, where the output space admits a vector-valued structure, is an important problem that covers a broad family of important domains, e. g. multi-label learning and multi-class classification.
no code implementations • 27 Aug 2019 • Xugong Qin, Yu Zhou, Dongbao Yang, Weiping Wang
The performance of the proposed method is comparable with the state-of-the-art methods with only 10% pixel-level annotated data and 90% rectangle-level weakly annotated data.
1 code implementation • 7 Jun 2019 • Jian Li, Yong liu, Weiping Wang
In this paper, using refined proof techniques, we first extend the optimal rates for distributed learning with random features to the non-attainable case.
no code implementations • 13 Feb 2019 • Yong Liu, Jian Li, Guangjun Wu, Lizhong Ding, Weiping Wang
In this paper, we provide a method to approximate the CV for manifold regularization based on a notion of robust statistics, called Bouligand influence function (BIF).
no code implementations • 19 Dec 2018 • Yong Liu, Jian Li, Weiping Wang
We study the risk performance of distributed learning for the regularization empirical risk minimization with fast convergence rate, substantially improving the error analysis of the existing divide-and-conquer based distributed learning.
no code implementations • NeurIPS 2018 • Jian Li, Yong liu, Rong Yin, Hua Zhang, Lizhong Ding, Weiping Wang
In this paper, we study the generalization performance of multi-class classification and obtain a shaper data-dependent generalization error bound with fast convergence rate, substantially improving the state-of-art bounds in the existing data-dependent generalization analysis.