no code implementations • Findings (EMNLP) 2021 • Bayu Distiawan Trisedya, Xiaojie Wang, Jianzhong Qi, Rui Zhang, Qingjun Cui
A key component of the GSC-attention is grouped-attention, which is token-level attention constrained within each input attribute that enables our proposed model captures both local and global context.
no code implementations • COLING 2022 • Ziqin Rao, Fangxiang Feng, Ruifan Li, Xiaojie Wang
Our BGM comprises of an instance embedding module and a bag representation module.
1 code implementation • Findings (EMNLP) 2021 • Chenxu Lv, Hengtong Lu, Shuyu Lei, Huixing Jiang, Wei Wu, Caixia Yuan, Xiaojie Wang
A reliable clustering algorithm for task-oriented dialogues can help developer analysis and define dialogue tasks efficiently.
no code implementations • Findings (EMNLP) 2021 • Yuzhao Mao, Guang Liu, Xiaojie Wang, Weiguo Gao, Xuan Li
Emotion dynamics formulates principles explaining the emotional fluctuation during conversations.
1 code implementation • ACL 2022 • Yiwen Zhang, Caixia Yuan, Xiaojie Wang, Ziwei Bai, Yongbin Liu
Generalized zero-shot text classification aims to classify textual instances from both previously seen classes and incrementally emerging unseen classes.
1 code implementation • ACL 2022 • Hao Chen, Zepeng Zhai, Fangxiang Feng, Ruifan Li, Xiaojie Wang
Specifically, we first define ten types of relations for ASTE task, and then adopt a biaffine attention module to embed these relations as an adjacent tensor between words in a sentence.
no code implementations • 9 Apr 2024 • Pengfei Zhou, Fangxiang Feng, Xiaojie Wang
To deal with these issues, in this paper, we first adapt a pre-trained latent diffusion model to the image harmonization task to generate the harmonious but potentially blurry initial images.
no code implementations • 10 Mar 2024 • Junhui Yin, Xinyu Zhang, Lin Wu, Xianghua Xie, Xiaojie Wang
To this end, we explore the concept of test-time prompt tuning (TTPT), which enables the adaptation of the CLIP model to novel downstream tasks through only one step of optimization on an unsupervised objective that involves the test sample.
no code implementations • 7 Mar 2024 • Ningfei Wang, Yupin Huang, Han Cheng, Jiri Gesi, Xiaojie Wang, Vivek Mittal
As e-commerce retailers use various techniques to improve the quality of search results, we hope that this research offers valuable guidance for measuring the robustness of the ranking systems.
no code implementations • 8 Dec 2023 • Zhaolong Ning, Hao Hu, Xiaojie Wang, Qingqing Wu, Chau Yuen, F. Richard Yu, Yan Zhang
To address the aforementioned challenges, we propose a new optimization algorithm for joint IRS-user association, trajectory optimization of UAVs, successive interference cancellation (SIC) decoding order scheduling and power allocation to maximize system energy efficiency.
no code implementations • 27 Oct 2023 • Xiaojie Wang, Beibei Wang, Yu Wu, Zhaolong Ning, Song Guo, Fei Richard Yu
Edge Intelligence (EI) integrates Edge Computing (EC) and Artificial Intelligence (AI) to push the capabilities of AI to the network edge for real-time, efficient and secure intelligent decision-making and computation.
no code implementations • 20 Oct 2023 • Yangyang Luo, Shiyu Tian, Caixia Yuan, Xiaojie Wang
Conversational Machine Reading (CMR) requires answering a user's initial question through multi-turn dialogue interactions based on a given document.
1 code implementation • 1 Oct 2023 • Lucen Zhong, Hengtong Lu, Caixia Yuan, Xiaojie Wang, Jiashen Sun, Ke Zeng, Guanglu Wan
A global policy consistency task is designed to capture the multi-turn dialog policy sequential relation, and an act-based contrastive learning task is designed to capture similarities among samples with the same dialog policy.
no code implementations • 12 Sep 2023 • Di Lu, Zhongping Liang, Caixia Yuan, Xiaojie Wang
This paper presents a novel approach to address the Entity Recognition and Linking Challenge at NLPCC 2015.
1 code implementation • 19 Aug 2023 • Fulong Ye, Yuxing Long, Fangxiang Feng, Xiaojie Wang
Referring Expression Generation (REG) aims to generate unambiguous Referring Expressions (REs) for objects in a visual scene, with a dual task of Referring Expression Comprehension (REC) to locate the referred object.
1 code implementation • 23 Jul 2023 • Yuzhao Mao, Di Lu, Xiaojie Wang, Yang Zhang
This paper concentrates on the understanding of interlocutors' emotions evoked in conversational utterances.
Ranked #17 on Emotion Recognition in Conversation on IEMOCAP
1 code implementation • 26 May 2023 • Yuxing Long, Binyuan Hui, Caixia Yuan1, Fei Huang, Yongbin Li, Xiaojie Wang
Existing multimodal task-oriented dialog data fails to demonstrate the diverse expressions of user subjective preferences and recommendation acts in the real-life shopping scenario.
1 code implementation • 4 May 2023 • Sai Zhang, Yuwei Hu, Xiaojie Wang, Caixia Yuan
The errors from DST might misguide the dialog policy, and the system action brings extra difficulties for the DST module.
1 code implementation • journal 2023 • Kang Xu, Weixin Li, Xia Wang, Xiaoyan Hu, Ke Yan, Xiaojie Wang, Xuan Dong
Based on the prior that, for each pixel, its similar pixels are usually spatially close, our insights are that (1) we partition the image into non-overlapped windows and perform regional self-attention to reduce the search range of each pixel, and (2) we encourage pixels across different windows to communicate with each other.
1 code implementation • 5 Jan 2023 • Yuxing Long, Binyuan Hui, Fulong Ye, Yanyang Li, Zhuoxin Han, Caixia Yuan, Yongbin Li, Xiaojie Wang
Existing multimodal conversation agents have shown impressive abilities to locate absolute positions or retrieve attributes in simple scenarios, but they fail to perform well when complex relative positions and information alignments are involved, which poses a bottleneck in response quality.
1 code implementation • 24 Oct 2022 • Duo Zheng, Tao Kong, Ya Jing, Jiaan Wang, Xiaojie Wang
Additionally, IRTF could generate pseudo input regions for the REC task to enable a uniform way for sharing the identical representation space across the REC and REG.
1 code implementation • 23 May 2022 • Bo Yang, Fangxiang Feng, Xiaojie Wang
We also introduce a new metric Cross-Model Distance (CMD) for simultaneously evaluating image quality and image-text consistency.
no code implementations • 3 Apr 2022 • Yuxi Qian, Yuncong Hu, Ruonan Wang, Fangxiang Feng, Xiaojie Wang
It first models semantic, spatial, and implicit visual relations in images by three graph attention networks, then question information is utilized to guide the aggregation process of the three graphs, further, our QD-GFN adopts an object filtering mechanism to remove question-irrelevant objects contained in the image.
no code implementations • Findings (ACL) 2022 • Ruonan Wang, Yuxi Qian, Fangxiang Feng, Xiaojie Wang, Huixing Jiang
Most existing approaches to Visual Question Answering (VQA) answer questions directly, however, people usually decompose a complex question into a sequence of simple sub questions and finally obtain the answer to the original question after answering the sub question sequence(SQS).
1 code implementation • Findings (ACL) 2022 • Sai Zhang, Yuwei Hu, Yuchuan Wu, Jiaman Wu, Yongbin Li, Jian Sun, Caixia Yuan, Xiaojie Wang
We find some new linguistic phenomena and interactive manners in SSTOD which raise critical challenges of building dialog agents for the task.
Ranked #1 on SSTOD on SSD_NAME
1 code implementation • 16 Mar 2022 • Duo Zheng, Fandong Meng, Qingyi Si, Hairun Fan, Zipeng Xu, Jie zhou, Fangxiang Feng, Xiaojie Wang
Visual dialog has witnessed great progress after introducing various vision-oriented goals into the conversation, especially such as GuessWhich and GuessWhat, where the only image is visible by either and both of the questioner and the answerer, respectively.
no code implementations • 29 Oct 2021 • Yu Zhao, Jia Song, Huali Feng, Fuzhen Zhuang, Qing Li, Xiaojie Wang, Ji Liu
Keyphrase provides accurate information of document content that is highly compact, concise, full of meanings, and widely used for discourse comprehension, organization, and text retrieval.
1 code implementation • Findings (EMNLP) 2021 • Junpeng Liu, Yanyan Zou, Hainan Zhang, Hongshen Chen, Zhuoye Ding, Caixia Yuan, Xiaojie Wang
To capture the various topic information of a conversation and outline salient facts for the captured topics, this work proposes two topic-aware contrastive learning objectives, namely coherence detection and sub-summary generation objectives, which are expected to implicitly model the topic change and handle information scattering challenges for the dialogue summarization task.
Ranked #3 on Text Summarization on SAMSum
1 code implementation • Findings (EMNLP) 2021 • Duo Zheng, Zipeng Xu, Fandong Meng, Xiaojie Wang, Jiaan Wang, Jie zhou
To enhance VD Questioner: 1) we propose a Related entity enhanced Questioner (ReeQ) that generates questions under the guidance of related entities and learns entity-based questioning strategy from human dialogs; 2) we propose an Augmented Guesser (AugG) that is strong and is optimized for the VD setting especially.
1 code implementation • ACL 2021 • Ruifan Li, Hao Chen, Fangxiang Feng, Zhanyu Ma, Xiaojie Wang, Eduard Hovy
To overcome these challenges, in this paper, we propose a dual graph convolutional networks (DualGCN) model that considers the complementarity of syntax structures and semantic correlations simultaneously.
Aspect-Based Sentiment Analysis Aspect-Based Sentiment Analysis (ABSA) +2
1 code implementation • ACL 2021 • Tongtong Liu, Fangxiang Feng, Xiaojie Wang
Experimental results show that our method achieves comparable performance to the original LXMERT model in all downstream tasks, and even outperforms the original model in Image-Text Retrieval task.
1 code implementation • 12 Jul 2021 • Zipeng Xu, Fandong Meng, Xiaojie Wang, Duo Zheng, Chenxu Lv, Jie zhou
In Reinforcement Learning, it is crucial to represent states and assign rewards based on the action-caused transitions of states.
1 code implementation • 4 Feb 2021 • Han Liu, Caixia Yuan, Xiaojie Wang, Yushu Yang, Huixing Jiang, Zhongyuan Wang
We propose a novel task, Multi-Document Driven Dialogue (MD3), in which an agent can guess the target document that the user is interested in by leading a dialogue.
no code implementations • 15 Oct 2020 • Yuzhao Mao, Qi Sun, Guang Liu, Xiaojie Wang, Weiguo Gao, Xuan Li, Jianping Shen
Emotion Recognition in Conversations (ERC) is essential for building empathetic human-machine systems.
no code implementations • 15 Oct 2020 • Peng Lu, Jiahui Liu, Xujun Peng, Xiaojie Wang
In order to tackle this problem, a weakly supervised cropping frame- work is proposed, where the distribution dissimilarity between high quality images and cropped images is used to guide the coordinate predictor’s training and the ground truths of cropping windows are not required by the proposed method.
1 code implementation • 1 Oct 2020 • Zipeng Xu, Fangxiang Feng, Xiaojie Wang, Yushu Yang, Huixing Jiang, Zhongyuan Wang
In this paper, we propose an Answer-Driven Visual State Estimator (ADVSE) to impose the effects of different answers on visual states.
1 code implementation • 15 Aug 2020 • Han Liu, Caixia Yuan, Xiaojie Wang
A major challenge of multi-label text classification (MLTC) is to stimulatingly exploit possible label differences and label correlations.
Ranked #1 on Multi-Label Text Classification on AAPD (Micro F1 metric)
1 code implementation • ACL 2020 • Yu Zhao, Anxiang Zhang, Ruobing Xie, Kang Liu, Xiaojie Wang
In this paper, we propose a novel approach for KG entity typing which is trained by jointly utilizing local typing knowledge from existing entity type assertions and global triple knowledge from KGs.
1 code implementation • AAAI Technical Track: Vision 2020 • Xuan Dong, Weixin Li, Xiaojie Wang, Yunhong Wang
We present a new CNN model, named cycle CNN, which can directly use the real data from monochrome-color camera systems for training.
1 code implementation • ECCV 2020 • Wei Pang, Xiaojie Wang
This paper proposes a guessing state for the Guesser, and regards guess as a process with change of guessing state through a dialogue.
no code implementations • Neurocomputing 2020 • Ruifan Li, Haoyun Liang, Yihui Shi, Fangxiang Feng, Xiaojie Wang
Abstract The task of paragraph image captioning aims to generate a coherent paragraph describing a given image.
1 code implementation • 12 Nov 2019 • Wei Pang, Xiaojie Wang
A visual dialogue state is defined as the distribution on objects in the image as well as representations of objects.
no code implementations • CONLL 2019 • Jiayu Chen, Caixia Yuan, Xiaojie Wang, Ziwei Bai
This paper focuses on how to extract multiple relational facts from unstructured text.
1 code implementation • 31 Oct 2019 • Yue Ma, Xiaojie Wang, Zhenjiang Dong, Hong Chen
Dialogue embeddings are learned by a LSTM at the middle of the network, and updated by the feeding of all turn embeddings.
2 code implementations • Proceedings of the AAAI Conference on Artificial Intelligence 2019 • Xuan Dong, Weixin Li, Xiaojie Wang, Yunhong Wang
To get high-quality color images, it is desired to colorize the gray image with the color image as reference.
no code implementations • 1 Jun 2019 • Xiaojie Wang, Rui Zhang, Yu Sun, Jianzhong Qi
In recommender systems, usually the ratings of a user to most items are missing and a critical problem is that the missing ratings are often missing not at random (MNAR) in reality.
no code implementations • 24 May 2019 • Chenfei Wu, Yanzhao Zhou, Gen Li, Nan Duan, Duyu Tang, Xiaojie Wang
This paper presents a strong baseline for real-world visual reasoning (GQA), which achieves 60. 93% in GQA 2019 challenge and won the sixth place.
no code implementations • NeurIPS 2018 • Xiaojie Wang, Rui Zhang, Yu Sun, Jianzhong Qi
An alternative method is to adversarially train the classifier against a discriminator in a two-player game akin to generative adversarial networks (GAN), which can ensure the classifier to learn the true data distribution at the equilibrium of this game.
no code implementations • NeurIPS 2018 • Chenfei Wu, Jinlai Liu, Xiaojie Wang, Xuan Dong
A chain of reasoning (CoR) is constructed for supporting multi-step and dynamic reasoning on changed relations and objects.
no code implementations • 26 Dec 2013 • Peng Lu, Xujun Peng, Xinshan Zhu, Xiaojie Wang
To effectively retrieve objects from large corpus with high accuracy is a challenge task.
no code implementations • 4 Jul 2013 • Fangxiang Feng, Ruifan Li, Xiaojie Wang
This paper describes our solution to the multi-modal learning challenge of ICML.
11 code implementations • 1 Jul 2013 • Ian J. Goodfellow, Dumitru Erhan, Pierre Luc Carrier, Aaron Courville, Mehdi Mirza, Ben Hamner, Will Cukierski, Yichuan Tang, David Thaler, Dong-Hyun Lee, Yingbo Zhou, Chetan Ramaiah, Fangxiang Feng, Ruifan Li, Xiaojie Wang, Dimitris Athanasakis, John Shawe-Taylor, Maxim Milakov, John Park, Radu Ionescu, Marius Popescu, Cristian Grozea, James Bergstra, Jingjing Xie, Lukasz Romaszko, Bing Xu, Zhang Chuang, Yoshua Bengio
The ICML 2013 Workshop on Challenges in Representation Learning focused on three challenges: the black box learning challenge, the facial expression recognition challenge, and the multimodal learning challenge.
Ranked #12 on Facial Expression Recognition (FER) on FER2013