Search Results for author: Xun Wang

Found 47 papers, 20 papers with code

Early Prediction of Alzheimers Disease Leveraging Symptom Occurrences from Longitudinal Electronic Health Records of US Military Veterans

no code implementations23 Jul 2023 Rumeng Li, Xun Wang, Dan Berlowitz, Brian Silver, Wen Hu, Heather Keating, Raelene Goodwin, Weisong Liu, Honghuang Lin, Hong Yu

We used a panel of AD-related keywords and their occurrences over time in a patient's longitudinal EHRs as predictors for AD prediction with four machine learning models.

In-context Autoencoder for Context Compression in a Large Language Model

no code implementations13 Jul 2023 Tao Ge, Jing Hu, Xun Wang, Si-Qing Chen, Furu Wei

Our experimental results demonstrate that the ICAE learned with our proposed pretraining and fine-tuning paradigm can effectively produce memory slots with $4\times$ context compression, which can be well conditioned on by the target LLM to respond to various prompts.

Language Modelling Large Language Model +1

ODD: A Benchmark Dataset for the NLP-based Opioid Related Aberrant Behavior Detection

1 code implementation5 Jul 2023 Sunjae Kwon, Xun Wang, Weisong Liu, Emily Druhl, Minhee L. Sung, Joel I. Reisman, Wenjun Li, Robert D. Kerns, William Becker, Hong Yu

Experimental results show that the prompt-tuning models outperformed the finetuning models in most cateogories and the gains were especially higher among uncommon categories (Suggested aberrant behavior, Diagnosed opioid dependency and Medication change).

End-to-End Out-of-distribution Detection with Self-supervised Sampling

no code implementations2 Jul 2023 Sen Pei, Jiaxi Sun, Peng Qin, Qi Chen, Xinglong Wu, Xun Wang

Out-of-distribution (OOD) detection empowers the model trained on the closed set to identify unknown data in the open world.

Out-of-Distribution Detection Out of Distribution (OOD) Detection

Interactive Editing for Text Summarization

1 code implementation5 Jun 2023 Yujia Xie, Xun Wang, Si-Qing Chen, Wayne Xiong, Pengcheng He

Summarizing lengthy documents is a common and essential task in our daily lives.

Text Summarization

Smart Word Suggestions for Writing Assistance

1 code implementation17 May 2023 Chenshuo Wang, Shaoguang Mao, Tao Ge, Wenshan Wu, Xun Wang, Yan Xia, Jonathan Tien, Dongyan Zhao

The training dataset comprises over 3. 7 million sentences and 12. 7 million suggestions generated through rules.

An Evaluation on Large Language Model Outputs: Discourse and Memorization

no code implementations17 Apr 2023 Adrian de Wynter, Xun Wang, Alex Sokolov, Qilong Gu, Si-Qing Chen

We present an empirical evaluation of various outputs generated by nine of the most widely-available large language models (LLMs).

Language Modelling Large Language Model +1

Generalized Few-Shot Continual Learning with Contrastive Mixture of Adapters

1 code implementation12 Feb 2023 Yawen Cui, Zitong Yu, Rizhao Cai, Xun Wang, Alex C. Kot, Li Liu

The goal of Few-Shot Continual Learning (FSCL) is to incrementally learn novel tasks with limited labeled samples and preserve previous capabilities simultaneously, while current FSCL methods are all for the class-incremental purpose.

Continual Learning Contrastive Learning +2

Pay Attention to Your Tone: Introducing a New Dataset for Polite Language Rewrite

no code implementations20 Dec 2022 Xun Wang, Tao Ge, Allen Mao, Yuki Li, Furu Wei, Si-Qing Chen

We introduce \textsc{PoliteRewrite} -- a dataset for polite language rewrite which is a novel sentence rewrite task.

Style Transfer Text Style Transfer

Momentum Calibration for Text Generation

no code implementations8 Dec 2022 Xingxing Zhang, Yiran Liu, Xun Wang, Pengcheng He, Yang Yu, Si-Qing Chen, Wayne Xiong, Furu Wei

The input and output of most text generation tasks can be transformed to two sequences of tokens and they can be modeled using sequence-to-sequence learning modeling tools such as Transformers.

Abstractive Text Summarization Text Generation

Hierarchical Contrast for Unsupervised Skeleton-based Action Representation Learning

1 code implementation5 Dec 2022 Jianfeng Dong, Shengkai Sun, Zhonglin Liu, ShuJie Chen, Baolong Liu, Xun Wang

This paper targets unsupervised skeleton-based action representation learning and proposes a new Hierarchical Contrast (HiCo) framework.

Action Recognition Representation Learning +2

Extensible Prompts for Language Models

no code implementations1 Dec 2022 Tao Ge, Jing Hu, Li Dong, Shaoguang Mao, Yan Xia, Xun Wang, Si-Qing Chen, Furu Wei

We propose eXtensible Prompt (X-Prompt) for prompting a large language model (LLM) beyond natural language (NL).

Descriptive Language Modelling +1

Latent Prompt Tuning for Text Summarization

no code implementations3 Nov 2022 Yubo Zhang, Xingxing Zhang, Xun Wang, Si-Qing Chen, Furu Wei

In this paper, we propose Lotus (shorthand for Latent Prompt Tuning for Summarization), which is a single model that can be applied in both controlled and uncontrolled (without control signals) modes.

Contrastive Learning Text Summarization

Hypothesis Test Procedures for Detecting Leakage Signals in Water Pipeline Channels

no code implementations24 Oct 2022 Liusha Yang, Matthew R. McKay, Xun Wang

We design statistical hypothesis tests for performing leak detection in water pipeline channels.

Partially Relevant Video Retrieval

1 code implementation26 Aug 2022 Jianfeng Dong, Xianke Chen, Minsong Zhang, Xun Yang, ShuJie Chen, Xirong Li, Xun Wang

To fill the gap, we propose in this paper a novel T2VR subtask termed Partially Relevant Video Retrieval (PRVR).

 Ranked #1 on Partially Relevant Video Retrieval on Charades-STA (using extra training data)

Moment Retrieval Multiple Instance Learning +5

Cross-Lingual Cross-Modal Retrieval with Noise-Robust Learning

1 code implementation26 Aug 2022 Yabing Wang, Jianfeng Dong, Tianxiang Liang, Minsong Zhang, Rui Cai, Xun Wang

In this paper, we propose a noise-robust cross-lingual cross-modal retrieval method for low-resource languages.

Cross-Modal Retrieval Machine Translation +2

Modality-Balanced Embedding for Video Retrieval

no code implementations18 Apr 2022 Xun Wang, Bingqing Ke, Xuanping Li, Fangyu Liu, Mingyu Zhang, Xiao Liang, Qiushi Xiao, Cheng Luo, Yue Yu

This modality imbalanceresults from a) modality gap: the relevance between a query and a video text is much easier to learn as the query is also a piece of text, with the same modality as the video text; b) data bias: most training samples can be solved solely by text matching.

Retrieval Text Matching +1

Spatial Ensemble: a Novel Model Smoothing Mechanism for Student-Teacher Framework

1 code implementation NeurIPS 2021 Tengteng Huang, Yifan Sun, Xun Wang, Haotian Yao, Chi Zhang

Model smoothing is of central importance for obtaining a reliable teacher model in the student-teacher framework, where the teacher generates surrogate supervision signals to train the student.


Learning to Persuade

no code implementations29 Sep 2021 Xiaodong Liu, Zhikang Fan, Xun Wang, Weiran Shen

Then we update the sender model to obtain an approximately optimal scheme using the receiver model.

Combining Graph Neural Networks with Expert Knowledge for Smart Contract Vulnerability Detection

1 code implementation24 Jul 2021 Zhenguang Liu, Peng Qian, Xiaoyang Wang, Yuan Zhuang, Lin Qiu, Xun Wang

Then, we propose a novel temporal message propagation network to extract the graph feature from the normalized graph, and combine the graph feature with designed expert patterns to yield a final detection system.

Vulnerability Detection

Multi-scale super-resolution generation of low-resolution scanned pathological images

1 code implementation15 May 2021 Kai Sun, Yanhua Gao, Ting Xie, Xun Wang, Qingqing Yang, Le Chen, Kuansong Wang, Gang Yu

We design a strategy to scan slides with low resolution (5X) and a super-resolution method is proposed to restore the image details when in diagnosis.

SSIM Super-Resolution

Rethinking Deep Contrastive Learning with Embedding Memory

no code implementations25 Mar 2021 Haozhi Zhang, Xun Wang, Weilin Huang, Matthew R. Scott

Pair-wise loss functions have been extensively studied and shown to continuously improve the performance of deep metric learning (DML).

Contrastive Learning Metric Learning +1

Progressive Localization Networks for Language-based Moment Localization

no code implementations2 Feb 2021 Qi Zheng, Jianfeng Dong, Xiaoye Qu, Xun Yang, Yabing Wang, Pan Zhou, Baolong Liu, Xun Wang

The language-based setting of this task allows for an open set of target activities, resulting in a large variation of the temporal lengths of video moments.

Dual Encoding for Video Retrieval by Text

1 code implementation10 Sep 2020 Jianfeng Dong, Xirong Li, Chaoxi Xu, Xun Yang, Gang Yang, Xun Wang, Meng Wang

In this paper we achieve this by proposing a dual deep encoding network that encodes videos and queries into powerful dense representations of their own.

Ranked #3 on Ad-hoc video search on TRECVID-AVS16 (IACC.3) (using extra training data)

Ad-hoc video search Retrieval +1

Tree-Augmented Cross-Modal Encoding for Complex-Query Video Retrieval

no code implementations6 Jul 2020 Xun Yang, Jianfeng Dong, Yixin Cao, Xun Wang, Meng Wang, Tat-Seng Chua

To facilitate video retrieval with complex queries, we propose a Tree-augmented Cross-modal Encoding method by jointly learning the linguistic structure of queries and the temporal representation of videos.

Retrieval Video Retrieval

Anisotropy links cell shapes to tissue flow during convergent extension

no code implementations14 May 2020 Xun Wang, Matthias Merkel, Leo B. Sutter, Gonca Erdemci-Tandogan, M. Lisa Manning, Karen E. Kasza

Within developing embryos, tissues flow and reorganize dramatically on timescales as short as minutes.

Feature Re-Learning with Data Augmentation for Video Relevance Prediction

1 code implementation8 Apr 2020 Jianfeng Dong, Xun Wang, Leimin Zhang, Chaoxi Xu, Gang Yang, Xirong Li

Predicting the relevance between two given videos with respect to their visual content is a key component for content-based video recommendation and retrieval.

Data Augmentation Retrieval

Channel Interaction Networks for Fine-Grained Image Categorization

no code implementations AAAI-2020 2020 Yu Gao, Xintong Han, Xun Wang, Weilin Huang, Matthew R. Scott

Fine-grained image categorization is challenging due to the subtle inter-class differences. We posit that exploiting the rich relationships between channels can help capture such differences since different channels correspond to different semantics.

Image Categorization Metric Learning

Cross-Batch Memory for Embedding Learning

4 code implementations CVPR 2020 Xun Wang, Haozhi Zhang, Weilin Huang, Matthew R. Scott

This suggests that the features of instances computed at preceding iterations can be used to considerably approximate their features extracted by the current model.

Image Retrieval Metric Learning +1

HAL: Improved Text-Image Matching by Mitigating Visual Semantic Hubs

1 code implementation22 Nov 2019 Fangyu Liu, Rongtian Ye, Xun Wang, Shuaipeng Li

The hubness problem widely exists in high-dimensional embedding space and is a fundamental source of error for cross-modal matching tasks.

Multi-Similarity Loss with General Pair Weighting for Deep Metric Learning

2 code implementations CVPR 2019 Xun Wang, Xintong Han, Weilin Huang, Dengke Dong, Matthew R. Scott

A family of loss functions built on pair-based computation have been proposed in the literature which provide a myriad of solutions for deep metric learning.

Image Retrieval Metric Learning +1

Modeling Word Relatedness in Latent Dirichlet Allocation

no code implementations10 Nov 2014 Xun Wang

Standard LDA model suffers the problem that the topic assignment of each word is independent and word correlation hence is neglected.

Topic Models

What a Nasty day: Exploring Mood-Weather Relationship from Twitter

no code implementations30 Oct 2014 Jiwei Li, Xun Wang, Eduard Hovy

While it has long been believed in psychology that weather somehow influences human's mood, the debates have been going on for decades about how they are correlated.

Time-dependent Hierarchical Dirichlet Model for Timeline Generation

no code implementations8 Dec 2013 Rumeng Li, Tao Wang, Xun Wang

Existing approaches neglect such hierarchical topic structure involved in the news corpus in timeline generation.

Cannot find the paper you are looking for? You can Submit a new open access paper.