Search Results for author: Xun Yang

Found 32 papers, 13 papers with code

Enhancing One-Shot Federated Learning Through Data and Ensemble Co-Boosting

1 code implementation23 Feb 2024 Rong Dai, Yonggang Zhang, Ang Li, Tongliang Liu, Xun Yang, Bo Han

These hard samples are then employed to promote the quality of the ensemble model by adjusting the ensembling weights for each client model.

Federated Learning

Finding and Editing Multi-Modal Neurons in Pre-Trained Transformer

no code implementations13 Nov 2023 Haowen Pan, Yixin Cao, Xiaozhi Wang, Xun Yang

Multi-modal large language models (LLM) have achieved powerful capabilities for visual semantic understanding in recent years.

knowledge editing

Unified Multi-modal Unsupervised Representation Learning for Skeleton-based Action Understanding

1 code implementation6 Nov 2023 Shengkai Sun, Daizong Liu, Jianfeng Dong, Xiaoye Qu, Junyu Gao, Xun Yang, Xun Wang, Meng Wang

In this manner, our framework is able to learn the unified representations of uni-modal or multi-modal skeleton input, which is flexible to different kinds of modality input for robust action understanding in practical cases.

Action Understanding Representation Learning +1

Exploring Sparse Spatial Relation in Graph Inference for Text-Based VQA

no code implementations13 Oct 2023 Sheng Zhou, Dan Guo, Jia Li, Xun Yang, Meng Wang

The associations between these repetitive objects are superfluous for answer reasoning; (2) two spatially distant OCR tokens detected in the image frequently have weak semantic dependencies for answer reasoning; and (3) the co-existence of nearby objects and tokens may be indicative of important visual cues for predicting answers.

Graph Learning Object +5

Towards Complex-query Referring Image Segmentation: A Novel Benchmark

no code implementations29 Sep 2023 Wei Ji, Li Li, Hao Fei, Xiangyan Liu, Xun Yang, Juncheng Li, Roger Zimmermann

Referring Image Understanding (RIS) has been extensively studied over the past decade, leading to the development of advanced algorithms.

Image Segmentation Semantic Segmentation

From Region to Patch: Attribute-Aware Foreground-Background Contrastive Learning for Fine-Grained Fashion Retrieval

1 code implementation17 May 2023 Jianfeng Dong, Xiaoman Peng, Zhe Ma, Daizong Liu, Xiaoye Qu, Xun Yang, Jixiang Zhu, Baolong Liu

As the attribute-specific similarity typically corresponds to the specific subtle regions of images, we propose a Region-to-Patch Framework (RPF) that consists of a region-aware branch and a patch-aware branch to extract fine-grained attribute-related visual features for precise retrieval in a coarse-to-fine manner.

Attribute Contrastive Learning +2

Domain Generalized Stereo Matching via Hierarchical Visual Transformation

no code implementations CVPR 2023 Tianyu Chang, Xun Yang, Tianzhu Zhang, Meng Wang

In this way, we can prevent the model from exploiting the artifacts of synthetic stereo images as shortcut features, thereby estimating the disparity maps more effectively based on the learned robust and shortcut-invariant representation.

Domain Generalization Stereo Matching

Efficient Cross-Modal Video Retrieval with Meta-Optimized Frames

1 code implementation16 Oct 2022 Ning Han, Xun Yang, Ee-Peng Lim, Hao Chen, Qianru Sun

In turn, the frame-level optimization is through gradient descent using the meta loss of video retrieval model computed on the whole video.

Bilevel Optimization Retrieval +2

Self-supervised Graph Learning for Long-tailed Cognitive Diagnosis

no code implementations15 Oct 2022 Shanshan Wang, Zhen Zeng, Xun Yang, Xingyi Zhang

Cognitive diagnosis is a fundamental yet critical research task in the field of intelligent education, which aims to discover the proficiency level of different students on specific knowledge concepts.

cognitive diagnosis Graph Learning

Partially Relevant Video Retrieval

1 code implementation26 Aug 2022 Jianfeng Dong, Xianke Chen, Minsong Zhang, Xun Yang, ShuJie Chen, Xirong Li, Xun Wang

To fill the gap, we propose in this paper a novel T2VR subtask termed Partially Relevant Video Retrieval (PRVR).

Moment Retrieval Multiple Instance Learning +5

Mitigating Hidden Confounding Effects for Causal Recommendation

no code implementations16 May 2022 Xinyuan Zhu, Yang Zhang, Fuli Feng, Xun Yang, Dingxian Wang, Xiangnan He

Towards this goal, we propose a Hidden Confounder Removal (HCR) framework that leverages front-door adjustment to decompose the causal effect into two partial effects, according to the mediators between item features and user feedback.

Multi-Task Learning Recommendation Systems

Impression Allocation and Policy Search in Display Advertising

no code implementations11 Mar 2022 Di wu, Cheng Chen, Xiujun Chen, Junwei Pan, Xun Yang, Qing Tan, Jian Xu, Kuang-Chih Lee

In order to address the unstable traffic pattern challenge and achieve the optimal overall outcome, we propose a multi-agent reinforcement learning method to adjust the bids from each guaranteed contract, which is simple, converging efficiently and scalable.

Multi-agent Reinforcement Learning

Modeling Field-level Factor Interactions for Fashion Recommendation

no code implementations7 Mar 2022 Yujuan Ding, P. Y. Mok, Xun Yang, Yanghong Zhou

Personalized fashion recommendation aims to explore patterns from historical interactions between users and fashion items and thereby predict the future ones.

Joint transmit and reflective beamforming for IRS-assisted integrated sensing and communication

no code implementations26 Nov 2021 Xianxin Song, Ding Zhao, Haocheng Hua, Tony Xiao Han, Xun Yang, Jie Xu

This paper studies an intelligent reflecting surface (IRS)-assisted integrated sensing and communication (ISAC) system, in which one IRS is deployed to not only assist the wireless communication from a multi-antenna base station (BS) to a single-antenna communication user (CU), but also create virtual line-of-sight (LoS) links for sensing targets at areas with LoS links blocked.

Deconfounded Video Moment Retrieval with Causal Intervention

1 code implementation3 Jun 2021 Xun Yang, Fuli Feng, Wei Ji, Meng Wang, Tat-Seng Chua

To fill the research gap, we propose a causality-inspired VMR framework that builds structural causal model to capture the true effect of query and video content on the prediction.

Moment Retrieval Retrieval

Reproducibility Companion Paper: Knowledge Enhanced Neural Fashion Trend Forecasting

1 code implementation25 May 2021 Yunshan Ma, Yujuan Ding, Xun Yang, Lizi Liao, Wai Keung Wong, Tat-Seng Chua, Jinyoung Moon, Hong-Han Shuai

This companion paper supports the replication of the fashion trend forecasting experiments with the KERN (Knowledge Enhanced Recurrent Network) method that we presented in the ICMR 2020.

Fine-Grained Fashion Similarity Prediction by Attribute-Specific Embedding Learning

1 code implementation6 Apr 2021 Jianfeng Dong, Zhe Ma, Xiaofeng Mao, Xun Yang, Yuan He, Richang Hong, Shouling Ji

In this similarity paradigm, one should pay more attention to the similarity in terms of a specific design/attribute between fashion items.

Attribute

Computation Resource Allocation Solution in Recommender Systems

no code implementations3 Mar 2021 Xun Yang, Yunli Wang, Cheng Chen, Qing Tan, Chuan Yu, Jian Xu, Xiaoqiang Zhu

On the other hand, the response time of these systems is strictly limited to a short period, e. g. 300 milliseconds in our real system, which is also being exhausted by the increasingly complex models and algorithms.

Recommendation Systems

Progressive Localization Networks for Language-based Moment Localization

no code implementations2 Feb 2021 Qi Zheng, Jianfeng Dong, Xiaoye Qu, Xun Yang, Yabing Wang, Pan Zhou, Baolong Liu, Xun Wang

The language-based setting of this task allows for an open set of target activities, resulting in a large variation of the temporal lengths of video moments.

Dual Encoding for Video Retrieval by Text

1 code implementation10 Sep 2020 Jianfeng Dong, Xirong Li, Chaoxi Xu, Xun Yang, Gang Yang, Xun Wang, Meng Wang

In this paper we achieve this by proposing a dual deep encoding network that encodes videos and queries into powerful dense representations of their own.

Ranked #3 on Ad-hoc video search on TRECVID-AVS16 (IACC.3) (using extra training data)

Ad-hoc video search Retrieval +2

Tree-Augmented Cross-Modal Encoding for Complex-Query Video Retrieval

no code implementations6 Jul 2020 Xun Yang, Jianfeng Dong, Yixin Cao, Xun Wang, Meng Wang, Tat-Seng Chua

To facilitate video retrieval with complex queries, we propose a Tree-augmented Cross-modal Encoding method by jointly learning the linguistic structure of queries and the temporal representation of videos.

Retrieval Video Retrieval

Knowledge Enhanced Neural Fashion Trend Forecasting

1 code implementation7 May 2020 Yunshan Ma, Yujuan Ding, Xun Yang, Lizi Liao, Wai Keung Wong, Tat-Seng Chua

Further-more, to effectively model the time series data of fashion elements with rather complex patterns, we propose a Knowledge EnhancedRecurrent Network model (KERN) which takes advantage of the capability of deep recurrent neural networks in modeling time-series data.

Time Series Time Series Analysis

Who, Where, and What to Wear? Extracting Fashion Knowledge from Social Media

no code implementations12 Aug 2019 Yunshan Ma, Xun Yang, Lizi Liao, Yixin Cao, Tat-Seng Chua

We unify three tasks of occasion, person and clothing discovery from multiple modalities of images, texts and metadata.

Human Detection

Deep Conversational Recommender in Travel

no code implementations25 Jun 2019 Lizi Liao, Ryuichi Takanobu, Yunshan Ma, Xun Yang, Minlie Huang, Tat-Seng Chua

When traveling to a foreign country, we are often in dire need of an intelligent conversational agent to provide instant and informative responses to our various queries.

Response Generation

Person Re-identification with Metric Learning using Privileged Information

no code implementations10 Apr 2019 Xun Yang, Meng Wang, DaCheng Tao

We jointly learn two distance metrics by minimizing the empirical loss penalizing the difference between the distance in the original space and that in the privileged space.

Decision Making Metric Learning +1

A Multi-Agent Reinforcement Learning Method for Impression Allocation in Online Display Advertising

no code implementations10 Sep 2018 Di Wu, Cheng Chen, Xun Yang, Xiujun Chen, Qing Tan, Jian Xu, Kun Gai

With this formulation, we derive the optimal impression allocation strategy by solving the optimal bidding functions for contracts.

Multi-agent Reinforcement Learning reinforcement-learning +1

Budget Constrained Bidding by Model-free Reinforcement Learning in Display Advertising

no code implementations23 Feb 2018 Di Wu, Xiujun Chen, Xun Yang, Hao Wang, Qing Tan, Xiaoxun Zhang, Jian Xu, Kun Gai

Our analysis shows that the immediate reward from environment is misleading under a critical resource constraint.

Marketing reinforcement-learning +1

Enhancing Person Re-identification in a Self-trained Subspace

1 code implementation20 Apr 2017 Xun Yang, Meng Wang, Richang Hong, Qi Tian, Yong Rui

To address this problem, in this paper, we propose a self-trained subspace learning paradigm for person re-ID which effectively utilizes both labeled and unlabeled data to learn a discriminative subspace where person images across disjoint camera views can be easily matched.

Person Re-Identification

On the Pricing of Storable Commodities

no code implementations21 Jul 2013 Dorje C. Brody, Lane P. Hughston, Xun Yang

The price of a commodity is the expectation under a suitable pricing measure of the totality of the discounted risk-adjusted future convenience dividend, conditional on the information provided by the market filtration.

Cannot find the paper you are looking for? You can Submit a new open access paper.