Search Results for author: Xiaoyang Wang

Found 51 papers, 17 papers with code

An ExplainableFair Framework for Prediction of Substance Use Disorder Treatment Completion

no code implementations4 Apr 2024 Mary M. Lucas, Xiaoyang Wang, Chia-Hsuan Chang, Christopher C. Yang, Jacqueline E. Braughton, Quyen M. Ngo

Fairness of machine learning models in healthcare has drawn increasing attention from clinicians, researchers, and even at the highest level of government.

Decision Making Explainable Models +1

Polarity Calibration for Opinion Summarization

1 code implementation2 Apr 2024 Yuanyuan Lei, Kaiqiang Song, Sangwoo Cho, Xiaoyang Wang, Ruihong Huang, Dong Yu

To address this issue and make the summarizer express both sides of opinions, we introduce the concept of polarity calibration, which aims to align the polarity of output summary with that of input text.

Opinion Summarization

Towards the Uncharted: Density-Descending Feature Perturbation for Semi-supervised Semantic Segmentation

no code implementations11 Mar 2024 Xiaoyang Wang, Huihui Bai, Limin Yu, Yao Zhao, Jimin Xiao

Inspired by the low-density separation assumption in semi-supervised learning, our key insight is that feature density can shed a light on the most promising direction for the segmentation classifier to explore, which is the regions with lower density.

Semi-Supervised Semantic Segmentation

Can Large Language Models do Analytical Reasoning?

no code implementations6 Mar 2024 Yebowen Hu, Kaiqiang Song, Sangwoo Cho, Xiaoyang Wang, Hassan Foroosh, Dong Yu, Fei Liu

Our analytical reasoning embodies the tasks of letting large language models count how many points each team scores in a quarter in the NBA and NFL games.

Language Modelling Large Language Model

Continual Segmentation with Disentangled Objectness Learning and Class Recognition

no code implementations6 Mar 2024 Yizheng Gong, Siyue Yu, Xiaoyang Wang, Jimin Xiao

Based on these findings, we propose CoMasTRe by disentangling continual segmentation into two stages: forgetting-resistant continual objectness learning and well-researched continual classification.

Continual Learning Segmentation

SportsMetrics: Blending Text and Numerical Data to Understand Information Fusion in LLMs

no code implementations15 Feb 2024 Yebowen Hu, Kaiqiang Song, Sangwoo Cho, Xiaoyang Wang, Hassan Foroosh, Dong Yu, Fei Liu

In this paper, we introduce four novel tasks centered around sports data analytics to evaluate the numerical reasoning and information fusion capabilities of LLMs.

SPECTRUM: Speaker-Enhanced Pre-Training for Long Dialogue Summarization

no code implementations31 Jan 2024 Sangwoo Cho, Kaiqiang Song, Chao Zhao, Xiaoyang Wang, Dong Yu

Multi-turn dialogues are characterized by their extended length and the presence of turn-taking conversations.

Language Modelling Large Language Model

FedCore: Straggler-Free Federated Learning with Distributed Coresets

1 code implementation31 Jan 2024 Hongpeng Guo, Haotian Gu, Xiaoyang Wang, Bo Chen, Eun Kyung Lee, Tamar Eilam, Deming Chen, Klara Nahrstedt

Federated learning (FL) is a machine learning paradigm that allows multiple clients to collaboratively train a shared model while keeping their data on-premise.

Federated Learning

SFC: Shared Feature Calibration in Weakly Supervised Semantic Segmentation

1 code implementation22 Jan 2024 Xinqiao Zhao, Feilong Tang, Xiaoyang Wang, Jimin Xiao

Specifically, we leverage the class prototypes that carry positive shared features and propose a Multi-Scaled Distribution-Weighted (MSDW) consistency loss for narrowing the gap between the CAMs generated through classifier weights and class prototypes during training.

Pseudo Label Segmentation +2

InFoBench: Evaluating Instruction Following Ability in Large Language Models

1 code implementation7 Jan 2024 Yiwei Qin, Kaiqiang Song, Yebowen Hu, Wenlin Yao, Sangwoo Cho, Xiaoyang Wang, Xuansheng Wu, Fei Liu, PengFei Liu, Dong Yu

This paper introduces the Decomposed Requirements Following Ratio (DRFR), a new metric for evaluating Large Language Models' (LLMs) ability to follow instructions.

Instruction Following

Zebra: Extending Context Window with Layerwise Grouped Local-Global Attention

no code implementations14 Dec 2023 Kaiqiang Song, Xiaoyang Wang, Sangwoo Cho, Xiaoman Pan, Dong Yu

This paper introduces a novel approach to enhance the capabilities of Large Language Models (LLMs) in processing and understanding extensive text sequences, a critical aspect in applications requiring deep comprehension and synthesis of large volumes of information.

MMC: Advancing Multimodal Chart Understanding with Large-scale Instruction Tuning

3 code implementations15 Nov 2023 Fuxiao Liu, Xiaoyang Wang, Wenlin Yao, Jianshu Chen, Kaiqiang Song, Sangwoo Cho, Yaser Yacoob, Dong Yu

Recognizing the need for a comprehensive evaluation of LMM chart understanding, we also propose a MultiModal Chart Benchmark (MMC-Benchmark), a comprehensive human-annotated benchmark with 9 distinct tasks evaluating reasoning capabilities over charts.

Unsupervised Multi-document Summarization with Holistic Inference

no code implementations8 Sep 2023 Haopeng Zhang, Sangwoo Cho, Kaiqiang Song, Xiaoyang Wang, Hongwei Wang, Jiawei Zhang, Dong Yu

SRI balances the importance and diversity of a subset of sentences from the source documents and can be calculated in unsupervised and adaptive manners.

Document Summarization Extractive Summarization +1

Skills-in-Context Prompting: Unlocking Compositionality in Large Language Models

no code implementations1 Aug 2023 Jiaao Chen, Xiaoman Pan, Dian Yu, Kaiqiang Song, Xiaoyang Wang, Dong Yu, Jianshu Chen

Compositional generalization empowers the LLMs to solve problems that are harder than the ones they have seen (i. e., easy-to-hard generalization), which is a critical reasoning capability of human-like intelligence.

Math Math Word Problem Solving

Pretrained Language Model based Web Search Ranking: From Relevance to Satisfaction

no code implementations2 Jun 2023 Canjia Li, Xiaoyang Wang, Dongdong Li, Yiding Liu, Yu Lu, Shuaiqiang Wang, Zhicong Cheng, Simiu Gu, Dawei Yin

In this work, we focus on ranking user satisfaction rather than relevance in web search, and propose a PLM-based framework, namely SAT-Ranker, which comprehensively models different dimensions of user satisfaction in a unified manner.

Language Modelling

DecipherPref: Analyzing Influential Factors in Human Preference Judgments via GPT-4

no code implementations24 May 2023 Yebowen Hu, Kaiqiang Song, Sangwoo Cho, Xiaoyang Wang, Hassan Foroosh, Fei Liu

Human preference judgments are pivotal in guiding large language models (LLMs) to produce outputs that align with human values.

Informativeness

Streamlining Multimodal Data Fusion in Wireless Communication and Sensor Networks

no code implementations24 Feb 2023 Mohammud J. Bocus, Xiaoyang Wang, Robert. J. Piechocki

This paper presents a novel approach for multimodal data fusion based on the Vector-Quantized Variational Autoencoder (VQVAE) architecture.

FastRecon: Few-shot Industrial Anomaly Detection via Fast Feature Reconstruction

no code implementations ICCV 2023 Zheng Fang, Xiaoyang Wang, Haocheng Li, Jiejie Liu, Qiugui Hu, Jimin Xiao

In this paper, we propose a few-shot anomaly detection strategy that works in a low-data regime and can generalize across products at no cost.

Anomaly Detection

Hunting Sparsity: Density-Guided Contrastive Learning for Semi-Supervised Semantic Segmentation

1 code implementation CVPR 2023 Xiaoyang Wang, Bingfeng Zhang, Limin Yu, Jimin Xiao

Inspired by density-based unsupervised clustering, we propose to leverage feature density to locate sparse regions within feature clusters defined by label and pseudo labels.

Contrastive Learning Density Estimation +1

OASum: Large-Scale Open Domain Aspect-based Summarization

1 code implementation19 Dec 2022 Xianjun Yang, Kaiqiang Song, Sangwoo Cho, Xiaoyang Wang, Xiaoman Pan, Linda Petzold, Dong Yu

Specifically, zero/few-shot and fine-tuning results show that the model pre-trained on our corpus demonstrates a strong aspect or query-focused generation ability compared with the backbone model.

Salience Allocation as Guidance for Abstractive Summarization

1 code implementation22 Oct 2022 Fei Wang, Kaiqiang Song, Hongming Zhang, Lifeng Jin, Sangwoo Cho, Wenlin Yao, Xiaoyang Wang, Muhao Chen, Dong Yu

Recent literature adds extractive summaries as guidance for abstractive summarization models to provide hints of salient content and achieves better performance.

Abstractive Text Summarization

Z-LaVI: Zero-Shot Language Solver Fueled by Visual Imagination

1 code implementation21 Oct 2022 Yue Yang, Wenlin Yao, Hongming Zhang, Xiaoyang Wang, Dong Yu, Jianshu Chen

Large-scale pretrained language models have made significant advances in solving downstream language understanding tasks.

Language Modelling Retrieval +2

Invariant Aggregator for Defending against Federated Backdoor Attacks

no code implementations4 Oct 2022 Xiaoyang Wang, Dimitrios Dimitriadis, Sanmi Koyejo, Shruti Tople

Federated learning enables training high-utility models across several clients without directly sharing their private data.

Federated Learning Model Optimization

Federated Meta-Learning for Traffic Steering in O-RAN

no code implementations13 Sep 2022 Hakan Erdol, Xiaoyang Wang, Peizheng Li, Jonathan D. Thomas, Robert Piechocki, George Oikonomou, Rui Inacio, Abdelrahim Ahmad, Keith Briggs, Shipra Kapoor

In order to provide such services, 5G systems will support various combinations of access technologies such as LTE, NR, NR-U and Wi-Fi.

Management Meta-Learning

Multimodal sensor fusion in the latent representation space

no code implementations3 Aug 2022 Robert J. Piechocki, Xiaoyang Wang, Mohammud J. Bocus

In the second stage, the generative model serves as a reconstruction prior and the search manifold for the sensor fusion tasks.

Denoising Sensor Fusion

Sim2real for Reinforcement Learning Driven Next Generation Networks

no code implementations8 Jun 2022 Peizheng Li, Jonathan Thomas, Xiaoyang Wang, Hakan Erdol, Abdelrahim Ahmad, Rui Inacio, Shipra Kapoor, Arjun Parekh, Angela Doufexi, Arman Shojaeifard, Robert Piechocki

One of the main reasons is the modelling gap between the simulation and the real environment, which could make the RL agent trained by simulation ill-equipped for the real environment.

Data Interaction reinforcement-learning +1

RLOps: Development Life-cycle of Reinforcement Learning Aided Open RAN

no code implementations12 Nov 2021 Peizheng Li, Jonathan Thomas, Xiaoyang Wang, Ahmed Khalil, Abdelrahim Ahmad, Rui Inacio, Shipra Kapoor, Arjun Parekh, Angela Doufexi, Arman Shojaeifard, Robert Piechocki

We provide a taxonomy for the challenges faced by ML/RL models throughout the development life-cycle: from the system specification to production deployment (data acquisition, model design, testing and management, etc.).

Management reinforcement-learning +1

Robust and Personalized Federated Learning with Spurious Features: an Adversarial Approach

no code implementations29 Sep 2021 Xiaoyang Wang, Han Zhao, Klara Nahrstedt, Oluwasanmi O Koyejo

To this end, we propose a strategy to mitigate the effect of spurious features based on our observation that the global model in the federated learning step has a low accuracy disparity due to statistical heterogeneity.

Personalized Federated Learning

AppQ: Warm-starting App Recommendation Based on View Graphs

no code implementations8 Sep 2021 Dan Su, Jiqiang Liu, Sencun Zhu, Xiaoyang Wang, Wei Wang, Xiangliang Zhang

In this work, we propose AppQ, a novel app quality grading and recommendation system that extracts inborn features of apps based on app source code.

Recommendation Systems

Combining Graph Neural Networks with Expert Knowledge for Smart Contract Vulnerability Detection

1 code implementation24 Jul 2021 Zhenguang Liu, Peng Qian, Xiaoyang Wang, Yuan Zhuang, Lin Qiu, Xun Wang

Then, we propose a novel temporal message propagation network to extract the graph feature from the normalized graph, and combine the graph feature with designed expert patterns to yield a final detection system.

Vulnerability Detection

Self-play Learning Strategies for Resource Assignment in Open-RAN Networks

no code implementations3 Mar 2021 Xiaoyang Wang, Jonathan D Thomas, Robert J Piechocki, Shipra Kapoor, Raul Santos-Rodriguez, Arjun Parekh

Open Radio Access Network (ORAN) is being developed with an aim to democratise access and lower the cost of future mobile data networks, supporting network services with various QoS requirements, such as massive IoT and URLLC.

Edge-computing Management

NaturalConv: A Chinese Dialogue Dataset Towards Multi-turn Topic-driven Conversation

no code implementations3 Mar 2021 Xiaoyang Wang, Chen Li, Jianqiao Zhao, Dong Yu

To facilitate the research on this corpus, we provide results of several benchmark models.

Robusta: Robust AutoML for Feature Selection via Reinforcement Learning

no code implementations15 Jan 2021 Xiaoyang Wang, Bo Li, Yibo Zhang, Bhavya Kailkhura, Klara Nahrstedt

However, these AutoML pipelines only focus on improving the learning accuracy of benign samples while ignoring the ML model robustness under adversarial attacks.

AutoML Feature Importance +3

Identifying Coarse-grained Independent Causal Mechanisms with Self-supervision

1 code implementation 1st Conference on Causal Learning and Reasoning 2022 Xiaoyang Wang, Klara Nahrstedt, Oluwasanmi O Koyejo

Current approaches for learning disentangled representations assume that independent latent variables generate the data through a single data generation process.

Automatic Summarization of Open-Domain Podcast Episodes

no code implementations9 Nov 2020 Kaiqiang Song, Chen Li, Xiaoyang Wang, Dong Yu, Fei Liu

Instead, we investigate several less-studied aspects of neural abstractive summarization, including (i) the importance of selecting important segments from transcripts to serve as input to the summarizer; (ii) striking a balance between the amount and quality of training instances; (iii) the appropriate summary length and start/end points.

Abstractive Text Summarization

Graph Neural Network for Fraud Detection via Spatial-Temporal Attention

1 code implementation TKDE 2020 Dawei Cheng, Xiaoyang Wang, Ying Zhang, Liqing Zhang

But manually generating features needs domain knowledge and may lay behind the modus operandi of fraud, which means we need to automatically focus on the most relevant fraudulent behavior patterns in the online detection system.

Fraud Detection

Lipschitz Learning for Signal Recovery

no code implementations4 Oct 2019 Hong Jiang, Jong-Hoon Ahn, Xiaoyang Wang

We will develop a theoretical framework to characterize the signals that can be robustly recovered from their observations by an ML algorithm, and establish a Lipschitz condition on signals and observations that is both necessary and sufficient for the existence of a robust recovery.

Compressive Sensing

STA: Spatial-Temporal Attention for Large-Scale Video-based Person Re-Identification

no code implementations9 Nov 2018 Yang Fu, Xiaoyang Wang, Yunchao Wei, Thomas Huang

Thus, a more robust clip-level feature representation can be generated according to a weighted sum operation guided by the mined 2-D attention score matrix.

Large-Scale Person Re-Identification Video-Based Person Re-Identification

Request-and-Reverify: Hierarchical Hypothesis Testing for Concept Drift Detection with Expensive Labels

no code implementations25 Jun 2018 Shujian Yu, Xiaoyang Wang, Jose C. Principe

In this paper, a novel Hierarchical Hypothesis Testing framework with Request-and-Reverify strategy is developed to detect concept drifts by requesting labels only when necessary.

Attribute General Classification +1

Video Event Recognition With Deep Hierarchical Context Model

no code implementations CVPR 2015 Xiaoyang Wang, Qiang Ji

Video event recognition still faces great challenges due to large intra-class variation and low image resolution, in particular for surveillance videos.

Cannot find the paper you are looking for? You can Submit a new open access paper.