Search Results for author: Ming Yin

Found 45 papers, 5 papers with code

基于自动识别的委婉语历时性发展变化与社会共变研究(A Study on the Diachronic Development and Social Covariance of Euphemism Based on Automatic Recognition)

no code implementations CCL 2021 Chenlin Zhang, Mingwen Wang, Yiming Tan, Ming Yin, Xinyi Zhang

“本文主要以汉语委婉语作为研究对象, 基于大量人工标注, 借助机器学习有监督分类方法, 实现了较高精度的委婉语自动识别, 并基于此对1946年-2017年的《人民日报》中的委婉语历时变化发展情况进行量化统计分析。从大规模数据的角度探讨委婉语历时性发展变化、委婉语与社会之间的共变关系, 验证了语言的格雷什姆规律与更新规律。”

A Theoretical Perspective for Speculative Decoding Algorithm

no code implementations30 Oct 2024 Ming Yin, Minshuo Chen, Kaixuan Huang, Mengdi Wang

Transformer-based autoregressive sampling has been the major bottleneck for slowing down large language model inferences.

Language Modelling Large Language Model

NetworkGym: Reinforcement Learning Environments for Multi-Access Traffic Management in Network Simulation

no code implementations30 Oct 2024 Momin Haider, Ming Yin, Menglei Zhang, Arpit Gupta, Jing Zhu, Yu-Xiang Wang

Mobile devices such as smartphones, laptops, and tablets can often connect to multiple access networks (e. g., Wi-Fi, LTE, and 5G) simultaneously.

D4RL Management +1

Fast Best-of-N Decoding via Speculative Rejection

1 code implementation26 Oct 2024 Hanshi Sun, Momin Haider, Ruiqi Zhang, Huitao Yang, Jiahao Qiu, Ming Yin, Mengdi Wang, Peter Bartlett, Andrea Zanette

The safe and effective deployment of Large Language Models (LLMs) involves a critical step called alignment, which ensures that the model's responses are in accordance with human preferences.

How Does the Disclosure of AI Assistance Affect the Perceptions of Writing?

no code implementations6 Oct 2024 Zhuoyan Li, Chen Liang, Jing Peng, Ming Yin

To understand how people perceive writings that are produced under this paradigm, in this paper, we conduct an experimental study to understand whether and how the disclosure of the level and type of AI assistance in the writing process would affect people's perceptions of the writing on various aspects, including their evaluation on the quality of the writing and their ranking of different writings.

Understanding Decision Subjects' Engagement with and Perceived Fairness of AI Models When Opportunities of Qualification Improvement Exist

no code implementations4 Oct 2024 Meric Altug Gemalmaz, Ming Yin

We explore how an AI model's decision fairness affects people's engagement with and perceived fairness of the model if they are subject to its decisions, but could repeatedly and strategically respond to these decisions.

Fairness

Relative-Translation Invariant Wasserstein Distance

no code implementations4 Sep 2024 Binshuai Wang, Qiwei Di, Ming Yin, Mengdi Wang, Quanquan Gu, Peng Wei

We introduce a new family of distances, relative-translation invariant Wasserstein distances ($RW_p$), for measuring the similarity of two probability distributions under distribution shift.

Computational Efficiency Translation

Learning the Target Network in Function Space

no code implementations3 Jun 2024 Kavosh Asadi, Yao Liu, Shoham Sabach, Ming Yin, Rasool Fakoor

We focus on the task of learning the value function in the reinforcement learning (RL) setting.

Reinforcement Learning (RL)

Transfer Q Star: Principled Decoding for LLM Alignment

no code implementations30 May 2024 Souradip Chakraborty, Soumya Suvra Ghosal, Ming Yin, Dinesh Manocha, Mengdi Wang, Amrit Singh Bedi, Furong Huang

Hence, prior SoTA methods either approximate this $Q^*$ using $Q^{\pi_{\texttt{sft}}}$ (derived from the reference $\texttt{SFT}$ model) or rely on short-term rewards, resulting in sub-optimal decoding performance.

Towards Human-AI Deliberation: Design and Evaluation of LLM-Empowered Deliberative AI for AI-Assisted Decision-Making

no code implementations25 Mar 2024 Shuai Ma, Qiaoyi Chen, Xinru Wang, Chengbo Zheng, Zhenhui Peng, Ming Yin, Xiaojuan Ma

In AI-assisted decision-making, humans often passively review AI's suggestion and decide whether to accept or reject it as a whole.

Decision Making

Offline Multitask Representation Learning for Reinforcement Learning

no code implementations18 Mar 2024 Haque Ishfaq, Thanh Nguyen-Tang, Songtao Feng, Raman Arora, Mengdi Wang, Ming Yin, Doina Precup

We study offline multitask representation learning in reinforcement learning (RL), where a learner is provided with an offline dataset from different tasks that share a common representation and is asked to learn the shared representation.

reinforcement-learning Reinforcement Learning +2

Robust Federated Learning Mitigates Client-side Training Data Distribution Inference Attacks

no code implementations5 Mar 2024 Yichang Xu, Ming Yin, Minghong Fang, Neil Zhenqiang Gong

Recent studies have revealed that federated learning (FL), once considered secure due to clients not sharing their private data with the server, is vulnerable to attacks such as client-side training data distribution inference, where a malicious client can recreate the victim's data.

Federated Learning

Beyond Recommender: An Exploratory Study of the Effects of Different AI Roles in AI-Assisted Decision Making

no code implementations4 Mar 2024 Shuai Ma, Chenyi Zhang, Xinru Wang, Xiaojuan Ma, Ming Yin

Artificial Intelligence (AI) is increasingly employed in various decision-making tasks, typically as a Recommender, providing recommendations that the AI deems correct.

Decision Making Diversity

Poisoning Federated Recommender Systems with Fake Users

no code implementations18 Feb 2024 Ming Yin, Yichang Xu, Minghong Fang, Neil Zhenqiang Gong

Current poisoning attacks on federated recommender systems often rely on additional information, such as the local training data of genuine users or item popularity.

Federated Learning Recommendation Systems

Does More Advice Help? The Effects of Second Opinions in AI-Assisted Decision Making

no code implementations13 Jan 2024 Zhuoran Lu, Dakuo Wang, Ming Yin

AI assistance in decision-making has become popular, yet people's inappropriate reliance on AI often leads to unsatisfactory human-AI collaboration performance.

Decision Making

Decoding AI's Nudge: A Unified Framework to Predict Human Behavior in AI-assisted Decision Making

no code implementations11 Jan 2024 Zhuoyan Li, Zhuoran Lu, Ming Yin

In this paper, we propose a computational framework that can provide an interpretable characterization of the influence of different forms of AI assistance on decision makers in AI-assisted decision making.

Decision Making

Synthetic Data Generation with Large Language Models for Text Classification: Potential and Limitations

no code implementations11 Oct 2023 Zhuoyan Li, Hangxiao Zhu, Zhuoran Lu, Ming Yin

The collection and curation of high-quality training data is crucial for developing text classification models with superior performance, but it is often associated with significant costs and time investment.

Synthetic Data Generation text-classification +1

Improving Sample Efficiency of Model-Free Algorithms for Zero-Sum Markov Games

no code implementations17 Aug 2023 Songtao Feng, Ming Yin, Yu-Xiang Wang, Jing Yang, Yingbin Liang

In this work, we propose a model-free stage-based Q-learning algorithm and show that it achieves the same sample complexity as the best model-based algorithm, and hence for the first time demonstrate that model-free algorithms can enjoy the same optimality in the $H$ dependence as model-based algorithms.

Multi-agent Reinforcement Learning Q-Learning +1

Offline Policy Evaluation for Reinforcement Learning with Adaptively Collected Data

no code implementations24 Jun 2023 Sunil Madhow, Dan Qiao, Ming Yin, Yu-Xiang Wang

Developing theoretical guarantees on the sample complexity of offline RL methods is an important step towards making data-hungry RL algorithms practically viable.

Offline RL reinforcement-learning +1

Non-stationary Reinforcement Learning under General Function Approximation

no code implementations1 Jun 2023 Songtao Feng, Ming Yin, Ruiquan Huang, Yu-Xiang Wang, Jing Yang, Yingbin Liang

To the best of our knowledge, this is the first dynamic regret analysis in non-stationary MDPs with general function approximation.

reinforcement-learning Reinforcement Learning +1

TheoremQA: A Theorem-driven Question Answering dataset

1 code implementation21 May 2023 Wenhu Chen, Ming Yin, Max Ku, Pan Lu, Yixin Wan, Xueguang Ma, Jianyu Xu, Xinyi Wang, Tony Xia

We evaluate a wide spectrum of 16 large language and code models with different prompting strategies like Chain-of-Thoughts and Program-of-Thoughts.

Math Question Answering

No-Regret Linear Bandits beyond Realizability

no code implementations26 Feb 2023 Chong Liu, Ming Yin, Yu-Xiang Wang

It achieves a near-optimal $\sqrt{T}$ regret for problems that the best-known regret is almost linear in time horizon $T$.

Offline Reinforcement Learning with Closed-Form Policy Improvement Operators

no code implementations29 Nov 2022 Jiachen Li, Edwin Zhang, Ming Yin, Qinxun Bai, Yu-Xiang Wang, William Yang Wang

Behavior constrained policy optimization has been demonstrated to be a successful paradigm for tackling Offline Reinforcement Learning.

D4RL Offline RL +3

On Instance-Dependent Bounds for Offline Reinforcement Learning with Linear Function Approximation

no code implementations23 Nov 2022 Thanh Nguyen-Tang, Ming Yin, Sunil Gupta, Svetha Venkatesh, Raman Arora

To the best of our knowledge, these are the first $\tilde{\mathcal{O}}(\frac{1}{K})$ bound and absolute zero sub-optimality bound respectively for offline RL with linear function approximation from adaptive data with partial coverage.

Offline RL reinforcement-learning +1

Offline Reinforcement Learning with Differentiable Function Approximation is Provably Efficient

no code implementations3 Oct 2022 Ming Yin, Mengdi Wang, Yu-Xiang Wang

Offline reinforcement learning, which aims at optimizing sequential decision-making strategies with historical data, has been extensively applied in real-life applications.

Decision Making Offline RL +4

Why Quantization Improves Generalization: NTK of Binary Weight Neural Networks

no code implementations13 Jun 2022 Kaiqi Zhang, Ming Yin, Yu-Xiang Wang

We propose a quasi neural network to approximate the distribution propagation, which is a neural network with continuous parameters and smooth activation function.

Quantization

Offline Stochastic Shortest Path: Learning, Evaluation and Towards Optimality

no code implementations10 Jun 2022 Ming Yin, Wenjing Chen, Mengdi Wang, Yu-Xiang Wang

Goal-oriented Reinforcement Learning, where the agent needs to reach the goal state while simultaneously minimizing the cost, has received significant attention in real-world applications.

Near-optimal Offline Reinforcement Learning with Linear Representation: Leveraging Variance Information with Pessimism

no code implementations11 Mar 2022 Ming Yin, Yaqi Duan, Mengdi Wang, Yu-Xiang Wang

However, a precise understanding of the statistical limits with function representations, remains elusive, even when such a representation is linear.

Decision Making reinforcement-learning +2

Sample-Efficient Reinforcement Learning with loglog(T) Switching Cost

no code implementations13 Feb 2022 Dan Qiao, Ming Yin, Ming Min, Yu-Xiang Wang

In this paper, we propose a new algorithm based on stage-wise exploration and adaptive policy elimination that achieves a regret of $\widetilde{O}(\sqrt{H^4S^2AT})$ while requiring a switching cost of $O(HSA \log\log T)$.

reinforcement-learning Reinforcement Learning +1

Towards Instance-Optimal Offline Reinforcement Learning with Pessimism

no code implementations NeurIPS 2021 Ming Yin, Yu-Xiang Wang

We study the offline reinforcement learning (offline RL) problem, where the goal is to learn a reward-maximizing policy in an unknown Markov Decision Process (MDP) using the data coming from a policy $\mu$.

Offline RL reinforcement-learning +2

Optimal Uniform OPE and Model-based Offline Reinforcement Learning in Time-Homogeneous, Reward-Free and Task-Agnostic Settings

no code implementations NeurIPS 2021 Ming Yin, Yu-Xiang Wang

This work studies the statistical limits of uniform convergence for offline policy evaluation (OPE) problems with model-based methods (for episodic MDP) and provides a unified framework towards optimal learning for several well-motivated offline tasks.

Offline RL

Near-Optimal Offline Reinforcement Learning via Double Variance Reduction

no code implementations NeurIPS 2021 Ming Yin, Yu Bai, Yu-Xiang Wang

Our main result shows that OPDVR provably identifies an $\epsilon$-optimal policy with $\widetilde{O}(H^2/d_m\epsilon^2)$ episodes of offline data in the finite-horizon stationary transition setting, where $H$ is the horizon length and $d_m$ is the minimal marginal state-action distribution induced by the behavior policy.

Offline RL reinforcement-learning +2

Near-Optimal Provable Uniform Convergence in Offline Policy Evaluation for Reinforcement Learning

no code implementations7 Jul 2020 Ming Yin, Yu Bai, Yu-Xiang Wang

The problem of Offline Policy Evaluation (OPE) in Reinforcement Learning (RL) is a critical step towards applying RL in real-life applications.

Offline RL reinforcement-learning +1

Asymptotically Efficient Off-Policy Evaluation for Tabular Reinforcement Learning

no code implementations29 Jan 2020 Ming Yin, Yu-Xiang Wang

We consider the problem of off-policy evaluation for reinforcement learning, where the goal is to estimate the expected reward of a target policy $\pi$ using offline data collected by running a logging policy $\mu$.

Off-policy evaluation reinforcement-learning +1

Shared Generative Latent Representation Learning for Multi-view Clustering

1 code implementation23 Jul 2019 Ming Yin, Weitian Huang, Junbin Gao

Clustering multi-view data has been a fundamental research topic in the computer vision community.

Clustering Diversity +1

Low-rank Multi-view Clustering in Third-Order Tensor Space

no code implementations30 Aug 2016 Ming Yin, Junbin Gao, Shengli Xie, Yi Guo

Multi-view subspace clustering is based on the fact that the multi-view data are generated from a latent subspace.

Clustering Multi-view Subspace Clustering

Neighborhood Preserved Sparse Representation for Robust Classification on Symmetric Positive Definite Matrices

no code implementations27 Jan 2016 Ming Yin, Shengli Xie, Yi Guo, Junbin Gao, Yun Zhang

Due to its promising classification performance, sparse representation based classification(SRC) algorithm has attracted great attention in the past few years.

Classification General Classification +2

Kernel Sparse Subspace Clustering on Symmetric Positive Definite Manifolds

no code implementations CVPR 2016 Ming Yin, Yi Guo, Junbin Gao, Zhaoshui He, Shengli Xie

Sparse subspace clustering (SSC), as one of the most successful subspace clustering methods, has achieved notable clustering accuracy in computer vision tasks.

Clustering

Supervised learning of sparse context reconstruction coefficients for data representation and classification

no code implementations18 Aug 2015 Xuejie Liu, Jingbin Wang, Ming Yin, Benjamin Edwards, Peijuan Xu

Context of data points, which is usually defined as the other data points in a data set, has been found to play important roles in data representation and classification.

Classification General Classification

Cannot find the paper you are looking for? You can Submit a new open access paper.