Search Results for author: Xingyu Zhou

Found 39 papers, 8 papers with code

Optimal Rates for Robust Stochastic Convex Optimization

no code implementations15 Dec 2024 Changyu Gao, Andrew Lowy, Xingyu Zhou, Stephen J. Wright

Machine learning algorithms in high-dimensional settings are highly susceptible to the influence of even a small fraction of structured outliers, making robust optimization techniques essential.

Integrated Location Sensing and Communication for Ultra-Massive MIMO With Hybrid-Field Beam-Squint Effect

no code implementations8 Nov 2024 Zhen Gao, Xingyu Zhou, Boyu Ning, Yu Su, Tong Qin, Dusit Niyato

The advent of ultra-massive multiple-input-multiple output systems holds great promise for next-generation communications, yet their channels exhibit hybrid far- and near- field beam-squint (HFBS) effect.

Apple Intelligence Foundation Language Models

no code implementations29 Jul 2024 Tom Gunter, ZiRui Wang, Chong Wang, Ruoming Pang, Aonan Zhang, BoWen Zhang, Chen Chen, Chung-Cheng Chiu, David Qiu, Deepak Gopinath, Dian Ang Yap, Dong Yin, Feng Nan, Floris Weers, Guoli Yin, Haoshuo Huang, Jianyu Wang, Jiarui Lu, John Peebles, Ke Ye, Mark Lee, Nan Du, Qibin Chen, Quentin Keunebroek, Sam Wiseman, Syd Evans, Tao Lei, Vivek Rathod, Xiang Kong, Xianzhi Du, Yanghao Li, Yongqiang Wang, Yuan Gao, Zaid Ahmed, Zhaoyang Xu, Zhiyun Lu, Al Rashid, Albin Madappally Jose, Alec Doane, Alfredo Bencomo, Allison Vanderby, Andrew Hansen, Ankur Jain, Anupama Mann Anupama, Areeba Kamal, Bugu Wu, Carolina Brum, Charlie Maalouf, Chinguun Erdenebileg, Chris Dulhanty, Dominik Moritz, Doug Kang, Eduardo Jimenez, Evan Ladd, Fangping Shi, Felix Bai, Frank Chu, Fred Hohman, Hadas Kotek, Hannah Gillis Coleman, Jane Li, Jeffrey Bigham, Jeffery Cao, Jeff Lai, Jessica Cheung, Jiulong Shan, Joe Zhou, John Li, Jun Qin, Karanjeet Singh, Karla Vega, Kelvin Zou, Laura Heckman, Lauren Gardiner, Margit Bowler, Maria Cordell, Meng Cao, Nicole Hay, Nilesh Shahdadpuri, Otto Godwin, Pranay Dighe, Pushyami Rachapudi, Ramsey Tantawi, Roman Frigg, Sam Davarnia, Sanskruti Shah, Saptarshi Guha, Sasha Sirovica, Shen Ma, Shuang Ma, Simon Wang, Sulgi Kim, Suma Jayaram, Vaishaal Shankar, Varsha Paidi, Vivek Kumar, Xin Wang, Xin Zheng, Walker Cheng, Yael Shrager, Yang Ye, Yasu Tanaka, Yihao Guo, Yunsong Meng, Zhao Tang Luo, Zhi Ouyang, Alp Aygar, Alvin Wan, Andrew Walkingshaw, Andy Narayanan, Antonie Lin, Arsalan Farooq, Brent Ramerth, Colorado Reed, Chris Bartels, Chris Chaney, David Riazati, Eric Liang Yang, Erin Feldman, Gabriel Hochstrasser, Guillaume Seguin, Irina Belousova, Joris Pelemans, Karen Yang, Keivan Alizadeh Vahid, Liangliang Cao, Mahyar Najibi, Marco Zuliani, Max Horton, Minsik Cho, Nikhil Bhendawade, Patrick Dong, Piotr Maj, Pulkit Agrawal, Qi Shan, Qichen Fu, Regan Poston, Sam Xu, Shuangning Liu, Sushma Rao, Tashweena Heeramun, Thomas Merth, Uday Rayala, Victor Cui, Vivek Rangarajan Sridhar, Wencong Zhang, Wenqi Zhang, Wentao Wu, Xingyu Zhou, Xinwen Liu, Yang Zhao, Yin Xia, Zhile Ren, Zhongzheng Ren

We present foundation language models developed to power Apple Intelligence features, including a ~3 billion parameter model designed to run efficiently on devices and a large server-based language model designed for Private Cloud Compute.

Language Modeling Language Modelling

Private Heterogeneous Federated Learning Without a Trusted Server Revisited: Error-Optimal and Communication-Efficient Algorithms for Convex Losses

no code implementations12 Jul 2024 Changyu Gao, Andrew Lowy, Xingyu Zhou, Stephen J. Wright

In this context, every silo (e. g. hospital) has data from several people (e. g. patients) and needs to protect the privacy of each person's data (e. g. health records), even if the server and/or other silos try to uncover this data.

Federated Learning

Near-Optimal MIMO Detection Using Gradient-Based MCMC in Discrete Spaces

no code implementations8 Jul 2024 Xingyu Zhou, Le Liang, Jing Zhang, Chao-Kai Wen, Shi Jin

The discrete nature of transmitted symbols poses challenges for achieving optimal detection in multiple-input multiple-output (MIMO) systems associated with a large number of antennas.

Large Scale Hierarchical Industrial Demand Time-Series Forecasting incorporating Sparsity

1 code implementation2 Jul 2024 Harshavardhan Kamarthi, Aditya B. Sasanur, Xinjie Tong, Xingyu Zhou, James Peters, Joe Czyzyk, B. Aditya Prakash

Recent works, however, do not address two important challenges that are typically observed in many demand forecasting applications at large companies.

Demand Forecasting Time Series +1

Design of UAV flight state recognition and trajectory prediction system based on trajectory feature construction

no code implementations28 Jan 2024 Xingyu Zhou, Zhuoyong Shi

With the impact of artificial intelligence on the traditional UAV industry, autonomous UAV flight has become a current hot research field.

Trajectory Prediction

Transcending the Limit of Local Window: Advanced Super-Resolution Transformer with Adaptive Token Dictionary

1 code implementation CVPR 2024 Leheng Zhang, Yawei Li, Xingyu Zhou, Xiaorui Zhao, Shuhang Gu

The introduced token dictionary could learn prior information from training data and adapt the learned prior to specific testing image through an adaptive refinement step.

Image Super-Resolution

Improved Implicit Neural Representation with Fourier Reparameterized Training

2 code implementations CVPR 2024 Kexuan Shi, Xingyu Zhou, Shuhang Gu

We evaluate the proposed Fourier reparameterization method on different INR tasks with various MLP architectures, including vanilla MLP, MLP with positional encoding and MLP with advanced activation function, etc.

Video Super-Resolution Transformer with Masked Inter&Intra-Frame Attention

1 code implementation CVPR 2024 Xingyu Zhou, Leheng Zhang, Xiaorui Zhao, Keze Wang, Leida Li, Shuhang Gu

The core of MIA-VSR is leveraging feature-level temporal continuity between adjacent frames to reduce redundant computations and make more rational use of previously enhanced SR features.

Video Super-Resolution

Differentially Private Reward Estimation with Preference Feedback

no code implementations30 Oct 2023 Sayak Ray Chowdhury, Xingyu Zhou, Nagarajan Natarajan

Within a standard minimax estimation framework, we provide tight upper and lower bounds on the error in estimating $\theta^*$ under both local and central models of DP.

Adversarial Attack

Gradient-Based Markov Chain Monte Carlo for MIMO Detection

no code implementations12 Aug 2023 Xingyu Zhou, Le Liang, Jing Zhang, Chao-Kai Wen, Shi Jin

However, optimal MIMO detection is associated with a complexity that grows exponentially with the MIMO dimensions and quickly becomes impractical.

Bayesian Inference

Understanding the Role of Feedback in Online Learning with Switching Costs

no code implementations16 Jun 2023 Duo Cheng, Xingyu Zhou, Bo Ji

To design algorithms that can achieve the minimax regret, it is instructive to consider a more general setting where the learner has a budget of $B$ total observations.

Provably Efficient Model-Free Algorithms for Non-stationary CMDPs

no code implementations10 Mar 2023 Honghao Wei, Arnob Ghosh, Ness Shroff, Lei Ying, Xingyu Zhou

We study model-free reinforcement learning (RL) algorithms in episodic non-stationary constrained Markov Decision Processes (CMDPs), in which an agent aims to maximize the expected cumulative reward subject to a cumulative constraint on the expected utility (cost).

Reinforcement Learning (RL)

On Differentially Private Federated Linear Contextual Bandits

no code implementations27 Feb 2023 Xingyu Zhou, Sayak Ray Chowdhury

We first establish privacy and regret guarantees under silo-level local differential privacy, which fix the issues present in state-of-the-art algorithm.

Multi-Armed Bandits

(Private) Kernelized Bandits with Distributed Biased Feedback

no code implementations28 Jan 2023 Fengjiao Li, Xingyu Zhou, Bo Ji

This problem is motivated by several real-world applications (such as dynamic pricing, cellular network configuration, and policy making), where users from a large population contribute to the reward of the action chosen by a central entity, but it is difficult to collect feedback from all users.

Contextual Bandits with Packing and Covering Constraints: A Modular Lagrangian Approach via Regression

no code implementations14 Nov 2022 Aleksandrs Slivkins, Xingyu Zhou, Karthik Abinav Sankararaman, Dylan J. Foster

We consider contextual bandits with linear constraints (CBwLC), a variant of contextual bandits in which the algorithm consumes multiple resources subject to linear constraints on total consumption.

Multi-Armed Bandits regression

Grant-Free NOMA-OTFS Paradigm: Enabling Efficient Ubiquitous Access for LEO Satellite Internet-of-Things

no code implementations25 Sep 2022 Zhen Gao, Xingyu Zhou, Jingjing Zhao, Juan Li, Chunli Zhu, Chun Hu, Pei Xiao, Symeon Chatzinotas, Derrick Wing Kwan Ng, Bjorn Ottersten

With the blooming of Internet-of-Things (IoT), we are witnessing an explosion in the number of IoT terminals, triggering an unprecedented demand for ubiquitous wireless access globally.

Differentially Private Linear Bandits with Partial Distributed Feedback

no code implementations12 Jul 2022 Fengjiao Li, Xingyu Zhou, Bo Ji

To tackle this problem, we consider differentially private distributed linear bandits, where only a subset of users from the population are selected (called clients) to participate in the learning process and the central server learns the global model from such partial feedback by iteratively aggregating these clients' local feedback in a differentially private fashion.

Provably Efficient Model-Free Constrained RL with Linear Function Approximation

no code implementations23 Jun 2022 Arnob Ghosh, Xingyu Zhou, Ness Shroff

To this end, we consider the episodic constrained Markov decision processes with linear function approximation, where the transition dynamics and the reward function can be represented as a linear function of some known feature mapping.

Distributed Differential Privacy in Multi-Armed Bandits

no code implementations12 Jun 2022 Sayak Ray Chowdhury, Xingyu Zhou

This protocol achieves ($\epsilon,\delta$) or approximate-DP guarantee by sacrificing an additional additive $O\!\left(\!\frac{K\log T\sqrt{\log(1/\delta)}}{\epsilon}\!\right)\!$ cost in $T$-step cumulative regret.

Multi-Armed Bandits

Learning to Control under Time-Varying Environment

no code implementations6 Jun 2022 Yuzhen Han, Ruben Solozabal, Jing Dong, Xingyu Zhou, Martin Takac, Bin Gu

To the best of our knowledge, our study establishes the first model-based online algorithm with regret guarantees under LTV dynamical systems.

On Kernelized Multi-Armed Bandits with Constraints

no code implementations29 Mar 2022 Xingyu Zhou, Bo Ji

Our ultimate goal is to study how to utilize the nature of soft constraints to attain a finer complexity-regret-constraint trade-off in the kernelized bandit setting.

Thompson Sampling

Shuffle Private Linear Contextual Bandits

no code implementations11 Feb 2022 Sayak Ray Chowdhury, Xingyu Zhou

Prior work largely focus on two trust models of DP: the central model, where a central server is responsible for protecting users sensitive data, and the (stronger) local model, where information needs to be protected directly on user side.

Multi-Armed Bandits

Differentially Private Reinforcement Learning with Linear Function Approximation

no code implementations18 Jan 2022 Xingyu Zhou

Motivated by the wide adoption of reinforcement learning (RL) in real-world personalized services, where users' sensitive and private information needs to be protected, we study regret minimization in finite-horizon Markov decision processes (MDPs) under the constraints of differential privacy (DP).

Privacy Preserving reinforcement-learning +2

Adversarial Attack via Dual-Stage Network Erosion

1 code implementation1 Jan 2022 Yexin Duan, Junhua Zou, Xingyu Zhou, Wu Zhang, Jin Zhang, Zhisong Pan

Deep neural networks are vulnerable to adversarial examples, which can fool deep models by adding subtle perturbations.

Adversarial Attack

Differentially Private Regret Minimization in Episodic Markov Decision Processes

1 code implementation20 Dec 2021 Sayak Ray Chowdhury, Xingyu Zhou

We study regret minimization in finite horizon tabular Markov decision processes (MDPs) under the constraints of differential privacy (DP).

Decision Making Reinforcement Learning (RL) +1

Wasserstein Generative Learning of Conditional Distribution

1 code implementation19 Dec 2021 Shiao Liu, Xingyu Zhou, Yuling Jiao, Jian Huang

The proposed approach uses a conditional generator to transform a known distribution to the target conditional distribution.

Density Estimation Image Generation +2

Adaptive Control of Differentially Private Linear Quadratic Systems

no code implementations26 Aug 2021 Sayak Ray Chowdhury, Xingyu Zhou, Ness Shroff

In this paper, we study the problem of regret minimization in reinforcement learning (RL) under differential privacy constraints.

Reinforcement Learning (RL)

Orientation-Aware Planning for Parallel Task Execution of Omni-Directional Mobile Robot

no code implementations2 Aug 2021 Cheng Gong, Zirui Li, Xingyu Zhou, Jiachen Li, Jianwei Gong, Junhui Zhou

Omni-directional mobile robot (OMR) systems have been very popular in academia and industry for their superb maneuverability and flexibility.

Position

Weighted Gaussian Process Bandits for Non-stationary Environments

no code implementations6 Jul 2021 Yuntian Deng, Xingyu Zhou, Baekjin Kim, Ambuj Tewari, Abhishek Gupta, Ness Shroff

To this end, we develop WGP-UCB, a novel UCB-type algorithm based on weighted Gaussian process regression.

regression

No-Regret Algorithms for Time-Varying Bayesian Optimization

no code implementations11 Feb 2021 Xingyu Zhou, Ness Shroff

In this paper, we consider the time-varying Bayesian optimization problem.

Bayesian Optimization

Local Differential Privacy for Bayesian Optimization

no code implementations13 Oct 2020 Xingyu Zhou, Jian Tan

Motivated by the increasing concern about privacy in nowadays data-intensive online learning systems, we consider a black-box optimization in the nonparametric Gaussian process setting with local differential privacy (LDP) guarantee.

Bayesian Optimization

Multi-Armed Bandits with Local Differential Privacy

no code implementations6 Jul 2020 Wenbo Ren, Xingyu Zhou, Jia Liu, Ness B. Shroff

To handle this dilemma, we adopt differential privacy and study the regret upper and lower bounds for MAB algorithms with a given LDP guarantee.

Multi-Armed Bandits

TopoAna: A generic tool for the event type analysis of inclusive Monte-Carlo samples in high energy physics experiments

1 code implementation13 Jan 2020 Xingyu Zhou, Shuxian Du, Gang Li, Chengping Shen

To help analysts obtain the physics process information from the truth information of the samples, we develop a physics process analysis program, TopoAna, with C++, ROOT, and LaTeX.

High Energy Physics - Experiment

Explaining Adversarial Examples with Knowledge Representation

no code implementations ICLR 2019 Xingyu Zhou, Tengyu Ma, Huahong Zhang

This paper, in contrast, discusses the origin of adversarial examples from a more underlying knowledge representation point of view.

Cannot find the paper you are looking for? You can Submit a new open access paper.