Search Results for author: Xinyi Chen

Found 32 papers, 9 papers with code

Online Learning of Quantum States

no code implementations NeurIPS 2018 Scott Aaronson, Xinyi Chen, Elad Hazan, Satyen Kale, Ashwin Nayak

Even in the "non-realizable" setting---where there could be arbitrary noise in the measurement outcomes---we show how to output hypothesis states that do significantly worse than the best possible states at most $\operatorname{O}\!\left(\sqrt {Tn}\right) $ times on the first $T$ measurements.

Efficient Full-Matrix Adaptive Regularization

no code implementations ICLR 2019 Naman Agarwal, Brian Bullins, Xinyi Chen, Elad Hazan, Karan Singh, Cyril Zhang, Yi Zhang

Due to the large number of parameters of machine learning problems, full-matrix preconditioning methods are prohibitively expensive.

Extreme Tensoring for Low-Memory Preconditioning

no code implementations ICLR 2020 Xinyi Chen, Naman Agarwal, Elad Hazan, Cyril Zhang, Yi Zhang

State-of-the-art models are now trained with billions of parameters, reaching hardware limits in terms of memory consumption.

Stochastic Optimization

Calibration, Entropy Rates, and Memory in Language Models

no code implementations ICML 2020 Mark Braverman, Xinyi Chen, Sham M. Kakade, Karthik Narasimhan, Cyril Zhang, Yi Zhang

Building accurate language models that capture meaningful long-term dependencies is a core challenge in natural language processing.

Dark Energy Survey Year 1 Results: Cosmological Constraints from Cluster Abundances and Weak Lensing

no code implementations25 Feb 2020 DES Collaboration, Tim Abbott, Michel Aguena, Alex Alarcon, Sahar Allam, Steve Allen, James Annis, Santiago Avila, David Bacon, Alberto Bermeo, Gary Bernstein, Emmanuel Bertin, Sunayana Bhargava, Sebastian Bocquet, David Brooks, Dillon Brout, Elizabeth Buckley-Geer, David Burke, Aurelio Carnero Rosell, Matias Carrasco Kind, Jorge Carretero, Francisco Javier Castander, Ross Cawthon, Chihway Chang, Xinyi Chen, Ami Choi, Matteo Costanzi, Martin Crocce, Luiz da Costa, Tamara Davis, Juan De Vicente, Joseph DeRose, Shantanu Desai, H. Thomas Diehl, Jörg Dietrich, Scott Dodelson, Peter Doel, Alex Drlica-Wagner, Kathleen Eckert, Tim Eifler, Jack Elvin-Poole, Juan Estrada, Spencer Everett, August Evrard, Arya Farahi, Ismael Ferrero, Brenna Flaugher, Pablo Fosalba, Josh Frieman, Juan Garcia-Bellido, Marco Gatti, Enrique Gaztanaga, David Gerdes, Tommaso Giannantonio, Paul Giles, Sebastian Grandis, Daniel Gruen, Robert Gruendl, Julia Gschwend, Gaston Gutierrez, Will Hartley, Samuel Hinton, Devon L. Hollowood, Klaus Honscheid, Ben Hoyle, Dragan Huterer, David James, Mike Jarvis, Tesla Jeltema, Margaret Johnson, Stephen Kent, Elisabeth Krause, Richard Kron, Kyler Kuehn, Nikolay Kuropatkin, Ofer Lahav, Ting Li, Christopher Lidman, Marcos Lima, Huan Lin, Niall MacCrann, Marcio Maia, Adam Mantz, Jennifer Marshall, Paul Martini, Julian Mayers, Peter Melchior, Juan Mena, Felipe Menanteau, Ramon Miquel, Joe Mohr, Robert Nichol, Brian Nord, Ricardo Ogando, Antonella Palmese, Francisco Paz-Chinchon, Andrés Plazas Malagón, Judit Prat, Markus Michael Rau, Kathy Romer, Aaron Roodman, Philip Rooney, Eduardo Rozo, Eli Rykoff, Masao Sako, Simon Samuroff, Carles Sanchez, Alexandro Saro, Vic Scarpine, Michael Schubnell, Daniel Scolnic, Santiago Serrano, Ignacio Sevilla, Erin Sheldon, J. Allyn Smith, Eric Suchyta, Molly Swanson, Gregory Tarle, Daniel Thomas, Chun-Hao To, Michael A. Troxel, Douglas Tucker, Tamas Norbert Varga, Anja von der Linden, Alistair Walker, Risa Wechsler, Jochen Weller, Reese Wilkinson, Hao-Yi Wu, Brian Yanny, Zhuowen Zhang, Joe Zuntz

We perform a joint analysis of the counts and weak lensing signal of redMaPPer clusters selected from the Dark Energy Survey (DES) Year 1 dataset.

Cosmology and Nongalactic Astrophysics

Online Agnostic Boosting via Regret Minimization

no code implementations NeurIPS 2020 Nataly Brukhim, Xinyi Chen, Elad Hazan, Shay Moran

Boosting is a widely used machine learning approach based on the idea of aggregating weak learning rules.

Black-Box Control for Linear Dynamical Systems

no code implementations13 Jul 2020 Xinyi Chen, Elad Hazan

To complete the picture, we investigate the complexity of the online black-box control problem, and give a matching lower bound of $2^{\Omega(\mathcal{L})}$ on the regret, showing that the additional exponential cost is inevitable.

Label Representations in Modeling Classification as Text Generation

no code implementations Asian Chapter of the Association for Computational Linguistics 2020 Xinyi Chen, Jingxian Xu, Alex Wang

Several recent state-of-the-art transfer learning methods model classification tasks as text generation, where labels are represented as strings for the model to generate.

text-classification Text Classification +2

Machine Learning for Mechanical Ventilation Control

2 code implementations12 Feb 2021 Daniel Suo, Naman Agarwal, Wenhan Xia, Xinyi Chen, Udaya Ghai, Alexander Yu, Paula Gradu, Karan Singh, Cyril Zhang, Edgar Minasyan, Julienne LaChance, Tom Zajdel, Manuel Schottdorf, Daniel Cohen, Elad Hazan

We consider the problem of controlling an invasive mechanical ventilator for pressure-controlled ventilation: a controller must let air in and out of a sedated patient's lungs according to a trajectory of airway pressures specified by a clinician.

BIG-bench Machine Learning

Variational Relational Point Completion Network

1 code implementation CVPR 2021 Liang Pan, Xinyi Chen, Zhongang Cai, Junzhe Zhang, Haiyu Zhao, Shuai Yi, Ziwei Liu

In particular, we propose a dual-path architecture to enable principled probabilistic modeling across partial and complete clouds.

Point Cloud Completion

Unsupervised 3D Shape Completion through GAN Inversion

no code implementations CVPR 2021 Junzhe Zhang, Xinyi Chen, Zhongang Cai, Liang Pan, Haiyu Zhao, Shuai Yi, Chai Kiat Yeo, Bo Dai, Chen Change Loy

In contrast to previous fully supervised approaches, in this paper we present ShapeInversion, which introduces Generative Adversarial Network (GAN) inversion to shape completion for the first time.

Generative Adversarial Network valid

A Deep Reinforcement Learning Approach towards Pendulum Swing-up Problem based on TF-Agents

no code implementations17 Jun 2021 Yifei Bi, Xinyi Chen, Caihui Xiao

Adapting the idea of training CartPole with Deep Q-learning agent, we are able to find a promising result that prevent the pole from falling down.

Position Q-Learning +2

Robust Online Control with Model Misspecification

no code implementations16 Jul 2021 Xinyi Chen, Udaya Ghai, Elad Hazan, Alexandre Megretski

We study online control of an unknown nonlinear dynamical system that is approximated by a time-invariant linear system with model misspecification.

Provable Regret Bounds for Deep Online Learning and Control

no code implementations15 Oct 2021 Xinyi Chen, Edgar Minasyan, Jason D. Lee, Elad Hazan

The theory of deep learning focuses almost exclusively on supervised learning, non-convex optimization using stochastic gradient descent, and overparametrized neural networks.

Second-order methods

Adaptive Online Learning of Quantum States

no code implementations1 Jun 2022 Xinyi Chen, Elad Hazan, Tongyang Li, Zhou Lu, Xinzhao Wang, Rui Yang

In the fundamental problem of shadow tomography, the goal is to efficiently learn an unknown $d$-dimensional quantum state using projective measurements.

A Nonstochastic Control Approach to Optimization

no code implementations19 Jan 2023 Xinyi Chen, Elad Hazan

Selecting the best hyperparameters for a particular optimization instance, such as the learning rate and momentum, is an important but nonconvex problem.

A lightweight network for photovoltaic cell defect detection in electroluminescence images based on neural architecture search and knowledge distillation

no code implementations15 Feb 2023 Jinxia Zhang, Xinyi Chen, Haikun Wei, Kanjian Zhang

To solve these problems, we propose a novel lightweight high-performance model for automatic defect detection of PV cells in electroluminescence(EL) images based on neural architecture search and knowledge distillation.

Data Augmentation Defect Detection +2

REMAST: Real-time Emotion-based Music Arrangement with Soft Transition

1 code implementation14 May 2023 ZiHao Wang, Le Ma, Chen Zhang, Bo Han, Yunfei Xu, Yikai Wang, Xinyi Chen, HaoRong Hong, Wenbo Liu, Xinda Wu, Kejun Zhang

Music as an emotional intervention medium has important applications in scenarios such as music therapy, games, and movies.

A Hybrid Neural Coding Approach for Pattern Recognition with Spiking Neural Networks

1 code implementation26 May 2023 Xinyi Chen, Qu Yang, Jibin Wu, Haizhou Li, Kay Chen Tan

As an initial exploration in this direction, we propose a hybrid neural coding and learning framework, which encompasses a neural coding zoo with diverse neural coding schemes discovered in neuroscience.

Image Classification

Unleashing the Potential of Spiking Neural Networks for Sequential Modeling with Contextual Embedding

no code implementations29 Aug 2023 Xinyi Chen, Jibin Wu, Huajin Tang, Qinyuan Ren, Kay Chen Tan

The human brain exhibits remarkable abilities in integrating temporally distant sensory inputs for decision-making.

Decision Making

Performance Bounds for Near-Field Localization with Widely-Spaced Multi-Subarray mmWave/THz MIMO

1 code implementation12 Sep 2023 Songjie Yang, Xinyi Chen, Yue Xiu, Wanting Lyu, Zhongpei Zhang, Chau Yuen

By employing the Riemann sum, closed-form CRB expressions are derived for the spherical wavefront-based WSMS (SW-WSMS).

The BLA Benchmark: Investigating Basic Language Abilities of Pre-Trained Multimodal Models

1 code implementation23 Oct 2023 Xinyi Chen, Raquel Fernández, Sandro Pezzelle

Despite the impressive performance achieved by pre-trained language-and-vision models in downstream tasks, it remains an open question whether this reflects a proper understanding of image-text interaction.

In-Context Learning

Robust Learning Based Condition Diagnosis Method for Distribution Network Switchgear

no code implementations14 Nov 2023 Wenxi Zhang, Zhe Li, Weixi Li, Weisi Ma, Xinyi Chen, Sizhe Li

This paper introduces a robust, learning-based method for diagnosing the state of distribution network switchgear, which is crucial for maintaining the power quality for end users.

Position

DesignGPT: Multi-Agent Collaboration in Design

no code implementations20 Nov 2023 Shiying Ding, Xinyi Chen, Yan Fang, Wenrui Liu, Yiwu Qiu, Chunlei Chai

Generative AI faces many challenges when entering the product design workflow, such as interface usability and interaction patterns.

Playing Large Games with Oracles and AI Debate

1 code implementation8 Dec 2023 Xinyi Chen, Angelica Chen, Dean Foster, Elad Hazan

We give a novel efficient algorithm for internal regret minimization whose regret and per-iteration computation depend logarithmically on the number of actions.

Spectral State Space Models

1 code implementation11 Dec 2023 Naman Agarwal, Daniel Suo, Xinyi Chen, Elad Hazan

This paper studies sequence modeling for prediction tasks with long range dependencies.

Adaptive Regret for Bandits Made Possible: Two Queries Suffice

no code implementations17 Jan 2024 Zhou Lu, Qiuyi Zhang, Xinyi Chen, Fred Zhang, David Woodruff, Elad Hazan

In this paper, we give query and regret optimal bandit algorithms under the strict notion of strongly adaptive regret, which measures the maximum regret over any contiguous interval $I$.

Hyperparameter Optimization Multi-Armed Bandits

Knowledge Graph Assisted Automatic Sports News Writing

no code implementations17 Feb 2024 Yang Cao, Xinyi Chen, Xin Zhang, Siying Li

In this paper, we present a novel method for automatically generating sports news, which employs a unique algorithm that extracts pivotal moments from live text broadcasts and uses them to create an initial draft of the news.

Knowledge Graph Completion

Efficient Online Learning for Networks of Two-Compartment Spiking Neurons

no code implementations25 Feb 2024 Yujia Yin, Xinyi Chen, Chenxiang Ma, Jibin Wu, Kay Chen Tan

The brain-inspired Spiking Neural Networks (SNNs) have garnered considerable research interest due to their superior performance and energy efficiency in processing temporal signals.

Cannot find the paper you are looking for? You can Submit a new open access paper.