Search Results for author: Hejia Zhang

Found 13 papers, 6 papers with code

Effective Long-Context Scaling of Foundation Models

1 code implementation27 Sep 2023 Wenhan Xiong, Jingyu Liu, Igor Molybog, Hejia Zhang, Prajjwal Bhargava, Rui Hou, Louis Martin, Rashi Rungta, Karthik Abinav Sankararaman, Barlas Oguz, Madian Khabsa, Han Fang, Yashar Mehdad, Sharan Narang, Kshitiz Malik, Angela Fan, Shruti Bhosale, Sergey Edunov, Mike Lewis, Sinong Wang, Hao Ma

We also examine the impact of various design choices in the pretraining process, including the data mix and the training curriculum of sequence lengths -- our ablation experiments suggest that having abundant long texts in the pretrain dataset is not the key to achieving strong performance, and we empirically verify that long context continual pretraining is more efficient and similarly effective compared to pretraining from scratch with long sequences.

Continual Pretraining Language Modelling

Surrogate Assisted Generation of Human-Robot Interaction Scenarios

1 code implementation26 Apr 2023 Varun Bhatt, Heramb Nemlekar, Matthew C. Fontaine, Bryon Tjanaka, Hejia Zhang, Ya-Chuan Hsu, Stefanos Nikolaidis

In the shared control teleoperation domain and a more complex shared workspace collaboration task, we show that surrogate assisted scenario generation efficiently synthesizes diverse datasets of challenging scenarios.

PATO: Policy Assisted TeleOperation for Scalable Robot Data Collection

no code implementations9 Dec 2022 Shivin Dass, Karl Pertsch, Hejia Zhang, Youngwoon Lee, Joseph J. Lim, Stefanos Nikolaidis

Large-scale data is an essential component of machine learning as demonstrated in recent advances in natural language processing and computer vision research.

Video Game Level Repair via Mixed Integer Linear Programming

1 code implementation13 Oct 2020 Hejia Zhang, Matthew C. Fontaine, Amy K. Hoover, Julian Togelius, Bistra Dilkina, Stefanos Nikolaidis

Recent advancements in procedural content generation via machine learning enable the generation of video-game levels that are aesthetically similar to human-authored examples.

Generative Adversarial Network

Incorporating structured assumptions with probabilistic graphical models in fMRI data analysis

no code implementations11 May 2020 Ming Bo Cai, Michael Shvartsman, Anqi Wu, Hejia Zhang, Xia Zhu

With the wide adoption of functional magnetic resonance imaging (fMRI) by cognitive neuroscience researchers, large volumes of brain imaging data have been accumulated in recent years.

Zero-Shot Imitating Collaborative Manipulation Plans from YouTube Cooking Videos

no code implementations25 Nov 2019 Hejia Zhang, Jie Zhong, Stefanos Nikolaidis

Building upon this theory of language for action, we propose a system for understanding and executing demonstrated action sequences from full-length, real-world cooking videos on the web.

Action Detection

Interactive Differentiable Simulation

2 code implementations26 May 2019 Eric Heiden, David Millard, Hejia Zhang, Gaurav S. Sukhatme

While learning-based models of the environment dynamics have contributed to significant improvements in sample efficiency compared to model-free reinforcement learning algorithms, they typically fail to generalize to system states beyond the training data, while often grounding their predictions on non-interpretable latent variables.

Model Predictive Control reinforcement-learning +1

Simulator Predictive Control: Using Learned Task Representations and MPC for Zero-Shot Generalization and Sequencing

1 code implementation4 Oct 2018 Zhanpeng He, Ryan Julian, Eric Heiden, Hejia Zhang, Stefan Schaal, Joseph J. Lim, Gaurav Sukhatme, Karol Hausman

We complete unseen tasks by choosing new sequences of skill latents to control the robot using MPC, where our MPC model is composed of the pre-trained skill policy executed in the simulation environment, run in parallel with the real robot.

Model Predictive Control Zero-shot Generalization

Auto-conditioned Recurrent Mixture Density Networks for Learning Generalizable Robot Skills

no code implementations29 Sep 2018 Hejia Zhang, Eric Heiden, Stefanos Nikolaidis, Joseph J. Lim, Gaurav S. Sukhatme

Personal robots assisting humans must perform complex manipulation tasks that are typically difficult to specify in traditional motion planning pipelines, where multiple objectives must be met and the high-level context be taken into consideration.

Motion Planning

Scaling simulation-to-real transfer by learning composable robot skills

1 code implementation26 Sep 2018 Ryan Julian, Eric Heiden, Zhanpeng He, Hejia Zhang, Stefan Schaal, Joseph J. Lim, Gaurav Sukhatme, Karol Hausman

In particular, we first use simulation to jointly learn a policy for a set of low-level skills, and a "skill embedding" parameterization which can be used to compose them.

Segmenting Brain Tumors with Symmetry

no code implementations17 Nov 2017 Hejia Zhang, Xia Zhu, Theodore L. Willke

We explore encoding brain symmetry into a neural network for a brain tumor segmentation task.

Brain Tumor Segmentation Segmentation +1

A Searchlight Factor Model Approach for Locating Shared Information in Multi-Subject fMRI Analysis

no code implementations29 Sep 2016 Hejia Zhang, Po-Hsuan Chen, Janice Chen, Xia Zhu, Javier S. Turek, Theodore L. Willke, Uri Hasson, Peter J. Ramadge

In this work, we examine a searchlight based shared response model to identify shared information in small contiguous regions (searchlights) across the whole brain.

General Classification

A Convolutional Autoencoder for Multi-Subject fMRI Data Aggregation

no code implementations17 Aug 2016 Po-Hsuan Chen, Xia Zhu, Hejia Zhang, Javier S. Turek, Janice Chen, Theodore L. Willke, Uri Hasson, Peter J. Ramadge

We examine two ways to combine the ideas of a factor model and a searchlight based analysis to aggregate multi-subject fMRI data while preserving spatial locality.

Anatomy

Cannot find the paper you are looking for? You can Submit a new open access paper.