Search Results for author: Yingheng Wang

Found 11 papers, 7 papers with code

Denoising Diffusion Variational Inference: Diffusion Models as Expressive Variational Posteriors

no code implementations5 Jan 2024 Top Piriyakulkij, Yingheng Wang, Volodymyr Kuleshov

We propose denoising diffusion variational inference (DDVI), an approximate inference algorithm for latent variable models which relies on diffusion models as flexible variational posteriors.

Denoising Variational Inference

ModuLoRA: Finetuning 2-Bit LLMs on Consumer GPUs by Integrating with Modular Quantizers

3 code implementations28 Sep 2023 Junjie Yin, Jiahao Dong, Yingheng Wang, Christopher De Sa, Volodymyr Kuleshov

We propose a memory-efficient finetuning algorithm for large language models (LLMs) that supports finetuning LLMs with 65B parameters in 2/3/4-bit precision on as little as one 24GB GPU.

Instruction Following Natural Language Inference +3

InfoDiffusion: Representation Learning Using Information Maximizing Diffusion Models

no code implementations14 Jun 2023 Yingheng Wang, Yair Schiff, Aaron Gokaslan, Weishen Pan, Fei Wang, Christopher De Sa, Volodymyr Kuleshov

While diffusion models excel at generating high-quality samples, their latent variables typically lack semantic meaning and are not suitable for representation learning.

Representation Learning

Time Series Contrastive Learning with Information-Aware Augmentations

1 code implementation21 Mar 2023 Dongsheng Luo, Wei Cheng, Yingheng Wang, Dongkuan Xu, Jingchao Ni, Wenchao Yu, Xuchao Zhang, Yanchi Liu, Yuncong Chen, Haifeng Chen, Xiang Zhang

A key component of contrastive learning is to select appropriate augmentations imposing some priors to construct feasible positive samples, such that an encoder can be trained to learn robust and discriminative representations.

Contrastive Learning Open-Ended Question Answering +2

Xtal2DoS: Attention-based Crystal to Sequence Learning for Density of States Prediction

no code implementations3 Feb 2023 Junwen Bai, Yuanqi Du, Yingheng Wang, Shufeng Kong, John Gregoire, Carla Gomes

Modern machine learning techniques have been extensively applied to materials science, especially for property prediction tasks.

Property Prediction

Going Deeper into Permutation-Sensitive Graph Neural Networks

1 code implementation28 May 2022 Zhongyu Huang, Yingheng Wang, Chaozhuo Li, Huiguang He

We prove that our approach is strictly more powerful than the 2-dimensional Weisfeiler-Lehman (2-WL) graph isomorphism test and not less powerful than the 3-WL test.

Graph Data Augmentation for Graph Machine Learning: A Survey

1 code implementation17 Feb 2022 Tong Zhao, Wei Jin, Yozen Liu, Yingheng Wang, Gang Liu, Stephan Günnemann, Neil Shah, Meng Jiang

Overall, our work aims to clarify the landscape of existing literature in graph data augmentation and motivates additional work in this area, providing a helpful resource for researchers and practitioners in the broader graph machine learning domain.

BIG-bench Machine Learning Data Augmentation

Information-Aware Time Series Meta-Contrastive Learning

no code implementations29 Sep 2021 Dongsheng Luo, Wei Cheng, Yingheng Wang, Dongkuan Xu, Jingchao Ni, Wenchao Yu, Xuchao Zhang, Yanchi Liu, Haifeng Chen, Xiang Zhang

How to find the desired augmentations of time series data that are meaningful for given contrastive learning tasks and datasets remains an open question.

Contrastive Learning Meta-Learning +4

One-shot Transfer Learning for Population Mapping

1 code implementation13 Aug 2021 Erzhuo Shao, Jie Feng, Yingheng Wang, Tong Xia, Yong Li

Thus, obtaining fine-grained population distribution from coarse-grained distribution becomes an important problem.

Population Mapping Scheduling +1

Cannot find the paper you are looking for? You can Submit a new open access paper.