no code implementations • 14 Mar 2024 • Yi-Lun Liao, Tess Smidt, Abhishek Das
We study the effectiveness of training equivariant networks with DeNS on OC20, OC22 and MD17 datasets and demonstrate that DeNS can achieve new state-of-the-art results on OC20 and OC22 and significantly improve training efficiency on MD17.
1 code implementation • 21 Jun 2023 • Yi-Lun Liao, Brandon Wood, Abhishek Das, Tess Smidt
Equivariant Transformers such as Equiformer have demonstrated the efficacy of applying Transformers to the domain of 3D atomistic systems.
3 code implementations • 23 Jun 2022 • Yi-Lun Liao, Tess Smidt
Despite their widespread success in various domains, Transformer networks have yet to perform well across datasets in the domain of 3D atomistic graphs such as molecules even when 3D-related inductive biases like translational invariance and rotational equivariance are considered.
Graph Attention Initial Structure to Relaxed Energy (IS2RE), Direct
no code implementations • 4 Oct 2021 • Cheng-I Jeff Lai, Erica Cooper, Yang Zhang, Shiyu Chang, Kaizhi Qian, Yi-Lun Liao, Yung-Sung Chuang, Alexander H. Liu, Junichi Yamagishi, David Cox, James Glass
Are end-to-end text-to-speech (TTS) models over-parametrized?
1 code implementation • 1 Sep 2021 • Yi-Lun Liao, Sertac Karaman, Vivienne Sze
This naturally raises the question of how the performance of ViT can be advanced with design techniques of CNN.
no code implementations • NeurIPS 2021 • Cheng-I Jeff Lai, Yang Zhang, Alexander H. Liu, Shiyu Chang, Yi-Lun Liao, Yung-Sung Chuang, Kaizhi Qian, Sameer Khurana, David Cox, James Glass
We investigate the existence of sparse subnetworks in pre-trained speech SSL models that achieve even better low-resource ASR results.
Automatic Speech Recognition Automatic Speech Recognition (ASR) +3
no code implementations • CVPR 2021 • Tien-Ju Yang, Yi-Lun Liao, Vivienne Sze
Neural architecture search (NAS) typically consists of three main steps: training a super-network, training and evaluating sampled deep neural networks (DNNs), and training the discovered DNN.
no code implementations • 29 Nov 2018 • Yi-Lun Liao, Yao-Cheng Yang, Yu-Chiang Frank Wang
Aiming at inferring 3D shapes from 2D images, 3D shape reconstruction has drawn huge attention from researchers in computer vision and deep learning communities.
3D Reconstruction 3D Shape Reconstruction From A Single 2D Image +1