no code implementations • 24 Oct 2023 • Zhengqi Gao, Fan-Keng Sun, Ron Rohrer, Duane S. Boning
Essentially, KirchhoffNet is an analog circuit that can function as a neural network, utilizing its initial node voltages as the neural network input and the node voltages at a specific time point as the output.
1 code implementation • 22 Jul 2022 • Zhengqi Gao, Fan-Keng Sun, Mingran Yang, Sucheng Ren, Zikai Xiong, Marc Engeler, Antonio Burazer, Linda Wildling, Luca Daniel, Duane S. Boning
Data lies at the core of modern deep learning.
no code implementations • 24 May 2022 • Fan-Keng Sun, Duane S. Boning
Finally, we validate that the frequency domain is indeed better by comparing univariate models trained in the frequency v. s.
1 code implementation • NeurIPS 2021 • Fan-Keng Sun, Christopher I. Lang, Duane S. Boning
A common assumption in training neural networks via maximum likelihood estimation on time series is that the errors across time steps are uncorrelated.
no code implementations • 14 Nov 2020 • Fan-Keng Sun, Cheng-I Lai
Transformer-based language models have shown to be very powerful for natural language generation (NLG).
no code implementations • 2 Mar 2020 • Kyongmin Yeo, Dylan E. C. Grullon, Fan-Keng Sun, Duane S. Boning, Jayant R. Kalagnanam
Unlike the classical variational inference, where a factorized distribution is used to approximate the posterior, we employ a feedforward neural network supplemented by an encoder recurrent neural network to develop a more flexible probabilistic model.
1 code implementation • ICLR 2020 • Fan-Keng Sun, Cheng-Hao Ho, Hung-Yi Lee
We present LAMOL, a simple yet effective method for lifelong language learning (LLL) based on language modeling.
Ranked #4 on Continual Learning on ASC (19 tasks)
4 code implementations • 12 Sep 2018 • Shun-Yao Shih, Fan-Keng Sun, Hung-Yi Lee
To obtain accurate prediction, it is crucial to model long-term dependency in time series data, which can be achieved to some good extent by recurrent neural network (RNN) with attention mechanism.
Ranked #2 on Univariate Time Series Forecasting on Electricity