no code implementations • 1 Nov 2024 • Cristian Meo, Louis Mahon, Anirudh Goyal, Justin Dauwels
The proposed TC bound is grounded in information theory constructs, generalizes the $\beta$-VAE lower bound, and can be reduced to a convex combination of the known variational information bottleneck (VIB) and conditional entropy bottleneck (CEB) terms.
no code implementations • 21 Oct 2024 • Cristian Meo, Akihiro Nakano, Mircea Lică, Aniket Didolkar, Masahiro Suzuki, Anirudh Goyal, Mengmi Zhang, Justin Dauwels, Yutaka Matsuo, Yoshua Bengio
Unsupervised object-centric learning from videos is a promising approach towards learning compositional representations that can be applied to various downstream tasks, such as prediction and reasoning.
no code implementations • 10 Oct 2024 • Cristian Meo, Mircea Lica, Zarif Ikram, Akihiro Nakano, Vedant Shah, Aniket Rajiv Didolkar, Dianbo Liu, Anirudh Goyal, Justin Dauwels
Building on the Efficient Stochastic Transformer-based World Models (STORM) architecture, we replace the traditional MLP prior with a Masked Generative Prior (e. g., MaskGIT Prior) and introduce GIT-STORM.
no code implementations • 18 Jun 2024 • Cristian Meo, Ksenia Sycheva, Anirudh Goyal, Justin Dauwels
In this work, we propose Bayesian-LoRA which approaches low-rank adaptation and quantization from a Bayesian perspective by employing a prior distribution on both quantization levels and rank values.
no code implementations • 14 Jun 2024 • Junzhe Yin, Cristian Meo, Ankush Roy, Zeineh Bou Cher, Yanbo Wang, Ruben Imhoff, Remko Uijlenhoet, Justin Dauwels
The proposed model adopts a GAN structure, featuring a Vector Quantization Generative Adversarial Network (VQ-GAN) and a Transformer as the generator, with a temporal discriminator serving as the discriminator.
1 code implementation • 6 Mar 2024 • Cristian Meo, Ankush Roy, Mircea Lică, Junzhe Yin, Zeineb Bou Che, Yanbo Wang, Ruben Imhoff, Remko Uijlenhoet, Justin Dauwels
This paper presents an innovative approach to extreme precipitation nowcasting by employing Transformer-based generative models, namely NowcastingGPT with Extreme Value Loss (EVL) regularization.
no code implementations • 12 Jun 2023 • Yanbo Wang, Letao Liu, Justin Dauwels
Slot attention has shown remarkable object-centric representation learning performance in computer vision tasks without requiring any supervision.
1 code implementation • 31 May 2023 • Leibny Paola Garcia Perera, Y. H. Victoria Chua, Hexin Liu, Fei Ting Woon, Andy W. H. Khong, Justin Dauwels, Sanjeev Khudanpur, Suzy J. Styles
This paper introduces the inaugural Multilingual Everyday Recordings- Language Identification on Code-Switched Child-Directed Speech (MERLIon CCS) Challenge, focused on developing robust language identification and language diarization systems that are reliable for non-standard, accented, spontaneous code-switched, child-directed speech collected via Zoom.
1 code implementation • 30 May 2023 • Suzy J. Styles, Victoria Y. H. Chua, Fei Ting Woon, Hexin Liu, Leibny Paola Garcia Perera, Sanjeev Khudanpur, Andy W. H. Khong, Justin Dauwels
These overview metrics do not provide information about model performance at the level of individual speakers, recordings, or units of speech with different linguistic characteristics.
1 code implementation • 30 May 2023 • Victoria Y. H. Chua, Hexin Liu, Leibny Paola Garcia Perera, Fei Ting Woon, Jinyi Wong, Xiangyu Zhang, Sanjeev Khudanpur, Andy W. H. Khong, Justin Dauwels, Suzy J. Styles
To enhance the reliability and robustness of language identification (LID) and language diarization (LD) systems for heterogeneous populations and scenarios, there is a need for speech processing models to be trained on datasets that feature diverse language registers and speech patterns.
no code implementations • 8 Apr 2023 • Cristian Meo, Anirudh Goyal, Justin Dauwels
We show that the proposed model is able to uncover OOD generative factors on different datasets and outperforms on average the related baselines in terms of downstream disentanglement metrics.
no code implementations • 23 Feb 2023 • Andrea Piazzoni, Jim Cherian, Justin Dauwels, Lap-Pui Chau
In this article, we define Perception Error Models (PEM), a virtual simulation component that can enable the analysis of the impact of perception errors on AV safety, without the need to model the sensors themselves.
no code implementations • 21 Nov 2022 • Andrea Piazzoni, Jim Cherian, Roshan Vijay, Lap-Pui Chau, Justin Dauwels
In this paper, we introduce the notion of Cooperative Perception Error Models (coPEMs) towards achieving an effective and efficient integration of V2X solutions within a virtual test environment.
1 code implementation • 13 Sep 2022 • Rongkai Zhang, Cong Zhang, Zhiguang Cao, Wen Song, Puay Siew Tan, Jie Zhang, Bihan Wen, Justin Dauwels
We propose a manager-worker framework based on deep reinforcement learning to tackle a hard yet nontrivial variant of Travelling Salesman Problem (TSP), \ie~multiple-vehicle TSP with time window and rejections (mTSPTWR), where customers who cannot be served before the deadline are subject to rejections.
no code implementations • 4 Aug 2022 • Wei Yan Peh, Yuanyuan Yao, Justin Dauwels
Next, for each of these five types of artifacts, we combine the output of these channel-wise detectors to detect artifacts in multi-channel EEG segments.
no code implementations • 29 Jul 2022 • Wei Yan Peh, Prasanth Thangavel, Yuanyuan Yao, John Thomas, Yee Leng Tan, Justin Dauwels
In this study, we propose a patient-independent seizure detector to automatically detect seizures in both scalp EEG and intracranial EEG (iEEG).
1 code implementation • 7 Mar 2022 • Hexin Liu, Leibny Paola Garcia Perera, Andy W. H. Khong, Justin Dauwels, Suzy J. Styles, Sanjeev Khudanpur
In this paper, we propose to employ a dual-mode framework on the x-vector self-attention (XSA-LID) model with knowledge distillation (KD) to enhance its language identification (LID) performance for both long and short utterances.
no code implementations • 12 Jul 2021 • Rongkai Zhang, Jiang Zhu, Zhiyuan Zha, Justin Dauwels, Bihan Wen
To benchmark the effectiveness of reinforcement learning in R3L, we train a recurrent neural network with the same architecture for residual recovery using the deterministic loss, thus to analyze how the two different training strategies affect the denoising performance.
Ranked #1 on
Image Denoising
on BSD68 sigma30
no code implementations • 1 Jan 2021 • Letao Liu, Martin Saerbeck, Justin Dauwels
This paper proposes Affine Disentangled GAN (ADIS-GAN), which is a Generative Adversarial Network that can explicitly disentangle affine transformations in a self-supervised and rigorous manner.
no code implementations • 28 Sep 2020 • Wei Yan Peh, John Thomas, Elham Bagheri, Rima Chaudhari, Sagar Karia, Rahul Rathakrishnan, Vinay Saini, Nilesh Shah, Rohit Srivastava, Yee-Leng Tan, Justin Dauwels
The TDS, SLDS, and DLDS performs prediction via detecting slowing at individual channels, and those detections are arranged in histograms for detection of slowing at the segment- and EEG-level.
no code implementations • 16 Sep 2020 • Hang Yu, Songwei Wu, Justin Dauwels
Estimating time-varying graphical models are of paramount importance in various social, financial, biological, and engineering systems, since the evolution of such networks can be utilized for example to spot trends, detect anomalies, predict vulnerability, and evaluate the impact of interventions.
no code implementations • 31 Aug 2020 • Inon Peled, Kelvin Lee, Yu Jiang, Justin Dauwels, Francisco C. Pereira
Our results suggest that the optimized performance is mainly affected by the skew of the noise distribution and the presence of infrequently large prediction errors.
no code implementations • 31 Jan 2020 • Andrea Piazzoni, Jim Cherian, Martin Slavik, Justin Dauwels
Sensing and Perception (S&P) is a crucial component of an autonomous system (such as a robot), especially when deployed in highly dynamic environments where it is required to react to unexpected situations.
1 code implementation • 9 Nov 2019 • Satyajit Neogi, Justin Dauwels
In addition, LSTM based models display inconsistent performance across validation and test data, and pose diffculty to select models on validation data during our experiments.
1 code implementation • 27 Jul 2019 • Satyajit Neogi, Michael Hoy, Kang Dang, Hang Yu, Justin Dauwels
Such systems call for early and accurate prediction of a pedestrian's crossing/not-crossing behaviour in front of the vehicle.
no code implementations • 6 Jul 2019 • Letao Liu, Martin Saerbeck, Justin Dauwels
Autonomous vehicles (AV) have progressed rapidly with the advancements in computer vision algorithms.
no code implementations • 26 Feb 2019 • Inon Peled, Kelvin Lee, Yu Jiang, Justin Dauwels, Francisco C. Pereira
This study develops an online predictive optimization framework for dynamically operating a transit service in an area of crowd movements.
no code implementations • 23 Jul 2018 • Kang Dang, Chunluan Zhou, Zhigang Tu, Michael Hoy, Justin Dauwels, Junsong Yuan
One major challenge for this task is that when an actor performs an action, different body parts of the actor provide different types of cues for the action category and may receive inconsistent action labeling when they are labeled independently.
no code implementations • 29 Jun 2018 • Song Guang Ho, Ramesh Ramasamy Pandi, Sarat Chandra Nagavarapu, Justin Dauwels
It is observed that MATA attains a first feasible solution 29. 8 to 65. 1% faster, and obtains a final solution that is 3. 9 to 5. 2% better, when compared to other algorithms within 60 sec.
no code implementations • 25 Jan 2018 • Songguang Ho, Sarat Chandra Nagavarapu, Ramesh Ramasamy Pandi, Justin Dauwels
Multi-vehicle routing has become increasingly important with the rapid development of autonomous vehicle technology.
no code implementations • 16 Nov 2017 • Tejas Dharamsi, Payel Das, Tejaswini Pedapati, Gregory Bramble, Vinod Muthusamy, Horst Samulowitz, Kush R. Varshney, Yuvaraj Rajamanickam, John Thomas, Justin Dauwels
In this work, we present a cloud-based deep neural network approach to provide decision support for non-specialist physicians in EEG analysis and interpretation.