Search Results for author: Yew-Soon Ong

Found 35 papers, 12 papers with code

CAN-PINN: A Fast Physics-Informed Neural Network Based on Coupled-Automatic-Numerical Differentiation Method

no code implementations29 Oct 2021 Pao-Hsiung Chiu, Jian Cheng Wong, Chinchun Ooi, My Ha Dao, Yew-Soon Ong

In this study, novel physics-informed neural network (PINN) methods for coupling neighboring support points and automatic differentiation (AD) through Taylor series expansion are proposed to allow efficient training with improved accuracy.

Half a Dozen Real-World Applications of Evolutionary Multitasking and More

no code implementations27 Sep 2021 Abhishek Gupta, Lei Zhou, Yew-Soon Ong, Zefeng Chen, Yaqing Hou

Until recently, the potential to transfer evolved skills across distinct optimization problem instances (or tasks) was seldom explored in evolutionary computation.

Learning in Sinusoidal Spaces with Physics-Informed Neural Networks

no code implementations20 Sep 2021 Jian Cheng Wong, Chinchun Ooi, Abhishek Gupta, Yew-Soon Ong

A physics-informed neural network (PINN) uses physics-augmented loss functions, e. g., incorporating the residual term from governing differential equations, to ensure its output is consistent with fundamental physics laws.

Word2Pix: Word to Pixel Cross Attention Transformer in Visual Grounding

no code implementations31 Jul 2021 Heng Zhao, Joey Tianyi Zhou, Yew-Soon Ong

Current one-stage methods for visual grounding encode the language query as one holistic sentence embedding before fusion with visual feature.

Sentence Embedding Visual Grounding

Multi-Party Dual Learning

no code implementations14 Apr 2021 Maoguo Gong, Yuan Gao, Yu Xie, A. K. Qin, Ke Pan, Yew-Soon Ong

The performance of machine learning algorithms heavily relies on the availability of a large amount of training data.

RNA Alternative Splicing Prediction with Discrete Compositional Energy Network

1 code implementation7 Mar 2021 Alvin Chan, Anna Korsakova, Yew-Soon Ong, Fernaldo Richtia Winnerdy, Kah Wai Lim, Anh Tuan Phan

In the case of alternative splicing prediction, DCEN models mRNA transcript probabilities through its constituent splice junctions' energy values.

Multi-Space Evolutionary Search for Large-Scale Optimization

no code implementations23 Feb 2021 Liang Feng, Qingxia Shang, Yaqing Hou, Kay Chen Tan, Yew-Soon Ong

This paper thus proposes a new search paradigm, namely the multi-space evolutionary search, to enhance the existing evolutionary search methods for solving large-scale optimization problems.

Dimensionality Reduction

Learning Conjoint Attentions for Graph Neural Nets

1 code implementation NeurIPS 2021 Tiantian He, Yew-Soon Ong, Lu Bai

Given the novel Conjoint Attention strategies, we then propose Graph conjoint attention networks (CATs) that can learn representations embedded with significant latent features deemed by the Conjoint Attentions.

Graph Attention

Can Transfer Neuroevolution Tractably Solve Your Differential Equations?

no code implementations6 Jan 2021 Jian Cheng Wong, Abhishek Gupta, Yew-Soon Ong

In the context of solving differential equations, we are faced with the problem of finding globally optimum parameters of the network, instead of being concerned with out-of-sample generalization.

Scalable Transfer Evolutionary Optimization: Coping with Big Task Instances

1 code implementation3 Dec 2020 Mojtaba Shakeri, Erfan Miahi, Abhishek Gupta, Yew-Soon Ong

In today's digital world, we are confronted with an explosion of data and models produced and manipulated by numerous large-scale IoT/cloud-based applications.

Graph Joint Attention Networks

no code implementations28 Sep 2020 Tiantian He, Lu Bai, Yew-Soon Ong

In this paper, we propose Graph Joint Attention Networks (JATs) to address the aforementioned challenge.

Graph Attention Node Classification

Modulating Scalable Gaussian Processes for Expressive Statistical Learning

1 code implementation29 Aug 2020 Haitao Liu, Yew-Soon Ong, Xiaomo Jiang, Xiaofang Wang

For a learning task, Gaussian process (GP) is interested in learning the statistical relationship between inputs and outputs, since it offers not only the prediction mean but also the associated variability.

Gaussian Processes Variational Inference

Adversary Agnostic Robust Deep Reinforcement Learning

no code implementations14 Aug 2020 Xinghua Qu, Yew-Soon Ong, Abhishek Gupta, Zhu Sun

Motivated by this finding, we propose a new policy distillation loss with two terms: 1) a prescription gap maximization loss aiming at simultaneously maximizing the likelihood of the action selected by the teacher policy and the entropy over the remaining actions; 2) a corresponding Jacobian regularization loss that minimizes the magnitude of the gradient with respect to the input state.

Adversarial Robustness Atari Games

CoCon: A Self-Supervised Approach for Controlled Text Generation

1 code implementation ICLR 2021 Alvin Chan, Yew-Soon Ong, Bill Pung, Aston Zhang, Jie Fu

While there are studies that seek to control high-level attributes (such as sentiment and topic) of generated text, there is still a lack of more precise control over its content at the word- and phrase-level.

Text Generation

Deep Latent-Variable Kernel Learning

1 code implementation18 May 2020 Haitao Liu, Yew-Soon Ong, Xiaomo Jiang, Xiaofang Wang

Deep kernel learning (DKL) leverages the connection between Gaussian process (GP) and neural networks (NN) to build an end-to-end, hybrid model.

Heterogeneous Representation Learning: A Review

no code implementations28 Apr 2020 Joey Tianyi Zhou, Xi Peng, Yew-Soon Ong

The real-world data usually exhibits heterogeneous properties such as modalities, views, or resources, which brings some unique challenges wherein the key is Heterogeneous Representation Learning (HRL) termed in this paper.

Multi-Task Learning MULTI-VIEW LEARNING +1

What it Thinks is Important is Important: Robustness Transfers through Input Gradients

2 code implementations CVPR 2020 Alvin Chan, Yi Tay, Yew-Soon Ong

Learned weights of models robust to such perturbations are previously found to be transferable across different tasks but this applies only if the model architecture for the source and target tasks is the same.

Adversarial Robustness

Poison as a Cure: Detecting & Neutralizing Variable-Sized Backdoor Attacks in Deep Neural Networks

no code implementations19 Nov 2019 Alvin Chan, Yew-Soon Ong

Existing defenses are effective under certain conditions such as a small size of the poison pattern, knowledge about the ratio of poisoned training samples or when a validated clean dataset is available.

A Multi-Task Gradient Descent Method for Multi-Label Learning

no code implementations18 Nov 2019 Lu Bai, Yew-Soon Ong, Tiantian He, Abhishek Gupta

Multi-label learning studies the problem where an instance is associated with a set of labels.

Multi-Label Learning

Scalable Gaussian Process Classification with Additive Noise for Various Likelihoods

1 code implementation14 Sep 2019 Haitao Liu, Yew-Soon Ong, Ziwei Yu, Jianfei Cai, Xiaobo Shen

Gaussian process classification (GPC) provides a flexible and powerful statistical framework describing joint distributions over function space.

General Classification GPR +2

A Survey on Multi-output Learning

no code implementations2 Jan 2019 Donna Xu, Yaxin Shi, Ivor W. Tsang, Yew-Soon Ong, Chen Gong, Xiaobo Shen

Multi-output learning aims to simultaneously predict multiple outputs given an input.

Decision Making

AIR5: Five Pillars of Artificial Intelligence Research

no code implementations30 Dec 2018 Yew-Soon Ong, Abhishek Gupta

In this article, we provide and overview of what we consider to be some of the most pressing research questions facing the fields of artificial intelligence (AI) and computational intelligence (CI); with the latter focusing on algorithms that are inspired by various natural phenomena.

Artificial Life

Towards Safer Smart Contracts: A Sequence Learning Approach to Detecting Vulnerabilities

1 code implementation16 Nov 2018 Wesley Joon-Wie Tann, Xing Jie Han, Sourav Sen Gupta, Yew-Soon Ong

In particular, we propose a novel approach of sequential learning of smart contract vulnerabilities using machine learning --- long-short term memory (LSTM) --- that perpetually learns from an increasing number of contracts handled over time, leading to safer smart contracts.

Cryptography and Security

Understanding and Comparing Scalable Gaussian Process Regression for Big Data

no code implementations3 Nov 2018 Haitao Liu, Jianfei Cai, Yew-Soon Ong, Yi Wang

This paper devotes to investigating the methodological characteristics and performance of representative global and local scalable GPs including sparse approximations and local aggregations from four main perspectives: scalability, capability, controllability and robustness.

Large-scale Heteroscedastic Regression via Gaussian Process

no code implementations3 Nov 2018 Haitao Liu, Yew-Soon Ong, Jianfei Cai

To improve the scalability, we first develop a variational sparse inference algorithm, named VSHGP, to handle large-scale datasets.

Variational Inference

When Gaussian Process Meets Big Data: A Review of Scalable GPs

no code implementations3 Jul 2018 Haitao Liu, Yew-Soon Ong, Xiaobo Shen, Jianfei Cai

The review of scalable GPs in the GP community is timely and important due to the explosion of data size.

Generalized Robust Bayesian Committee Machine for Large-scale Gaussian Process Regression

1 code implementation ICML 2018 Haitao Liu, Jianfei Cai, Yi Wang, Yew-Soon Ong

In order to scale standard Gaussian process (GP) regression to large-scale datasets, aggregation models employ factorized training process and then combine predictions from distributed experts.

Distributed Computing

Evolutionary Multitasking for Single-objective Continuous Optimization: Benchmark Problems, Performance Metric, and Baseline Results

no code implementations12 Jun 2017 Bingshui Da, Yew-Soon Ong, Liang Feng, A. K. Qin, Abhishek Gupta, Zexuan Zhu, Chuan-Kang Ting, Ke Tang, Xin Yao

In this report, we suggest nine test problems for multi-task single-objective optimization (MTSOO), each of which consists of two single-objective optimization tasks that need to be solved simultaneously.

Evolutionary Multitasking for Multiobjective Continuous Optimization: Benchmark Problems, Performance Metrics and Baseline Results

no code implementations8 Jun 2017 Yuan Yuan, Yew-Soon Ong, Liang Feng, A. K. Qin, Abhishek Gupta, Bingshui Da, Qingfu Zhang, Kay Chen Tan, Yaochu Jin, Hisao Ishibuchi

In this report, we suggest nine test problems for multi-task multi-objective optimization (MTMOO), each of which consists of two multiobjective optimization tasks that need to be solved simultaneously.

Multiobjective Optimization

Co-evolutionary multi-task learning for dynamic time series prediction

1 code implementation27 Feb 2017 Rohitash Chandra, Yew-Soon Ong, Chi-Keong Goh

In this paper, we propose a co-evolutionary multi-task learning method that provides a synergy between multi-task learning and co-evolutionary algorithms to address dynamic time series prediction.

Multi-Task Learning Time Series +1

Genetic Transfer or Population Diversification? Deciphering the Secret Ingredients of Evolutionary Multitask Optimization

no code implementations19 Jul 2016 Abhishek Gupta, Yew-Soon Ong

Evolutionary multitasking has recently emerged as a novel paradigm that enables the similarities and/or latent complementarities (if present) between distinct optimization tasks to be exploited in an autonomous manner simply by solving them together with a unified solution representation scheme.

Adaptive Subgradient Methods for Online AUC Maximization

no code implementations1 Feb 2016 Yi Ding, Peilin Zhao, Steven C. H. Hoi, Yew-Soon Ong

Despite their encouraging results reported, the existing online AUC maximization algorithms often adopt simple online gradient descent approaches that fail to exploit the geometrical knowledge of the data observed during the online learning process, and thus could suffer from relatively larger regret.

Cannot find the paper you are looking for? You can Submit a new open access paper.