Search Results for author: Yang Li

Found 436 papers, 124 papers with code

Cluster-GCN: An Efficient Algorithm for Training Deep and Large Graph Convolutional Networks

6 code implementations KDD 2019 Wei-Lin Chiang, Xuanqing Liu, Si Si, Yang Li, Samy Bengio, Cho-Jui Hsieh

Furthermore, Cluster-GCN allows us to train much deeper GCN without much time and memory overhead, which leads to improved prediction accuracy---using a 5-layer Cluster-GCN, we achieve state-of-the-art test F1 score 99. 36 on the PPI dataset, while the previous best result was 98. 71 by [16].

Clustering Computational Efficiency +4

Mapping Natural Language Instructions to Mobile UI Action Sequences

2 code implementations ACL 2020 Yang Li, Jiacong He, Xin Zhou, Yuan Zhang, Jason Baldridge

We present a new problem: grounding natural language instructions to mobile user interface actions, and create three new datasets for it.

Position

Predicting and Explaining Mobile UI Tappability with Vision Modeling and Saliency Analysis

1 code implementation5 Apr 2022 Eldon Schoop, Xin Zhou, Gang Li, Zhourong Chen, Björn Hartmann, Yang Li

We use a deep learning based approach to predict whether a selected element in a mobile UI screenshot will be perceived by users as tappable, based on pixels only instead of view hierarchies required by previous work.

Enabling Conversational Interaction with Mobile UI using Large Language Models

1 code implementation18 Sep 2022 Bryan Wang, Gang Li, Yang Li

This paper investigates the feasibility of enabling versatile conversational interactions with mobile UIs using a single LLM.

Automatic Macro Mining from Interaction Traces at Scale

1 code implementation10 Oct 2023 Forrest Huang, Gang Li, Tao Li, Yang Li

Macros are building block tasks of our everyday smartphone activity (e. g., "login", or "booking a flight").

Rich Human Feedback for Text-to-Image Generation

1 code implementation15 Dec 2023 Youwei Liang, Junfeng He, Gang Li, Peizhao Li, Arseniy Klimovskiy, Nicholas Carolan, Jiao Sun, Jordi Pont-Tuset, Sarah Young, Feng Yang, Junjie Ke, Krishnamurthy Dj Dvijotham, Katie Collins, Yiwen Luo, Yang Li, Kai J Kohlhoff, Deepak Ramachandran, Vidhya Navalpakkam

We show that the predicted rich human feedback can be leveraged to improve image generation, for example, by selecting high-quality training data to finetune and improve the generative models, or by creating masks with predicted heatmaps to inpaint the problematic regions.

Text-to-Image Generation

Screen2Words: Automatic Mobile UI Summarization with Multimodal Learning

2 code implementations7 Aug 2021 Bryan Wang, Gang Li, Xin Zhou, Zhourong Chen, Tovi Grossman, Yang Li

Mobile User Interface Summarization generates succinct language descriptions of mobile screens for conveying important contents and functionalities of the screen, which can be useful for many language-based application scenarios.

CodeGeeX: A Pre-Trained Model for Code Generation with Multilingual Evaluations on HumanEval-X

2 code implementations30 Mar 2023 Qinkai Zheng, Xiao Xia, Xu Zou, Yuxiao Dong, Shan Wang, Yufei Xue, Zihan Wang, Lei Shen, Andi Wang, Yang Li, Teng Su, Zhilin Yang, Jie Tang

Large pre-trained code generation models, such as OpenAI Codex, can generate syntax- and function-correct code, making the coding of programmers more productive and our pursuit of artificial general intelligence closer.

Code Generation

Delving into the Devils of Bird's-eye-view Perception: A Review, Evaluation and Recipe

2 code implementations12 Sep 2022 Hongyang Li, Chonghao Sima, Jifeng Dai, Wenhai Wang, Lewei Lu, Huijie Wang, Jia Zeng, Zhiqi Li, Jiazhi Yang, Hanming Deng, Hao Tian, Enze Xie, Jiangwei Xie, Li Chen, Tianyu Li, Yang Li, Yulu Gao, Xiaosong Jia, Si Liu, Jianping Shi, Dahua Lin, Yu Qiao

As sensor configurations get more complex, integrating multi-source information from different sensors and representing features in a unified view come of vital importance.

Autonomous Driving

GCNs-Net: A Graph Convolutional Neural Network Approach for Decoding Time-resolved EEG Motor Imagery Signals

1 code implementation16 Jun 2020 Yimin Hou, Shuyue Jia, Xiangmin Lun, Ziqian Hao, Yan Shi, Yang Li, Rui Zeng, Jinglei Lv

To conclude, the GCNs-Net filters EEG signals based on the functional topological relationship, which manages to decode relevant features for brain motor imagery.

EEG Motor Imagery

Attention-based Graph ResNet for Motor Intent Detection from Raw EEG signals

1 code implementation25 Jun 2020 Shuyue Jia, Yimin Hou, Yan Shi, Yang Li

In previous studies, decoding electroencephalography (EEG) signals has not considered the topological relationship of EEG electrodes.

EEG Intent Detection +2

Robust Estimation of Similarity Transformation for Visual Object Tracking

2 code implementations14 Dec 2017 Yang Li, Jianke Zhu, Steven C. H. Hoi, Wenjie Song, Zhefeng Wang, Hantang Liu

In order to efficiently search in such a large 4-DoF space in real-time, we formulate the problem into two 2-DoF sub-problems and apply an efficient Block Coordinates Descent solver to optimize the estimation result.

Object Visual Object Tracking

PersFormer: 3D Lane Detection via Perspective Transformer and the OpenLane Benchmark

2 code implementations21 Mar 2022 Li Chen, Chonghao Sima, Yang Li, Zehan Zheng, Jiajie Xu, Xiangwei Geng, Hongyang Li, Conghui He, Jianping Shi, Yu Qiao, Junchi Yan

Methods for 3D lane detection have been recently proposed to address the issue of inaccurate lane layouts in many autonomous driving scenarios (uphill/downhill, bump, etc.).

3D Lane Detection Autonomous Driving +1

Open-sourced Data Ecosystem in Autonomous Driving: the Present and Future

2 code implementations6 Dec 2023 Hongyang Li, Yang Li, Huijie Wang, Jia Zeng, Huilin Xu, Pinlong Cai, Li Chen, Junchi Yan, Feng Xu, Lu Xiong, Jingdong Wang, Futang Zhu, Chunjing Xu, Tiancai Wang, Fei Xia, Beipeng Mu, Zhihui Peng, Dahua Lin, Yu Qiao

With the continuous maturation and application of autonomous driving technology, a systematic examination of open-source autonomous driving datasets becomes instrumental in fostering the robust evolution of the industry ecosystem.

Autonomous Driving

OpenBox: A Generalized Black-box Optimization Service

6 code implementations1 Jun 2021 Yang Li, Yu Shen, Wentao Zhang, Yuanwei Chen, Huaijun Jiang, Mingchao Liu, Jiawei Jiang, Jinyang Gao, Wentao Wu, Zhi Yang, Ce Zhang, Bin Cui

Black-box optimization (BBO) has a broad range of applications, including automatic machine learning, engineering, physics, and experimental design.

Experimental Design Transfer Learning

Automated Hyperparameter Optimization Challenge at CIKM 2021 AnalyticCup

1 code implementation31 Oct 2021 Huaijun Jiang, Yu Shen, Yang Li

In this paper, we describe our method for tackling the automated hyperparameter optimization challenge in QQ Browser 2021 AI Algorithm Competiton (ACM CIKM 2021 AnalyticCup Track 2).

Bayesian Optimization Hyperparameter Optimization

OpenBox: A Python Toolkit for Generalized Black-box Optimization

1 code implementation26 Apr 2023 Huaijun Jiang, Yu Shen, Yang Li, Beicheng Xu, Sixian Du, Wentao Zhang, Ce Zhang, Bin Cui

Black-box optimization (BBO) has a broad range of applications, including automatic machine learning, experimental design, and database knob tuning.

Experimental Design

4DComplete: Non-Rigid Motion Estimation Beyond the Observable Surface

1 code implementation ICCV 2021 Yang Li, Hikari Takehara, Takafumi Taketomi, Bo Zheng, Matthias Nießner

Tracking non-rigidly deforming scenes using range sensors has numerous applications including computer vision, AR/VR, and robotics.

Motion Estimation

Counterfactual Explanations for Face Forgery Detection via Adversarial Removal of Artifacts

2 code implementations12 Apr 2024 Yang Li, Songlin Yang, Wei Wang, Ziwen He, Bo Peng, Jing Dong

We verify the effectiveness of the proposed explanations from two aspects: (1) Counterfactual Trace Visualization: the enhanced forgery images are useful to reveal artifacts by visually contrasting the original images and two different visualization methods; (2) Transferable Adversarial Attacks: the adversarial forgery images generated by attacking the detection model are able to mislead other detection models, implying the removed artifacts are general.

Adversarial Attack counterfactual

Non-rigid Point Cloud Registration with Neural Deformation Pyramid

1 code implementation25 May 2022 Yang Li, Tatsuya Harada

Non-rigid point cloud registration is a key component in many computer vision and computer graphics applications.

Point Cloud Registration

PaSca: a Graph Neural Architecture Search System under the Scalable Paradigm

1 code implementation1 Mar 2022 Wentao Zhang, Yu Shen, Zheyu Lin, Yang Li, Xiaosen Li, Wen Ouyang, Yangyu Tao, Zhi Yang, Bin Cui

Through deconstructing the message passing mechanism, PasCa presents a novel Scalable Graph Neural Architecture Paradigm (SGAP), together with a general architecture design space consisting of 150k different designs.

Neural Architecture Search

MFES-HB: Efficient Hyperband with Multi-Fidelity Quality Measurements

5 code implementations5 Dec 2020 Yang Li, Yu Shen, Jiawei Jiang, Jinyang Gao, Ce Zhang, Bin Cui

Instead of sampling configurations randomly in HB, BOHB samples configurations based on a BO surrogate model, which is constructed with the high-fidelity measurements only.

Bayesian Optimization Hyperparameter Optimization

Robustness Verification of Tree-based Models

2 code implementations NeurIPS 2019 Hongge Chen, huan zhang, Si Si, Yang Li, Duane Boning, Cho-Jui Hsieh

We show that there is a simple linear time algorithm for verifying a single tree, and for tree ensembles, the verification problem can be cast as a max-clique problem on a multi-partite graph with bounded boxicity.

Swin Transformer for Fast MRI

2 code implementations10 Jan 2022 Jiahao Huang, Yingying Fang, Yinzhe Wu, Huanjun Wu, Zhifan Gao, Yang Li, Javier Del Ser, Jun Xia, Guang Yang

The IM and OM were 2D convolutional layers and the FEM was composed of a cascaded of residual Swin transformer blocks (RSTBs) and 2D convolutional layers.

MRI Reconstruction

VolcanoML: Speeding up End-to-End AutoML via Scalable Search Space Decomposition

3 code implementations19 Jul 2021 Yang Li, Yu Shen, Wentao Zhang, Jiawei Jiang, Bolin Ding, Yaliang Li, Jingren Zhou, Zhi Yang, Wentao Wu, Ce Zhang, Bin Cui

End-to-end AutoML has attracted intensive interests from both academia and industry, which automatically searches for ML pipelines in a space induced by feature engineering, algorithm/model selection, and hyper-parameter tuning.

AutoML Feature Engineering +1

Homography Decomposition Networks for Planar Object Tracking

3 code implementations15 Dec 2021 Xinrui Zhan, Yueran Liu, Jianke Zhu, Yang Li

Planar object tracking plays an important role in AI applications, such as robotics, visual servoing, and visual SLAM.

Object Object Tracking

Relational Learning with Gated and Attentive Neighbor Aggregator for Few-Shot Knowledge Graph Completion

1 code implementation27 Apr 2021 Guanglin Niu, Yang Li, Chengguang Tang, Ruiying Geng, Jian Dai, Qiao Liu, Hao Wang, Jian Sun, Fei Huang, Luo Si

Moreover, modeling and inferring complex relations of one-to-many (1-N), many-to-one (N-1), and many-to-many (N-N) by previous knowledge graph completion approaches requires high model complexity and a large amount of training instances.

Few-Shot Learning Relational Reasoning

GMSS: Graph-Based Multi-Task Self-Supervised Learning for EEG Emotion Recognition

1 code implementation12 Apr 2022 Yang Li, Ji Chen, Fu Li, Boxun Fu, Hao Wu, Youshuo Ji, Yijin Zhou, Yi Niu, Guangming Shi, Wenming Zheng

GMSS has the ability to learn more general representations by integrating multiple self-supervised tasks, including spatial and frequency jigsaw puzzle tasks, and contrastive learning tasks.

Contrastive Learning EEG +2

MSPKmerCounter: A Fast and Memory Efficient Approach for K-mer Counting

1 code implementation25 May 2015 Yang Li, XifengYan

For the task of k-mer counting, MSPKmerCounter offers a very fast and memory-efficient solution.

Improved Techniques for Learning to Dehaze and Beyond: A Collective Study

1 code implementation30 Jun 2018 Yu Liu, Guanlong Zhao, Boyuan Gong, Yang Li, Ritu Raj, Niraj Goel, Satya Kesav, Sandeep Gottimukkala, Zhangyang Wang, Wenqi Ren, DaCheng Tao

Here we explore two related but important tasks based on the recently released REalistic Single Image DEhazing (RESIDE) benchmark dataset: (i) single image dehazing as a low-level image restoration problem; and (ii) high-level visual understanding (e. g., object detection) of hazy images.

Image Dehazing Image Restoration +4

Efficient End-to-End AutoML via Scalable Search Space Decomposition

1 code implementation19 Jun 2022 Yang Li, Yu Shen, Wentao Zhang, Ce Zhang, Bin Cui

End-to-end AutoML has attracted intensive interests from both academia and industry which automatically searches for ML pipelines in a space induced by feature engineering, algorithm/model selection, and hyper-parameter tuning.

AutoML Feature Engineering +1

Improving Deep Neural Network with Multiple Parametric Exponential Linear Units

1 code implementation1 Jun 2016 Yang Li, Chunxiao Fan, Yong Li, Qiong Wu, Yue Ming

In this paper, we first propose a new activation function, Multiple Parametric Exponential Linear Units (MPELU), aiming to generalize and unify the rectified and exponential linear units.

TableLLM: Enabling Tabular Data Manipulation by LLMs in Real Office Usage Scenarios

1 code implementation28 Mar 2024 Xiaokang Zhang, Jing Zhang, Zeyao Ma, Yang Li, Bohan Zhang, Guanlin Li, Zijun Yao, Kangli Xu, Jinchang Zhou, Daniel Zhang-li, Jifan Yu, Shu Zhao, Juanzi Li, Jie Tang

We introduce TableLLM, a robust large language model (LLM) with 13 billion parameters, purpose-built for proficiently handling tabular data manipulation tasks, whether they are embedded within documents or spreadsheets, catering to real-world office scenarios.

Language Modelling Large Language Model

Distance-Aware Occlusion Detection with Focused Attention

1 code implementation23 Aug 2022 Yang Li, Yucheng Tu, Xiaoxue Chen, Hao Zhao, Guyue Zhou

In this work, (1) we propose a novel three-decoder architecture as the infrastructure for focused attention; 2) we use the generalized intersection box prediction task to effectively guide our model to focus on occlusion-specific regions; 3) our model achieves a new state-of-the-art performance on distance-aware relationship detection.

Human-Object Interaction Detection Relationship Detection +1

Multi-Modal Automatic Prosody Annotation with Contrastive Pretraining of SSWP

1 code implementation11 Sep 2023 Jinzuomu Zhong, Yang Li, Hui Huang, Jie Liu, Zhiba Su, Jing Guo, Benlai Tang, Fengjie Zhu

While human prosody annotation contributes a lot to the performance, it is a labor-intensive and time-consuming process, often resulting in inconsistent outcomes.

Understanding Embodied Reference with Touch-Line Transformer

1 code implementation11 Oct 2022 Yang Li, Xiaoxue Chen, Hao Zhao, Jiangtao Gong, Guyue Zhou, Federico Rossano, Yixin Zhu

Human studies have revealed that objects referred to or pointed to do not lie on the elbow-wrist line, a common misconception; instead, they lie on the so-called virtual touch line.

Bad Actor, Good Advisor: Exploring the Role of Large Language Models in Fake News Detection

1 code implementation21 Sep 2023 Beizhe Hu, Qiang Sheng, Juan Cao, Yuhui Shi, Yang Li, Danding Wang, Peng Qi

To instantiate this proposal, we design an adaptive rationale guidance network for fake news detection (ARG), in which SLMs selectively acquire insights on news analysis from the LLMs' rationales.

Fake News Detection

Phoneme Hallucinator: One-shot Voice Conversion via Set Expansion

1 code implementation11 Aug 2023 Siyuan Shan, Yang Li, Amartya Banerjee, Junier B. Oliva

Objective and subjective evaluations show that \textit{Phoneme Hallucinator} outperforms existing VC methods for both intelligibility and speaker similarity.

Voice Conversion

Learning to Denoise Raw Mobile UI Layouts for Improving Datasets at Scale

1 code implementation11 Jan 2022 Gang Li, Gilles Baechler, Manuel Tragut, Yang Li

The layout of a mobile screen is a critical data source for UI design research and semantic understanding of the screen.

Denoising valid

Attribute-aware Pedestrian Detection in a Crowd

1 code implementation21 Oct 2019 Jialiang Zhang, Lixiang Lin, Yang Li, Yun-chen Chen, Jianke Zhu, Yao Hu, Steven C. H. Hoi

To tackle this critical problem, we propose an attribute-aware pedestrian detector to explicitly model people's semantic attributes in a high-level feature detection fashion.

Attribute Pedestrian Detection

GPU-based Private Information Retrieval for On-Device Machine Learning Inference

1 code implementation26 Jan 2023 Maximilian Lam, Jeff Johnson, Wenjie Xiong, Kiwan Maeng, Udit Gupta, Yang Li, Liangzhen Lai, Ilias Leontiadis, Minsoo Rhu, Hsien-Hsin S. Lee, Vijay Janapa Reddi, Gu-Yeon Wei, David Brooks, G. Edward Suh

Together, for various on-device ML applications such as recommendation and language modeling, our system on a single V100 GPU can serve up to $100, 000$ queries per second -- a $>100 \times$ throughput improvement over a CPU-based baseline -- while maintaining model accuracy.

Information Retrieval Language Modelling +1

Cooperative Open-ended Learning Framework for Zero-shot Coordination

1 code implementation9 Feb 2023 Yang Li, Shao Zhang, Jichen Sun, Yali Du, Ying Wen, Xinbing Wang, Wei Pan

However, these approaches can result in a loss of learning and an inability to cooperate with certain strategies within the population, known as cooperative incompatibility.

Tackling Cooperative Incompatibility for Zero-Shot Human-AI Coordination

1 code implementation5 Jun 2023 Yang Li, Shao Zhang, Jichen Sun, WenHao Zhang, Yali Du, Ying Wen, Xinbing Wang, Wei Pan

In order to solve cooperative incompatibility in learning and effectively address the problem in the context of ZSC, we introduce the Cooperative Open-ended LEarning (COLE) framework, which formulates open-ended objectives in cooperative games with two players using perspectives of graph theory to evaluate and pinpoint the cooperative capacity of each strategy.

Cross-Utterance Conditioned VAE for Non-Autoregressive Text-to-Speech

1 code implementation ACL 2022 Yang Li, Cheng Yu, Guangzhi Sun, Hua Jiang, Fanglei Sun, Weiqin Zu, Ying Wen, Yang Yang, Jun Wang

Modelling prosody variation is critical for synthesizing natural and expressive speech in end-to-end text-to-speech (TTS) systems.

An Information-Theoretic Metric of Transferability for Task Transfer Learning

1 code implementation ICLR 2019 Yajie Bao, Yang Li, Shao-Lun Huang, Lin Zhang, Amir R. Zamir, Leonidas J. Guibas

An important question in task transfer learning is to determine task transferability, i. e. given a common input domain, estimating to what extent representations learned from a source task can help in learning a target task.

General Classification Scene Understanding +1

Rethinking Training from Scratch for Object Detection

1 code implementation6 Jun 2021 Yang Li, Hong Zhang, Yu Zhang

The ImageNet pre-training initialization is the de-facto standard for object detection.

Object object-detection +1

MM-BigBench: Evaluating Multimodal Models on Multimodal Content Comprehension Tasks

1 code implementation13 Oct 2023 Xiaocui Yang, Wenfang Wu, Shi Feng, Ming Wang, Daling Wang, Yang Li, Qi Sun, Yifei Zhang, XiaoMing Fu, Soujanya Poria

Consequently, our work complements research on the performance of MLLMs in multimodal comprehension tasks, achieving a more comprehensive and holistic evaluation of MLLMs.

Multimodal Reasoning

Efficient and Accurate Conversion of Spiking Neural Network with Burst Spikes

1 code implementation28 Apr 2022 Yang Li, Yi Zeng

Spiking neural network (SNN), as a brain-inspired energy-efficient neural network, has attracted the interest of researchers.

Efficient Neural Network

HardSATGEN: Understanding the Difficulty of Hard SAT Formula Generation and A Strong Structure-Hardness-Aware Baseline

1 code implementation4 Feb 2023 Yang Li, Xinyan Chen, Wenxuan Guo, Xijun Li, Wanqian Luo, Junhua Huang, Hui-Ling Zhen, Mingxuan Yuan, Junchi Yan

On top of the observations that industrial formulae exhibit clear community structure and oversplit substructures lead to the difficulty in semantic formation of logical structures, we propose HardSATGEN, which introduces a fine-grained control mechanism to the neural split-merge paradigm for SAT formula generation to better recover the structural and computational properties of the industrial benchmarks.

Widget Captioning: Generating Natural Language Description for Mobile User Interface Elements

1 code implementation EMNLP 2020 Yang Li, Gang Li, Luheng He, Jingjie Zheng, Hong Li, Zhiwei Guan

We propose widget captioning, a novel task for automatically generating language descriptions for UI elements from multimodal input including both the image and the structural representations of user interfaces.

OTCE: A Transferability Metric for Cross-Domain Cross-Task Representations

1 code implementation CVPR 2021 Yang Tan, Yang Li, Shao-Lun Huang

Specifically, we use optimal transport to estimate domain difference and the optimal coupling between source and target distributions, which is then used to derive the conditional entropy of the target task (task difference).

Model Selection Transfer Learning

N-Omniglot, a large-scale neuromorphic dataset for spatio-temporal sparse few-shot learning

1 code implementation25 Dec 2021 Yang Li, Yiting Dong, Dongcheng Zhao, Yi Zeng

Few-shot learning (learning with a few samples) is one of the most important cognitive abilities of the human brain.

Few-Shot Learning

$L_0$-ARM: Network Sparsification via Stochastic Binary Optimization

1 code implementation9 Apr 2019 Yang Li, Shihao Ji

Thanks to the flexibility of ARM, many smooth or non-smooth parametric functions, such as scaled sigmoid or hard sigmoid, can be used to parameterize this binary optimization problem and the unbiasness of the ARM estimator is retained, while the hard concrete estimator has to rely on the hard sigmoid function to achieve conditional computation and thus accelerated training.

Super-resolution Probabilistic Rain Prediction from Satellite Data Using 3D U-Nets and EarthFormers

1 code implementation6 Dec 2022 Yang Li, Haiyu Dong, Zuliang Fang, Jonathan Weyn, Pete Luferenko

To further improve the model performance, multi-model ensemble and threshold optimization were used to produce the final probabilistic rain prediction.

Decision Making Super-Resolution

NRTSI: Non-Recurrent Time Series Imputation

1 code implementation5 Feb 2021 Siyuan Shan, Yang Li, Junier B. Oliva

Time series imputation is a fundamental task for understanding time series with missing data.

Imputation Time Series +1

A Universal PINNs Method for Solving Partial Differential Equations with a Point Source

1 code implementation Proceedings of the Thirty-First International Joint Conference on Artificial Intelligence 2022 Xiang Huang, Hongsheng Liu, Beiji Shi, Zidong Wang, Kang Yang, Yang Li, Min Wang, Haotian Chu, Jing Zhou, Fan Yu, Bei Hua, Bin Dong, Lei Chen

In recent years, deep learning technology has been used to solve partial differential equations (PDEs), among which the physics-informed neural networks (PINNs)method emerges to be a promising method for solving both forward and inverse PDE problems.

Chinese Idiom Paraphrasing

1 code implementation15 Apr 2022 Jipeng Qiang, Yang Li, Chaowei Zhang, Yun Li, Yunhao Yuan, Yi Zhu, Xindong Wu

Idioms, are a kind of idiomatic expression in Chinese, most of which consist of four Chinese characters.

Machine Translation Paraphrase Generation +1

Flow Models for Arbitrary Conditional Likelihoods

1 code implementation13 Sep 2019 Yang Li, Shoaib Akbar, Junier B. Oliva

Understanding the dependencies among features of a dataset is at the core of most unsupervised learning tasks.

Image Inpainting Imputation

ACFlow: Flow Models for Arbitrary Conditional Likelihoods

1 code implementation ICML 2020 Yang Li, Shoaib Akbar, Junier Oliva

However, a majority of generative modeling approaches are focused solely on the joint distribution $p(x)$ and utilize models where it is intractable to obtain the conditional distribution of some arbitrary subset of features $x_u$ given the rest of the observed covariates $x_o$: $p(x_u \mid x_o)$.

Imputation

Multitask Learning for Emotion and Personality Detection

1 code implementation7 Jan 2021 Yang Li, Amirmohammad Kazameini, Yash Mehta, Erik Cambria

In recent years, deep learning-based automated personality trait detection has received a lot of attention, especially now, due to the massive digital footprints of an individual.

Language Modelling Model Optimization

Contrastive Bayesian Analysis for Deep Metric Learning

1 code implementation10 Oct 2022 Shichao Kan, Zhiquan He, Yigang Cen, Yang Li, Vladimir Mladenovic, Zhihai He

Recent methods for deep metric learning have been focusing on designing different contrastive loss functions between positive and negative pairs of samples so that the learned feature embedding is able to pull positive samples of the same class closer and push negative samples from different classes away from each other.

Contrastive Learning Metric Learning

Area Attention

1 code implementation ICLR 2019 Yang Li, Lukasz Kaiser, Samy Bengio, Si Si

We propose area attention: a way to attend to areas in the memory, where each area contains a group of items that are structurally adjacent, e. g., spatially for a 2D memory such as images, or temporally for a 1D memory such as natural language sentences.

Image Captioning Machine Translation +1

Grain: Improving Data Efficiency of Graph Neural Networks via Diversified Influence Maximization

1 code implementation31 Jul 2021 Wentao Zhang, Zhi Yang, Yexin Wang, Yu Shen, Yang Li, Liang Wang, Bin Cui

Data selection methods, such as active learning and core-set selection, are useful tools for improving the data efficiency of deep learning models on large-scale datasets.

Active Learning Knowledge Graphs

Learning Point-wise Abstaining Penalty for Point Cloud Anomaly Detection

1 code implementation19 Sep 2023 Shaocong Xu, Pengfei Li, Xinyu Liu, Qianpu Sun, Yang Li, Shihui Guo, Zhen Wang, Bo Jiang, Rui Wang, Kehua Sheng, Bo Zhang, Hao Zhao

We demonstrate that learning different abstaining penalties, apart from point-wise penalty, for different types of (synthesized) outliers can further improve the performance.

Anomaly Detection Autonomous Driving +1

FusionINN: Invertible Image Fusion for Brain Tumor Monitoring

1 code implementation23 Mar 2024 Nishant Kumar, Ziyan Tao, Jaikirat Singh, Yang Li, Peiwen Sun, Binghui Zhao, Stefan Gumhold

Image fusion typically employs non-invertible neural networks to merge multiple source images into a single fused image.

Denoising Multi-Exposure Image Fusion

NAFS: A Simple yet Tough-to-beat Baseline for Graph Representation Learning

2 code implementations17 Jun 2022 Wentao Zhang, Zeang Sheng, Mingyu Yang, Yang Li, Yu Shen, Zhi Yang, Bin Cui

First, GNNs can learn higher-order structural information by stacking more layers but can not deal with large depth due to the over-smoothing issue.

Graph Representation Learning Link Prediction +1

Meta-Neighborhoods

1 code implementation NeurIPS 2020 Siyuan Shan, Yang Li, Junier Oliva

Making an adaptive prediction based on one's input is an important ability for general artificial intelligence.

Meta-Learning Multi-Task Learning

FGeo-HyperGNet: Geometric Problem Solving Integrating Formal Symbolic System and Hypergraph Neural Network

1 code implementation18 Feb 2024 Xiaokai Zhang, Na Zhu, Cheng Qin, Yang Li, Zhenbing Zeng, Tuo Leng

The symbolic part is a formal system built on FormalGeo, which can automatically perform geomertic relational reasoning and algebraic calculations and organize the solving process into a solution hypertree with conditions as hypernodes and theorems as hyperedges.

Geometry Problem Solving Relational Reasoning

ChunkAttention: Efficient Self-Attention with Prefix-Aware KV Cache and Two-Phase Partition

1 code implementation23 Feb 2024 Lu Ye, Ze Tao, Yong Huang, Yang Li

In this paper, we introduce ChunkAttention, a prefix-aware self-attention module that can detect matching prompt prefixes across multiple requests and share their key/value tensors in memory at runtime to improve the memory utilization of KV cache.

Saliency detection based on structural dissimilarity induced by image quality assessment model

1 code implementation24 May 2019 Yang Li, Xuanqin Mou

Similar to IQA models, the structural dissimilarity is computed based on the correlation of the structural features.

Image Quality Assessment Saliency Detection

Learn from Yesterday: A Semi-Supervised Continual Learning Method for Supervision-Limited Text-to-SQL Task Streams

1 code implementation21 Nov 2022 Yongrui Chen, Xinnan Guo, Tongtong Wu, Guilin Qi, Yang Li, Yang Dong

The first solution Vanilla is to perform self-training, augmenting the supervised training data with predicted pseudo-labeled instances of the current task, while replacing the full volume retraining with episodic memory replay to balance the training efficiency with the performance of previous tasks.

Continual Learning Text-To-SQL

Improving Long-Tail Relation Extraction with Collaborating Relation-Augmented Attention

2 code implementations COLING 2020 Yang Li, Tao Shen, Guodong Long, Jing Jiang, Tianyi Zhou, Chengqi Zhang

Then, facilitated by the proposed base model, we introduce collaborating relation features shared among relations in the hierarchies to promote the relation-augmenting process and balance the training data for long-tail relations.

Relation Relation Extraction +1

An Efficient Knowledge Transfer Strategy for Spiking Neural Networks from Static to Event Domain

1 code implementation23 Mar 2023 Xiang He, Dongcheng Zhao, Yang Li, Guobin Shen, Qingqun Kong, Yi Zeng

In order to improve the generalization ability of SNNs on event-based datasets, we use static images to assist SNN training on event data.

Transfer Learning

Fine-Grained Extraction of Road Networks via Joint Learning of Connectivity and Segmentation

1 code implementation7 Dec 2023 Yijia Xu, Liqiang Zhang, Wuming Zhang, Suhong Liu, Jingwen Li, Xingang Li, Yuebin Wang, Yang Li

Road network extraction from satellite images is widely applicated in intelligent traffic management and autonomous driving fields.

Autonomous Driving Management +2

Relation-Aware Question Answering for Heterogeneous Knowledge Graphs

1 code implementation19 Dec 2023 Haowei Du, Quzhe Huang, Chen Li, Chen Zhang, Yang Li, Dongyan Zhao

To address this issue, we construct a \textbf{dual relation graph} where each node denotes a relation in the original KG (\textbf{primal entity graph}) and edges are constructed between relations sharing same head or tail entities.

Knowledge Base Question Answering Knowledge Graphs +1

Exchangeable Generative Models with Flow Scans

1 code implementation5 Feb 2019 Christopher Bender, Kevin O'Connor, Yang Li, Juan Jose Garcia, Manzil Zaheer, Junier Oliva

In this work, we develop a new approach to generative density estimation for exchangeable, non-i. i. d.

Density Estimation

Learning to Model the Relationship Between Brain Structural and Functional Connectomes

1 code implementation18 Dec 2021 Yang Li, Gonzalo Mateos, Zhengwu Zhang

Recent advances in neuroimaging along with algorithmic innovations in statistical learning from network data offer a unique pathway to integrate brain structure and function, and thus facilitate revealing some of the brain's organizing principles at the system level.

Graph Representation Learning

FewSAR: A Few-shot SAR Image Classification Benchmark

1 code implementation16 Jun 2023 Rui Zhang, Ziqi Wang, Yang Li, Jiabao Wang, Zhiteng Wang

Motivated by this observation, we propose a novel few-shot SAR image classification benchmark (FewSAR) to address this issue.

Classification Few-Shot Learning +2

Computation Rate Maximization for Wireless Powered Edge Computing With Multi-User Cooperation

1 code implementation22 Jan 2024 Yang Li, Xing Zhang, Bo Lei, Qianying Zhao, Min Wei, Zheyan Qu, Wenbo Wang

Simulation results show that the performance of the proposed algorithms is comparable to that of the exhaustive search method, and the deep learning-based algorithm significantly reduces the execution time of the algorithm.

Edge-computing

Attention-based Graph Convolution Fusing Latent Structures and Multiple Features for Graph Neural Networks

1 code implementation2 Mar 2023 Yang Li, Yuichi Tanaka

Instead, we propose two methods to improve the representational power of AGCs by utilizing 1) structural information in a high-dimensional space and 2) multiple attention functions when calculating their weights.

Learning a Low-Rank Feature Representation: Achieving Better Trade-Off between Stability and Plasticity in Continual Learning

1 code implementation14 Dec 2023 Zhenrong Liu, Yang Li, Yi Gong, Yik-Chung Wu

This approach optimizes network parameters in the null space of the past tasks' feature representation matrix to guarantee the stability.

Continual Learning

Learning Persistent Community Structures in Dynamic Networks via Topological Data Analysis

1 code implementation6 Jan 2024 Dexu Kong, Anping Zhang, Yang Li

Dynamic community detection methods often lack effective mechanisms to ensure temporal consistency, hindering the analysis of network evolution.

Clustering Community Detection +3

PagPassGPT: Pattern Guided Password Guessing via Generative Pretrained Transformer

1 code implementation7 Apr 2024 Xingyu Su, Xiaojie Zhu, Yang Li, Yong Li, Chi Chen, Paulo Esteves-Veríssimo

Amidst the surge in deep learning-based password guessing models, challenges of generating high-quality passwords and reducing duplicate passwords persist.

Collaborative Learning for Extremely Low Bit Asymmetric Hashing

1 code implementation25 Sep 2018 Yadan Luo, Zi Huang, Yang Li, Fumin Shen, Yang Yang, Peng Cui

Hashing techniques are in great demand for a wide range of real-world applications such as image retrieval and network compression.

Image Retrieval Retrieval

ROD: Reception-aware Online Distillation for Sparse Graphs

1 code implementation25 Jul 2021 Wentao Zhang, Yuezihan Jiang, Yang Li, Zeang Sheng, Yu Shen, Xupeng Miao, Liang Wang, Zhi Yang, Bin Cui

Unfortunately, many real-world networks are sparse in terms of both edges and labels, leading to sub-optimal performance of GNNs.

Clustering Graph Learning +5

HDL: Hybrid Deep Learning for the Synthesis of Myocardial Velocity Maps in Digital Twins for Cardiac Analysis

1 code implementation9 Mar 2022 Xiaodan Xing, Javier Del Ser, Yinzhe Wu, Yang Li, Jun Xia, Lei Xu, David Firmin, Peter Gatehouse, Guang Yang

A core part of digital healthcare twins is model-based data synthesis, which permits the generation of realistic medical signals without requiring to cope with the modelling complexity of anatomical and biochemical phenomena producing them in reality.

Decision Making Generative Adversarial Network +1

Multi-Agent Feedback Enabled Neural Networks for Intelligent Communications

1 code implementation22 May 2022 Fanglei Sun, Yang Li, Ying Wen, Jingchen Hu, Jun Wang, Yang Yang, Kai Li

The design of MAFENN framework and algorithm are dedicated to enhance the learning capability of the feedfoward DL networks or their variations with the simple data feedback.

Denoising Intelligent Communication

Video-based Cross-modal Auxiliary Network for Multimodal Sentiment Analysis

1 code implementation30 Aug 2022 Rongfei Chen, Wenju Zhou, Yang Li, Huiyu Zhou

Multimodal sentiment analysis has a wide range of applications due to its information complementarity in multimodal interactions.

Classification Image Classification +1

GloTSFormer: Global Video Text Spotting Transformer

1 code implementation8 Jan 2024 Han Wang, Yanjie Wang, Yang Li, Can Huang

In this paper, we propose a novel Global Video Text Spotting Transformer GloTSFormer to model the tracking problem as global associations and utilize the Gaussian Wasserstein distance to guide the morphological correlation between frames.

Text Spotting

Neural Plasticity Networks

1 code implementation13 Aug 2019 Yang Li, Shihao Ji

To the best of our knowledge, this is the first learning framework that unifies network sparsification and network expansion in an end-to-end training pipeline.

Image Classification

Extracting Stochastic Governing Laws by Nonlocal Kramers-Moyal Formulas

1 code implementation28 Aug 2021 Yubin Lu, Yang Li, Jinqiao Duan

In this work, we propose a data-driven approach to extract stochastic governing laws with both (Gaussian) Brownian motion and (non-Gaussian) L\'evy motion, from short bursts of simulation data.

Accounting for Temporal Variability in Functional Magnetic Resonance Imaging Improves Prediction of Intelligence

1 code implementation11 Nov 2022 Yang Li, Xin Ma, Raj Sunderraman, Shihao Ji, Suprateek Kundu

We compare the prediction performance for different intelligence measures based on static FC, dynamic FC, and region level time series acquired from the Adolescent Brain Cognitive Development (ABCD) study involving close to 7000 individuals.

feature selection Time Series +1

Kernel Learning in Ridge Regression "Automatically" Yields Exact Low Rank Solution

1 code implementation18 Oct 2023 Yunlu Chen, Yang Li, Keli Liu, Feng Ruan

Assuming that the covariates have nonzero explanatory power for the response only through a low dimensional subspace (central mean subspace), we find that the global minimizer of the finite sample kernel learning objective is also low rank with high probability.

regression

Hypergrah-Enhanced Dual Convolutional Network for Bundle Recommendation

1 code implementation18 Dec 2023 Kangbo Liu, Yang Li, Yaoxin Wu, Zhaoxuan Wang, Xiaoxu Wang

While previous approaches have demonstrated notable performance, we argue that they may compromise the ternary relationship among users, items, and bundles.

Contrastive Continual Learning with Importance Sampling and Prototype-Instance Relation Distillation

1 code implementation7 Mar 2024 Jiyong Li, Dilshod Azizov, Yang Li, Shangsong Liang

Recently, because of the high-quality representations of contrastive learning methods, rehearsal-based contrastive continual learning has been proposed to explore how to continually learn transferable representation embeddings to avoid the catastrophic forgetting issue in traditional continual settings.

Continual Learning Contrastive Learning +2

Progressive Neural Networks for Image Classification

no code implementations25 Apr 2018 Zhi Zhang, Guanghan Ning, Yigang Cen, Yang Li, Zhiqun Zhao, Hao Sun, Zhihai He

The inference structures and computational complexity of existing deep neural networks, once trained, are fixed and remain the same for all test images.

Classification General Classification +1

Tensor graph convolutional neural network

no code implementations27 Mar 2018 Tong Zhang, Wenming Zheng, Zhen Cui, Yang Li

For cross graph convolution, a parameterized Kronecker sum operation is proposed to generate a conjunctive adjacency matrix characterizing the relationship between every pair of nodes across two subgraphs.

Attribute Matrix Completion

Nonlinear Online Learning with Adaptive Nyström Approximation

no code implementations21 Feb 2018 Si Si, Sanjiv Kumar, Yang Li

Use of nonlinear feature maps via kernel approximation has led to success in many online learning tasks.

Time-Dependent Representation for Neural Event Sequence Prediction

no code implementations ICLR 2018 Yang Li, Nan Du, Samy Bengio

Because neural sequence models such as RNN are more amenable for handling token-like input, we propose two methods for time-dependent event representation, based on the intuition on how time is tokenized in everyday life and previous work on embedding contextualization.

Sentence

Gland Instance Segmentation Using Deep Multichannel Neural Networks

no code implementations21 Nov 2016 Yan Xu, Yang Li, Yipei Wang, Mingyuan Liu, Yubo Fan, Maode Lai, Eric I-Chao Chang

Methods: We leverage the idea of image-to-image prediction in recent deep learning by designing an algorithm that automatically exploits and fuses complex multichannel information - regional, location, and boundary cues - in gland histology images.

Instance Segmentation Segmentation +1

Disentangled Variational Auto-Encoder for Semi-supervised Learning

no code implementations15 Sep 2017 Yang Li, Quan Pan, Suhang Wang, Haiyun Peng, Tao Yang, Erik Cambria

The majority of existing semi-supervised VAEs utilize a classifier to exploit label information, where the parameters of the classifier are introduced to the VAE.

Detection of Moving Object in Dynamic Background Using Gaussian Max-Pooling and Segmentation Constrained RPCA

no code implementations3 Sep 2017 Yang Li, Guangcan Liu, Sheng-Yong Chen

Due to its efficiency and stability, Robust Principal Component Analysis (RPCA) has been emerging as a promising tool for moving object detection.

Moving Object Detection object-detection

Spatial-Temporal Recurrent Neural Network for Emotion Recognition

no code implementations12 May 2017 Tong Zhang, Wenming Zheng, Zhen Cui, Yuan Zong, Yang Li

Then a bi-directional temporal RNN layer is further used to learn discriminative temporal dependencies from the sequences concatenating spatial features of each time slice produced from the spatial RNN layer.

EEG Emotion Recognition

Multi-Camera Action Dataset for Cross-Camera Action Recognition Benchmarking

no code implementations21 Jul 2016 Wenhui Li, Yongkang Wong, An-An Liu, Yang Li, Yu-Ting Su, Mohan Kankanhalli

To enable the study of this problem, there exist a vast number of action datasets, which are recorded under controlled laboratory settings, real-world surveillance environments, or crawled from the Internet.

Action Recognition Benchmarking +1

Recurrent Regression for Face Recognition

no code implementations24 Jul 2016 Yang Li, Wenming Zheng, Zhen Cui

To address the sequential changes of images including poses, in this paper we propose a recurrent regression neural network(RRNN) framework to unify two classic tasks of cross-pose face recognition on still images and video-based face recognition.

Face Recognition regression

Gland Instance Segmentation by Deep Multichannel Neural Networks

no code implementations17 Jul 2016 Yan Xu, Yang Li, Mingyuan Liu, Yipei Wang, Yubo Fan, Maode Lai, Eric I-Chao Chang

Here we leverage the idea of image-to-image prediction in recent deep learning by building a framework that automatically exploits and fuses complex multichannel information, regional, location and boundary patterns in gland histology images.

Instance Segmentation Segmentation +1

Gland Instance Segmentation by Deep Multichannel Side Supervision

no code implementations12 Jul 2016 Yan Xu, Yang Li, Mingyuan Liu, Yipei Wang, Maode Lai, Eric I-Chao Chang

In this paper, we propose a new image instance segmentation method that segments individual glands (instances) in colon histology images.

Instance Segmentation Segmentation +1

GroupReduce: Block-Wise Low-Rank Approximation for Neural Language Model Shrinking

no code implementations NeurIPS 2018 Patrick H. Chen, Si Si, Yang Li, Ciprian Chelba, Cho-Jui Hsieh

Model compression is essential for serving large deep neural nets on devices with limited resources or applications that require real-time responses.

Language Modelling Model Compression +1

Boosted Convolutional Neural Networks for Motor Imagery EEG Decoding with Multiwavelet-based Time-Frequency Conditional Granger Causality Analysis

no code implementations22 Oct 2018 Yang Li, Meng-Ying Lei, Xianrui Zhang, Weigang Cui, Yuzhu Guo, Ting-Wen Huang, Hua-Liang Wei

Decoding EEG signals of different mental states is a challenging task for brain-computer interfaces (BCIs) due to nonstationarity of perceptual decision processes.

Binary Classification EEG +2

Learning to Screen for Fast Softmax Inference on Large Vocabulary Neural Networks

no code implementations ICLR 2019 Patrick H. Chen, Si Si, Sanjiv Kumar, Yang Li, Cho-Jui Hsieh

The algorithm achieves an order of magnitude faster inference than the original softmax layer for predicting top-$k$ words in various tasks such as beam search in machine translation or next words prediction.

Clustering Machine Translation +1

An amplitudes-perturbation data augmentation method in convolutional neural networks for EEG decoding

no code implementations6 Nov 2018 Xian-Rui Zhang, Meng-Ying Lei, Yang Li

Brain-Computer Interface (BCI) system provides a pathway between humans and the outside world by analyzing brain signals which contain potential neural information.

Brain Computer Interface Data Augmentation +2

Implementation of Robust Face Recognition System Using Live Video Feed Based on CNN

no code implementations18 Nov 2018 Yang Li, Sangwhan Cha

In this way, the advantages of multiple models can be combined to mention the recognition accuracy.

Face Recognition Iris Recognition +1

You Look Twice: GaterNet for Dynamic Filter Selection in CNNs

no code implementations CVPR 2019 Zhourong Chen, Yang Li, Samy Bengio, Si Si

The concept of conditional computation for deep nets has been proposed previously to improve model performance by selectively using only parts of the model conditioned on the sample it is processing.

Guess Me if You Can: Acronym Disambiguation for Enterprises

no code implementations ACL 2018 Yang Li, Bo Zhao, Ariel Fuxman, Fangbo Tao

The framework takes the enterprise corpus as input and produces a high-quality acronym disambiguation system as output.

Question Answering

Face Recognition System

no code implementations8 Jan 2019 Yang Li, Sangwhan Cha

Deep learning is one of the new and important branches in machine learning.

BIG-bench Machine Learning Face Recognition

Ensemble Feature for Person Re-Identification

no code implementations17 Jan 2019 Jiabao Wang, Yang Li, Zhuang Miao

However, deep feature extracted by a single CNN network is not robust enough in testing stage.

Person Re-Identification

Phonetic-enriched Text Representation for Chinese Sentiment Analysis with Reinforcement Learning

no code implementations23 Jan 2019 Haiyun Peng, Yukun Ma, Soujanya Poria, Yang Li, Erik Cambria

Furthermore, we also fuse phonetic features with textual and visual features in order to mimic the way humans read and understand Chinese text.

Chinese Sentiment Analysis reinforcement-learning +2

Reliable Patch Trackers: Robust Visual Tracking by Exploiting Reliable Patches

no code implementations CVPR 2015 Yang Li, Jianke Zhu, Steven C. H. Hoi

Most modern trackers typically employ a bounding box given in the first frame to track visual objects, where their tracking results are often sensitive to the initialization.

Clustering Visual Tracking

3D Model-Based Continuous Emotion Recognition

no code implementations CVPR 2015 Hui Chen, Jiangdong Li, Fengjun Zhang, Yang Li, Hongan Wang

We propose a real-time 3D model-based method that continuously recognizes dimensional emotions from facial expressions in natural communications.

Emotion Recognition

A Forest from the Trees: Generation through Neighborhoods

no code implementations4 Feb 2019 Yang Li, Tianxiang Gao, Junier B. Oliva

In this work, we propose to learn a generative model using both learned features (through a latent space) and memories (through neighbors).

The Complexity of Morality: Checking Markov Blanket Consistency with DAGs via Morality

1 code implementation5 Mar 2019 Yang Li, Kevin Korb, Lloyd Allison

A family of Markov blankets in a faithful Bayesian network satisfies the symmetry and consistency properties.

Proving the NP-completeness of optimal moral graph triangulation

no code implementations6 Mar 2019 Yang Li, Lloyd Allison, Kevin Korb

Moral graphs were introduced in the 1980s as an intermediate step when transforming a Bayesian network to a junction tree, on which exact belief propagation can be efficiently done.

Pose Graph Optimization for Unsupervised Monocular Visual Odometry

no code implementations15 Mar 2019 Yang Li, Yoshitaka Ushiku, Tatsuya Harada

In this paper, we propose to leverage graph optimization and loop closure detection to overcome limitations of unsupervised learning based monocular visual odometry.

Loop Closure Detection Monocular Visual Odometry

SADIH: Semantic-Aware DIscrete Hashing

no code implementations3 Apr 2019 Zheng Zhang, Guo-Sen Xie, Yang Li, Sheng Li, Zi Huang

Due to its low storage cost and fast query speed, hashing has been recognized to accomplish similarity search in large-scale multimedia retrieval applications.

Retrieval

Integrating Tensor Similarity to Enhance Clustering Performance

no code implementations10 May 2019 Hong Peng, Yu Hu, Jiazhou Chen, Hai-Yan Wang, Yang Li, Hongmin Cai

The performance of most the clustering methods hinges on the used pairwise affinity, which is usually denoted by a similarity matrix.

Clustering

Event Detection without Triggers

no code implementations NAACL 2019 Shulin Liu, Yang Li, Feng Zhang, Tao Yang, Xinpeng Zhou

The goal of event detection (ED) is to detect the occurrences of events and categorize them.

Event Detection Sentence

Inferring Latent dimension of Linear Dynamical System with Minimum Description Length

no code implementations23 Jun 2019 Yang Li

This paper addresses the issue and proposes a criterion for linear dynamical system based on the principle of minimum description length.

Model Selection

Bayesian Optimization with Directionally Constrained Search

no code implementations22 Jun 2019 Yang Li, Yaqiang Yao

This constraint demands an optimizer to be aware of its remaining budget and able to spend it wisely, in order to return as better a point as possible.

Bayesian Optimization

Snowball: Iterative Model Evolution and Confident Sample Discovery for Semi-Supervised Learning on Very Small Labeled Datasets

no code implementations4 Sep 2019 Yang Li, Jianhe Yuan, Zhiqun Zhao, Hao Sun, Zhihai He

In this work, we develop a joint sample discovery and iterative model evolution method for semi-supervised learning on very small labeled training sets.

What Happens on the Edge, Stays on the Edge: Toward Compressive Deep Learning

no code implementations4 Sep 2019 Yang Li, Thomas Strohmer

We propose a hybrid hardware-software framework that has the potential to significantly reduce the computational complexity and memory requirements of on-device machine learning.

BIG-bench Machine Learning Compressive Sensing +1

Forecaster: A Graph Transformer for Forecasting Spatial and Time-Dependent Data

no code implementations9 Sep 2019 Yang Li, José M. F. Moura

Specifically, we start by learning the structure of the graph that parsimoniously represents the spatial dependency between the data at different locations.

Self-Attention Enhanced Selective Gate with Entity-Aware Embedding for Distantly Supervised Relation Extraction

no code implementations27 Nov 2019 Yang Li, Guodong Long, Tao Shen, Tianyi Zhou, Lina Yao, Huan Huo, Jing Jiang

Distantly supervised relation extraction intrinsically suffers from noisy labels due to the strong assumption of distant supervision.

Entity Embeddings Relation +3

Auto Completion of User Interface Layout Design Using Transformer-Based Tree Decoders

no code implementations14 Jan 2020 Yang Li, Julien Amelot, Xin Zhou, Samy Bengio, Si Si

While we focus on interface layout prediction, our model can be generally applicable for other layout prediction problems that involve tree structures and 2-dimensional placements.

Layout Design

Illumination adaptive person reid based on teacher-student model and adversarial training

no code implementations5 Feb 2020 Ziyue Zhang, Richard YD Xu, Shuai Jiang, Yang Li, Congzhentao Huang, Chen Deng

Most existing works in Person Re-identification (ReID) focus on settings where illumination either is kept the same or has very little fluctuation.

General Classification Person Re-Identification

Deep Learning-based End-to-end Diagnosis System for Avascular Necrosis of Femoral Head

no code implementations12 Feb 2020 Yang Li, Yan Li, Hua Tian

To the best of our knowledge, this study is the first research on the prospective use of a deep learning-based diagnosis system for AVNFH by conducting two pilot studies representing real-world application scenarios.

Decision Making Head Detection

Differential Evolution with Individuals Redistribution for Real Parameter Single Objective Optimization

no code implementations1 Mar 2020 Cheng-Jun Li, Yang Li

Versions of the ten DE algorithms based on individuals redistribution are compared with not only original version but also version based on complete restart, where individuals redistribution and complete restart are based on the same entry criterion.

FlowFusion: Dynamic Dense RGB-D SLAM Based on Optical Flow

no code implementations11 Mar 2020 Tianwei Zhang, Huayan Zhang, Yang Li, Yoshihiko Nakamura, Lei Zhang

Dynamic environments are challenging for visual SLAM since the moving objects occlude the static environment features and lead to wrong camera motion estimation.

Motion Estimation Optical Flow Estimation +1

Defense Through Diverse Directions

no code implementations ICML 2020 Christopher M. Bender, Yang Li, Yifeng Shi, Michael K. Reiter, Junier B. Oliva

In this work we develop a novel Bayesian neural network methodology to achieve strong adversarial robustness without the need for online adversarial training.

Adversarial Robustness

Learning to Optimize Non-Rigid Tracking

no code implementations CVPR 2020 Yang Li, Aljaž Božič, Tianwei Zhang, Yanli Ji, Tatsuya Harada, Matthias Nießner

One of the widespread solutions for non-rigid tracking has a nested-loop structure: with Gauss-Newton to minimize a tracking objective in the outer loop, and Preconditioned Conjugate Gradient (PCG) to solve a sparse linear system in the inner loop.

SSIM-Based CTU-Level Joint Optimal Bit Allocation and Rate Distortion Optimization

no code implementations28 Apr 2020 Yang Li, Xuanqin Mou

This problem is due to the lack of an accurate R-$D_\text{SSIM}$ model that can be used uniformly in both OBA and RDO.

SSIM

A Data-Driven Approach for Discovering Stochastic Dynamical Systems with Non-Gaussian Levy Noise

no code implementations7 May 2020 Yang Li, Jinqiao Duan

We then design a numerical algorithm to compute the drift, diffusion coefficient and jump measure, and thus extract a governing stochastic differential equation with Gaussian and non-Gaussian noise.

A heterogeneous branch and multi-level classification network for person re-identification

no code implementations2 Jun 2020 Jiabao Wang, Yang Li, Yangshuo Zhang, Zhuang Miao, Rui Zhang

A new heterogeneous branch, SE-Res-Branch, is proposed based on the SE-Res module, which consists of the Squeeze-and-Excitation block and the residual block.

Attribute Classification +2

Grafted network for person re-identification

no code implementations2 Jun 2020 Jiabao Wang, Yang Li, Shanshan Jiao, Zhuang Miao, Rui Zhang

In order to relieve this problem, we propose a novel grafted network (GraftedNet), which is designed by grafting a high-accuracy rootstock and a light-weighted scion.

Person Re-Identification

Dynamic Feature Acquisition with Arbitrary Conditional Flows

no code implementations13 Jun 2020 Yang Li, Junier B. Oliva

To trade off the improvement with the cost of acquisition, we leverage an information theoretic metric, conditional mutual information, to select the most informative feature to acquire.

Probabilistic Classification Vector Machine for Multi-Class Classification

no code implementations29 Jun 2020 Shengfei Lyu, Xing Tian, Yang Li, Bingbing Jiang, Huanhuan Chen

The probabilistic classification vector machine (PCVM) synthesizes the advantages of both the support vector machine and the relevant vector machine, delivering a sparse Bayesian solution to classification problems.

Classification General Classification +1

SplitFusion: Simultaneous Tracking and Mapping for Non-Rigid Scenes

no code implementations4 Jul 2020 Yang Li, Tianwei Zhang, Yoshihiko Nakamura, Tatsuya Harada

We present SplitFusion, a novel dense RGB-D SLAM framework that simultaneously performs tracking and dense reconstruction for both rigid and non-rigid components of the scene.

RGB-IR Cross-modality Person ReID based on Teacher-Student GAN Model

no code implementations15 Jul 2020 Ziyue Zhang, Shuai Jiang, Congzhentao Huang, Yang Li, Richard Yi Da Xu

To solve this challenge, we proposed a Teacher-Student GAN model (TS-GAN) to adopt different domains and guide the ReID backbone to learn better ReID information.

Generative Adversarial Network Person Re-Identification

Multi-Stage Influence Function

no code implementations NeurIPS 2020 Hongge Chen, Si Si, Yang Li, Ciprian Chelba, Sanjiv Kumar, Duane Boning, Cho-Jui Hsieh

With this score, we can identify the pretraining examples in the pretraining task that contribute most to a prediction in the finetuning task.

Transfer Learning

A Novel Ensemble Deep Learning Model for Stock Prediction Based on Stock Prices and News

no code implementations23 Jul 2020 Yang Li, Yi Pan

This paper proposes to use sentiment analysis to extract useful information from multiple textual data sources and a blending ensemble deep learning model to predict future stock movement.

Philosophy Sentiment Analysis +3

A Survey on Complex Question Answering over Knowledge Base: Recent Advances and Challenges

no code implementations26 Jul 2020 Bin Fu, Yunqi Qiu, Chengguang Tang, Yang Li, Haiyang Yu, Jian Sun

Question Answering (QA) over Knowledge Base (KB) aims to automatically answer natural language questions via well-structured relation information between entities stored in knowledge bases.

Information Retrieval Question Answering +2

Exchangeable Neural ODE for Set Modeling

no code implementations NeurIPS 2020 Yang Li, Haidong Yi, Christopher M. Bender, Siyuan Shan, Junier B. Oliva

Reasoning over an instance composed of a set of vectors, like a point cloud, requires that one accounts for intra-set dependent features among elements.

Unsupervised Deep Metric Learning with Transformed Attention Consistency and Contrastive Clustering Loss

no code implementations ECCV 2020 Yang Li, Shichao Kan, Zhihai He

To further enhance the inter-class discriminative power of the feature generated by this network, we adapt the concept of triplet loss from supervised metric learning to our unsupervised case and introduce the contrastive clustering loss.

Clustering Metric Learning

A Novel Transferability Attention Neural Network Model for EEG Emotion Recognition

no code implementations21 Sep 2020 Yang Li, Boxun Fu, Fu Li, Guangming Shi, Wenming Zheng

So it is necessary to give more attention to the EEG samples with strong transferability rather than forcefully training a classification model by all the samples.

EEG EEG Emotion Recognition

InvertGAN: Reducing mode collapse with multi-dimensional Gaussian Inversion

no code implementations1 Jan 2021 Liangliang Shi, Yang Li, Junchi Yan

Generative adversarial networks have shown their ability in capturing high-dimensional complex distributions and generating realistic data samples e. g. images.

Active Feature Acquisition with Generative Surrogate Models

no code implementations6 Oct 2020 Yang Li, Junier B. Oliva

Many real-world situations allow for the acquisition of additional relevant information when making an assessment with limited or uncertain data.

Navigate

A Machine Learning Framework for Computing the Most Probable Paths of Stochastic Dynamical Systems

no code implementations1 Oct 2020 Yang Li, Jinqiao Duan, Xianbin Liu

The emergence of transition phenomena between metastable states induced by noise plays a fundamental role in a broad range of nonlinear systems.

BIG-bench Machine Learning

Anomalous Motion of Particle Levitated by Laguerre-Gaussian beam

no code implementations14 Apr 2020 Yang Li, Lei-Ming Zhou, Nan Zhao

We calculated the scattering force distribution of a micro-particle trapped in an optical tweezers formed by the strongly focused LG beam, and showed that there exist stable trajectories of the particle that controlled by the negative torque.

Optics

Interpretable Models in ANNs

no code implementations24 Nov 2020 Yang Li

Artificial neural networks are often very complex and too deep for a human to understand.

Efficient Automatic CASH via Rising Bandits

no code implementations8 Dec 2020 Yang Li, Jiawei Jiang, Jinyang Gao, Yingxia Shao, Ce Zhang, Bin Cui

In this framework, the BO methods are used to solve the HPO problem for each ML algorithm separately, incorporating a much smaller hyperparameter space for BO methods.

Bayesian Optimization BIG-bench Machine Learning +2

Deep Learning for Short-Term Voltage Stability Assessment of Power Systems

no code implementations4 Feb 2021 Meng Zhang, Jiazheng Li, Yang Li, Runnan Xu

Secondly, a long short-term memory (LSTM) based assessment model is built through learning the time dependencies from the post-disturbance system dynamics.

Partially Observed Exchangeable Modeling

no code implementations11 Feb 2021 Yang Li, Junier B. Oliva

Modeling dependencies among features is fundamental for many machine learning tasks.

Imputation

Cannot find the paper you are looking for? You can Submit a new open access paper.