Search Results for author: Bing Li

Found 173 papers, 61 papers with code

When does Further Pre-training MLM Help? An Empirical Study on Task-Oriented Dialog Pre-training

1 code implementation EMNLP (insights) 2021 Qi Zhu, Yuxian Gu, Lingxiao Luo, Bing Li, Cheng Li, Wei Peng, Minlie Huang, Xiaoyan Zhu

Further pre-training language models on in-domain data (domain-adaptive pre-training, DAPT) or task-relevant data (task-adaptive pre-training, TAPT) before fine-tuning has been shown to improve downstream tasks’ performances.

An Empirical Study of Federated Prompt Learning for Vision Language Model

no code implementations29 May 2025 Zhihao Wang, Wenke Huang, Tian Chen, Zekun Shi, Guancheng Wan, Yu Qiao, Bin Yang, Jian Wang, Bing Li, Mang Ye

This paper systematically investigates the behavioral differences between language prompt learning (LPT) and vision prompt learning (VPT) under data heterogeneity challenges, including label skew and domain shift.

Federated Learning Language Modeling +3

OmniResponse: Online Multimodal Conversational Response Generation in Dyadic Interactions

no code implementations27 May 2025 Cheng Luo, Jianghui Wang, Bing Li, Siyang Song, Bernard Ghanem

OMCRG reflects natural dyadic interactions and poses new challenges in achieving synchronization between the generated audio and facial responses of the listener.

Audio-Visual Synchronization Conversational Response Generation +3

DetailFusion: A Dual-branch Framework with Detail Enhancement for Composed Image Retrieval

no code implementations23 May 2025 Yuxin Yang, Yinan Zhou, Yuxin Chen, Ziqi Zhang, Zongyang Ma, Chunfeng Yuan, Bing Li, Lin Song, Jun Gao, Peng Li, Weiming Hu

Composed Image Retrieval (CIR) aims to retrieve target images from a gallery based on a reference image and modification text as a combined query.

Image Retrieval Retrieval

NTIRE 2025 challenge on Text to Image Generation Model Quality Assessment

no code implementations22 May 2025 Shuhao Han, Haotian Fan, Fangyuan Kong, Wenjie Liao, Chunle Guo, Chongyi Li, Radu Timofte, Liang Li, Tao Li, Junhui Cui, Yunqiu Wang, Yang Tai, Jingwei Sun, Jianhui Sun, Xinli Yue, Tianyi Wang, Huan Hou, Junda Lu, Xinyang Huang, Zitang Zhou, Zijian Zhang, Xuhui Zheng, Xuecheng Wu, Chong Peng, Xuezhi Cao, Trong-Hieu Nguyen-Mau, Minh-Hoang Le, Minh-Khoa Le-Phan, Duy-Nam Ly, Hai-Dang Nguyen, Minh-Triet Tran, Yukang Lin, Yan Hong, Chuanbiao Song, Siyuan Li, Jun Lan, Zhichao Zhang, Xinyue Li, Wei Sun, ZiCheng Zhang, Yunhao Li, Xiaohong Liu, Guangtao Zhai, Zitong Xu, Huiyu Duan, Jiarui Wang, Guangji Ma, Liu Yang, Lu Liu, Qiang Hu, Xiongkuo Min, Zichuan Wang, Zhenchen Tang, Bo Peng, Jing Dong, Fengbin Guan, Zihao Yu, Yiting Lu, Wei Luo, Xin Li, Minhao Lin, Haofeng Chen, Xuanxuan He, Kele Xu, Qisheng Xu, Zijian Gao, Tianjiao Wan, Bo-Cheng Qiu, Chih-Chung Hsu, Chia-Ming Lee, Yu-Fan Lin, Bo Yu, Zehao Wang, Da Mu, Mingxiu Chen, Junkang Fang, Huamei Sun, Wending Zhao, Zhiyu Wang, Wang Liu, Weikang Yu, Puhong Duan, Bin Sun, Xudong Kang, Shutao Li, Shuai He, Lingzhi Fu, Heng Cong, Rongyu Zhang, Jiarong He, Zhishan Qiao, Yongqing Huang, Zewen Chen, Zhe Pang, Juan Wang, Jian Guo, Zhizhuo Shao, Ziyu Feng, Bing Li, Weiming Hu, Hesong Li, Dehua Liu, Zeming Liu, Qingsong Xie, Ruichen Wang, Zhihao LI, Yuqi Liang, Jianqi Bi, Jun Luo, Junfeng Yang, Can Li, Jing Fu, Hongwei Xu, Mingrui Long, Lulin Tang

A total of 211 participants have registered in the structure track.

Image Restoration Text to Image Generation +1

Agent-as-a-Service based on Agent Network

no code implementations13 May 2025 Yuhan Zhu, Haojie Liu, Jian Wang, Bing Li, Zikang Yin, Yefei Liao

AaaS-AN unifies the entire agent lifecycle, including construction, integration, interoperability, and networked collaboration, through two core components: (1) a dynamic Agent Network, which models agents and agent groups as vertexes that self-organize within the network based on task and role dependencies; (2) service-oriented agents, incorporating service discovery, registration, and interoperability protocols.

Code Generation Mathematical Reasoning

On relative universality, regression operator, and conditional independence

no code implementations15 Apr 2025 Bing Li, Ben Jones, Andreas Artemiou

The notion of relative universality with respect to a {\sigma}-field was introduced to establish the unbiasedness and Fisher consistency of an estimator in nonlinear sufficient dimension reduction.

Causal Inference Dimensionality Reduction +2

NuWa: Deriving Lightweight Task-Specific Vision Transformers for Edge Devices

no code implementations4 Apr 2025 Ziteng Wei, Qiang He, Bing Li, Feifei Chen, Yun Yang

NuWa can transfer task-specific knowledge extracted from the base ViT into small ViTs that fully leverage constrained resources on edge devices to maximize model accuracy with inference latency assurance.

Assessing Validity of ICD-10 Administrative Data in Coding Comorbidities

no code implementations31 Mar 2025 Jie Pan, Seungwon Lee, Cheligeer Cheligeer, Bing Li, Guosong Wu, Catherine A Eastwood, Yuan Xu, Hude Quan

The C-statistics for predicting in-hospital mortality using comorbidities by ICD-10 were 0. 84 in 2003, 0. 81 in 2015, and 0. 78 in 2022.

Mortality Prediction

Can Video Diffusion Model Reconstruct 4D Geometry?

no code implementations27 Mar 2025 Jinjie Mai, Wenxuan Zhu, Haozhe Liu, Bing Li, Cheng Zheng, Jürgen Schmidhuber, Bernard Ghanem

Reconstructing dynamic 3D scenes (i. e., 4D geometry) from monocular video is an important yet challenging problem.

4D reconstruction model +1

High Accuracy Pulmonary Vessel Segmentation for Contrast and Non-contrast CT Images and Clinical Evaluation

no code implementations21 Mar 2025 Ying Ming, Shaoze Luo, Longfei Zhao, Ruijie Zhao, Bing Li, Qiqi Xu, Wei Song

However, the segmentation precision of these methods is insufficient, and support for NCCT (Non-Contrast Computed Tomography) types of data is also a requirement in some clinical scenarios.

Image Segmentation Medical Diagnosis +2

Visual-Instructed Degradation Diffusion for All-in-One Image Restoration

no code implementations CVPR 2025 Wenyang Luo, Haina Qin, Zewen Chen, Libin Wang, Dandan Zheng, Yuming Li, Yufan Liu, Bing Li, Weiming Hu

Image restoration tasks like deblurring, denoising, and dehazing usually need distinct models for each degradation type, restricting their generalization in real-world scenarios with mixed or unknown degradations.

All Deblurring +2

Reversing Flow for Image Restoration

no code implementations CVPR 2025 Haina Qin, Wenyang Luo, Libin Wang, Dandan Zheng, Jingdong Chen, Ming Yang, Bing Li, Weiming Hu

Image restoration aims to recover high-quality (HQ) images from degraded low-quality (LQ) ones by reversing the effects of degradation.

Image Restoration

Prompting Large Language Models with Rationale Heuristics for Knowledge-based Visual Question Answering

no code implementations22 Dec 2024 Zhongjian Hu, Peng Yang, Bing Li, Fengyuan Liu

Despite the encouraging results of previous studies, prior methods prompt LLMs to predict answers directly, neglecting intermediate thought processes.

Question Answering Visual Question Answering

WiFi CSI Based Temporal Activity Detection via Dual Pyramid Network

1 code implementation19 Dec 2024 Zhendong Liu, Le Zhang, Bing Li, Yingjie Zhou, Zhenghua Chen, Ce Zhu

We address the challenge of WiFi-based temporal activity detection and propose an efficient Dual Pyramid Network that integrates Temporal Signal Semantic Encoders and Local Sensitive Response Encoders.

Action Detection Action Recognition +1

Belted and Ensembled Neural Network for Linear and Nonlinear Sufficient Dimension Reduction

no code implementations12 Dec 2024 Yin Tang, Bing Li

We introduce a unified, flexible, and easy-to-implement framework of sufficient dimension reduction that can accommodate both linear and nonlinear dimension reduction, and both the conditional distribution and the conditional mean as the targets of estimation.

Dimensionality Reduction

mR$^2$AG: Multimodal Retrieval-Reflection-Augmented Generation for Knowledge-Based VQA

no code implementations22 Nov 2024 Tao Zhang, Ziqi Zhang, Zongyang Ma, Yuxin Chen, Zhongang Qi, Chunfeng Yuan, Bing Li, Junfu Pu, Yuxuan Zhao, Zehua Xie, Jin Ma, Ying Shan, Weiming Hu

Thus, multimodal Retrieval-Augmented Generation (mRAG) is naturally introduced to provide MLLMs with comprehensive and up-to-date knowledge, effectively expanding the knowledge scope.

RAG Retrieval +2

SEAGULL: No-reference Image Quality Assessment for Regions of Interest via Vision-Language Instruction Tuning

1 code implementation15 Nov 2024 Zewen Chen, Juan Wang, Wen Wang, Sunhan Xu, Hang Xiong, Yun Zeng, Jian Guo, Shuxun Wang, Chunfeng Yuan, Bing Li, Weiming Hu

The quality analysis of ROIs can provide fine-grained guidance for image quality improvement and is crucial for scenarios focusing on region-level quality.

Language Modeling Language Modelling +1

DyConfidMatch: Dynamic Thresholding and Re-sampling for 3D Semi-supervised Learning

no code implementations13 Nov 2024 Zhimin Chen, Bing Li

Semi-supervised learning (SSL) leverages limited labeled and abundant unlabeled data but often faces challenges with data imbalance, especially in 3D contexts.

SynCL: A Synergistic Training Strategy with Instance-Aware Contrastive Learning for End-to-End Multi-Camera 3D Tracking

no code implementations11 Nov 2024 Shubo Lin, Yutong Kou, Zirui Wu, Shaoru Wang, Bing Li, Weiming Hu, Jin Gao

Specifically, we propose a Task-specific Hybrid Matching module for a weight-shared cross-attention-based decoder that matches the targets of track queries with multiple object queries to exploit promising candidates overlooked by the self-attention mechanism.

3D Multi-Object Tracking Contrastive Learning +3

VQ-Map: Bird's-Eye-View Map Layout Estimation in Tokenized Discrete Space via Vector Quantization

1 code implementation3 Nov 2024 Yiwei Zhang, Jin Gao, Fudong Ge, Guan Luo, Bing Li, Zhaoxiang Zhang, Haibin Ling, Weiming Hu

Bird's-eye-view (BEV) map layout estimation requires an accurate and full understanding of the semantics for the environmental elements around the ego car to make the results coherent and realistic.

Quantization Representation Learning

LLM-Aided Efficient Hardware Design Automation

no code implementations24 Oct 2024 Kangwei Xu, Ruidi Qiu, Zhuorui Zhao, Grace Li Zhang, Ulf Schlichtmann, Bing Li

With the rapidly increasing complexity of modern chips, hardware engineers are required to invest more effort in tasks such as circuit design, verification, and physical implementation.

Code Repair Logical Reasoning +1

SAM-Guided Masked Token Prediction for 3D Scene Understanding

no code implementations16 Oct 2024 Zhimin Chen, Liang Yang, Yingwei Li, Longlong Jing, Bing Li

Foundation models have significantly enhanced 2D task performance, and recent works like Bridge3D have successfully applied these models to improve 3D scene understanding through knowledge distillation, marking considerable advancements.

3D Object Detection Knowledge Distillation +4

SynFER: Towards Boosting Facial Expression Recognition with Synthetic Data

no code implementations13 Oct 2024 Xilin He, Cheng Luo, Xiaole Xian, Bing Li, Siyang Song, Muhammad Haris Khan, Weicheng Xie, Linlin Shen, ZongYuan Ge

Facial expression datasets remain limited in scale due to privacy concerns, the subjectivity of annotations, and the labor-intensive nature of data collection.

Facial Expression Recognition Pseudo Label +1

Basis Sharing: Cross-Layer Parameter Sharing for Large Language Model Compression

1 code implementation2 Oct 2024 Jingcun Wang, Yu-Guang Chen, Ing-Chao Lin, Bing Li, Grace Li Zhang

In this paper, we take a step further to explore parameter sharing across different layers with SVD to achieve more effective compression for LLMs.

Language Modeling Language Modelling +2

Token Caching for Diffusion Transformer Acceleration

no code implementations27 Sep 2024 Jinming Lou, Wenyang Luo, Yufan Liu, Bing Li, Xinmiao Ding, Weiming Hu, Jiajiong Cao, Yuming Li, Chenguang Ma

Diffusion transformers have gained substantial interest in diffusion generative modeling due to their outstanding performance.

Denoising Scheduling

Multi-View Adaptive Contrastive Learning for Information Retrieval Based Fault Localization

no code implementations19 Sep 2024 Chunying Zhou, Xiaoyuan Xie, Gong Chen, Peng He, Bing Li

Most studies focused on information retrieval-based techniques for fault localization, which built representations for bug reports and source code files and matched their semantic vectors through similarity measurement.

Contrastive Learning Fault localization +3

MobileIQA: Exploiting Mobile-level Diverse Opinion Network For No-Reference Image Quality Assessment Using Knowledge Distillation

1 code implementation2 Sep 2024 Zewen Chen, Sunhan Xu, Yun Zeng, Haochen Guo, Jian Guo, Shuai Liu, Juan Wang, Bing Li, Weiming Hu, Dehua Liu, Hesong Li

With the rising demand for high-resolution (HR) images, No-Reference Image Quality Assessment (NR-IQA) gains more attention, as it can ecaluate image quality in real-time on mobile devices and enhance user experience.

Computational Efficiency Knowledge Distillation

An Efficient General-Purpose Optical Accelerator for Neural Networks

no code implementations2 Sep 2024 Sijie Fei, Amro Eldebiky, Grace Li Zhang, Bing Li, Ulf Schlichtmann

Experimental results show that with a given number of MZIs, the mapping efficiency of neural networks on the proposed architecture can be enhanced by 21. 87%, 21. 20%, 24. 69%, and 25. 52% for VGG16 and Resnet18 on datasets Cifar10 and Cifar100, respectively.

TrackNeRF: Bundle Adjusting NeRF from Sparse and Noisy Views via Feature Tracks

no code implementations20 Aug 2024 Jinjie Mai, Wenxuan Zhu, Sara Rojas, Jesus Zarzar, Abdullah Hamdi, Guocheng Qian, Bing Li, Silvio Giancola, Bernard Ghanem

Neural radiance fields (NeRFs) generally require many images with accurate poses for accurate novel view synthesis, which does not reflect realistic setups where views can be sparse and poses can be noisy.

NeRF Novel View Synthesis

SuperEncoder: Towards Universal Neural Approximate Quantum State Preparation

no code implementations10 Aug 2024 Yilun Zhao, Bingmeng Wang, Wenle Jiang, Xiwei Pan, Bing Li, Yinhe Han, Ying Wang

Numerous quantum algorithms operate under the assumption that classical data has already been converted into quantum states, a process termed Quantum State Preparation (QSP).

MIBench: Evaluating Multimodal Large Language Models over Multiple Images

no code implementations21 Jul 2024 Haowei Liu, Xi Zhang, Haiyang Xu, Yaya Shi, Chaoya Jiang, Ming Yan, Ji Zhang, Fei Huang, Chunfeng Yuan, Bing Li, Weiming Hu

However, most existing MLLMs and benchmarks primarily focus on single-image input scenarios, leaving the performance of MLLMs when handling realistic multiple images underexplored.

In-Context Learning Multiple-choice

How to Make Cross Encoder a Good Teacher for Efficient Image-Text Retrieval?

no code implementations CVPR 2024 Yuxin Chen, Zongyang Ma, Ziqi Zhang, Zhongang Qi, Chunfeng Yuan, Bing Li, Junfu Pu, Ying Shan, Xiaojuan Qi, Weiming Hu

Dominant dual-encoder models enable efficient image-text retrieval but suffer from limited accuracy while the cross-encoder models offer higher accuracy at the expense of efficiency.

Contrastive Learning Image-text Retrieval +3

EA-VTR: Event-Aware Video-Text Retrieval

no code implementations10 Jul 2024 Zongyang Ma, Ziqi Zhang, Yuxin Chen, Zhongang Qi, Chunfeng Yuan, Bing Li, Yingmin Luo, Xu Li, Xiaojuan Qi, Ying Shan, Weiming Hu

EA-VTR can efficiently encode frame-level and video-level visual representations simultaneously, enabling detailed event content and complex event temporal cross-modal alignment, ultimately enhancing the comprehensive understanding of video events.

Action Recognition Contrastive Learning +6

Automated C/C++ Program Repair for High-Level Synthesis via Large Language Models

no code implementations4 Jul 2024 Kangwei Xu, Grace Li Zhang, Xunzhao Yin, Cheng Zhuo, Ulf Schlichtmann, Bing Li

Since Large Language Models (LLMs) have the ability to automate code generation, they can also be used for automated program repair in HLS.

C++ code Code Generation +4

Classification-Based Automatic HDL Code Generation Using LLMs

no code implementations4 Jul 2024 Wenhao Sun, Bing Li, Grace Li Zhang, Xunzhao Yin, Cheng Zhuo, Ulf Schlichtmann

In this work, we introduce a human-expert-inspired method to mitigate the hallucination of LLMs and improve the performance in HDL code generation.

Classification Code Generation +1

BasisN: Reprogramming-Free RRAM-Based In-Memory-Computing by Basis Combination for Deep Neural Networks

no code implementations4 Jul 2024 Amro Eldebiky, Grace Li Zhang, Xunzhao Yin, Cheng Zhuo, Ing-Chao Lin, Ulf Schlichtmann, Bing Li

BasisN introduces a novel representation of the kernels in DNN layers as combinations of global basis vectors shared between all layers with quantized coefficients.

LiveMind: Low-latency Large Language Models with Simultaneous Inference

1 code implementation20 Jun 2024 Chuangtao Chen, Grace Li Zhang, Xunzhao Yin, Cheng Zhuo, Ulf Schlichtmann, Bing Li

By employing an large LLM for inference and a small LLM for output, we achieve an average 37% reduction in response latency, alongside a 4. 30% improvement in accuracy on the MMLU-Pro dataset compared with the baseline.

Collaborative Inference Language Modeling +3

Root Cause Localization for Microservice Systems in Cloud-edge Collaborative Environments

no code implementations19 Jun 2024 Yuhan Zhu, Jian Wang, Bing Li, Xuxian Tang, Hao Li, Neng Zhang, Yuqi Zhao

Experiments conducted on the dataset collected from the benchmark show that MicroCERCL can accurately localize the root cause of microservice systems in such environments, significantly outperforming state-of-the-art approaches with an increase of at least 24. 1% in top-1 accuracy.

Graph Neural Network

Vivid-ZOO: Multi-View Video Generation with Diffusion Model

no code implementations12 Jun 2024 Bing Li, Cheng Zheng, Wenxuan Zhu, Jinjie Mai, Biao Zhang, Peter Wonka, Bernard Ghanem

To this end, we propose a novel diffusion-based pipeline that generates high-quality multi-view videos centered around a dynamic 3D object from text.

Video Generation

DA-Flow: Dual Attention Normalizing Flow for Skeleton-based Video Anomaly Detection

no code implementations5 Jun 2024 Ruituo Wu, Yang Chen, Jian Xiao, Bing Li, Jicong Fan, Frédéric Dufaux, Ce Zhu, Yipeng Liu

Cooperation between temporal convolutional networks (TCN) and graph convolutional networks (GCN) as a processing module has shown promising results in skeleton-based video anomaly detection (SVAD).

Anomaly Detection Dimensionality Reduction +1

Lazy Layers to Make Fine-Tuned Diffusion Models More Traceable

no code implementations1 May 2024 Haozhe Liu, Wentian Zhang, Bing Li, Bernard Ghanem, Jürgen Schmidhuber

Foundational generative models should be traceable to protect their owners and facilitate safety regulation.

NTIRE 2024 Quality Assessment of AI-Generated Content Challenge

no code implementations25 Apr 2024 Xiaohong Liu, Xiongkuo Min, Guangtao Zhai, Chunyi Li, Tengchuan Kou, Wei Sun, HaoNing Wu, Yixuan Gao, Yuqin Cao, ZiCheng Zhang, Xiele Wu, Radu Timofte, Fei Peng, Huiyuan Fu, Anlong Ming, Chuanming Wang, Huadong Ma, Shuai He, Zifei Dou, Shu Chen, Huacong Zhang, Haiyi Xie, Chengwei Wang, Baoying Chen, Jishen Zeng, Jianquan Yang, Weigang Wang, Xi Fang, Xiaoxin Lv, Jun Yan, Tianwu Zhi, Yabin Zhang, Yaohui Li, Yang Li, Jingwen Xu, Jianzhao Liu, Yiting Liao, Junlin Li, Zihao Yu, Yiting Lu, Xin Li, Hossein Motamednia, S. Farhad Hosseini-Benvidi, Fengbin Guan, Ahmad Mahmoudi-Aznaveh, Azadeh Mansouri, Ganzorig Gankhuyag, Kihwan Yoon, Yifang Xu, Haotian Fan, Fangyuan Kong, Shiling Zhao, Weifeng Dong, Haibing Yin, Li Zhu, Zhiling Wang, Bingchen Huang, Avinab Saha, Sandeep Mishra, Shashank Gupta, Rajesh Sureddi, Oindrila Saha, Luigi Celona, Simone Bianco, Paolo Napoletano, Raimondo Schettini, Junfeng Yang, Jing Fu, Wei zhang, Wenzhi Cao, Limei Liu, Han Peng, Weijun Yuan, Zhan Li, Yihang Cheng, Yifan Deng, Haohui Li, Bowen Qu, Yao Li, Shuqing Luo, Shunzhou Wang, Wei Gao, Zihao Lu, Marcos V. Conde, Xinrui Wang, Zhibo Chen, Ruling Liao, Yan Ye, Qiulin Wang, Bing Li, Zhaokun Zhou, Miao Geng, Rui Chen, Xin Tao, Xiaoyu Liang, Shangkun Sun, Xingyuan Ma, Jiaze Li, Mengduo Yang, Haoran Xu, Jie zhou, Shiding Zhu, Bohan Yu, Pengfei Chen, Xinrui Xu, Jiabin Shen, Zhichao Duan, Erfan Asadi, Jiahe Liu, Qi Yan, Youran Qu, Xiaohui Zeng, Lele Wang, Renjie Liao

A total of 196 participants have registered in the video track.

Image Quality Assessment Image Restoration +2

End-To-End Training and Testing Gamification Framework to Learn Human Highway Driving

no code implementations16 Apr 2024 Satya R. Jaladi, Zhimin Chen, Narahari R. Malayanur, Raja M. Macherla, Bing Li

The proposed solution is validated in GTA V games, and the results demonstrate the effectiveness of this end-to-end gamification framework for learning human driving skills.

Autonomous Driving Decision Making

A Copula Graphical Model for Multi-Attribute Data using Optimal Transport

no code implementations10 Apr 2024 Qi Zhang, Bing Li, Lingzhou Xue

Motivated by modern data forms such as images and multi-view data, the multi-attribute graphical model aims to explore the conditional independence structure among vectors.

Attribute

PromptIQA: Boosting the Performance and Generalization for No-Reference Image Quality Assessment via Prompts

1 code implementation8 Mar 2024 Zewen Chen, Haina Qin, Juan Wang, Chunfeng Yuan, Bing Li, Weiming Hu, Liang Wang

On the other hand, PromptIQA is trained on a mixed dataset with two proposed data augmentation strategies to learn diverse requirements, thus enabling it to effectively adapt to new requirements.

Data Augmentation Diversity +1

Benchmarking Segmentation Models with Mask-Preserved Attribute Editing

1 code implementation CVPR 2024 Zijin Yin, Kongming Liang, Bing Li, Zhanyu Ma, Jun Guo

We evaluate a broad variety of semantic segmentation models, spanning from conventional close-set models to recent open-vocabulary large models on their robustness to different types of variations.

Attribute Benchmarking +2

NARUTO: Neural Active Reconstruction from Uncertain Target Observations

1 code implementation CVPR 2024 Ziyue Feng, Huangying Zhan, Zheng Chen, Qingan Yan, Xiangyu Xu, Changjiang Cai, Bing Li, Qilun Zhu, Yi Xu

We present NARUTO, a neural active reconstruction system that combines a hybrid neural representation with uncertainty learning, enabling high-fidelity surface reconstruction.

Surface Reconstruction

Location-guided Head Pose Estimation for Fisheye Image

no code implementations28 Feb 2024 Bing Li, Dong Zhang, Cheng Huang, Yun Xian, Ming Li, Dah-Jye Lee

Camera with a fisheye or ultra-wide lens covers a wide field of view that cannot be modeled by the perspective projection.

Head Pose Estimation Multi-Task Learning

Unifying Latent and Lexicon Representations for Effective Video-Text Retrieval

no code implementations26 Feb 2024 Haowei Liu, Yaya Shi, Haiyang Xu, Chunfeng Yuan, Qinghao Ye, Chenliang Li, Ming Yan, Ji Zhang, Fei Huang, Bing Li, Weiming Hu

In this work, we propose the UNIFY framework, which learns lexicon representations to capture fine-grained semantics and combines the strengths of latent and lexicon representations for video-text retrieval.

Text Retrieval Video-Text Retrieval

EncodingNet: A Novel Encoding-based MAC Design for Efficient Neural Network Acceleration

1 code implementation25 Feb 2024 Bo Liu, Grace Li Zhang, Xunzhao Yin, Ulf Schlichtmann, Bing Li

The experimental results confirmed the reduction of circuit area by up to 48. 79% and the reduction of power consumption of executing DNNs by up to 64. 41%, while the accuracy of the neural networks can still be well maintained.

Efficient Neural Network image-classification +2

Pruner: A Speculative Exploration Mechanism to Accelerate Tensor Program Tuning

1 code implementation4 Feb 2024 Liang Qiao, Jun Shi, Xiaoyu Hao, Xi Fang, Minfan Zhao, Ziqi Zhu, Junshi Chen, Hong An, Bing Li, Honghui Yuan, Xinyang Wang, Xulong Tang

Results show that in online cost model tuning scenarios, Pruner and MoA-Pruner can achieve an average speedup of $2. 6 \times$ and $4. 82 \times$ compared to Ansor.

Transfer Learning

NFT1000: A Cross-Modal Dataset for Non-Fungible Token Retrieval

1 code implementation29 Jan 2024 Shuxun Wang, Yunfei Lei, Ziqi Zhang, Wei Liu, Haowei Liu, Li Yang, Wenjuan Li, Bing Li, Weiming Hu

In this paper, we will introduce a benchmark dataset named "NFT Top1000 Visual-Text Dataset" (NFT1000), containing 7. 56 million image-text pairs, and being collected from 1000 most famous PFP1 NFT collections2 by sales volume on the Ethereum blockchain.

Retrieval

CIM-MLC: A Multi-level Compilation Stack for Computing-In-Memory Accelerators

no code implementations23 Jan 2024 Songyun Qu, Shixin Zhao, Bing Li, Yintao He, Xuyi Cai, Lei Zhang, Ying Wang

Based on the proposed abstraction, CIM-MLC can compile tasks onto a wide range of CIM accelerators having different devices, architectures, and programming interfaces.

Scheduling

GMC-IQA: Exploiting Global-correlation and Mean-opinion Consistency for No-reference Image Quality Assessment

no code implementations19 Jan 2024 Zewen Chen, Juan Wang, Bing Li, Chunfeng Yuan, Weiming Hu, Junxian Liu, Peng Li, Yan Wang, Youqun Zhang, Congxuan Zhang

Due to the subjective nature of image quality assessment (IQA), assessing which image has better quality among a sequence of images is more reliable than assigning an absolute mean opinion score for an image.

No-Reference Image Quality Assessment

Empowering Resampling Operation for Ultra-High-Definition Image Enhancement with Model-Aware Guidance

1 code implementation CVPR 2024 Wei Yu, Jie Huang, Bing Li, Kaiwen Zheng, Qi Zhu, Man Zhou, Feng Zhao

At the second stage the image-wise compensatory information is derived with the compensatory kernels and embedded into the rescaled input images.

Image Enhancement

Set Prediction Guided by Semantic Concepts for Diverse Video Captioning

no code implementations25 Dec 2023 Yifan Lu, Ziqi Zhang, Chunfeng Yuan, Peng Li, Yan Wang, Bing Li, Weiming Hu

Each caption in the set is attached to a concept combination indicating the primary semantic content of the caption and facilitating element alignment in set prediction.

Caption Generation Diversity +2

Dataset Distillation via Adversarial Prediction Matching

1 code implementation14 Dec 2023 Mingyang Chen, Bo Huang, Junda Lu, Bing Li, Yi Wang, Minhao Cheng, Wei Wang

This ensures the memory efficiency of our method and provides a flexible tradeoff between time and memory budgets, allowing us to distil ImageNet-1K using a minimum of only 6. 5GB of GPU memory.

Dataset Distillation Prediction

Point Cloud Self-supervised Learning via 3D to Multi-view Masked Autoencoder

1 code implementation17 Nov 2023 Zhimin Chen, Yingwei Li, Longlong Jing, Liang Yang, Bing Li

However, a notable limitation of these approaches is that they do not fully utilize the multi-view attributes inherent in 3D point clouds, which is crucial for a deeper understanding of 3D structures.

3D Object Classification 3D Object Detection +3

Knowledge Graph Construction in Power Distribution Networks

no code implementations15 Nov 2023 Xiang Li, Che Wang, Bing Li, Hao Chen, Sizhe Li

In this paper, we propose a method for knowledge graph construction in power distribution networks.

Entity Linking graph construction +1

ZoomTrack: Target-aware Non-uniform Resizing for Efficient Visual Tracking

1 code implementation NeurIPS 2023 Yutong Kou, Jin Gao, Bing Li, Gang Wang, Weiming Hu, Yizheng Wang, Liang Li

To this end, we non-uniformly resize the cropped image to have a smaller input size while the resolution of the area where the target is more likely to appear is higher and vice versa.

Visual Tracking

Automatic Animation of Hair Blowing in Still Portrait Photos

no code implementations ICCV 2023 Wenpeng Xiao, Wentao Liu, Yitong Wang, Bernard Ghanem, Bing Li

Considering the complexity of hair structure, we innovatively treat hair wisp extraction as an instance segmentation problem, where a hair wisp is referred to as an instance.

Image Animation Instance Segmentation +2

Logic Design of Neural Networks for High-Throughput and Low-Power Applications

no code implementations19 Sep 2023 Kangwei Xu, Grace Li Zhang, Ulf Schlichtmann, Bing Li

However, under a given area constraint, the number of MAC units in such platforms is limited, so MAC units have to be reused to perform MAC operations in a neural network.

On Exact Bayesian Credible Sets for Classification and Pattern Recognition

no code implementations21 Aug 2023 Chaegeun Song, Bing Li

As a result, there is as of today no general way to construct an exact credible set for classification.

Bayesian Inference Classification +1

Learning to Identify Critical States for Reinforcement Learning from Videos

1 code implementation ICCV 2023 Haozhe Liu, Mingchen Zhuge, Bing Li, Yuhui Wang, Francesco Faccio, Bernard Ghanem, Jürgen Schmidhuber

Recent work on deep reinforcement learning (DRL) has pointed out that algorithmic information about good policies can be extracted from offline data which lack explicit information about executed actions.

Deep Reinforcement Learning reinforcement-learning

Spectral Regularized Kernel Goodness-of-Fit Tests

no code implementations8 Aug 2023 Omar Hagrass, Bharath K. Sriperumbudur, Bing Li

Maximum mean discrepancy (MMD) has enjoyed a lot of success in many machine learning and statistical applications, including non-parametric hypothesis testing, because of its ability to handle non-Euclidean data.

On Sufficient Graphical Models

no code implementations10 Jul 2023 Bing Li, Kyongwon Kim

We introduce a sufficient graphical model by applying the recently developed nonlinear sufficient dimension reduction techniques to the evaluation of conditional independence.

Dimensionality Reduction Variable Selection

Magic123: One Image to High-Quality 3D Object Generation Using Both 2D and 3D Diffusion Priors

1 code implementation30 Jun 2023 Guocheng Qian, Jinjie Mai, Abdullah Hamdi, Jian Ren, Aliaksandr Siarohin, Bing Li, Hsin-Ying Lee, Ivan Skorokhodov, Peter Wonka, Sergey Tulyakov, Bernard Ghanem

We present Magic123, a two-stage coarse-to-fine approach for high-quality, textured 3D meshes generation from a single unposed image in the wild using both2D and 3D priors.

Image to 3D

CATS: A Pragmatic Chinese Answer-to-Sequence Dataset with Large Scale and High Quality

no code implementations20 Jun 2023 Liang Li, Ruiying Geng, Chengyang Fang, Bing Li, Can Ma, Rongyu Cao, Binhua Li, Fei Huang, Yongbin Li

To alleviate these limitations, in this paper, we present CATS, a pragmatic Chinese answer-to-sequence dataset with large scale and high quality.

Dynamically Masked Discriminator for Generative Adversarial Networks

1 code implementation13 Jun 2023 Wentian Zhang, Haozhe Liu, Bing Li, Jinheng Xie, Yawen Huang, Yuexiang Li, Yefeng Zheng, Bernard Ghanem

By treating the generated data in training as a stream, we propose to detect whether the discriminator slows down the learning of new knowledge in generated data.

Continual Learning

Computational and Storage Efficient Quadratic Neurons for Deep Neural Networks

no code implementations10 Jun 2023 Chuangtao Chen, Grace Li Zhang, Xunzhao Yin, Cheng Zhuo, Ulf Schlichtmann, Bing Li

Deep neural networks (DNNs) have been widely deployed across diverse domains such as computer vision and natural language processing.

Image Classification Semantic Segmentation

Exploiting Correlations Between Contexts and Definitions with Multiple Definition Modeling

no code implementations24 May 2023 Linhan Zhang, Qian Chen, Wen Wang, Yuxin Jiang, Bing Li, Wei Wang, Xin Cao

In this paper, we carefully design a new task called Multiple Definition Modeling (MDM) that pool together all contexts and definition of target words.

Bridging the Domain Gap: Self-Supervised 3D Scene Understanding with Foundation Models

1 code implementation NeurIPS 2023 Zhimin Chen, Longlong Jing, Yingwei Li, Bing Li

Foundation models have achieved remarkable results in 2D and language tasks like image segmentation, object detection, and visual-language understanding.

3D Object Detection Image Captioning +7

Component-aware anomaly detection framework for adjustable and logical industrial visual inspection

1 code implementation15 May 2023 Tongkun Liu, Bing Li, Xiao Du, Bingke Jiang, Xiao Jin, Liuyi Jin, Zhuo Zhao

Meanwhile, segmenting a product image into multiple components provides a novel perspective for industrial visual inspection, demonstrating great potential in model customization, noise resistance, and anomaly classification.

Anomaly Classification Unsupervised Semantic Segmentation

LLM as A Robotic Brain: Unifying Egocentric Memory and Control

no code implementations19 Apr 2023 Jinjie Mai, Jun Chen, Bing Li, Guocheng Qian, Mohamed Elhoseiny, Bernard Ghanem

In this paper, we propose a novel and generalizable framework called LLM-Brain: using Large-scale Language Model as a robotic brain to unify egocentric memory and control.

Embodied Question Answering Language Modeling +3

PowerPruning: Selecting Weights and Activations for Power-Efficient Neural Network Acceleration

no code implementations24 Mar 2023 Richard Petri, Grace Li Zhang, Yiran Chen, Ulf Schlichtmann, Bing Li

To address this challenge, we propose PowerPruning, a novel method to reduce power consumption in digital neural network accelerators by selecting weights that lead to less power consumption in MAC operations.

Efficient Neural Network

Understanding Bugs in Multi-Language Deep Learning Frameworks

no code implementations5 Mar 2023 Zengyang Li, Sicheng Wang, Wenshuo Wang, Peng Liang, Ran Mo, Bing Li

Third, we found that 28. 6%, 31. 4%, and 16. 0% of bugs in MXNet, PyTorch, and TensorFlow are MPL bugs, respectively; the PL combination of Python and C/C++ is most used in fixing more than 92% MPL bugs in all DLFs.

Deep Learning

Improving GAN Training via Feature Space Shrinkage

1 code implementation2 Mar 2023 Haozhe Liu, Wentian Zhang, Bing Li, Haoqian Wu, Nanjun He, Yawen Huang, Yuexiang Li, Bernard Ghanem, Yefeng Zheng

The evaluation results demonstrate that our AdaptiveMix can facilitate the training of GANs and effectively improve the image quality of generated samples.

image-classification Out of Distribution (OOD) Detection

Mean Parity Fair Regression in RKHS

1 code implementation21 Feb 2023 Shaokui Wei, Jiayin Liu, Bing Li, Hongyuan Zha

We study the fair regression problem under the notion of Mean Parity (MP) fairness, which requires the conditional mean of the learned function output to be constant with respect to the sensitive attributes.

Fairness regression

Variation Enhanced Attacks Against RRAM-based Neuromorphic Computing System

no code implementations20 Feb 2023 Hao Lv, Bing Li, Lei Zhang, Cheng Liu, Ying Wang

The RRAM-based neuromorphic computing system has amassed explosive interests for its superior data processing capability and energy efficiency than traditional architectures, and thus being widely used in many data-centric applications.

Adversarial Attack

Plan-then-Seam: Towards Efficient Table-to-Text Generation

1 code implementation10 Feb 2023 Liang Li, Ruiying Geng, Chengyang Fang, Bing Li, Can Ma, Binhua Li, Yongbin Li

Table-to-text generation aims at automatically generating text to help people conveniently obtain salient information in tables.

Table-to-Text Generation

AdaptiveMix: Improving GAN Training via Feature Space Shrinkage

1 code implementation CVPR 2023 Haozhe Liu, Wentian Zhang, Bing Li, Haoqian Wu, Nanjun He, Yawen Huang, Yuexiang Li, Bernard Ghanem, Yefeng Zheng

The evaluation results demonstrate that our AdaptiveMix can facilitate the training of GANs and effectively improve the image quality of generated samples.

image-classification Out of Distribution (OOD) Detection

AUNet: Learning Relations Between Action Units for Face Forgery Detection

no code implementations CVPR 2023 Weiming Bai, Yufan Liu, Zhipeng Zhang, Bing Li, Weiming Hu

Observing that face manipulation may alter the relation between different facial action units (AU), we propose the Action Units Relation Learning framework to improve the generality of forgery detection.

DeepFake Detection Face Swapping +1

ViLEM: Visual-Language Error Modeling for Image-Text Retrieval

no code implementations CVPR 2023 Yuxin Chen, Zongyang Ma, Ziqi Zhang, Zhongang Qi, Chunfeng Yuan, Ying Shan, Bing Li, Weiming Hu, XiaoHu Qie, Jianping Wu

ViLEM then enforces the model to discriminate the correctness of each word in the plausible negative texts and further correct the wrong words via resorting to image information.

Contrastive Learning Image-text Retrieval +3

Spectral Regularized Kernel Two-Sample Tests

1 code implementation19 Dec 2022 Omar Hagrass, Bharath K. Sriperumbudur, Bing Li

First, we show the popular MMD (maximum mean discrepancy) two-sample test to be not optimal in terms of the separation boundary measured in Hellinger distance.

Vocal Bursts Valence Prediction

Hierarchical Terrain Attention and Multi-Scale Rainfall Guidance For Flood Image Prediction

no code implementations4 Dec 2022 Feifei Wang, Yong Wang, Bing Li, Qidong Huang, Shaoqing Chen

With the deterioration of climate, the phenomenon of rain-induced flooding has become frequent.

Be Careful with Rotation: A Uniform Backdoor Pattern for 3D Shape

no code implementations28 Nov 2022 Linkun Fan, Fazhi He, Qing Guo, Wei Tang, Xiaolin Hong, Bing Li

As a result, backdoor pattern designed for one certain 3D data structure will be disable for other data structures of the same 3D scene.

Backdoor Attack

CorrectNet: Robustness Enhancement of Analog In-Memory Computing for Neural Networks by Error Suppression and Compensation

no code implementations27 Nov 2022 Amro Eldebiky, Grace Li Zhang, Georg Boecherer, Bing Li, Ulf Schlichtmann

These acceleration platforms rely on analog properties of the devices and thus suffer from process variations and noise.

SteppingNet: A Stepping Neural Network with Incremental Accuracy Enhancement

no code implementations27 Nov 2022 Wenhao Sun, Grace Li Zhang, Xunzhao Yin, Cheng Zhuo, Huaxi Gu, Bing Li, Ulf Schlichtmann

In such platforms, neural networks need to provide acceptable results quickly and the accuracy of the results should be able to be enhanced dynamically according to the computational resources available in the computing system.

Autonomous Vehicles

Class-based Quantization for Neural Networks

no code implementations27 Nov 2022 Wenhao Sun, Grace Li Zhang, Huaxi Gu, Bing Li, Ulf Schlichtmann

In the proposed method, the importance score of each filter or neuron with respect to the number of classes in the dataset is first evaluated.

Quantization

Decoupled Mixup for Generalized Visual Recognition

1 code implementation26 Oct 2022 Haozhe Liu, Wentian Zhang, Jinheng Xie, Haoqian Wu, Bing Li, Ziqi Zhang, Yuexiang Li, Yawen Huang, Bernard Ghanem, Yefeng Zheng

Since the observation is that noise-prone regions such as textural and clutter backgrounds are adverse to the generalization ability of CNN models during training, we enhance features from discriminative regions and suppress noise-prone ones when combining an image pair.

Reconstruction from edge image combined with color and gradient difference for industrial surface anomaly detection

1 code implementation26 Oct 2022 Tongkun Liu, Bing Li, Zhuo Zhao, Xiao Du, Bingke Jiang, Leqi Geng

The model with an overly strong generalization capability can even well reconstruct the abnormal regions, making them less distinguishable, while the model with a poor generalization capability can not reconstruct those changeable high-frequency components in the normal regions, which ultimately leads to false positives.

Anomaly Detection Denoising

Class-Level Confidence Based 3D Semi-Supervised Learning

2 code implementations18 Oct 2022 Zhimin Chen, Longlong Jing, Liang Yang, Yingwei Li, Bing Li

Firstly, a dynamic thresholding strategy is proposed to utilize more unlabeled data, especially for low learning status classes.

Knowledge Is Flat: A Seq2Seq Generative Framework for Various Knowledge Graph Completion

1 code implementation COLING 2022 Chen Chen, YuFei Wang, Bing Li, Kwok-Yan Lam

To remedy the KG structure information loss from the "flat" text, we further improve the input representations of entities and relations, and the inference algorithm in KG-S2S.

Knowledge Graph Completion

Combating Mode Collapse in GANs via Manifold Entropy Estimation

1 code implementation25 Aug 2022 Haozhe Liu, Bing Li, Haoqian Wu, Hanbang Liang, Yawen Huang, Yuexiang Li, Bernard Ghanem, Yefeng Zheng

In this paper, we propose a novel training pipeline to address the mode collapse issue of GANs.

Cross-Architecture Knowledge Distillation

no code implementations12 Jul 2022 Yufan Liu, Jiajiong Cao, Bing Li, Weiming Hu, Jingting Ding, Liang Li

However, most existing knowledge distillation methods only consider homologous-architecture distillation, such as distilling knowledge from CNN to CNN.

Knowledge Distillation

Nonlinear Sufficient Dimension Reduction for Distribution-on-Distribution Regression

1 code implementation11 Jul 2022 Qi Zhang, Bing Li, Lingzhou Xue

We introduce a new approach to nonlinear sufficient dimension reduction in cases where both the predictor and the response are distributional data, modeled as members of a metric space.

Dimensionality Reduction regression

Narrowing the Gap: Improved Detector Training with Noisy Location Annotations

1 code implementation12 Jun 2022 Shaoru Wang, Jin Gao, Bing Li, Weiming Hu

Experiments for both synthesized and real-world scenarios consistently demonstrate the effectiveness of our approach, e. g., our method increases the degraded performance of the FCOS detector from 33. 6% AP to 35. 6% AP on COCO.

object-detection Object Detection

Representation Learning for Compressed Video Action Recognition via Attentive Cross-modal Interaction with Motion Enhancement

no code implementations7 May 2022 Bing Li, Jiaxin Chen, Dongming Zhang, Xiuguo Bao, Di Huang

To address the two issues above, this paper proposes a novel framework, namely Attentive Cross-modal Interaction Network with Motion Enhancement (MEACI-Net).

Action Recognition Denoising +2

SubGraph Networks based Entity Alignment for Cross-lingual Knowledge Graph

no code implementations7 May 2022 Shanqing Yu, Shihan Zhang, Jianlin Zhang, Jiajun Zhou, Qi Xuan, Bing Li, Xiaojuan Hu

Cross-lingual knowledge graph entity alignment aims to discover the cross-lingual links in the multi-language KGs, which is of great significance to the NLP applications and multi-language KGs fusion.

Entity Alignment Knowledge Graphs

Improving Visual Grounding with Visual-Linguistic Verification and Iterative Reasoning

1 code implementation CVPR 2022 Li Yang, Yan Xu, Chunfeng Yuan, Wei Liu, Bing Li, Weiming Hu

They base the visual grounding on the features from pre-generated proposals or anchors, and fuse these features with the text embeddings to locate the target mentioned by the text.

Attribute Decoder +3

CREATE: A Benchmark for Chinese Short Video Retrieval and Title Generation

no code implementations31 Mar 2022 Ziqi Zhang, Yuxin Chen, Zongyang Ma, Zhongang Qi, Chunfeng Yuan, Bing Li, Ying Shan, Weiming Hu

In this paper, we propose to CREATE, the first large-scale Chinese shoRt vidEo retrievAl and Title gEneration benchmark, to facilitate research and application in video titling and video retrieval in Chinese.

Retrieval Video Captioning +1

Disentangling Object Motion and Occlusion for Unsupervised Multi-frame Monocular Depth

1 code implementation29 Mar 2022 Ziyue Feng, Liang Yang, Longlong Jing, HaiYan Wang, YingLi Tian, Bing Li

Conventional self-supervised monocular depth prediction methods are based on a static environment assumption, which leads to accuracy degradation in dynamic scenes due to the mismatch and occlusion problems introduced by object motions.

Depth Prediction Disentanglement +5

Learning Scene Flow in 3D Point Clouds with Noisy Pseudo Labels

no code implementations23 Mar 2022 Bing Li, Cheng Zheng, Guohao Li, Bernard Ghanem

To provide an alternative, we propose a novel approach that utilizes monocular RGB images and point clouds to generate pseudo scene flow labels for training scene flow networks.

Pseudo Label Self-Supervised Learning

Continual Prompt Tuning for Dialog State Tracking

1 code implementation ACL 2022 Qi Zhu, Bing Li, Fei Mi, Xiaoyan Zhu, Minlie Huang

A desirable dialog system should be able to continually learn new skills without forgetting old ones, and thereby adapt to new domains or tasks in its life cycle.

Continual Learning dialog state tracking +1

Learning Target-aware Representation for Visual Tracking via Informative Interactions

no code implementations7 Jan 2022 Mingzhe Guo, Zhipeng Zhang, Heng Fan, Liping Jing, Yilin Lyu, Bing Li, Weiming Hu

The proposed GIM module and InBN mechanism are general and applicable to different backbone types including CNN and Transformer for improvements, as evidenced by our extensive experiments on multiple benchmarks.

Representation Learning Visual Tracking

An additive graphical model for discrete data

no code implementations29 Dec 2021 Jun Tao, Bing Li, Lingzhou Xue

We introduce a nonparametric graphical model for discrete node variables based on additive conditional independence.

model Relation

Recursive Least-Squares Estimator-Aided Online Learning for Visual Tracking

2 code implementations CVPR 2020 Jin Gao, Yan Lu, Xiaojuan Qi, Yutong Kou, Bing Li, Liang Li, Shan Yu, Weiming Hu

In this paper, we propose a simple yet effective recursive least-squares estimator-aided online learning approach for few-shot online adaptation without requiring offline training.

Continual Learning One-Shot Learning +1

Joint Learning of Visual-Audio Saliency Prediction and Sound Source Localization on Multi-face Videos

1 code implementation5 Nov 2021 Minglang Qiao, Yufan Liu, Mai Xu, Xin Deng, Bing Li, Weiming Hu, Ali Borji

In this paper, we propose a multitask learning method for visual-audio saliency prediction and sound source localization on multi-face video by leveraging visual, audio and face information.

Prediction Saliency Prediction +1

Multimodal Semi-Supervised Learning for 3D Objects

1 code implementation22 Oct 2021 Zhimin Chen, Longlong Jing, Yang Liang, YingLi Tian, Bing Li

This paper explores how the coherence of different modelities of 3D data (e. g. point cloud, image, and mesh) can be used to improve data efficiency for both 3D classification and retrieval tasks.

3D Classification Retrieval

MDERank: A Masked Document Embedding Rank Approach for Unsupervised Keyphrase Extraction

1 code implementation Findings (ACL) 2022 Linhan Zhang, Qian Chen, Wen Wang, Chong Deng, Shiliang Zhang, Bing Li, Wei Wang, Xin Cao

In this work, we propose a novel unsupervised embedding-based KPE approach, Masked Document Embedding Rank (MDERank), to address this problem by leveraging a mask strategy and ranking candidates by the similarity between embeddings of the source document and the masked document.

Contrastive Learning Document Embedding +4

Dimension Reduction for Fréchet Regression

no code implementations1 Oct 2021 Qi Zhang, Lingzhou Xue, Bing Li

In this paper, we introduce a flexible sufficient dimension reduction (SDR) method for Fr\'echet regression to achieve two purposes: to mitigate the curse of dimensionality caused by high-dimensional predictors and to provide a visual inspection tool for Fr\'echet regression.

Data Visualization Dimensionality Reduction +1

Self-Supervised Modality-Invariant and Modality-Specific Feature Learning for 3D Objects

no code implementations29 Sep 2021 Longlong Jing, Zhimin Chen, Bing Li, YingLi Tian

Our proposed novel self-supervised model learns two types of distinct features: modality-invariant features and modality-specific features.

3D Object Recognition Cross-Modal Retrieval +1

Advancing Self-supervised Monocular Depth Learning with Sparse LiDAR

2 code implementations20 Sep 2021 Ziyue Feng, Longlong Jing, Peng Yin, YingLi Tian, Bing Li

Unlike the existing methods that use sparse LiDAR mainly in a manner of time-consuming iterative post-processing, our model fuses monocular image features and sparse LiDAR features to predict initial depth maps.

Depth Completion Depth Prediction +3

SDTP: Semantic-aware Decoupled Transformer Pyramid for Dense Image Prediction

no code implementations18 Sep 2021 Zekun Li, Yufan Liu, Bing Li, Weiming Hu, Kebin Wu, Pei Wang

CDI builds the global attention and interaction among different levels in decoupled space which also solves the problem of heavy computation.

Diversity Prediction

Sent2Span: Span Detection for PICO Extraction in the Biomedical Text without Span Annotations

1 code implementation Findings (EMNLP) 2021 Shifeng Liu, Yifang Sun, Bing Li, Wei Wang, Florence T. Bourgeois, Adam G. Dunn

The rapid growth in published clinical trials makes it difficult to maintain up-to-date systematic reviews, which requires finding all relevant trials.

Articles PICO +1

Learn to Match: Automatic Matching Network Design for Visual Tracking

1 code implementation ICCV 2021 Zhipeng Zhang, Yihao Liu, Xiao Wang, Bing Li, Weiming Hu

Siamese tracking has achieved groundbreaking performance in recent years, where the essence is the efficient matching operator cross-correlation and its variants.

Visual Tracking

PSE-Match: A Viewpoint-free Place Recognition Method with Parallel Semantic Embedding

no code implementations1 Aug 2021 Peng Yin, Lingyun Xu, Ziyue Feng, Anton Egorov, Bing Li

Accurate localization on autonomous driving cars is essential for autonomy and driving safety, especially for complex urban streets and search-and-rescue subterranean environments where high-accurate GPS is not available.

Autonomous Driving Retrieval

Automatic Construction of Enterprise Knowledge Base

no code implementations EMNLP (ACL) 2021 Junyi Chai, Yujie He, Homa Hashemi, Bing Li, Daraksha Parveen, Ranganath Kondapally, Wenjin Xu

In this paper, we present an automatic knowledge base construction system from large scale enterprise documents with minimal efforts of human intervention.

Knowledge Base Construction

SCTN: Sparse Convolution-Transformer Network for Scene Flow Estimation

1 code implementation10 May 2021 Bing Li, Cheng Zheng, Silvio Giancola, Bernard Ghanem

We propose a novel scene flow estimation approach to capture and infer 3D motions from point clouds.

Scene Flow Estimation

A Simple and Strong Baseline for Universal Targeted Attacks on Siamese Visual Tracking

no code implementations6 May 2021 Zhenbang Li, Yaya Shi, Jin Gao, Shaoru Wang, Bing Li, Pengpeng Liang, Weiming Hu

In this paper, we show the existence of universal perturbations that can enable the targeted attack, e. g., forcing a tracker to follow the ground-truth trajectory with specified offsets, to be video-agnostic and free from inference in a network.

Visual Tracking

PDNet: Toward Better One-Stage Object Detection With Prediction Decoupling

1 code implementation28 Apr 2021 Li Yang, Yan Xu, Shaoru Wang, Chunfeng Yuan, Ziqi Zhang, Bing Li, Weiming Hu

However, the most suitable positions for inferring different targets, i. e., the object category and boundaries, are generally different.

Object object-detection +2

Learning to Predict Salient Faces: A Novel Visual-Audio Saliency Model

1 code implementation ECCV 2020 Yufan Liu, Minglang Qiao, Mai Xu, Bing Li, Weiming Hu, Ali Borji

Inspired by the findings of our investigation, we propose a novel multi-modal video saliency model consisting of three branches: visual, audio and face.

Saliency Prediction

Open-book Video Captioning with Retrieve-Copy-Generate Network

no code implementations CVPR 2021 Ziqi Zhang, Zhongang Qi, Chunfeng Yuan, Ying Shan, Bing Li, Ying Deng, Weiming Hu

Due to the rapid emergence of short videos and the requirement for content understanding and creation, the video captioning task has received increasing attention in recent years.

Decoder Retrieval +1

AniGAN: Style-Guided Generative Adversarial Networks for Unsupervised Anime Face Generation

3 code implementations24 Feb 2021 Bing Li, Yuanlue Zhu, Yitong Wang, Chia-Wen Lin, Bernard Ghanem, Linlin Shen

Specifically, a new generator architecture is proposed to simultaneously transfer color/texture styles and transform local facial shapes into anime-like counterparts based on the style of a reference anime-face, while preserving the global structure of the source photo-face.

Face Generation Translation

On Forward Sufficient Dimension Reduction for Categorical and Ordinal Responses

no code implementations11 Feb 2021 Harris Quach, Bing Li

Like other forward regression-based sufficient dimension reduction methods, our approach avoids the relatively stringent distributional requirements necessary for inverse regression alternatives.

Dimensionality Reduction Methodology

FGNET-RH: Fine-Grained Named Entity Typing via Refinement in Hyperbolic Space

no code implementations27 Jan 2021 Muhammad Asif Ali, Yifang Sun, Bing Li, Wei Wang

Fine-Grained Named Entity Typing (FG-NET) aims at classifying the entity mentions into a wide range of entity types (usually hundreds) depending upon the context.

Entity Typing

Named Entity Recognition in the Style of Object Detection

no code implementations26 Jan 2021 Bing Li

In this work, we propose a two-stage method for named entity recognition (NER), especially for nested NER.

named-entity-recognition Named Entity Recognition +6

Cross-Lingual Named Entity Recognition Using Parallel Corpus: A New Approach Using XLM-RoBERTa Alignment

no code implementations26 Jan 2021 Bing Li, Yujie He, Wenjin Xu

We built an entity alignment model on top of XLM-RoBERTa to project the entities detected on the English part of the parallel data to the target language sentences, whose accuracy surpasses all previous unsupervised models.

Cross-Lingual NER Entity Alignment +4

High Quality Disparity Remapping With Two-Stage Warping

no code implementations ICCV 2021 Bing Li, Chia-Wen Lin, Cheng Zheng, Shan Liu, Junsong Yuan, Bernard Ghanem, C.-C. Jay Kuo

In the second stage, we derive another warping model to refine warping results in less important regions by eliminating serious distortions in shape, disparity and 3D structure.

Vocal Bursts Intensity Prediction Vocal Bursts Valence Prediction

Rethinking the competition between detection and ReID in Multi-Object Tracking

4 code implementations23 Oct 2020 Chao Liang, Zhipeng Zhang, Xue Zhou, Bing Li, Shuyuan Zhu, Weiming Hu

However, the inherent differences and relations between detection and re-identification (ReID) are unconsciously overlooked because of treating them as two isolated tasks in the one-shot tracking paradigm.

 Ranked #1 on Multi-Object Tracking on HiEve (using extra training data)

Multi-Object Tracking

Towards Accurate Pixel-wise Object Tracking by Attention Retrieval

1 code implementation6 Aug 2020 Zhipeng Zhang, Bing Li, Weiming Hu, Houwen Peng

We first build a look-up-table (LUT) with the ground-truth mask in the starting frame, and then retrieves the LUT to obtain an attention map for spatial constraints.

Object Object Tracking +2

Object Relational Graph with Teacher-Recommended Learning for Video Captioning

no code implementations CVPR 2020 Ziqi Zhang, Yaya Shi, Chunfeng Yuan, Bing Li, Peijin Wang, Weiming Hu, Zheng-Jun Zha

In this paper, we propose a complete video captioning system including both a novel model and an effective training strategy.

Ranked #9 on Video Captioning on VATEX (using extra training data)

Language Modeling Language Modelling +1

HAMNER: Headword Amplified Multi-span Distantly Supervised Method for Domain Specific Named Entity Recognition

no code implementations3 Dec 2019 Shifeng Liu, Yifang Sun, Bing Li, Wei Wang, Xiang Zhao

To tackle Named Entity Recognition (NER) tasks, supervised methods need to obtain sufficient cleanly annotated data, which is labor and time consuming.

Boundary Detection named-entity-recognition +2

An Overview of In-memory Processing with Emerging Non-volatile Memory for Data-intensive Applications

no code implementations15 Jun 2019 Bing Li, Bonan Yan, Hai, Li

The conventional von Neumann architecture has been revealed as a major performance and energy bottleneck for rising data-intensive applications.

Multimodal Semantic Attention Network for Video Captioning

no code implementations8 May 2019 Liang Sun, Bing Li, Chunfeng Yuan, Zheng-Jun Zha, Weiming Hu

Inspired by the fact that different modalities in videos carry complementary information, we propose a Multimodal Semantic Attention Network(MSAN), which is a new encoder-decoder framework incorporating multimodal semantic attributes for video captioning.

Attribute Decoder +4

Interaction-aware Spatio-temporal Pyramid Attention Networks for Action Classification

no code implementations ECCV 2018 Yang Du, Chunfeng Yuan, Bing Li, Lili Zhao, Yangxi Li, Weiming Hu

Furthermore, since different layers in a deep network capture feature maps of different scales, we use these feature maps to construct a spatial pyramid and then utilize multi-scale information to obtain more accurate attention scores, which are used to weight the local features in all spatial positions of feature maps to calculate attention maps.

Action Classification Classification +1

Depth-Aware Stereo Video Retargeting

no code implementations CVPR 2018 Bing Li, Chia-Wen Lin, Boxin Shi, Tiejun Huang, Wen Gao, C. -C. Jay Kuo

As compared with traditional video retargeting, stereo video retargeting poses new challenges because stereo video contains the depth information of salient objects and its time dynamics.

Spatio-Temporal Self-Organizing Map Deep Network for Dynamic Object Detection From Videos

no code implementations CVPR 2017 Yang Du, Chunfeng Yuan, Bing Li, Weiming Hu, Stephen Maybank

In dynamic object detection, it is challenging to construct an effective model to sufficiently characterize the spatial-temporal properties of the background.

object-detection Object Detection +1

Linear Contour Learning: A Method for Supervised Dimension Reduction

no code implementations13 Aug 2014 Bing Li, Hongyuan Zha, Francesca Chiaromonte

We propose a novel approach to sufficient dimension reduction in regression, based on estimating contour directions of negligible variation for the response surface.

Dimensionality Reduction regression

Removing Mixture of Gaussian and Impulse Noise by Patch-Based Weighted Means

no code implementations11 Mar 2014 Haijuan Hu, Bing Li, Quansheng Liu

We first establish a law of large numbers and a convergence theorem in distribution to show the rate of convergence of the non-local means filter for removing Gaussian noise.

Illumination Estimation Based on Bilayer Sparse Coding

no code implementations CVPR 2013 Bing Li, Weihua Xiong, Weiming Hu, Houwen Peng

In this paper, we propose a novel bilayer sparse coding model for illumination estimation that considers image similarity in terms of both low level color distribution and high level image scene content simultaneously.

Color Constancy

Cannot find the paper you are looking for? You can Submit a new open access paper.