Search Results for author: Sam Kwong

Found 67 papers, 26 papers with code

Feedback Chain Network For Hippocampus Segmentation

no code implementations15 Nov 2022 Heyu Huang, Runmin Cong, Lianhe Yang, Ling Du, Cong Wang, Sam Kwong

The feedback chain structure unit learns deeper and wider feature representation of each encoder layer through the hierarchical feature aggregation feedback chains, and achieves feature selection and feedback through the feature handover attention module.

Hippocampus Image Segmentation +2

PSNet: Parallel Symmetric Network for Video Salient Object Detection

no code implementations12 Oct 2022 Runmin Cong, Weiyu Song, Jianjun Lei, Guanghui Yue, Yao Zhao, Sam Kwong

Finally, we use the Importance Perception Fusion (IPF) module to fuse the features from two parallel branches according to their different importance in different scenarios.

object-detection Optical Flow Estimation +3

HVS Revisited: A Comprehensive Video Quality Assessment Framework

no code implementations9 Oct 2022 Ao-Xiang Zhang, Yuan-Gen Wang, Weixuan Tang, Leida Li, Sam Kwong

Based on the revisited HVS, a no-reference VQA framework called HVS-5M (NRVQA framework with five modules simulating HVS with five characteristics) is proposed.

Video Quality Assessment Visual Question Answering (VQA)

Does Thermal Really Always Matter for RGB-T Salient Object Detection?

1 code implementation9 Oct 2022 Runmin Cong, Kepu Zhang, Chen Zhang, Feng Zheng, Yao Zhao, Qingming Huang, Sam Kwong

In addition, considering the role of thermal modality, we set up different cross-modality interaction mechanisms in the encoding phase and the decoding phase.

object-detection Object Detection +2

Just Noticeable Difference Modeling for Face Recognition System

no code implementations13 Sep 2022 Yu Tian, Zhangkai Ni, Baoliang Chen, Shurun Wang, Shiqi Wang, Hanli Wang, Sam Kwong

In particular, in order to maximum redundancy removal without impairment of robust identity information, we apply the encoder with multiple feature extraction and attention-based feature decomposition modules to progressively decompose face features into two uncorrelated components, i. e., identity and residual features, via self-supervised learning.

Face Recognition Self-Supervised Learning

Deep Feature Statistics Mapping for Generalized Screen Content Image Quality Assessment

1 code implementation12 Sep 2022 Baoliang Chen, Hanwei Zhu, Lingyu Zhu, Shiqi Wang, Sam Kwong

The underlying mechanism of the proposed approach is based upon the wild assumption that the SCIs, which are not physically acquired, still obey certain statistics that could be understood in a learning fashion.

No-Reference Image Quality Assessment

Boundary Guided Semantic Learning for Real-time COVID-19 Lung Infection Segmentation System

no code implementations7 Sep 2022 Runmin Cong, Yumo Zhang, Ning Yang, Haisheng Li, Xueqi Zhang, Ruochen Li, Zewen Chen, Yao Zhao, Sam Kwong

The coronavirus disease 2019 (COVID-19) continues to have a negative impact on healthcare systems around the world, though the vaccines have been developed and national vaccination coverage rate is steadily increasing.

A Weakly Supervised Learning Framework for Salient Object Detection via Hybrid Labels

2 code implementations7 Sep 2022 Runmin Cong, Qi Qin, Chen Zhang, Qiuping Jiang, Shiqi Wang, Yao Zhao, Sam Kwong

In this paper, we focus on a new weakly-supervised SOD task under hybrid labels, where the supervision labels include a large number of coarse labels generated by the traditional unsupervised method and a small number of real labels.

object-detection RGB Salient Object Detection +3

High Dynamic Range Image Quality Assessment Based on Frequency Disparity

1 code implementation6 Sep 2022 Yue Liu, Zhangkai Ni, Shiqi Wang, Hanli Wang, Sam Kwong

In this paper, a novel and effective image quality assessment (IQA) algorithm based on frequency disparity for high dynamic range (HDR) images is proposed, termed as local-global frequency feature-based model (LGFM).

Image Quality Assessment

DeepWSD: Projecting Degradations in Perceptual Space to Wasserstein Distance in Deep Feature Space

1 code implementation5 Aug 2022 Xigran Liao, Baoliang Chen, Hanwei Zhu, Shiqi Wang, Mingliang Zhou, Sam Kwong

Existing deep learning-based full-reference IQA (FR-IQA) models usually predict the image quality in a deterministic way by explicitly comparing the features, gauging how severely distorted an image is by how far the corresponding feature lies from the space of the reference images.

BCS-Net: Boundary, Context and Semantic for Automatic COVID-19 Lung Infection Segmentation from CT Images

3 code implementations17 Jul 2022 Runmin Cong, Haowei Yang, Qiuping Jiang, Wei Gao, Haisheng Li, Cong Wang, Yao Zhao, Sam Kwong

The spread of COVID-19 has brought a huge disaster to the world, and the automatic segmentation of infection regions can help doctors to make diagnosis quickly and reduce workload.

Cycle-Interactive Generative Adversarial Network for Robust Unsupervised Low-Light Enhancement

no code implementations3 Jul 2022 Zhangkai Ni, Wenhan Yang, Hanli Wang, Shiqi Wang, Lin Ma, Sam Kwong

Getting rid of the fundamental limitations in fitting to the paired training data, recent unsupervised low-light enhancement methods excel in adjusting illumination and contrast of images.

Low-Light Image Enhancement

Dual Swin-Transformer based Mutual Interactive Network for RGB-D Salient Object Detection

no code implementations7 Jun 2022 Chao Zeng, Sam Kwong

Considering the inaccurate depth map issue, we collect the RGB features of early stages into a skip convolution module to give more guidance from RGB modality to the final saliency prediction.

object-detection RGB-D Salient Object Detection +2

Multi-View Video Coding with GAN Latent Learning

no code implementations7 May 2022 Chengdong Lan, Cheng Luo, Hao Yan, Tiesong Zhao, Sam Kwong

The introduction of multiple viewpoints inevitably increases the bitrates to store and transmit video scenes.

Efficient VVC Intra Prediction Based on Deep Feature Fusion and Probability Estimation

no code implementations7 May 2022 Tiesong Zhao, Yuhang Huang, Weize Feng, Yiwen Xu, Sam Kwong

The ever-growing multimedia traffic has underscored the importance of effective multimedia codecs.

Global-and-Local Collaborative Learning for Co-Salient Object Detection

no code implementations19 Apr 2022 Runmin Cong, Ning Yang, Chongyi Li, Huazhu Fu, Yao Zhao, Qingming Huang, Sam Kwong

In this paper, we propose a global-and-local collaborative learning architecture, which includes a global correspondence modeling (GCM) and a local correspondence modeling (LCM) to capture comprehensive inter-image corresponding relationship among different images from the global and local perspectives.

Co-Salient Object Detection object-detection +1

Deep Learning-Based Intra Mode Derivation for Versatile Video Coding

no code implementations8 Apr 2022 Linwei Zhu, Yun Zhang, Na Li, Gangyi Jiang, Sam Kwong

To further improve the performance of intra coding in Versatile Video Coding (VVC), an intelligent intra mode derivation method is proposed in this paper, termed as Deep Learning based Intra Mode Derivation (DLIMD).

Multi-class Classification Quantization

Two-stream Hierarchical Similarity Reasoning for Image-text Matching

no code implementations10 Mar 2022 Ran Chen, Hanli Wang, Lei Wang, Sam Kwong

Second, previous approaches only consider learning single-stream similarity alignment (i. e., image-to-text level or text-to-image level), which is inadequate to fully use similarity information for image-text matching.

Text Matching

Distortion-Aware Loop Filtering of Intra 360^o Video Coding with Equirectangular Projection

no code implementations20 Feb 2022 Pingping Zhang, Xu Wang, Linwei Zhu, Yun Zhang, Shiqi Wang, Sam Kwong

In this paper, we propose a distortion-aware loop filtering model to improve the performance of intra coding for 360$^o$ videos projected via equirectangular projection (ERP) format.

Image Reconstruction

Generalized Visual Quality Assessment of GAN-Generated Face Images

no code implementations28 Jan 2022 Yu Tian, Zhangkai Ni, Baoliang Chen, Shiqi Wang, Hanli Wang, Sam Kwong

However, little work has been dedicated to automatic quality assessment of such GAN-generated face images (GFIs), even less have been devoted to generalized and robust quality assessment of GFIs generated with unseen GAN model.

Face Generation Image Quality Assessment +1

Crowd Counting in the Frequency Domain

1 code implementation CVPR 2022 Weibo Shu, Jia Wan, Kay Chen Tan, Sam Kwong, Antoni B. Chan

By transforming the density map into the frequency domain and using the nice properties of the characteristic function, we propose a novel method that is simple, effective, and efficient.

Crowd Counting

CSformer: Bridging Convolution and Transformer for Compressive Sensing

no code implementations31 Dec 2021 Dongjie Ye, Zhangkai Ni, Hanli Wang, Jian Zhang, Shiqi Wang, Sam Kwong

The proposed approach is an end-to-end compressive image sensing method, composed of adaptive sampling and recovery.

Compressive Sensing Inductive Bias +1

Learning Transformer Features for Image Quality Assessment

no code implementations1 Dec 2021 Chao Zeng, Sam Kwong

In addition, comparable NR performance is achieved in extensive experiments, and the results show that the NR performance can be leveraged by the joint training scheme.

Image Quality Assessment

RRNet: Relational Reasoning Network with Parallel Multi-scale Attention for Salient Object Detection in Optical Remote Sensing Images

1 code implementation27 Oct 2021 Runmin Cong, Yumo Zhang, Leyuan Fang, Jun Li, Yao Zhao, Sam Kwong

Salient object detection (SOD) for optical remote sensing images (RSIs) aims at locating and extracting visually distinctive objects/regions from the optical RSIs.

object-detection Object Detection +2

Cross-modality Discrepant Interaction Network for RGB-D Salient Object Detection

1 code implementation4 Aug 2021 Chen Zhang, Runmin Cong, Qinwei Lin, Lin Ma, Feng Li, Yao Zhao, Sam Kwong

For the cross-modality interaction in feature encoder, existing methods either indiscriminately treat RGB and depth modalities, or only habitually utilize depth cues as auxiliary information of the RGB branch.

object-detection RGB-D Salient Object Detection +1

BridgeNet: A Joint Learning Network of Depth Map Super-Resolution and Monocular Depth Estimation

no code implementations27 Jul 2021 Qi Tang, Runmin Cong, Ronghui Sheng, Lingzhi He, Dan Zhang, Yao Zhao, Sam Kwong

The other is the content guidance bridge (CGBdg) designed for the depth map reconstruction process, which provides the content guidance learned from DSR task for MDE task.

Depth Map Super-Resolution Monocular Depth Estimation +1

Detect and Locate: Exposing Face Manipulation by Semantic- and Noise-level Telltales

1 code implementation13 Jul 2021 Chenqi Kong, Baoliang Chen, Haoliang Li, Shiqi Wang, Anderson Rocha, Sam Kwong

The technological advancements of deep learning have enabled sophisticated face manipulation schemes, raising severe trust issues and security concerns in modern society.

Decision Making

Contrastive Semantic Similarity Learning for Image Captioning Evaluation with Intrinsic Auto-encoder

no code implementations29 Jun 2021 Chao Zeng, Tiesong Zhao, Sam Kwong

Motivated by the auto-encoder mechanism and contrastive representation learning advances, we propose a learning-based metric for image captioning, which we call Intrinsic Image Captioning Evaluation($I^2CE$).

Image Captioning Representation Learning +2

Self-supervised Symmetric Nonnegative Matrix Factorization

1 code implementation2 Mar 2021 Yuheng Jia, Hui Liu, Junhui Hou, Sam Kwong, Qingfu Zhang

Inspired by ensemble clustering that aims to seek a better clustering result from a set of clustering results, we propose self-supervised SNMF (S$^3$NMF), which is capable of boosting clustering performance progressively by taking advantage of the sensitivity to initialization characteristic of SNMF, without relying on any additional information.

On the Philosophical, Cognitive and Mathematical Foundations of Symbiotic Autonomous Systems (SAS)

no code implementations11 Feb 2021 Yingxu Wang, Fakhri Karray, Sam Kwong, Konstantinos N. Plataniotis, Henry Leung, Ming Hou, Edward Tunstel, Imre J. Rudas, Ljiljana Trajkovic, Okyay Kaynak, Janusz Kacprzyk, Mengchu Zhou, Michael H. Smith, Philip Chen, Shushma Patel

Symbiotic Autonomous Systems (SAS) are advanced intelligent and cognitive systems exhibiting autonomous collective intelligence enabled by coherent symbiosis of human-machine interactions in hybrid societies.

Camera Invariant Feature Learning for Generalized Face Anti-spoofing

no code implementations25 Jan 2021 Baoliang Chen, Wenhan Yang, Haoliang Li, Shiqi Wang, Sam Kwong

The first branch aims to learn the camera invariant spoofing features via feature level decomposition in the high frequency domain.

Face Anti-Spoofing

Towards Unsupervised Deep Image Enhancement with Generative Adversarial Network

1 code implementation30 Dec 2020 Zhangkai Ni, Wenhan Yang, Shiqi Wang, Lin Ma, Sam Kwong

In this paper, we present an unsupervised image enhancement generative adversarial network (UEGAN), which learns the corresponding image-to-image mapping from a set of images with desired characteristics in an unsupervised manner, rather than learning on a large number of paired images.

Image Enhancement L2 Regularization

Unpaired Image Enhancement with Quality-Attention Generative Adversarial Network

no code implementations30 Dec 2020 Zhangkai Ni, Wenhan Yang, Shiqi Wang, Lin Ma, Sam Kwong

The key novelty of the proposed QAGAN lies in the injected QAM for the generator such that it learns domain-relevant quality attention directly from the two domains.

Image Enhancement

Intrinsic Image Captioning Evaluation

no code implementations14 Dec 2020 Chao Zeng, Sam Kwong

The image captioning task is about to generate suitable descriptions from images.

Image Captioning Word Embeddings

Superpixel Segmentation Based on Spatially Constrained Subspace Clustering

no code implementations11 Dec 2020 Hua Li, Yuheng Jia, Runmin Cong, Wenhui Wu, Sam Kwong, Chuanbo Chen

Consequently, we devise a spatial regularization and propose a novel convex locality-constrained subspace clustering model that is able to constrain the spatial adjacent pixels with similar attributes to be clustered into a superpixel and generate the content-aware superpixels with more detailed boundaries.


Dense Attention Fluid Network for Salient Object Detection in Optical Remote Sensing Images

3 code implementations26 Nov 2020 Qijian Zhang, Runmin Cong, Chongyi Li, Ming-Ming Cheng, Yuming Fang, Xiaochun Cao, Yao Zhao, Sam Kwong

Despite the remarkable advances in visual saliency analysis for natural scene images (NSIs), salient object detection (SOD) for optical remote sensing images (RSIs) still remains an open and challenging problem.

object-detection Object Detection +1

Deep Magnification-Flexible Upsampling over 3D Point Clouds

1 code implementation25 Nov 2020 Yue Qian, Junhui Hou, Sam Kwong, Ying He

In addition, we propose a simple yet effective training strategy to drive such a flexible ability.

Controllable Pareto Multi-Task Learning

no code implementations13 Oct 2020 Xi Lin, Zhiyuan Yang, Qingfu Zhang, Sam Kwong

With a fixed model capacity, the tasks would be conflicted with each other, and the system usually has to make a trade-off among learning all of them together.

Multiobjective Optimization Multi-Task Learning

Unsupervised Image-to-Image Translation via Pre-trained StyleGAN2 Network

1 code implementation12 Oct 2020 Jialu Huang, Jing Liao, Sam Kwong

We proposed a new I2I translation method that generates a new model in the target domain via a series of model transformations on a pre-trained StyleGAN2 model in the source domain.

Colorization Semantic Similarity +4

Deep Selective Combinatorial Embedding and Consistency Regularization for Light Field Super-resolution

no code implementations26 Sep 2020 Jing Jin, Junhui Hou, Zhiyu Zhu, Jie Chen, Sam Kwong

To preserve the parallax structure among the reconstructed SAIs, we subsequently append a consistency regularization network trained over a structure-aware loss function to refine the parallax relationships over the coarse estimation.

Disparity Estimation Super-Resolution

Towards Modality Transferable Visual Information Representation with Optimal Model Compression

no code implementations13 Aug 2020 Rongqun Lin, Linwei Zhu, Shiqi Wang, Sam Kwong

Compactly representing the visual signals is of fundamental importance in various image/video-centered applications.

Model Compression Philosophy

Multi-Density Sketch-to-Image Translation Network

no code implementations18 Jun 2020 Jialu Huang, Jing Liao, Zhifeng Tan, Sam Kwong

Sketch-to-image (S2I) translation plays an important role in image synthesis and manipulation tasks, such as photo editing and colorization.

Colorization Image Generation +2

MOPS-Net: A Matrix Optimization-driven Network forTask-Oriented 3D Point Cloud Downsampling

1 code implementation1 May 2020 Yue Qian, Junhui Hou, Qijian Zhang, Yiming Zeng, Sam Kwong, Ying He

This paper explores the problem of task-oriented downsampling over 3D point clouds, which aims to downsample a point cloud while maintaining the performance of subsequent applications applied to the downsampled sparse points as much as possible.

Point Cloud Classification

Multi-View Spectral Clustering Tailored Tensor Low-Rank Representation

no code implementations30 Apr 2020 Yuheng Jia, Hui Liu, Junhui Hou, Sam Kwong, Qingfu Zhang

On the basis of the novel tensor low-rank norm, we formulate MVSC as a convex low-rank tensor recovery problem, which is then efficiently solved with an augmented Lagrange multiplier based method iteratively.

Light Field Spatial Super-resolution via Deep Combinatorial Geometry Embedding and Structural Consistency Regularization

1 code implementation CVPR 2020 Jing Jin, Junhui Hou, Jie Chen, Sam Kwong

Light field (LF) images acquired by hand-held devices usually suffer from low spatial resolution as the limited sampling resources have to be shared with the angular dimension.


PUGeo-Net: A Geometry-centric Network for 3D Point Cloud Upsampling

1 code implementation ECCV 2020 Yue Qian, Junhui Hou, Sam Kwong, Ying He

Matrix $\mathbf T$ approximates the augmented Jacobian matrix of a local parameterization and builds a one-to-one correspondence between the 2D parametric domain and the 3D tangent plane so that we can lift the adaptively distributed 2D samples (which are also learned from data) to 3D space.

Point Cloud Super Resolution Surface Reconstruction

Zero-Reference Deep Curve Estimation for Low-Light Image Enhancement

9 code implementations CVPR 2020 Chunle Guo, Chongyi Li, Jichang Guo, Chen Change Loy, Junhui Hou, Sam Kwong, Runmin Cong

The paper presents a novel method, Zero-Reference Deep Curve Estimation (Zero-DCE), which formulates light enhancement as a task of image-specific curve estimation with a deep network.

 Ranked #1 on Low-Light Image Enhancement on NPE (User Study Score metric)

Face Detection Low-Light Image Enhancement

Pareto Multi-Task Learning

1 code implementation NeurIPS 2019 Xi Lin, Hui-Ling Zhen, Zhenhua Li, Qingfu Zhang, Sam Kwong

Recently, a novel method is proposed to find one single Pareto optimal solution with good trade-off among different tasks by casting multi-task learning as multiobjective optimization.

Multiobjective Optimization Multi-Task Learning

An Ensemble Rate Adaptation Framework for Dynamic Adaptive Streaming Over HTTP

no code implementations26 Dec 2019 Hui Yuan, Xiaoqian Hu, Junhui Hou, Xuekai Wei, Sam Kwong

Specifically, the proposed framework is composed of two modules, i. e., the method pool and method controller.

Video Compression Coding via Colorization: A Generative Adversarial Network (GAN)-Based Approach

no code implementations23 Dec 2019 Zhaoqing Pan, Feng Yuan, Jianjun Lei, Sam Kwong

Under the limited storage, computing and network bandwidth resources, the video compression coding technology plays an important role for visual communication.

Colorization Video Compression

Spatial and Temporal Consistency-Aware Dynamic Adaptive Streaming for 360-Degree Videos

no code implementations20 Dec 2019 Hui Yuan, Shiyun Zhao, Junhui Hou, Xuekai Wei, Sam Kwong

That is, our method preserves both the quality and the smoothness of tiles in FoV, thus providing the best QoE for users.

Controllable List-wise Ranking for Universal No-reference Image Quality Assessment

1 code implementation24 Nov 2019 Fu-Zhao Ou, Yuan-Gen Wang, Jin Li, Guopu Zhu, Sam Kwong

First, to extend the authentically distorted image dataset, we present an imaging-heuristic approach, in which the over-underexposure is formulated as an inverse of Weber-Fechner law, and fusion strategy and probabilistic compression are adopted, to generate the degraded real-world images.

No-Reference Image Quality Assessment

Deep Coarse-to-fine Dense Light Field Reconstruction with Flexible Sampling and Geometry-aware Fusion

1 code implementation31 Aug 2019 Jing Jin, Junhui Hou, Jie Chen, Huanqiang Zeng, Sam Kwong, Jingyi Yu

Specifically, the coarse sub-aperture image (SAI) synthesis module first explores the scene geometry from an unstructured sparsely-sampled LF and leverages it to independently synthesize novel SAIs, in which a confidence-based blending strategy is proposed to fuse the information from different input SAIs, giving an intermediate densely-sampled LF.

Depth Estimation

Bayesian Network Based Label Correlation Analysis For Multi-label Classifier Chain

no code implementations6 Aug 2019 Ran Wang, Suhe Ye, Ke Li, Sam Kwong

Classifier chain (CC) is a multi-label learning approach that constructs a sequence of binary classifiers according to a label order.

Multi-Label Learning

Light Field Super-resolution via Attention-Guided Fusion of Hybrid Lenses

1 code implementation23 Jul 2019 Jing Jin, Junhui Hou, Jie Chen, Sam Kwong, Jingyi Yu

To the best of our knowledge, this is the first end-to-end deep learning method for reconstructing a high-resolution LF image with a hybrid input.


Nested Network with Two-Stream Pyramid for Salient Object Detection in Optical Remote Sensing Images

no code implementations20 Jun 2019 Chongyi Li, Runmin Cong, Junhui Hou, Sanyi Zhang, Yue Qian, Sam Kwong

Arising from the various object types and scales, diverse imaging orientations, and cluttered backgrounds in optical remote sensing image (RSI), it is difficult to directly extend the success of salient object detection for nature scene image to the optical RSI.

object-detection RGB Salient Object Detection +1

An Underwater Image Enhancement Benchmark Dataset and Beyond

1 code implementation11 Jan 2019 Chongyi Li, Chunle Guo, Wenqi Ren, Runmin Cong, Junhui Hou, Sam Kwong, DaCheng Tao

In this paper, we construct an Underwater Image Enhancement Benchmark (UIEB) including 950 real-world underwater images, 890 of which have the corresponding reference images.

Ranked #5 on Underwater Image Restoration on LSUI (using extra training data)

Image Enhancement Underwater Image Restoration

Nonlinear Collaborative Scheme for Deep Neural Networks

no code implementations4 Nov 2018 Hui-Ling Zhen, Xi Lin, Alan Z. Tang, Zhenhua Li, Qingfu Zhang, Sam Kwong

Different from them, in this paper, we aim to link the generalization ability of a deep network to optimizing a new objective function.

A Batched Scalable Multi-Objective Bayesian Optimization Algorithm

no code implementations4 Nov 2018 Xi Lin, Hui-Ling Zhen, Zhenhua Li, Qingfu Zhang, Sam Kwong

The proposed algorithm uses the Bayesian neural network as the scalable surrogate model.

Evolutionary Many-Objective Optimization Based on Adversarial Decomposition

no code implementations7 Apr 2017 Mengyuan Wu, Ke Li, Sam Kwong, Qingfu Zhang

It decomposes a multi-objective optimization problem into several single-objective optimization subproblems, each of which is usually defined as a scalarizing function using a weight vector.

Matching-Based Selection with Incomplete Lists for Decomposition Multi-Objective Optimization

no code implementations30 Aug 2016 Mengyuan Wu, Ke Li, Sam Kwong, Yu Zhou, Qingfu Zhang

In particular, the stable matching between subproblems and solutions, which achieves an equilibrium between their mutual preferences, implicitly strikes a balance between the convergence and diversity.

Cannot find the paper you are looking for? You can Submit a new open access paper.