no code implementations • 23 Dec 2022 • Runmin Cong, Ke Huang, Jianjun Lei, Yao Zhao, Qingming Huang, Sam Kwong
Salient object detection (SOD) aims to determine the most visually attractive objects in an image.
no code implementations • 15 Nov 2022 • Heyu Huang, Runmin Cong, Lianhe Yang, Ling Du, Cong Wang, Sam Kwong
The feedback chain structure unit learns deeper and wider feature representation of each encoder layer through the hierarchical feature aggregation feedback chains, and achieves feature selection and feedback through the feature handover attention module.
no code implementations • 12 Oct 2022 • Runmin Cong, Weiyu Song, Jianjun Lei, Guanghui Yue, Yao Zhao, Sam Kwong
Finally, we use the Importance Perception Fusion (IPF) module to fuse the features from two parallel branches according to their different importance in different scenarios.
no code implementations • 9 Oct 2022 • Ao-Xiang Zhang, Yuan-Gen Wang, Weixuan Tang, Leida Li, Sam Kwong
Based on the revisited HVS, a no-reference VQA framework called HVS-5M (NRVQA framework with five modules simulating HVS with five characteristics) is proposed.
Ranked #4 on
Video Quality Assessment
on LIVE-FB LSVQ
1 code implementation • 9 Oct 2022 • Runmin Cong, Kepu Zhang, Chen Zhang, Feng Zheng, Yao Zhao, Qingming Huang, Sam Kwong
In addition, considering the role of thermal modality, we set up different cross-modality interaction mechanisms in the encoding phase and the decoding phase.
no code implementations • 13 Sep 2022 • Yu Tian, Zhangkai Ni, Baoliang Chen, Shurun Wang, Shiqi Wang, Hanli Wang, Sam Kwong
In particular, in order to maximum redundancy removal without impairment of robust identity information, we apply the encoder with multiple feature extraction and attention-based feature decomposition modules to progressively decompose face features into two uncorrelated components, i. e., identity and residual features, via self-supervised learning.
1 code implementation • 12 Sep 2022 • Baoliang Chen, Hanwei Zhu, Lingyu Zhu, Shiqi Wang, Sam Kwong
The underlying mechanism of the proposed approach is based upon the wild assumption that the SCIs, which are not physically acquired, still obey certain statistics that could be understood in a learning fashion.
no code implementations • 7 Sep 2022 • Runmin Cong, Yumo Zhang, Ning Yang, Haisheng Li, Xueqi Zhang, Ruochen Li, Zewen Chen, Yao Zhao, Sam Kwong
The coronavirus disease 2019 (COVID-19) continues to have a negative impact on healthcare systems around the world, though the vaccines have been developed and national vaccination coverage rate is steadily increasing.
2 code implementations • 7 Sep 2022 • Runmin Cong, Qi Qin, Chen Zhang, Qiuping Jiang, Shiqi Wang, Yao Zhao, Sam Kwong
In this paper, we focus on a new weakly-supervised SOD task under hybrid labels, where the supervision labels include a large number of coarse labels generated by the traditional unsupervised method and a small number of real labels.
Ranked #8 on
RGB Salient Object Detection
on PASCAL-S
1 code implementation • 6 Sep 2022 • Yue Liu, Zhangkai Ni, Shiqi Wang, Hanli Wang, Sam Kwong
In this paper, a novel and effective image quality assessment (IQA) algorithm based on frequency disparity for high dynamic range (HDR) images is proposed, termed as local-global frequency feature-based model (LGFM).
1 code implementation • 5 Aug 2022 • Xigran Liao, Baoliang Chen, Hanwei Zhu, Shiqi Wang, Mingliang Zhou, Sam Kwong
Existing deep learning-based full-reference IQA (FR-IQA) models usually predict the image quality in a deterministic way by explicitly comparing the features, gauging how severely distorted an image is by how far the corresponding feature lies from the space of the reference images.
3 code implementations • 17 Jul 2022 • Runmin Cong, Haowei Yang, Qiuping Jiang, Wei Gao, Haisheng Li, Cong Wang, Yao Zhao, Sam Kwong
The spread of COVID-19 has brought a huge disaster to the world, and the automatic segmentation of infection regions can help doctors to make diagnosis quickly and reduce workload.
no code implementations • 3 Jul 2022 • Zhangkai Ni, Wenhan Yang, Hanli Wang, Shiqi Wang, Lin Ma, Sam Kwong
Getting rid of the fundamental limitations in fitting to the paired training data, recent unsupervised low-light enhancement methods excel in adjusting illumination and contrast of images.
no code implementations • 7 Jun 2022 • Chao Zeng, Sam Kwong
Considering the inaccurate depth map issue, we collect the RGB features of early stages into a skip convolution module to give more guidance from RGB modality to the final saliency prediction.
no code implementations • 7 May 2022 • Chengdong Lan, Cheng Luo, Hao Yan, Tiesong Zhao, Sam Kwong
The introduction of multiple viewpoints inevitably increases the bitrates to store and transmit video scenes.
no code implementations • 7 May 2022 • Tiesong Zhao, Yuhang Huang, Weize Feng, Yiwen Xu, Sam Kwong
The ever-growing multimedia traffic has underscored the importance of effective multimedia codecs.
no code implementations • 19 Apr 2022 • Runmin Cong, Ning Yang, Chongyi Li, Huazhu Fu, Yao Zhao, Qingming Huang, Sam Kwong
In this paper, we propose a global-and-local collaborative learning architecture, which includes a global correspondence modeling (GCM) and a local correspondence modeling (LCM) to capture comprehensive inter-image corresponding relationship among different images from the global and local perspectives.
no code implementations • 8 Apr 2022 • Linwei Zhu, Yun Zhang, Na Li, Gangyi Jiang, Sam Kwong
To further improve the performance of intra coding in Versatile Video Coding (VVC), an intelligent intra mode derivation method is proposed in this paper, termed as Deep Learning based Intra Mode Derivation (DLIMD).
no code implementations • 10 Mar 2022 • Ran Chen, Hanli Wang, Lei Wang, Sam Kwong
Second, previous approaches only consider learning single-stream similarity alignment (i. e., image-to-text level or text-to-image level), which is inadequate to fully use similarity information for image-text matching.
no code implementations • 20 Feb 2022 • Pingping Zhang, Xu Wang, Linwei Zhu, Yun Zhang, Shiqi Wang, Sam Kwong
In this paper, we propose a distortion-aware loop filtering model to improve the performance of intra coding for 360$^o$ videos projected via equirectangular projection (ERP) format.
no code implementations • 28 Jan 2022 • Yu Tian, Zhangkai Ni, Baoliang Chen, Shiqi Wang, Hanli Wang, Sam Kwong
However, little work has been dedicated to automatic quality assessment of such GAN-generated face images (GFIs), even less have been devoted to generalized and robust quality assessment of GFIs generated with unseen GAN model.
1 code implementation • CVPR 2022 • Weibo Shu, Jia Wan, Kay Chen Tan, Sam Kwong, Antoni B. Chan
By transforming the density map into the frequency domain and using the nice properties of the characteristic function, we propose a novel method that is simple, effective, and efficient.
no code implementations • 31 Dec 2021 • Dongjie Ye, Zhangkai Ni, Hanli Wang, Jian Zhang, Shiqi Wang, Sam Kwong
The proposed approach is an end-to-end compressive image sensing method, composed of adaptive sampling and recovery.
no code implementations • 1 Dec 2021 • Chao Zeng, Sam Kwong
In addition, comparable NR performance is achieved in extensive experiments, and the results show that the NR performance can be leveraged by the joint training scheme.
1 code implementation • 27 Oct 2021 • Runmin Cong, Yumo Zhang, Leyuan Fang, Jun Li, Yao Zhao, Sam Kwong
Salient object detection (SOD) for optical remote sensing images (RSIs) aims at locating and extracting visually distinctive objects/regions from the optical RSIs.
1 code implementation • 4 Aug 2021 • Chen Zhang, Runmin Cong, Qinwei Lin, Lin Ma, Feng Li, Yao Zhao, Sam Kwong
For the cross-modality interaction in feature encoder, existing methods either indiscriminately treat RGB and depth modalities, or only habitually utilize depth cues as auxiliary information of the RGB branch.
no code implementations • 27 Jul 2021 • Qi Tang, Runmin Cong, Ronghui Sheng, Lingzhi He, Dan Zhang, Yao Zhao, Sam Kwong
The other is the content guidance bridge (CGBdg) designed for the depth map reconstruction process, which provides the content guidance learned from DSR task for MDE task.
1 code implementation • 13 Jul 2021 • Chenqi Kong, Baoliang Chen, Haoliang Li, Shiqi Wang, Anderson Rocha, Sam Kwong
The technological advancements of deep learning have enabled sophisticated face manipulation schemes, raising severe trust issues and security concerns in modern society.
no code implementations • 29 Jun 2021 • Chao Zeng, Tiesong Zhao, Sam Kwong
Motivated by the auto-encoder mechanism and contrastive representation learning advances, we propose a learning-based metric for image captioning, which we call Intrinsic Image Captioning Evaluation($I^2CE$).
1 code implementation • 2 Mar 2021 • Yuheng Jia, Hui Liu, Junhui Hou, Sam Kwong, Qingfu Zhang
Inspired by ensemble clustering that aims to seek a better clustering result from a set of clustering results, we propose self-supervised SNMF (S$^3$NMF), which is capable of boosting clustering performance progressively by taking advantage of the sensitivity to initialization characteristic of SNMF, without relying on any additional information.
no code implementations • 11 Feb 2021 • Yingxu Wang, Fakhri Karray, Sam Kwong, Konstantinos N. Plataniotis, Henry Leung, Ming Hou, Edward Tunstel, Imre J. Rudas, Ljiljana Trajkovic, Okyay Kaynak, Janusz Kacprzyk, Mengchu Zhou, Michael H. Smith, Philip Chen, Shushma Patel
Symbiotic Autonomous Systems (SAS) are advanced intelligent and cognitive systems exhibiting autonomous collective intelligence enabled by coherent symbiosis of human-machine interactions in hybrid societies.
no code implementations • 25 Jan 2021 • Baoliang Chen, Wenhan Yang, Haoliang Li, Shiqi Wang, Sam Kwong
The first branch aims to learn the camera invariant spoofing features via feature level decomposition in the high frequency domain.
1 code implementation • 30 Dec 2020 • Zhangkai Ni, Wenhan Yang, Shiqi Wang, Lin Ma, Sam Kwong
In this paper, we present an unsupervised image enhancement generative adversarial network (UEGAN), which learns the corresponding image-to-image mapping from a set of images with desired characteristics in an unsupervised manner, rather than learning on a large number of paired images.
no code implementations • 30 Dec 2020 • Zhangkai Ni, Wenhan Yang, Shiqi Wang, Lin Ma, Sam Kwong
The key novelty of the proposed QAGAN lies in the injected QAM for the generator such that it learns domain-relevant quality attention directly from the two domains.
no code implementations • 14 Dec 2020 • Chao Zeng, Sam Kwong
The image captioning task is about to generate suitable descriptions from images.
no code implementations • 11 Dec 2020 • Hua Li, Yuheng Jia, Runmin Cong, Wenhui Wu, Sam Kwong, Chuanbo Chen
Consequently, we devise a spatial regularization and propose a novel convex locality-constrained subspace clustering model that is able to constrain the spatial adjacent pixels with similar attributes to be clustered into a superpixel and generate the content-aware superpixels with more detailed boundaries.
3 code implementations • 26 Nov 2020 • Qijian Zhang, Runmin Cong, Chongyi Li, Ming-Ming Cheng, Yuming Fang, Xiaochun Cao, Yao Zhao, Sam Kwong
Despite the remarkable advances in visual saliency analysis for natural scene images (NSIs), salient object detection (SOD) for optical remote sensing images (RSIs) still remains an open and challenging problem.
1 code implementation • 25 Nov 2020 • Yue Qian, Junhui Hou, Sam Kwong, Ying He
In addition, we propose a simple yet effective training strategy to drive such a flexible ability.
no code implementations • 13 Oct 2020 • Xi Lin, Zhiyuan Yang, Qingfu Zhang, Sam Kwong
With a fixed model capacity, the tasks would be conflicted with each other, and the system usually has to make a trade-off among learning all of them together.
1 code implementation • 12 Oct 2020 • Jialu Huang, Jing Liao, Sam Kwong
We proposed a new I2I translation method that generates a new model in the target domain via a series of model transformations on a pre-trained StyleGAN2 model in the source domain.
no code implementations • 26 Sep 2020 • Jing Jin, Junhui Hou, Zhiyu Zhu, Jie Chen, Sam Kwong
To preserve the parallax structure among the reconstructed SAIs, we subsequently append a consistency regularization network trained over a structure-aware loss function to refine the parallax relationships over the coarse estimation.
no code implementations • 13 Aug 2020 • Rongqun Lin, Linwei Zhu, Shiqi Wang, Sam Kwong
Compactly representing the visual signals is of fundamental importance in various image/video-centered applications.
no code implementations • 6 Aug 2020 • Xinju Wu, Yun Zhang, Chunling Fan, Junhui Hou, Sam Kwong
The impact of distorted geometry and texture attributes is further discussed in this paper.
1 code implementation • 29 Jun 2020 • Wing WY Ng, Shichao Xu, Jianjun Zhang, Xing Tian, Tongwen Rong, Sam Kwong
Samples in the majority class are divided into many subspaces by a hashing method.
no code implementations • 18 Jun 2020 • Jialu Huang, Jing Liao, Zhifeng Tan, Sam Kwong
Sketch-to-image (S2I) translation plays an important role in image synthesis and manipulation tasks, such as photo editing and colorization.
1 code implementation • 1 May 2020 • Yue Qian, Junhui Hou, Qijian Zhang, Yiming Zeng, Sam Kwong, Ying He
This paper explores the problem of task-oriented downsampling over 3D point clouds, which aims to downsample a point cloud while maintaining the performance of subsequent applications applied to the downsampled sparse points as much as possible.
no code implementations • 30 Apr 2020 • Yuheng Jia, Hui Liu, Junhui Hou, Sam Kwong, Qingfu Zhang
On the basis of the novel tensor low-rank norm, we formulate MVSC as a convex low-rank tensor recovery problem, which is then efficiently solved with an augmented Lagrange multiplier based method iteratively.
1 code implementation • CVPR 2020 • Jing Jin, Junhui Hou, Jie Chen, Sam Kwong
Light field (LF) images acquired by hand-held devices usually suffer from low spatial resolution as the limited sampling resources have to be shared with the angular dimension.
1 code implementation • 26 Feb 2020 • Jing Jin, Junhui Hou, Hui Yuan, Sam Kwong
In addition, our method preserves the light field parallax structure better.
1 code implementation • ECCV 2020 • Yue Qian, Junhui Hou, Sam Kwong, Ying He
Matrix $\mathbf T$ approximates the augmented Jacobian matrix of a local parameterization and builds a one-to-one correspondence between the 2D parametric domain and the 3D tangent plane so that we can lift the adaptively distributed 2D samples (which are also learned from data) to 3D space.
9 code implementations • CVPR 2020 • Chunle Guo, Chongyi Li, Jichang Guo, Chen Change Loy, Junhui Hou, Sam Kwong, Runmin Cong
The paper presents a novel method, Zero-Reference Deep Curve Estimation (Zero-DCE), which formulates light enhancement as a task of image-specific curve estimation with a deep network.
Ranked #1 on
Low-Light Image Enhancement
on NPE
(User Study Score metric)
1 code implementation • NeurIPS 2019 • Xi Lin, Hui-Ling Zhen, Zhenhua Li, Qingfu Zhang, Sam Kwong
Recently, a novel method is proposed to find one single Pareto optimal solution with good trade-off among different tasks by casting multi-task learning as multiobjective optimization.
no code implementations • 27 Dec 2019 • Hui Yuan, Huayong Fu, Ju Liu, Junhui Hou, Sam Kwong
The proposed algorithm is proxy-free.
no code implementations • 26 Dec 2019 • Hui Yuan, Xiaoqian Hu, Junhui Hou, Xuekai Wei, Sam Kwong
Specifically, the proposed framework is composed of two modules, i. e., the method pool and method controller.
no code implementations • 23 Dec 2019 • Zhaoqing Pan, Feng Yuan, Jianjun Lei, Sam Kwong
Under the limited storage, computing and network bandwidth resources, the video compression coding technology plays an important role for visual communication.
no code implementations • 20 Dec 2019 • Hui Yuan, Shiyun Zhao, Junhui Hou, Xuekai Wei, Sam Kwong
That is, our method preserves both the quality and the smoothness of tiles in FoV, thus providing the best QoE for users.
1 code implementation • 24 Nov 2019 • Fu-Zhao Ou, Yuan-Gen Wang, Jin Li, Guopu Zhu, Sam Kwong
First, to extend the authentically distorted image dataset, we present an imaging-heuristic approach, in which the over-underexposure is formulated as an inverse of Weber-Fechner law, and fusion strategy and probabilistic compression are adopted, to generate the degraded real-world images.
1 code implementation • 31 Aug 2019 • Jing Jin, Junhui Hou, Jie Chen, Huanqiang Zeng, Sam Kwong, Jingyi Yu
Specifically, the coarse sub-aperture image (SAI) synthesis module first explores the scene geometry from an unstructured sparsely-sampled LF and leverages it to independently synthesize novel SAIs, in which a confidence-based blending strategy is proposed to fuse the information from different input SAIs, giving an intermediate densely-sampled LF.
no code implementations • 6 Aug 2019 • Ran Wang, Suhe Ye, Ke Li, Sam Kwong
Classifier chain (CC) is a multi-label learning approach that constructs a sequence of binary classifiers according to a label order.
1 code implementation • 23 Jul 2019 • Jing Jin, Junhui Hou, Jie Chen, Sam Kwong, Jingyi Yu
To the best of our knowledge, this is the first end-to-end deep learning method for reconstructing a high-resolution LF image with a hybrid input.
no code implementations • 20 Jun 2019 • Chongyi Li, Runmin Cong, Junhui Hou, Sanyi Zhang, Yue Qian, Sam Kwong
Arising from the various object types and scales, diverse imaging orientations, and cluttered backgrounds in optical remote sensing image (RSI), it is difficult to directly extend the success of salient object detection for nature scene image to the optical RSI.
no code implementations • 4 May 2019 • Yuheng Jia, Hui Liu, Junhui Hou, Sam Kwong
Graph-based clustering methods have demonstrated the effectiveness in various applications.
1 code implementation • 11 Jan 2019 • Chongyi Li, Chunle Guo, Wenqi Ren, Runmin Cong, Junhui Hou, Sam Kwong, DaCheng Tao
In this paper, we construct an Underwater Image Enhancement Benchmark (UIEB) including 950 real-world underwater images, 890 of which have the corresponding reference images.
Ranked #5 on
Underwater Image Restoration
on LSUI
(using extra training data)
no code implementations • 4 Nov 2018 • Hui-Ling Zhen, Xi Lin, Alan Z. Tang, Zhenhua Li, Qingfu Zhang, Sam Kwong
Different from them, in this paper, we aim to link the generalization ability of a deep network to optimizing a new objective function.
no code implementations • 4 Nov 2018 • Xi Lin, Hui-Ling Zhen, Zhenhua Li, Qingfu Zhang, Sam Kwong
The proposed algorithm uses the Bayesian neural network as the scalable surrogate model.
no code implementations • 7 Apr 2017 • Mengyuan Wu, Ke Li, Sam Kwong, Qingfu Zhang
It decomposes a multi-objective optimization problem into several single-objective optimization subproblems, each of which is usually defined as a scalarizing function using a weight vector.
no code implementations • 30 Aug 2016 • Mengyuan Wu, Ke Li, Sam Kwong, Yu Zhou, Qingfu Zhang
In particular, the stable matching between subproblems and solutions, which achieves an equilibrium between their mutual preferences, implicitly strikes a balance between the convergence and diversity.