Search Results for author:
Found 34 papers, 25 papers with code
Towards Robust Online Domain Adaptive Semantic Segmentation under Adverse Weather Conditions
Online Domain Adaptation (OnDA) is designed to handle unforeseeable domain changes at minimal cost that occur during the deployment of the model, lacking clear boundaries between the domain, such as sudden weather events.
Q-Ground: Image Quality Grounding with Large Multi-modality Models
Recent advances of large multi-modality models (LMM) have greatly improved the ability of image quality assessment (IQA) method to evaluate and explain the quality of visual content.
Towards Open-ended Visual Quality Comparison
Comparative settings (e. g. pairwise choice, listwise ranking) have been adopted by a wide range of subjective studies for image quality assessment (IQA), as it inherently standardizes the evaluation criteria across different observers and offer more clear-cut responses.
Boosting Image Quality Assessment through Efficient Transformer Adaptation with Local Feature Enhancement
Further we propose a local distortion extractor to obtain local distortion features from the pretrained CNNs and a local distortion injector to inject the local distortion features into ViT.
Q-Align: Teaching LMMs for Visual Scoring via Discrete Text-Defined Levels
The explosion of visual content available online underscores the requirement for an accurate machine assessor to robustly evaluate scores across diverse types of visual contents.
Ranked #1 on
Video Quality Assessment
on LIVE-FB LSVQ
Iterative Token Evaluation and Refinement for Real-World Super-Resolution
Distortion removal involves simple HQ token prediction with LQ images, while texture generation uses a discrete diffusion model to iteratively refine the distortion removal output with a token refinement network.
Enhancing Diffusion Models with Text-Encoder Reinforcement Learning
While fine-tuning the U-Net can partially improve performance, it remains suffering from the suboptimal text encoder.
Q-Instruct: Improving Low-level Visual Abilities for Multi-modality Foundation Models
Multi-modality foundation models, as represented by GPT-4V, have brought a new paradigm for low-level visual perception and understanding tasks, that can respond to a broad range of natural human instructions in a model.
Bilateral Network with Residual U-blocks and Dual-Guided Attention for Real-time Semantic Segmentation
To be precise, we use the Dual-Guided Attention (DGA) module we proposed to replace some multi-scale transformations with the calculation of attention which means we only use several attention layers of near linear complexity to achieve performance comparable to frequently-used multi-layer fusion.
Q-Bench: A Benchmark for General-Purpose Foundation Models on Low-level Vision
To address this gap, we present Q-Bench, a holistic benchmark crafted to systematically evaluate potential abilities of MLLMs on three realms: low-level visual perception, low-level visual description, and overall visual quality assessment.
Local Distortion Aware Efficient Transformer Adaptation for Image Quality Assessment
Further, we propose a local distortion extractor to obtain local distortion features from the pretrained CNN and a local distortion injector to inject the local distortion features into ViT.
TOPIQ: A Top-down Approach from Semantics to Distortions for Image Quality Assessment
Our approach to IQA involves the design of a heuristic coarse-to-fine network (CFANet) that leverages multi-scale features and progressively propagates multi-level semantic information to low-level representations in a top-down manner.
Ranked #11 on
Video Quality Assessment
on MSU SR-QA Dataset
Color Image Recovery Using Generalized Matrix Completion over Higher-Order Finite Dimensional Algebra
To improve the accuracy of color image completion with missing entries, we present a recovery method based on generalized higher-order scalars.
TransRef: Multi-Scale Reference Embedding Transformer for Reference-Guided Image Inpainting
For precise utilization of the reference features for guidance, a reference-patch alignment (Ref-PA) module is proposed to align the patch features of the reference and corrupted images and harmonize their style differences, while a reference-patch transformer (Ref-PT) module is proposed to refine the embedded reference feature.
Towards Explainable In-the-Wild Video Quality Assessment: A Database and a Language-Prompted Approach
Though subjective studies have collected overall quality scores for these videos, how the abstract quality scores relate with specific factors is still obscure, hindering VQA methods from more concrete quality evaluations (e. g. sharpness of a video).
GCFAgg: Global and Cross-view Feature Aggregation for Multi-view Clustering
However, most existing deep clustering methods learn consensus representation or view-specific representations from multiple views via view-wise aggregation way, where they ignore structure relationship of all samples.
Towards Robust Text-Prompted Semantic Criterion for In-the-Wild Video Quality Assessment
The proliferation of videos collected during in-the-wild natural settings has pushed the development of effective Video Quality Assessment (VQA) methodologies.
Exploring Opinion-unaware Video Quality Assessment with Semantic Affinity Criterion
Recent learning-based video quality assessment (VQA) algorithms are expensive to implement due to the cost of data collection of human quality opinions, and are less robust across various scenarios due to the biases of these opinions.
Exploring Video Quality Assessment on User Generated Contents from Aesthetic and Technical Perspectives
In light of this, we propose the Disentangled Objective Video Quality Evaluator (DOVER) to learn the quality of UGC videos based on the two perspectives.
Ranked #1 on
Video Quality Assessment
on YouTube-UGC
Neighbourhood Representative Sampling for Efficient End-to-end Video Quality Assessment
On the other hand, existing practices, such as resizing and cropping, will change the quality of original videos due to the loss of details and contents, and are therefore harmful to quality assessment.
Ranked #2 on
Video Quality Assessment
on KoNViD-1k
(using extra training data)
Reference-Guided Texture and Structure Inference for Image Inpainting
Existing learning-based image inpainting methods are still in challenge when facing complex semantic environments and diverse hole patterns.
Exploring the Effectiveness of Video Perceptual Representation in Blind Video Quality Assessment
Experiments show that the perceptual representation in the HVS is an effective way of predicting subjective temporal quality, and thus TPQI can, for the first time, achieve comparable performance to the spatial quality metric and be even more effective in assessing videos with large temporal variations.
FAST-VQA: Efficient End-to-end Video Quality Assessment with Fragment Sampling
Consisting of fragments and FANet, the proposed FrAgment Sample Transformer for VQA (FAST-VQA) enables efficient end-to-end deep VQA and learns effective video-quality-related representations.
Ranked #4 on
Video Quality Assessment
on LIVE-VQC
(using extra training data)
DisCoVQA: Temporal Distortion-Content Transformers for Video Quality Assessment
Based on prominent time-series modeling ability of transformers, we propose a novel and effective transformer-based VQA method to tackle these two issues.
Ranked #6 on
Video Quality Assessment
on KoNViD-1k
Unsupervised Foggy Scene Understanding via Self Spatial-Temporal Label Diffusion
Specifically, based on the two discoveries of local spatial similarity and adjacent temporal correspondence of the sequential image data, we propose a novel Target-Domain driven pseudo label Diffusion (TDo-Dif) scheme.
Spatial-Temporal Space Hand-in-Hand: Spatial-Temporal Video Super-Resolution via Cycle-Projected Mutual Learning
Specifically, we propose to exploit the mutual information among them via iterative up-and-down projections, where the spatial and temporal features are fully fused and distilled, helping the high-quality video reconstruction.
Approximation of Images via Generalized Higher Order Singular Value Decomposition over Finite-dimensional Commutative Semisimple Algebra
Higher order singular value decomposition (HOSVD) extends the SVD and can approximate higher order data using sums of a few rank-one components.
Generalized Image Reconstruction over T-Algebra
We also show in our experiments that the performance of TPCA increases when the order of compounded pixels increases.
Image Inpainting Guided by Coherence Priors of Semantics and Textures
In this paper, we introduce coherence priors between the semantics and textures which make it possible to concentrate on completing separate textures in a semantic-wise manner.
General Data Analytics with Applications to Visual Information Analysis: A Provable Backward-Compatible Semisimple Paradigm over T-Algebra
We consider a novel backward-compatible paradigm of general data analytics over a recently-reported semisimple algebra (called t-algebra).
Guidance and Evaluation: Semantic-Aware Image Inpainting for Mixed Scenes
Completing a corrupted image with correct structures and reasonable textures for a mixed scene remains an elusive challenge.
Intrinsic Dimension Estimation via Nearest Constrained Subspace Classifier
We consider the problems of classification and intrinsic dimension estimation on image data.
Generalized Visual Information Analysis via Tensorial Algebra
Higher order data is modeled using matrices whose entries are numerical arrays of a fixed size.
