Search Results for author:
Found 27 papers, 10 papers with code
Multi-Dimensional Quality Assessment for Text-to-3D Assets: Dataset and Model
This database encompasses 969 validated 3D assets generated from 170 prompts via 6 popular text-to-3D asset generation models, and corresponding subjective quality ratings for these assets from the perspectives of quality, authenticity, and text-asset correspondence, respectively.
Facial Attractiveness Prediction in Live Streaming: A New Benchmark and Multi-modal Method
Furthermore, a multi-modal FAP method is proposed to measure the facial attractiveness in live streaming.
HarmonyIQA: Pioneering Benchmark and Model for Image Harmonization Quality Assessment
To address the issue and facilitate the advancement of IHAs, we introduce the first Image Quality Assessment Database for image Harmony evaluation (HarmonyIQAD), which consists of 1, 350 harmonized images generated by 9 different IHAs, and the corresponding human visual preference scores.
ESVQA: Perceptual Quality Assessment of Egocentric Spatial Videos
With the rapid development of eXtended Reality (XR), egocentric spatial shooting and display technologies have further enhanced immersion and engagement for users.
FineVQ: Fine-Grained User Generated Content Video Quality Assessment
The rapid growth of user-generated content (UGC) videos has produced an urgent need for effective video quality assessment (VQA) algorithms to monitor video quality and guide optimization and recommendation procedures.
F-Bench: Rethinking Human Preference Evaluation Metrics for Benchmarking Face Generation, Customization, and Restoration
The FaceQ database comprises 12, 255 images generated by 29 models across three tasks: (1) face generation, (2) face customization, and (3) face restoration.
AIGV-Assessor: Benchmarking and Evaluating the Perceptual Quality of Text-to-Video Generation with LMM
The rapid advancement of large multimodal models (LMMs) has led to the rapid expansion of artificial intelligence generated videos (AIGVs), which highlights the pressing need for effective video quality assessment (VQA) models designed specifically for AIGVs.
MMHead: Towards Fine-grained Multi-modal 3D Facial Animation
To fill this gap, we first construct a large-scale multi-modal 3D facial animation dataset, MMHead, which consists of 49 hours of 3D facial motion sequences, speech audios, and rich hierarchical text annotations.
AIM 2024 Challenge on Video Saliency Prediction: Methods and Results
The goal of the participants was to develop a method for predicting accurate saliency maps for the provided set of video sequences.
How Does Audio Influence Visual Attention in Omnidirectional Videos? Database and Model
To advance the research on audio-visual saliency prediction for ODVs, we further establish a new benchmark based on the AVS-ODV database by testing numerous state-of-the-art saliency models, including visual-only models and audio-visual models.
ESIQA: Perceptual Quality Assessment of Vision-Pro-based Egocentric Spatial Images
In this paper, we establish the Egocentric Spatial Images Quality Assessment Database (ESIQAD), the first IQA database dedicated for egocentric spatial images as far as we know.
UniProcessor: A Text-induced Unified Low-level Image Processor
In this paper, we propose a text-induced unified image processor for low-level vision tasks, termed UniProcessor, which can effectively process various degradation types and levels, and support multimodal control.
Quality-guided Skin Tone Enhancement for Portrait Photography
In this paper, we propose a quality-guided image enhancement paradigm that enables image enhancement models to learn the distribution of images with various quality ratings.
MVBIND: Self-Supervised Music Recommendation For Videos Via Embedding Space Binding
However, at present, the background music of short videos is generally chosen by the video producer, and there is a lack of automatic music recommendation methods for short videos.
Quality Assessment for AI Generated Images with Instruction Tuning
Artificial Intelligence Generated Content (AIGC) has grown rapidly in recent years, among which AI-based image generation has gained widespread attention due to its efficient and imaginative image creation ability.
How is Visual Attention Influenced by Text Guidance? Database and Model
Finally, considering the effect of text descriptions on visual attention, while most existing saliency models ignore this impact, we further propose a text-guided saliency (TGSal) prediction model, which extracts and integrates both image features and text features to predict the image saliency under various text-description conditions.
AIGCOIQA2024: Perceptual Quality Assessment of AI Generated Omnidirectional Images
Finally, we conduct a benchmark experiment to evaluate the performance of state-of-the-art IQA models on our database.
Perceptual Video Quality Assessment: A Survey
Perceptual video quality assessment plays a vital role in the field of video processing due to the existence of quality degradations introduced in various stages of video signal acquisition, compression, transmission and display.
Audio-visual Saliency for Omnidirectional Videos
Visual saliency prediction for omnidirectional videos (ODVs) has shown great significance and necessity for omnidirectional videos to help ODV coding, ODV transmission, ODV rendering, etc..
Perceptual Quality Assessment of Omnidirectional Audio-visual Signals
Omnidirectional videos (ODVs) play an increasingly important role in the application fields of medical, education, advertising, tourism, etc.
AIGCIQA2023: A Large-scale Image Quality Assessment Database for AI Generated Images: from the Perspectives of Quality, Authenticity and Correspondence
In this paper, in order to get a better understanding of the human visual preferences for AIGIs, a large-scale IQA database for AIGC is established, which is named as AIGCIQA2023.
Masked Autoencoders as Image Processors
Recently, masked autoencoders (MAE) for feature pre-training have further unleashed the potential of Transformers, leading to state-of-the-art performances on various high-level vision tasks.
Ranked #4 on
Image Defocus Deblurring
on DPD (Dual-view)
Perceptual Quality Assessment of Omnidirectional Images
The original and distorted omnidirectional images, subjective quality ratings, and the head and eye movement data together constitute the OIQA database.
Saliency in Augmented Reality
Therefore, in this paper, we mainly analyze the interaction effect between background (BG) scenes and AR contents, and study the saliency prediction problem in AR.
Confusing Image Quality Assessment: Towards Better Augmented Reality Experience
An objective metric termed CFIQA is also proposed to better evaluate the confusing image quality.
Iwin: Human-Object Interaction Detection via Transformer with Irregular Windows
Iwin Transformer is a hierarchical Transformer which progressively performs token representation learning and token agglomeration within irregular windows.
End-to-End Human-Gaze-Target Detection with Transformers
In contrast, we redefine the HGT detection task as detecting human head locations and their gaze targets, simultaneously.
