Search Results for author:
Found 38 papers, 23 papers with code
STAMP: Scalable Task And Model-agnostic Collaborative Perception
Perception is crucial for autonomous driving, but single-agent perception is often constrained by sensors' physical limitations, leading to degraded performance under severe occlusion, adverse weather conditions, and when detecting distant objects.
HFMF: Hierarchical Fusion Meets Multi-Stream Models for Deepfake Detection
The first component of our approach integrates vision Transformers and convolutional nets through a hierarchical feature fusion mechanism.
AutoTrust: Benchmarking Trustworthiness in Large Vision Language Models for Autonomous Driving
Our findings call for immediate and decisive action to address the trustworthiness of DriveVLMs -- an issue of critical importance to public safety and the welfare of all citizens relying on autonomous transportation systems.
OpenEMMA: Open-Source Multimodal Model for End-to-End Autonomous Driving
Furthermore, OpenEMMA demonstrates effectiveness, generalizability, and robustness across a variety of challenging driving scenarios, offering a more efficient and effective approach to autonomous driving.
Political-LLM: Large Language Models in Political Science
In recent years, large language models (LLMs) have been widely adopted in political science tasks such as election prediction, sentiment analysis, policy impact assessment, and misinformation detection.
SleeperMark: Towards Robust Watermark against Fine-Tuning Text-to-image Diffusion Models
Recent advances in large-scale text-to-image (T2I) diffusion models have enabled a variety of downstream applications, including style customization, subject-driven personalization, and conditional generation.
Video Quality Assessment: A Comprehensive Survey
Numerous deep learning-based VQA models have been developed, with progress in this direction driven by the creation of content-diverse, large-scale human-labeled databases that supply ground truth psychometric video quality data.
MWFormer: Multi-Weather Image Restoration Using Degradation-Aware Transformers
Moreover, MWFormer allows for a novel way of tuning, during application, to either a single type of weather restoration or to hybrid weather restoration without any retraining, offering greater controllability than existing methods.
Edit Away and My Face Will not Stay: Personal Biometric Defense against Malicious Generative Editing
Recent advancements in diffusion models have made generative image editing more accessible, enabling creative edits but raising ethical concerns, particularly regarding malicious edits to human portraits that threaten privacy and identity security.
DPU: Dynamic Prototype Updating for Multimodal Out-of-Distribution Detection
Extensive experiments on two tasks, five datasets, and nine base OOD algorithms demonstrate that DPU significantly improves OOD detection performance, setting a new state-of-the-art in multimodal OOD detection, with improvements of up to 80 percent in Far-OOD detection.
Unraveling Cross-Modality Knowledge Conflicts in Large Vision-Language Models
Specifically, using LLaVA-34B, our proposed dynamic contrastive decoding improves an average accuracy of 2. 24%.
CoMamba: Real-time Cooperative Perception Unlocked with State Space Models
Cooperative perception systems play a vital role in enhancing the safety and efficiency of vehicular autonomy.
AIM 2024 Challenge on Compressed Video Quality Assessment: Methods and Results
The challenge aimed to evaluate the performance of VQA methods on a diverse dataset of 459 videos, encoded with 14 codecs of various compression standards (AVC/H. 264, HEVC/H. 265, AV1, and VVC/H. 266) and containing a comprehensive collection of compression artifacts.
4K4DGen: Panoramic 4D Generation at 4K Resolution
Subsequently, we propose \textbf{Dynamic Panoramic Lifting} to elevate the panoramic video into a 4D immersive environment while preserving spatial and temporal consistency.
AIS 2024 Challenge on Video Quality Assessment of User-Generated Content: Methods and Results
The performance of the top-5 submissions is reviewed and provided here as a survey of diverse deep models for efficient video quality assessment of user-generated content.
Light the Night: A Multi-Condition Diffusion Framework for Unpaired Low-Light Enhancement in Autonomous Driving
Vision-centric perception systems for autonomous driving have gained considerable attention recently due to their cost-effectiveness and scalability, especially compared to LiDAR-based systems.
Bigger is not Always Better: Scaling Properties of Latent Diffusion Models
We study the scaling properties of latent diffusion models (LDMs) with an emphasis on their sampling efficiency.
V2X-DGW: Domain Generalization for Multi-agent Perception under Adverse Weather Conditions
In this paper, we propose a Domain Generalization based approach, named V2X-DGW, for LiDAR-based 3D object detection on multi-agent perception system under adverse weather conditions.
SPIRE: Semantic Prompt-Driven Image Restoration
In this paper, we develop SPIRE, a Semantic and restoration Prompt-driven Image Restoration framework that leverages natural language as a user-friendly interface to control the image restoration process.
CoDi: Conditional Diffusion Distillation for Higher-Fidelity and Faster Image Generation
Our conditional-task learning and distillation approach outperforms previous distillation methods, achieving a new state-of-the-art in producing high-quality images with very few steps (e. g., 1-4) across multiple tasks, including super-resolution, text-guided image editing, and depth-to-image generation.
MULLER: Multilayer Laplacian Resizer for Vision
Specifically, we select a state-of-the-art vision Transformer, MaxViT, as the baseline, and show that, if trained with MULLER, MaxViT gains up to 0. 6% top-1 accuracy, and meanwhile enjoys 36% inference cost saving to achieve similar top-1 accuracy on ImageNet-1k, as compared to the standard training scheme.
V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perception
To facilitate the development of cooperative perception, we present V2V4Real, the first large-scale real-world multi-modal dataset for V2V perception.
CoBEVT: Cooperative Bird's Eye View Semantic Segmentation with Sparse Transformers
The extensive experiments on the V2V perception dataset, OPV2V, demonstrate that CoBEVT achieves state-of-the-art performance for cooperative BEV semantic segmentation.
Pik-Fix: Restoring and Colorizing Old Photos
Our proposed framework consists of three modules: a restoration sub-network that conducts restoration from degradations, a similarity network that performs color histogram matching and color transfer, and a colorization subnet that learns to predict the chroma elements of images conditioned on chromatic reference signals.
MaxViT: Multi-Axis Vision Transformer
We also show that our proposed model expresses strong generative modeling capability on ImageNet, demonstrating the superior potential of MaxViT blocks as a universal vision module.
Ranked #2 on
Object Detection
on COCO 2017
Perceptual Quality Assessment of UGC Gaming Videos
In recent years, with the vigorous development of the video game industry, the proportion of gaming videos on major video websites like YouTube has dramatically increased.
V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer
In this paper, we investigate the application of Vehicle-to-Everything (V2X) communication to improve the perception performance of autonomous vehicles.
Ranked #1 on
3D Object Detection
on V2XSet
ROMNet: Renovate the Old Memories
Renovating the memories in old photos is an intriguing research topic in computer vision fields.
MAXIM: Multi-Axis MLP for Image Processing
In this work, we present a multi-axis MLP based architecture called MAXIM, that can serve as an efficient and flexible general-purpose vision backbone for image processing tasks.
Ranked #1 on
Deblurring
on HIDE (trained on GOPRO)
FAVER: Blind Quality Prediction of Variable Frame Rate Videos
Video quality assessment (VQA) remains an important and challenging problem that affects many applications at the widest scales.
Predicting Eye Fixations Under Distortion Using Bayesian Observers
Visual attention is very an essential factor that affects how human perceives visual signals.
Regression or Classification? New Methods to Evaluate No-Reference Picture and Video Quality Models
Video and image quality assessment has long been projected as a regression problem, which requires predicting a continuous quality score given an input stimulus.
RAPIQUE: Rapid and Accurate Video Quality Prediction of User Generated Content
However, these models are either incapable or inefficient for predicting the quality of complex and diverse UGC videos in practical applications.
Ranked #4 on
Video Quality Assessment
on LIVE Livestream
Adaptive Debanding Filter
Banding artifacts, which manifest as staircase-like color bands on pictures or video frames, is a common distortion caused by compression of low-textured smooth regions.
UGC-VQA: Benchmarking Blind Video Quality Assessment for User Generated Content
Recent years have witnessed an explosion of user-generated content (UGC) videos shared and streamed over the Internet, thanks to the evolution of affordable and reliable consumer capture devices, and the tremendous popularity of social media platforms.
Ranked #13 on
Video Quality Assessment
on LIVE-FB LSVQ
BBAND Index: A No-Reference Banding Artifact Predictor
Banding artifact, or false contouring, is a common video compression impairment that tends to appear on large flat regions in encoded videos.
A Comparative Evaluation of Temporal Pooling Methods for Blind Video Quality Assessment
Many objective video quality assessment (VQA) algorithms include a key step of temporal pooling of frame-level quality scores.
Fitness Done Right: a Real-time Intelligent Personal Trainer for Exercise Correction
Finally, key values for key features of the two poses are computed correspondingly in the pose error detection part, which helps give correction advice.
