Search Results for author:
Found 68 papers, 45 papers with code
Enhancing Self-Attention with Knowledge-Assisted Attention Maps
Large-scale pre-trained language models have attracted extensive attentions in the research community and shown promising results on various tasks of natural language processing.
Generative Classifier for Domain Generalization
To address these issues, we explore the theoretical implications of relying on domain invariance, revealing the crucial role of domain-specific information in mitigating the target risk for DG.
Training-free Diffusion Acceleration with Bottleneck Sampling
Bottleneck Sampling follows a high-low-high denoising workflow: it performs high-resolution denoising in the initial and final stages while operating at lower resolutions in intermediate steps.
Decouple and Track: Benchmarking and Improving Video Diffusion Transformers for Motion Transfer
In contrast, state-of-the-art video Diffusion Transformers (DiT) models use 3D full attention, which does not explicitly separate temporal and spatial information.
Diffusion-Sharpening: Fine-tuning Diffusion Models with Denoising Trajectory Sharpening
We propose Diffusion-Sharpening, a fine-tuning approach that enhances downstream alignment by optimizing sampling trajectories.
Are They the Same? Exploring Visual Correspondence Shortcomings of Multimodal LLMs
Recent advancements in multimodal models have shown a strong ability in visual perception, reasoning abilities, and vision-language understanding.
Sa2VA: Marrying SAM2 with LLaVA for Dense Grounded Understanding of Images and Videos
This work presents Sa2VA, the first unified model for dense grounded understanding of both images and videos.
Ranked #1 on
Referring Video Object Segmentation
on MeViS
Training-free Heterogeneous Graph Condensation via Data Selection
The second is low efficiency, HGCond follows the existing GC methods designed for homogeneous graphs and leverages the sophisticated optimization paradigm, resulting in a time-consuming condensing procedure.
Towards Scalable and Deep Graph Neural Networks via Noise Masking
Unlike the previous model-simplification works, we focus on continuous P and found that the noise existing inside each P is the cause of the over-smoothing issue, and use the efficient masking mechanism to eliminate them.
DiffSensei: Bridging Multi-Modal LLMs and Diffusion Models for Customized Manga Generation
Story visualization, the task of creating visual narratives from textual descriptions, has seen progress with text-to-image generation models.
RelationBooth: Towards Relation-Aware Customized Object Generation
Instead, this work addresses that gap by focusing on relation-aware customized image generation, which aims to preserve the identities from image prompts while maintaining the predicate relations described in text prompts.
MTL-LoRA: Low-Rank Adaptation for Multi-Task Learning
Parameter-efficient fine-tuning (PEFT) has been widely employed for domain adaptation, with LoRA being one of the most prominent methods due to its simplicity and effectiveness.
Direct Preference Optimization for LLM-Enhanced Recommendation Systems
Large Language Models (LLMs) have exhibited remarkable performance across a wide range of domains, motivating research into their potential for recommendation systems.
You Can't Ignore Either: Unifying Structure and Feature Denoising for Robust Graph Learning
However, the noises and attacks may come from both structures and features in graphs, making the graph denoising a dilemma and challenging problem.
LLAVADI: What Matters For Multimodal Large Language Models Distillation
The recent surge in Multimodal Large Language Models (MLLMs) has showcased their remarkable potential for achieving generalized intelligence by integrating visual understanding into Large Language Models. Nevertheless, the sheer model size of MLLMs leads to substantial memory and computational demands that hinder their widespread deployment.
MotionBooth: Motion-Aware Customized Text-to-Video Generation
In this work, we present MotionBooth, an innovative framework designed for animating customized subjects with precise control over both object and camera movements.
SEFraud: Graph-based Self-Explainable Fraud Detection via Interpretative Mask Learning
While considerable efforts have been devoted to designing adequate fraud detectors, the interpretability of their results has often been overlooked.
SemFlow: Binding Semantic Segmentation and Image Synthesis via Rectified Flow
For image synthesis, we propose a finite perturbation approach to enhance the diversity of generated results without changing the semantic categories.
VG4D: Vision-Language Model Goes 4D Video Recognition
By transferring the knowledge of the VLM to the 4D encoder and combining the VLM, our VG4D achieves improved recognition performance.
Explore In-Context Segmentation via Latent Diffusion Models
In-context segmentation has drawn more attention with the introduction of vision foundation models.
Towards Language-Driven Video Inpainting via Multimodal Large Language Models
We introduce a new task -- language-driven video inpainting, which uses natural language instructions to guide the inpainting process.
DST-Det: Simple Dynamic Self-Training for Open-Vocabulary Object Detection
We refer to this approach as the self-training strategy, which enhances recall and accuracy for novel classes without requiring extra annotations, datasets, and re-training.
Mitigating Semantic Confusion from Hostile Neighborhood for Graph Active Learning
Graph Active Learning (GAL), which aims to find the most informative nodes in graphs for annotation to maximize the Graph Neural Networks (GNNs) performance, has attracted many research efforts but remains non-trivial challenges.
Towards Open Vocabulary Learning: A Survey
To our knowledge, this is the first comprehensive literature review of open vocabulary learning.
PanopticPartFormer++: A Unified and Decoupled View for Panoptic Part Segmentation
Third, inspired by Mask2Former, based on our meta-architecture, we propose Panoptic-PartFormer++ and design a new part-whole cross-attention scheme to boost part segmentation qualities further.
Betrayed by Captions: Joint Caption Grounding and Generation for Open Vocabulary Instance Segmentation
Experiments on the COCO dataset with two settings: Open Vocabulary Instance Segmentation (OVIS) and Open Set Panoptic Segmentation (OSPS) demonstrate the superiority of the CGG.
Label-Efficient Interactive Time-Series Anomaly Detection
Time-series anomaly detection is an important task and has been widely applied in the industry.
Convolution-enhanced Evolving Attention Networks
To the best of our knowledge, this is the first work that explicitly models the layer-wise evolution of attention maps.
Towards Robust Referring Image Segmentation
It considers the negative sentence inputs besides the regular positive text inputs.
SFNet: Faster, Accurate, and Domain Agnostic Semantic Segmentation via Semantic Flow
In this paper, we focus on exploring effective methods for faster, accurate, and domain agnostic semantic segmentation.
Ranked #12 on
Semantic Segmentation
on BDD100K val
Panoptic-PartFormer: Learning a Unified Model for Panoptic Part Segmentation
To the best of our knowledge, we are the first to solve the PPS problem via \textit{a unified and end-to-end transformer model.
Fashionformer: A simple, Effective and Unified Baseline for Human Fashion Segmentation and Recognition
This focus on joint human fashion segmentation and attribute recognition.
Video K-Net: A Simple, Strong, and Unified Baseline for Video Segmentation
We hope this simple, yet effective method can serve as a new, flexible baseline in unified video segmentation design.
Ranked #1 on
Video Panoptic Segmentation
on KITTI-STEP
(using extra training data)
TransVOD: End-to-End Video Object Detection with Spatial-Temporal Transformers
Detection Transformer (DETR) and Deformable DETR have been proposed to eliminate the need for many hand-designed components in object detection while demonstrating good performance as previous complex hand-crafted detectors.
Ranked #6 on
Video Object Detection
on ImageNet VID
(using extra training data)
PolyphonicFormer: Unified Query Learning for Depth-aware Video Panoptic Segmentation
The Depth-aware Video Panoptic Segmentation (DVPS) is a new challenging vision problem that aims to predict panoptic segmentation and depth in a video simultaneously.
Graph Pointer Neural Networks
On the one hand, multi-hop-based approaches do not explicitly distinguish relevant nodes from a large number of multi-hop neighborhoods, leading to a severe over-smoothing problem.
Competence-based Curriculum Learning for Multilingual Machine Translation
Therefore, we focus on balancing the learning competencies of different languages and propose Competence-based Curriculum Learning for Multilingual Machine Translation, named CCL-M.
Global Aggregation then Local Distribution for Scene Parsing
Modelling long-range contextual relationships is critical for pixel-wise prediction tasks such as semantic segmentation.
Improving Video Instance Segmentation via Temporal Pyramid Routing
To incorporate both temporal and scale information, we propose a Temporal Pyramid Routing (TPR) strategy to conditionally align and conduct pixel-level aggregation from a feature pyramid pair of two adjacent frames.
Customizing Graph Neural Networks using Path Reweighting
Specifically, the proposed CustomGNN can automatically learn the high-level semantics for specific downstream tasks to highlight semantically relevant paths as well to filter out task-irrelevant noises in a graph.
TS2Vec: Towards Universal Representation of Time Series
Furthermore, to obtain the representation of an arbitrary sub-sequence in the time series, we can apply a simple aggregation over the representations of corresponding timestamps.
Fast and Accurate Scene Parsing via Bi-direction Alignment Networks
Motivated by this, we propose a novel network by aligning two-path information into each other through a learned flow field.
Ranked #12 on
Semantic Segmentation
on BDD100K val
BoundarySqueeze: Image Segmentation as Boundary Squeezing
This module is used to squeeze the object boundary from both inner and outer directions, which contributes to precise mask representation.
Dynamic Dual Sampling Module for Fine-Grained Semantic Segmentation
Representation of semantic context and local details is the essential issue for building modern semantic segmentation models.
End-to-End Video Object Detection with Spatial-Temporal Transformers
Recently, DETR and Deformable DETR have been proposed to eliminate the need for many hand-designed components in object detection while demonstrating good performance as previous complex hand-crafted detectors.
Enhanced Boundary Learning for Glass-like Object Segmentation
We use these two modules to design a decoder that generates accurate and clean segmentation results, especially on the object contours.
Ranked #20 on
Thermal Image Segmentation
on RGB-T-Glass-Segmentation
Spectral Temporal Graph Neural Network for Multivariate Time-series Forecasting
In this paper, we propose Spectral Temporal Graph Neural Network (StemGNN) to further improve the accuracy of multivariate time-series forecasting.
Ranked #8 on
Traffic Prediction
on EXPY-TKY
Graph Neural Network
Multivariate Time Series Forecasting
+2
PointFlow: Flowing Semantics Through Points for Aerial Image Segmentation
Experimental results on three different aerial segmentation datasets suggest that the proposed method is more effective and efficient than state-of-the-art general semantic segmentation methods.
Syntax-BERT: Improving Pre-trained Transformers with Syntax Trees
Pre-trained language models like BERT achieve superior performances in various NLP tasks without explicit consideration of syntactic information.
Evolving Attention with Residual Convolutions
In this paper, we propose a novel and generic mechanism based on evolving attention to improve the performance of transformers.
Predictive Attention Transformer: Improving Transformer with Attention Map Prediction
Instead, we model their dependencies via a chain of prediction models that take previous attention maps as input to predict the attention maps of a new layer through convolutional neural networks.
Towards Efficient Scene Understanding via Squeeze Reasoning
Instead of propagating information on the spatial map, we first learn to squeeze the input feature into a channel-wise global vector and perform reasoning within the single vector where the computation cost can be significantly reduced.
AutoADR: Automatic Model Design for Ad Relevance
We add the model designed by AutoADR as a sub-model into the production Ad Relevance model.
Multivariate Time-series Anomaly Detection via Graph Attention Network
Anomaly detection on multivariate time-series is of great importance in both data mining research and industrial applications.
Ranked #4 on
Unsupervised Anomaly Detection
on SMAP
Boundary Content Graph Neural Network for Temporal Action Proposal Generation
To address this issue, we propose a novel Boundary Content Graph Neural Network (BC-GNN) to model the insightful relations between the boundary and action content of temporal proposals by the graph neural networks.
Ranked #26 on
Temporal Action Localization
on ActivityNet-1.3
Improving Semantic Segmentation via Decoupled Body and Edge Supervision
Our insight is that appealing performance of semantic segmentation requires \textit{explicitly} modeling the object \textit{body} and \textit{edge}, which correspond to the high and low frequency of the image.
LadaBERT: Lightweight Adaptation of BERT through Hybrid Model Compression
BERT is a cutting-edge language representation model pre-trained by a large corpus, which achieves superior performances on various natural language understanding tasks.
Improving BERT with Self-Supervised Attention
One of the most popular paradigms of applying large pre-trained NLP models such as BERT is to fine-tune it on a smaller dataset.
Semantic Flow for Fast and Accurate Scene Parsing
A common practice to improve the performance is to attain high resolution feature maps with strong semantic representation.
Ranked #2 on
Real-Time Semantic Segmentation
on Cityscapes test
TextNAS: A Neural Architecture Search Space tailored for Text Representation
Learning text representation is crucial for text classification and other language related tasks.
Customized Graph Embedding: Tailoring Embedding Vectors to different Applications
For these applications, graph embedding is crucial as it provides vector representations of the graph.
Global Aggregation then Local Distribution in Fully Convolutional Networks
GALD is end-to-end trainable and can be easily plugged into existing FCNs with various global aggregation modules for a wide range of vision tasks, and consistently improves the performance of state-of-the-art object detection and instance segmentation approaches.
Ranked #1 on
Semantic Segmentation
on PASCAL VOC 2007
Dual Graph Convolutional Network for Semantic Segmentation
Exploiting long-range contextual information is key for pixel-wise prediction tasks such as semantic segmentation.
Ranked #32 on
Semantic Segmentation
on Cityscapes test
Reprojection R-CNN: A Fast and Accurate Object Detector for 360° Images
Specifically, we adapt the terminologies of the traditional object detection task to the omnidirectional scenarios, and propose a novel two-stage object detector, i. e., Reprojection R-CNN by combining both ERP and perspective projection.
GFF: Gated Fully Fusion for Semantic Segmentation
Semantic segmentation generates comprehensive understanding of scenes through densely predicting the category for each pixel.
Ranked #29 on
Semantic Segmentation
on Cityscapes test
A Cooperative Multi-Agent Reinforcement Learning Framework for Resource Balancing in Complex Logistics Network
Traditional solutions on these problems leverage combinatorial optimization with demand and supply forecasting.
