Search Results for author:
Found 54 papers, 18 papers with code
Beyond Text: Incorporating Metadata and Label Structure for Multi-Label Document Classification using Heterogeneous Graphs
The other is label heterogeneous graph, which is constructed based on both the labels’ hierarchy and their statistical dependencies.
ID-Aligner: Enhancing Identity-Preserving Text-to-Image Generation with Reward Feedback Learning
The rapid development of diffusion models has triggered diverse applications.
Hyper-SD: Trajectory Segmented Consistency Model for Efficient Image Synthesis
Current distillation techniques often dichotomize into two distinct aspects: i) ODE Trajectory Preservation; and ii) ODE Trajectory Reformulation.
LAECIPS: Large Vision Model Assisted Adaptive Edge-Cloud Collaboration for IoT-based Perception System
We propose to update the edge model and its collaboration strategy with the cloud under the supervision of the large vision model, so as to adapt to the dynamic IoT data streams.
ControlNet++: Improving Conditional Controls with Efficient Consistency Feedback
To this end, we propose ControlNet++, a novel approach that improves controllable generation by explicitly optimizing pixel-level cycle consistency between generated images and conditional controls.
UniFL: Improve Stable Diffusion via Unified Feedback Learning
Diffusion models have revolutionized the field of image generation, leading to the proliferation of high-quality models and diverse downstream applications.
ByteEdit: Boost, Comply and Accelerate Generative Image Editing
Recent advancements in diffusion-based generative image editing have sparked a profound revolution, reshaping the landscape of image outpainting and inpainting tasks.
ResAdapter: Domain Consistent Resolution Adapter for Diffusion Models
Especially, after learning a deep understanding of pure resolution priors, ResAdapter trained on the general dataset, generates resolution-free images with personalized diffusion models while preserving their original style domain.
Grounding Language Models for Visual Entity Recognition
We introduce AutoVER, an Autoregressive model for Visual Entity Recognition.
DiffusionGPT: LLM-Driven Text-to-Image Generation System
Diffusion models have opened up new avenues for the field of image generation, resulting in the proliferation of high-quality models shared on open-source platforms.
MagicVideo-V2: Multi-Stage High-Aesthetic Video Generation
The growing demand for high-fidelity video generation from textual descriptions has catalyzed significant research in this field.
Diversity-Based Recruitment in Crowdsensing By Combinatorial Multi-Armed Bandits
Additionally, it accommodates the variability in task completion quality caused by overlaps in the same round, which can range from the maximum individual worker's quality to the summation of qualities of all assigned workers in the overlap.
DreamTuner: Single Image is Enough for Subject-Driven Generation
Diffusion-based models have demonstrated impressive capabilities for text-to-image generation and are expected for personalized applications of subject-driven generation, which require the generation of customized concepts with one or a few reference images.
FuXi-S2S: An accurate machine learning model for global subseasonal forecasts
Skillful subseasonal forecasts beyond 2 weeks are crucial for a wide range of applications across various sectors of society.
On the Communication Complexity of Decentralized Bilevel Optimization
To the best of our knowledge, this is the first stochastic algorithm achieving these theoretical results under the heterogeneous setting.
Instructed Language Models with Retrievers Are Powerful Entity Linkers
Generative approaches powered by large language models (LLMs) have demonstrated emergent abilities in tasks that require complex reasoning abilities.
Coherent Entity Disambiguation via Modeling Topic and Categorical Dependency
We propose CoherentED, an ED system equipped with novel designs aimed at enhancing the coherence of entity predictions.
AutoDiffusion: Training-Free Optimization of Time Steps and Architectures for Automated Diffusion Model Acceleration
Therefore, we propose to search the optimal time steps sequence and compressed model architecture in a unified framework to achieve effective image generation for diffusion models without any further training.
UGC: Unified GAN Compression for Efficient Image-to-Image Translation
Recent years have witnessed the prevailing progress of Generative Adversarial Networks (GANs) in image-to-image translation.
DiffusionEngine: Diffusion Model is Scalable Data Engine for Object Detection
This paper reveals that the recently developed Diffusion Model is a scalable data engine for object detection.
DLIP: Distilling Language-Image Pre-training
Furthermore, DLIP succeeds in retaining more than 95% of the performance with 22. 4% parameters and 24. 8% FLOPs compared to the teacher model and accelerates inference speed by 2. 7x.
AlignDet: Aligning Pre-training and Fine-tuning in Object Detection
To this end, we propose AlignDet, a unified pre-training framework that can be adapted to various existing detectors to alleviate the discrepancies.
You Can Trade Your Experience in Distributed Multi-Agent Multi-Armed Bandits
In this paper, we propose a transaction-based multi-agent MAB framework, where agents can trade their bandit experience with each other to improve their total individual rewards.
When Decentralized Optimization Meets Federated Learning
Federated learning is a new learning paradigm for extracting knowledge from distributed data.
Control-A-Video: Controllable Text-to-Video Generation with Diffusion Models
Based on a pre-trained conditional text-to-image (T2I) diffusion model, our model aims to generate videos conditioned on a sequence of control signals, such as edge or depth maps.
FreeSeg: Unified, Universal and Open-Vocabulary Image Segmentation
Recently, open-vocabulary learning has emerged to accomplish segmentation for arbitrary categories of text-based descriptions, which popularizes the segmentation system to more general-purpose application scenarios.
Ranked #6 on
Open Vocabulary Panoptic Segmentation
on ADE20K
Masked Vision-Language Transformers for Scene Text Recognition
MVLT is trained in two stages: in the first stage, we design a STR-tailored pretraining method based on a masking strategy; in the second stage, we fine-tune our model and adopt an iterative correction method to improve the performance.
FedVeca: Federated Vectorized Averaging on Non-IID Data with Adaptive Bi-directional Global Objective
However, the clients' Non-Independent and Identically Distributed (Non-IID) data negatively affect the trained model, and clients with different numbers of local updates may cause significant gaps to the local gradients in each communication round.
Multi-Granularity Distillation Scheme Towards Lightweight Semi-Supervised Semantic Segmentation
Consequently, we offer the first attempt to provide lightweight SSSS models via a novel multi-granularity distillation (MGD) scheme, where multi-granularity is captured from three aspects: i) complementary teacher structure; ii) labeled-unlabeled data cooperative distillation; iii) hierarchical and multi-levels loss setting.
Knowledge Distillation
Semi-Supervised Semantic Segmentation
Parallel Pre-trained Transformers (PPT) for Synthetic Data-based Instance Segmentation
Recently, Synthetic data-based Instance Segmentation has become an exceedingly favorable optimization paradigm since it leverages simulation rendering and physics to generate high-quality image-annotation pairs.
TRT-ViT: TensorRT-oriented Vision Transformer
We revisit the existing excellent Transformers from the perspective of practical application.
SepViT: Separable Vision Transformer
Vision Transformers have witnessed prevailing success in a series of vision tasks.
ScalableViT: Rethinking the Context-oriented Generalization of Vision Transformer
The vanilla self-attention mechanism inherently relies on pre-defined and steadfast computational dimensions.
Soft-CP: A Credible and Effective Data Augmentation for Semantic Segmentation of Medical Lesions
The medical datasets are usually faced with the problem of scarcity and data imbalance.
Activation Modulation and Recalibration Scheme for Weakly Supervised Semantic Segmentation
Extensive experiments show that AMR establishes a new state-of-the-art performance on the PASCAL VOC 2012 dataset, surpassing not only current methods trained with the image-level of supervision but also some methods relying on stronger supervision, such as saliency label.
Uncovering the Dark Side of Telegram: Fakes, Clones, Scams, and Conspiracy Movements
We study the channels that Telegram marks as verified or scam, highlighting analogies and differences.
Revisiting Discriminator in GAN Compression: A Generator-discriminator Cooperative Compression Scheme
In this work, we revisit the role of discriminator in GAN compression and design a novel generator-discriminator cooperative compression scheme for GAN compression, termed GCC.
Online Multi-Granularity Distillation for GAN Compression
It reveals that OMGD provides a feasible solution for the deployment of real-time image translation on resource-constrained devices.
Weakly-Supervised Spatio-Temporal Anomaly Detection in Surveillance Video
In this paper, we introduce a novel task, referred to as Weakly-Supervised Spatio-Temporal Anomaly Detection (WSSTAD) in surveillance video.
Spoken Language Understanding for Task-oriented Dialogue Systems with Augmented Memory Networks
We adopt a key-value memory network to model slot context dynamically and to track more important slot tags decoded before, which are then fed into our decoder for slot tagging.
Auction-Based Combinatorial Multi-Armed Bandit Mechanisms with Strategic Arms
The multi-armed bandit (MAB) model has been deeply studied to solve many online learning problems, such as rate allocation in communication networks, Ad recommendation in social networks, etc.
Robust Sequence Submodular Maximization
Compared to robust submodular maximization for set function, new challenges arise when sequence functions are concerned.
Reinforcement Learning for Weakly Supervised Temporal Grounding of Natural Language in Untrimmed Videos
Temporal grounding of natural language in untrimmed videos is a fundamental yet challenging multimedia task facilitating cross-media visual content retrieval.
Fine-Grained Image Captioning with Global-Local Discriminative Objective
This is primarily due to (i) the conservative characteristic of traditional training objectives that drives the model to generate correct but hardly discriminative captions for similar images and (ii) the uneven word distribution of the ground-truth captions, which encourages generating highly frequent words/phrases while suppressing the less frequent but more concrete ones.
Combinatorial Multi-Armed Bandit Based Unknown Worker Recruitment in Heterogeneous Crowdsensing
In each round, every task may be covered by more than one recruited workers, but its completion quality only depends on these workers' maximum sensing quality.
Adversarially Trained Multi-Singer Sequence-To-Sequence Singing Synthesizer
This paper presents a high quality singing synthesizer that is able to model a voice with limited available recordings.
XiaoiceSing: A High-Quality and Integrated Singing Voice Synthesis System
This paper presents XiaoiceSing, a high-quality singing voice synthesis system which employs an integrated network for spectrum, F0 and duration modeling.
Tree-Structured Policy based Progressive Reinforcement Learning for Temporally Language Grounding in Video
Temporally language grounding in untrimmed videos is a newly-raised task in video understanding.
PMC-GANs: Generating Multi-Scale High-Quality Pedestrian with Multimodal Cascaded GANs
Recently, generative adversarial networks (GANs) have shown great advantages in synthesizing images, leading to a boost of explorations of using faked images to augment data.
Data-driven prediction of vortex-induced vibration response of marine risers subjected to three-dimensional current
The load model and hydrodynamic parameters in present VIV prediction tools are developed based on two-dimensional (2D) flow conditions, as it is challenging to consider the effect of 3D flow along the risers.
Visual Saliency Maps Can Apply to Facial Expression Recognition
Human eyes concentrate different facial regions during distinct cognitive activities.
Facial Expression Recognition
Facial Expression Recognition (FER)
+2
Hand Gesture Recognition with Leap Motion
The recent introduction of depth cameras like Leap Motion Controller allows researchers to exploit the depth information to recognize hand gesture more robustly.
Polarimetric Hierarchical Semantic Model and Scattering Mechanism Based PolSAR Image Classification
For polarimetric SAR (PolSAR) image classification, it is a challenge to classify the aggregated terrain types, such as the urban area, into semantic homogenous regions due to sharp bright-dark variations in intensity.
Room-temperature implementation of the Deutsch-Jozsa algorithm with a single electronic spin in diamond
The nitrogen-vacancy defect center (NV center) is a promising candidate for quantum information processing due to the possibility of coherent manipulation of individual spins in the absence of the cryogenic requirement.
Quantum Physics
