Search Results for author:
Found 19 papers, 10 papers with code
LAPTOP-Diff: Layer Pruning and Normalized Distillation for Compressing Diffusion Models
To this end, we proposed the layer pruning and normalized distillation for compressing diffusion models (LAPTOP-Diff).
InsCL: A Data-efficient Continual Learning Paradigm for Fine-tuning Large Language Models with Instructions
Instruction tuning effectively optimizes Large Language Models (LLMs) for downstream tasks.
SCott: Accelerating Diffusion Models with Stochastic Consistency Distillation
In contrast to vanilla consistency distillation (CD) which distills the ordinary differential equation solvers-based sampling process of a pretrained teacher model into a student, SCott explores the possibility and validates the efficacy of integrating stochastic differential equation (SDE) solvers into CD to fully unleash the potential of the teacher.
Dream360: Diverse and Immersive Outdoor Virtual Scene Creation via Transformer-Based 360 Image Outpainting
To this end, we propose a transformer-based 360 image outpainting framework called Dream360, which can generate diverse, high-fidelity, and high-resolution panoramas from user-selected viewports, considering the spherical properties of 360 images.
PEA-Diffusion: Parameter-Efficient Adapter with Knowledge Distillation in non-English Text-to-Image Generation
In this paper, we are inspired to propose a simple plug-and-play language transfer method based on knowledge distillation.
Cross-lingual Text-to-Image Generation
Knowledge Distillation
+1
MCAD: Multi-teacher Cross-modal Alignment Distillation for efficient image-text retrieval
Due to the success of large-scale visual-language pretraining (VLP) models and the widespread use of image-text retrieval in industry areas, it is now critically necessary to reduce the model size and streamline their mobile-device deployment.
MoEController: Instruction-based Arbitrary Image Manipulation with Mixture-of-Expert Controllers
In this work, we propose a method with a mixture-of-expert (MOE) controllers to align the text-guided capacity of diffusion models with different kinds of human instructions, enabling our model to handle various open-domain image manipulation tasks with natural language instructions.
Subject-Diffusion:Open Domain Personalized Text-to-Image Generation without Test-time Fine-tuning
In this paper, we propose Subject-Diffusion, a novel open-domain personalized image generation model that, in addition to not requiring test-time fine-tuning, also only requires a single reference image to support personalized generation of single- or multi-subject in any domain.
Diffusion Personalization Tuning Free
Text-to-Image Generation
Prompt Space Optimizing Few-shot Reasoning Success with Large Language Models
To address this issue in prompt engineering, we propose a new and effective approach called Prompt Space.
Towards Language-guided Interactive 3D Generation: LLMs as Layout Interpreter with Generative Feedback
Generating and editing a 3D scene guided by natural language poses a challenge, primarily due to the complexity of specifying the positional relations and volumetric changes within the 3D space.
Compositional Text-to-Image Synthesis with Attention Map Control of Diffusion Models
Our approach produces a more semantically accurate synthesis by constraining the attention regions of each token in the prompt to the image.
Edit Everything: A Text-Guided Generative System for Images Editing
We introduce a new generative system called Edit Everything, which can take image and text inputs and produce image outputs.
GlyphDraw: Seamlessly Rendering Text with Intricate Spatial Structures in Text-to-Image Generation
Recent breakthroughs in the field of language-guided image generation have yielded impressive achievements, enabling the creation of high-quality and diverse images based on user instructions. Although the synthesis performance is fascinating, one significant limitation of current image generation models is their insufficient ability to generate text coherently within images, particularly for complex glyph structures like Chinese characters.
Optical Character Recognition (OCR)
Text-to-Image Generation
CompoNeRF: Text-guided Multi-object Compositional NeRF with Editable 3D Scene Layout
To tackle the issue of 'guidance collapse' and enhance consistency, we propose a novel framework, dubbed CompoNeRF, by integrating an editable 3D scene layout with object specific and scene-wide guidance mechanisms.
GammaE: Gamma Embeddings for Logical Queries on Knowledge Graphs
However, it remains challenging to model the negation and union operator.
Emily: Developing An Emotion-affective Open-Domain Chatbot with Knowledge Graph-based Persona
In this paper, we describe approaches for developing Emily, an emotion-affective open-domain chatbot.
KELM: Knowledge Enhanced Pre-Trained Language Representations with Message Passing on Hierarchical Relational Graphs
Incorporating factual knowledge into pre-trained language models (PLM) such as BERT is an emerging trend in recent NLP studies.
Ranked #11 on
Common Sense Reasoning
on ReCoRD
AugNet: End-to-End Unsupervised Visual Representation Learning with Image Augmentation
In our evaluations, the method outperforms all the state-of-the-art image retrieval algorithms on some out-of-domain image datasets.
DensE: An Enhanced Non-commutative Representation for Knowledge Graph Embedding with Adaptive Semantic Hierarchy
This design principle leads to several advantages of our method: (1) For composite relations, the corresponding diagonal relation matrices can be non-commutative, reflecting a predominant scenario in real world applications; (2) Our model preserves the natural interaction between relational operations and entity embeddings; (3) The scaling operation provides the modeling power for the intrinsic semantic hierarchical structure of entities; (4) The enhanced expressiveness of DensE is achieved with high computational efficiency in terms of both parameter size and training time; and (5) Modeling entities in Euclidean space instead of quaternion space keeps the direct geometrical interpretations of relational patterns.
Ranked #7 on
Link Prediction
on WN18
