Search Results for author:
Found 36 papers, 13 papers with code
Implicit Sentiment Analysis with Event-centered Text Representation
Implicit sentiment analysis, aiming at detecting the sentiment of a sentence without sentiment words, has become an attractive research topic in recent years.
Unposed Sparse Views Room Layout Reconstruction in the Age of Pretrain Model
Room layout estimation from multiple-perspective images is poorly investigated due to the complexities that emerge from multi-view geometry, which requires muti-step solutions such as camera intrinsic and extrinsic estimation, image matching, and triangulation.
OccScene: Semantic Occupancy-based Cross-task Mutual Learning for 3D Scene Generation
Within OccScene, the perception module can be effectively improved with customized and diverse generated scenes, while the perception priors in return enhance the generation performance for mutual benefits.
DreamWaltz-G: Expressive 3D Gaussian Avatars from Skeleton-Guided 2D Diffusion
The core of this framework lies in Skeleton-guided Score Distillation and Hybrid 3D Gaussian Avatar representation.
BeSimulator: A Large Language Model Powered Text-based Behavior Simulator
Traditional robot simulators focus on physical process modeling and realistic rendering, often suffering from high computational costs, inefficiencies, and limited adaptability.
Technique Report of CVPR 2024 PBDL Challenges
The intersection of physics-based vision and deep learning presents an exciting frontier for advancing computer vision technologies.
HeGTa: Leveraging Heterogeneous Graph-enhanced Large Language Models for Few-shot Complex Table Understanding
Table understanding (TU) has achieved promising advancements, but it faces the challenges of the scarcity of manually labeled tables and the presence of complex table structures. To address these challenges, we propose HGT, a framework with a heterogeneous graph (HG)-enhanced large language model (LLM) to tackle few-shot TU tasks. It leverages the LLM by aligning the table semantics with the LLM's parametric knowledge through soft prompts and instruction turning and deals with complex tables by a multi-task pre-training scheme involving three novel multi-granularity self-supervised HG pre-training objectives. We empirically demonstrate the effectiveness of HGT, showing that it outperforms the SOTA for few-shot complex TU on several benchmarks.
CoCoCo: Improving Text-Guided Video Inpainting for Better Consistency, Controllability and Compatibility
To this end, this paper proposes a novel text-guided video inpainting model that achieves better consistency, controllability and compatibility.
Ctrl123: Consistent Novel View Synthesis via Closed-Loop Transcription
This consequently limits the performance of downstream tasks, such as image-to-multiview generation and 3D reconstruction.
DiffSHEG: A Diffusion-Based Approach for Real-Time Speech-driven Holistic 3D Expression and Gesture Generation
We propose DiffSHEG, a Diffusion-based approach for Speech-driven Holistic 3D Expression and Gesture generation with arbitrary length.
Stable Score Distillation for High-Quality 3D Generation
Although Score Distillation Sampling (SDS) has exhibited remarkable performance in conditional 3D content generation, a comprehensive understanding of its formulation is still lacking, hindering the development of 3D generation.
Progressive3D: Progressively Local Editing for Text-to-3D Content Creation with Complex Semantic Prompts
Recent text-to-3D generation methods achieve impressive 3D content creation capacity thanks to the advances in image diffusion models and optimizing strategies.
TOSS:High-quality Text-guided Novel View Synthesis from a Single Image
In this paper, we present TOSS, which introduces text to the task of novel view synthesis (NVS) from just a single RGB image.
Consistent123: Improve Consistency for One Image to 3D Object Synthesis
Large image diffusion models enable novel view synthesis with high quality and excellent zero-shot capability.
Delta-LoRA: Fine-Tuning High-Rank Parameters with the Delta of Low-Rank Matrices
In this paper, we present Delta-LoRA, which is a novel parameter-efficient approach to fine-tune large language models (LLMs).
DreamTime: An Improved Optimization Strategy for Diffusion-Guided 3D Generation
Text-to-image diffusion models pre-trained on billions of image-text pairs have recently enabled 3D content creation by optimizing a randomly initialized differentiable 3D representation with score distillation.
Understanding Optimization of Deep Learning via Jacobian Matrix and Lipschitz Constant
This article provides a comprehensive understanding of optimization in deep learning, with a primary focus on the challenges of gradient vanishing and gradient exploding, which normally lead to diminished model representational ability and training instability, respectively.
detrex: Benchmarking Detection Transformers
To address this issue, we develop a unified, highly modular, and lightweight codebase called detrex, which supports a majority of the mainstream DETR-based instance recognition algorithms, covering various fundamental tasks, including object detection, segmentation, and pose estimation.
LipsFormer: Introducing Lipschitz Continuity to Vision Transformers
In contrast to previous practical tricks that address training instability by learning rate warmup, layer normalization, attention formulation, and weight initialization, we show that Lipschitz continuity is a more essential property to ensure training stability.
DisCo-CLIP: A Distributed Contrastive Loss for Memory Efficient CLIP Training
In this way, we can reduce the GPU memory consumption of contrastive loss computation from $\bigO(B^2)$ to $\bigO(\frac{B^2}{N})$, where $B$ and $N$ are the batch size and the number of GPUs used for training.
HumanSD: A Native Skeleton-Guided Diffusion Model for Human Image Generation
While such a plug-and-play approach is appealing, the inevitable and uncertain conflicts between the original images produced from the frozen SD branch and the given condition incur significant challenges for the learnable branch, which essentially conducts image feature editing for condition enforcement.
Human-Art: A Versatile Human-Centric Dataset Bridging Natural and Artificial Scenes
Humans have long been recorded in a variety of forms since antiquity.
Entity-Level Text-Guided Image Manipulation
In the image manipulation phase, SeMani adopts a generative model to synthesize new images conditioned on the entity-irrelevant regions and target text descriptions.
A Multi-Source Information Learning Framework for Airbnb Price Prediction
Thirdly, we uses the points of interest(POI) around the rental house information generates a variety of spatial network graphs, and learns the embedding of the network to obtain the spatial feature embedding.
Multi-View MOOC Quality Evaluation via Information-Aware Graph Representation Learning
To tackle the challenges, we formulate the problem as a course representation learning task-based and develop an Information-aware Graph Representation Learning(IaGRL) for multi-view MOOC quality evaluation.
Exploring Vision Transformers as Diffusion Learners
We further provide a hypothesis on the implication of disentangling the generative backbone as an encoder-decoder structure and show proof-of-concept experiments verifying the effectiveness of a stronger encoder for generative tasks with ASymmetriC ENcoder Decoder (ASCEND).
Streaming Traffic Flow Prediction Based on Continuous Reinforcement Learning
We propose to formulate the problem as a continuous reinforcement learning task, where the agent is the next flow value predictor, the action is the next time-series flow value in the sensor, and the environment state is a dynamically fused representation of the sensor and transportation network.
ManiTrans: Entity-Level Text-Guided Image Manipulation via Token-wise Semantic Alignment and Generation
Existing text-guided image manipulation methods aim to modify the appearance of the image or to edit a few objects in a virtual or simple scenario, which is far from practical application.
Data-efficient Alignment of Multimodal Sequences by Aligning Gradient Updates and Internal Feature Distributions
The task of video and text sequence alignment is a prerequisite step toward joint understanding of movie videos and screenplays.
A Combinatorial Perspective on Transfer Learning
Our main postulate is that the combination of task segmentation, modular learning and memory-based ensembling can give rise to generalization on an exponentially growing number of unseen tasks.
Online Learning in Contextual Bandits using Gated Linear Networks
We introduce a new and completely online contextual bandit algorithm called Gated Linear Contextual Bandits (GLCB).
Gated Linear Networks
This paper presents a new family of backpropagation-free neural architectures, Gated Linear Networks (GLNs).
Learning Object Bounding Boxes for 3D Instance Segmentation on Point Clouds
The framework directly regresses 3D bounding boxes for all instances in a point cloud, while simultaneously predicting a point-level mask for each instance.
Ranked #14 on
3D Instance Segmentation
on S3DIS
(mPrec metric)
mID: Tracking and Identifying People with Millimeter Wave Radar
The key to offering personalised services in smart spaces is knowing where a particular person is with a high degree of accuracy.
Group Linguistic Bias Aware Neural Response Generation
For practical chatbots, one of the essential factor for improving user experience is the capability of customizing the talking style of the agents, that is, to make chatbots provide responses meeting users{'} preference on language styles, topics, etc.
Predicting Users' Negative Feedbacks in Multi-Turn Human-Computer Dialogues
Besides, strategies of obtaining distance supervision data for pre-training are also discussed in this work.
