Search Results for author:
Found 32 papers, 12 papers with code
Motion-2-to-3: Leveraging 2D Motion Data to Boost 3D Motion Generation
To enhance this model to synthesize 3D motion, we fine-tune the generator with 3D data, transforming it into a multi-view generator that predicts view-consistent local joint motion and root dynamics.
G3Flow: Generative 3D Semantic Flow for Pose-aware and Generalizable Object Manipulation
Our results demonstrate the effectiveness of G3Flow in enhancing real-time dynamic semantic feature understanding for robotic manipulation policies.
Controllable Shape Modeling with Neural Generalized Cylinder
Due to the implicit manner to use features for shape representation, manipulating the shapes faces inherent challenge of inconvenience, since the feature cannot be intuitively edited.
World-Grounded Human Motion Recovery via Gravity-View Coordinates
Instead, we propose estimating human poses in a novel Gravity-View (GV) coordinate system, which is defined by the world gravity and the camera view direction.
LLM-enhanced Scene Graph Learning for Household Rearrangement
The household rearrangement task involves spotting misplaced objects in a scene and accommodate them with proper places.
FRI-Net: Floorplan Reconstruction via Room-wise Implicit Representation
In this paper, we introduce a novel method called FRI-Net for 2D floorplan reconstruction from 3D point cloud.
LGTM: Local-to-Global Text-Driven Human Motion Diffusion Model
In this paper, we introduce LGTM, a novel Local-to-Global pipeline for Text-to-Motion generation.
Spatial and Surface Correspondence Field for Interaction Transfer
In this paper, we introduce a new method for the task of interaction transfer.
MaPa: Text-driven Photorealistic Material Painting for 3D Shapes
Instead of relying on extensive paired data, i. e., 3D meshes with material graphs and corresponding text descriptions, to train a material graph generative model, we propose to leverage the pre-trained 2D diffusion model as a bridge to connect the text and material graphs.
InterFusion: Text-Driven Generation of 3D Human-Object Interaction
In this study, we tackle the complex task of generating 3D human-object interactions (HOI) from textual descriptions in a zero-shot text-to-3D manner.
Learning Dual-arm Object Rearrangement for Cartesian Robots
To achieve the goal, the core idea is to develop an effective object-to-arm task assignment strategy for minimizing the cumulative task execution time and maximizing the dual-arm cooperation efficiency.
SAM-guided Graph Cut for 3D Instance Segmentation
Experimental results on the ScanNet, ScanNet++ and KITTI-360 datasets demonstrate that our method achieves robust segmentation performance and can generalize across different types of scenes.
Interaction-Driven Active 3D Reconstruction with Object Interiors
We introduce an active 3D reconstruction method which integrates visual perception, robot-object interaction, and 3D scanning to recover both the exterior and interior, i. e., unexposed, geometries of a target 3D object.
Neural Packing: from Visual Sensing to Reinforcement Learning
We present a novel learning framework to solve the transport-and-packing (TAP) problem in 3D.
AffordPose: A Large-scale Dataset of Hand-Object Interactions with Affordance-driven Hand Pose
We collect a total of 26. 7K hand-object interactions, each including the 3D object shape, the part-level affordance label, and the manually adjusted hand poses.
Semi-Weakly Supervised Object Kinematic Motion Prediction
First, although 3D dataset with fully annotated motion labels is limited, there are existing datasets and methods for object part semantic segmentation at large scale.
Self-Supervised Category-Level Articulated Object Pose Estimation with Part-Level SE(3) Equivariance
Category-level articulated object pose estimation aims to estimate a hierarchy of articulation-aware object poses of an unseen articulated object from a known category.
ARO-Net: Learning Implicit Fields from Anchored Radial Observations
We introduce anchored radial observations (ARO), a novel shape encoding for learning implicit field representation of 3D shapes that is category-agnostic and generalizable amid significant shape variations.
NIFT: Neural Interaction Field and Template for Object Manipulation
Given a few object manipulation demos, NIFT guides the generation of the interaction imitation for a new object instance by matching the Neural Interaction Template (NIT) extracted from the demos in the target Neural Interaction Field (NIF) defined for the new object.
Shape Completion with Points in the Shadow
The core challenge is to generate plausible geometries to fill the unobserved part of the object based on a partial scan, which is under-constrained and suffers from a huge solution space.
Active Self-Training for Weakly Supervised 3D Scene Semantic Segmentation
Since the preparation of labeled data for training semantic segmentation networks of point clouds is a time-consuming process, weakly supervised approaches have been introduced to learn from only a small fraction of data.
Photo-to-Shape Material Transfer for Diverse Structures
The image translation network translates the color from the exemplar to a projection of the 3D shape and the part segmentation from the projection to the exemplar.
Learning High-DOF Reaching-and-Grasping via Dynamic Representation of Gripper-Object Interaction
To resolve the sample efficiency issue in learning the high-dimensional and complex control of dexterous grasping, we propose an effective representation of grasping state characterizing the spatial interaction between the gripper and the target object.
Point cloud completion via structured feature maps using a feedback network
To efficiently exploit local structures and enhance point distribution uniformity, we propose IFNet, a point upsampling module with a self-correction mechanism that can progressively refine details of the generated dense point cloud.
Consistent Two-Flow Network for Tele-Registration of Point Clouds
In this paper, we present a learning-based technique that alleviates this problem, and allows registration between point clouds, presented in arbitrary poses, and having little or even no overlap, a setting that has been referred to as tele-registration.
Shape-driven Coordinate Ordering for Star Glyph Sets via Reinforcement Learning
Given a set of star glyphs associated to multiple class labels, we propose to use shape context descriptors to measure the perceptual distance between pairs of glyphs, and use the derived silhouette coefficient to measure the perception of class separability within the entire set.
TAP-Net: Transport-and-Pack using Reinforcement Learning
Using a learning-based approach, a trained network can learn and encode solution patterns to guide the solution of new problem instances instead of executing an expensive online search.
Predictive and Generative Neural Networks for Object Functionality
Given a 3D object in isolation, our functional similarity network (fSIM-NET), a variation of the triplet network, is trained to predict the functionality of the object by inferring functionality-revealing interaction contexts.
RPM-Net: Recurrent Prediction of Motion and Parts from Point Cloud
We show results of simultaneous motion and part predictions from synthetic and real scans of 3D objects exhibiting a variety of part mobilities, possibly involving multiple movable parts.
FAME: 3D Shape Generation via Functionality-Aware Model Evolution
Our tool supports constrained modeling, allowing users to restrict or steer the model evolution with functionality labels.
Graphics
Graph2Plan: Learning Floorplan Generation from Layout Graphs
The core component of our learning framework is a deep neural network, Graph2Plan, which converts a layout graph, along with a building boundary, into a floorplan that fulfills both the layout and boundary constraints.
Global-to-Local Generative Model for 3D Shapes
We also introduce new means to measure and evaluate the performance of an adversarial generative model.
