Search Results for author: Jan Eric Lenssen

Found 29 papers, 14 papers with code

PersonaHOI: Effortlessly Improving Personalized Face with Human-Object Interaction Generation

1 code implementation10 Jan 2025 Xinting Hu, Haoran Wang, Jan Eric Lenssen, Bernt Schiele

We introduce PersonaHOI, a training- and tuning-free framework that fuses a general StableDiffusion model with a personalized face diffusion (PFD) model to generate identity-consistent human-object interaction (HOI) images.

Human-Object Interaction Detection Human-Object Interaction Generation

ContextGNN: Beyond Two-Tower Recommendation Systems

1 code implementation29 Nov 2024 Yiwen Yuan, Zecheng Zhang, Xinwei He, Akihiro Nitta, Weihua Hu, Dong Wang, Manan Shah, Shenyang Huang, Blaž Stojanovič, Alan Krumholz, Jan Eric Lenssen, Jure Leskovec, Matthias Fey

Recommendation systems predominantly utilize two-tower architectures, which evaluate user-item rankings through the inner product of their respective embeddings.

Link Prediction Recommendation Systems

TokenFormer: Rethinking Transformer Scaling with Tokenized Model Parameters

2 code implementations30 Oct 2024 Haiyang Wang, Yue Fan, Muhammad Ferjad Naeem, Yongqin Xian, Jan Eric Lenssen, LiWei Wang, Federico Tombari, Bernt Schiele

By treating model parameters as tokens, we replace all the linear projections in Transformers with our token-parameter attention layer, where input tokens act as queries and model parameters as keys and values.

model

Spurfies: Sparse Surface Reconstruction using Local Geometry Priors

no code implementations29 Aug 2024 Kevin Raj, Christopher Wewer, Raza Yunus, Eddy Ilg, Jan Eric Lenssen

We introduce Spurfies, a novel method for sparse-view surface reconstruction that disentangles appearance and geometry information to utilize local geometry priors trained on synthetic data.

3D Reconstruction NeRF +2

Scribbles for All: Benchmarking Scribble Supervised Segmentation Across Datasets

1 code implementation22 Aug 2024 Wolfgang Boettcher, Lukas Hoyer, Ozan Unal, Jan Eric Lenssen, Bernt Schiele

In this work, we introduce Scribbles for All, a label and training data generation algorithm for semantic segmentation trained on scribble labels.

All Benchmarking +3

Improving 2D Feature Representations by 3D-Aware Fine-Tuning

no code implementations29 Jul 2024 Yuanwen Yue, Anurag Das, Francis Engelmann, Siyu Tang, Jan Eric Lenssen

In this work, we show that fine-tuning on 3D-aware data improves the quality of emerging semantic features.

Depth Estimation Semantic Segmentation

Sp2360: Sparse-view 360 Scene Reconstruction using Cascaded 2D Diffusion Priors

no code implementations26 May 2024 Soumava Paul, Christopher Wewer, Bernt Schiele, Jan Eric Lenssen

We aim to tackle sparse-view reconstruction of a 360 3D scene using priors from latent diffusion models (LDM).

3DGS NeRF

GEARS: Local Geometry-aware Hand-object Interaction Synthesis

no code implementations CVPR 2024 Keyang Zhou, Bharat Lal Bhatnagar, Jan Eric Lenssen, Gerard Pons-Moll

Generating realistic hand motion sequences in interaction with objects has gained increasing attention with the growing interest in digital humans.

Object

From Similarity to Superiority: Channel Clustering for Time Series Forecasting

1 code implementation31 Mar 2024 Jialin Chen, Jan Eric Lenssen, Aosong Feng, Weihua Hu, Matthias Fey, Leandros Tassiulas, Jure Leskovec, Rex Ying

Motivated by our observation of a correlation between the time series model's performance boost against channel mixing and the intrinsic similarity on a pair of channels, we developed a novel and adaptable Channel Clustering Module (CCM).

Clustering Time Series +1

latentSplat: Autoencoding Variational Gaussians for Fast Generalizable 3D Reconstruction

no code implementations24 Mar 2024 Christopher Wewer, Kevin Raj, Eddy Ilg, Bernt Schiele, Jan Eric Lenssen

We present latentSplat, a method to predict semantic Gaussians in a 3D latent space that can be splatted and decoded by a light-weight generative 2D architecture.

3D Reconstruction Decoder

Recent Trends in 3D Reconstruction of General Non-Rigid Scenes

no code implementations22 Mar 2024 Raza Yunus, Jan Eric Lenssen, Michael Niemeyer, Yiyi Liao, Christian Rupprecht, Christian Theobalt, Gerard Pons-Moll, Jia-Bin Huang, Vladislav Golyanik, Eddy Ilg

Reconstructing models of the real world, including 3D geometry, appearance, and motion of real scenes, is essential for computer graphics and computer vision.

3D geometry 3D Reconstruction +1

NRDF: Neural Riemannian Distance Fields for Learning Articulated Pose Priors

no code implementations CVPR 2024 Yannan He, Garvita Tiwari, Tolga Birdal, Jan Eric Lenssen, Gerard Pons-Moll

Faithfully modeling the space of articulations is a crucial task that allows recovery and generation of realistic poses, and remains a notorious challenge.

Pose Estimation

Template Free Reconstruction of Human-object Interaction with Procedural Interaction Generation

no code implementations CVPR 2024 Xianghui Xie, Bharat Lal Bhatnagar, Jan Eric Lenssen, Gerard Pons-Moll

We generate 1M+ human-object interaction pairs in 3D and leverage this large-scale data to train our HDM (Hierarchical Diffusion Model), a novel method to reconstruct interacting human and unseen objects, without any templates.

Human-Object Interaction Detection Object

Relational Deep Learning: Graph Representation Learning on Relational Databases

no code implementations7 Dec 2023 Matthias Fey, Weihua Hu, Kexin Huang, Jan Eric Lenssen, Rishabh Ranjan, Joshua Robinson, Rex Ying, Jiaxuan You, Jure Leskovec

The core idea is to view relational databases as a temporal, heterogeneous graph, with a node for each row in each table, and edges specified by primary-foreign key links.

Deep Learning Feature Engineering +1

Neural Parametric Gaussians for Monocular Non-Rigid Object Reconstruction

no code implementations CVPR 2024 Devikalyan Das, Christopher Wewer, Raza Yunus, Eddy Ilg, Jan Eric Lenssen

However, owing to the ill-posed nature of this problem, there has been no solution that can provide consistent, high-quality novel views from camera positions that are significantly different from the training views.

Object Object Reconstruction

SimNP: Learning Self-Similarity Priors Between Neural Points

no code implementations ICCV 2023 Christopher Wewer, Eddy Ilg, Bernt Schiele, Jan Eric Lenssen

(1) We design the first neural point representation on a category level by utilizing the concept of coherent point clouds.

3D Object Reconstruction Object

Pose-NDF: Modeling Human Pose Manifolds with Neural Distance Fields

1 code implementation27 Jul 2022 Garvita Tiwari, Dimitrije Antic, Jan Eric Lenssen, Nikolaos Sarafianos, Tony Tung, Gerard Pons-Moll

The resulting high-dimensional implicit function can be differentiated with respect to the input poses and thus can be used to project arbitrary poses onto the manifold by using gradient descent on the set of 3-dimensional hyperspheres.

Denoising

TOCH: Spatio-Temporal Object-to-Hand Correspondence for Motion Refinement

no code implementations16 May 2022 Keyang Zhou, Bharat Lal Bhatnagar, Jan Eric Lenssen, Gerard Pons-Moll

The core of our method are TOCH fields, a novel spatio-temporal representation for modeling correspondences between hands and objects during interaction.

Denoising Object +1

Quaternion Equivariant Capsule Networks for 3D Point Clouds

2 code implementations ECCV 2020 Yongheng Zhao, Tolga Birdal, Jan Eric Lenssen, Emanuele Menegatti, Leonidas Guibas, Federico Tombari

We present a 3D capsule module for processing point clouds that is equivariant to 3D rotations and translations, as well as invariant to permutations of the input points.

Pose Estimation

Deep Iterative Surface Normal Estimation

2 code implementations CVPR 2020 Jan Eric Lenssen, Christian Osendorfer, Jonathan Masci

This results in a state-of-the-art surface normal estimator that is robust to noise, outliers and point density variation, preserves sharp features through anisotropic kernels and equivariance through a local quaternion-based spatial transformer.

Deep Learning Surface Normal Estimation +1

Fast Graph Representation Learning with PyTorch Geometric

6 code implementations6 Mar 2019 Matthias Fey, Jan Eric Lenssen

We introduce PyTorch Geometric, a library for deep learning on irregularly structured input data such as graphs, point clouds and manifolds, built upon PyTorch.

Graph Classification Graph Representation Learning +2

Group Equivariant Capsule Networks

1 code implementation NeurIPS 2018 Jan Eric Lenssen, Matthias Fey, Pascal Libuschewski

We present group equivariant capsule networks, a framework to introduce guaranteed equivariance and invariance properties to the capsule network idea.

SplineCNN: Fast Geometric Deep Learning with Continuous B-Spline Kernels

5 code implementations CVPR 2018 Matthias Fey, Jan Eric Lenssen, Frank Weichert, Heinrich Müller

We present Spline-based Convolutional Neural Networks (SplineCNNs), a variant of deep neural networks for irregular structured and geometric input, e. g., graphs or meshes.

Deep Learning General Classification +3

Cannot find the paper you are looking for? You can Submit a new open access paper.