BKinD-3D: Self-Supervised 3D Keypoint Discovery from Multi-View Videos

1 code implementation • CVPR 2023 • Jennifer J. Sun, Lili Karashchuk, Amil Dravid, Serim Ryou, Sonia Fereidooni, John Tuthill, Aggelos Katsaggelos, Bingni W. Brunton, Georgia Gkioxari, Ann Kennedy, Yisong Yue, Pietro Perona

In this way, we discover keypoints without requiring manual supervision in videos of humans and rats, demonstrating the potential of 3D keypoint discovery for studying behavior.

Self-Supervised Keypoint Discovery in Behavioral Videos

1 code implementation • CVPR 2022 • Jennifer J. Sun, Serim Ryou, Roni Goldshmid, Brandon Weissbourd, John Dabiri, David J. Anderson, Ann Kennedy, Yisong Yue, Pietro Perona

We propose a method for learning the posture and structure of agents from unlabelled behavioral videos.

Unsupervised Human Pose Estimation

Weakly Supervised Keypoint Discovery

no code implementations • 28 Sep 2021 • Serim Ryou, Pietro Perona

In this paper, we propose a method for keypoint discovery from a 2D image using image-level supervision.

Conditional Image Generation Keypoint Estimation +1

Graph Neural Networks for the Prediction of Substrate-Specific Organic Reaction Conditions

1 code implementation • 8 Jul 2020 • Serim Ryou, Michael R. Maser, Alexander Y. Cui, Travis J. DeLano, Yisong Yue, Sarah E. Reisman

We present a systematic investigation using graph neural networks (GNNs) to model organic chemical reactions.

BIG-bench Machine Learning

Anchor Loss: Modulating Loss Scale based on Prediction Difficulty

1 code implementation • ICCV 2019 • Serim Ryou, Seong-Gyun Jeong, Pietro Perona

We propose a novel loss function that dynamically rescales the cross entropy based on prediction difficulty regarding a sample.

General Classification Image Classification +1