Action Triplet Recognition
8 papers with code • 6 benchmarks • 4 datasets
Recognising action as a triplet of subject verb and object. Example HOI = Human Object Interaction, Surgical IVT = Instrument Verb Target, etc.
Benchmarks
These leaderboards are used to track progress in Action Triplet Recognition
| Trend | Dataset | Best Model | Paper | Code | Compare |
|---|---|---|---|---|---|
|
|||||
|
|||||
|
|||||
|
|||||
|
|||||
|
Libraries
Use these libraries to find Action Triplet Recognition models and implementations
CholecT50
CholecT45
CholecT40
PETRAW
Most implemented papers
Benchmarking Deep Reinforcement Learning for Continuous Control
rllab/rllab
•
•
Recently, researchers have made significant progress combining the advances in deep learning for learning feature representations with reinforcement learning.
Rendezvous: Attention Mechanisms for the Recognition of Surgical Action Triplets in Endoscopic Videos
To achieve this task, we introduce our new model, the Rendezvous (RDV), which recognizes triplets directly from surgical videos by leveraging attention at two different levels.
Data Splits and Metrics for Method Benchmarking on Surgical Action Triplet Datasets
We also develop a metrics library, ivtmetrics, for model evaluation on surgical triplets.
CholecTriplet2021: A benchmark challenge for surgical action triplet recognition
In this paper, we present the challenge setup and assessment of the state-of-the-art deep learning methods proposed by the participants during the challenge.
Recognition of Instrument-Tissue Interactions in Endoscopic Videos via Action Triplets
Recognition of surgical activity is an essential component to develop context-aware decision support for the operating room.
CholecTriplet2022: Show me a tool and tell me the triplet -- an endoscopic vision challenge for surgical action triplet detection
This paper presents the CholecTriplet2022 challenge, which extends surgical action triplet modeling from recognition to detection.
Dissecting Self-Supervised Learning Methods for Surgical Computer Vision
Correct transfer of these methods to surgery, as described and conducted in this work, leads to substantial performance gains over generic uses of SSL - up to 7. 4% on phase recognition and 20% on tool presence detection - as well as state-of-the-art semi-supervised phase recognition approaches by up to 14%.
Rendezvous in Time: An Attention-based Temporal Fusion approach for Surgical Triplet Recognition
camma-public/rendezvous-in-time
•
•
Focusing more on the verbs, our RiT explores the connectedness of current and past frames to learn temporal attention-based features for enhanced triplet recognition.
