Search Results for author: Hani J. Marcus

Found 9 papers, 2 papers with code

SurgicalVLM-Agent: Towards an Interactive AI Co-Pilot for Pituitary Surgery

no code implementations12 Mar 2025 Jiayuan Huang, Runlong He, Danyal Z. Khan, Evangelos Mazomenos, Danail Stoyanov, Hani J. Marcus, Matthew J. Clarkson, Mobarakol Islam

Image-guided surgery demands adaptive, real-time decision support, yet static AI models struggle with structured task planning and providing interactive guidance.

Activity Recognition Anatomy +5

PitVQA++: Vector Matrix-Low-Rank Adaptation for Open-Ended Visual Question Answering in Pituitary Surgery

1 code implementation19 Feb 2025 Runlong He, Danyal Z. Khan, Evangelos B. Mazomenos, Hani J. Marcus, Danail Stoyanov, Matthew J. Clarkson, Mobarakol Islam

However, the development of VLMs for surgical VQA is challenging due to limited datasets and the risk of overfitting and catastrophic forgetting during full fine-tuning of pretrained weights.

Question Answering Visual Question Answering

PitRSDNet: Predicting Intra-operative Remaining Surgery Duration in Endoscopic Pituitary Surgery

no code implementations25 Sep 2024 Anjana Wijekoon, Adrito Das, Roxana R. Herrera, Danyal Z. Khan, John Hanrahan, Eleanor Carter, Valpuri Luoma, Danail Stoyanov, Hani J. Marcus, Sophia Bano

In endoscopic pituitary surgery, it is uniquely challenging due to variable workflow sequences with a selection of optional steps contributing to high variability in surgery duration.

Multi-Task Learning Scheduling

PitVQA: Image-grounded Text Embedding LLM for Visual Question Answering in Pituitary Surgery

1 code implementation22 May 2024 Runlong He, Mengya Xu, Adrito Das, Danyal Z. Khan, Sophia Bano, Hani J. Marcus, Danail Stoyanov, Matthew J. Clarkson, Mobarakol Islam

This paper introduces PitVQA, a novel dataset specifically designed for VQA in endonasal pituitary surgery and PitVQA-Net, an adaptation of the GPT2 with a novel image-grounded text embedding for surgical VQA.

Question Answering Visual Question Answering

Shifted-Windows Transformers for the Detection of Cerebral Aneurysms in Microsurgery

no code implementations16 Mar 2023 Jinfan Zhou, William Muirhead, Simon C. Williams, Danail Stoyanov, Hani J. Marcus, Evangelos B. Mazomenos

Automated recognition of instances when the aneurysm is exposed in the surgical video would be a valuable reference point for neuronavigation, indicating phase transitioning and more importantly designating moments of high risk for rupture.

Scene Understanding

Surgical Video Motion Magnification with Suppression of Instrument Artefacts

no code implementations16 Sep 2020 Mirek Janatka, Hani J. Marcus, Neil L. Dorward, Danail Stoyanov

Video motion magnification could directly highlight subsurface blood vessels in endoscopic video in order to prevent inadvertent damage and bleeding.

Motion Magnification SSIM

Cannot find the paper you are looking for? You can Submit a new open access paper.