Search Results for author: Demetri Terzopoulos

Found 34 papers, 9 papers with code

Image Segmentation Using Deep Learning: A Survey

2 code implementations15 Jan 2020 Shervin Minaee, Yuri Boykov, Fatih Porikli, Antonio Plaza, Nasser Kehtarnavaz, Demetri Terzopoulos

Image segmentation is a key topic in image processing and computer vision with applications such as scene understanding, medical image analysis, robotic perception, video surveillance, augmented reality, and image compression, among many others.

Image Compression Image Segmentation +3

Agent AI: Surveying the Horizons of Multimodal Interaction

1 code implementation7 Jan 2024 Zane Durante, Qiuyuan Huang, Naoki Wake, Ran Gong, Jae Sung Park, Bidipta Sarkar, Rohan Taori, Yusuke Noda, Demetri Terzopoulos, Yejin Choi, Katsushi Ikeuchi, Hoi Vo, Li Fei-Fei, Jianfeng Gao

To accelerate research on agent-based multimodal intelligence, we define "Agent AI" as a class of interactive systems that can perceive visual stimuli, language inputs, and other environmentally-grounded data, and can produce meaningful embodied actions.

MultiMix: Sparingly Supervised, Extreme Multitask Learning From Medical Images

1 code implementation28 Oct 2020 Ayaan Haque, Abdullah-Al-Zubaer Imran, Adam Wang, Demetri Terzopoulos

Our extensive experimentation with varied quantities of labeled data in the training sets justify the effectiveness of our multitasking model for the classification of pneumonia and segmentation of lungs from chest X-ray images.

General Classification Segmentation

Deep Active Lesion Segmentation

1 code implementation19 Aug 2019 Ali Hatamizadeh, Assaf Hoogi, Debleena Sengupta, Wuyue Lu, Brian Wilcox, Daniel Rubin, Demetri Terzopoulos

Lesion segmentation is an important problem in computer-assisted diagnosis that remains challenging due to the prevalence of low contrast, irregular boundaries that are unamenable to shape priors.

Lesion Segmentation Segmentation

CAT-Net: A Cross-Slice Attention Transformer Model for Prostate Zonal Segmentation in MRI

1 code implementation29 Mar 2022 Alex Ling Yu Hung, Haoxin Zheng, Qi Miao, Steven S. Raman, Demetri Terzopoulos, Kyunghyun Sung

However, state-of-the-art automatic segmentation methods often fail to produce well-contained volumetric segmentation of the prostate zones since certain slices of prostate MRI, such as base and apex slices, are harder to segment than other slices.

Segmentation

A Location-Sensitive Local Prototype Network for Few-Shot Medical Image Segmentation

1 code implementation18 Mar 2021 Qinji Yu, Kang Dang, Nima Tajbakhsh, Demetri Terzopoulos, Xiaowei Ding

Despite the tremendous success of deep neural networks in medical image segmentation, they typically require a large amount of costly, expert-level annotated data.

Image Segmentation Medical Image Segmentation +3

CSAM: A 2.5D Cross-Slice Attention Module for Anisotropic Volumetric Medical Image Segmentation

1 code implementation8 Nov 2023 Alex Ling Yu Hung, Haoxin Zheng, Kai Zhao, Xiaoxi Du, Kaifeng Pang, Qi Miao, Steven S. Raman, Demetri Terzopoulos, Kyunghyun Sung

Both 3D and purely 2D deep learning-based segmentation methods are deficient in dealing with such volumetric data since the performance of 3D methods suffers when confronting anisotropic data, and 2D methods disregard crucial volumetric information.

Image Segmentation Semantic Segmentation +1

Attention-based Natural Language Person Retrieval

no code implementations24 May 2017 Tao Zhou, Muhao Chen, Jie Yu, Demetri Terzopoulos

Following the recent progress in image classification and captioning using deep learning, we develop a novel natural language person retrieval system based on an attention mechanism.

Image Classification Person Retrieval +2

Configurable 3D Scene Synthesis and 2D Image Rendering with Per-Pixel Ground Truth using Stochastic Grammars

no code implementations1 Apr 2017 Chenfanfu Jiang, Siyuan Qi, Yixin Zhu, Siyuan Huang, Jenny Lin, Lap-Fai Yu, Demetri Terzopoulos, Song-Chun Zhu

We propose a systematic learning-based approach to the generation of massive quantities of synthetic 3D scenes and arbitrary numbers of photorealistic 2D images thereof, with associated ground truth information, for the purposes of training, benchmarking, and diagnosing learning-based computer vision and robotics algorithms.

Benchmarking Object +2

Surrogate Supervision for Medical Image Analysis: Effective Deep Learning From Limited Quantities of Labeled Data

no code implementations25 Jan 2019 Nima Tajbakhsh, Yufei Hu, Junli Cao, Xingjian Yan, Yi Xiao, Yong Lu, Jianming Liang, Demetri Terzopoulos, Xiaowei Ding

We investigate the effectiveness of a simple solution to the common problem of deep learning in medical image analysis with limited quantities of labeled training data.

Colorization Transfer Learning

Inferring Forces and Learning Human Utilities From Videos

no code implementations CVPR 2016 Yixin Zhu, Chenfanfu Jiang, Yibiao Zhao, Demetri Terzopoulos, Song-Chun Zhu

We propose a notion of affordance that takes into account physical quantities generated when the human body interacts with real-world objects, and introduce a learning framework that incorporates the concept of human utilities, which in our opinion provides a deeper and finer-grained account not only of object affordance but also of people's interaction with objects.

Motion Planning Robot Task Planning

Deep Dilated Convolutional Nets for the Automatic Segmentation of Retinal Vessels

no code implementations28 May 2019 Ali Hatamizadeh, Hamid Hosseini, Zhengyuan Liu, Steven D. Schwartz, Demetri Terzopoulos

The reliable segmentation of retinal vasculature can provide the means to diagnose and monitor the progression of a variety of diseases affecting the blood vessel network, including diabetes and hypertension.

Retinal Vessel Segmentation Segmentation

Multi-Adversarial Variational Autoencoder Networks

no code implementations14 Jun 2019 Abdullah-Al-Zubaer Imran, Demetri Terzopoulos

The unsupervised training of GANs and VAEs has enabled them to generate realistic images mimicking real-world distributions and perform image-based unsupervised clustering or semi-supervised classification.

Clustering General Classification +2

Semi-Supervised Multi-Task Learning With Chest X-Ray Images

no code implementations10 Aug 2019 Abdullah-Al-Zubaer Imran, Demetri Terzopoulos

Discriminative models that require full supervision are inefficacious in the medical imaging domain when large labeled datasets are unavailable.

Multi-Task Learning Segmentation

End-to-End Boundary Aware Networks for Medical Image Segmentation

no code implementations21 Aug 2019 Ali Hatamizadeh, Demetri Terzopoulos, Andriy Myronenko

Fully convolutional neural networks (CNNs) have proven to be effective at representing and classifying textural information, thus transforming image intensity into output class masks that achieve semantic image segmentation.

Brain Tumor Segmentation Image Segmentation +2

End-to-End Deep Convolutional Active Contours for Image Segmentation

no code implementations29 Sep 2019 Ali Hatamizadeh, Debleena Sengupta, Demetri Terzopoulos

The Active Contour Model (ACM) is a standard image analysis technique whose numerous variants have attracted an enormous amount of research attention across multiple fields.

Image Segmentation Instance Segmentation +2

Analysis of Scoliosis From Spinal X-Ray Images

no code implementations15 Apr 2020 Abdullah-Al-Zubaer Imran, Chao Huang, Hui Tang, Wei Fan, Kenneth M. C. Cheung, Michael To, Zhen Qian, Demetri Terzopoulos

Leveraging a carefully-adjusted U-Net model with progressive side outputs, we propose an end-to-end segmentation model that provides a fully automatic and reliable segmentation of the vertebrae associated with scoliosis measurement.

Segmentation

Partly Supervised Multitask Learning

no code implementations5 May 2020 Abdullah-Al-Zubaer Imran, Chao Huang, Hui Tang, Wei Fan, Yuan Xiao, Dingjun Hao, Zhen Qian, Demetri Terzopoulos

Leveraging self-supervision and adversarial training, we propose a novel general purpose semi-supervised, multiple-task model---namely, self-supervised, semi-supervised, multitask learning (S$^4$MTL)---for accomplishing two important tasks in medical imaging, segmentation and diagnostic classification.

Medical Image Segmentation Segmentation

Progressive Adversarial Semantic Segmentation

no code implementations8 May 2020 Abdullah-Al-Zubaer Imran, Demetri Terzopoulos

Medical image computing has advanced rapidly with the advent of deep learning techniques such as convolutional neural networks.

Anatomy Image Segmentation +3

End-to-End Trainable Deep Active Contour Models for Automated Image Segmentation: Delineating Buildings in Aerial Imagery

no code implementations ECCV 2020 Ali Hatamizadeh, Debleena Sengupta, Demetri Terzopoulos

The automated segmentation of buildings in remote sensing imagery is a challenging task that requires the accurate delineation of multiple building instances over typically large image areas.

Image Segmentation Segmentation +1

Neuromuscular Control of the Face-Head-Neck Biomechanical Complex With Learning-Based Expression Transfer From Images and Videos

no code implementations12 Nov 2021 Xiao S. Zeng, Surya Dwarakanath, Wuyue Lu, Masaki Nakada, Demetri Terzopoulos

The success of our approach is demonstrated through experiments involving the transfer onto our face-head-neck model of facial expressions and head poses from a range of facial images and videos.

Anatomy

Semi-Supervised Relational Contrastive Learning

no code implementations11 Apr 2023 Attiano Purpura-Pontoniere, Demetri Terzopoulos, Adam Wang, Abdullah-Al-Zubaer Imran

Disease diagnosis from medical images via supervised learning is usually dependent on tedious, error-prone, and costly image labeling by medical experts.

Contrastive Learning Lesion Classification +2

MindAgent: Emergent Gaming Interaction

no code implementations18 Sep 2023 Ran Gong, Qiuyuan Huang, Xiaojian Ma, Hoi Vo, Zane Durante, Yusuke Noda, Zilong Zheng, Song-Chun Zhu, Demetri Terzopoulos, Li Fei-Fei, Jianfeng Gao

Large Language Models (LLMs) have the capacity of performing complex scheduling in a multi-agent system and can coordinate these agents into completing sophisticated tasks that require extensive collaboration.

In-Context Learning Scheduling

Aligner: One Global Token is Worth Millions of Parameters When Aligning Large Language Models

no code implementations9 Dec 2023 Zhou Ziheng, YingNian Wu, Song-Chun Zhu, Demetri Terzopoulos

We introduce Aligner, a novel Parameter-Efficient Fine-Tuning (PEFT) method for aligning multi-billion-parameter-sized Large Language Models (LLMs).

Instruction Following

Cannot find the paper you are looking for? You can Submit a new open access paper.