Search Results for author:
Found 11 papers, 6 papers with code
OCTCube-M: A 3D multimodal optical coherence tomography foundation model for retinal and systemic diseases with cross-cohort and cross-device validation
It then exploits a novel multi-modal contrastive learning framework COEP to integrate other retinal imaging modalities, such as fundus autofluorescence and infrared retinal imaging, into OCTCube, efficiently extending it into multi-modal foundation models.
Panacea: A foundation model for clinical trial search, summarization, design, and recruitment
To address this challenge, we propose a clinical trial foundation model named Panacea, designed to handle multiple tasks, including trial search, trial summarization, trial design, and patient-trial matching.
Towards a clinically accessible radiology foundation model: open-access and lightweight, with automated evaluation
Frontier general-domain models such as GPT-4V still have significant performance gaps in multimodal biomedical applications.
T-Rex: Text-assisted Retrosynthesis Prediction
As a fundamental task in computational chemistry, retrosynthesis prediction aims to identify a set of reactants to synthesize a target molecule.
When an Image is Worth 1,024 x 1,024 Words: A Case Study in Computational Pathology
This technical report presents LongViT, a vision Transformer that can process gigapixel images in an end-to-end manner.
Towards Large-scale Single-shot Millimeter-wave Imaging for Low-cost Security Inspection
These elements are then sampled based on the ranking, building the experimentally optimal sparse sampling strategy that reduces the cost of antenna array by up to one order of magnitude.
BiomedCLIP: a multimodal biomedical foundation model pretrained from fifteen million scientific image-text pairs
Therefore, training an effective generalist biomedical model requires high-quality multimodal data, such as parallel image-text pairs.
Ranked #2 on
Medical Visual Question Answering
on SLAKE-English
Large-scale Global Low-rank Optimization for Computational Compressed Imaging
However, the computational cost has inhibited NLR from seeking global structural similarity, which consequentially keeps it trapped in the tradeoff between accuracy and efficiency and prevents it from high-dimensional large-scale tasks.
MetaFill: Text Infilling for Meta-Path Generation on Heterogeneous Information Networks
Meta-path, a sequence of node types and edge types, is the core technique to embed HINs.
ProTranslator: zero-shot protein function prediction using textual description
Here, we tackle this problem by annotating proteins to a function only based on its textual description so that we do not need to know any associated proteins for this function.
GraphPrompt: Graph-Based Prompt Templates for Biomedical Synonym Prediction
In the expansion of biomedical dataset, the same category may be labeled with different terms, thus being tedious and onerous to curate these terms.
