Search Results for author: Hongyu Hu

Found 6 papers, 1 papers with code

Context-Aware Prompt Tuning for Vision-Language Model with Dual-Alignment

no code implementations8 Sep 2023 Hongyu Hu, Tiancheng Lin, Jie Wang, Zhenbang Sun, Yi Xu

To achieve this, we introduce a pre-trained LLM to generate context descriptions, and we encourage the prompts to learn from the LLM's knowledge by alignment, as well as the alignment between prompts and local image features.

Language Modelling Zero-Shot Learning

CIEM: Contrastive Instruction Evaluation Method for Better Instruction Tuning

no code implementations5 Sep 2023 Hongyu Hu, Jiyuan Zhang, Minyi Zhao, Zhenbang Sun

Nowadays, the research on Large Vision-Language Models (LVLMs) has been significantly promoted thanks to the success of Large Language Models (LLM).

Hallucination

Breast Lesion Diagnosis Using Static Images and Dynamic Video

no code implementations19 Aug 2023 Yunwen Huang, Hongyu Hu, Ying Zhu, Yi Xu

In this work, we propose a multi-modality breast tumor diagnosis model to imitate the diagnosing process of radiologists, which learns the features of both static images and dynamic video and explores the potential relationship between the two modalities.

Holistic Transformer: A Joint Neural Network for Trajectory Prediction and Decision-Making of Autonomous Vehicles

no code implementations17 Jun 2022 Hongyu Hu, Qi Wang, Zhengguang Zhang, Zhengyi Li, Zhenhai Gao

Trajectory prediction and behavioral decision-making are two important tasks for autonomous vehicles that require good understanding of the environmental context; behavioral decisions are better made by referring to the outputs of trajectory predictions.

Autonomous Vehicles Decision Making +2

Cannot find the paper you are looking for? You can Submit a new open access paper.