Search Results for author: Weifeng Ge

Found 21 papers, 11 papers with code

Weakly Supervised Gaussian Contrastive Grounding with Large Multimodal Models for Video Question Answering

no code implementations19 Jan 2024 Haibo Wang, Chenghang Lai, Yixuan Sun, Weifeng Ge

GCG learns multiple Gaussian functions to characterize the temporal structure of the video, and sample question-critical frames as positive moments to be the visual inputs of LMMs.

Question Answering Video Question Answering

Q&A Prompts: Discovering Rich Visual Clues through Mining Question-Answer Prompts for VQA requiring Diverse World Knowledge

no code implementations19 Jan 2024 Haibi Wang, Weifeng Ge

With the breakthrough of multi-modal large language models, answering complex visual questions that demand advanced reasoning abilities and world knowledge has become a much more important testbed for developing AI models than ever.

Question Answering Question Generation +4

Improving Empathetic Dialogue Generation by Dynamically Infusing Commonsense Knowledge

1 code implementation24 May 2023 Hua Cai, Xuli Shen, Qing Xu, Weilin Shen, Xiaomei Wang, Weifeng Ge, Xiaoqing Zheng, xiangyang xue

To this end, we propose a novel approach for empathetic response generation, which incorporates an adaptive module for commonsense knowledge selection to ensure consistency between the generated empathetic responses and the speaker's situation.

Dialogue Generation Empathetic Response Generation +1

Correspondence Transformers With Asymmetric Feature Learning and Matching Flow Super-Resolution

1 code implementation CVPR 2023 Yixuan Sun, Dongyang Zhao, Zhangyue Yin, Yiwen Huang, Tao Gui, Wenqiang Zhang, Weifeng Ge

The asymmetric feature learning module exploits a biased cross-attention mechanism to encode token features of source images with their target counterparts.

Super-Resolution

Weakly Supervised Learning of Semantic Correspondence through Cascaded Online Correspondence Refinement

1 code implementation ICCV 2023 Yiwen Huang, Yixuan Sun, Chenghang Lai, Qing Xu, Xiaomei Wang, Xuli Shen, Weifeng Ge

Following the spirit of multiple instance learning (MIL), we decompose the weakly supervised correspondence learning problem into three stages: image-level matching, region-level matching, and pixel-level matching.

Multiple Instance Learning Semantic correspondence +1

ColoristaNet for Photorealistic Video Style Transfer

no code implementations19 Dec 2022 Xiaowen Qiu, Ruize Xu, Boan He, Yingtao Zhang, Wenqiang Zhang, Weifeng Ge

The style removal network removes the original image styles, and the style restoration network recovers image styles in a supervised manner.

Optical Flow Estimation Style Transfer +1

RankDNN: Learning to Rank for Few-shot Learning

1 code implementation28 Nov 2022 Qianyu Guo, Hongtong Gong, Xujun Wei, Yanwei Fu, Weifeng Ge, Yizhou Yu, Wenqiang Zhang

This paper introduces a new few-shot learning pipeline that casts relevance ranking for image retrieval as binary ranking relation classification.

Few-Shot Learning Image Classification +4

Attribute Surrogates Learning and Spectral Tokens Pooling in Transformers for Few-shot Learning

1 code implementation CVPR 2022 Yangji He, Weihan Liang, Dongyang Zhao, Hong-Yu Zhou, Weifeng Ge, Yizhou Yu, Wenqiang Zhang

To improve data efficiency, we propose hierarchically cascaded transformers that exploit intrinsic image structures through spectral tokens pooling and optimize the learnable parameters through latent attribute surrogates.

Attribute Few-Shot Image Classification +2

GraphFPN: Graph Feature Pyramid Network for Object Detection

2 code implementations ICCV 2021 Gangming Zhao, Weifeng Ge, Yizhou Yu

State-of-the-art methods for multi-scale feature learning focus on performing feature interactions across space and scales using neural networks with a fixed topology.

Object object-detection +1

Multi-scale Matching Networks for Semantic Correspondence

1 code implementation ICCV 2021 Dongyang Zhao, Ziyang Song, Zhenghao Ji, Gangming Zhao, Weifeng Ge, Yizhou Yu

We follow the coarse-to-fine matching strategy and build a top-down feature and matching enhancement scheme that is coupled with the multi-scale hierarchy of deep convolutional neural networks.

Computational Efficiency Semantic correspondence

Image Super-Resolution via Deterministic-Stochastic Synthesis and Local Statistical Rectification

1 code implementation18 Sep 2018 Weifeng Ge, Bingchen Gong, Yizhou Yu

With respect to a downsampled low resolution image, we model a high resolution image as a combination of two components, a deterministic component and a stochastic component.

Image Super-Resolution regression

Borrowing Treasures from the Wealthy: Deep Transfer Learning through Selective Joint Fine-tuning

1 code implementation CVPR 2017 Weifeng Ge, Yizhou Yu

In this paper, we introduce a source-target selective joint fine-tuning scheme for improving the performance of deep learning tasks with insufficient training data.

General Classification Transfer Learning

Cannot find the paper you are looking for? You can Submit a new open access paper.