Search Results for author: Shuangrui Ding

Found 15 papers, 11 papers with code

Rethinking Image-to-Video Adaptation: An Object-centric Perspective

no code implementations9 Jul 2024 Rui Qian, Shuangrui Ding, Dahua Lin

Instead of finetuning the entire image backbone, many image-to-video adaptation paradigms use lightweight adapters for temporal modeling on top of the spatial module.

Action Recognition Object +7

Streaming Long Video Understanding with Large Language Models

no code implementations25 May 2024 Rui Qian, Xiaoyi Dong, Pan Zhang, Yuhang Zang, Shuangrui Ding, Dahua Lin, Jiaqi Wang

After the encoding process, the Adaptive Memory Selection strategy selects a constant number of question-related memories from all the historical memories and feeds them into the LLM to generate informative responses.

Question Answering Video Understanding

Semantics Meets Temporal Correspondence: Self-supervised Object-centric Learning in Videos

1 code implementation ICCV 2023 Rui Qian, Shuangrui Ding, Xian Liu, Dahua Lin

In the second stage, for each semantics, we randomly sample slots from the corresponding Gaussian distribution and perform masked feature aggregation within the semantic area to exploit temporal correspondence patterns for instance identification.

Object Object Discovery +1

Prune Spatio-temporal Tokens by Semantic-aware Temporal Accumulation

1 code implementation ICCV 2023 Shuangrui Ding, Peisen Zhao, Xiaopeng Zhang, Rui Qian, Hongkai Xiong, Qi Tian

Based on the STA score, we are able to progressively prune the tokens without introducing any additional parameters or requiring further re-training.

Video Recognition

Static and Dynamic Concepts for Self-supervised Video Representation Learning

1 code implementation26 Jul 2022 Rui Qian, Shuangrui Ding, Xian Liu, Dahua Lin

In this paper, we propose a novel learning scheme for self-supervised video representation learning.

Diversity Representation Learning +1

Dual Contrastive Learning for Spatio-temporal Representation

no code implementations12 Jul 2022 Shuangrui Ding, Rui Qian, Hongkai Xiong

In this way, the static scene and the dynamic motion are simultaneously encoded into the compact RGB representation.

Contrastive Learning Representation Learning

Masked Autoencoders are Robust Data Augmentors

1 code implementation10 Jun 2022 Haohang Xu, Shuangrui Ding, Xiaopeng Zhang, Hongkai Xiong, Qi Tian

Specifically, MRA consistently enhances the performance on supervised, semi-supervised as well as few-shot classification.

Image Augmentation Image Classification +1

Motion-aware Contrastive Video Representation Learning via Foreground-background Merging

1 code implementation CVPR 2022 Shuangrui Ding, Maomao Li, Tianyu Yang, Rui Qian, Haohang Xu, Qingyi Chen, Jue Wang, Hongkai Xiong

To alleviate such bias, we propose \textbf{F}oreground-b\textbf{a}ckground \textbf{Me}rging (FAME) to deliberately compose the moving foreground region of the selected video onto the static background of others.

Action Recognition Contrastive Learning +1

Towards More Practical Adversarial Attacks on Graph Neural Networks

2 code implementations NeurIPS 2020 Jiaqi Ma, Shuangrui Ding, Qiaozhu Mei

Our theoretical and empirical analyses suggest that there is a discrepancy between the loss and mis-classification rate, as the latter presents a diminishing-return pattern when the number of attacked nodes increases.

Classification General Classification

Cannot find the paper you are looking for? You can Submit a new open access paper.