Search Results for author: Yao Rong

Found 20 papers, 11 papers with code

State Space Model for New-Generation Network Alternative to Transformers: A Survey

1 code implementation15 Apr 2024 Xiao Wang, Shiao Wang, Yuhe Ding, Yuehang Li, Wentao Wu, Yao Rong, Weizhe Kong, Ju Huang, Shihao Li, Haoxiang Yang, Ziwen Wang, Bo Jiang, Chenglong Li, YaoWei Wang, Yonghong Tian, Jin Tang

In this paper, we give the first comprehensive review of these works and also provide experimental comparisons and analysis to better demonstrate the features and advantages of SSM.

A Transformer-Based Model for the Prediction of Human Gaze Behavior on Videos

no code implementations10 Apr 2024 Suleyman Ozdel, Yao Rong, Berat Mert Albaba, Yen-Ling Kuo, Xi Wang

Eye-tracking applications that utilize the human gaze in video understanding tasks have become increasingly important.

Activity Recognition Gaze Prediction +1

Gaze-Guided Graph Neural Network for Action Anticipation Conditioned on Intention

no code implementations10 Apr 2024 Suleyman Ozdel, Yao Rong, Berat Mert Albaba, Yen-Ling Kuo, Xi Wang

We introduce the Gaze-guided Action Anticipation algorithm, which establishes a visual-semantic graph from the video input.

Action Anticipation Intent Detection +1

Stepwise Self-Consistent Mathematical Reasoning with Large Language Models

1 code implementation24 Feb 2024 Zilong Zhao, Yao Rong, Dongyang Guo, Emek Gözlüklü, Emir Gülboy, Enkelejda Kasneci

SSC-CoT employs a strategy of selecting intermediate steps based on the intersection of various reasoning chains.

Math Mathematical Reasoning

I-CEE: Tailoring Explanations of Image Classification Models to User Expertise

1 code implementation19 Dec 2023 Yao Rong, Peizhu Qian, Vaibhav Unhelkar, Enkelejda Kasneci

Informed by existing work, I-CEE explains the decisions of image classification models by providing the user with an informative subset of training data (i. e., example images), corresponding local explanations, and model decisions.

Image Classification Informativeness

Unleashing the Power of CNN and Transformer for Balanced RGB-Event Video Recognition

1 code implementation18 Dec 2023 Xiao Wang, Yao Rong, Shiao Wang, Yuan Chen, Zhe Wu, Bo Jiang, Yonghong Tian, Jin Tang

It is intuitive to combine them for high-performance RGB-Event based video recognition, however, existing works fail to achieve a good balance between the accuracy and model parameters, as shown in Fig.~\ref{firstimage}.

Video Recognition

SSTFormer: Bridging Spiking Neural Network and Memory Support Transformer for Frame-Event based Recognition

1 code implementation8 Aug 2023 Xiao Wang, Zongzhen Wu, Yao Rong, Lin Zhu, Bo Jiang, Jin Tang, Yonghong Tian

Secondly, they adopt either Spiking Neural Networks (SNN) for energy-efficient recognition with suboptimal results, or Artificial Neural Networks (ANN) for energy-intensive, high-performance recognition.

Efficient GNN Explanation via Learning Removal-based Attribution

no code implementations9 Jun 2023 Yao Rong, Guanchu Wang, Qizhang Feng, Ninghao Liu, Zirui Liu, Enkelejda Kasneci, Xia Hu

A strategy of subgraph sampling is designed in LARA to improve the scalability of the training process.

DynStatF: An Efficient Feature Fusion Strategy for LiDAR 3D Object Detection

no code implementations24 May 2023 Yao Rong, Xiangyu Wei, Tianwei Lin, Yueyu Wang, Enkelejda Kasneci

In this work, we propose a novel feature fusion strategy, DynStaF (Dynamic-Static Fusion), which enhances the rich semantic information provided by the multi-frame (dynamic branch) with the accurate location information from the current single-frame (static branch).

3D Object Detection object-detection

When are Post-hoc Conceptual Explanations Identifiable?

1 code implementation28 Jun 2022 Tobias Leemann, Michael Kirchhof, Yao Rong, Enkelejda Kasneci, Gjergji Kasneci

Interest in understanding and factorizing learned embedding spaces through conceptual explanations is steadily growing.

Disentanglement

Where and What: Driver Attention-based Object Detection

2 code implementations26 Apr 2022 Yao Rong, Naemi-Rebecca Kassautzki, Wolfgang Fuhl, Enkelejda Kasneci

Human drivers use their attentional mechanisms to focus on critical objects and make decisions while driving.

Autonomous Driving Object +2

A Consistent and Efficient Evaluation Strategy for Attribution Methods

1 code implementation1 Feb 2022 Yao Rong, Tobias Leemann, Vadim Borisov, Gjergji Kasneci, Enkelejda Kasneci

With a variety of local feature attribution methods being proposed in recent years, follow-up work suggested several evaluation strategies.

Human Attention in Fine-grained Classification

1 code implementation2 Nov 2021 Yao Rong, Wenjia Xu, Zeynep Akata, Enkelejda Kasneci

The way humans attend to, process and classify a given image has the potential to vastly benefit the performance of deep learning models.

Classification Decision Making +1

Artificial Intelligence Methods in In-Cabin Use Cases: A Survey

no code implementations6 Jan 2021 Yao Rong, Chao Han, Christian Hellert, Antje Loyal, Enkelejda Kasneci

As interest in autonomous driving increases, efforts are being made to meet requirements for the high-level automation of vehicles.

Autonomous Driving

Explainable Online Validation of Machine Learning Models for Practical Applications

no code implementations2 Oct 2020 Wolfgang Fuhl, Yao Rong, Thomas Motz, Michael Scheidt, Andreas Hartel, Andreas Koch, Enkelejda Kasneci

The presented algorithm based on conditional probabilities is also online capable and requires only a fraction of memory compared to the kNN algorithm.

BIG-bench Machine Learning General Classification +1

DriverMHG: A Multi-Modal Dataset for Dynamic Recognition of Driver Micro Hand Gestures and a Real-Time Recognition Framework

no code implementations2 Mar 2020 Okan Köpüklü, Thomas Ledwon, Yao Rong, Neslihan Kose, Gerhard Rigoll

In this work, we propose an HCI system for dynamic recognition of driver micro hand gestures, which can have a crucial impact in automotive sector especially for safety related issues.

Talking With Your Hands: Scaling Hand Gestures and Recognition With CNNs

no code implementations10 May 2019 Okan Köpüklü, Yao Rong, Gerhard Rigoll

The use of hand gestures provides a natural alternative to cumbersome interface devices for Human-Computer Interaction (HCI) systems.

Cannot find the paper you are looking for? You can Submit a new open access paper.