Search Results for author: Bin Yan

Found 45 papers, 16 papers with code

Aligned with LLM: a new multi-modal training paradigm for encoding fMRI activity in visual cortex

no code implementations8 Jan 2024 Shuxiao Ma, Linyuan Wang, Senbao Hou, Bin Yan

Next, we use the contrast loss function to minimize the distance between the image embedding features and the text embedding features to complete the alignment operation of the stimulus image and text information.


A Multimodal Visual Encoding Model Aided by Introducing Verbal Semantic Information

no code implementations29 Aug 2023 Shuxiao Ma, Linyuan Wang, Bin Yan

A convolutional network then maps from this multimodal feature space to voxel space, constructing the multimodal visual information encoding network model.

Image Generation

Exploring Transformers for Open-world Instance Segmentation

no code implementations ICCV 2023 Jiannan Wu, Yi Jiang, Bin Yan, Huchuan Lu, Zehuan Yuan, Ping Luo

Open-world instance segmentation is a rising task, which aims to segment all objects in the image by learning from a limited number of base-category objects.

Contrastive Learning Open-World Instance Segmentation +1

RF-GNN: Random Forest Boosted Graph Neural Network for Social Bot Detection

1 code implementation14 Apr 2023 Shuhao Shi, Kai Qiao, Jie Yang, Baojie Song, Jian Chen, Bin Yan

This paper proposes a Random Forest boosted Graph Neural Network for social bot detection, called RF-GNN, which employs graph neural networks (GNNs) as the base classifiers to construct a random forest, effectively combining the advantages of ensemble learning and GNNs to improve the accuracy and robustness of the model.

Ensemble Learning feature selection +1

Universal Instance Perception as Object Discovery and Retrieval

1 code implementation CVPR 2023 Bin Yan, Yi Jiang, Jiannan Wu, Dong Wang, Ping Luo, Zehuan Yuan, Huchuan Lu

All instance perception tasks aim at finding certain objects specified by some queries such as category names, language expressions, and target annotations, but this complete field has been split into multiple independent subtasks.

 Ranked #1 on Referring Expression Segmentation on RefCoCo val (using extra training data)

Described Object Detection Generalized Referring Expression Comprehension +15

Over-Sampling Strategy in Feature Space for Graphs based Class-imbalanced Bot Detection

1 code implementation14 Feb 2023 Shuhao Shi, Kai Qiao, Jie Yang, Baojie Song, Jian Chen, Bin Yan

The proposed framework is evaluated using three real-world bot detection benchmark datasets, and it consistently exhibits superiority over the baselines.

MGTAB: A Multi-Relational Graph-Based Twitter Account Detection Benchmark

1 code implementation3 Jan 2023 Shuhao Shi, Kai Qiao, Jian Chen, Shuai Yang, Jie Yang, Baojie Song, Linyuan Wang, Bin Yan

However, in addition to low annotation quality, existing benchmarks generally have incomplete user relationships, suppressing graph-based account detection research.

Node Classification Stance Detection +1

Segment Every Reference Object in Spatial and Temporal Spaces

no code implementations ICCV 2023 Jiannan Wu, Yi Jiang, Bin Yan, Huchuan Lu, Zehuan Yuan, Ping Luo

In this work, we end the current fragmented situation and propose UniRef to unify the three reference-based object segmentation tasks with a single architecture.

Image Segmentation Object +5

Towards Grand Unification of Object Tracking

1 code implementation14 Jul 2022 Bin Yan, Yi Jiang, Peize Sun, Dong Wang, Zehuan Yuan, Ping Luo, Huchuan Lu

We present a unified method, termed Unicorn, that can simultaneously solve four tracking problems (SOT, MOT, VOS, MOTS) with a single network using the same model parameters.

Multi-Object Tracking Multi-Object Tracking and Segmentation +3

Select and Calibrate the Low-confidence: Dual-Channel Consistency based Graph Convolutional Networks

no code implementations8 May 2022 Shuhao Shi, Jian Chen, Kai Qiao, Shuai Yang, Linyuan Wang, Bin Yan

The Graph Convolutional Networks (GCNs) have achieved excellent results in node classification tasks, but the model's performance at low label rates is still unsatisfactory.

Node Classification

High-Performance Transformer Tracking

1 code implementation25 Mar 2022 Xin Chen, Bin Yan, Jiawen Zhu, Huchuan Lu, Xiang Ruan, Dong Wang

First, we present a transformer tracking (named TransT) method based on the Siamese-like feature extraction backbone, the designed attention-based fusion mechanism, and the classification and regression head.

Vocal Bursts Intensity Prediction

The Diversity Metrics of Sub-models based on SVD of Jacobians for Ensembles Adversarial Robustness

no code implementations AAAI Workshop AdvML 2022 Ruoxi Qin, Linyuan Wang, Xuehui Du, Bin Yan, Xingyuan Chen

A new constraints norm is proposed in model training based on these criteria to isolate adversarial transferability without any prior knowledge of adversarial samples.

Adversarial Robustness Attribute +2

Adaptive Multi-layer Contrastive Graph Neural Networks

no code implementations29 Sep 2021 Shuhao Shi, Pengfei Xie, Xu Luo, Kai Qiao, Linyuan Wang, Jian Chen, Bin Yan

AMC-GNN generates two graph views by data augmentation and compares different layers' output embeddings of Graph Neural Network encoders to obtain feature representations, which could be used for downstream tasks.

Data Augmentation Self-Supervised Learning

Improving the Transferability of Adversarial Examples with New Iteration Framework and Input Dropout

no code implementations3 Jun 2021 Pengfei Xie, Linyuan Wang, Ruoxi Qin, Kai Qiao, Shuhao Shi, Guoen Hu, Bin Yan

In this paper, we propose a new gradient iteration framework, which redefines the relationship between the above three.

Boosting-GNN: Boosting Algorithm for Graph Networks on Imbalanced Node Classification

no code implementations25 May 2021 S. Shi, Kai Qiao, Shuai Yang, L. Wang, J. Chen, Bin Yan

Traditional methods such as resampling, reweighting, and synthetic samples that deal with imbalanced datasets are no longer applicable in GNN.

Ensemble Learning Node Classification +1

Dynamic Defense Approach for Adversarial Robustness in Deep Neural Networks via Stochastic Ensemble Smoothed Model

no code implementations6 May 2021 Ruoxi Qin, Linyuan Wang, Xingyuan Chen, Xuehui Du, Bin Yan

The defense strategies are particularly passive in these processes, and enhancing initiative of such strategies can be an effective way to get out of this arms race.

Adversarial Robustness Attribute

Transformer Tracking

1 code implementation CVPR 2021 Xin Chen, Bin Yan, Jiawen Zhu, Dong Wang, Xiaoyun Yang, Huchuan Lu

The correlation operation is a simple fusion manner to consider the similarity between the template and the search region.

Visual Object Tracking Visual Tracking

Charged Lepton Flavor Violation at the EIC

no code implementations11 Feb 2021 Vincenzo Cirigliano, Kaori Fuyuto, Christopher Lee, Emanuele Mereghetti, Bin Yan

We present a comprehensive analysis of the potential sensitivity of the Electron-Ion Collider (EIC) to charged lepton flavor violation (CLFV) in the channel $ep\to \tau X$, within the model-independent framework of the Standard Model Effective Field Theory (SMEFT).

High Energy Physics - Phenomenology High Energy Physics - Experiment Nuclear Experiment Nuclear Theory

The anomalous $Zb\bar{b}$ couplings: From LEP to LHC

no code implementations15 Jan 2021 Bin Yan, C. -P. Yuan

We demonstrate that the $Zh$ data collected at the 13 TeV LHC can already resolve the apparent degeneracy of the anomalous $Zb\bar{b}$ couplings implied by the LEP precision electroweak measurements, with a strong dependence on the observed distribution of the $Z$ boson transverse momentum.

High Energy Physics - Phenomenology High Energy Physics - Experiment

Energy storage and coherence in closed and open quantum batteries

no code implementations30 Dec 2020 Francesco Caravelli, Bin Yan, Luis Pedro Garcia-Pintos, Alioscia Hamma

We study the role of coherence in closed and open quantum batteries.

Quantum Physics Other Condensed Matter

Nonadiabatic Phase Transition with Broken Chiral Symmetry

no code implementations14 Dec 2020 Bin Yan, Vladimir Y. Chernyak, Wojciech H. Zurek, Nikolai A. Sinitsyn

We explore nonadiabatic quantum phase transitions in an Ising spin chain with a linearly time-dependent transverse field and two different spins per unit cell.

Statistical Mechanics General Relativity and Quantum Cosmology High Energy Physics - Theory Quantum Physics

Alpha-Refine: Boosting Tracking Performance by Precise Bounding Box Estimation

1 code implementation4 Jul 2020 Bin Yan, Dong Wang, Huchuan Lu, Xiaoyun Yang

In recent years, the multiple-stage strategy has become a popular trend for visual tracking.

Visual Tracking

Neural encoding and interpretation for high-level visual cortices based on fMRI using image caption features

no code implementations26 Mar 2020 Kai Qiao, Chi Zhang, Jian Chen, Linyuan Wang, Li Tong, Bin Yan

Except for deep network structure, the task or corresponding big dataset is also important for deep network models, but neglected by previous studies.

General Classification Image Classification

Cooling-Shrinking Attack: Blinding the Tracker with Imperceptible Noises

1 code implementation CVPR 2020 Bin Yan, Dong Wang, Huchuan Lu, Xiaoyun Yang

An effective and efficient perturbation generator is trained with a carefully designed adversarial loss, which can simultaneously cool hot regions where the target exists on the heatmaps and force the predicted bounding box to shrink, making the tracked target invisible to trackers.

Adversarial Attack

BigGAN-based Bayesian reconstruction of natural images from human brain activity

no code implementations13 Mar 2020 Kai Qiao, Jian Chen, Linyuan Wang, Chi Zhang, Li Tong, Bin Yan

In this study, we proposed a new GAN-based Bayesian visual reconstruction method (GAN-BVRM) that includes a classifier to decode categories from fMRI data, a pre-trained conditional generator to generate natural images of specified categories, and a set of encoding models and evaluator to evaluate generated images.

Conditional Image Generation Generative Adversarial Network

AdvJND: Generating Adversarial Examples with Just Noticeable Difference

no code implementations1 Feb 2020 Zifei Zhang, Kai Qiao, Lingyun Jiang, Linyuan Wang, Bin Yan

To alleviate the tradeoff between the attack success rate and image fidelity, we propose a method named AdvJND, adding visual model coefficients, just noticeable difference coefficients, in the constraint of a distortion function when generating adversarial examples.

Image Classification

'Skimming-Perusal' Tracking: A Framework for Real-Time and Robust Long-term Tracking

1 code implementation ICCV 2019 Bin Yan, Haojie Zhao, Dong Wang, Huchuan Lu, Xiaoyun Yang

In this work, we present a novel robust and real-time long-term tracking framework based on the proposed skimming and perusal modules.

Effective and efficient ROI-wise visual encoding using an end-to-end CNN regression model and selective optimization

1 code implementation27 Jul 2019 Kai Qiao, Chi Zhang, Jian Chen, Linyuan Wang, Li Tong, Bin Yan

Recently, visual encoding based on functional magnetic resonance imaging (fMRI) have realized many achievements with the rapid development of deep network computation.


Cycle-Consistent Adversarial GAN: the integration of adversarial attack and defense

no code implementations12 Apr 2019 Lingyun Jiang, Kai Qiao, Ruoxi Qin, Linyuan Wang, Jian Chen, Haibing Bu, Bin Yan

In image classification of deep learning, adversarial examples where inputs intended to add small magnitude perturbations may mislead deep neural networks (DNNs) to incorrect results, which means DNNs are vulnerable to them.

Adversarial Attack Image Classification

Category decoding of visual stimuli from human brain activity using a bidirectional recurrent neural network to simulate bidirectional information flows in human visual cortices

no code implementations19 Mar 2019 Kai Qiao, Jian Chen, Linyuan Wang, Chi Zhang, Lei Zeng, Li Tong, Bin Yan

Despite the hierarchically similar representations of deep network and human vision, visual information flows from primary visual cortices to high visual cortices and vice versa based on the bottom-up and top-down manners, respectively.

Neurons and Cognition

A Sinogram Inpainting Method based on Generative Adversarial Network for Limited-angle Computed Tomography

no code implementations10 Mar 2019 Ziheng Li, Wenkun Zhang, Linyuan Wang, Ailong Cai, Ningning Liang, Bin Yan, Lei LI

Limited-angle computed tomography (CT) image reconstruction is a challenging reconstruction problem in the fields of CT. With the development of deep learning, the generative adversarial network (GAN) perform well in image restoration by approximating the distribution of training sample data.

Medical Physics

A visual encoding model based on deep neural networks and transfer learning

no code implementations23 Feb 2019 Chi Zhang, Kai Qiao, Linyuan Wang, Li Tong, Guoen Hu, Ruyuan Zhang, Bin Yan

In this framework, we employ the transfer learning technique to incorporate a pre-trained DNN (i. e., AlexNet) and train a nonlinear mapping from visual features to brain activity.

Transfer Learning

Dissociable neural representations of adversarially perturbed images in convolutional neural networks and the human brain

no code implementations22 Dec 2018 Chi Zhang, Xiaohan Duan, Linyuan Wang, Yongli Li, Bin Yan, Guoen Hu, Ruyuan Zhang, Li Tong

Furthermore, we show that voxel-encoding models trained on regular images can successfully generalize to the neural responses to AI images but not AN images.

Constraint-free Natural Image Reconstruction from fMRI Signals Based on Convolutional Neural Network

no code implementations16 Jan 2018 Chi Zhang, Kai Qiao, Linyuan Wang, Li Tong, Ying Zeng, Bin Yan

Without semantic prior information, we present a novel method to reconstruct nature images from fMRI signals of human visual cortex based on the computation model of convolutional neural network (CNN).

Image Reconstruction

Accurate reconstruction of image stimuli from human fMRI based on the decoding model with capsule network architecture

no code implementations2 Jan 2018 Kai Qiao, Chi Zhang, Linyuan Wang, Bin Yan, Jian Chen, Lei Zeng, Li Tong

We firstly employed the CapsNet to train the nonlinear mapping from image stimuli to high-level capsule features, and from high-level capsule features to image stimuli again in an end-to-end manner.

Open-Ended Question Answering SSIM

Image Prediction for Limited-angle Tomography via Deep Learning with Convolutional Neural Network

no code implementations29 Jul 2016 Hanming Zhang, Liang Li, Kai Qiao, Linyuan Wang, Bin Yan, Lei LI, Guoen Hu

The qualitative and quantitative evaluations of experimental results indicate that the proposed method show a stable and prospective performance on artifacts reduction and detail recovery for limited angle tomography.

Computed Tomography (CT)

Cannot find the paper you are looking for? You can Submit a new open access paper.