Search Results for author: Zhiqiang Tao

Found 20 papers, 10 papers with code

Text Is MASS: Modeling as Stochastic Embedding for Text-Video Retrieval

1 code implementation26 Mar 2024 Jiamian Wang, Guohao Sun, Pichao Wang, Dongfang Liu, Sohail Dianat, Majid Rabbani, Raghuveer Rao, Zhiqiang Tao

Correspondingly, a single text embedding may be less expressive to capture the video embedding and empower the retrieval.

SQ-LLaVA: Self-Questioning for Large Vision-Language Assistant

no code implementations17 Mar 2024 Guohao Sun, Can Qin, Jiamian Wang, Zeyuan Chen, ran Xu, Zhiqiang Tao

Recent advancements in the vision-language model have shown notable generalization in vision-language tasks after visual instruction tuning.

Language Modelling Question Answering +2

Cooperative Hardware-Prompt Learning for Snapshot Compressive Imaging

no code implementations1 Jun 2023 Jiamian Wang, Zongliang Wu, Yulun Zhang, Xin Yuan, Tao Lin, Zhiqiang Tao

In this work, we tackle this challenge by marrying prompt tuning with FL to snapshot compressive imaging for the first time and propose an federated hardware-prompt learning (FedHP) method.

Federated Learning

Iterative Soft Shrinkage Learning for Efficient Image Super-Resolution

2 code implementations ICCV 2023 Jiamian Wang, Huan Wang, Yulun Zhang, Yun Fu, Zhiqiang Tao

Second, existing pruning methods generally operate upon a pre-trained network for the sparse structure determination, hard to get rid of dense model training in the traditional SR paradigm.

Image Super-Resolution Network Pruning

Parameter-Efficient Masking Networks

1 code implementation13 Oct 2022 Yue Bai, Huan Wang, Xu Ma, Yitian Zhang, Zhiqiang Tao, Yun Fu

We validate the potential of PEMN learning masks on random weights with limited unique values and test its effectiveness for a new compression paradigm based on different network architectures.

Model Compression

S^2-Transformer for Mask-Aware Hyperspectral Image Reconstruction

1 code implementation24 Sep 2022 Jiamian Wang, Kunpeng Li, Yulun Zhang, Xin Yuan, Zhiqiang Tao

By observing this physical encoding procedure, two major challenges stand in the way of a high-fidelity reconstruction.

Blocking Image Reconstruction

Dual Lottery Ticket Hypothesis

1 code implementation ICLR 2022 Yue Bai, Huan Wang, Zhiqiang Tao, Kunpeng Li, Yun Fu

In this work, we regard the winning ticket from LTH as the subnetwork which is in trainable condition and its performance as our benchmark, then go from a complementary direction to articulate the Dual Lottery Ticket Hypothesis (DLTH): Randomly selected subnetworks from a randomly initialized dense network can be transformed into a trainable condition and achieve admirable performance compared with LTH -- random tickets in a given lottery pool can be transformed into winning tickets.

Modeling Mask Uncertainty in Hyperspectral Image Reconstruction

1 code implementation31 Dec 2021 Jiamian Wang, Yulun Zhang, Xin Yuan, Ziyi Meng, Zhiqiang Tao

Recently, hyperspectral imaging (HSI) has attracted increasing research attention, especially for the ones based on a coded aperture snapshot spectral imaging (CASSI) system.

Bilevel Optimization Image Reconstruction

A NEW BACKBONE FOR HYPERSPECTRAL IMAGE RECONSTRUCTION

no code implementations29 Sep 2021 Jiamian Wang, Yulun Zhang, Xin Yuan, Yun Fu, Zhiqiang Tao

As the inverse process of snapshot compressive imaging, the hyperspectral image (HSI) reconstruction takes the 2D measurement as input and posteriorly retrieves the captured 3D spatial-spectral signal.

Computational Efficiency Image Reconstruction

A Simple and Efficient Reconstruction Backbone for Snapshot Compressive Imaging

1 code implementation17 Aug 2021 Jiamian Wang, Yulun Zhang, Xin Yuan, Yun Fu, Zhiqiang Tao

The emerging technology of snapshot compressive imaging (SCI) enables capturing high dimensional (HD) data in an efficient way.

Compressive Sensing Computational Efficiency +4

Automated Graph Learning via Population Based Self-Tuning GCN

no code implementations9 Jul 2021 Ronghang Zhu, Zhiqiang Tao, Yaliang Li, Sheng Li

Owing to the remarkable capability of extracting effective graph embeddings, graph convolutional network (GCN) and its variants have been successfully applied to a broad range of tasks, such as node classification, link prediction, and graph classification.

Graph Classification Graph Learning +3

Learning to Mutate with Hypergradient Guided Population

no code implementations NeurIPS 2020 Zhiqiang Tao, Yaliang Li, Bolin Ding, Ce Zhang, Jingren Zhou, Yun Fu

Computing the gradient of model hyperparameters, i. e., hypergradient, enables a promising and natural way to solve the hyperparameter optimization task.

Hyperparameter Optimization

Collaborative Attention Mechanism for Multi-View Action Recognition

no code implementations14 Sep 2020 Yue Bai, Zhiqiang Tao, Lichen Wang, Sheng Li, Yu Yin, Yun Fu

Extensive experiments on four action datasets illustrate the proposed CAM achieves better results for each view and also boosts multi-view performance.

Action Recognition Representation Learning

Learnable Subspace Clustering

1 code implementation9 Apr 2020 Jun Li, Hongfu Liu, Zhiqiang Tao, Handong Zhao, Yun Fu

This paper studies the large-scale subspace clustering (LSSC) problem with million data points.

Clustering

Generative Partial Multi-View Clustering

no code implementations29 Mar 2020 Qianqian Wang, Zhengming Ding, Zhiqiang Tao, Quanxue Gao, Yun Fu

Nowadays, with the rapid development of data collection sources and feature extraction methods, multi-view data are getting easy to obtain and have received increasing research attention in recent years, among which, multi-view clustering (MVC) forms a mainstream research direction and is widely used in data analysis.

Clustering Imputation

Automated Relational Meta-learning

1 code implementation ICLR 2020 Huaxiu Yao, Xian Wu, Zhiqiang Tao, Yaliang Li, Bolin Ding, Ruirui Li, Zhenhui Li

In order to efficiently learn with small amount of data on new tasks, meta-learning transfers knowledge learned from previous tasks to the new ones.

Few-Shot Image Classification Meta-Learning

Correlative Channel-Aware Fusion for Multi-View Time Series Classification

no code implementations24 Nov 2019 Yue Bai, Lichen Wang, Zhiqiang Tao, Sheng Li, Yun Fu

Multi-view time series classification (MVTSC) aims to improve the performance by fusing the distinctive temporal information from multiple views.

Classification General Classification +3

Consensus Clustering: An Embedding Perspective, Extension and Beyond

no code implementations31 May 2019 Hongfu Liu, Zhiqiang Tao, Zhengming Ding

Consensus clustering fuses diverse basic partitions (i. e., clustering results obtained from conventional clustering methods) into an integrated one, which has attracted increasing attention in both academic and industrial areas due to its robust and effective performance.

Constrained Clustering Domain Adaptation +3

Segmentation Guided Image-to-Image Translation with Adversarial Networks

1 code implementation6 Jan 2019 Songyao Jiang, Zhiqiang Tao, Yun Fu

Recently image-to-image translation has received increasing attention, which aims to map images in one domain to another specific one.

Image-to-Image Translation Segmentation +2

Deep Sequential Context Networks for Action Prediction

no code implementations CVPR 2017 Yu Kong, Zhiqiang Tao, Yun Fu

Different from after-the-fact action recognition, action prediction task requires action labels to be predicted from these partially observed videos.

Action Recognition Temporal Action Localization

Cannot find the paper you are looking for? You can Submit a new open access paper.