Deep Attention

37 papers with code • 0 benchmarks • 2 datasets

This task has no description! Would you like to contribute one?

Restoring Snow-Degraded Single Images With Wavelet in Vision Transformer

WINS-lab/WiT IEEE Access 2023

In our experiments, we evaluated the performance of our model on the popular SRRS, SNOW100K, and CSD datasets, respectively.

5
11 Sep 2023

Deep Attention Q-Network for Personalized Treatment Recommendation

stevenmsm/rl-icu-daqn 4 Jul 2023

Tailoring treatment for individual patients is crucial yet challenging in order to achieve optimal healthcare outcomes.

1
04 Jul 2023

Towards Deep Attention in Graph Neural Networks: Problems and Remedies

syleeheal/aero-gnn 4 Jun 2023

AERO-GNN provably mitigates the proposed problems of deep graph attention, which is further empirically demonstrated with (a) its adaptive and less smooth attention functions and (b) higher performance at deep layers (up to 64).

21
04 Jun 2023

AIA: Attention in Attention Within Collaborate Domains

zhangle408/AIA-Attention-in-Attention- Pattern Recognition and Computer Vision 2022

Attention mechanisms can effectively improve the performance of the mobile networks with a limited computational complexity cost.

3
07 Oct 2022

Open-CyKG: An Open Cyber Threat Intelligence Knowledge Graph

IS5882/Open-CyKG Knowledge-Based Systems 2021

Instant analysis of cybersecurity reports is a fundamental challenge for security experts as an immeasurable amount of cyber information is generated on a daily basis, which necessitates automated information extraction tools to facilitate querying and retrieval of data.

63
05 Dec 2021

Deep Attention-guided Graph Clustering with Dual Self-supervision

zhihaopeng-cityu/dagc 10 Nov 2021

Existing deep embedding clustering works only consider the deepest layer to learn a feature embedding and thus fail to well utilize the available discriminative information from cluster assignments, resulting performance limitation.

12
10 Nov 2021

Label Cleaning Multiple Instance Learning: Refining Coarse Annotations on Single Whole-Slide Images

sulam-group/mil-pathology 22 Sep 2021

Annotating cancerous regions in whole-slide images (WSIs) of pathology samples plays a critical role in clinical diagnosis, biomedical research, and machine learning algorithms development.

11
22 Sep 2021

Thermal Image Super-Resolution Using Second-Order Channel Attention with Varying Receptive Fields

robotic-vision-lab/Attention-With-Varying-Receptive-Fields-Network 30 Jul 2021

Specifically, we explore how to effectively attend to contrasting receptive fields (RFs) where increasing the RFs of a network can be computationally expensive.

4
30 Jul 2021

Grid Partitioned Attention: Efficient TransformerApproximation with Inductive Bias for High Resolution Detail Generation

zalandoresearch/gpa 8 Jul 2021

Attention is a general reasoning mechanism than can flexibly deal with image information, but its memory requirements had made it so far impractical for high resolution image generation.

5
08 Jul 2021

HIT: A Hierarchically Fused Deep Attention Network for Robust Code-mixed Language Representation

LCS2-IIITD/HIT-ACL2021-Codemixed-Representation 30 May 2021

In this paper, we propose HIT, a robust representation learning method for code-mixed texts.

6
30 May 2021