Search Results for author:
Found 7 papers, 4 papers with code
Eagle and Finch: RWKV with Matrix-Valued States and Dynamic Recurrence
We present Eagle (RWKV-5) and Finch (RWKV-6), sequence models improving upon the RWKV (RWKV-4) architecture.
Highly Accurate Disease Diagnosis and Highly Reproducible Biomarker Identification with PathFormer
However, we found two major limitations of existing GNNs in omics data analysis, i. e., limited-prediction (diagnosis) accuracy and limited-reproducible biomarker identification capacity across multiple datasets.
RWKV: Reinventing RNNs for the Transformer Era
This work presents a significant step towards reconciling trade-offs between computational efficiency and model performance in sequence processing tasks.
Ranked #22 on
Natural Language Inference
on WNLI
Both Efficiency and Effectiveness! A Large Scale Pre-ranking Framework in Search System
In the realm of search systems, multi-stage cascade architecture is a prevalent method, typically consisting of sequential modules such as matching, pre-ranking, and ranking.
SpikeGPT: Generative Pre-trained Language Model with Spiking Neural Networks
As a result, their performance lags behind modern deep learning, and we are yet to see the effectiveness of SNNs in language generation.
TCJA-SNN: Temporal-Channel Joint Attention for Spiking Neural Networks
Given the critical role of attention mechanisms in enhancing neural network performance, the integration of SNNs and attention mechanisms exhibits potential to deliver energy-efficient and high-performance computing paradigms.
Utilizing Citation Network Structure to Predict Citation Counts: A Deep Learning Approach
Therefore, it is very important to be able to accurately predict the citation counts of academic papers.
