Search Results for author:
Found 3 papers, 0 papers with code
Småprat: DialoGPT for Natural Language Generation of Swedish Dialogue by Transfer Learning
Perplexity score (an automated intrinsic language model metric) and surveys by human evaluation were used to assess the performances of the fine-tuned models, with results that indicate that the capacity for transfer learning can be exploited with considerable success.
ReLU and Addition-based Gated RNN
It is demonstrated that the novel gating mechanism can capture long-term dependencies for a standard synthetic sequence learning task while significantly reducing computational costs such that execution time is reduced by half on CPU and by one-third under encryption.
The Inhibitor: ReLU and Addition-Based Attention for Efficient Transformers
In particular, we believe that the ReLU and addition-based attention mechanism introduced in this paper may enable privacy-preserving AI applications operating under homomorphic encryption by avoiding the costly multiplication of encrypted variables.
