Search Results for author:
Found 10 papers, 3 papers with code
Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length
The quadratic complexity and weak length extrapolation of Transformers limits their ability to scale to long sequences, and while sub-quadratic solutions like linear attention and state space models exist, they empirically underperform Transformers in pretraining efficiency and downstream task accuracy.
IPAD: Iterative, Parallel, and Diffusion-based Network for Scene Text Recognition
Nowadays, scene text recognition has attracted more and more attention due to its diverse applications.
End-to-end Story Plot Generator
Story plots, while short, carry most of the essential information of a full story that may contain tens of thousands of words.
Learning Personalized Story Evaluation
We further develop a personalized story evaluation model PERSE to infer reviewer preferences and provide a personalized evaluation.
TorchRL: A data-driven decision-making library for PyTorch
PyTorch has ascended as a premier machine learning framework, yet it lacks a native and comprehensive library for decision and control tasks suitable for large development teams dealing with complex real-world data and environments.
Masked and Permuted Implicit Context Learning for Scene Text Recognition
We utilize the training procedure of PLM, and to integrate MLM, we incorporate word length information into the decoding process and replace the undetermined characters with mask tokens.
Learning Compiler Pass Orders using Coreset and Normalized Value Prediction
Finding the optimal pass sequence of compilation can lead to a significant reduction in program size and/or improvement in program efficiency.
Sample-efficient Surrogate Model for Frequency Response of Linear PDEs using Self-Attentive Complex Polynomials
Linear Partial Differential Equations (PDEs) govern the spatial-temporal dynamics of physical systems that are essential to building modern technology.
Nocturne: a scalable driving benchmark for bringing multi-agent learning one step closer to the real world
We introduce Nocturne, a new 2D driving simulator for investigating multi-agent coordination under partial observability.
Hybrid Composition with IdleBlock: More Efficient Networks for Image Recognition
We propose a new building block, IdleBlock, which naturally prunes connections within the block.
