Search Results for author:
Found 3 papers, 1 papers with code
Implicit Bias of AdamW: $\ell_\infty$ Norm Constrained Optimization
Adam with decoupled weight decay, also known as AdamW, is widely acclaimed for its superior performance in language modeling tasks, surpassing Adam with $\ell_2$ regularization in terms of generalization and optimization.
WeaverBird: Empowering Financial Decision-Making with Large Language Model, Knowledge Base, and Search Engine
We present WeaverBird, an intelligent dialogue system designed specifically for the finance domain.
Hidden State Variability of Pretrained Language Models Can Guide Computation Reduction for Transfer Learning
We propose to select layers based on the variability of their hidden states given a task-specific corpus.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
