Search Results for author:
Found 4 papers, 3 papers with code
BiPFT: Binary Pre-trained Foundation Transformer with Low-rank Estimation of Binarization Residual Polynomials
Specifically, we first analyze the binarization error in self-attention operations and derive the polynomials of binarization error.
LM-Cocktail: Resilient Tuning of Language Models via Model Merging
Despite simplicity, LM-Cocktail is surprisingly effective: the resulted model is able to achieve a strong empirical performance in the whole scope of general tasks while preserving a superior capacity in its targeted domain.
Quantifying and Attributing the Hallucination of Large Language Models via Association Analysis
Although demonstrating superb performance on various NLP tasks, large language models (LLMs) still suffer from the hallucination problem, which threatens the reliability of LLMs.
Towards Accurate Binary Neural Networks via Modeling Contextual Dependencies
Second, to improve the robustness of binary models with contextual dependencies, we compute the contextual dynamic embeddings to determine the binarization thresholds in general binary convolutional blocks.
Cannot find the paper you are looking for? You can
Submit a new open access paper.
