Search Results for author:
Found 12 papers, 7 papers with code
Checkpoint Merging via Bayesian Optimization in LLM Pretraining
The rapid proliferation of large language models (LLMs) such as GPT-4 and Gemini underscores the intense demand for resources during their training processes, posing significant challenges due to substantial computational and environmental costs.
ShortGPT: Layers in Large Language Models are More Redundant Than You Expect
As Large Language Models (LLMs) continue to advance in performance, their size has escalated significantly, with current LLMs containing billions or even trillions of parameters.
Baichuan 2: Open Large-scale Language Models
Large language models (LLMs) have demonstrated remarkable performance on a variety of natural language tasks based on just a few examples of natural language instructions, reducing the need for extensive feature engineering.
T2Ranking: A large-scale Chinese Benchmark for Passage Ranking
T2Ranking comprises more than 300K queries and over 2M unique passages from real-world search engines.
ChiQA: A Large Scale Image-based Real-World Question Answering Dataset for Multi-Modal Understanding
However, in most of the public visual question answering datasets such as VQA, CLEVR, the questions are human generated that specific to the given image, such as `What color are her eyes?'.
Bridging the Gap Between Training and Inference of Bayesian Controllable Language Models
Large-scale pre-trained language models have achieved great success on natural language generation tasks.
ComQA:Compositional Question Answering via Hierarchical Graph Neural Networks
In compositional question answering, the systems should assemble several supporting evidence from the document to generate the final answer, which is more difficult than sentence-level or phrase-level QA.
SenSeNet: Neural Keyphrase Generation with Document Structure
Keyphrase Generation (KG) is the task of generating central topics from a given document or literary work, which captures the crucial information necessary to understand the content.
Tasty Burgers, Soggy Fries: Probing Aspect Robustness in Aspect-Based Sentiment Analysis
Based on the SemEval 2014 dataset, we construct the Aspect Robustness Test Set (ARTS) as a comprehensive probe of the aspect robustness of ABSA models.
Aspect-Based Sentiment Analysis
Aspect-Based Sentiment Analysis (ABSA)
Sogou Machine Reading Comprehension Toolkit
In this paper, we present a Sogou Machine Reading Comprehension (SMRC) toolkit that can be used to provide the fast and efficient development of modern machine comprehension models, including both published models and original prototypes.
