Search Results for author:
Found 155 papers, 64 papers with code
Pre-Training with Whole Word Masking for Chinese BERT
To demonstrate the effectiveness of these models, we create a series of Chinese pre-trained language models as our baselines, including BERT, RoBERTa, ELECTRA, RBT, etc.
Revisiting Pre-Trained Models for Chinese Natural Language Processing
Bidirectional Encoder Representations from Transformers (BERT) has shown marvelous improvements across various NLP tasks, and consecutive variants have been proposed to further improve the performance of the pre-trained language models.
Ranked #13 on
Stock Market Prediction
on Astock
HuaTuo: Tuning LLaMA Model with Chinese Medical Knowledge
Large Language Models (LLMs), such as the LLaMA model, have demonstrated their effectiveness in various general-domain natural language processing (NLP) tasks.
Knowledge-tuning Large Language Models with Structured Medical Knowledge Bases for Reliable Response Generation in Chinese
To address this challenge, we propose knowledge-tuning, which leverages structured medical knowledge bases for the LLMs to grasp domain knowledge efficiently and facilitate reliable response generation.
Don't Ignore Dual Logic Ability of LLMs while Privatizing: A Data-Intensive Analysis in Medical Domain
We conduct several experiments to analyze the dual logic ability of LLMs by examining the consistency of the stance in responses to paired questions about the same fact.
CodeBERT: A Pre-Trained Model for Programming and Natural Languages
Results show that CodeBERT achieves state-of-the-art performance on both natural language code search and code documentation generation tasks.
Ranked #1 on
Code Documentation Generation
on CodeSearchNet - Go
Effective LSTMs for Target-Dependent Sentiment Classification
Target-dependent sentiment classification remains a challenge: modeling the semantic relatedness of a target with its context words in a sentence.
Aspect-Based Sentiment Analysis (ABSA)
General Classification
+2
Aspect Level Sentiment Classification with Deep Memory Network
Such importance degree and text representation are calculated with multiple computational layers, each of which is a neural attention model over an external memory.
Aspect-Based Sentiment Analysis (ABSA)
General Classification
+1
Retrieval-Generation Synergy Augmented Large Language Models
Large language models augmented with task-relevant documents have demonstrated impressive performance on knowledge-intensive tasks.
KwaiAgents: Generalized Information-seeking Agent System with Large Language Models
Driven by curiosity, humans have continually sought to explore and understand the world around them, leading to the invention of various tools to satiate this inquisitiveness.
A Survey of Chain of Thought Reasoning: Advances, Frontiers and Future
Chain-of-thought reasoning, a cognitive process fundamental to human intelligence, has garnered significant attention in the realm of artificial intelligence and natural language processing.
A Survey on Hallucination in Large Language Models: Principles, Taxonomy, Challenges, and Open Questions
The emergence of large language models (LLMs) has marked a significant breakthrough in natural language processing (NLP), leading to remarkable advancements in text understanding and generation.
Less Learn Shortcut: Analyzing and Mitigating Learning of Spurious Feature-Label Correlation
In this study, we focus on the spurious correlation between word features and labels that models learn from the biased data distribution of training data.
The Factual Inconsistency Problem in Abstractive Text Summarization: A Survey
Recently, various neural encoder-decoder models pioneered by Seq2Seq framework have been proposed to achieve the goal of generating more abstractive summaries by learning to map input text to output text.
Language Model as an Annotator: Exploring DialoGPT for Dialogue Summarization
Current dialogue summarization systems usually encode the text with a number of general semantic features (e. g., keywords and topics) to gain more powerful dialogue modeling capabilities.
TableGPT: Few-shot Table-to-Text Generation with Table Structure Reconstruction and Content Matching
Although neural table-to-text models have achieved remarkable progress with the help of large-scale datasets, they suffer insufficient learning problem with limited training data.
Cross-Lingual Machine Reading Comprehension
In this paper, we propose Cross-Lingual Machine Reading Comprehension (CLMRC) task for the languages other than English.
Molweni: A Challenge Multiparty Dialogues-based Machine Reading Comprehension Dataset with Discourse Structure
Research into the area of multiparty dialog has grown considerably over recent years.
Ranked #7 on
Discourse Parsing
on Molweni
Dialogue Discourse-Aware Graph Model and Data Augmentation for Meeting Summarization
First, we present a Dialogue Discourse-Dware Meeting Summarizer (DDAMS) to explicitly model the interaction between utterances in a meeting by modeling different discourse relations.
Kuaipedia: a Large-scale Multi-modal Short-video Encyclopedia
In this paper, we propose Kuaipedia, a large-scale multi-modal encyclopedia consisting of items, aspects, and short videos lined to them, which was extracted from billions of videos of Kuaishou (Kwai), a well-known short-video platform in China.
e-CARE: a New Dataset for Exploring Explainable Causal Reasoning
Understanding causality has vital importance for various Natural Language Processing (NLP) applications.
A Distributional Lens for Multi-Aspect Controllable Text Generation
Multi-aspect controllable text generation is a more challenging and practical task than single-aspect control.
Controllable Text Generation via Probability Density Estimation in the Latent Space
Previous work on controllable text generation has explored the idea of control from the latent space, such as optimizing a representation with attribute-related classifiers or sampling a representation from relevant discrete samples.
CogGPT: Unleashing the Power of Cognitive Dynamics on Large Language Models
Cognitive dynamics are pivotal to advance human understanding of the world.
Parsing Tweets into Universal Dependencies
Nonetheless, using the new treebank, we build a pipeline system to parse raw tweets into UD.
Ranked #2 on
Dependency Parsing
on Tweebank
Exploring Segment Representations for Neural Segmentation Models
Many natural language processing (NLP) tasks can be generalized into segmentation problem.
Distilling Knowledge for Search-based Structured Prediction
Many natural language processing tasks can be modeled into structured prediction and solved as a search problem.
Distilled Dual-Encoder Model for Vision-Language Understanding
We propose a cross-modal attention distillation framework to train a dual-encoder model for vision-language understanding tasks, such as visual reasoning and visual question answering.
How Does Selective Mechanism Improve Self-Attention Networks?
Self-attention networks (SANs) with selective mechanism has produced substantial improvements in various NLP tasks by concentrating on a subset of input words.
Incorporating Commonsense Knowledge into Abstractive Dialogue Summarization via Heterogeneous Graph Networks
In detail, we consider utterance and commonsense knowledge as two different types of data and design a Dialogue Heterogeneous Graph Network (D-HGN) for modeling both information.
Sentiment Word Aware Multimodal Refinement for Multimodal Sentiment Analysis with ASR Errors
Through further analysis of the ASR outputs, we find that in some cases the sentiment words, the key sentiment elements in the textual modality, are recognized as other words, which makes the sentiment of the text change and hurts the performance of multimodal sentiment models directly.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+4
An AMR Aligner Tuned by Transition-based Parser
In this paper, we propose a new rich resource enhanced AMR aligner which produces multiple alignments and a new transition system for AMR parsing along with its oracle parser.
Ranked #2 on
AMR Parsing
on LDC2014T12:
Learning to Rewrite for Non-Autoregressive Neural Machine Translation
Towards keeping the consistency of data distribution with iterative decoding, an iterative training strategy is employed to further improve the capacity of rewriting.
Is ChatGPT a Good Causal Reasoner? A Comprehensive Evaluation
Causal reasoning ability is crucial for numerous NLP applications.
Table-to-Text Generation with Effective Hierarchical Encoder on Three Dimensions (Row, Column and Time)
To address aforementioned problems, not only do we model each table cell considering other records in the same row, we also enrich table's representation by modeling each table cell in context of other cells in the same column or with historical (time dimension) data respectively.
TimeBench: A Comprehensive Evaluation of Temporal Reasoning Abilities in Large Language Models
Understanding time is a pivotal aspect of human cognition, crucial in the broader framework of grasping the intricacies of the world.
Hansel: A Chinese Few-Shot and Zero-Shot Entity Linking Benchmark
We then establish a strong baseline that scores a R@1 of 46. 2% on Few-Shot and 76. 6% on Zero-Shot on our dataset.
From Artificially Real to Real: Leveraging Pseudo Data from Large Language Models for Low-Resource Molecule Discovery
Furthermore, our method shows a sustained improvement as the volume of pseudo data increases, revealing the great potential of pseudo data in advancing low-resource cross-modal molecule discovery.
ReCo: Reliable Causal Chain Reasoning via Structural Causal Recurrent Neural Networks
Causal chain reasoning (CCR) is an essential ability for many decision-making AI systems, which requires the model to build reliable causal chains by connecting causal pairs.
Learning Event Graph Knowledge for Abductive Reasoning
Abductive reasoning aims at inferring the most plausible explanation for observed events, which would play critical roles in various NLP applications, such as reading comprehension and question answering.
An Early Evaluation of GPT-4V(ision)
In this paper, we evaluate different abilities of GPT-4V including visual understanding, language understanding, visual puzzle solving, and understanding of other modalities such as depth, thermal, video, and audio.
Unifying the Convergences in Multilingual Neural Machine Translation
In this paper, we propose a novel training strategy named LSSD (Language-Specific Self-Distillation), which can alleviate the convergence inconsistency and help MNMT models achieve the best performance on each language pair simultaneously.
Knowledge-Bridged Causal Interaction Network for Causal Emotion Entailment
Moreover, social-interaction CSK serves as emotion-level bridge (E-bridge) and action-level bridge (A-bridge) to connect candidate utterances with the target one, which provides explicit causal clues for the Emotional Interaction module and Actional Interaction module to reason the target emotion.
Ranked #4 on
Causal Emotion Entailment
on RECCON
ExCAR: Event Graph Knowledge Enhanced Explainable Causal Reasoning
ExCAR first acquires additional evidence information from a large-scale causal event graph as logical rules for causal reasoning.
TransESC: Smoothing Emotional Support Conversation via Turn-Level State Transition
Specifically, we construct the state transition graph with a two-step way, named transit-then-interact, to grasp such three types of turn-level transition information.
MolTailor: Tailoring Chemical Molecular Representation to Specific Tasks via Text Prompts
The agent accentuates task-relevant features in the molecular representation by understanding the natural language description of the task, just as a tailor customizes clothes for clients.
Learning to Select Bi-Aspect Information for Document-Scale Text Content Manipulation
In this paper, we focus on a new practical task, document-scale text content manipulation, which is the opposite of text style transfer and aims to preserve text styles while altering the content.
Prompt Combines Paraphrase: Teaching Pre-trained Models to Understand Rare Biomedical Words
Prompt-based fine-tuning for pre-trained models has proven effective for many natural language processing tasks under few-shot settings in general domain.
MuCDN: Mutual Conversational Detachment Network for Emotion Recognition in Multi-Party Conversations
Specifically, two detachment ways are devised to perform context and speaker-specific modeling within detached threads and they are bridged through a mutual module.
MSAMSum: Towards Benchmarking Multi-lingual Dialogue Summarization
Dialogue summarization helps users capture salient information from various types of dialogues has received much attention recently.
CogBERT: Cognition-Guided Pre-trained Language Models
To fill the gap, we propose CogBERT, a framework that can induce fine-grained cognitive features from cognitive data and incorporate cognitive features into BERT by adaptively adjusting the weight of cognitive features for different NLP tasks.
A Diffusion Model for Event Skeleton Generation
Event skeleton generation, aiming to induce an event schema skeleton graph with abstracted event nodes and their temporal relations from a set of event instance graphs, is a critical step in the temporal complex event schema induction task.
Towards Higher Pareto Frontier in Multilingual Machine Translation
Multilingual neural machine translation has witnessed remarkable progress in recent years.
Don't Lose Yourself! Empathetic Response Generation via Explicit Self-Other Awareness
As a critical step to achieve human-like chatbots, empathetic response generation has attained increasing interests.
NoisywikiHow: A Benchmark for Learning with Real-world Noisy Labels in Natural Language Processing
To mitigate the effects of label noise, learning with noisy labels (LNL) methods are designed to achieve better generalization performance.
Learning to Describe for Predicting Zero-shot Drug-Drug Interactions
Adverse drug-drug interactions~(DDIs) can compromise the effectiveness of concurrent drug administration, posing a significant challenge in healthcare.
Enhancing Content Planning for Table-to-Text Generation with Data Understanding and Verification
Neural table-to-text models, which select and order salient data, as well as verbalizing them fluently via surface realization, have achieved promising progress.
Less Is More: Domain Adaptation with Lottery Ticket for Reading Comprehension
Then, we only fine-tune the lottery subnetwork, a small fraction of the whole parameters, on the annotated target domain data for adaptation.
Neural Natural Logic Inference for Interpretable Question Answering
Many open-domain question answering problems can be cast as a textual entailment task, where a question and candidate answers are concatenated to form hypotheses.
Manifold-based Verbalizer Space Re-embedding for Tuning-free Prompt-based Classification
Experimental results indicate that even without tuning any parameters, our LLE-INC is on par with automated verbalizers with parameter tuning.
Examining Inter-Consistency of Large Language Models Collaboration: An In-depth Analysis via Debate
Through extensive experiments on various datasets, LLMs can effectively collaborate to reach a consensus despite noticeable inter-inconsistencies, but imbalances in their abilities can lead to domination by superior LLMs.
Semantic Parsing with Syntax- and Table-Aware SQL Generation
We present a generative model to map natural language questions into SQL queries.
Ranked #4 on
Code Generation
on WikiSQL
Truth Discovery with Memory Network
We use feedforward memory network and feedback memory network to learn the representation of the credibility of statements which are about the same object.
A Planning based Framework for Essay Generation
Generating an article automatically with computer program is a challenging task in artificial intelligence and natural language processing.
Emotion Analysis Platform on Chinese Microblog
In order to analyze the emotional changes in accordance with time and space, this paper presents an Emotion Analysis Platform (EAP), which explores the emotional distribution of each province, so that can monitor the global pulse of each province in China.
Knowledge-Aware Conversational Semantic Parsing Over Web Tables
Results show that our knowledge-aware model outperforms the state-of-the-art approaches.
Knowledge Based Machine Reading Comprehension
Machine reading comprehension (MRC) requires reasoning about both the knowledge involved in a document and knowledge about the world.
Adaptive Multi-pass Decoder for Neural Machine Translation
Although end-to-end neural machine translation (NMT) has achieved remarkable progress in the recent years, the idea of adopting multi-pass decoding mechanism into conventional NMT is not well explored.
English-Chinese Knowledge Base Translation with Neural Network
Knowledge base (KB) such as Freebase plays an important role for many natural language processing tasks.
Learning to Refine Source Representations for Neural Machine Translation
Neural machine translation (NMT) models generally adopt an encoder-decoder architecture for modeling the entire translation process.
Towards Time-Aware Distant Supervision for Relation Extraction
Time-DS is composed of a time series instance-popularity and two strategies.
Attribute Acquisition in Ontology based on Representation Learning of Hierarchical Classes and Attributes
This paper investigates an attention-based automatic paradigm called TransATT for attribute acquisition, by learning the representation of hierarchical classes and attributes in Chinese ontology.
Learning to Ask Unanswerable Questions for Machine Reading Comprehension
We also present a way to construct training data for our question generation models by leveraging the existing reading comprehension dataset.
Constructing Information-Lossless Biological Knowledge Graphs from Conditional Statements
Conditions are essential in the statements of biological literature.
Neural Semantic Parsing in Low-Resource Settings with Back-Translation and Meta-Learning
Neural semantic parsing has achieved impressive results in recent years, yet its success relies on the availability of large amounts of supervised data.
Multi-Input Multi-Output Sequence Labeling for Joint Extraction of Fact and Condition Tuples from Scientific Text
In this work, we propose a new sequence labeling framework (as well as a new tag schema) to jointly extract the fact and condition tuples from statement sentences.
Enhancing Neural Data-To-Text Generation Models with External Background Knowledge
Recent neural models for data-to-text generation rely on massive parallel pairs of data and text to learn the writing knowledge.
Transforming Wikipedia into Augmented Data for Query-Focused Summarization
The limited size of existing query-focused summarization datasets renders training data-driven summarization models challenging.
An Annotation Scheme of A Large-scale Multi-party Dialogues Dataset for Discourse Parsing and Machine Comprehension
In this paper, we propose the scheme for annotating large-scale multi-party chat dialogues for discourse parsing and machine comprehension.
Canonicalizing Open Knowledge Bases with Multi-Layered Meta-Graph Neural Network
Noun phrases and relational phrases in Open Knowledge Bases are often not canonical, leading to redundant and ambiguous facts.
Biomedical Knowledge Graph Refinement with Embedding and Logic Rules
This paper proposes a method BioGRER to improve the BioKG's quality, which comprehensively combines the knowledge graph embedding and logic rules that support and negate triplets in the BioKG.
An Iterative Emotion Interaction Network for Emotion Recognition in Conversations
We noticed that the gold emotion labels of the context utterances can provide explicit and accurate emotion interaction, but it is impossible to input gold labels at inference time.
Ranked #41 on
Emotion Recognition in Conversation
on IEMOCAP
Learning to Share by Masking the Non-shared for Multi-domain Sentiment Classification
To this end, we propose the BertMasker network which explicitly masks domain-related words from texts, learns domain-invariant sentiment features from these domain-agnostic texts, and uses those masked words to form domain-aware sentence representations.
General Classification
Multi-Domain Sentiment Classification
+3
DADgraph: A Discourse-aware Dialogue Graph Neural Network for Multiparty Dialogue Machine Reading Comprehension
Multiparty Dialogue Machine Reading Comprehension (MRC) differs from traditional MRC as models must handle the complex dialogue discourse structure, previously unconsidered in traditional MRC.
Ranked #4 on
Question Answering
on Molweni
HIT-SCIR at SemEval-2020 Task 5: Training Pre-trained Language Model with Pseudo-labeling Data for Counterfactuals Detection
In this task, we dedicate to detecting causation, especially counterfactuals from texts.
A Survey on Dialogue Summarization: Recent Advances and New Frontiers
We hope that this first survey of dialogue summarization can provide the community with a quick access and a general picture to this task and motivate future researches.
CausalBERT: Injecting Causal Knowledge Into Pre-trained Models with Minimal Supervision
Recent work has shown success in incorporating pre-trained models like BERT to improve NLP systems.
GEDIT: Geographic-Enhanced and Dependency-Guided Tagging for Joint POI and Accessibility Extraction at Baidu Maps
We approach this task as a sequence tagging problem, where the goal is to produce <POI name, accessibility label> pairs from unstructured text.
Retrieve, Discriminate and Rewrite: A Simple and Effective Framework for Obtaining Affective Response in Retrieval-Based Chatbots
To address this problem, we propose a simple and effective Retrieve-Discriminate-Rewrite framework.
Pretraining without Wordpieces: Learning Over a Vocabulary of Millions of Words
(2) how to predict a word via cloze test without knowing the number of wordpieces in advance?
Improving Controllable Text Generation with Position-Aware Weighted Decoding
Weighted decoding methods composed of the pretrained language model (LM) and the controller have achieved promising results for controllable text generation.
A Graph Enhanced BERT Model for Event Prediction
To this end, we incorporate an additional structured variable into BERT to learn to predict the event connections in the training process.
MACSA: A Multimodal Aspect-Category Sentiment Analysis Dataset with Multimodal Fine-grained Aligned Annotations
In this paper, we propose a new dataset, the Multimodal Aspect-Category Sentiment Analysis (MACSA) dataset, which contains more than 21K text-image pairs.
VEM$^2$L: A Plug-and-play Framework for Fusing Text and Structure Knowledge on Sparse Knowledge Graph Completion
In this paper, we solve the sparse KGC from these two motivations simultaneously and handle their respective drawbacks further, and propose a plug-and-play unified framework VEM$^2$L over sparse KGs.
DiscrimLoss: A Universal Loss for Hard Samples and Incorrect Samples Discrimination
To relieve this issue, curriculum learning is proposed to improve model performance and generalization by ordering training samples in a meaningful (e. g., easy to hard) sequence.
Zero-shot Aspect-level Sentiment Classification via Explicit Utilization of Aspect-to-Document Sentiment Composition
Our key intuition is that the sentiment representation of a document is composed of the sentiment representations of all the aspects of that document.
An Efficient End-to-End Transformer with Progressive Tri-modal Attention for Multi-modal Emotion Recognition
At the low-level, we propose the progressive tri-modal attention, which can model the tri-modal feature interactions by adopting a two-pass strategy and can further leverage such interactions to significantly reduce the computation and memory complexity through reducing the input token length.
面向话题的讽刺识别:新任务、新数据和新方法(Topic-Oriented Sarcasm Detection: New Task, New Dataset and New Method)
“现有的文本讽刺识别研究通常只停留在句子级别的讽刺表达分类, 缺乏考虑讽刺对象对讽刺表达的影响。针对这一问题, 本文提出一个新的面向话题的讽刺识别任务。该任务通过话题的引入, 以话题作为讽刺对象, 有助于更好地理解和建模讽刺表达。对应地, 本文构建了一个新的面向话题的讽刺识别数据集。这个数据集包含了707个话题, 以及对应的4871个话题-评论对组。在此基础上, 基于提示学习和大规模预训练语言模型, 提出了一种面向话题的讽刺表达提示学习模型。在本文构建的面向话题讽刺识别数据集上的实验结果表明, 相比基线模型, 本文所提出的面向话题的讽刺表达提示学习模型取得了更优的性能。同时, 实验分析也表明本文提出的面向话题的讽刺识别任务相比传统的句子级讽刺识别任务更具挑战性。”
SSR: Utilizing Simplified Stance Reasoning Process for Robust Stance Detection
Motivated by how humans tackle stance detection tasks, we propose to incorporate the stance reasoning process as task knowledge to assist in learning genuine features and reducing reliance on bias features.
BigCilin: An Automatic Chinese Open-domain Knowledge Graph with Fine-grained Hypernym-Hyponym Relations
One is that it supports querying any Chinese named entity and browsing the extracted hypernym-hyponym paths surro-unding the query entity.
Debiasing Stance Detection Models with Counterfactual Reasoning and Adversarial Bias Learning
Stance detection models may tend to rely on dataset bias in the text part as a shortcut and thus fail to sufficiently learn the interaction between the targets and texts.
Semantic-aware Contrastive Learning for Electroencephalography-to-Text Generation with Curriculum Learning
To mitigate this challenge, we devise a Curriculum Semantic-aware Contrastive Learning strategy (C-SCL), which effectively re-calibrates the subject-dependent EEG representation to the semantic-dependent EEG representation, thus reducing the discrepancy.
STOA-VLP: Spatial-Temporal Modeling of Object and Action for Video-Language Pre-training
Although large-scale video-language pre-training models, which usually build a global alignment between the video and the text, have achieved remarkable progress on various downstream tasks, the idea of adopting fine-grained information during the pre-training stage is not well explored.
Hierarchical Catalogue Generation for Literature Review: A Benchmark
Scientific literature review generation aims to extract and organize important information from an abundant collection of reference papers and produces corresponding reviews while lacking a clear and logical hierarchy.
Global Prompt Cell: A Portable Control Module for Effective Prompt Tuning
As a novel approach to tuning pre-trained models, prompt tuning involves freezing the parameters in downstream tasks while inserting trainable embeddings into inputs in the first layer.
Is ChatGPT Equipped with Emotional Dialogue Capabilities?
This report presents a study on the emotional dialogue capability of ChatGPT, an advanced language model developed by OpenAI.
The Role of Summarization in Generative Agents: A Preliminary Perspective
Generative agents that simulate human society show tremendous potential for further research and practical applications.
Improving Cross-Task Generalization with Step-by-Step Instructions
Instruction tuning has been shown to be able to improve cross-task generalization of language models.
UNIMO-3: Multi-granularity Interaction for Vision-Language Representation Learning
The experimental results show that our model achieves state-of-the-art performance in various downstream tasks, and through ablation study can prove that effective cross-layer learning improves the model's ability of multimodal representation.
SmartTrim: Adaptive Tokens and Attention Pruning for Efficient Vision-Language Models
Despite achieving remarkable performance on various vision-language tasks, Transformer-based Vision-Language Models (VLMs) suffer from redundancy in inputs and parameters, significantly hampering their efficiency in real-world applications.
Improved Visual Story Generation with Adaptive Context Modeling
Diffusion models developed on top of powerful text-to-image generation models like Stable Diffusion achieve remarkable success in visual story generation.
SkillNet-X: A Multilingual Multitask Model with Sparsely Activated Skills
Traditional multitask learning methods basically can only exploit common knowledge in task- or language-wise, which lose either cross-language or cross-task knowledge.
Exploring & Exploiting High-Order Graph Structure for Sparse Knowledge Graph Completion
The proposed approach comprises two main components: a GNN-based predictor and a reasoning path distiller.
UniCoRN: Unified Cognitive Signal ReconstructioN bridging cognitive signals and human language
In this paper, we propose fMRI2text, the first openvocabulary task aiming to bridge fMRI time series and human language.
Adapter-based Selective Knowledge Distillation for Federated Multi-domain Meeting Summarization
However, existing work has focused on training models on centralized data, neglecting real-world scenarios where meeting data are infeasible to collect centrally, due to their sensitive nature.
GLS-CSC: A Simple but Effective Strategy to Mitigate Chinese STM Models' Over-Reliance on Superficial Clue
To address this issue, it is crucial to analyze and mitigate the influence of superficial clues on STM models.
Make Your Decision Convincing! A Unified Two-Stage Framework: Self-Attribution and Decision-Making
Through extensive experiments on five reasoning datasets from the ERASER benchmark, we demonstrate that our framework not only establishes a more reliable link between the generated rationale and model decision but also achieves competitive results in task performance and the quality of rationale.
MTGER: Multi-view Temporal Graph Enhanced Temporal Reasoning over Time-Involved Document
To address this issue, we propose MTGER, a novel Multi-view Temporal Graph Enhanced Temporal Reasoning framework for temporal reasoning over time-involved documents.
Trends in Integration of Knowledge and Large Language Models: A Survey and Taxonomy of Methods, Benchmarks, and Applications
In this paper, we propose a review to discuss the trends in integration of knowledge and large language models, including taxonomy of methods, benchmarks, and applications.
Analyzing the Inherent Response Tendency of LLMs: Real-World Instructions-Driven Jailbreak
The jailbreak idea of our method is "Inherent Response Tendency Analysis" which identifies real-world instructions that can inherently induce LLMs to generate affirmation responses and the corresponding jailbreak strategy is "Real-World Instructions-Driven Jailbreak" which involves strategically splicing real-world instructions identified through the above analysis around the malicious instruction.
Emage: Non-Autoregressive Text-to-Image Generation
Compared with autoregressive baselines that needs to run one thousand times, our model only runs 16 times to generate images of competitive quality with an order of magnitude lower inference latency.
Length Extrapolation of Transformers: A Survey from the Perspective of Positional Encoding
In this survey, we present these advances towards length extrapolation in a unified notation from the perspective of PE.
Aligning Translation-Specific Understanding to General Understanding in Large Language Models
To align the translation-specific understanding to the general one, we propose a novel translation process xIoD (Cross-Lingual Interpretation of Difficult words), explicitly incorporating the general understanding on the content incurring inconsistent understanding to guide the translation.
SAPT: A Shared Attention Framework for Parameter-Efficient Continual Learning of Large Language Models
Existing methods devise the learning module to acquire task-specific knowledge with parameter-efficient tuning (PET) block and the selection module to pick out the corresponding one for the testing input, aiming at handling the challenges of catastrophic forgetting and knowledge transfer in CL.
Beyond Direct Diagnosis: LLM-based Multi-Specialist Agent Consultation for Automatic Diagnosis
Automatic diagnosis is a significant application of AI in healthcare, where diagnoses are generated based on the symptom description of patients.
Beyond the Answers: Reviewing the Rationality of Multiple Choice Question Answering for the Evaluation of Large Language Models
In the field of natural language processing (NLP), Large Language Models (LLMs) have precipitated a paradigm shift, markedly enhancing performance in natural language generation tasks.
Multiple-choice
Multiple Choice Question Answering (MCQA)
+1
Both Matter: Enhancing the Emotional Intelligence of Large Language Models without Compromising the General Intelligence
Emotional Intelligence (EI), consisting of emotion perception, emotion cognition and emotion expression, plays the critical roles in improving user interaction experience for the current large language model (LLM) based conversational general AI assistants.
Deciphering the Impact of Pretraining Data on Large Language Models through Machine Unlearning
Through pretraining on a corpus with various sources, Large Language Models (LLMs) have gained impressive performance.
How does Architecture Influence the Base Capabilities of Pre-trained Language Models? A Case Study Based on FFN-Wider Transformer Models
In this work, we attempt to explain and reverse the decline in base capabilities caused by the architecture of FFN-Wider Transformers, seeking to provide some insights.
Vanilla Transformers are Transfer Capability Teachers
However, studies have indicated that MoE Transformers underperform vanilla Transformers in many downstream tasks, significantly diminishing the practical value of MoE models.
AS-ES Learning: Towards Efficient CoT Learning in Small Models
Chain-of-Thought (CoT) serves as a critical emerging ability in LLMs, especially when it comes to logical reasoning.
Meaningful Learning: Advancing Abstract Reasoning in Large Language Models via Generic Fact Guidance
Large language models (LLMs) have developed impressive performance and strong explainability across various reasoning scenarios, marking a significant stride towards mimicking human-like intelligence.
RU22Fact: Optimizing Evidence for Multilingual Explainable Fact-Checking on Russia-Ukraine Conflict
Furthermore, we construct RU22Fact, a novel multilingual explainable fact-checking dataset on the Russia-Ukraine conflict in 2022 of 16K samples, each containing real-world claims, optimized evidence, and referenced explanation.
