Search Results for author:
Found 15 papers, 10 papers with code
Tunable Soft Prompts are Messengers in Federated Learning
As the global model itself is not required to be shared and the local training is conducted based on an auxiliary model with fewer parameters than the global model, the proposed approach provides protection for the global model while reducing communication and computation costs in FL.
Data-Juicer: A One-Stop Data Processing System for Large Language Models
A data recipe is a mixture of data from different sources for training LLMs, which plays a vital role in LLMs' performance.
FederatedScope-LLM: A Comprehensive Package for Fine-tuning Large Language Models in Federated Learning
When several entities have similar interested tasks, but their data cannot be shared because of privacy concerns regulations, federated learning (FL) is a mainstream solution to leverage the data of different entities.
Counterfactual Debiasing for Generating Factually Consistent Text Summaries
Despite substantial progress in abstractive text summarization to generate fluent and informative texts, the factual inconsistency in the generated summaries remains an important yet challenging problem to be solved.
FS-Real: Towards Real-World Cross-Device Federated Learning
Federated Learning (FL) aims to train high-quality models in collaboration with distributed clients while not uploading their local data, which attracts increasing attention in both academia and industry.
Collaborating Heterogeneous Natural Language Processing Tasks via Federated Learning
In this study, we further broaden the application scope of FL in NLP by proposing an Assign-Then-Contrast (denoted as ATC) framework, which enables clients with heterogeneous NLP tasks to construct an FL course and learn useful knowledge from each other.
A Benchmark for Federated Hetero-Task Learning
To investigate the heterogeneity in federated learning in real-world scenarios, we generalize the classic federated learning to federated hetero-task learning, which emphasizes the inconsistency across the participants in federated learning in terms of both data distribution and learning tasks.
FederatedScope-GNN: Towards a Unified, Comprehensive and Efficient Package for Federated Graph Learning
The incredible development of federated learning (FL) has benefited various tasks in the domains of computer vision and natural language processing, and the existing frameworks such as TFF and FATE has made the deployment easy in real-world applications.
FederatedScope: A Flexible Federated Learning Platform for Heterogeneity
Although remarkable progress has been made by existing federated learning (FL) platforms to provide infrastructures for development, these platforms may not well tackle the challenges brought by various types of heterogeneity, including the heterogeneity in participants' local data, resources, behaviors and learning goals.
iFlood: A Stable and Effective Regularizer
However, our further studies uncover that the design of the loss function of Flooding can lead to a discrepancy between its objective and implementation, and cause the instability issue.
Factual Consistency Evaluation for Text Summarization via Counterfactual Estimation
However, existing metrics either neglect the intrinsic cause of the factual inconsistency or rely on auxiliary tasks, leading to an unsatisfied correlation with human judgments or increasing the inconvenience of usage in practice.
Contextualized Knowledge-aware Attentive Neural Network: Enhancing Answer Selection with Knowledge
Answer selection, which is involved in many natural language processing applications such as dialog systems and question answering (QA), is an important yet challenging task in practice, since conventional methods typically suffer from the issues of ignoring diverse real-world background knowledge.
FIVES: Feature Interaction Via Edge Search for Large-Scale Tabular Data
Then we instantiate this search strategy by optimizing both a dedicated graph neural network (GNN) and the adjacency tensor associated with the defined feature graph.
Joint Learning of Answer Selection and Answer Summary Generation in Community Question Answering
Community question answering (CQA) gains increasing popularity in both academy and industry recently.
Multi-Task Learning with Multi-View Attention for Answer Selection and Knowledge Base Question Answering
Second, these two tasks can benefit each other: answer selection can incorporate the external knowledge from knowledge base (KB), while KBQA can be improved by learning contextual information from answer selection.
