Search Results for author: Jinbo Wang

Found 5 papers, 1 papers with code

How to Defend Against Large-scale Model Poisoning Attacks in Federated Learning: A Vertical Solution

no code implementations16 Nov 2024 Jinbo Wang, Ruijin Wang, Fengli Zhang

In this work, based on the key insight that the convergence process of the model is a highly predictable process, we break away from the traditional horizontal solution of defense and innovatively transform the problem of solving the optimal aggregation gradients into a vertical solution problem.

Federated Learning Model Poisoning

$\text{Memory}^3$: Language Modeling with Explicit Memory

no code implementations1 Jul 2024 Hongkang Yang, Zehao Lin, Wenjin Wang, Hao Wu, Zhiyu Li, Bo Tang, Wenqiang Wei, Jinbo Wang, Zeyun Tang, Shichao Song, Chenyang Xi, Yu Yu, Kai Chen, Feiyu Xiong, Linpeng Tang, Weinan E

The model is named $\text{Memory}^3$, since explicit memory is the third form of memory in LLMs after implicit memory (model parameters) and working memory (context key-values).

Language Modelling RAG +1

Improving Generalization and Convergence by Enhancing Implicit Regularization

1 code implementation31 May 2024 Mingze Wang, Jinbo Wang, Haotian He, Zilin Wang, Guanhua Huang, Feiyu Xiong, Zhiyu Li, Weinan E, Lei Wu

In this work, we propose an Implicit Regularization Enhancement (IRE) framework to accelerate the discovery of flat solutions in deep learning, thereby improving generalization and convergence.

Image Classification

YOLO based Ocean Eddy Localization with AWS SageMaker

no code implementations10 Apr 2024 Seraj Al Mahmud Mostafa, Jinbo Wang, Benjamin Holt, Jianwu Wang

Ocean eddies play a significant role both on the sea surface and beneath it, contributing to the sustainability of marine life dependent on oceanic behaviors.

Management

Exploring the Integration of Large Language Models into Automatic Speech Recognition Systems: An Empirical Study

no code implementations13 Jul 2023 Zeping Min, Jinbo Wang

This paper explores the integration of Large Language Models (LLMs) into Automatic Speech Recognition (ASR) systems to improve transcription accuracy.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +3

Cannot find the paper you are looking for? You can Submit a new open access paper.