Search Results for author: Zihao Wei

Found 11 papers, 10 papers with code

Everything is Editable: Extend Knowledge Editing to Unstructured Data in Large Language Models

1 code implementation24 May 2024 Jingcheng Deng, Zihao Wei, Liang Pang, Hanxing Ding, HuaWei Shen, Xueqi Cheng

Firstly, in the layer dimension, we propose non-local block key-value storage to replace local layer key-value storage, increasing the representation ability of key-value pairs and incorporating attention layer knowledge.

knowledge editing World Knowledge

Efficient Vision-Language Pre-training by Cluster Masking

1 code implementation CVPR 2024 Zihao Wei, Zixuan Pan, Andrew Owens

We propose a simple strategy for masking image patches during visual-language contrastive learning that improves the quality of the learned representations and the training speed.

Contrastive Learning

Stable Knowledge Editing in Large Language Models

1 code implementation20 Feb 2024 Zihao Wei, Liang Pang, Hanxing Ding, Jingcheng Deng, HuaWei Shen, Xueqi Cheng

The premise of localization results in an incomplete knowledge editing, whereas an isolated assumption may impair both other knowledge and general abilities.

knowledge editing

Retrieve Only When It Needs: Adaptive Retrieval Augmentation for Hallucination Mitigation in Large Language Models

no code implementations16 Feb 2024 Hanxing Ding, Liang Pang, Zihao Wei, HuaWei Shen, Xueqi Cheng

A careful and balanced integration of the parametric knowledge within LLMs with external information is crucial to alleviate hallucinations.

Hallucination Retrieval

SwinMM: Masked Multi-view with Swin Transformers for 3D Medical Image Segmentation

1 code implementation24 Jul 2023 YiQing Wang, Zihan Li, Jieru Mei, Zihao Wei, Li Liu, Chen Wang, Shengtian Sang, Alan Yuille, Cihang Xie, Yuyin Zhou

To address this limitation, we present Masked Multi-view with Swin Transformers (SwinMM), a novel multi-view pipeline for enabling accurate and data-efficient self-supervised medical image analysis.

Contrastive Learning Image Reconstruction +5

MacLaSa: Multi-Aspect Controllable Text Generation via Efficient Sampling from Compact Latent Space

1 code implementation22 May 2023 Hanxing Ding, Liang Pang, Zihao Wei, HuaWei Shen, Xueqi Cheng, Tat-Seng Chua

Multi-aspect controllable text generation aims to generate fluent sentences that possess multiple desired attributes simultaneously.

Attribute Decoder +1

TRBoost: A Generic Gradient Boosting Machine based on Trust-region Method

1 code implementation28 Sep 2022 Jiaqi Luo, Zihao Wei, Junkai Man, Shixin Xu

Gradient Boosting Machines (GBMs) have demonstrated remarkable success in solving diverse problems by utilizing Taylor expansions in functional space.

Discovering Intrinsic Reward with Contrastive Random Walk

1 code implementation23 Apr 2022 Zixuan Pan, Zihao Wei, Yidong Huang, Aditya Gupta

The aim of this paper is to demonstrate the efficacy of using Contrastive Random Walk as a curiosity method to achieve faster convergence to the optimal policy. Contrastive Random Walk defines the transition matrix of a random walk with the help of neural networks.

A-ESRGAN: Training Real-World Blind Super-Resolution with Attention U-Net Discriminators

1 code implementation19 Dec 2021 Zihao Wei, Yidong Huang, Yuang Chen, Chenhao Zheng, Jinnan Gao

In this paper, we present A-ESRGAN, a GAN model for blind SR tasks featuring an attention U-Net based, multi-scale discriminator that can be seamlessly integrated with other generators.

Blind Super-Resolution Generative Adversarial Network +1

Cannot find the paper you are looking for? You can Submit a new open access paper.