Search Results for author: Yumeng Wang

Found 11 papers, 4 papers with code

CALM: Unleashing the Cross-Lingual Self-Aligning Ability of Language Model Question Answering

no code implementations30 Jan 2025 Yumeng Wang, Zhiyuan Fan, Qingyun Wang, May Fung, Heng Ji

To address this, we explore the Cross-Lingual Self-Aligning ability of Language Models (CALM) to align knowledge across languages.

General Knowledge Language Modeling +3

2-Tier SimCSE: Elevating BERT for Robust Sentence Embeddings

no code implementations23 Jan 2025 Yumeng Wang, Ziran Zhou, Junjin Wang

Our contributions include experimenting with three different dropout techniques, namely standard dropout, curriculum dropout, and adaptive dropout, to tackle overfitting, proposing a novel 2-Tier SimCSE Fine-tuning Model that combines both unsupervised and supervised SimCSE on STS task, and exploring transfer learning potential for Paraphrase and SST tasks.

Contrastive Learning Semantic Textual Similarity +5

DISCO: DISCovering Overfittings as Causal Rules for Text Classification Models

no code implementations7 Nov 2024 Zijian Zhang, Vinay Setty, Yumeng Wang, Avishek Anand

With the rapid advancement of neural language models, the deployment of over-parameterized models has surged, increasing the need for interpretable explanations comprehensible to human inspectors.

text-classification Text Classification

Croc: Pretraining Large Multimodal Models with Cross-Modal Comprehension

1 code implementation18 Oct 2024 Yin Xie, Kaicheng Yang, Ninghua Yang, Weimo Deng, Xiangzi Dai, Tiancheng Gu, Yumeng Wang, Xiang An, Yongle Zhao, Ziyong Feng, Roy Miles, Ismail Elezi, Jiankang Deng

Then, we conceptualize visual tokens as analogous to a "foreign language" for the LLMs and propose a mixed attention mechanism with bidirectional visual attention and unidirectional textual attention to comprehensively enhance the understanding of visual tokens.

Caption Generation

QUIDS: Query Intent Generation via Dual Space Modeling

no code implementations16 Oct 2024 Yumeng Wang, Xiuying Chen, Suzan Verberne

In this paper, we address the task of query intent generation: to automatically generate detailed and precise intent descriptions for search queries using relevant and irrelevant documents given a query.

Information Retrieval Retrieval

LoMA: Lossless Compressed Memory Attention

no code implementations16 Jan 2024 Yumeng Wang, Zhenyang Xiao

We introduce Lossless Compressed Memory Attention (LoMA), a novel approach that enables lossless compression of the KV cache, thereby reducing the memory and computational demands during autoregressive generation.

DoNet: Deep De-overlapping Network for Cytology Instance Segmentation

1 code implementation CVPR 2023 Hao Jiang, Rushan Zhang, Yanning Zhou, Yumeng Wang, Hao Chen

Cell instance segmentation in cytology images has significant importance for biology analysis and cancer screening, while remains challenging due to 1) the extensive overlapping translucent cell clusters that cause the ambiguous boundaries, and 2) the confusion of mimics and debris as nuclei.

Instance Segmentation Region Proposal +2

Explainable Information Retrieval: A Survey

no code implementations4 Nov 2022 Avishek Anand, Lijun Lyu, Maximilian Idahl, Yumeng Wang, Jonas Wallat, Zijian Zhang

Explainable information retrieval is an emerging research area aiming to make transparent and trustworthy information retrieval systems.

Information Retrieval Retrieval +1

BERT Rankers are Brittle: a Study using Adversarial Document Perturbations

1 code implementation23 Jun 2022 Yumeng Wang, Lijun Lyu, Avishek Anand

The aim of our algorithms is to add/replace a small number of tokens to a highly relevant or non-relevant document to cause a large rank demotion or promotion.

Document Ranking

A Black-Scholes user's guide to the Bachelier model

2 code implementations18 Apr 2021 Jaehyuk Choi, Minsuk Kwak, Chyng Wen Tee, Yumeng Wang

To cope with the negative oil futures price caused by the COVID-19 recession, global commodity futures exchanges temporarily switched the option model from Black--Scholes to Bachelier in 2020.

Management

Cannot find the paper you are looking for? You can Submit a new open access paper.