Search Results for author: Jiayi Wang

Found 49 papers, 12 papers with code

Alibaba’s Submission for the WMT 2020 APE Shared Task: Improving Automatic Post-Editing with Pre-trained Conditional Cross-Lingual BERT

no code implementations WMT (EMNLP) 2020 Jiayi Wang, Ke Wang, Kai Fan, Yuqi Zhang, Jun Lu, Xin Ge, Yangbin Shi, Yu Zhao

We also apply an imitation learning strategy to augment a reasonable amount of pseudo APE training data, potentially preventing the model to overfit on the limited real training data and boosting the performance on held-out data.

Automatic Post-Editing Benchmarking +5

HTML: A Parametric Hand Texture Model for 3D Hand Reconstruction and Personalization

no code implementations ECCV 2020 Neng Qian, Jiayi Wang, Franziska Mueller, Florian Bernard, Vladislav Golyanik, Christian Theobalt

3D hand reconstruction from images is a widely-studied problem in computer vision and graphics, and has a particularly high relevance for virtual and augmented reality.

Neural Rendering

Edge-Enhanced Dilated Residual Attention Network for Multimodal Medical Image Fusion

1 code implementation18 Nov 2024 Meng Zhou, Yuxuan Zhang, Xiaolan Xu, Jiayi Wang, Farzad Khalvati

Multimodal medical image fusion is a crucial task that combines complementary information from different imaging modalities into a unified representation, thereby enhancing diagnostic accuracy and treatment planning.

Brain Tumor Classification

Multilingual Pretraining Using a Large Corpus Machine-Translated from a Single Source Language

no code implementations31 Oct 2024 Jiayi Wang, Yao Lu, Maurice Weber, Max Ryabinin, Yihong Chen, Raphael Tang, Pontus Stenetorp

English, as a very high-resource language, enables the pretraining of high-quality large language models (LLMs).

A New Theoretical Perspective on Data Heterogeneity in Federated Optimization

no code implementations22 Jul 2024 Jiayi Wang, Shiqiang Wang, Rong-Rong Chen, Mingyue Ji

In particular, for many FL algorithms, the convergence rate grows dramatically when the number of local updates becomes large, especially when the product of the gradient divergence and local Lipschitz constant is large.

Federated Learning

Label-free Neural Semantic Image Synthesis

no code implementations1 Jul 2024 Jiayi Wang, Kevin Alexander Laube, Yumeng Li, Jan Hendrik Metzen, Shin-I Cheng, Julio Borges, Anna Khoreva

Neural layouts are advantageous as they provide rich descriptions of the desired image, containing both semantics and detailed geometry of the scene.

Image Generation Semantic Segmentation

Truncated Variance Reduced Value Iteration

no code implementations21 May 2024 Yujia Jin, Ishani Karmarkar, Aaron Sidford, Jiayi Wang

We provide an $\tilde{O}(A_{\text{tot}}[(1 - \gamma)^{-3}\epsilon^{-2} + (1 - \gamma)^{-2}])$-time algorithm in the sampling setting, where the probability transition matrix is unknown but accessible through a generative model which can be queried in $\tilde{O}(1)$-time, and an $\tilde{O}(s + (1-\gamma)^{-2})$-time algorithm in the offline setting where the probability transition matrix is known and $s$-sparse.

UniRGB-IR: A Unified Framework for RGB-Infrared Semantic Tasks via Adapter Tuning

no code implementations26 Apr 2024 Maoxun Yuan, Bo Cui, Tianyi Zhao, Jiayi Wang, Shan Fu, Xingxing Wei

Semantic analysis on visible (RGB) and infrared (IR) images has gained attention for its ability to be more accurate and robust under low-illumination and complex weather conditions.

ODFormer: Semantic Fundus Image Segmentation Using Transformer for Optic Nerve Head Detection

no code implementations15 Apr 2024 Jiayi Wang, Yi-An Mao, Xiaoyu Ma, Sicen Guo, Yuting Shao, Xiao Lv, Wenting Han, Mark Christopher, Linda M. Zangwill, Yanlong Bi, Rui Fan

However, the significant discrepancy between fundus image datasets, each generated using a single type of fundus camera, poses challenges to the generalizability of ONH detection approaches developed based on semantic segmentation networks.

Head Detection Image Segmentation +1

DNABERT-S: Pioneering Species Differentiation with Species-Aware DNA Embeddings

2 code implementations13 Feb 2024 Zhihan Zhou, Weimin Wu, Harrison Ho, Jiayi Wang, Lizhen Shi, Ramana V Davuluri, Zhong Wang, Han Liu

We introduce DNABERT-S, a tailored genome model that develops species-aware embeddings to naturally cluster and segregate DNA sequences of different species in the embedding space.

Contrastive Learning

MPRE: Multi-perspective Patient Representation Extractor for Disease Prediction

no code implementations1 Jan 2024 Ziyue Yu, Jiayi Wang, Wuman Luo, Rita Tse, Giovanni Pau

Patient representation learning based on electronic health records (EHR) is a critical task for disease prediction.

Disease Prediction Representation Learning

3D Pose Estimation of Two Interacting Hands from a Monocular Event Camera

1 code implementation21 Dec 2023 Christen Millerdurai, Diogo Luvizon, Viktor Rudnev, André Jonas, Jiayi Wang, Christian Theobalt, Vladislav Golyanik

3D hand tracking from a monocular video is a very challenging problem due to hand interactions, occlusions, left-right hand ambiguity, and fast motion.

3D Pose Estimation 3D Reconstruction

Strings from the Library of Babel: Random Sampling as a Strong Baseline for Prompt Optimisation

1 code implementation16 Nov 2023 Yao Lu, Jiayi Wang, Raphael Tang, Sebastian Riedel, Pontus Stenetorp

Recent prompt optimisation approaches use the generative nature of language models to produce prompts -- even rivaling the performance of human-curated prompts.

Language Modelling text-classification +1

Synslator: An Interactive Machine Translation Tool with Online Learning

no code implementations8 Oct 2023 Jiayi Wang, Ke Wang, Fengming Zhou, Chengyu Wang, Zhiyong Fu, Zeyu Feng, Yu Zhao, Yuqi Zhang

Interactive machine translation (IMT) has emerged as a progression of the computer-aided translation paradigm, where the machine translation system and the human translator collaborate to produce high-quality translations.

Language Modelling Machine Translation +1

Non-parametric, Nearest-neighbor-assisted Fine-tuning for Neural Machine Translation

no code implementations23 May 2023 Jiayi Wang, Ke Wang, Yuqi Zhang, Yu Zhao, Pontus Stenetorp

We explore whether such non-parametric models can improve machine translation models at the fine-tuning stage by incorporating statistics from the kNN predictions to inform the gradient updates for a baseline translation model.

Machine Translation Translation

ADELT: Transpilation Between Deep Learning Frameworks

no code implementations7 Mar 2023 Linyuan Gong, Jiayi Wang, Alvin Cheung

We propose the Adversarial DEep Learning Transpiler (ADELT), a novel approach to source-to-source transpilation between deep learning frameworks.

Deep Learning

Cost-aware Defense for Parallel Server Systems against Reliability and Security Failures

no code implementations27 Jan 2023 Qian Xie, Jiayi Wang, Li Jin

Parallel server systems in transportation, manufacturing, and computing heavily rely on dynamic routing using connected cyber components for computation and communication.

TSMind: Alibaba and Soochow University's Submission to the WMT22 Translation Suggestion Task

no code implementations16 Nov 2022 Xin Ge, Ke Wang, Jiayi Wang, Nini Xiao, Xiangyu Duan, Yu Zhao, Yuqi Zhang

The leader board finally shows that our submissions are ranked first in three of four language directions in the Naive TS task of the WMT22 Translation Suggestion task.

Data Augmentation Language Modelling +1

Easy Guided Decoding in Providing Suggestions for Interactive Machine Translation

1 code implementation14 Nov 2022 Ke Wang, Xin Ge, Jiayi Wang, Yu Zhao, Yuqi Zhang

Human translators perform post editing on machine translations to correct errors in the scene of computer aided translation.

Machine Translation NMT +1

HandFlow: Quantifying View-Dependent 3D Ambiguity in Two-Hand Reconstruction with Normalizing Flow

no code implementations4 Oct 2022 Jiayi Wang, Diogo Luvizon, Franziska Mueller, Florian Bernard, Adam Kortylewski, Dan Casas, Christian Theobalt

Through this, we demonstrate the quality of our probabilistic reconstruction and show that explicit ambiguity modeling is better-suited for this challenging problem.

valid

Blessing from Human-AI Interaction: Super Reinforcement Learning in Confounded Environments

no code implementations29 Sep 2022 Jiayi Wang, Zhengling Qi, Chengchun Shi

This approach utilizes the observed action, either from AI or humans, as input for achieving a stronger oracle in policy learning for the decision maker (humans or AI).

Decision Making reinforcement-learning +3

Rethinking Textual Adversarial Defense for Pre-trained Language Models

no code implementations21 Jul 2022 Jiayi Wang, Rongzhou Bao, Zhuosheng Zhang, Hai Zhao

However, we find that most existing textual adversarial examples are unnatural, which can be easily distinguished by both human and machine.

Adversarial Attack Adversarial Defense +1

Few-shot Fine-grained Image Classification via Multi-Frequency Neighborhood and Double-cross Modulation

1 code implementation18 Jul 2022 Hegui Zhu, Zhan Gao, Jiayi Wang, Yange Zhou, Chengqing Li

The comprehensive experiments on three fine-grained benchmark datasets for two few-shot tasks verify that FicNet has excellent performance compared to the state-of-the-art methods.

Classification Fine-Grained Image Classification

Revisiting Vicinal Risk Minimization for Partially Supervised Multi-Label Classification Under Data Scarcity

no code implementations19 Apr 2022 Nanqing Dong, Jiayi Wang, Irina Voiculescu

Due to the high human cost of annotation, it is non-trivial to curate a large-scale medical dataset that is fully labeled for all classes of interest.

Multi-Label Classification Open-Ended Question Answering +1

Distinguishing Non-natural from Natural Adversarial Samples for More Robust Pre-trained Language Model

1 code implementation Findings (ACL) 2022 Jiayi Wang, Rongzhou Bao, Zhuosheng Zhang, Hai Zhao

We question the validity of current evaluation of robustness of PrLMs based on these non-natural adversarial samples and propose an anomaly detector to evaluate the robustness of PrLMs with more natural adversarial samples.

Data Augmentation Language Modelling

QEMind: Alibaba's Submission to the WMT21 Quality Estimation Shared Task

no code implementations30 Dec 2021 Jiayi Wang, Ke Wang, Boxing Chen, Yu Zhao, Weihua Luo, Yuqi Zhang

Quality Estimation, as a crucial step of quality control for machine translation, has been explored for years.

Machine Translation Sentence +1

Projected State-action Balancing Weights for Offline Reinforcement Learning

no code implementations10 Sep 2021 Jiayi Wang, Zhengling Qi, Raymond K. W. Wong

Offline policy evaluation (OPE) is considered a fundamental and challenging problem in reinforcement learning (RL).

Causal Inference reinforcement-learning +2

RGB2Hands: Real-Time Tracking of 3D Hand Interactions from Monocular RGB Video

no code implementations22 Jun 2021 Jiayi Wang, Franziska Mueller, Florian Bernard, Suzanne Sorli, Oleksandr Sotnychenko, Neng Qian, Miguel A. Otaduy, Dan Casas, Christian Theobalt

Moreover, we demonstrate that our approach offers previously unseen two-hand tracking performance from RGB, and quantitatively and qualitatively outperforms existing RGB-based methods that were not explicitly designed for two-hand interactions.

3D Reconstruction Sign Language Recognition

Matrix Completion with Model-free Weighting

no code implementations9 Jun 2021 Jiayi Wang, Raymond K. W. Wong, Xiaojun Mao, Kwun Chuen Gary Chan

In particular, the proposed method achieves a stronger guarantee than existing work in terms of the scaling with respect to the observation probabilities, under asymptotically heterogeneous missing settings (where entry-wise observation probabilities can be of different orders).

Matrix Completion

Defending Pre-trained Language Models from Adversarial Word Substitutions Without Performance Sacrifice

1 code implementation30 May 2021 Rongzhou Bao, Jiayi Wang, Hai Zhao

In detail, we design an auxiliary anomaly detection classifier and adopt a multi-task learning procedure, by which PrLMs are able to distinguish adversarial input samples.

Adversarial Attack Anomaly Detection +2

Enhancing Pre-trained Language Model with Lexical Simplification

no code implementations30 Dec 2020 Rongzhou Bao, Jiayi Wang, Zhuosheng Zhang, Hai Zhao

By substituting complex words with simple alternatives, lexical simplification (LS) is a recognized method to reduce such lexical diversity, and therefore to improve the understandability of sentences.

Diversity General Classification +5

EventHands: Real-Time Neural 3D Hand Pose Estimation from an Event Stream

1 code implementation ICCV 2021 Viktor Rudnev, Vladislav Golyanik, Jiayi Wang, Hans-Peter Seidel, Franziska Mueller, Mohamed Elgharib, Christian Theobalt

Due to the different data modality of event cameras compared to classical cameras, existing methods cannot be directly applied to and re-trained for event streams.

3D Hand Pose Estimation

Demystifying Why Local Aggregation Helps: Convergence Analysis of Hierarchical SGD

1 code implementation24 Oct 2020 Jiayi Wang, Shiqiang Wang, Rong-Rong Chen, Mingyue Ji

Furthermore, we extend our analytical approach based on "upward" and "downward" divergences to study the convergence for the general case of H-SGD with more than two levels, where the "sandwich behavior" still holds.

Federated Learning

Convex Optimisation for Inverse Kinematics

no code implementations24 Oct 2019 Tarun Yenamandra, Florian Bernard, Jiayi Wang, Franziska Mueller, Christian Theobalt

We consider the problem of inverse kinematics (IK), where one wants to find the parameters of a given kinematic skeleton that best explain a set of observed 3D joint locations.

Neural Zero-Inflated Quality Estimation Model For Automatic Speech Recognition System

no code implementations3 Oct 2019 Kai Fan, Jiayi Wang, Bo Li, Shiliang Zhang, Boxing Chen, Niyu Ge, Zhijie Yan

The performances of automatic speech recognition (ASR) systems are usually evaluated by the metric word error rate (WER) when the manually transcribed data are provided, which are, however, expensively available in the real scenario.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +4

An encoding framework with brain inner state for natural image identification

no code implementations22 Aug 2019 Hao Wu, Ziyu Zhu, Jiayi Wang, Nanning Zheng, Badong Chen

The framework comprises two parts: forward encoding model that deals with visual stimuli and inner state model that captures influence from intrinsic connections in the brain.

Brain Decoding

Low-Rank Phase Retrieval via Variational Bayesian Learning

no code implementations5 Nov 2018 Kaihui Liu, Jiayi Wang, Zhengli Xing, Linxiao Yang, Jun Fang

We propose a hierarchical prior model for low-rank phase retrieval, in which a Gaussian-Wishart hierarchical prior is placed on the underlying low-rank matrix to promote the low-rankness of the matrix.

Retrieval

Alibaba Submission for WMT18 Quality Estimation Task

no code implementations WS 2018 Jiayi Wang, Kai Fan, Bo Li, Fengming Zhou, Boxing Chen, Yangbin Shi, Luo Si

The goal of WMT 2018 Shared Task on Translation Quality Estimation is to investigate automatic methods for estimating the quality of machine translation results without reference translations.

Automatic Post-Editing Language Modelling +2

"Bilingual Expert" Can Find Translation Errors

1 code implementation25 Jul 2018 Kai Fan, Jiayi Wang, Bo Li, Fengming Zhou, Boxing Chen, Luo Si

Recent advances in statistical machine translation via the adoption of neural sequence-to-sequence models empower the end-to-end system to achieve state-of-the-art in many WMT benchmarks.

Language Modelling Machine Translation +1

Cannot find the paper you are looking for? You can Submit a new open access paper.