Search Results for author: Ziyi Yin

Found 14 papers, 8 papers with code

VQAttack: Transferable Adversarial Attacks on Visual Question Answering via Pre-trained Models

no code implementations16 Feb 2024 Ziyi Yin, Muchao Ye, Tianrong Zhang, Jiaqi Wang, Han Liu, Jinghui Chen, Ting Wang, Fenglong Ma

Correspondingly, we propose a novel VQAttack model, which can iteratively generate both image and text perturbations with the designed modules: the large language model (LLM)-enhanced image attack and the cross-modal joint attack module.

Adversarial Robustness Language Modelling +3

Recent Advances in Predictive Modeling with Electronic Health Records

no code implementations2 Feb 2024 Jiaqi Wang, Junyu Luo, Muchao Ye, Xiaochen Wang, Yuan Zhong, Aofei Chang, Guanjie Huang, Ziyi Yin, Cao Xiao, Jimeng Sun, Fenglong Ma

This survey systematically reviews recent advances in deep learning-based predictive models using EHR data.

WISE: full-Waveform variational Inference via Subsurface Extensions

no code implementations11 Dec 2023 Ziyi Yin, Rafael Orozco, Mathias Louboutin, Felix J. Herrmann

We introduce a probabilistic technique for full-waveform inversion, employing variational inference and conditional normalizing flows to quantify uncertainty in migration-velocity models and its impact on imaging.

Variational Inference

Inference of CO2 flow patterns -- a feasibility study

no code implementations1 Nov 2023 Abhinav Prakash Gahlot, Huseyin Tuna Erdinc, Rafael Orozco, Ziyi Yin, Felix J. Herrmann

To arrive at a formulation capable of inferring flow patterns for regular and irregular flow from well and seismic data, the performance of conditional normalizing flow will be analyzed on a series of carefully designed numerical experiments.

Hierarchical Pretraining on Multimodal Electronic Health Records

1 code implementation11 Oct 2023 Xiaochen Wang, Junyu Luo, Jiaqi Wang, Ziyi Yin, Suhan Cui, Yuan Zhong, Yaqing Wang, Fenglong Ma

Pretraining has proven to be a powerful technique in natural language processing (NLP), exhibiting remarkable success in various NLP downstream tasks.

VLATTACK: Multimodal Adversarial Attacks on Vision-Language Tasks via Pre-trained Models

1 code implementation NeurIPS 2023 Ziyi Yin, Muchao Ye, Tianrong Zhang, Tianyu Du, Jinguo Zhu, Han Liu, Jinghui Chen, Ting Wang, Fenglong Ma

In this paper, we aim to investigate a new yet practical task to craft image and text perturbations using pre-trained VL models to attack black-box fine-tuned models on different downstream tasks.

Adversarial Robustness

MedDiffusion: Boosting Health Risk Prediction via Diffusion-based Data Augmentation

no code implementations4 Oct 2023 Yuan Zhong, Suhan Cui, Jiaqi Wang, Xiaochen Wang, Ziyi Yin, Yaqing Wang, Houping Xiao, Mengdi Huai, Ting Wang, Fenglong Ma

Health risk prediction is one of the fundamental tasks under predictive modeling in the medical domain, which aims to forecast the potential health risks that patients may face in the future using their historical Electronic Health Records (EHR).

Data Augmentation

Solving multiphysics-based inverse problems with learned surrogates and constraints

1 code implementation18 Jul 2023 Ziyi Yin, Rafael Orozco, Mathias Louboutin, Felix J. Herrmann

Solving multiphysics-based inverse problems for geological carbon storage monitoring can be challenging when multimodal time-lapse data are expensive to collect and costly to simulate numerically.

Learned multiphysics inversion with differentiable programming and machine learning

1 code implementation12 Apr 2023 Mathias Louboutin, Ziyi Yin, Rafael Orozco, Thomas J. Grady II, Ali Siahkoohi, Gabrio Rizzuti, Philipp A. Witte, Olav Møyner, Gerard J. Gorman, Felix J. Herrmann

We present the Seismic Laboratory for Imaging and Modeling/Monitoring (SLIM) open-source software framework for computational geophysics and, more generally, inverse problems involving the wave-equation (e. g., seismic and medical ultrasound), regularization with learned priors, and learned neural surrogates for multiphase flow simulations.

Geophysics

De-risking Carbon Capture and Sequestration with Explainable CO2 Leakage Detection in Time-lapse Seismic Monitoring Images

1 code implementation16 Dec 2022 Huseyin Tuna Erdinc, Abhinav Prakash Gahlot, Ziyi Yin, Mathias Louboutin, Felix J. Herrmann

With the growing global deployment of carbon capture and sequestration technology to combat climate change, monitoring and detection of potential CO2 leakage through existing or storage induced faults are critical to the safe and long-term viability of the technology.

Binary Classification Seismic Imaging

De-risking geological carbon storage from high resolution time-lapse seismic to explainable leakage detection

1 code implementation7 Oct 2022 Ziyi Yin, Huseyin Tuna Erdinc, Abhinav Prakash Gahlot, Mathias Louboutin, Felix J. Herrmann

Amongst the different monitoring modalities, seismic imaging stands out with its ability to attain high resolution and high fidelity images.

Seismic Imaging

Model-Parallel Fourier Neural Operators as Learned Surrogates for Large-Scale Parametric PDEs

1 code implementation4 Apr 2022 Thomas J. Grady II, Rishi Khan, Mathias Louboutin, Ziyi Yin, Philipp A. Witte, Ranveer Chandra, Russell J. Hewett, Felix J. Herrmann

Fourier neural operators (FNOs) are a recently introduced neural network architecture for learning solution operators of partial differential equations (PDEs), which have been shown to perform significantly better than comparable deep learning approaches.

Learned coupled inversion for carbon sequestration monitoring and forecasting with Fourier neural operators

1 code implementation27 Mar 2022 Ziyi Yin, Ali Siahkoohi, Mathias Louboutin, Felix J. Herrmann

We show that we can accurately use a Fourier neural operator as a proxy for the fluid-flow simulator for a fraction of the computational cost.

Attention-Oriented Action Recognition for Real-Time Human-Robot Interaction

no code implementations2 Jul 2020 Ziyang Song, Ziyi Yin, Zejian yuan, Chong Zhang, Wanchao Chi, Yonggen Ling, Shenghao Zhang

Despite the notable progress made in action recognition tasks, not much work has been done in action recognition specifically for human-robot interaction.

Action Recognition Pose Estimation

Cannot find the paper you are looking for? You can Submit a new open access paper.