Search Results for author: Yuanqi Du

Found 47 papers, 25 papers with code

Large Language Model is Secretly a Protein Sequence Optimizer

no code implementations16 Jan 2025 Yinkai Wang, Jiaxing He, Yuanqi Du, Xiaohui Chen, Jianan Canal Li, Li-Ping Liu, Xiaolin Xu, Soha Hassoun

We consider the protein sequence engineering problem, which aims to find protein sequences with high fitness levels, starting from a given wild-type sequence.

AlphaNet: Scaling Up Local Frame-based Atomistic Foundation Model

1 code implementation13 Jan 2025 Bangchen Yin, Jiaao Wang, Weitao Du, Pengbo Wang, Penghua Ying, Haojun Jia, Zisheng Zhang, Yuanqi Du, Carla P. Gomes, Chenru Duan, Hai Xiao, Graeme Henkelman

We present AlphaNet, a local frame-based equivariant model designed to achieve both accurate and efficient simulations for atomistic systems.

Computational Efficiency

Graph Generative Pre-trained Transformer

no code implementations2 Jan 2025 Xiaohui Chen, Yinkai Wang, Jiaxing He, Yuanqi Du, Soha Hassoun, Xiaolin Xu, Li-Ping Liu

We advocate for this approach due to its efficient encoding of graphs and propose a novel representation.

Graph Generation Graph Property Prediction +1

Generative Design of Functional Metal Complexes Utilizing the Internal Knowledge of Large Language Models

no code implementations21 Oct 2024 Jieyu Lu, Zhangde Song, Qiyuan Zhao, Yuanqi Du, Yirui Cao, Haojun Jia, Chenru Duan

We integrate large language models (LLMs) into the evolutionary optimization framework (LLM-EO) and apply it in both single- and multi-objective optimization for TMCs.

Prompt Engineering

Generalized Flow Matching for Transition Dynamics Modeling

no code implementations19 Oct 2024 Haibo Wang, Yuxuan Qiu, Yanze Wang, Rob Brekelmans, Yuanqi Du

Simulating transition dynamics between metastable states is a fundamental challenge in dynamical systems and stochastic processes with wide real-world applications in understanding protein folding, chemical reactions and neural activities.

Protein Folding

Doob's Lagrangian: A Sample-Efficient Variational Approach to Transition Path Sampling

1 code implementation10 Oct 2024 Yuanqi Du, Michael Plainer, Rob Brekelmans, Chenru Duan, Frank Noé, Carla P. Gomes, Alán Aspuru-Guzik, Kirill Neklyudov

Rare event sampling in dynamical systems is a fundamental problem arising in the natural sciences, which poses significant computational challenges due to an exponentially large space of trajectories.

Protein Folding

Efficient Evolutionary Search Over Chemical Space with Large Language Models

1 code implementation23 Jun 2024 Haorui Wang, Marta Skreta, Cher-Tian Ser, Wenhao Gao, Lingkai Kong, Felix Strieth-Kalthoff, Chenru Duan, Yuchen Zhuang, Yue Yu, Yanqiao Zhu, Yuanqi Du, Alán Aspuru-Guzik, Kirill Neklyudov, Chao Zhang

Molecular discovery, when formulated as an optimization problem, presents significant computational challenges because optimization objectives can be non-differentiable.

Drug Design Evolutionary Algorithms

Aligning Large Language Models with Representation Editing: A Control Perspective

1 code implementation10 Jun 2024 Lingkai Kong, Haorui Wang, Wenhao Mu, Yuanqi Du, Yuchen Zhuang, Yifei Zhou, Yue Song, Rongzhi Zhang, Kai Wang, Chao Zhang

To achieve alignment for specific objectives, we introduce external control signals into the state space of this language dynamical system.

Navigating Chemical Space with Latent Flows

1 code implementation7 May 2024 Guanghao Wei, Yining Huang, Chenru Duan, Yue Song, Yuanqi Du

In this paper, we propose a new framework, ChemFlow, to traverse chemical space through navigating the latent space learned by molecule generative models through flows.

Diversity Drug Design +1

React-OT: Optimal Transport for Generating Transition State in Chemical Reactions

no code implementations20 Apr 2024 Chenru Duan, Guan-Horng Liu, Yuanqi Du, Tianrong Chen, Qiyuan Zhao, Haojun Jia, Carla P. Gomes, Evangelos A. Theodorou, Heather J. Kulik

The RMSD and barrier height error is further improved by roughly 25\% through pretraining React-OT on a large reaction dataset obtained with a lower level of theory, GFN2-xTB.

Diffusion Models as Constrained Samplers for Optimization with Unknown Constraints

no code implementations28 Feb 2024 Lingkai Kong, Yuanqi Du, Wenhao Mu, Kirill Neklyudov, Valentin De Bortoli, Dongxia Wu, Haorui Wang, Aaron Ferber, Yi-An Ma, Carla P. Gomes, Chao Zhang

To constrain the optimization process to the data manifold, we reformulate the original optimization problem as a sampling problem from the product of the Boltzmann distribution defined by the objective function and the data distribution learned by the diffusion model.

On Separate Normalization in Self-supervised Transformers

1 code implementation NeurIPS 2023 Xiaohui Chen, Yinkai Wang, Yuanqi Du, Soha Hassoun, Li-Ping Liu

Self-supervised training methods for transformers have demonstrated remarkable performance across various domains.

Uncovering Neural Scaling Laws in Molecular Representation Learning

2 code implementations NeurIPS 2023 Dingshuo Chen, Yanqiao Zhu, Jieyu Zhang, Yuanqi Du, ZHIXUN LI, Qiang Liu, Shu Wu, Liang Wang

Molecular Representation Learning (MRL) has emerged as a powerful tool for drug and materials discovery in a variety of tasks such as virtual screening and inverse design.

molecular representation Representation Learning

MUBen: Benchmarking the Uncertainty of Molecular Representation Models

2 code implementations14 Jun 2023 Yinghao Li, Lingkai Kong, Yuanqi Du, Yue Yu, Yuchen Zhuang, Wenhao Mu, Chao Zhang

While some studies have included UQ to improve molecular pre-trained models, the process of selecting suitable backbone and UQ methods for reliable molecular uncertainty estimation remains underexplored.

Benchmarking Drug Discovery +4

Accurate transition state generation with an object-aware equivariant elementary reaction diffusion model

1 code implementation12 Apr 2023 Chenru Duan, Yuanqi Du, Haojun Jia, Heather J. Kulik

Provided reactant and product, this model generates a TS structure in seconds instead of hours required when performing quantum chemistry-based optimizations.

Uncertainty Quantification

Xtal2DoS: Attention-based Crystal to Sequence Learning for Density of States Prediction

no code implementations3 Feb 2023 Junwen Bai, Yuanqi Du, Yingheng Wang, Shufeng Kong, John Gregoire, Carla Gomes

Modern machine learning techniques have been extensively applied to materials science, especially for property prediction tasks.

Property Prediction

Audio-Driven Co-Speech Gesture Video Generation

no code implementations5 Dec 2022 Xian Liu, Qianyi Wu, Hang Zhou, Yuanqi Du, Wayne Wu, Dahua Lin, Ziwei Liu

Our key insight is that the co-speech gestures can be decomposed into common motion patterns and subtle rhythmic dynamics.

Video Generation

A Systematic Survey of Chemical Pre-trained Models

2 code implementations29 Oct 2022 Jun Xia, Yanqiao Zhu, Yuanqi Du, Stan Z. Li

Deep learning has achieved remarkable success in learning representations for molecules, which is crucial for various biochemical applications, ranging from property prediction to drug design.

Drug Design molecular representation +2

Structure-based Drug Design with Equivariant Diffusion Models

2 code implementations24 Oct 2022 Arne Schneuing, Charles Harris, Yuanqi Du, Kieran Didi, Arian Jamasb, Ilia Igashov, Weitao Du, Carla Gomes, Tom Blundell, Pietro Lio, Max Welling, Michael Bronstein, Bruno Correia

Here we show how a single pre-trained diffusion model can be applied to a broader range of problems, such as off-the-shelf property optimization, explicit negative design, and partial molecular design with inpainting.

Drug Design Specificity

Multi-objective Deep Data Generation with Correlated Property Control

1 code implementation1 Oct 2022 Shiyu Wang, Xiaojie Guo, Xuanyang Lin, Bo Pan, Yuanqi Du, Yinkai Wang, Yanfang Ye, Ashley Ann Petersen, Austin Leitgeb, Saleh AlKhalifa, Kevin Minbiole, William Wuest, Amarda Shehu, Liang Zhao

Developing deep generative models has been an emerging field due to the ability to model and generate complex data for various purposes, such as image synthesis and molecular design.

Image Generation

Improving Molecular Pretraining with Complementary Featurizations

1 code implementation29 Sep 2022 Yanqiao Zhu, Dingshuo Chen, Yuanqi Du, Yingze Wang, Qiang Liu, Shu Wu

Molecular pretraining, which learns molecular representations over massive unlabeled data, has become a prominent paradigm to solve a variety of tasks in computational chemistry and drug discovery.

Computational chemistry Drug Discovery +2

Controllable Data Generation by Deep Learning: A Review

no code implementations19 Jul 2022 Shiyu Wang, Yuanqi Du, Xiaojie Guo, Bo Pan, Zhaohui Qin, Liang Zhao

This article is a systematic review that explains this promising research area, commonly known as controllable deep data generation.

Deep Learning Speech Synthesis

Stochastic Optimal Control for Collective Variable Free Sampling of Molecular Transition Paths

1 code implementation NeurIPS 2023 Lars Holdijk, Yuanqi Du, Ferry Hooft, Priyank Jaini, Bernd Ensing, Max Welling

We consider the problem of sampling transition paths between two given metastable states of a molecular system, e. g. a folded and unfolded protein or products and reactants of a chemical reaction.

Dimensionality Reduction

A Flexible Diffusion Model

no code implementations17 Jun 2022 Weitao Du, Tao Yang, He Zhang, Yuanqi Du

Despite the empirical success of the hand-crafted fixed forward SDEs, a great quantity of proper forward SDEs remain unexplored.

Pik-Fix: Restoring and Colorizing Old Photos

1 code implementation4 May 2022 Runsheng Xu, Zhengzhong Tu, Yuanqi Du, Xiaoyu Dong, Jinlong Li, Zibo Meng, Jiaqi Ma, Alan Bovik, Hongkai Yu

Our proposed framework consists of three modules: a restoration sub-network that conducts restoration from degradations, a similarity network that performs color histogram matching and color transfer, and a colorization subnet that learns to predict the chroma elements of images conditioned on chromatic reference signals.

Colorization

MolGenSurvey: A Systematic Survey in Machine Learning Models for Molecule Design

no code implementations28 Mar 2022 Yuanqi Du, Tianfan Fu, Jimeng Sun, Shengchao Liu

Recently, with the rapid development of machine learning methods, especially generative methods, molecule design has achieved great progress by leveraging machine learning models to generate candidate molecules.

3D geometry BIG-bench Machine Learning +2

A Survey on Deep Graph Generation: Methods and Applications

no code implementations13 Mar 2022 Yanqiao Zhu, Yuanqi Du, Yinkai Wang, Yichen Xu, Jieyu Zhang, Qiang Liu, Shu Wu

In this paper, we conduct a comprehensive review on the existing literature of deep graph generation from a variety of emerging methods to its wide application areas.

Graph Generation Graph Learning +1

Recovering medical images from CT film photos

no code implementations10 Mar 2022 Quan Quan, Qiyuan Wang, Yuanqi Du, Liu Li, S. Kevin Zhou

While medical images such as computed tomography (CT) are stored in DICOM format in hospital PACS, it is still quite routine in many countries to print a film as a transferable medium for the purposes of self-storage and secondary consultation.

Computed Tomography (CT)

Interpretable Molecular Graph Generation via Monotonic Constraints

no code implementations28 Feb 2022 Yuanqi Du, Xiaojie Guo, Amarda Shehu, Liang Zhao

Recent advances in deep graph generative models treat molecule design as graph generation problems which provide new opportunities toward the breakthrough of this long-lasting problem.

Disentanglement Drug Discovery +2

Disentangled Spatiotemporal Graph Generative Models

no code implementations28 Feb 2022 Yuanqi Du, Xiaojie Guo, Hengning Cao, Yanfang Ye, Liang Zhao

Spatiotemporal graph represents a crucial data structure where the nodes and edges are embedded in a geometric space and can evolve dynamically over time.

Disentanglement Functional Connectivity +2

A Survey of Pretraining on Graphs: Taxonomy, Methods, and Applications

3 code implementations16 Feb 2022 Jun Xia, Yanqiao Zhu, Yuanqi Du, Stan Z. Li

Pretrained Language Models (PLMs) such as BERT have revolutionized the landscape of Natural Language Processing (NLP).

Drug Discovery Graph Representation Learning +1

ROMNet: Renovate the Old Memories

no code implementations5 Feb 2022 Runsheng Xu, Zhengzhong Tu, Yuanqi Du, Xiaoyu Dong, Jinlong Li, Zibo Meng, Jiaqi Ma, Hongkai Yu

Renovating the memories in old photos is an intriguing research topic in computer vision fields.

Colorization

Graph-based Ensemble Machine Learning for Student Performance Prediction

no code implementations15 Dec 2021 Yinkai Wang, Aowei Ding, Kaiyi Guan, Shixi Wu, Yuanqi Du

Student performance prediction is a critical research problem to understand the students' needs, present proper learning opportunities/resources, and develop the teaching quality.

BIG-bench Machine Learning Clustering

SE(3) Equivariant Graph Neural Networks with Complete Local Frames

1 code implementation26 Oct 2021 Weitao Du, He Zhang, Yuanqi Du, Qi Meng, Wei Chen, Bin Shao, Tie-Yan Liu

In this paper, we propose a framework to construct SE(3) equivariant graph neural networks that can approximate the geometric quantities efficiently.

Computational Efficiency

Interpreting Molecule Generative Models for Interactive Molecule Discovery

no code implementations29 Sep 2021 Yuanqi Du, Xian Liu, Shengchao Liu, Bolei Zhou

In this work, we develop a simple yet effective method to interpret the latent space of the learned generative models with various molecular properties for more interactive molecule generation and discovery.

Drug Discovery

GraphGT: Machine Learning Datasets for Graph Generation and Transformation

1 code implementation NeurIPS Workshop AI4Scien 2021 Yuanqi Du, Shiyu Wang, Xiaojie Guo, Hengning Cao, Shujie Hu, Junji Jiang, Aishwarya Varala, Abhinav Angirekula, Liang Zhao

Graph generation, which learns from known graphs and discovers novel graphs, has great potential in numerous research topics like drug design and mobility synthesis and is one of the fastest-growing domains recently due to its promise for discovering new knowledge.

BIG-bench Machine Learning Drug Design +2

Where is the disease? Semi-supervised pseudo-normality synthesis from an abnormal image

no code implementations24 Jun 2021 Yuanqi Du, Quan Quan, Hu Han, S. Kevin Zhou

Pseudo-normality synthesis, which computationally generates a pseudo-normal image from an abnormal one (e. g., with lesions), is critical in many perspectives, from lesion detection, data augmentation to clinical surgery suggestion.

Data Augmentation Image Generation +3

A Survey on Graph Structure Learning: Progress and Opportunities

no code implementations4 Mar 2021 Yanqiao Zhu, Weizhi Xu, Jinghao Zhang, Yuanqi Du, Jieyu Zhang, Qiang Liu, Carl Yang, Shu Wu

Specifically, we first formulate a general pipeline of GSL and review state-of-the-art methods classified by the way of modeling graph structures, followed by applications of GSL across domains.

Graph structure learning Survey

Property Controllable Variational Autoencoder via Invertible Mutual Dependence

1 code implementation ICLR 2021 Xiaojie Guo, Yuanqi Du, Liang Zhao

Deep generative models have made important progress towards modeling complex, high dimensional data via learning latent representations.

Disentanglement

CT Film Recovery via Disentangling Geometric Deformation and Illumination Variation: Simulated Datasets and Deep Models

no code implementations17 Dec 2020 Quan Quan, Qiyuan Wang, Liu Li, Yuanqi Du, S. Kevin Zhou

We also record all accompanying information related to the geometric deformation (such as 3D coordinate, depth, normal, and UV maps) and illumination variation (such as albedo map).

Computed Tomography (CT)

Deep Learning to Segment Pelvic Bones: Large-scale CT Datasets and Baseline Models

1 code implementation16 Dec 2020 Pengbo Liu, Hu Han, Yuanqi Du, Heqin Zhu, Yinhao Li, Feng Gu, Honghu Xiao, Jun Li, Chunpeng Zhao, Li Xiao, Xinbao Wu, S. Kevin Zhou

Due to the lack of a large-scale pelvic CT dataset with annotations, deep learning methods are not fully explored.

Generating Tertiary Protein Structures via an Interpretative Variational Autoencoder

1 code implementation8 Apr 2020 Xiaojie Guo, Yuanqi Du, Sivani Tadepalli, Liang Zhao, Amarda Shehu

Much scientific enquiry across disciplines is founded upon a mechanistic treatment of dynamic systems that ties form to function.

Protein Structure Prediction Stochastic Optimization

Cannot find the paper you are looking for? You can Submit a new open access paper.