Search Results for author: Di Luo

Found 19 papers, 7 papers with code

QuanTA: Efficient High-Rank Fine-Tuning of LLMs with Quantum-Informed Tensor Adaptation

1 code implementation31 May 2024 Zhuo Chen, Rumen Dangovski, Charlotte Loh, Owen Dugan, Di Luo, Marin Soljačić

We propose Quantum-informed Tensor Adaptation (QuanTA), a novel, easy-to-implement, fine-tuning method with no inference overhead for large-scale pre-trained language models.

Arithmetic Reasoning

Leveraging 2D Information for Long-term Time Series Forecasting with Vanilla Transformers

1 code implementation22 May 2024 Xin Cheng, Xiuying Chen, Shuqi Li, Di Luo, Xun Wang, Dongyan Zhao, Rui Yan

A vertical slicing of this grid combines the variates at each time step into a \textit{time token}, while a horizontal slicing embeds the individual series across all time steps into a \textit{variate token}.

Time Series Time Series Forecasting +1

TENG: Time-Evolving Natural Gradient for Solving PDEs With Deep Neural Nets Toward Machine Precision

1 code implementation16 Apr 2024 Zhuo Chen, Jacob McCarran, Esteban Vizcaino, Marin Soljačić, Di Luo

Partial differential equations (PDEs) are instrumental for modeling dynamical systems in science and engineering.

Enhancing Job Recommendation through LLM-based Generative Adversarial Networks

no code implementations20 Jul 2023 Yingpeng Du, Di Luo, Rui Yan, Hongzhi Liu, Yang song, HengShu Zhu, Jie Zhang

However, directly leveraging LLMs to enhance recommendation results is not a one-size-fits-all solution, as LLMs may suffer from fabricated generation and few-shot problems, which degrade the quality of resume completion.

Lift Yourself Up: Retrieval-augmented Text Generation with Self Memory

1 code implementation3 May 2023 Xin Cheng, Di Luo, Xiuying Chen, Lemao Liu, Dongyan Zhao, Rui Yan

In this paper, by exploring the duality of the primal problem: better generation also prompts better memory, we propose a novel framework, selfmem, which addresses this limitation by iteratively employing a retrieval-augmented generator to create an unbounded memory pool and using a memory selector to choose one output as memory for the subsequent generation round.

Abstractive Text Summarization Dialogue Generation +2

GenPhys: From Physical Processes to Generative Models

no code implementations5 Apr 2023 Ziming Liu, Di Luo, Yilun Xu, Tommi Jaakkola, Max Tegmark

We introduce a general family, Generative Models from Physical Processes (GenPhys), where we translate partial differential equations (PDEs) describing physical processes to generative models.

ANTN: Bridging Autoregressive Neural Networks and Tensor Networks for Quantum Many-Body Simulation

1 code implementation NeurIPS 2023 Zhuo Chen, Laker Newhouse, Eddie Chen, Di Luo, Marin Soljačić

Quantum many-body physics simulation has important impacts on understanding fundamental science and has applications to quantum materials design and quantum technology.

Inductive Bias Tensor Networks

Artificial intelligence for artificial materials: moiré atom

no code implementations14 Mar 2023 Di Luo, Aidan P. Reddy, Trithep Devakul, Liang Fu

Moir\'e engineering in atomically thin van der Waals heterostructures creates artificial quantum materials with designer properties.

Q-Flow: Generative Modeling for Differential Equations of Open Quantum Dynamics with Normalizing Flows

no code implementations23 Feb 2023 Owen Dugan, Peter Y. Lu, Rumen Dangovski, Di Luo, Marin Soljačić

Studying the dynamics of open quantum systems can enable breakthroughs both in fundamental physics and applications to quantum engineering and quantum computation.

Simulating 2+1D Lattice Quantum Electrodynamics at Finite Density with Neural Flow Wavefunctions

no code implementations14 Dec 2022 Zhuo Chen, Di Luo, Kaiwen Hu, Bryan K. Clark

We present a neural flow wavefunction, Gauge-Fermion FlowNet, and use it to simulate 2+1D lattice compact quantum electrodynamics with finite density dynamical fermions.

Blocking

Gauge Equivariant Neural Networks for 2+1D U(1) Gauge Theory Simulations in Hamiltonian Formulation

no code implementations6 Nov 2022 Di Luo, Shunyue Yuan, James Stokes, Bryan K. Clark

Gauge Theory plays a crucial role in many areas in science, including high energy physics, condensed matter physics and quantum information science.

Variational Monte Carlo

QuACK: Accelerating Gradient-Based Quantum Optimization with Koopman Operator Learning

1 code implementation NeurIPS 2023 Di Luo, Jiayu Shen, Rumen Dangovski, Marin Soljačić

Quantum optimization, a key application of quantum computing, has traditionally been stymied by the linearly increasing complexity of gradient calculations with an increasing number of parameters.

Operator learning Quantum Machine Learning

Infinite Neural Network Quantum States: Entanglement and Training Dynamics

no code implementations1 Dec 2021 Di Luo, James Halverson

We study infinite limits of neural network quantum states ($\infty$-NNQS), which exhibit representation power through ensemble statistics, and also tractable gradient descent dynamics.

Spacetime Neural Network for High Dimensional Quantum Dynamics

no code implementations4 Aug 2021 Jiangran Wang, Zhuo Chen, Di Luo, Zhizhen Zhao, Vera Mikyoung Hur, Bryan K. Clark

We develop a spacetime neural network method with second order optimization for solving quantum dynamics from the high dimensional Schr\"{o}dinger equation.

Vocal Bursts Intensity Prediction

Gauge Invariant and Anyonic Symmetric Transformer and RNN Quantum States for Quantum Lattice Models

no code implementations18 Jan 2021 Di Luo, Zhuo Chen, Kaiwen Hu, Zhizhen Zhao, Vera Mikyoung Hur, Bryan K. Clark

Symmetries such as gauge invariance and anyonic symmetry play a crucial role in quantum many-body physics.

Gauge equivariant neural networks for quantum lattice gauge theories

no code implementations9 Dec 2020 Di Luo, Giuseppe Carleo, Bryan K. Clark, James Stokes

Gauge symmetries play a key role in physics appearing in areas such as quantum field theories of the fundamental particles and emergent degrees of freedom in quantum materials.

Deep Learning Enabled Strain Mapping of Single-Atom Defects in 2D Transition Metal Dichalcogenides with Sub-picometer Precision

1 code implementation22 Jan 2020 Chia-Hao Lee, Abid Khan, Di Luo, Tatiane P. Santos, Chuqiao Shi, Blanka E. Janicek, Sangmin Kang, Wenjuan Zhu, Nahil A. Sobh, André Schleife, Bryan K. Clark, Pinshane Y. Huang

2D materials offer an ideal platform to study the strain fields induced by individual atomic defects, yet challenges associated with radiation damage have so-far limited electron microscopy methods to probe these atomic-scale strain fields.

Materials Science Mesoscale and Nanoscale Physics

Cannot find the paper you are looking for? You can Submit a new open access paper.