no code implementations • 18 Jul 2024 • Minyang Tian, Luyu Gao, Shizhuo Dylan Zhang, Xinan Chen, Cunwei Fan, Xuefei Guo, Roland Haas, Pan Ji, Kittithat Krongchon, Yao Li, Shengyan Liu, Di Luo, Yutao Ma, Hao Tong, Kha Trinh, Chenyu Tian, Zihan Wang, Bohao Wu, Yanyu Xiong, Shengzhu Yin, Minhui Zhu, Kilian Lieret, Yanxin Lu, Genglin Liu, Yufeng Du, Tianhua Tao, Ofir Press, Jamie Callan, Eliu Huerta, Hao Peng
Since language models (LMs) now outperform average humans on many challenging tasks, it has become increasingly difficult to develop challenging, high-quality, and realistic evaluations.
1 code implementation • 31 May 2024 • Zhuo Chen, Rumen Dangovski, Charlotte Loh, Owen Dugan, Di Luo, Marin Soljačić
We propose Quantum-informed Tensor Adaptation (QuanTA), a novel, easy-to-implement, fine-tuning method with no inference overhead for large-scale pre-trained language models.
1 code implementation • 22 May 2024 • Xin Cheng, Xiuying Chen, Shuqi Li, Di Luo, Xun Wang, Dongyan Zhao, Rui Yan
A vertical slicing of this grid combines the variates at each time step into a \textit{time token}, while a horizontal slicing embeds the individual series across all time steps into a \textit{variate token}.
Ranked #34 on Time Series Forecasting on ETTh1 (336) Multivariate
1 code implementation • 16 Apr 2024 • Zhuo Chen, Jacob McCarran, Esteban Vizcaino, Marin Soljačić, Di Luo
Partial differential equations (PDEs) are instrumental for modeling dynamical systems in science and engineering.
no code implementations • 3 Nov 2023 • Di Luo, David D. Dai, Liang Fu
We develop a pairing-based graph neural network for simulating quantum many-body systems.
no code implementations • 20 Jul 2023 • Yingpeng Du, Di Luo, Rui Yan, Hongzhi Liu, Yang song, HengShu Zhu, Jie Zhang
However, directly leveraging LLMs to enhance recommendation results is not a one-size-fits-all solution, as LLMs may suffer from fabricated generation and few-shot problems, which degrade the quality of resume completion.
1 code implementation • 3 May 2023 • Xin Cheng, Di Luo, Xiuying Chen, Lemao Liu, Dongyan Zhao, Rui Yan
In this paper, by exploring the duality of the primal problem: better generation also prompts better memory, we propose a novel framework, selfmem, which addresses this limitation by iteratively employing a retrieval-augmented generator to create an unbounded memory pool and using a memory selector to choose one output as memory for the subsequent generation round.
Ranked #1 on Text Summarization on X-Sum
no code implementations • 5 Apr 2023 • Ziming Liu, Di Luo, Yilun Xu, Tommi Jaakkola, Max Tegmark
We introduce a general family, Generative Models from Physical Processes (GenPhys), where we translate partial differential equations (PDEs) describing physical processes to generative models.
1 code implementation • NeurIPS 2023 • Zhuo Chen, Laker Newhouse, Eddie Chen, Di Luo, Marin Soljačić
Quantum many-body physics simulation has important impacts on understanding fundamental science and has applications to quantum materials design and quantum technology.
no code implementations • 14 Mar 2023 • Di Luo, Aidan P. Reddy, Trithep Devakul, Liang Fu
Moir\'e engineering in atomically thin van der Waals heterostructures creates artificial quantum materials with designer properties.
no code implementations • 23 Feb 2023 • Owen Dugan, Peter Y. Lu, Rumen Dangovski, Di Luo, Marin Soljačić
Studying the dynamics of open quantum systems can enable breakthroughs both in fundamental physics and applications to quantum engineering and quantum computation.
no code implementations • 14 Dec 2022 • Zhuo Chen, Di Luo, Kaiwen Hu, Bryan K. Clark
We present a neural flow wavefunction, Gauge-Fermion FlowNet, and use it to simulate 2+1D lattice compact quantum electrodynamics with finite density dynamical fermions.
no code implementations • 6 Nov 2022 • Di Luo, Shunyue Yuan, James Stokes, Bryan K. Clark
Gauge Theory plays a crucial role in many areas in science, including high energy physics, condensed matter physics and quantum information science.
1 code implementation • NeurIPS 2023 • Di Luo, Jiayu Shen, Rumen Dangovski, Marin Soljačić
Quantum optimization, a key application of quantum computing, has traditionally been stymied by the linearly increasing complexity of gradient calculations with an increasing number of parameters.
no code implementations • 1 Dec 2021 • Di Luo, James Halverson
We study infinite limits of neural network quantum states ($\infty$-NNQS), which exhibit representation power through ensemble statistics, and also tractable gradient descent dynamics.
no code implementations • 4 Aug 2021 • Jiangran Wang, Zhuo Chen, Di Luo, Zhizhen Zhao, Vera Mikyoung Hur, Bryan K. Clark
We develop a spacetime neural network method with second order optimization for solving quantum dynamics from the high dimensional Schr\"{o}dinger equation.
no code implementations • 18 Jan 2021 • Di Luo, Zhuo Chen, Kaiwen Hu, Zhizhen Zhao, Vera Mikyoung Hur, Bryan K. Clark
Symmetries such as gauge invariance and anyonic symmetry play a crucial role in quantum many-body physics.
no code implementations • 9 Dec 2020 • Di Luo, Giuseppe Carleo, Bryan K. Clark, James Stokes
Gauge symmetries play a key role in physics appearing in areas such as quantum field theories of the fundamental particles and emergent degrees of freedom in quantum materials.
1 code implementation • 22 Jan 2020 • Chia-Hao Lee, Abid Khan, Di Luo, Tatiane P. Santos, Chuqiao Shi, Blanka E. Janicek, Sangmin Kang, Wenjuan Zhu, Nahil A. Sobh, André Schleife, Bryan K. Clark, Pinshane Y. Huang
2D materials offer an ideal platform to study the strain fields induced by individual atomic defects, yet challenges associated with radiation damage have so-far limited electron microscopy methods to probe these atomic-scale strain fields.
Materials Science Mesoscale and Nanoscale Physics