no code implementations • 26 May 2025 • Avik Pal, Alan Edelman, Christopher Rackauckas
Despite the promise of scientific machine learning (SciML) in combining data-driven techniques with mechanistic modeling, existing approaches for incorporating hard constraints in neural differential equations (NDEs) face significant limitations.
1 code implementation • 14 Jun 2024 • Facundo Sapienza, Jordi Bolibar, Frank Schäfer, Brian Groenke, Avik Pal, Victor Boussange, Patrick Heimbach, Giles Hooker, Fernando Pérez, Per-Olof Persson, Christopher Rackauckas
Many scientific models are based on differential equations, where differentiable programming plays a crucial role in calculating model sensitivities, inverting model parameters, and training hybrid models that combine differential equations with data-driven approaches.
1 code implementation • 13 Jun 2023 • Gaurav Arya, Ruben Seyer, Frank Schäfer, Kartik Chandra, Alexander K. Lew, Mathieu Huot, Vikash K. Mansinghka, Jonathan Ragan-Kelley, Christopher Rackauckas, Moritz Schauer
We develop an algorithm for automatic differentiation of Metropolis-Hastings samplers, allowing us to differentiate through probabilistic inference, even if the model has discrete components within it.
1 code implementation • 28 Jan 2022 • Avik Pal, Alan Edelman, Christopher Rackauckas
Additionally, we address the question: is there a way to simultaneously achieve the robustness of implicit layers while allowing the reduced computational expense of an explicit layer?
1 code implementation • 21 Sep 2021 • Elisabeth Roesch, Joe G. Greener, Adam L. MacLean, Huda Nassar, Christopher Rackauckas, Timothy E. Holy, Michael P. H. Stumpf
Increasing emphasis on data and quantitative methods in the biomedical sciences is making biological research more computational.
3 code implementations • 9 May 2021 • Avik Pal, Yingbo Ma, Viral Shah, Christopher Rackauckas
While we can control the computational cost by choosing the number of layers in standard architectures, in NDEs the number of neural network evaluations for a forward pass can depend on the number of steps of the adaptive ODE solver.
4 code implementations • 9 May 2021 • Shashi Gowda, Yingbo Ma, Alessandro Cheli, Maja Gwozdz, Viral B. Shah, Alan Edelman, Christopher Rackauckas
We showcase how this can be used to optimize term construction and give a 113x acceleration on general symbolic transformations.
1 code implementation • 29 Mar 2021 • Suyong Kim, Weiqi Ji, Sili Deng, Yingbo Ma, Christopher Rackauckas
We first show the challenges of learning neural ODE in the classical stiff ODE systems of Robertson's problem and propose techniques to mitigate the challenges associated with scale separations in stiff systems.
no code implementations • 3 Nov 2020 • Emil Annevelink, Rachel Kurchin, Eric Muckley, Lance Kavalsky, Vinay I. Hegde, Valentin Sulzer, Shang Zhu, Jiankun Pu, David Farina, Matthew Johnson, Dhairya Gandhi, Adarsh Dave, Hongyi Lin, Alan Edelman, Bharath Ramsundar, James Saal, Christopher Rackauckas, Viral Shah, Bryce Meredig, Venkatasubramanian Viswanathan
Large-scale electrification is vital to addressing the climate crisis, but several scientific and technological challenges remain to fully electrify both the chemical industry and transportation.
9 code implementations • 13 Jan 2020 • Christopher Rackauckas, Yingbo Ma, Julius Martensen, Collin Warner, Kirill Zubov, Rohit Supekar, Dominic Skinner, Ali Ramadhan, Alan Edelman
In the context of science, the well-known adage "a picture is worth a thousand words" might well be "a model is worth a thousand datasets."
2 code implementations • 5 Dec 2018 • Christopher Rackauckas, Yingbo Ma, Vaibhav Dixit, Xingjian Guo, Mike Innes, Jarrett Revels, Joakim Nyberg, Vijay Ivaturi
In this manuscript we investigate the performance characteristics of Discrete Local Sensitivity Analysis implemented via Automatic Differentiation (DSAAD) against continuous adjoint sensitivity analysis.
Numerical Analysis
no code implementations • 17 Jul 2018 • Christopher Rackauckas, Qing Nie
Performant numerical solving of differential equations is required for large-scale scientific modeling.
Software Engineering Mathematical Software