no code implementations • 20 May 2024 • Zongren Zou, Adar Kahana, Enrui Zhang, Eli Turkel, Rishikesh Ranade, Jay Pathak, George Em Karniadakis
We extend a recently proposed machine-learning-based iterative solver, i. e. the hybrid iterative transferable solver (HINTS), to solve the scattering problem described by the Helmholtz equation in an exterior domain with a complex absorbing boundary condition.
no code implementations • 1 Feb 2024 • Adar Kahana, Jaya Susan Mathew, Said Bleik, Jeremy Reynolds, Oren Elisha
With the widespread adoption of Large Language Models (LLMs), in this paper we investigate the multilingual capability of these models.
no code implementations • 1 Dec 2023 • Youngeun Kim, Adar Kahana, Ruokai Yin, Yuhang Li, Panos Stinis, George Em Karniadakis, Priyadarshini Panda
In this work, we delve into the role of skip connections, a widely used concept in Artificial Neural Networks (ANNs), within the domain of SNNs with TTFS coding.
no code implementations • 31 Aug 2023 • Qian Zhang, Chenxi Wu, Adar Kahana, Youngeun Kim, Yuhang Li, George Em Karniadakis, Priyadarshini Panda
We introduce a method to convert Physics-Informed Neural Networks (PINNs), commonly used in scientific machine learning, to Spiking Neural Networks (SNNs), which are expected to have higher energy efficiency compared to traditional Artificial Neural Networks (ANNs).
no code implementations • 18 Jul 2023 • Oded Ovadia, Vivek Oommen, Adar Kahana, Ahmad Peyvan, Eli Turkel, George Em Karniadakis
The proposed method, named Diffusion-inspired Temporal Transformer Operator (DiTTO), is inspired by latent diffusion models and their conditioning mechanism, which we use to incorporate the temporal evolution of the PDE, in combination with elements from the transformer architecture to improve its capabilities.
no code implementations • 8 Jul 2023 • Maria Luisa Taccari, Oded Ovadia, He Wang, Adar Kahana, Xiaohui Chen, Peter K. Jimack
This paper presents a comprehensive comparison of various machine learning models, namely U-Net, U-Net integrated with Vision Transformers (ViT), and Fourier Neural Operator (FNO), for time-dependent forward modelling in groundwater systems.
no code implementations • 27 Jun 2023 • Varun Kumar, Leonard Gleyzer, Adar Kahana, Khemraj Shukla, George Em Karniadakis
To demonstrate the flow of the MyCrunchGPT, and create an infrastructure that can facilitate a broader vision, we built a webapp based guided user interface, that includes options for a comprehensive summary report.
no code implementations • 15 Mar 2023 • Oded Ovadia, Adar Kahana, Panos Stinis, Eli Turkel, George Em Karniadakis
We combine vision transformers with operator learning to solve diverse inverse problems described by partial differential equations (PDEs).
no code implementations • 4 Jan 2023 • Adar Kahana, Oren Elisha
To achieve message representation, each type of input is processed in a dedicated block in the neural network architecture that is suitable for the data type.
no code implementations • 17 Nov 2022 • Qian Zhang, Adar Kahana, George Em Karniadakis, Panos Stinis
We propose a Spiking Neural Network (SNN)-based explicit numerical scheme for long time integration of time-dependent Ordinary and Partial Differential Equations (ODEs, PDEs).
no code implementations • 28 Aug 2022 • Enrui Zhang, Adar Kahana, Alena Kopaničáková, Eli Turkel, Rishikesh Ranade, Jay Pathak, George Em Karniadakis
Neural networks suffer from spectral bias having difficulty in representing the high frequency components of a function while relaxation methods can resolve high frequencies efficiently but stall at moderate to low frequencies.
no code implementations • 7 Aug 2022 • Adar Kahana, Symeon Papadimitropoulos, Eli Turkel, Dmitry Batenkov
Inverse source problems are central to many applications in acoustics, geophysics, non-destructive testing, and more.
no code implementations • 22 May 2022 • Oded Ovadia, Adar Kahana, Eli Turkel
We propose an accurate numerical scheme for approximating the solution of the two dimensional acoustic wave problem.
no code implementations • 17 May 2022 • Adar Kahana, Qian Zhang, Leonard Gleyzer, George Em Karniadakis
We demonstrate this new approach for classification using the SNN in the branch, achieving results comparable to the literature.