Search Results for author: Jascha Achterberg

Found 8 papers, 2 papers with code

Brain-Like Processing Pathways Form in Models With Heterogeneous Experts

no code implementations3 Jun 2025 Jack Cook, Danyal Akarca, Rui Ponte Costa, Jascha Achterberg

The brain is made up of a vast set of heterogeneous regions that dynamically organize into pathways as a function of task demands.

Form Mixture-of-Experts

Dynamical similarity analysis can identify compositional dynamics developing in RNNs

1 code implementation31 Oct 2024 Quentin Guilhot, Michał Wójcik, Jascha Achterberg, Rui Ponte Costa

Here we propose that the phenomena of compositional learning in recurrent neural networks (RNNs) allows us to build a test case for dynamical representation alignment metrics.

Mamba State Space Models

Accelerated AI Inference via Dynamic Execution Methods

no code implementations30 Oct 2024 Haim Barad, Jascha Achterberg, Tien Pei Chou, Jean Yu

In this paper, we focus on Dynamic Execution techniques that optimize the computation flow based on input.

Quantization

Brain-inspired learning in artificial neural networks: a review

no code implementations18 May 2023 Samuel Schmidgall, Jascha Achterberg, Thomas Miconi, Louis Kirsch, Rojin Ziaei, S. Pardis Hajiseyedrazi, Jason Eshraghian

Artificial neural networks (ANNs) have emerged as an essential tool in machine learning, achieving remarkable success across diverse domains, including image and speech generation, game playing, and robotics.

Building artificial neural circuits for domain-general cognition: a primer on brain-inspired systems-level architecture

no code implementations21 Mar 2023 Jascha Achterberg, Danyal Akarca, Moataz Assem, Moritz Heimbach, Duncan E. Astle, John Duncan

There is a concerted effort to build domain-general artificial intelligence in the form of universal neural network models with sufficient computational flexibility to solve a wide variety of cognitive tasks but without requiring fine-tuning on individual problem spaces and domains.

Cannot find the paper you are looking for? You can Submit a new open access paper.