Search Results for author:
Found 25 papers, 7 papers with code
Evolutionary algorithms as an alternative to backpropagation for supervised training of Biophysical Neural Networks and Neural ODEs
Training networks consisting of biophysically accurate neuron models could allow for new insights into how brain circuits can organize and solve tasks.
Learning Time-Invariant Representations for Individual Neurons from Population Dynamics
This suggests that neuronal activity is a combination of its time-invariant identity and the inputs the neuron receives from the rest of the circuit.
To reverse engineer an entire nervous system
More fundamentally, reconstructing or modeling a system is an important milestone in understanding it, and so, simulating an entire nervous system is in itself one of the goals, indeed dreams, of systems neuroscience.
Physics-Driven Diffusion Models for Impact Sound Synthesis from Videos
Traditional methods of impact sound synthesis use physics simulation to obtain a set of physics parameters that could represent and synthesize the sound.
Be Everywhere - Hear Everything (BEE): Audio Scene Reconstruction by Sparse Audio-Visual Samples
The audio at the listener location is a complex outcome of sound propagation through the scene geometry and interacting with surfaces and also the locations of the emitters and the sounds they emit.
TKIL: Tangent Kernel Approach for Class Balanced Incremental Learning
In our work, we propose to address these challenges with the introduction of a novel methodology of Tangent Kernel for Incremental Learning (TKIL) that achieves class-balanced performance.
STNDT: Modeling Neural Population Activity with a Spatiotemporal Transformer
Modeling neural population dynamics underlying noisy single-trial spiking activities is essential for relating neural observation and behavior.
Statistical Perspective on Functional and Causal Neural Connectomics: The Time-Aware PC Algorithm
In this work, we propose to model and estimate the causal functional connectivity from neural time series using a novel approach that adapts directed probabilistic graphical modeling to the time series scenario.
Lyapunov-Guided Representation of Recurrent Neural Network Performance
To address the fact that RNN features go beyond the existing Lyapunov spectral analysis, we propose to infer relevant features from the Lyapunov spectrum with an Autoencoder and an embedding of its latent representation (AeLLE).
How Does it Sound?
It is often the case that the experience of watching the video can be enhanced by adding a musical soundtrack that is in-sync with the rhythmic features of these activities.
Statistical Perspective on Functional and Causal Neural Connectomics: A Comparative Study
Additional approaches have been proposed to incorporate aspects of causality to turn functional connectomes into causal functional connectomes, however, these methodologies typically focus on specific aspects of causality.
Knowledge Distillation Circumvents Nonlinearity for Optical Convolutional Neural Networks
However, a major challenge in using this spectral approach, as well as in an optical implementation of CNNs, is the inclusion of a nonlinearity between each convolutional layer, without which CNN performance drops dramatically.
Multi-Instrumentalist Net: Unsupervised Generation of Music from Body Movements
We propose a novel system that takes as an input body movements of a musician playing a musical instrument and generates music in an unsupervised setting.
Sparse Semi-Supervised Action Recognition with Active Learning
Current state-of-the-art methods for skeleton-based action recognition are supervised and rely on labels.
On Lyapunov Exponents for RNNs: Understanding Information Propagation Using Dynamical Systems Tools
Recurrent neural networks (RNNs) have been successfully applied to a variety of problems involving sequential data, but their optimization is sensitive to parameter initialization, architecture, and optimizer hyperparameters.
Audeo: Audio Generation for a Silent Performance Video
We present a novel system that gets as an input video frames of a musician playing the piano and generates the music for that video.
Deep Reinforcement Learning for Neural Control
To infer candidate control policies, our approach maps neural circuits and their connectome into a grid-world like setting and infers the actions needed to achieve aimed behavior.
Iterate & Cluster: Iterative Semi-Supervised Action Recognition
The method utilizes latent space embedding and clustering of the unsupervised encoder-decoder to guide the selection of sequences to be annotated in each iteration.
BI-MAML: Balanced Incremental Approach for Meta Learning
The balanced learning strategy enables BI-MAML to both outperform other state-of-the-art models in terms of classification accuracy for existing tasks and also accomplish efficient adaption to similar new tasks with less required shots.
R-FORCE: Robust Learning for Random Recurrent Neural Networks
Random Recurrent Neural Networks (RRNN) are the simplest recurrent networks to model and extract features from sequential data.
PREDICT & CLUSTER: Unsupervised Skeleton Based Action Recognition
Given inputs of body keypoints sequences obtained during various movements, our system associates the sequences with actions.
Clustering and Recognition of Spatiotemporal Features through Interpretable Embedding of Sequence to Sequence Recurrent Neural Networks
We show that the methodology provides a high-quality unsupervised categorization of movements.
An Optical Frontend for a Convolutional Neural Network
The parallelism of optics and the miniaturization of optical components using nanophotonic structures, such as metasurfaces present a compelling alternative to electronic implementations of convolutional neural networks.
Audio to Body Dynamics
We present a method that gets as input an audio of violin or piano playing, and outputs a video of skeleton predictions which are further used to animate an avatar.
Low-dimensional functionality of complex network dynamics: Neuro-sensory integration in the Caenorhabditis elegans connectome
We develop a biophysical model of neuro-sensory integration in the model organism Caenorhabditis elegans.
