Search Results for author: Mike Davies

Found 27 papers, 9 papers with code

A Compressed Sensing Framework for Magnetic Resonance Fingerprinting

no code implementations9 Dec 2013 Mike Davies, Gilles Puy, Pierre Vandergheynst, Yves Wiaux

Inspired by the recently proposed Magnetic Resonance Fingerprinting (MRF) technique, we develop a principled compressed sensing framework for quantitative MRI.

Information Theory Information Theory

Dictionary learning for fast classification based on soft-thresholding

no code implementations9 Feb 2014 Alhussein Fawzi, Mike Davies, Pascal Frossard

The dictionary learning problem, which jointly learns the dictionary and linear classifier, is cast as a difference of convex (DC) program and solved efficiently with an iterative DC solver.

Classification Dictionary Learning +1

Sparse Coding by Spiking Neural Networks: Convergence Theory and Computational Results

no code implementations15 May 2017 Ping Tak Peter Tang, Tsung-Han Lin, Mike Davies

With a moderate but well-defined assumption, we prove that the SNN indeed solves sparse coding.

PAC-Bayesian Margin Bounds for Convolutional Neural Networks

1 code implementation30 Dec 2017 Konstantinos Pitas, Mike Davies, Pierre Vandergheynst

Recently the generalization error of deep neural networks has been analyzed through the PAC-Bayesian framework, for the case of fully connected layers.

Cheap DNN Pruning with Performance Guarantees

no code implementations ICLR 2018 Konstantinos Pitas, Mike Davies, Pierre Vandergheynst

Recent DNN pruning algorithms have succeeded in reducing the number of parameters in fully connected layers often with little or no drop in classification accuracy.

Classification General Classification

FeTa: A DCA Pruning Algorithm with Generalization Error Guarantees

1 code implementation12 Mar 2018 Konstantinos Pitas, Mike Davies, Pierre Vandergheynst

Recent DNN pruning algorithms have succeeded in reducing the number of parameters in fully connected layers, often with little or no drop in classification accuracy.

General Classification

CoverBLIP: accelerated and scalable iterative matched-filtering for Magnetic Resonance Fingerprint reconstruction

1 code implementation3 Oct 2018 Mohammad Golbabaee, Zhouye Chen, Yves Wiaux, Mike Davies

Current popular methods for Magnetic Resonance Fingerprint (MRF) recovery are bottlenecked by the heavy computations of a matched-filtering step due to the growing size and complexity of the fingerprint dictionaries in multi-parametric quantitative MRI applications.

Dimensionality Reduction

Revisiting hard thresholding for DNN pruning

no code implementations21 May 2019 Konstantinos Pitas, Mike Davies, Pierre Vandergheynst

Recently developed smart pruning algorithms use the DNN response over the training set for a variety of cost functions to determine redundant network weights, leading to less accuracy degradation and possibly less retraining time.

The role of invariance in spectral complexity-based generalization bounds

no code implementations23 May 2019 Konstantinos Pitas, Andreas Loukas, Mike Davies, Pierre Vandergheynst

Deep convolutional neural networks (CNNs) have been shown to be able to fit a random labeling over data while still being able to generalize well for normal labels.

Generalization Bounds

The Practicality of Stochastic Optimization in Imaging Inverse Problems

no code implementations22 Oct 2019 Junqi Tang, Karen Egiazarian, Mohammad Golbabaee, Mike Davies

We investigate this phenomenon and propose a theory-inspired mechanism for the practitioners to efficiently characterize whether it is beneficial for an inverse problem to be solved by stochastic optimization techniques or not.

Deblurring Image Deblurring +1

SPRING: A fast stochastic proximal alternating method for non-smooth non-convex optimization

no code implementations27 Feb 2020 Derek Driggs, Junqi Tang, Jingwei Liang, Mike Davies, Carola-Bibiane Schönlieb

We introduce SPRING, a novel stochastic proximal alternating linearized minimization algorithm for solving a class of non-smooth and non-convex optimization problems.

Image Deconvolution Stochastic Optimization Optimization and Control 90C26

The Neural Tangent Link Between CNN Denoisers and Non-Local Filters

no code implementations CVPR 2021 Julián Tachella, Junqi Tang, Mike Davies

While the NTK theory accurately predicts the filter associated with networks trained using standard gradient descent, our analysis shows that it falls short to explain the behaviour of networks trained using the popular Adam optimizer.

Image Denoising Image Restoration

A Fast Stochastic Plug-and-Play ADMM for Imaging Inverse Problems

no code implementations20 Jun 2020 Junqi Tang, Mike Davies

In this work we propose an efficient stochastic plug-and-play (PnP) algorithm for imaging inverse problems.

Efficient Neuromorphic Signal Processing with Loihi 2

no code implementations5 Nov 2021 Garrick Orchard, E. Paxon Frady, Daniel Ben Dayan Rubin, Sophia Sanborn, Sumit Bam Shrestha, Friedrich T. Sommer, Mike Davies

The biologically inspired spiking neurons used in neuromorphic computing are nonlinear filters with dynamic state variables -- very different from the stateless neuron models used in deep learning.

Audio Classification Optical Flow Estimation

Unsupervised Learning From Incomplete Measurements for Inverse Problems

1 code implementation28 Jan 2022 Julián Tachella, Dongdong Chen, Mike Davies

In many real-world inverse problems, only incomplete measurement data are available for training which can pose a problem for learning a reconstruction function.

Image Inpainting

Sensing Theorems for Unsupervised Learning in Linear Inverse Problems

1 code implementation23 Mar 2022 Julián Tachella, Dongdong Chen, Mike Davies

In this paper, we present necessary and sufficient sensing conditions for learning the signal model from measurement data alone which only depend on the dimension of the model and the number of operators or properties of the group action that the model is invariant to.

Dictionary Learning Matrix Completion

Imaging with Equivariant Deep Learning

no code implementations5 Sep 2022 Dongdong Chen, Mike Davies, Matthias J. Ehrhardt, Carola-Bibiane Schönlieb, Ferdia Sherry, Julián Tachella

From early image processing to modern computational imaging, successful models and algorithms have relied on a fundamental property of natural signals: symmetry.

Image Classification Self-Supervised Learning

The Intel Neuromorphic DNS Challenge

1 code implementation16 Mar 2023 Jonathan Timcheck, Sumit Bam Shrestha, Daniel Ben Dayan Rubin, Adam Kupryjanow, Garrick Orchard, Lukasz Pindor, Timothy Shea, Mike Davies

A critical enabler for progress in neuromorphic computing research is the ability to transparently evaluate different neuromorphic solutions on important tasks and to compare them to state-of-the-art conventional solutions.

Audio Denoising Denoising

NeuroBench: A Framework for Benchmarking Neuromorphic Computing Algorithms and Systems

1 code implementation10 Apr 2023 Jason Yik, Korneel Van den Berghe, Douwe den Blanken, Younes Bouhadjar, Maxime Fabre, Paul Hueber, Denis Kleyko, Noah Pacik-Nelson, Pao-Sheng Vincent Sun, Guangzhi Tang, Shenqi Wang, Biyan Zhou, Soikat Hasan Ahmed, George Vathakkattil Joseph, Benedetto Leto, Aurora Micheli, Anurag Kumar Mishra, Gregor Lenz, Tao Sun, Zergham Ahmed, Mahmoud Akl, Brian Anderson, Andreas G. Andreou, Chiara Bartolozzi, Arindam Basu, Petrut Bogdan, Sander Bohte, Sonia Buckley, Gert Cauwenberghs, Elisabetta Chicca, Federico Corradi, Guido de Croon, Andreea Danielescu, Anurag Daram, Mike Davies, Yigit Demirag, Jason Eshraghian, Tobias Fischer, Jeremy Forest, Vittorio Fra, Steve Furber, P. Michael Furlong, William Gilpin, Aditya Gilra, Hector A. Gonzalez, Giacomo Indiveri, Siddharth Joshi, Vedant Karia, Lyes Khacef, James C. Knight, Laura Kriener, Rajkumar Kubendran, Dhireesha Kudithipudi, Yao-Hong Liu, Shih-Chii Liu, Haoyuan Ma, Rajit Manohar, Josep Maria Margarit-Taulé, Christian Mayr, Konstantinos Michmizos, Dylan Muir, Emre Neftci, Thomas Nowotny, Fabrizio Ottati, Ayca Ozcelikkale, Priyadarshini Panda, Jongkil Park, Melika Payvand, Christian Pehle, Mihai A. Petrovici, Alessandro Pierro, Christoph Posch, Alpha Renner, Yulia Sandamirskaya, Clemens JS Schaefer, André van Schaik, Johannes Schemmel, Samuel Schmidgall, Catherine Schuman, Jae-sun Seo, Sadique Sheik, Sumit Bam Shrestha, Manolis Sifalakis, Amos Sironi, Matthew Stewart, Kenneth Stewart, Terrence C. Stewart, Philipp Stratmann, Jonathan Timcheck, Nergis Tömen, Gianvito Urgese, Marian Verhelst, Craig M. Vineyard, Bernhard Vogginger, Amirreza Yousefzadeh, Fatima Tuz Zohora, Charlotte Frenkel, Vijay Janapa Reddi

The NeuroBench framework introduces a common set of tools and systematic methodology for inclusive benchmark measurement, delivering an objective reference framework for quantifying neuromorphic approaches in both hardware-independent (algorithm track) and hardware-dependent (system track) settings.

Benchmarking

Efficient Video and Audio processing with Loihi 2

no code implementations5 Oct 2023 Sumit Bam Shrestha, Jonathan Timcheck, Paxon Frady, Leobardo Campos-Macias, Mike Davies

Loihi 2 is an asynchronous, brain-inspired research processor that generalizes several fundamental elements of neuromorphic architecture, such as stateful neuron models communicating with event-driven spikes, in order to address limitations of the first generation Loihi.

Audio Denoising Denoising

Self-Supervised Learning for Image Super-Resolution and Deblurring

1 code implementation18 Dec 2023 Jérémy Scanvic, Mike Davies, Patrice Abry, Julián Tachella

These methods critically rely on invariance to translations and/or rotations of the image distribution to learn from incomplete measurement data alone.

Deblurring Image Super-Resolution +1

Perspective-Equivariant Imaging: an Unsupervised Framework for Multispectral Pansharpening

no code implementations14 Mar 2024 Andrew Wang, Mike Davies

Ill-posed image reconstruction problems appear in many scenarios such as remote sensing, where obtaining high quality images is crucial for environmental monitoring, disaster management and urban planning.

Image Reconstruction Management +1

Cannot find the paper you are looking for? You can Submit a new open access paper.