Search Results for author:
Found 73 papers, 23 papers with code
Zero-Shot Everything Sketch-Based Image Retrieval, and in Explainable Style
This paper studies the problem of zero-short sketch-based image retrieval (ZS-SBIR), however with two significant differentiators to prior art (i) we tackle all variants (inter-category, intra-category, and cross datasets) of ZS-SBIR with just one network (``everything''), and (ii) we would really like to understand how this sketch-photo matching operates (``explainable'').
Amortised Invariance Learning for Contrastive Self-Supervision
Contrastive self-supervised learning methods famously produce high quality transferable representations by learning invariances to different data augmentations.
Domain Generalisation via Domain Adaptation: An Adversarial Fourier Amplitude Approach
We tackle the domain generalisation (DG) problem by posing it as a domain adaptation (DA) task where we adversarially synthesise the worst-case target domain and adapt a model to that worst-case domain, thereby improving the model's robustness.
Meta-Learned Kernel For Blind Super-Resolution Kernel Estimation
Recent image degradation estimation methods have enabled single-image super-resolution (SR) approaches to better upsample real-world images.
Federated Learning for Inference at Anytime and Anywhere
Federated learning has been predominantly concerned with collaborative training of deep networks from scratch, and especially the many challenges that arise, such as communication cost, robustness to heterogeneous data, and support for diverse device capabilities.
MEDFAIR: Benchmarking Fairness for Medical Imaging
In this work, we introduce MEDFAIR, a framework to benchmark the fairness of machine learning models for medical imaging.
Attacking Adversarial Defences by Smoothing the Loss Landscape
This paper investigates a family of methods for defending against adversarial attacks that owe part of their success to creating a noisy, discontinuous, or otherwise rugged loss landscape that adversaries find difficult to navigate.
HyperInvariances: Amortizing Invariance Learning
Providing invariances in a given learning task conveys a key inductive bias that can lead to sample-efficient learning and good generalisation, if correctly specified.
Feed-Forward Source-Free Latent Domain Adaptation via Cross-Attention
We study the highly practical but comparatively under-studied problem of latent-domain adaptation, where a source model should be adapted to a target dataset that contains a mixture of unlabelled domain-relevant and domain-irrelevant examples.
Lessons learned from the NeurIPS 2021 MetaDL challenge: Backbone fine-tuning without episodic meta-learning dominates for few-shot learning image classification
Although deep neural networks are capable of achieving performance superior to humans on various tasks, they are notorious for requiring large amounts of data and computing resources, restricting their success to domains where such resources are available.
MetaAudio: A Few-Shot Audio Classification Benchmark
Currently available benchmarks for few-shot learning (machine learning with few training examples) are limited in the domains they cover, primarily focusing on image classification.
Ranked #1 on
Few-Shot Audio Classification
on NSynth
Finding lost DG: Explaining domain generalization via model complexity
However much of the work in general purpose DG is heuristically motivated, as the DG problem is hard to model formally; and recent evaluations have cast doubt on existing methods' practical efficacy -- in particular compared to a well tuned empirical risk minimisation baseline.
Gaussian Process Meta Few-shot Classifier Learning via Linear Discriminant Laplace Approximation
In essence, the MAP solution is approximated by the LDA estimate, but to take the GP prior into account, we adopt the prior-norm adjustment to estimate LDA's shared variance parameters, which ensures that the adjusted estimate is consistent with the GP prior.
Defensive Tensorization
We propose defensive tensorization, an adversarial defence technique that leverages a latent high-order factorization of the network.
Online Hyperparameter Meta-Learning with Hypergradient Distillation
Many gradient-based meta-learning methods assume a set of parameters that do not participate in inner-optimization, which can be considered as hyperparameters.
SketchODE: Learning neural sketch representation in continuous time
Learning meaningful representations for chirographic drawing data such as sketches, handwriting, and flowcharts is a gateway for understanding and emulating human creative expression.
Loss Function Learning for Domain Generalization by Implicit Gradient
We take a different approach, and explore the impact of the ERM loss function on out-of-domain generalisation.
Visual Representation Learning over Latent Domains
A fundamental shortcoming of deep neural networks is their specialization to a single task and domain.
Vision-based system identification and 3D keypoint discovery using dynamics constraints
This paper introduces V-SysId, a novel method that enables simultaneous keypoint discovery, 3D system identification, and extrinsic camera calibration from an unlabeled video taken from a static camera, using only the family of equations of motion of the object of interest as weak supervision.
A Channel Coding Benchmark for Meta-Learning
We use our MetaCC benchmark to study several aspects of meta-learning, including the impact of task distribution breadth and shift, which can be controlled in the coding problem.
EvoGrad: Efficient Gradient-Based Meta-Learning and Hyperparameter Optimization
Gradient-based meta-learning and hyperparameter optimization have seen significant progress recently, enabling practical end-to-end training of neural networks together with many hyperparameters.
Meta-Calibration: Learning of Model Calibration Using Differentiable Expected Calibration Error
The problem is especially noticeable when using modern neural networks, for which there is a significant difference between the confidence of the model and the probability of correct prediction.
Cloud2Curve: Generation and Vectorization of Parametric Sketches
Analysis of human sketches in deep learning has advanced immensely through the use of waypoint-sequences rather than raster-graphic representations.
Shallow Bayesian Meta Learning for Real-World Few-Shot Recognition
Current state-of-the-art few-shot learners focus on developing effective training procedures for feature representations, before using simple, e. g. nearest centroid, classifiers.
Ranked #6 on
Few-Shot Image Classification
on Meta-Dataset
cross-domain few-shot learning
Few-Shot Image Classification
Reducing Implicit Bias in Latent Domain Learning
A fundamental shortcoming of deep neural networks is their specialization to a single task and domain.
Robust Domain Randomised Reinforcement Learning through Peer-to-Peer Distillation
In reinforcement learning, domain randomisation is an increasingly popular technique for learning more general policies that are robust to domain-shifts at deployment.
Margin-Based Transfer Bounds for Meta Learning with Deep Feature Embedding
By transferring knowledge learned from seen/previous tasks, meta learning aims to generalize well to unseen/future tasks.
Weight-Covariance Alignment for Adversarially Robust Neural Networks
Stochastic Neural Networks (SNNs) that inject noise into their hidden layers have recently been shown to achieve strong robustness against adversarial attacks.
Learning to Generate Novel Domains for Domain Generalization
This explicitly increases the diversity of available training domains and leads to a more generalizable model.
Ranked #51 on
Domain Generalization
on PACS
Learning the Prediction Distribution for Semi-Supervised Learning with Normalising Flows
In this work, we propose a probabilistically principled general approach to SSL that considers the distribution over label predictions, for labels of different complexity, from "one-hot" vectors to binary vectors and images.
BézierSketch: A generative model for scalable vector sketches
The study of neural generative models of human sketches is a fascinating contemporary modeling problem due to the links between sketch image generation and the human drawing process.
Flexible Dataset Distillation: Learn Labels Instead of Images
In particular, we study the problem of label distillation - creating synthetic labels for a small set of real images, and show it to be more effective than the prior image-based approach to dataset distillation.
A Probabilistic Model for Discriminative and Neuro-Symbolic Semi-Supervised Learning
Much progress has been made in semi-supervised learning (SSL) by combining methods that exploit different aspects of the data distribution, e. g. consistency regularisation relies on properties of $p(x)$, whereas entropy minimisation pertains to the label distribution $p(y|x)$.
NewtonianVAE: Proportional Control and Goal Identification from Pixels via Physical Latent Spaces
Learning low-dimensional latent state space dynamics models has been a powerful paradigm for enabling vision-based planning and learning for control.
Latent Domain Learning with Dynamic Residual Adapters
While recent techniques in domain adaptation and multi-domain learning enable the learning of more domain-agnostic features, their success relies on the presence of domain labels, typically requiring manual annotation and careful curation of datasets.
ALBA : Reinforcement Learning for Video Object Segmentation
We treat this as a grouping problem by exploiting object proposals and making a joint inference about grouping over both space and time.
One-shot visual object segmentation
reinforcement-learning
+5
DREAM Architecture: a Developmental Approach to Open-Ended Learning in Robotics
Robots are still limited to controlled conditions, that the robot designer knows with enough details to endow the robot with the appropriate models or behaviors.
SimpleMKKM: Simple Multiple Kernel K-means
We propose a simple yet effective multiple kernel clustering algorithm, termed simple multiple kernel k-means (SimpleMKKM).
Meta-Learning in Neural Networks: A Survey
We survey promising applications and successes of meta-learning such as few-shot learning and reinforcement learning.
Online Meta-Learning for Multi-Source and Semi-Supervised Domain Adaptation
Therefore we propose an online shortest-path meta-learning framework that is both computationally tractable and practically effective for improving DA performance.
Meta-Learning
Multi-Source Unsupervised Domain Adaptation
+1
Sequential Learning for Domain Generalization
In DG this means encountering a sequence of domains and at each step training to maximise performance on the next domain.
Ranked #62 on
Domain Generalization
on PACS
Deep Domain-Adversarial Image Generation for Domain Generalisation
This is achieved by having a learning objective formulated to ensure that the generated data can be correctly classified by the label classifier while fooling the domain classifier.
Ranked #49 on
Domain Generalization
on PACS
Incremental Few-Shot Object Detection
To this end we propose OpeN-ended Centre nEt (ONCE), a detector designed for incrementally learning to detect novel class objects with few examples.
DADA: Differentiable Automatic Data Augmentation
In this paper, we propose Differentiable Automatic Data Augmentation (DADA) which dramatically reduces the cost.
Ranked #13 on
Data Augmentation
on ImageNet
Adversarial Generation of Informative Trajectories for Dynamics System Identification
Dynamic System Identification approaches usually heavily rely on the evolutionary and gradient-based optimisation techniques to produce optimal excitation trajectories for determining the physical parameters of robot platforms.
Full-Scale Continuous Synthetic Sonar Data Generation with Markov Conditional Generative Adversarial Networks
High-quality realistic sonar data simulation could be of benefit to multiple applications, including training of human operators for post-mission analysis, as well as tuning and validation of autonomous target recognition (ATR) systems for underwater vehicles.
Interpreting Knowledge Graph Relation Representation from Word Embeddings
Many models learn representations of knowledge graph data by exploiting its low-rank latent structure, encoding known relations between entities and enabling unknown facts to be inferred.
Simple and Effective Stochastic Neural Networks
Stochastic neural networks (SNNs) are currently topical, with several paradigms being actively investigated including dropout, Bayesian neural networks, variational information bottleneck (VIB) and noise regularized learning.
Zero-Shot Crowd Behavior Recognition
To that end, we relax the common assumption that each individual crowd video instance is only associated with a single crowd attribute.
Factorized Higher-Order CNNs with an Application to Spatio-Temporal Emotion Estimation
To alleviate this, one approach is to apply low-rank tensor decompositions to convolution kernels in order to compress the network and reduce its number of parameters.
Physics-as-Inverse-Graphics: Unsupervised Physical Parameter Estimation from Video
Our approach significantly outperforms related unsupervised methods in long-term future frame prediction of systems with interacting objects (such as ball-spring or 3-body gravitational systems), due to its ability to build dynamics into the model as an inductive bias.
Multi-relational Poincaré Graph Embeddings
Hyperbolic embeddings have recently gained attention in machine learning due to their ability to represent hierarchical data more accurately and succinctly than their Euclidean analogues.
Ranked #34 on
Link Prediction
on FB15k-237
Analogies Explained: Towards Understanding Word Embeddings
Word embeddings generated by neural network methods such as word2vec (W2V) are well known to exhibit seemingly linear behaviour, e. g. the embeddings of analogy "woman is to queen as man is to king" approximately describe a parallelogram.
Behavioural Repertoire via Generative Adversarial Policy Networks
Leveraging our generative policy network, a robot can sample novel behaviors until it finds one that works for a new environment.
Learning Unsupervised Word Translations Without Adversaries
Word translation, or bilingual dictionary induction, is an important capability that impacts many multilingual language processing tasks.
Deep Multi-Task Learning to Recognise Subtle Facial Expressions of Mental States
To advance subtle expression recognition, we contribute a Large-scale Subtle Emotions and Mental States in the Wild database (LSEMSW).
Meta-Learning Transferable Active Learning Policies by Deep Reinforcement Learning
In contrast to this body of research, we propose to treat active learning algorithm design as a meta-learning problem and learn the best criterion from data.
What the Vec? Towards Probabilistically Grounded Embeddings
We show that different interactions between PMI vectors reflect semantic word relationships, such as similarity and paraphrasing, that are encoded in low dimensional word embeddings under a suitable projection, theoretically explaining why embeddings of W2V and GloVe work.
Learning to Sketch with Shortcut Cycle Consistency
In this paper, we present a novel approach for translating an object photo to a sketch, mimicking the human sketching process.
Deep Stock Representation Learning: From Candlestick Charts to Investment Decisions
We propose a novel investment decision strategy (IDS) based on deep learning.
Computational Finance
Learning to Learn: Meta-Critic Networks for Sample Efficient Learning
We propose a novel and flexible approach to meta-learning for learning-to-learn from only a few examples.
Deep Multi-task Representation Learning: A Tensor Factorisation Approach
Our approach applies to both homogeneous and heterogeneous MTL.
Frankenstein: Learning Deep Face Representations using Small Data
To train such networks, very large training sets are needed with millions of labeled images.
Transductive Zero-Shot Action Recognition by Word-Vector Embedding
This is a more challenging problem than existing ZSL of still images and/or attributes, because the mapping between video spacetime features of actions and the semantic space is more complex and harder to learn for the purpose of generalising over any cross-category domain shift.
Free-hand Sketch Synthesis with Deformable Stroke Models
We present a generative model which can automatically summarize the stroke composition of free-hand sketches of a given category.
Zero-Shot Domain Adaptation via Kernel Regression on the Grassmannian
Most visual recognition methods implicitly assume the data distribution remains unchanged from training to testing.
Discovery of Shared Semantic Spaces for Multi-Scene Video Query and Summarization
The growing rate of public space CCTV installations has generated a need for automated methods for exploiting video surveillance data including scene understanding, query, behaviour annotation and summarization.
Making Better Use of Edges via Perceptual Grouping
We propose a perceptual grouping framework that organizes image edges into meaningful structures and demonstrate its usefulness on various computer vision tasks.
When Face Recognition Meets with Deep Learning: an Evaluation of Convolutional Neural Networks for Face Recognition
In this work, we conduct an extensive evaluation of CNN-based face recognition systems (CNN-FRS) on a common ground to make our work easily reproducible.
Semantic Embedding Space for Zero-Shot Action Recognition
In this framework a mapping is constructed between visual features and a human interpretable semantic description of each category, allowing categories to be recognised in the absence of any training data.
Ranked #24 on
Zero-Shot Action Recognition
on UCF101
Sketch-a-Net that Beats Humans
We propose a multi-scale multi-channel deep neural network framework that, for the first time, yields sketch recognition performance surpassing that of humans.
A Survey on Heterogeneous Face Recognition: Sketch, Infra-red, 3D and Low-resolution
Heterogeneous face recognition (HFR) refers to matching face imagery across different domains.
