Search Results for author: Timothy Hospedales

Found 99 papers, 38 papers with code

VL-ICL Bench: The Devil in the Details of Benchmarking Multimodal In-Context Learning

1 code implementation19 Mar 2024 Yongshuo Zong, Ondrej Bohdal, Timothy Hospedales

Built on top of LLMs, vision large language models (VLLMs) have advanced significantly in areas such as recognition, reasoning, and grounding.

Benchmarking Image Captioning +3

SketchINR: A First Look into Sketches as Implicit Neural Representations

no code implementations14 Mar 2024 Hmrishav Bandyopadhyay, Ayan Kumar Bhunia, Pinaki Nath Chowdhury, Aneeshan Sain, Tao Xiang, Timothy Hospedales, Yi-Zhe Song

(ii) SketchINR's auto-decoder provides a much higher-fidelity representation than other learned vector sketch representations, and is uniquely able to scale to complex vector sketches such as FS-COCO.

Data Compression

Safety Fine-Tuning at (Almost) No Cost: A Baseline for Vision Large Language Models

1 code implementation3 Feb 2024 Yongshuo Zong, Ondrej Bohdal, Tingyang Yu, Yongxin Yang, Timothy Hospedales

Our experiments demonstrate that integrating this dataset into standard vision-language fine-tuning or utilizing it for post-hoc fine-tuning effectively safety aligns VLLMs.

Instruction Following

DemoFusion: Democratising High-Resolution Image Generation With No $$$

1 code implementation24 Nov 2023 Ruoyi Du, Dongliang Chang, Timothy Hospedales, Yi-Zhe Song, Zhanyu Ma

High-resolution image generation with Generative Artificial Intelligence (GenAI) has immense potential but, due to the enormous capital investment required for training, it is increasingly centralised to a few large corporations, and hidden behind paywalls.

Image Generation

Sketch-based Video Object Segmentation: Benchmark and Analysis

no code implementations13 Nov 2023 Ruolin Yang, Da Li, Conghui Hu, Timothy Hospedales, Honggang Zhang, Yi-Zhe Song

Reference-based video object segmentation is an emerging topic which aims to segment the corresponding target object in each video frame referred by a given reference, such as a language expression or a photo mask.

Object Segmentation +3

Is Scaling Learned Optimizers Worth It? Evaluating The Value of VeLO's 4000 TPU Months

no code implementations27 Oct 2023 Fady Rezk, Antreas Antoniou, Henry Gouk, Timothy Hospedales

We analyze VeLO (versatile learned optimizer), the largest scale attempt to train a general purpose "foundational" optimizer to date.

Fool Your (Vision and) Language Model With Embarrassingly Simple Permutations

1 code implementation2 Oct 2023 Yongshuo Zong, Tingyang Yu, Bingchen Zhao, Ruchika Chavhan, Timothy Hospedales

Large language and vision-language models are rapidly being deployed in practice thanks to their impressive capabilities in instruction following, in-context learning, and so on.

In-Context Learning Instruction Following +3

BayesDLL: Bayesian Deep Learning Library

2 code implementations22 Sep 2023 Minyoung Kim, Timothy Hospedales

We release a new Bayesian neural network library for PyTorch for large-scale deep networks.

Bayesian Inference Variational Inference

Feed-Forward Source-Free Domain Adaptation via Class Prototypes

no code implementations20 Jul 2023 Ondrej Bohdal, Da Li, Timothy Hospedales

Source-free domain adaptation has become popular because of its practical usefulness and no need to access source data.

Source-Free Domain Adaptation

Label Calibration for Semantic Segmentation Under Domain Shift

no code implementations20 Jul 2023 Ondrej Bohdal, Da Li, Timothy Hospedales

Performance of a pre-trained semantic segmentation model is likely to substantially decrease on data from a new domain.

Segmentation Semantic Segmentation

Navigating Noise: A Study of How Noise Influences Generalisation and Calibration of Neural Networks

1 code implementation30 Jun 2023 Martin Ferianc, Ondrej Bohdal, Timothy Hospedales, Miguel Rodrigues

Enhancing the generalisation abilities of neural networks (NNs) through integrating noise such as MixUp or Dropout during training has emerged as a powerful and adaptable technique.

Data Augmentation

A Hierarchical Bayesian Model for Deep Few-Shot Meta Learning

1 code implementation16 Jun 2023 Minyoung Kim, Timothy Hospedales

We propose a novel hierarchical Bayesian model for learning with a large (possibly infinite) number of tasks/episodes, which suits well the few-shot meta learning problem.

Bayesian Inference Meta-Learning +1

Neural Fine-Tuning Search for Few-Shot Learning

1 code implementation15 Jun 2023 Panagiotis Eustratiadis, Łukasz Dudziak, Da Li, Timothy Hospedales

In few-shot recognition, a classifier that has been trained on one set of classes is required to rapidly adapt and generalize to a disjoint, novel set of classes.

Few-Shot Learning Neural Architecture Search

Meta Omnium: A Benchmark for General-Purpose Learning-to-Learn

1 code implementation CVPR 2023 Ondrej Bohdal, Yinbing Tian, Yongshuo Zong, Ruchika Chavhan, Da Li, Henry Gouk, Li Guo, Timothy Hospedales

Meta-learning and other approaches to few-shot learning are widely studied for image recognition, and are increasingly applied to other vision tasks such as pose estimation and dense prediction.

Few-Shot Learning Pose Estimation +1

FedHB: Hierarchical Bayesian Federated Learning

no code implementations8 May 2023 Minyoung Kim, Timothy Hospedales

We propose a novel hierarchical Bayesian approach to Federated Learning (FL), where our model reasonably describes the generative process of clients' local data via hierarchical Bayesian modeling: constituting random variables of local models for clients that are governed by a higher-level global variate.

Avg Federated Learning +1

Fairness in AI and Its Long-Term Implications on Society

no code implementations16 Apr 2023 Ondrej Bohdal, Timothy Hospedales, Philip H. S. Torr, Fazl Barez

Successful deployment of artificial intelligence (AI) in various settings has led to numerous positive outcomes for individuals and society.

Decision Making Fairness

ChiroDiff: Modelling chirographic data with Diffusion Models

no code implementations7 Apr 2023 Ayan Das, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song

Such strictly-ordered discrete factorization however falls short of capturing key properties of chirographic data -- it fails to build holistic understanding of the temporal concept due to one-way visibility (causality).


Self-Supervised Multimodal Learning: A Survey

1 code implementation31 Mar 2023 Yongshuo Zong, Oisin Mac Aodha, Timothy Hospedales

In this survey, we provide a comprehensive review of the state-of-the-art in SSML, in which we elucidate three major challenges intrinsic to self-supervised learning with multimodal data: (1) learning representations from multimodal data without labels, (2) fusion of different modalities, and (3) learning with unaligned data.

Machine Translation Self-Supervised Learning

Zero-Shot Everything Sketch-Based Image Retrieval, and in Explainable Style

1 code implementation CVPR 2023 Fengyin Lin, Mingkang Li, Da Li, Timothy Hospedales, Yi-Zhe Song, Yonggang Qi

This paper studies the problem of zero-short sketch-based image retrieval (ZS-SBIR), however with two significant differentiators to prior art (i) we tackle all variants (inter-category, intra-category, and cross datasets) of ZS-SBIR with just one network (``everything''), and (ii) we would really like to understand how this sketch-photo matching operates (``explainable'').

Relation Network Retrieval +1

Amortised Invariance Learning for Contrastive Self-Supervision

1 code implementation24 Feb 2023 Ruchika Chavhan, Henry Gouk, Jan Stuehmer, Calum Heggan, Mehrdad Yaghoobi, Timothy Hospedales

Contrastive self-supervised learning methods famously produce high quality transferable representations by learning invariances to different data augmentations.

Contrastive Learning Representation Learning +1

Domain Generalisation via Domain Adaptation: An Adversarial Fourier Amplitude Approach

no code implementations23 Feb 2023 Minyoung Kim, Da Li, Timothy Hospedales

We tackle the domain generalisation (DG) problem by posing it as a domain adaptation (DA) task where we adversarially synthesise the worst-case target domain and adapt a model to that worst-case domain, thereby improving the model's robustness.

Domain Adaptation

Quality Diversity for Visual Pre-Training

no code implementations ICCV 2023 Ruchika Chavhan, Henry Gouk, Da Li, Timothy Hospedales

Notably, the augmentations used in both supervised and self-supervised training lead to features with high invariance to spatial and appearance transformations.

Inductive Bias Transfer Learning

An Erudite Fine-Grained Visual Classification Model

no code implementations CVPR 2023 Dongliang Chang, Yujun Tong, Ruoyi Du, Timothy Hospedales, Yi-Zhe Song, Zhanyu Ma

Therefore, we first propose a feature disentanglement module and a feature re-fusion module to reduce negative transfer and boost positive transfer between different datasets.

Classification Disentanglement +2

Meta-Learned Kernel For Blind Super-Resolution Kernel Estimation

1 code implementation15 Dec 2022 Royson Lee, Rui Li, Stylianos I. Venieris, Timothy Hospedales, Ferenc Huszár, Nicholas D. Lane

Recent image degradation estimation methods have enabled single-image super-resolution (SR) approaches to better upsample real-world images.

Blind Super-Resolution Image Super-Resolution

Federated Learning for Inference at Anytime and Anywhere

no code implementations8 Dec 2022 Zicheng Liu, Da Li, Javier Fernandez-Marques, Stefanos Laskaridis, Yan Gao, Łukasz Dudziak, Stan Z. Li, Shell Xu Hu, Timothy Hospedales

Federated learning has been predominantly concerned with collaborative training of deep networks from scratch, and especially the many challenges that arise, such as communication cost, robustness to heterogeneous data, and support for diverse device capabilities.

Federated Learning

MEDFAIR: Benchmarking Fairness for Medical Imaging

1 code implementation4 Oct 2022 Yongshuo Zong, Yongxin Yang, Timothy Hospedales

In this work, we introduce MEDFAIR, a framework to benchmark the fairness of machine learning models for medical imaging.

Benchmarking Fairness +2

Attacking Adversarial Defences by Smoothing the Loss Landscape

1 code implementation1 Aug 2022 Panagiotis Eustratiadis, Henry Gouk, Da Li, Timothy Hospedales

This paper investigates a family of methods for defending against adversarial attacks that owe part of their success to creating a noisy, discontinuous, or otherwise rugged loss landscape that adversaries find difficult to navigate.


HyperInvariances: Amortizing Invariance Learning

no code implementations17 Jul 2022 Ruchika Chavhan, Henry Gouk, Jan Stühmer, Timothy Hospedales

Providing invariances in a given learning task conveys a key inductive bias that can lead to sample-efficient learning and good generalisation, if correctly specified.

Inductive Bias

Feed-Forward Latent Domain Adaptation

no code implementations15 Jul 2022 Ondrej Bohdal, Da Li, Shell Xu Hu, Timothy Hospedales

Recognizing that device's data are likely to come from multiple latent domains that include a mixture of unlabelled domain-relevant and domain-irrelevant examples, we focus on the comparatively under-studied problem of latent domain adaptation.

Source-Free Domain Adaptation

MetaAudio: A Few-Shot Audio Classification Benchmark

1 code implementation5 Apr 2022 Calum Heggan, Sam Budgett, Timothy Hospedales, Mehrdad Yaghoobi

Currently available benchmarks for few-shot learning (machine learning with few training examples) are limited in the domains they cover, primarily focusing on image classification.

Audio Classification Few-Shot Audio Classification +1

Finding lost DG: Explaining domain generalization via model complexity

no code implementations1 Feb 2022 Da Li, Henry Gouk, Timothy Hospedales

However much of the work in general purpose DG is heuristically motivated, as the DG problem is hard to model formally; and recent evaluations have cast doubt on existing methods' practical efficacy -- in particular compared to a well tuned empirical risk minimisation baseline.

Domain Generalization

Gaussian Process Meta Few-shot Classifier Learning via Linear Discriminant Laplace Approximation

no code implementations9 Nov 2021 Minyoung Kim, Timothy Hospedales

In essence, the MAP solution is approximated by the LDA estimate, but to take the GP prior into account, we adopt the prior-norm adjustment to estimate LDA's shared variance parameters, which ensures that the adjusted estimate is consistent with the GP prior.


Defensive Tensorization

no code implementations26 Oct 2021 Adrian Bulat, Jean Kossaifi, Sourav Bhattacharya, Yannis Panagakis, Timothy Hospedales, Georgios Tzimiropoulos, Nicholas D Lane, Maja Pantic

We propose defensive tensorization, an adversarial defence technique that leverages a latent high-order factorization of the network.

Audio Classification Image Classification

Online Hyperparameter Meta-Learning with Hypergradient Distillation

no code implementations ICLR 2022 Hae Beom Lee, Hayeon Lee, Jaewoong Shin, Eunho Yang, Timothy Hospedales, Sung Ju Hwang

Many gradient-based meta-learning methods assume a set of parameters that do not participate in inner-optimization, which can be considered as hyperparameters.

Hyperparameter Optimization Knowledge Distillation +1

Loss Function Learning for Domain Generalization by Implicit Gradient

no code implementations29 Sep 2021 Boyan Gao, Henry Gouk, Yongxin Yang, Timothy Hospedales

We take a different approach, and explore the impact of the ERM loss function on out-of-domain generalisation.

Domain Generalization Meta-Learning

SketchODE: Learning neural sketch representation in continuous time

no code implementations ICLR 2022 Ayan Das, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song

Learning meaningful representations for chirographic drawing data such as sketches, handwriting, and flowcharts is a gateway for understanding and emulating human creative expression.

Data Augmentation

Vision-based system identification and 3D keypoint discovery using dynamics constraints

no code implementations13 Sep 2021 Miguel Jaques, Martin Asenov, Michael Burke, Timothy Hospedales

This paper introduces V-SysId, a novel method that enables simultaneous keypoint discovery, 3D system identification, and extrinsic camera calibration from an unlabeled video taken from a static camera, using only the family of equations of motion of the object of interest as weak supervision.

Camera Calibration

A Channel Coding Benchmark for Meta-Learning

1 code implementation15 Jul 2021 Rui Li, Ondrej Bohdal, Rajesh Mishra, Hyeji Kim, Da Li, Nicholas Lane, Timothy Hospedales

We use our MetaCC benchmark to study several aspects of meta-learning, including the impact of task distribution breadth and shift, which can be controlled in the coding problem.


EvoGrad: Efficient Gradient-Based Meta-Learning and Hyperparameter Optimization

1 code implementation NeurIPS 2021 Ondrej Bohdal, Yongxin Yang, Timothy Hospedales

Gradient-based meta-learning and hyperparameter optimization have seen significant progress recently, enabling practical end-to-end training of neural networks together with many hyperparameters.

cross-domain few-shot learning Hyperparameter Optimization

Meta-Calibration: Learning of Model Calibration Using Differentiable Expected Calibration Error

1 code implementation17 Jun 2021 Ondrej Bohdal, Yongxin Yang, Timothy Hospedales

The problem is especially noticeable when using modern neural networks, for which there is a significant difference between the confidence of the model and the probability of correct prediction.


Cloud2Curve: Generation and Vectorization of Parametric Sketches

1 code implementation CVPR 2021 Ayan Das, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song

Analysis of human sketches in deep learning has advanced immensely through the use of waypoint-sequences rather than raster-graphic representations.

Shallow Bayesian Meta Learning for Real-World Few-Shot Recognition

2 code implementations ICCV 2021 Xueting Zhang, Debin Meng, Henry Gouk, Timothy Hospedales

Current state-of-the-art few-shot learners focus on developing effective training procedures for feature representations, before using simple, e. g. nearest centroid, classifiers.

cross-domain few-shot learning Few-Shot Image Classification

Reducing Implicit Bias in Latent Domain Learning

no code implementations1 Jan 2021 Lucas Deecke, Timothy Hospedales, Hakan Bilen

A fundamental shortcoming of deep neural networks is their specialization to a single task and domain.

Image Classification

Robust Domain Randomised Reinforcement Learning through Peer-to-Peer Distillation

no code implementations9 Dec 2020 Chenyang Zhao, Timothy Hospedales

In reinforcement learning, domain randomisation is an increasingly popular technique for learning more general policies that are robust to domain-shifts at deployment.

Continuous Control reinforcement-learning +1

Margin-Based Transfer Bounds for Meta Learning with Deep Feature Embedding

no code implementations2 Dec 2020 Jiechao Guan, Zhiwu Lu, Tao Xiang, Timothy Hospedales

By transferring knowledge learned from seen/previous tasks, meta learning aims to generalize well to unseen/future tasks.

Classification General Classification +2

Weight-Covariance Alignment for Adversarially Robust Neural Networks

1 code implementation17 Oct 2020 Panagiotis Eustratiadis, Henry Gouk, Da Li, Timothy Hospedales

Stochastic Neural Networks (SNNs) that inject noise into their hidden layers have recently been shown to achieve strong robustness against adversarial attacks.

Adversarial Robustness

Learning the Prediction Distribution for Semi-Supervised Learning with Normalising Flows

1 code implementation6 Jul 2020 Ivana Balažević, Carl Allen, Timothy Hospedales

In this work, we propose a probabilistically principled general approach to SSL that considers the distribution over label predictions, for labels of different complexity, from "one-hot" vectors to binary vectors and images.

Attribute General Classification +4

BézierSketch: A generative model for scalable vector sketches

1 code implementation ECCV 2020 Ayan Das, Yongxin Yang, Timothy Hospedales, Tao Xiang, Yi-Zhe Song

The study of neural generative models of human sketches is a fascinating contemporary modeling problem due to the links between sketch image generation and the human drawing process.

Image Generation

Flexible Dataset Distillation: Learn Labels Instead of Images

2 code implementations15 Jun 2020 Ondrej Bohdal, Yongxin Yang, Timothy Hospedales

In particular, we study the problem of label distillation - creating synthetic labels for a small set of real images, and show it to be more effective than the prior image-based approach to dataset distillation.

Data Summarization Meta-Learning

A Probabilistic Model for Discriminative and Neuro-Symbolic Semi-Supervised Learning

no code implementations10 Jun 2020 Carl Allen, Ivana Balažević, Timothy Hospedales

Much progress has been made in semi-supervised learning (SSL) by combining methods that exploit different aspects of the data distribution, e. g. consistency regularisation relies on properties of $p(x)$, whereas entropy minimisation pertains to the label distribution $p(y|x)$.

Image Augmentation Logical Reasoning

NewtonianVAE: Proportional Control and Goal Identification from Pixels via Physical Latent Spaces

no code implementations CVPR 2021 Miguel Jaques, Michael Burke, Timothy Hospedales

Learning low-dimensional latent state space dynamics models has been a powerful paradigm for enabling vision-based planning and learning for control.

Behavioural cloning

Latent Domain Learning with Dynamic Residual Adapters

no code implementations1 Jun 2020 Lucas Deecke, Timothy Hospedales, Hakan Bilen

While recent techniques in domain adaptation and multi-domain learning enable the learning of more domain-agnostic features, their success relies on the presence of domain labels, typically requiring manual annotation and careful curation of datasets.

Domain Adaptation Image Classification +1

SimpleMKKM: Simple Multiple Kernel K-means

1 code implementation11 May 2020 Xinwang Liu, En Zhu, Jiyuan Liu, Timothy Hospedales, Yang Wang, Meng Wang

We propose a simple yet effective multiple kernel clustering algorithm, termed simple multiple kernel k-means (SimpleMKKM).


Meta-Learning in Neural Networks: A Survey

1 code implementation11 Apr 2020 Timothy Hospedales, Antreas Antoniou, Paul Micaelli, Amos Storkey

We survey promising applications and successes of meta-learning such as few-shot learning and reinforcement learning.

Few-Shot Learning Hyperparameter Optimization +1

Online Meta-Learning for Multi-Source and Semi-Supervised Domain Adaptation

no code implementations ECCV 2020 Da Li, Timothy Hospedales

Therefore we propose an online shortest-path meta-learning framework that is both computationally tractable and practically effective for improving DA performance.

Meta-Learning Multi-Source Unsupervised Domain Adaptation +2

Sequential Learning for Domain Generalization

no code implementations3 Apr 2020 Da Li, Yongxin Yang, Yi-Zhe Song, Timothy Hospedales

In DG this means encountering a sequence of domains and at each step training to maximise performance on the next domain.

Domain Generalization Meta-Learning

Deep Domain-Adversarial Image Generation for Domain Generalisation

no code implementations12 Mar 2020 Kaiyang Zhou, Yongxin Yang, Timothy Hospedales, Tao Xiang

This is achieved by having a learning objective formulated to ensure that the generated data can be correctly classified by the label classifier while fooling the domain classifier.

Domain Generalization Image Generation

Incremental Few-Shot Object Detection

no code implementations CVPR 2020 Juan-Manuel Perez-Rua, Xiatian Zhu, Timothy Hospedales, Tao Xiang

To this end we propose OpeN-ended Centre nEt (ONCE), a detector designed for incrementally learning to detect novel class objects with few examples.

Few-Shot Learning Few-Shot Object Detection +3

Adversarial Generation of Informative Trajectories for Dynamics System Identification

1 code implementation2 Mar 2020 Marija Jegorova, Joshua Smith, Michael Mistry, Timothy Hospedales

Dynamic System Identification approaches usually heavily rely on the evolutionary and gradient-based optimisation techniques to produce optimal excitation trajectories for determining the physical parameters of robot platforms.

Generative Adversarial Network valid

Full-Scale Continuous Synthetic Sonar Data Generation with Markov Conditional Generative Adversarial Networks

no code implementations15 Oct 2019 Marija Jegorova, Antti Ilari Karjalainen, Jose Vazquez, Timothy Hospedales

High-quality realistic sonar data simulation could be of benefit to multiple applications, including training of human operators for post-mission analysis, as well as tuning and validation of autonomous target recognition (ATR) systems for underwater vehicles.

Interpreting Knowledge Graph Relation Representation from Word Embeddings

no code implementations ICLR 2021 Carl Allen, Ivana Balažević, Timothy Hospedales

Many models learn representations of knowledge graph data by exploiting its low-rank latent structure, encoding known relations between entities and enabling unknown facts to be inferred.

Link Prediction Relation +1

Simple and Effective Stochastic Neural Networks

no code implementations25 Sep 2019 Tianyuan Yu, Yongxin Yang, Da Li, Timothy Hospedales, Tao Xiang

Stochastic neural networks (SNNs) are currently topical, with several paradigms being actively investigated including dropout, Bayesian neural networks, variational information bottleneck (VIB) and noise regularized learning.

Adversarial Attack Adversarial Defense

Zero-Shot Crowd Behavior Recognition

no code implementations16 Aug 2019 Xun Xu, Shaogang Gong, Timothy Hospedales

To that end, we relax the common assumption that each individual crowd video instance is only associated with a single crowd attribute.

Attribute Zero-Shot Learning

Factorized Higher-Order CNNs with an Application to Spatio-Temporal Emotion Estimation

no code implementations CVPR 2020 Jean Kossaifi, Antoine Toisoul, Adrian Bulat, Yannis Panagakis, Timothy Hospedales, Maja Pantic

To alleviate this, one approach is to apply low-rank tensor decompositions to convolution kernels in order to compress the network and reduce its number of parameters.

Emotion Recognition Image Classification

Physics-as-Inverse-Graphics: Unsupervised Physical Parameter Estimation from Video

1 code implementation ICLR 2020 Miguel Jaques, Michael Burke, Timothy Hospedales

Our approach significantly outperforms related unsupervised methods in long-term future frame prediction of systems with interacting objects (such as ball-spring or 3-body gravitational systems), due to its ability to build dynamics into the model as an inductive bias.

Inductive Bias Model Predictive Control +2

Multi-relational Poincaré Graph Embeddings

1 code implementation NeurIPS 2019 Ivana Balažević, Carl Allen, Timothy Hospedales

Hyperbolic embeddings have recently gained attention in machine learning due to their ability to represent hierarchical data more accurately and succinctly than their Euclidean analogues.

Entity Embeddings Knowledge Graphs +1

Analogies Explained: Towards Understanding Word Embeddings

no code implementations28 Jan 2019 Carl Allen, Timothy Hospedales

Word embeddings generated by neural network methods such as word2vec (W2V) are well known to exhibit seemingly linear behaviour, e. g. the embeddings of analogy "woman is to queen as man is to king" approximately describe a parallelogram.

Word Embeddings

Behavioural Repertoire via Generative Adversarial Policy Networks

no code implementations7 Nov 2018 Marija Jegorova, Stéphane Doncieux, Timothy Hospedales

Leveraging our generative policy network, a robot can sample novel behaviors until it finds one that works for a new environment.

Learning Unsupervised Word Translations Without Adversaries

no code implementations EMNLP 2018 Tanmoy Mukherjee, Makoto Yamada, Timothy Hospedales

Word translation, or bilingual dictionary induction, is an important capability that impacts many multilingual language processing tasks.

Machine Translation Multilingual Word Embeddings +3

Meta-Learning Transferable Active Learning Policies by Deep Reinforcement Learning

no code implementations ICLR 2018 Kunkun Pang, Mingzhi Dong, Yang Wu, Timothy Hospedales

In contrast to this body of research, we propose to treat active learning algorithm design as a meta-learning problem and learn the best criterion from data.

Active Learning Meta-Learning +2

What the Vec? Towards Probabilistically Grounded Embeddings

no code implementations NeurIPS 2019 Carl Allen, Ivana Balažević, Timothy Hospedales

We show that different interactions between PMI vectors reflect semantic word relationships, such as similarity and paraphrasing, that are encoded in low dimensional word embeddings under a suitable projection, theoretically explaining why embeddings of W2V and GloVe work.

Graph Embedding Word Embeddings

Learning to Sketch with Shortcut Cycle Consistency

no code implementations CVPR 2018 Jifei Song, Kaiyue Pang, Yi-Zhe Song, Tao Xiang, Timothy Hospedales

In this paper, we present a novel approach for translating an object photo to a sketch, mimicking the human sketching process.

Multi-Task Learning Retrieval +1

Transductive Zero-Shot Action Recognition by Word-Vector Embedding

no code implementations13 Nov 2015 Xun Xu, Timothy Hospedales, Shaogang Gong

This is a more challenging problem than existing ZSL of still images and/or attributes, because the mapping between video spacetime features of actions and the semantic space is more complex and harder to learn for the purpose of generalising over any cross-category domain shift.

Action Recognition Attribute +2

Free-hand Sketch Synthesis with Deformable Stroke Models

no code implementations9 Oct 2015 Yi Li, Yi-Zhe Song, Timothy Hospedales, Shaogang Gong

We present a generative model which can automatically summarize the stroke composition of free-hand sketches of a given category.

Zero-Shot Domain Adaptation via Kernel Regression on the Grassmannian

no code implementations28 Jul 2015 Yongxin Yang, Timothy Hospedales

Most visual recognition methods implicitly assume the data distribution remains unchanged from training to testing.

regression Unsupervised Domain Adaptation

Discovery of Shared Semantic Spaces for Multi-Scene Video Query and Summarization

no code implementations27 Jul 2015 Xun Xu, Timothy Hospedales, Shaogang Gong

The growing rate of public space CCTV installations has generated a need for automated methods for exploiting video surveillance data including scene understanding, query, behaviour annotation and summarization.

Scene Understanding Semantic Similarity +2

Making Better Use of Edges via Perceptual Grouping

no code implementations CVPR 2015 Yonggang Qi, Yi-Zhe Song, Tao Xiang, Honggang Zhang, Timothy Hospedales, Yi Li, Jun Guo

We propose a perceptual grouping framework that organizes image edges into meaningful structures and demonstrate its usefulness on various computer vision tasks.

Learning-To-Rank Retrieval +1

Semantic Embedding Space for Zero-Shot Action Recognition

no code implementations5 Feb 2015 Xun Xu, Timothy Hospedales, Shaogang Gong

In this framework a mapping is constructed between visual features and a human interpretable semantic description of each category, allowing categories to be recognised in the absence of any training data.

Action Recognition Attribute +3

Sketch-a-Net that Beats Humans

2 code implementations30 Jan 2015 Qian Yu, Yongxin Yang, Yi-Zhe Song, Tao Xiang, Timothy Hospedales

We propose a multi-scale multi-channel deep neural network framework that, for the first time, yields sketch recognition performance surpassing that of humans.

Sketch Recognition

Cannot find the paper you are looking for? You can Submit a new open access paper.