Search Results for author:
Found 66 papers, 33 papers with code
Visually Consistent Hierarchical Image Classification
Hierarchical classification predicts labels across multiple levels of a taxonomy, e. g., from coarse-level 'Bird' to mid-level 'Hummingbird' to fine-level 'Green hermit', allowing flexible recognition under varying visual conditions.
Pose-Aware Self-Supervised Learning with Viewpoint Trajectory Regularization
Learning visual features from unlabeled images has proven successful for semantic categorization, often by mapping different $views$ of the same object to the same feature to achieve recognition invariance.
Debiased Learning for Remote Sensing Data
Deep learning has had remarkable success at analyzing handheld imagery such as consumer photos due to the availability of large-scale human annotations (e. g., ImageNet).
Zero-shot Building Attribute Extraction from Large-Scale Vision and Language Models
The proposed workflow contains two key components: image-level captioning and segment-level captioning for the building images based on the vocabularies pertinent to structural and civil engineering.
How to guess a gradient
We study how to narrow the gap in optimization performance between methods that calculate exact gradients and those that use directional derivatives.
Learning to Transform for Generalizable Instance-wise Invariance
However, too much or too little invariance can hurt, and the correct amount is unknown a priori and dependent on the instance.
VEATIC: Video-based Emotion and Affect Tracking in Context Dataset
Along with the dataset, we propose a new computer vision task to infer the affect of the selected character via both context and character information in each video frame.
Coordinate-based neural representations for computational adaptive optics in widefield microscopy
We implemented CoCoA for widefield imaging of mouse brain tissues and validated its performance with direct-wavefront-sensing-based adaptive optics.
Unsupervised Feature Learning with Emergent Data-Driven Prototypicality
With our feature mapper simply trained to spread out training instances in hyperbolic space, we observe that images move closer to the origin with congealing, validating our idea of unsupervised prototypicality discovery.
Bootstrapping Objectness from Videos by Relaxed Common Fate and Visual Grouping
The Gestalt law of common fate, i. e., what move at the same speed belong together, has inspired unsupervised object discovery based on motion segmentation.
Ranked #1 on
Unsupervised Object Segmentation
on FBMS-59
Cut and Learn for Unsupervised Object Detection and Instance Segmentation
We propose Cut-and-LEaRn (CutLER), a simple approach for training unsupervised object detection and segmentation models.
Ranked #1 on
Unsupervised Instance Segmentation
on UVO
High-fidelity Direct Contrast Synthesis from Magnetic Resonance Fingerprinting
Here we propose a supervised learning-based method that directly synthesizes contrast-weighted images from the MRF data without going through the quantitative mapping and spin-dynamics simulation.
Generative Adversarial Network
Magnetic Resonance Fingerprinting
+1
Improving Unsupervised Video Object Segmentation with Motion-Appearance Synergy
Previous methods in unsupervised video object segmentation (UVOS) have demonstrated the effectiveness of motion as either input or supervision for segmentation.
Tracking the Dynamics of the Tear Film Lipid Layer
Tear film instability is a known factor for DED, and is thought to be regulated in large part by the thin lipid layer that covers and stabilizes the tear film.
Multi-Spectral Image Classification with Ultra-Lean Complex-Valued Models
Multi-spectral imagery is invaluable for remote sensing due to different spectral signatures exhibited by materials that often appear identical in greyscale and RGB imagery.
Learning Hierarchical Image Segmentation For Recognition and By Recognition
Large vision and language models learned directly through image-text associations often lack detailed visual substantiation, whereas image segmentation tasks are treated separately from recognition, supervisedly learned without interconnections.
Unsupervised Scene Sketch to Photo Synthesis
Taking this advantage, we synthesize a photo-realistic image by combining the structure of a sketch and the visual style of a reference photo.
Open Long-Tailed Recognition in a Dynamic World
A practical recognition system must balance between majority (head) and minority (tail) classes, generalize across the distribution, and acknowledge novelty upon the instances of unseen classes (open classes).
Unsupervised Hierarchical Semantic Segmentation with Multiview Cosegmentation and Clustering Transformers
We enforce spatial consistency of grouping and bootstrap feature learning with co-segmentation among multiple views of the same image, and enforce semantic consistency across the grouping hierarchy with clustering transformers between coarse- and fine-grained features.
Debiased Learning from Naturally Imbalanced Pseudo-Labels
Our key insight is that pseudo-labels are naturally imbalanced due to intrinsic data similarity, even when a model is trained on balanced source data and evaluated on balanced target data.
Ranked #1 on
Few-Shot Image Classification
on ImageNet - 0-Shot
(using extra training data)
Co-domain Symmetry for Complex-Valued Deep Learning
We study complex-valued scaling as a type of symmetry natural and unique to complex-valued measurements and representations.
The Emergence of Objectness: Learning Zero-Shot Segmentation from Videos
Our model starts with two separate pathways: an appearance pathway that outputs feature-based region segmentation for a single image, and a motion pathway that outputs motion features for a pair of images.
Ranked #7 on
Unsupervised Object Segmentation
on FBMS-59
Unsupervised Selective Labeling for More Effective Semi-Supervised Learning
Intuitively, no matter what the downstream task is, instances to be labeled must be representative and diverse: The former would facilitate label propagation to unlabeled data, whereas the latter would ensure coverage of the entire dataset.
Active Learning
Semi-Supervised Image Classification (Cold Start)
Clipped Hyperbolic Classifiers Are Super-Hyperbolic Classifiers
Hyperbolic space can naturally embed hierarchies, unlike Euclidean space.
Compact and Optimal Deep Learning with Recurrent Parameter Generators
We propose a drastically different approach to compact and optimal deep learning: We decouple the Degrees of freedom (DoF) and the actual number of parameters of a model, optimize a small DoF with predefined random linear constraints for a large model of arbitrary architecture, in one-stage end-to-end learning.
Ranked #97 on
Image Classification
on ObjectNet
(using extra training data)
Unsupervised Discriminative Learning of Sounds for Audio Event Classification
Recent progress in network-based audio event classification has shown the benefit of pre-training models on visual data such as ImageNet.
Iterative Human and Automated Identification of Wildlife Images
Camera trapping is increasingly used to monitor wildlife, but this technology typically requires extensive data annotation.
Universal Weakly Supervised Segmentation by Pixel-to-Segment Contrastive Learning
Weakly supervised segmentation requires assigning a label to every pixel based on training instances with partial annotations such as image-level tags, object bounding boxes, labeled points and scribbles.
Unsupervised Visual Attention and Invariance for Reinforcement Learning
Existing methods focus on training an RL policy that is universal to changing visual domains, whereas we focus on extracting visual foreground that is universal, feeding clean invariant vision to the RL policy learner.
Memory-efficient Learning for High-Dimensional MRI Reconstruction
Deep learning (DL) based unrolled reconstructions have shown state-of-the-art performance for under-sampled magnetic resonance imaging (MRI).
Long-tailed Recognition by Routing Diverse Distribution-Aware Experts
We take a dynamic view of the training data and provide a principled model bias and variance analysis as the training data fluctuates: Existing long-tail classifiers invariably increase the model variance and the head-tail model bias gap remains large, due to more and larger confusion with hard negatives for the tail.
Ranked #26 on
Long-tail Learning
on iNaturalist 2018
Tied Block Convolution: Leaner and Better CNNs with Shared Thinner Filters
The concept of TBC can also be extended to group convolution and fully connected layers, and can be applied to various backbone networks and attention modules.
Unsupervised Feature Learning by Cross-Level Instance-Group Discrimination
Unsupervised feature learning has made great strides with contrastive learning based on instance discrimination and invariant mapping, as benchmarked on curated class-balanced datasets.
Contrastive Learning
Semi-Supervised Image Classification
+2
3D Shape Reconstruction from Free-Hand Sketches
Additionally, we propose a sketch standardization module to handle different sketch distortions and styles.
A Deep Learning Approach for Meibomian Gland Atrophy Evaluation in Meibography Images
The development set was used to train and tune the deep learning model, while the evaluation set was used to evaluate the performance of the model.
Orthogonal Convolutional Neural Networks
We develop an efficient approach to impose filter orthogonality on a convolutional layer based on the doubly block-Toeplitz matrix representation of the convolutional kernel instead of using the common kernel orthogonality approach, which we show is only necessary but not sufficient for ensuring orthogonal convolutions.
POIRot: A rotation invariant omni-directional pointnet
Our proposed model is rotationally invariant and can preserve geometric shape of a 3D point-cloud.
SegSort: Segmentation by Discriminative Sorting of Segments
The proposed SegSort further produces an interpretable result, as each choice of label can be easily understood from the retrieved nearest segments.
Ranked #10 on
Unsupervised Semantic Segmentation
on PASCAL VOC 2012 val
(using extra training data)
Building Information Modeling and Classification by Visual Learning At A City Scale
In the first case, a machine learning-assisted framework, BRAILS, is proposed for city-scale building information modeling.
Open Compound Domain Adaptation
A typical domain adaptation approach is to adapt models trained on the annotated data in a source domain (e. g., sunny weather) for achieving high performance on the test data in a target domain (e. g., rainy weather).
Spatial Transformer for 3D Point Clouds
We propose a novel end-to-end approach to learn different non-rigid transformations of the input point cloud so that optimal local neighborhoods can be adopted at each layer.
SurReal: Fréchet Mean and Distance Transform for Complex-Valued Deep Learning
On RadioML, our model achieves comparable RF modulation classification accuracy at 10% of the baseline model size.
Large-Scale Long-Tailed Recognition in an Open World
We define Open Long-Tailed Recognition (OLTR) as learning from such naturally distributed data and optimizing the classification accuracy over a balanced test set which include head, tail, and open classes.
Improving Generalization via Scalable Neighborhood Component Analysis
Current major approaches to visual recognition follow an end-to-end formulation that classifies an input image into one of the pre-determined set of semantic categories.
Unsupervised Feature Learning via Non-Parametric Instance Discrimination
Neural net classifiers trained on data with annotated class labels can also capture apparent visual similarity among categories without being directed to do so.
Ranked #41 on
Semi-Supervised Image Classification
on ImageNet - 1% labeled data
(Top 5 Accuracy metric)
Adversarial Structure Matching for Structured Prediction Tasks
The structure analyzer is trained to maximize the ASM loss, or to emphasize recurring multi-scale hard negative structural mistakes among co-occurring patterns.
Learning Beyond Human Expertise with Generative Models for Dental Restorations
In the dental industry, it takes a technician years of training to design synthetic crowns that restore the function and integrity of missing teeth.
Adaptive Affinity Fields for Semantic Segmentation
Semantic segmentation has made much progress with increasingly powerful pixel-wise classifiers and incorporating structural priors via Conditional Random Fields (CRF) or Generative Adversarial Networks (GAN).
Ranked #56 on
Semantic Segmentation
on Cityscapes test
Successive Embedding and Classification Loss for Aerial Image Classification
To address the overfitting problem in aerial image classification, we consider the neural network as successive transformations of an input image into embedded feature representations and ultimately into a semantic class label, and train neural networks to optimize image representations in the embedded space in addition to optimizing the final classification score.
Better than Real: Complex-valued Neural Nets for MRI Fingerprinting
The task of MRI fingerprinting is to identify tissue parameters from complex-valued MRI signals.
Learning Non-Lambertian Object Intrinsics across ShapeNet Categories
Rendered with realistic environment maps, millions of synthetic images of objects and their corresponding albedo, shading, and specular ground-truth images are used to train an encoder-decoder CNN.
Multigrid Neural Architectures
Most critically, multigrid structure enables networks to learn internal attention and dynamic routing mechanisms, and use them to accomplish tasks on which modern CNNs fail.
Am I a Baller? Basketball Performance Assessment from First-Person Videos
Finally, we use this feature to learn a basketball assessment model from pairs of labeled first-person basketball videos, for which a basketball expert indicates, which of the two players is better.
Unsupervised Learning of Important Objects from First-Person Videos
In this work, we show that we can detect important objects in first-person images without the supervision by the camera wearer or even third-person labelers.
Convolutional Random Walk Networks for Semantic Image Segmentation
It combines these two objectives via a novel random walk layer that enforces consistent spatial grouping in the deep layers of the network.
Fine-to-coarse Knowledge Transfer For Low-Res Image Classification
We address the difficult problem of distinguishing fine-grained object categories in low resolution images.
First Person Action-Object Detection with EgoNet
Unlike traditional third-person cameras mounted on robots, a first-person camera, captures a person's visual sensorimotor object interactions from up close.
Affinity CNN: Learning Pixel-Centric Pairwise Relations for Figure/Ground Embedding
Spectral embedding provides a framework for solving perceptual organization problems, including image segmentation and figure/ground organization.
Direct Intrinsics: Learning Albedo-Shading Decomposition by Convolutional Regression
We demonstrate results on both the synthetic images of Sintel and the real images of the classic MIT intrinsic image dataset.
Constrained Structured Regression with Convolutional Neural Networks
We present a regression framework which models the output distribution of neural networks.
Mapping Images to Sentiment Adjective Noun Pairs with Factorized Neural Nets
We consider the visual sentiment task of mapping an image to an adjective noun pair (ANP) such as "cute baby".
FlowWeb: Joint Image Set Alignment by Weaving Consistent, Pixel-Wise Correspondences
Given a set of poorly aligned images of the same visual concept without any annotations, we propose an algorithm to jointly bring them into pixel-wise correspondence by estimating a FlowWeb representation of the image set.
Learning Lightness From Human Judgement on Relative Reflectance
We develop a new approach to inferring lightness, the perceived reflectance of surfaces, from a single image.
Reconstructive Sparse Code Transfer for Contour Detection and Semantic Labeling
We frame the task of predicting a semantic labeling as a sparse reconstruction procedure that applies a target-specific learned transfer function to a generic deep sparse code representation of an image.
Feature Transitions with Saccadic Search: Size, Color, and Orientation Are Not Alike
Size, color, and orientation have long been considered elementary features whose attributes are extracted in parallel and available to guide the deployment of attention.
