Search Results for author: C. V. Jawahar

Found 79 papers, 27 papers with code

Recurrent Image Annotation With Explicit Inter-Label Dependencies

1 code implementation ECCV 2020 Ayushi Dutta, Yashaswi Verma, C. V. Jawahar

Additionally, it provides a new perspecitve of looking at an unordered set of labels as equivalent to a collection of different permutations (sequences) of those labels, thus naturally aligning with the image annotation task.

Image Captioning

Detecting, Tracking and Counting Motorcycle Rider Traffic Violations on Unconstrained Roads

1 code implementation18 Apr 2022 Aman Goyal, Dev Agarwal, Anbumani Subramanian, C. V. Jawahar, Ravi Kiran Sarvadevabhatla, Rohit Saluja

In many Asian countries with unconstrained road traffic conditions, driving violations such as not wearing helmets and triple-riding are a significant source of fatalities involving motorcycles.

Classroom Slide Narration System

no code implementations21 Jan 2022 Jobin K. V., Ajoy Mondal, C. V. Jawahar

With this information, we build a Classroom Slide Narration System (CSNS) to help VI students understand the slide content.

Optical Character Recognition Semantic Segmentation +1

Automatic Quantification and Visualization of Street Trees

1 code implementation17 Jan 2022 Arpit Bahety, Rohit Saluja, Ravi Kiran Sarvadevabhatla, Anbumani Subramanian, C. V. Jawahar

We obtain TCDCA of 96. 77% on the test videos, with a remarkable improvement of 22. 58% over baseline, and demonstrate that our counting module's performance is close to human level.

Transfer Learning for Scene Text Recognition in Indian Languages

no code implementations10 Jan 2022 Sanjana Gunna, Rohit Saluja, C. V. Jawahar

WRRs improve over the baselines by 8%, 4%, 5%, and 3% on the MLT-19 Hindi and Bangla datasets and the Gujarati and Tamil datasets.

Scene Text Recognition Transfer Learning

Towards Boosting the Accuracy of Non-Latin Scene Text Recognition

1 code implementation10 Jan 2022 Sanjana Gunna, Rohit Saluja, C. V. Jawahar

Several controlled experiments are performed on English, by varying the number of (i) fonts to create the synthetic data and (ii) created word images.

Scene Text Recognition

Multi-Domain Incremental Learning for Semantic Segmentation

1 code implementation23 Oct 2021 Prachi Garg, Rohit Saluja, Vineeth N Balasubramanian, Chetan Arora, Anbumani Subramanian, C. V. Jawahar

Recent efforts in multi-domain learning for semantic segmentation attempt to learn multiple geographical datasets in a universal, joint model.

Incremental Learning Scene Segmentation

Ego4D: Around the World in 3,000 Hours of Egocentric Video

no code implementations13 Oct 2021 Kristen Grauman, Andrew Westbury, Eugene Byrne, Zachary Chavis, Antonino Furnari, Rohit Girdhar, Jackson Hamburger, Hao Jiang, Miao Liu, Xingyu Liu, Miguel Martin, Tushar Nagarajan, Ilija Radosavovic, Santhosh Kumar Ramakrishnan, Fiona Ryan, Jayant Sharma, Michael Wray, Mengmeng Xu, Eric Zhongcong Xu, Chen Zhao, Siddhant Bansal, Dhruv Batra, Vincent Cartillier, Sean Crane, Tien Do, Morrie Doulaty, Akshay Erapalli, Christoph Feichtenhofer, Adriano Fragomeni, Qichen Fu, Abrham Gebreselasie, Cristina Gonzalez, James Hillis, Xuhua Huang, Yifei HUANG, Wenqi Jia, Weslie Khoo, Jachym Kolar, Satwik Kottur, Anurag Kumar, Federico Landini, Chao Li, Yanghao Li, Zhenqiang Li, Karttikeya Mangalam, Raghava Modhugu, Jonathan Munro, Tullie Murrell, Takumi Nishiyasu, Will Price, Paola Ruiz Puentes, Merey Ramazanova, Leda Sari, Kiran Somasundaram, Audrey Southerland, Yusuke Sugano, Ruijie Tao, Minh Vo, Yuchen Wang, Xindi Wu, Takuma Yagi, Ziwei Zhao, Yunyi Zhu, Pablo Arbelaez, David Crandall, Dima Damen, Giovanni Maria Farinella, Christian Fuegen, Bernard Ghanem, Vamsi Krishna Ithapu, C. V. Jawahar, Hanbyul Joo, Kris Kitani, Haizhou Li, Richard Newcombe, Aude Oliva, Hyun Soo Park, James M. Rehg, Yoichi Sato, Jianbo Shi, Mike Zheng Shou, Antonio Torralba, Lorenzo Torresani, Mingfei Yan, Jitendra Malik

We introduce Ego4D, a massive-scale egocentric video dataset and benchmark suite.

De-identification

Evaluating Computer Vision Techniques for Urban Mobility on Large-Scale, Unconstrained Roads

no code implementations11 Sep 2021 Harish Rithish, Raghava Modhugu, Ranjith Reddy, Rohit Saluja, C. V. Jawahar

Conventional approaches for addressing road safety rely on manual interventions or immobile CCTV infrastructure.

ICDAR2019 Competition on Scanned Receipt OCR and Information Extraction

1 code implementation18 Mar 2021 Zheng Huang, Kai Chen, Jianhua He, Xiang Bai, Dimosthenis Karatzas, Shjian Lu, C. V. Jawahar

In this competition, we set up three tasks, namely, Scanned Receipt Text Localisation (Task 1), Scanned Receipt OCR (Task 2) and Key Information Extraction from Scanned Receipts (Task 3).

Key information extraction Optical Character Recognition

Few Shot Learning With No Labels

no code implementations26 Dec 2020 Aditya Bharti, N. B. Vineeth, C. V. Jawahar

Few-shot learners aim to recognize new categories given only a small number of training samples.

Few-Shot Learning

Improving Word Recognition using Multiple Hypotheses and Deep Embeddings

1 code implementation27 Oct 2020 Siddhant Bansal, Praveen Krishnan, C. V. Jawahar

We propose a novel scheme for improving the word recognition accuracy using word image embeddings.

Table Structure Recognition using Top-Down and Bottom-Up Cues

1 code implementation ECCV 2020 Sachin Raja, Ajoy Mondal, C. V. Jawahar

We present an approach for table structure recognition that combines cell detection and interaction modules to localize the cells and predict their row and column associations with other detected cells.

Optical Character Recognition

Graphical Object Detection in Document Images

1 code implementation25 Aug 2020 Ranajit Saha, Ajoy Mondal, C. V. Jawahar

Graphical elements: particularly tables and figures contain a visual summary of the most valuable information contained in a document.

Domain Adaptation Object Detection +1

A Lip Sync Expert Is All You Need for Speech to Lip Generation In The Wild

3 code implementations23 Aug 2020 K R Prajwal, Rudrabha Mukhopadhyay, Vinay Namboodiri, C. V. Jawahar

However, they fail to accurately morph the lip movements of arbitrary identities in dynamic, unconstrained talking face videos, resulting in significant parts of the video being out-of-sync with the new audio.

Unconstrained Lip-synchronization

Document Visual Question Answering Challenge 2020

no code implementations20 Aug 2020 Minesh Mathew, Ruben Tito, Dimosthenis Karatzas, R. Manmatha, C. V. Jawahar

For the task 1 a new dataset is introduced comprising 50, 000 questions-answer(s) pairs defined over 12, 767 document images.

Question Answering Visual Question Answering

Revisiting Low Resource Status of Indian Languages in Machine Translation

no code implementations11 Aug 2020 Jerin Philip, Shashank Siripragada, Vinay P. Namboodiri, C. V. Jawahar

Through this paper, we provide and analyse an automated framework to obtain such a corpus for Indian language neural machine translation (NMT) systems.

Machine Translation Translation

Textual Description for Mathematical Equations

1 code implementation7 Aug 2020 Ajoy Mondal, C. V. Jawahar

Reading of mathematical expression or equation in the document images is very challenging due to the large variability of mathematical symbols and expressions.

Image Captioning

IIIT-AR-13K: A New Dataset for Graphical Object Detection in Documents

no code implementations6 Aug 2020 Ajoy Mondal, Peter Lipps, C. V. Jawahar

This dataset, IIIT-AR-13k, is created by manually annotating the bounding boxes of graphical or page objects in publicly available annual reports.

Object Detection Table Detection

Weakly Supervised Instance Segmentation by Learning Annotation Consistent Instances

no code implementations ECCV 2020 Aditya Arun, C. V. Jawahar, M. Pawan Kumar

Recent approaches for weakly supervised instance segmentations depend on two components: (i) a pseudo label generation model that provides instances which are consistent with a given annotation; and (ii) an instance segmentation model, which is trained in a supervised manner using the pseudo labels as ground-truth.

Image-level Supervised Instance Segmentation Semantic Segmentation +1

A Multilingual Parallel Corpora Collection Effort for Indian Languages

2 code implementations LREC 2020 Shashank Siripragada, Jerin Philip, Vinay P. Namboodiri, C. V. Jawahar

We present sentence aligned parallel corpora across 10 Indian Languages - Hindi, Telugu, Tamil, Malayalam, Gujarati, Urdu, Bengali, Oriya, Marathi, Punjabi, and English - many of which are categorized as low resource.

Machine Translation Translation

Fused Text Recogniser and Deep Embeddings Improve Word Recognition and Retrieval

1 code implementation1 Jul 2020 Siddhant Bansal, Praveen Krishnan, C. V. Jawahar

Recognition and retrieval of textual content from the large document collections have been a powerful use case for the document image analysis community.

Optical Character Recognition

RoadText-1K: Text Detection & Recognition Dataset for Driving Videos

no code implementations19 May 2020 Sangeeth Reddy, Minesh Mathew, Lluis Gomez, Marcal Rusinol, Dimosthenis Karatzas., C. V. Jawahar

State of the art methods for text detection, recognition and tracking are evaluated on the new dataset and the results signify the challenges in unconstrained driving videos compared to existing datasets.

Frame

Learning Individual Speaking Styles for Accurate Lip to Speech Synthesis

1 code implementation CVPR 2020 K R Prajwal, Rudrabha Mukhopadhyay, Vinay Namboodiri, C. V. Jawahar

In this work, we explore the task of lip to speech synthesis, i. e., learning to generate natural speech given only the lip movements of a speaker.

 Ranked #1 on Lip Reading on LRW

Lip Reading Speaker-Specific Lip to Speech Synthesis +1

IndicSpeech: Text-to-Speech Corpus for Indian Languages

no code implementations LREC 2020 Nimisha Srivastava, Rudrabha Mukhopadhyay, Prajwal K R, C. V. Jawahar

We believe that one of the major reasons for this is the lack of large, publicly available text-to-speech corpora in these languages that are suitable for training neural text-to-speech systems.

Towards Automatic Face-to-Face Translation

1 code implementation ACM Multimedia, 2019 2019 Prajwal K R, Rudrabha Mukhopadhyay, Jerin Philip, Abhishek Jha, Vinay Namboodiri, C. V. Jawahar

As today's digital communication becomes increasingly visual, we argue that there is a need for systems that can automatically translate a video of a person speaking in language A into a target language B with realistic lip synchronization.

 Ranked #1 on Talking Face Generation on LRW (using extra training data)

Face to Face Translation Machine Translation +3

ICDAR 2019 Robust Reading Challenge on Reading Chinese Text on Signboard

no code implementations20 Dec 2019 Xi Liu, Rui Zhang, Yongsheng Zhou, Qianyi Jiang, Qi Song, Nan Li, Kai Zhou, Lei Wang, Dong Wang, Minghui Liao, Mingkun Yang, Xiang Bai, Baoguang Shi, Dimosthenis Karatzas, Shijian Lu, C. V. Jawahar

21 teams submit results for Task 1, 23 teams submit results for Task 2, 24 teams submit results for Task 3, and 13 teams submit results for Task 4.

Line Detection

A Deep Learning Approach for Robust Corridor Following

no code implementations18 Nov 2019 Vishnu Sashank Dorbala, A. H. Abdul Hafez, C. V. Jawahar

For an autonomous corridor following task where the environment is continuously changing, several forms of environmental noise prevent an automated feature extraction procedure from performing reliably.

CVIT's submissions to WAT-2019

no code implementations WS 2019 Jerin Philip, Shashank Siripragada, Upendra Kumar, Vinay Namboodiri, C. V. Jawahar

This paper describes the Neural Machine Translation systems used by IIIT Hyderabad (CVIT-MT) for the translation tasks part of WAT-2019.

Machine Translation Translation

ICDAR 2019 Competition on Scene Text Visual Question Answering

no code implementations30 Jun 2019 Ali Furkan Biten, Rubèn Tito, Andres Mafla, Lluis Gomez, Marçal Rusiñol, Minesh Mathew, C. V. Jawahar, Ernest Valveny, Dimosthenis Karatzas

ST-VQA introduces an important aspect that is not addressed by any Visual Question Answering system up to date, namely the incorporation of scene text to answer questions asked about an image.

Question Answering Visual Question Answering +1

CVIT-MT Systems for WAT-2018

no code implementations PACLIC 2018 Jerin Philip, Vinay P. Namboodiri, C. V. Jawahar

This document describes the machine translation system used in the submissions of IIIT-Hyderabad CVIT-MT for the WAT-2018 English-Hindi translation task.

Machine Translation Translation

Self-Supervised Visual Representations for Cross-Modal Retrieval

no code implementations31 Jan 2019 Yash Patel, Lluis Gomez, Marçal Rusiñol, Dimosthenis Karatzas, C. V. Jawahar

Cross-modal retrieval methods have been significantly improved in last years with the use of deep neural networks and large-scale annotated datasets such as ImageNet and Places.

Cross-Modal Retrieval Image Classification +1

City-Scale Road Audit System using Deep Learning

1 code implementation26 Nov 2018 Sudhir Yarram, Girish Varma, C. V. Jawahar

Road networks in cities are massive and is a critical component of mobility.

Frame Semantic Segmentation

IDD: A Dataset for Exploring Problems of Autonomous Navigation in Unconstrained Environments

2 code implementations26 Nov 2018 Girish Varma, Anbumani Subramanian, Anoop Namboodiri, Manmohan Chandraker, C. V. Jawahar

It also reflects label distributions of road scenes significantly different from existing datasets, with most classes displaying greater within-class diversity.

Autonomous Navigation Domain Adaptation +3

Universal Semi-Supervised Semantic Segmentation

1 code implementation ICCV 2019 Tarun Kalluri, Girish Varma, Manmohan Chandraker, C. V. Jawahar

In recent years, the need for semantic segmentation has arisen across several different applications and environments.

Ranked #21 on Semantic Segmentation on DensePASS (using extra training data)

Semi-Supervised Semantic Segmentation Unsupervised Domain Adaptation

Improved Visual Relocalization by Discovering Anchor Points

no code implementations11 Nov 2018 Soham Saha, Girish Varma, C. V. Jawahar

Our method improves the median error in indoor as well as outdoor localization datasets compared to the previous best deep learning model known as PoseNet (with geometric re-projection loss) using the same feature extractor.

Class2Str: End to End Latent Hierarchy Learning

1 code implementation20 Aug 2018 Soham Saha, Girish Varma, C. V. Jawahar

We propose an alternate architecture to the classifier network called the Latent Hierarchy (LH) Classifier and an end to end learned Class2Str mapping which discovers a latent hierarchy of the classes.

General Classification Image Classification

Connecting Visual Experiences using Max-flow Network with Application to Visual Localization

no code implementations1 Aug 2018 A. H. Abdul Hafez, Nakul Agarwal, C. V. Jawahar

This problem is solved by finding the maximum flow in a directed graph flow-network, whose vertices represent the matches between frames in the test and reference sequences.

Autonomous Navigation Visual Localization

Learning Human Poses from Actions

no code implementations24 Jul 2018 Aditya Arun, C. V. Jawahar, M. Pawan Kumar

In order to avoid the high cost of full supervision, we propose to use a diverse data set, which consists of two types of annotations: (i) a small number of images are labeled using the expensive ground-truth pose; and (ii) other images are labeled using the inexpensive action label.

TextTopicNet - Self-Supervised Learning of Visual Features Through Embedding Images on Semantic Text Spaces

1 code implementation4 Jul 2018 Yash Patel, Lluis Gomez, Raul Gomez, Marçal Rusiñol, Dimosthenis Karatzas, C. V. Jawahar

We show that adequate visual features can be learned efficiently by training a CNN to predict the semantic textual context in which a particular image is more probable to appear as an illustration.

Image Classification Object Detection +1

Efficient Semantic Segmentation using Gradual Grouping

no code implementations22 Jun 2018 Nikitha Vallurupalli, Sriharsha Annamaneni, Girish Varma, C. V. Jawahar, Manu Mathew, Soyeb Nagori

We study the effectiveness of these techniques on a real-time semantic segmentation architecture like ERFNet for improving run time by over 5X.

Real-Time Semantic Segmentation

Unsupervised Learning of Face Representations

1 code implementation3 Mar 2018 Samyak Datta, Gaurav Sharma, C. V. Jawahar

Although faces extracted from videos have a lower spatial resolution than those which are available as part of standard supervised face datasets such as LFW and CASIA-WebFace, the former represent a much more realistic setting, e. g. in surveillance scenarios where most of the faces detected are very small.

Frame

HWNet v2: An Efficient Word Image Representation for Handwritten Documents

no code implementations17 Feb 2018 Praveen Krishnan, C. V. Jawahar

We present a framework for learning an efficient holistic representation for handwritten word images.

Transfer Learning

SmartTennisTV: Automatic indexing of tennis videos

no code implementations4 Jan 2018 Anurag Ghosh, C. V. Jawahar

In this paper, we demonstrate a score based indexing approach for tennis videos.

Towards Structured Analysis of Broadcast Badminton Videos

no code implementations23 Dec 2017 Anurag Ghosh, Suriya Singh, C. V. Jawahar

Sports video data is recorded for nearly every major tournament but remains archived and inaccessible to large scale data mining and analytics.

Unconstrained Scene Text and Video Text Recognition for Arabic Script

no code implementations7 Nov 2017 Mohit Jain, Minesh Mathew, C. V. Jawahar

For scripts like Arabic, a major challenge in developing robust recognizers is the lack of large quantity of annotated data.

Scene Text Recognition

An EEG-based Image Annotation System

no code implementations7 Nov 2017 Viral Parekh, Ramanathan Subramanian, Dipanjan Roy, C. V. Jawahar

The success of deep learning in computer vision has greatly increased the need for annotated image datasets.

EEG

Pose-Aware Person Recognition

no code implementations CVPR 2017 Vijay Kumar, Anoop Namboodiri, Manohar Paluri, C. V. Jawahar

Person recognition methods that use multiple body regions have shown significant improvements over traditional face-based recognition.

Person Recognition

Self-supervised learning of visual features through embedding images into text topic spaces

no code implementations CVPR 2017 Lluis Gomez, Yash Patel, Marçal Rusiñol, Dimosthenis Karatzas, C. V. Jawahar

End-to-end training from scratch of current deep architectures for new computer vision problems would require Imagenet-scale datasets, and this is not always possible.

Image Classification Object Detection +1

Automated Top View Registration of Broadcast Football Videos

no code implementations4 Mar 2017 Rahul Anand Sharma, Bharath Bhat, Vineet Gandhi, C. V. Jawahar

The proposed method is fully automatic in contrast to the current state of the art which requires manual initialization of point correspondences between the image and the static model.

Bird View Synthesis Frame +1

Align Me: A framework to generate Parallel Corpus Using OCRs and Bilingual Dictionaries

no code implementations WS 2016 Priyam Bakliwal, Devadath V V, C. V. Jawahar

Multilingual language processing tasks like statistical machine translation and cross language information retrieval rely mainly on availability of accurate parallel corpora.

Active Learning Information Retrieval +2

Generating Synthetic Data for Text Recognition

no code implementations15 Aug 2016 Praveen Krishnan, C. V. Jawahar

Generating synthetic images is an art which emulates the natural process of image generation in a closest possible manner.

Data Augmentation Image Generation

First Person Action Recognition Using Deep Learned Descriptors

no code implementations CVPR 2016 Suriya Singh, Chetan Arora, C. V. Jawahar

It can also be trained from relatively small number of labeled egocentric videos that are available.

Action Recognition

Matching Handwritten Document Images

no code implementations19 May 2016 Praveen Krishnan, C. V. Jawahar

We address the problem of predicting similarity between a pair of handwritten document images written by different individuals.

Efficient Optimization for Rank-based Loss Functions

no code implementations CVPR 2018 Pritish Mohapatra, Michal Rolinek, C. V. Jawahar, Vladimir Kolmogorov, M. Pawan Kumar

We provide a complete characterization of the loss functions that are amenable to our algorithm, and show that it includes both AP and NDCG based loss functions.

Information Retrieval

Trajectory Aligned Features For First Person Action Recognition

no code implementations7 Apr 2016 Suriya Singh, Chetan Arora, C. V. Jawahar

Objects present in the scene and hand gestures of the wearer are the most important cues for first person action recognition but are difficult to segment and recognize in an egocentric video.

Action Recognition

Enhancing Energy Minimization Framework for Scene Text Recognition with Top-Down Cues

no code implementations13 Jan 2016 Anand Mishra, Karteek Alahari, C. V. Jawahar

We build a conditional random field model on these detections to jointly model the strength of the detections and the interactions between them.

Scene Text Recognition

Multi-Label Cross-Modal Retrieval

1 code implementation ICCV 2015 Viresh Ranjan, Nikhil Rasiwasia, C. V. Jawahar

In this work, we address the problem of cross-modal retrieval in presence of multi-label annotations.

Cross-Modal Retrieval

Visual Phrases for Exemplar Face Detection

no code implementations ICCV 2015 Vijay Kumar, Anoop Namboodiri, C. V. Jawahar

Contrary to traditional approaches that model face variations from a large and diverse set of training examples, exemplar-based approaches use a collection of discriminatively trained exemplars for detection.

Face Detection

TennisVid2Text: Fine-grained Descriptions for Domain Specific Videos

no code implementations26 Nov 2015 Mohak Sukhwani, C. V. Jawahar

In this work, we attempt to describe videos from a specific domain - broadcast videos of lawn tennis matches.

Relative Parts: Distinctive Parts for Learning Relative Attributes

no code implementations CVPR 2014 Ramachandruni N. Sandeep, Yashaswi Verma, C. V. Jawahar

The notion of relative attributes as introduced by Parikh and Grauman (ICCV, 2011) provides an appealing way of comparing two images based on their visual properties (or attributes) such as "smiling" for face images, "naturalness" for outdoor images, etc.

Image Retrieval

Optimizing Average Precision using Weakly Supervised Data

no code implementations CVPR 2014 Aseem Behl, C. V. Jawahar, M. Pawan Kumar

The performance of binary classification tasks, such as action classification and object detection, is often measured in terms of the average precision (AP).

Action Classification Classification +2

Parsing World's Skylines using Shape-Constrained MRFs

no code implementations CVPR 2014 Rashmi Tonge, Subhransu Maji, C. V. Jawahar

We propose an approach for segmenting the individual buildings in typical skyline images.

Blocks That Shout: Distinctive Parts for Scene Classification

no code implementations CVPR 2013 Mayank Juneja, Andrea Vedaldi, C. V. Jawahar, Andrew Zisserman

The automatic discovery of distinctive parts for an object or scene class is challenging since it requires simultaneously to learn the part appearance and also to identify the part occurrences in images.

Classification General Classification +1

Cannot find the paper you are looking for? You can Submit a new open access paper.