IndicLLMSuite: A Blueprint for Creating Pre-training and Fine-Tuning Datasets for Indian Languages

1 code implementation • 11 Mar 2024 • Mohammed Safi Ur Rahman Khan, Priyam Mehta, Ananth Sankar, Umashankar Kumaravelan, Sumanth Doddapaneni, Suriyaprasaad G, Varun Balan G, Sparsh Jain, Anoop Kunchukuttan, Pratyush Kumar, Raj Dabre, Mitesh M. Khapra

We hope that the datasets, tools, and resources released as a part of this work will not only propel the research and development of Indic LLMs but also establish an open-source blueprint for extending such efforts to other languages.

Transformer models: an introduction and catalog

no code implementations • 12 Feb 2023 • Xavier Amatriain, Ananth Sankar, Jie Bing, Praveen Kumar Bodigutla, Timothy J. Hazen, Michaeel Kazi

The goal of this paper is to offer a somewhat comprehensive but simple catalog and classification of the most popular Transformer models.

Self-Supervised Learning

Smoothed Gaussian Mixture Models for Video Classification and Recommendation

no code implementations • 17 Dec 2020 • Sirjan Kafle, Aman Gupta, Xue Xia, Ananth Sankar, Xi Chen, Di Wen, Liang Zhang

SGMM represents each video by the parameters of a Gaussian mixture model (GMM) trained for that video.

Action Recognition Classification +2

DeText: A Deep Text Ranking Framework with BERT

1 code implementation • 6 Aug 2020 • Weiwei Guo, Xiao-Wei Liu, Sida Wang, Huiji Gao, Ananth Sankar, Zimeng Yang, Qi Guo, Liang Zhang, Bo Long, Bee-Chung Chen, Deepak Agarwal

Ranking is the most important component in a search system.

Speech recognition for medical conversations

no code implementations • 20 Nov 2017 • Chung-Cheng Chiu, Anshuman Tripathi, Katherine Chou, Chris Co, Navdeep Jaitly, Diana Jaunzeikare, Anjuli Kannan, Patrick Nguyen, Hasim Sak, Ananth Sankar, Justin Tansuwan, Nathan Wan, Yonghui Wu, Xuedong Zhang

We explored both CTC and LAS systems for building speech recognition models.

Automatic Speech Recognition Automatic Speech Recognition (ASR) +1