Search Results for author: Ayush Kaushal

Found 10 papers, 7 papers with code

IITKGP at W-NUT 2020 Shared Task-1: Domain specific BERT representation for Named Entity Recognition of lab protocol

1 code implementation EMNLP (WNUT) 2020 Tejas Vaidhya, Ayush Kaushal

Supervised models trained to predict properties from representations have been achieving high accuracy on a variety of tasks. For in-stance, the BERT family seems to work exceptionally well on the downstream task from NER tagging to the range of other linguistictasks.

named-entity-recognition Named Entity Recognition +1

LORD: Low Rank Decomposition Of Monolingual Code LLMs For One-Shot Compression

no code implementations25 Sep 2023 Ayush Kaushal, Tejas Vaidhya, Irina Rish

Low Rank Decomposition of matrix - splitting a large matrix into a product of two smaller matrix offers a means for compression that reduces the parameters of a model without sparsification, and hence delivering more speedup on modern hardware.

Code Generation Quantization

Efficient Encoders for Streaming Sequence Tagging

no code implementations23 Jan 2023 Ayush Kaushal, Aditya Gupta, Shyam Upadhyay, Manaal Faruqui

A naive application of state-of-the-art bidirectional encoders for streaming sequence tagging would require encoding each token from scratch for each new token in an incremental streaming input (like transcribed speech).

What do tokens know about their characters and how do they know it?

1 code implementation NAACL 2022 Ayush Kaushal, Kyle Mahowald

Pre-trained language models (PLMs) that use subword tokenization schemes can succeed at a variety of language tasks that require character-level information, despite lacking explicit access to the character composition of tokens.

Causal Direction of Data Collection Matters: Implications of Causal and Anticausal Learning for NLP

1 code implementation EMNLP 2021 Zhijing Jin, Julius von Kügelgen, Jingwei Ni, Tejas Vaidhya, Ayush Kaushal, Mrinmaya Sachan, Bernhard Schölkopf

The principle of independent causal mechanisms (ICM) states that generative processes of real world data consist of independent modules which do not influence or inform each other.

Causal Inference Domain Adaptation

KGP at SemEval-2021 Task 8: Leveraging Multi-Staged Language Models for Extracting Measurements, their Attributes and Relations

1 code implementation SEMEVAL 2021 Neel Karia, Ayush Kaushal, Faraaz Mallick

SemEval-2021 Task 8: MeasEval aims at improving the machine understanding of measurements in scientific texts through a set of entity and semantic relation extraction sub-tasks on identifying quantity spans along with various attributes and relationships.

Multi-Task Learning Relation Extraction

Cannot find the paper you are looking for? You can Submit a new open access paper.