Winners at W-NUT 2020 Shared Task-3: Leveraging Event Specific and Chunk Span information for Extracting COVID Entities from Tweets. - Ayush Kaushal; Tejas Vaidhya (W-NUT@EMNLP, 2020)

IITKGP at W-NUT 2020 Shared Task-1: Domain specific BERT representation for Named Entity Recognition of lab protocol. - Tejas Vaidhya; Ayush Kaushal (W-NUT@EMNLP, 2020)

Leveraging Event Specific and Chunk Span features to Extract COVID Events from tweets. - Ayush Kaushal; Tejas Vaidhya (CoRR, 2020)

Domain specific BERT representation for Named Entity Recognition of lab protocol. - Tejas Vaidhya; Ayush Kaushal (CoRR, 2020)

WordTokenizers.jl: Basic tools for tokenizing natural language in Julia. - Ayush Kaushal; Lyndon White; Mike Innes; Rohit Kumar (J. Open Source Softw., 2020)

Causal Direction of Data Collection Matters: Implications of Causal and Anticausal Learning for NLP. - Zhijing Jin 001; Julius von Kügelgen; Jingwei Ni; Tejas Vaidhya; Ayush Kaushal; Mrinmaya Sachan; Bernhard Schölkopf (EMNLP (1), 2021)

tWT-WT: A Dataset to Assert the Role of Target Entities for Detecting Stance of Tweets. - Ayush Kaushal; Avirup Saha; Niloy Ganguly (NAACL-HLT, 2021)

KGP at SemEval-2021 Task 8: Leveraging Multi-Staged Language Models for Extracting Measurements, their Attributes and Relations. - Neel Karia; Ayush Kaushal; Faraaz Mallick (SemEval@ACL/IJCNLP, 2021)

INDEPROP: Information-Preserving De-propagandization of News Articles (Student Abstract). - Aaryan Bhagat; Faraaz Mallick; Neel Karia; Ayush Kaushal (AAAI, 2022)

What do tokens know about their characters and how do they know it? - Ayush Kaushal; Kyle Mahowald (NAACL-HLT, 2022)

Efficient Encoders for Streaming Sequence Tagging. - Ayush Kaushal; Aditya Gupta; Shyam Upadhyay; Manaal Faruqui (EACL, 2023)

LORD: Low Rank Decomposition Of Monolingual Code LLMs For One-Shot Compression. - Ayush Kaushal; Tejas Vaidhya; Irina Rish (CoRR, 2023)

Spectra: A Comprehensive Study of Ternary, Quantized, and FP16 Language Models. - Ayush Kaushal; Tejas Pandey; Tejas Vaidhya; Aaryan Bhagat; Irina Rish (CoRR, 2024)

Scaling Laws and Efficient Inference for Ternary Language Models. - Tejas Vaidhya; Ayush Kaushal; Vineet Jain; Francis Couture Harpin; Prashant Shishodia; Majid Behbahani; Yuriy Nevmyvaka; Irina Rish (ACL (1), 2025)

Surprising Effectiveness of pretraining Ternary Language Model at Scale. - Ayush Kaushal; Tejas Vaidhya; Arnab Kumar Mondal; Tejas Pandey; Aaryan Bhagat; Irina Rish (ICLR, 2025)

Spectra 1.1: Scaling Laws and Efficient Inference for Ternary Language Models. - Tejas Vaidhya; Ayush Kaushal; Vineet Jain; Francis Couture Harpin; Prashant Shishodia; Majid Behbahani; Yuriy Nevmyvaka; Irina Rish (CoRR, 2025)