Mayank Singh

About Mayank Singh

Mayank Singh, With an exceptional h-index of 13 and a recent h-index of 12 (since 2020), a distinguished researcher at Indian Institute of Technology Gandhinagar, specializes in the field of LLMs, Interpretability, Explainability, Code-mixing, NLP/ML/AI.

His recent articles reflect a diverse array of research interests and contributions to the field:

LEGOBench: Leaderboard Generation Benchmark for Scientific Models

Boldly Going Where No Benchmark Has Gone Before: Exposing Bias and Shortcomings in Code Generation Evaluation

Remember This Event That Year? Assessing Temporal Information and Reasoning in Large Language Models

Cross-lingual Editing in Multilingual Language Models

Unlocking Model Insights: A Dataset for Automated Model Card Generation

Tables to LaTeX: structure and content extraction from scientific tables

MMT: A Multilingual and Multi-Topic Indian Social Media Dataset

Bloom: A 176b-parameter open-access multilingual language model

Mayank Singh Information

University

Position

___

Citations(all)

1338

Citations(since 2020)

1296

Cited By

133

hIndex(all)

13

hIndex(since 2020)

12

i10Index(all)

18

i10Index(since 2020)

18

Email

University Profile Page

Indian Institute of Technology Gandhinagar

Google Scholar

View Google Scholar Profile

Mayank Singh Skills & Research Interests

LLMs

Interpretability

Explainability

Code-mixing

NLP/ML/AI

Top articles of Mayank Singh

Title

Journal

Author(s)

Publication Date

LEGOBench: Leaderboard Generation Benchmark for Scientific Models

arXiv preprint arXiv:2401.06233

Shruti Singh

Shoaib Alam

Mayank Singh

2024/1/11

Boldly Going Where No Benchmark Has Gone Before: Exposing Bias and Shortcomings in Code Generation Evaluation

arXiv preprint arXiv:2401.03855

Ankit Yadav

Mayank Singh

2024/1/8

Remember This Event That Year? Assessing Temporal Information and Reasoning in Large Language Models

arXiv preprint arXiv:2402.11997

Himanshu Beniwal

Mayank Singh

2024/2/19

Cross-lingual Editing in Multilingual Language Models

arXiv preprint arXiv:2401.10521

Himanshu Beniwal

Mayank Singh

2024/1/19

Unlocking Model Insights: A Dataset for Automated Model Card Generation

arXiv preprint arXiv:2309.12616

Shruti Singh

Hitesh Lodwal

Husain Malwat

Rakesh Thakur

Mayank Singh

2023/9/22

Tables to LaTeX: structure and content extraction from scientific tables

International Journal on Document Analysis and Recognition (IJDAR)

Pratik Kayal

Mrinal Anand

Harsh Desai

Mayank Singh

2023/6

MMT: A Multilingual and Multi-Topic Indian Social Media Dataset

arXiv preprint arXiv:2304.00634

Dwip Dalal

Vivek Srivastava

Mayank Singh

2023/4/2

Bloom: A 176b-parameter open-access multilingual language model

Teven Le Scao

Angela Fan

Christopher Akiki

Ellie Pavlick

Suzana Ilić

...

2023/11/20

MUTANT: A Multi-sentential Code-mixed Hinglish Dataset

arXiv preprint arXiv:2302.11766

Rahul Gupta

Vivek Srivastava

Mayank Singh

2023/2/23

Unveiling the Multi-Annotation Process: Examining the Influence of Annotation Quantity and Instance Difficulty on Model Performance

arXiv preprint arXiv:2310.14572

Pritam Kadasi

Mayank Singh

2023/10/23

LineEX: Data Extraction from Scientific Line Charts

VP Shivasankaran

Muhammad Yusuf Hassan

Mayank Singh

2023/1/2

Modeling interdisciplinary interactions among physics, mathematics and computer science

Journal of Physics: Complexity

Rima Hazra

Mayank Singh

Pawan Goyal

Bibhas Adhikari

Animesh Mukherjee

2023/10/13

Overview and results of MixMT shared-task at WMT 2022

Vivek Srivastava

Mayank Singh

2022/12

Indian classical music synthesis

Gaurav Viramgami

Hitarth Gandhi

Hrushti Naik

Nipun Mahajan

Praveen Venkatesh

...

2022/1/8

HinglishEval Generation Challenge on Quality Estimation of Synthetic Code-Mixed Text: Overview and Results

Vivek Srivastava

Mayank Singh

2022/7

Code-mixed nlg: Resources, metrics, and challenges

Vivek Srivastava

Mayank Singh

2022/1/8

The bull and the bear: summarizing stock market discussions

Ayush Kumar

Dhyey Jani

Jay Shah

Devanshu Thakar

Varun Jain

...

2022/6

Identifying early-warning indicators of onset of sudden collapse in networked infrastructure systems against sequential disruptions

Physica A: Statistical Mechanics and its Applications

Utkarsh Gangwal

Mayank Singh

Pradumn Kumar Pandey

Deepak Kamboj

Samrat Chatterjee

...

2022/4/1

The inefficiency of language models in scholarly retrieval: an experimental walk-through

arXiv preprint arXiv:2203.15364

Shruti Singh

Mayank Singh

2022/3/29

Program synthesis: does feedback help?

Harsh Patel

Praveen Venkatesh

Shivam Sahni

Varun Jain

Mrinal Anand

...

2022/1/8

See List of Professors in Mayank Singh University(Indian Institute of Technology Gandhinagar)

Co-Authors

H-index: 60
Soumen Chakrabarti

Soumen Chakrabarti

Indian Institute of Technology Bombay

H-index: 37
Tanmoy Chakraborty

Tanmoy Chakraborty

Indraprastha Institute of Information Technology

H-index: 34
Animesh Mukherjee

Animesh Mukherjee

Indian Institute of Technology Kharagpur

H-index: 30
Pawan Goyal

Pawan Goyal

Indian Institute of Technology Kharagpur

H-index: 13
Udit Bhatia

Udit Bhatia

Indian Institute of Technology Gandhinagar

H-index: 5
Jayesh Choudhari

Jayesh Choudhari

Indian Institute of Technology Gandhinagar

academic-engine