M -- A Diverse Benchmark to Assess the Performance of Large Multimodal Models Across Multilingual and Multicultural Vision-Language Tasks F Schneider, S Sitaram arXiv preprint arXiv:2407.03791, 2024 | | 2024 |
Improving Self Consistency in LLMs through Probabilistic Tokenization A Sathe, D Aggarwal, S Sitaram arXiv preprint arXiv:2407.03678, 2024 | | 2024 |
Teaching LLMs to Abstain across Languages via Multilingual Feedback S Feng, W Shi, Y Wang, W Ding, O Ahia, SS Li, V Balachandran, ... arXiv preprint arXiv:2406.15948, 2024 | | 2024 |
PARIKSHA: A Large-Scale Investigation of Human-LLM Evaluator Agreement on Multilingual and Multi-Cultural Data I Watts, V Gumma, A Yadavalli, V Seshadri, M Swaminathan, S Sitaram arXiv preprint arXiv:2406.15053, 2024 | 1 | 2024 |
Cultural Conditioning or Placebo? On the Effectiveness of Socio-Demographic Prompting S Mukherjee, MF Adilazuarda, S Sitaram, K Bali, AF Aji, M Choudhury arXiv preprint arXiv:2406.11661, 2024 | | 2024 |
MS-HuBERT: Mitigating Pre-training and Inference Mismatch in Masked Language Modelling methods for learning Speech Representations H Yadav, S Sitaram, RR Shah arXiv preprint arXiv:2406.05661, 2024 | | 2024 |
Beyond Metrics: Evaluating LLMs' Effectiveness in Culturally Nuanced, Low-Resource Real-World Scenarios M Ochieng, V Gumma, S Sitaram, J Wang, K Ronen, K Bali, J O'Neill arXiv preprint arXiv:2406.00343, 2024 | | 2024 |
Bridging the Gap: Dynamic Learning Strategies for Improving Multilingual Performance in LLMs S Kumar, V Balloli, M Ranjit, K Ahuja, T Ganu, S Sitaram, K Bali, A Nambi arXiv preprint arXiv:2405.18359, 2024 | | 2024 |
METAL: Towards Multilingual Meta-Evaluation R Hada, V Gumma, M Ahmed, K Bali, S Sitaram arXiv preprint arXiv:2404.01667, 2024 | | 2024 |
TRUCE: Private Benchmarking to Prevent Contamination and Improve Comparative Evaluation of LLMs T Rajore, N Chandran, S Sitaram, D Gupta, R Sharma, K Mittal, ... arXiv e-prints, arXiv: 2403.00393, 2024 | | 2024 |
Private Benchmarking to Prevent Contamination and Improve Comparative Evaluation of LLMs N Chandran, S Sitaram, D Gupta, R Sharma, K Mittal, M Swaminathan arXiv preprint arXiv:2403.00393, 2024 | 5 | 2024 |
DOSA: A Dataset of Social Artifacts from Different Indian Geographical Subcultures A Seth, S Ahuja, K Bali, S Sitaram arXiv preprint arXiv:2403.14651, 2024 | 1 | 2024 |
A unified framework and dataset for assessing gender bias in vision-language models A Sathe, P Jain, S Sitaram arXiv preprint arXiv:2402.13636, 2024 | 2 | 2024 |
MAFIA: Multi-Adapter Fused Inclusive LanguAge Models P Jain, A Sathe, V Gumma, K Ahuja, S Sitaram arXiv preprint arXiv:2402.07519, 2024 | | 2024 |
Culturellm: Incorporating cultural differences into large language models C Li, M Chen, J Wang, S Sitaram, X Xie arXiv preprint arXiv:2402.10946, 2024 | 14 | 2024 |
Maple: Multilingual evaluation of parameter efficient finetuning of large language models D Aggarwal, A Sathe, S Sitaram arXiv preprint arXiv:2401.07598, 2024 | 2 | 2024 |
Partial Rank Similarity Minimization Method for Quality MOS Prediction of Unseen Speech Synthesis Systems in Zero-Shot and Semi-Supervised Setting H Yadav, E Cooper, J Yamagishi, S Sitaram, RR Shah 2023 IEEE Automatic Speech Recognition and Understanding Workshop (ASRU), 1-7, 2023 | 1 | 2023 |
Proceedings of the 6th Workshop on Computational Approaches to Linguistic Code-Switching G Winata, S Kar, M Zhukova, T Solorio, M Diab, S Sitaram, M Choudhury, ... Proceedings of the 6th Workshop on Computational Approaches to Linguistic …, 2023 | | 2023 |
Megaverse: Benchmarking large language models across languages, modalities, models and tasks S Ahuja, D Aggarwal, V Gumma, I Watts, A Sathe, M Ochieng, R Hada, ... arXiv preprint arXiv:2311.07463, 2023 | 16 | 2023 |
Representativeness as a forgotten lesson for multilingual and code-switched data collection and preparation AS Doğruöz, S Sitaram, ZX Yong arXiv preprint arXiv:2310.20470, 2023 | 5 | 2023 |