The remarkable achievements of Artificial Intelligence (AI) algorithms, particularly in Machine Learning (ML) and Deep Learning (DL), have fueled their extensive deployment …
Large language models for code (LLM4Code), which demonstrate strong performance (eg, high accuracy) in processing source code, have significantly transformed software …
DN Palacio, A Velasco, N Cooper… - IEEE Transactions …, 2024 - ieeexplore.ieee.org
Neural Language Models of Code, or Neural Code Models (NCMs), are rapidly progressing from research prototypes to commercial developer tools. As such, understanding the …
S Chen, B Peng, M Chen, R Wang, M Xu… - arXiv preprint arXiv …, 2024 - arxiv.org
Causal reasoning is viewed as crucial for achieving human-level machine intelligence. Recent advances in language models have expanded the horizons of artificial intelligence …
DN Palacio, D Rodriguez-Cardenas, A Velasco… - arXiv preprint arXiv …, 2024 - arxiv.org
Trustworthiness and interpretability are inextricably linked concepts for LLMs. The more interpretable an LLM is, the more trustworthy it becomes. However, current techniques for …
A Velasco, DN Palacio… - Proceedings of the …, 2024 - dl.acm.org
This paper discusses the limitations of evaluating Masked Language Models (MLMs) in code completion tasks. We highlight that relying on accuracy-based measurements may …
SS Rajan, E Soremekun, S Chattopadhyay - arXiv preprint arXiv …, 2024 - arxiv.org
In this work, we systematically expose and measure the inconsistency and knowledge gaps of Large Language Models (LLMs). Specifically, we propose an automated testing …
D Rodriguez-Cardenas - Proceedings of the 2024 IEEE/ACM 46th …, 2024 - dl.acm.org
In recent years, Large Language Models for code (LLMc) have transformed the landscape of software engineering (SE), demonstrating significant efficacy in tasks such as code …
In recent years, tasks for automated software engineering have been achieved using Large Language Models trained on source code, such as Seq2Seq, LSTM, GPT, T5, BART and …