Modern language models (LMs) have been successfully employed in source code
generation and understanding, leading to a significant increase in research focused on …

Python is a popular dynamic programming language, evidenced by its ranking as the
second most commonly used language on GitHub. However, its dynamic type system can …

Automated code vulnerability detection has gained increasing attention in recent years. The
deep learning (DL)-based methods, which implicitly learn vulnerable code patterns, have …

Large Language Models (LLMs) are increasingly becoming fundamental in supporting
software developers in coding tasks. The massive datasets used for training LLMs are often …

Stack Overflow, the world's largest software Q&A (SQA) website, is facing a significant traffic
drop due to the emergence of generative AI techniques. ChatGPT is banned by Stack …

Causal reasoning is viewed as crucial for achieving human-level machine intelligence.
Recent advances in language models have expanded the horizons of artificial intelligence …

Transformer based code models have impressive performance in many software
engineering tasks. However, their effectiveness degrades when symbols are missing or not …

The masked language modeling (MLM) task is widely recognized as one of the most
effective pre-training tasks and currently derives many variants in the software engineering …

Abstract Context: Software Quality Assurance (SQA) is a fundamental part of software
engineering to ensure stakeholders that software products work as expected after release in …

Deep code models (DCMs) have achieved impressive accomplishments and have been
widely applied to various code-related tasks. However, existing studies show that some …