Automating code-related tasks through transformers: The impact of pre-training

R Tufano, L Pascarella, G Bavota - 2023 IEEE/ACM 45th …, 2023 - ieeexplore.ieee.org
Transformers have gained popularity in the software engineering (SE) literature. These deep
learning models are usually pre-trained through a self-supervised objective, meant to …

[HTML][HTML] Ai-assisted programming tasks using code embeddings and transformers

S Kotsiantis, V Verykios, M Tzagarakis - Electronics, 2024 - mdpi.com
This review article provides an in-depth analysis of the growing field of AI-assisted
programming tasks, specifically focusing on the use of code embeddings and transformers …

Software defect prediction with semantic and structural information of codes based on graph neural networks

C Zhou, P He, C Zeng, J Ma - Information and Software Technology, 2022 - Elsevier
Context: Most defect prediction methods consider a series of traditional manually designed
static code metrics. However, only using these hand-crafted features is impractical. Some …

Improving domain-specific neural code generation with few-shot meta-learning

Z Yang, JW Keung, Z Sun, Y Zhao, G Li, Z Jin… - Information and …, 2024 - Elsevier
Context: Neural code generation aims to automatically generate code snippets guided by
Natural Language Descriptions (NLDs). In recent years, various neural code generation …

AttSum: A Deep Attention-Based Summarization Model for Bug Report Title Generation

X Ma, JW Keung, X Yu, H Zou… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
Concise and precise bug report titles help software developers to capture the highlights of
the bug report quickly. Unfortunately, it is common that bug reporters do not create high …

Automated question title reformulation by mining modification logs from stack overflow

K Liu, X Chen, C Chen, X Xie… - IEEE Transactions on …, 2023 - ieeexplore.ieee.org
In Stack Overflow, developers may not clarify and summarize the critical problems in the
question titles due to a lack of domain knowledge or poor writing skills. Previous studies …

Exploring and unleashing the power of large language models in automated code translation

Z Yang, F Liu, Z Yu, JW Keung, J Li, S Liu… - arXiv preprint arXiv …, 2024 - arxiv.org
Code translation tools are developed for automatic source-to-source translation. Although
learning-based transpilers have shown impressive enhancement against rule-based …

Method-level bug severity prediction using source code metrics and LLMs

E Mashhadi, H Ahmadvand… - 2023 IEEE 34th …, 2023 - ieeexplore.ieee.org
In the past couple of decades, significant research efforts are devoted to the prediction of
software bugs. However, most existing work in this domain treats all bugs the same, which is …

Revisiting Code Smell Severity Prioritization using learning to rank techniques

L Liu, G Lin, L Zhu, Z Yang, P Song, X Wang… - Expert Systems with …, 2024 - Elsevier
Abstract Code Smell Severity Prioritization (CSSP) is crucial in helping software developers
minimize software maintenance costs and enhance software quality, particularly when faced …

Diverse title generation for Stack Overflow posts with multiple-sampling-enhanced transformer

F Zhang, J Liu, Y Wan, X Yu, X Liu, J Keung - Journal of Systems and …, 2023 - Elsevier
Stack Overflow is one of the most popular programming communities where developers can
seek help for their encountered problems. Nevertheless, if inexperienced developers fail to …