A systematic mapping study of source code representation for deep learning in software engineering

HP Samoaa, F Bayram, P Salza, P Leitner - IET Software, 2022 - Wiley Online Library
The usage of deep learning (DL) approaches for software engineering has attracted much
attention, particularly in source code modelling and analysis. However, in order to use DL …

Deep learning meets software engineering: A survey on pre-trained models of source code

C Niu, C Li, B Luo, V Ng - arXiv preprint arXiv:2205.11739, 2022 - arxiv.org
Recent years have seen the successful application of deep learning to software engineering
(SE). In particular, the development and use of pre-trained models of source code has …

Deep transfer learning for source code modeling

Y Hussain, Z Huang, Y Zhou, S Wang - International Journal of …, 2020 - World Scientific
In recent years, deep learning models have shown great potential in source code modeling
and analysis. Generally, deep learning-based approaches are problem-specific and data …

Adding context to source code representations for deep learning

F Tian, C Treude - 2022 IEEE International Conference on …, 2022 - ieeexplore.ieee.org
Deep learning models have been successfully applied to a variety of software engineering
tasks, such as code classification, summarisation, and bug and vulnerability detection. In …

Are deep neural networks the best choice for modeling source code?

VJ Hellendoorn, P Devanbu - Proceedings of the 2017 11th Joint …, 2017 - dl.acm.org
Current statistical language modeling techniques, including deep-learning based models,
have proven to be quite effective for source code. We argue here that the special properties …

Deep learning for source code modeling and generation: Models, applications, and challenges

THM Le, H Chen, MA Babar - ACM Computing Surveys (CSUR), 2020 - dl.acm.org
Deep Learning (DL) techniques for Natural Language Processing have been evolving
remarkably fast. Recently, the DL advances in language modeling, machine translation, and …

Mulcode: A multi-task learning approach for source code understanding

D Wang, Y Yu, S Li, W Dong, J Wang… - 2021 IEEE International …, 2021 - ieeexplore.ieee.org
Recent years have witnessed the significant rise of Deep Learning (DL) techniques applied
to source code. Researchers exploit DL for a multitude of tasks and achieve impressive …

Structcoder: Structure-aware transformer for code generation

S Tipirneni, M Zhu, CK Reddy - ACM Transactions on Knowledge …, 2024 - dl.acm.org
There has been a recent surge of interest in automating software engineering tasks using
deep learning. This article addresses the problem of code generation, in which the goal is to …

CodeGRU: Context-aware deep learning with gated recurrent unit for source code modeling

Y Hussain, Z Huang, Y Zhou, S Wang - Information and Software …, 2020 - Elsevier
Context: Recently deep learning based Natural Language Processing (NLP) models have
shown great potential in the modeling of source code. However, a major limitation of these …

Inspect: Intrinsic and systematic probing evaluation for code transformers

A Karmakar, R Robbes - IEEE Transactions on Software …, 2023 - ieeexplore.ieee.org
Pre-trained models of source code have recently been successfully applied to a wide variety
of Software Engineering tasks; they have also seen some practical adoption in practice, eg …