A survey on evaluation of large language models

Y Chang, X Wang, J Wang, Y Wu, L Yang… - ACM Transactions on …, 2024 - dl.acm.org
Large language models (LLMs) are gaining increasing popularity in both academia and
industry, owing to their unprecedented performance in various applications. As LLMs …

On the prospects of incorporating large language models (llms) in automated planning and scheduling (aps)

V Pallagani, BC Muppasani, K Roy, F Fabiano… - Proceedings of the …, 2024 - ojs.aaai.org
Abstract Automated Planning and Scheduling is among the growing areas in Artificial
Intelligence (AI) where mention of LLMs has gained popularity. Based on a comprehensive …

Llm+ p: Empowering large language models with optimal planning proficiency

B Liu, Y Jiang, X Zhang, Q Liu, S Zhang… - arXiv preprint arXiv …, 2023 - arxiv.org
Large language models (LLMs) have demonstrated remarkable zero-shot generalization
abilities: state-of-the-art chatbots can provide plausible answers to many common questions …

The Hitchhiker's Guide to Program Analysis: A Journey with Large Language Models

H Li, Y Hao, Y Zhai, Z Qian - arXiv preprint arXiv:2308.00245, 2023 - arxiv.org
Static analysis is a widely used technique in software engineering for identifying and
mitigating bugs. However, a significant hurdle lies in achieving a delicate balance between …

Plansformer: Generating symbolic plans using transformers

V Pallagani, B Muppasani, K Murugesan… - arXiv preprint arXiv …, 2022 - arxiv.org
Large Language Models (LLMs) have been the subject of active research, significantly
advancing the field of Natural Language Processing (NLP). From BERT to BLOOM, LLMs …

A fast optimization view: Reformulating single layer attention in llm based on tensor and svm trick, and solving it in matrix multiplication time

Y Gao, Z Song, W Wang, J Yin - arXiv preprint arXiv:2309.07418, 2023 - arxiv.org
Large language models (LLMs) have played a pivotal role in revolutionizing various facets
of our daily existence. Solving attention regression is a fundamental task in optimizing LLMs …

Enhancing Static Analysis for Practical Bug Detection: An LLM-Integrated Approach

H Li, Y Hao, Y Zhai, Z Qian - Proceedings of the ACM on Programming …, 2024 - dl.acm.org
While static analysis is instrumental in uncovering software bugs, its precision in analyzing
large and intricate codebases remains challenging. The emerging prowess of Large …

Through the lens of core competency: Survey on evaluation of large language models

Z Zhuang, Q Chen, L Ma, M Li, Y Han, Y Qian… - arXiv preprint arXiv …, 2023 - arxiv.org
From pre-trained language model (PLM) to large language model (LLM), the field of natural
language processing (NLP) has witnessed steep performance gains and wide practical …

Survey on AI-Generated Plagiarism Detection: The Impact of Large Language Models on Academic Integrity

S Pudasaini, L Miralles-Pechuán, D Lillis… - Journal of Academic …, 2024 - Springer
A survey conducted in 2023 surveyed 3,017 high school and college students. It found that
almost one-third of them confessed to using ChatGPT for assistance with their homework …

Neurosymbolic ai for enhancing instructability in generative ai

A Sheth, V Pallagani, K Roy - IEEE Intelligent Systems, 2024 - ieeexplore.ieee.org
Generative AI, especially via large language models (LLMs), has transformed content
creation across text, images, and music, showcasing capabilities in following instructions …