How you prompt matters! even task-oriented constraints in instructions affect llm-generated text detection

R Koike, M Kaneko, N Okazaki - arXiv preprint arXiv:2311.08369, 2023 - arxiv.org
Against the misuse (eg, plagiarism or spreading misinformation) of Large Language Models
(LLMs), many recent works have presented LLM-generated-text detectors with promising …

Outfox: Llm-generated essay detection through in-context learning with adversarially generated examples

R Koike, M Kaneko, N Okazaki - … of the AAAI Conference on Artificial …, 2024 - ojs.aaai.org
Large Language Models (LLMs) have achieved human-level fluency in text generation,
making it difficult to distinguish between human-written and LLM-generated texts. This poses …

Detecting llm-generated text in computing education: A comparative study for chatgpt cases

MS Orenstrakh, O Karnalim, CA Suarez… - arXiv preprint arXiv …, 2023 - arxiv.org
Due to the recent improvements and wide availability of Large Language Models (LLMs),
they have posed a serious threat to academic integrity in education. Modern LLM-generated …

BUST: Benchmark for the evaluation of detectors of LLM-Generated Text

J Cornelius, O Lithgow-Serrano, S Mitrović… - Proceedings of the …, 2024 - aclanthology.org
We introduce BUST, a comprehensive benchmark designed to evaluate detectors of texts
generated by instruction-tuned large language models (LLMs). Unlike previous benchmarks …

Enhancing Robustness of LLM-Synthetic Text Detectors for Academic Writing: A Comprehensive Analysis

Z Dou, Y Guo, CC Chang, HH Nguyen… - … Conference on Advanced …, 2024 - Springer
The emergence of large language models (LLMs), such as Generative Pre-trained
Transformer 4 (GPT-4) used by ChatGPT, has profoundly impacted the academic and …

DetectGPT-SC: Improving Detection of Text Generated by Large Language Models through Self-Consistency with Masked Predictions

R Wang, Q Li, S Xie - arXiv preprint arXiv:2310.14479, 2023 - arxiv.org
General large language models (LLMs) such as ChatGPT have shown remarkable success,
but it has also raised concerns among people about the misuse of AI-generated texts …

Stumbling blocks: Stress testing the robustness of machine-generated text detectors under attacks

Y Wang, S Feng, AB Hou, X Pu, C Shen, X Liu… - arXiv preprint arXiv …, 2024 - arxiv.org
The widespread use of large language models (LLMs) is increasing the demand for
methods that detect machine-generated text to prevent misuse. The goal of our study is to …

LLM-Detector: Improving AI-Generated Chinese Text Detection with Open-Source LLM Instruction Tuning

R Wang, H Chen, R Zhou, H Ma, Y Duan… - arXiv preprint arXiv …, 2024 - arxiv.org
ChatGPT and other general large language models (LLMs) have achieved remarkable
success, but they have also raised concerns about the misuse of AI-generated texts. Existing …

LLM paternity test: Generated text detection with LLM genetic inheritance

X Yu, Y Qi, K Chen, G Chen, X Yang, P Zhu… - arXiv preprint arXiv …, 2023 - arxiv.org
Large language models (LLMs) can generate texts that carry the risk of various misuses,
including plagiarism, planting fake reviews on e-commerce platforms, or creating …

Investigating the Influence of Prompt-Specific Shortcuts in AI Generated Text Detection

C Park, HJ Kim, J Kim, Y Kim, T Kim, H Cho… - arXiv preprint arXiv …, 2024 - arxiv.org
AI Generated Text (AIGT) detectors are developed with texts from humans and LLMs of
common tasks. Despite the diversity of plausible prompt choices, these datasets are …