[HTML][HTML] Machine learning techniques for IoT security: Current research and future vision with generative AI and large language models

F Alwahedi, A Aldhaheri, MA Ferrag, A Battah… - Internet of Things and …, 2024 - Elsevier
Despite providing unparalleled connectivity and convenience, the exponential growth of the
Internet of Things (IoT) ecosystem has triggered significant cybersecurity concerns. These …

The life cycle of large language models in education: A framework for understanding sources of bias

J Lee, Y Hicke, R Yu, C Brooks… - British Journal of …, 2024 - Wiley Online Library
Large language models (LLMs) are increasingly adopted in educational contexts to provide
personalized support to students and teachers. The unprecedented capacity of LLM‐based …

The llama 3 herd of models

A Dubey, A Jauhri, A Pandey, A Kadian… - arXiv preprint arXiv …, 2024 - arxiv.org
Modern artificial intelligence (AI) systems are powered by foundation models. This paper
presents a new set of foundation models, called Llama 3. It is a herd of language models …

Llamafactory: Unified efficient fine-tuning of 100+ language models

Y Zheng, R Zhang, J Zhang, Y Ye, Z Luo… - arXiv preprint arXiv …, 2024 - arxiv.org
Efficient fine-tuning is vital for adapting large language models (LLMs) to downstream tasks.
However, it requires non-trivial efforts to implement these methods on different models. We …

The power of noise: Redefining retrieval for rag systems

F Cuconasu, G Trappolini, F Siciliano, S Filice… - Proceedings of the 47th …, 2024 - dl.acm.org
Retrieval-Augmented Generation (RAG) has recently emerged as a method to extend
beyond the pre-trained knowledge of Large Language Models by augmenting the original …

Large language models surpass human experts in predicting neuroscience results

X Luo, A Rechardt, G Sun, KK Nejad, F Yáñez… - Nature human …, 2024 - nature.com
Scientific discoveries often hinge on synthesizing decades of research, a task that potentially
outstrips human information processing capacities. Large language models (LLMs) offer a …

Why deep generative modeling?

JM Tomczak - Deep Generative Modeling, 2024 - Springer
Before we start thinking about (deep) generative modeling, let us consider a simple
example. Imagine we have trained a deep neural network that classifies images (x∈ ℤ D) of …

Moshi: a speech-text foundation model for real-time dialogue

A Défossez, L Mazaré, M Orsini, A Royer… - arXiv preprint arXiv …, 2024 - arxiv.org
We introduce Moshi, a speech-text foundation model and full-duplex spoken dialogue
framework. Current systems for spoken dialogue rely on pipelines of independent …

Olmo: Accelerating the science of language models

D Groeneveld, I Beltagy, P Walsh, A Bhagia… - arXiv preprint arXiv …, 2024 - arxiv.org
Language models (LMs) have become ubiquitous in both NLP research and in commercial
product offerings. As their commercial importance has surged, the most powerful models …

Contextual feature extraction hierarchies converge in large language models and the brain

G Mischler, YA Li, S Bickel, AD Mehta… - Nature Machine …, 2024 - nature.com
Recent advancements in artificial intelligence have sparked interest in the parallels between
large language models (LLMs) and human neural processing, particularly in language …