[HTML][HTML] Artificial intelligence based multimodal language decoding from brain activity: A review

Y Zhao, Y Chen, K Cheng, W Huang - Brain Research Bulletin, 2023 - Elsevier
Decoding brain activity is conducive to the breakthrough of brain-computer interface (BCI)
technology. The development of artificial intelligence (AI) continually promotes the progress …

Brain-conditional multimodal synthesis: A survey and taxonomy

W Mai, J Zhang, P Fang, Z Zhang - IEEE Transactions on …, 2024 - ieeexplore.ieee.org
In the era of Artificial Intelligence Generated Content (AIGC), conditional multimodal
synthesis technologies (eg, text-to-image) are dynamically reshaping the natural content …

Unibrain: Unify image reconstruction and captioning all in one diffusion model from human brain activity

W Mai, Z Zhang - arXiv preprint arXiv:2308.07428, 2023 - arxiv.org
Image reconstruction and captioning from brain activity evoked by visual stimuli allow
researchers to further understand the connection between the human brain and the visual …

[HTML][HTML] Mental image reconstruction from human brain activity: Neural decoding of mental imagery via deep neural network-based Bayesian estimation

N Koide-Majima, S Nishimoto, K Majima - Neural Networks, 2024 - Elsevier
Visual images observed by humans can be reconstructed from their brain activity. However,
the visualization (externalization) of mental imagery is challenging. Only a few studies have …

Reconstructing controllable faces from brain activity with hierarchical multiview representations

Z Ren, J Li, X Xue, X Li, F Yang, Z Jiao, X Gao - Neural Networks, 2023 - Elsevier
Reconstructing visual experience from brain responses measured by functional magnetic
resonance imaging (fMRI) is a challenging yet important research topic in brain decoding …

A CNN-transformer hybrid approach for decoding visual neural activity into text

J Zhang, C Li, G Liu, M Min, C Wang, J Li… - Computer Methods and …, 2022 - Elsevier
Abstract Background and Objective Most studies used neural activities evoked by linguistic
stimuli such as phrases or sentences to decode the language structure. However, compared …

Boosting-GNN: boosting algorithm for graph networks on imbalanced node classification

S Shi, K Qiao, S Yang, L Wang, J Chen… - Frontiers in …, 2021 - frontiersin.org
The graph neural network (GNN) has been widely used for graph data representation.
However, the existing researches only consider the ideal balanced dataset, and the …

Recent advances in nanotechnology and its application for neuro-disease: a review

K Radhakrishnan, P Senthil Kumar, G Rangasamy… - Applied …, 2023 - Springer
Nanotechnology is an emerging field that is useful for various purposes. Numerous
neurological disorders, such as Parkinson's disease (PD), Alzheimer's disease (AD), stroke …

Modality-Agnostic fMRI Decoding of Vision and Language

M Nikolaus, M Mozafari, N Asher, L Reddy… - arXiv preprint arXiv …, 2024 - arxiv.org
Previous studies have shown that it is possible to map brain activation data of subjects
viewing images onto the feature representation space of not only vision models (modality …

Mind captioning: Evolving descriptive text of mental content from human brain activity

T Horikawa - bioRxiv, 2024 - biorxiv.org
A central challenge in neuroscience is decoding brain activity to uncover the mental content
comprising multiple components and their interactions. Despite progress in decoding …