Direct training high-performance deep spiking neural networks: a review of theories and methods

C Zhou, H Zhang, L Yu, Y Ye, Z Zhou… - Frontiers in …, 2024 - frontiersin.org
Spiking neural networks (SNNs) offer a promising energy-efficient alternative to artificial
neural networks (ANNs), in virtue of their high biological plausibility, rich spatial-temporal …

Spikemba: Multi-modal spiking saliency mamba for temporal video grounding

W Li, X Hong, R Xiong, X Fan - arXiv preprint arXiv:2404.01174, 2024 - arxiv.org
Temporal video grounding (TVG) is a critical task in video content understanding, requiring
precise alignment between video content and natural language instructions. Despite …

A Simple and Effective Point-based Network for Event Camera 6-DOFs Pose Relocalization

H Ren, J Zhu, Y Zhou, H Fu… - Proceedings of the …, 2024 - openaccess.thecvf.com
Event cameras exhibit remarkable attributes such as high dynamic range asynchronicity and
low latency making them highly suitable for vision tasks that involve high-speed motion in …

FAPNet: An Effective Frequency Adaptive Point-based Eye Tracker

X Lin, H Ren, B Cheng - … of the IEEE/CVF Conference on …, 2024 - openaccess.thecvf.com
Eye tracking is crucial for human-computer interaction in different domains. Conventional
cameras encounter challenges such as power consumption and image quality during …

Rethinking Efficient and Effective Point-based Networks for Event Camera Classification and Regression: EventMamba

H Ren, Y Zhou, J Zhu, H Fu, Y Huang, X Lin… - arXiv preprint arXiv …, 2024 - arxiv.org
Event cameras, drawing inspiration from biological systems, efficiently detect changes in
ambient light with low latency and high dynamic range while consuming minimal power. The …

TIM: An Efficient Temporal Interaction Module for Spiking Transformer

S Shen, D Zhao, G Shen, Y Zeng - arXiv preprint arXiv:2401.11687, 2024 - arxiv.org
Spiking Neural Networks (SNNs), as the third generation of neural networks, have gained
prominence for their biological plausibility and computational efficiency, especially in …

Overcoming the Limitations of Layer Synchronization in Spiking Neural Networks

R Koopman, A Yousefzadeh, M Shahsavari… - arXiv preprint arXiv …, 2024 - arxiv.org
Currently, neural-network processing in machine learning applications relies on layer
synchronization, whereby neurons in a layer aggregate incoming currents from all neurons …

Learning Normal Flow Directly From Event Neighborhoods

D Yuan, L Burner, J Wu, M Liu, J Chen… - arXiv preprint arXiv …, 2024 - arxiv.org
Event-based motion field estimation is an important task. However, current optical flow
methods face challenges: learning-based approaches, often frame-based and relying on …

CHASE: Learning Convex Hull Adaptive Shift for Skeleton-based Multi-Entity Action Recognition

Y Wen, M Liu, S Wu, B Ding - arXiv preprint arXiv:2410.07153, 2024 - arxiv.org
Skeleton-based multi-entity action recognition is a challenging task aiming to identify
interactive actions or group activities involving multiple diverse entities. Existing models for …

Frequency-aware Event Cloud Network

H Ren, F Ma, X Lin, Y Fang, H Huang, Y Huang… - arXiv preprint arXiv …, 2024 - arxiv.org
Event cameras are biologically inspired sensors that emit events asynchronously with
remarkable temporal resolution, garnering significant attention from both industry and …