cs.CL 2401.03462

Long Context Compression with Activation Beacon

Activation Beacon introduces progressive activation compression, enabling efficient long-text processing with up to 8x compression, doubling inference speed.

Peitian Zhang, Zheng Liu, Shitao Xiao et al.

2024-01-07 58
cs.AI 2402.09413

Mathematical Explanations

Extends causal models with impossible worlds to formalize mathematical explanations, addressing the issue that all mathematical facts are true in all models.

Joseph Y. Halpern

2024-01-01 41
cs.NE 2401.00473

Emulating insect brains for neuromorphic navigation

Emulates insect path integration on BrainScaleS-2 with spike-based short-term memory, achieving high-precision autonomous navigation.

Korbinian Schreiber, Timo Wunderlich, Philipp Spilger et al.

2023-12-31 53
cs.LG 2312.15103

Energy-based learning algorithms for analog computing: a comparative study

This study compares seven energy-based learning algorithms on deep convolutional Hopfield networks, revealing negative perturbations outperform positive ones, with Centered EP achieving state-of-the-art results.

Benjamin Scellier, Maxence Ernoult, Jack Kendall et al.

2023-12-23 54 citations 42