stat.ML 2301.13856

Simplex Random Features

Proposes Simplex Random Features (SimRFs) for optimal kernel approximation via geometric correlation, outperforming orthogonal RFs with minimal extra cost.

Isaac Reid, Krzysztof Choromanski, Valerii Likhosherstov et al.

2023-02-01 40
stat.ML 2211.08775

Unbalanced Optimal Transport, from Theory to Numerics

Unbalanced OT combined with entropic regularization and Gromov-Wasserstein enhances high-dimensional data matching robustness and efficiency.

Thibault Séjourné, Gabriel Peyré, François-Xavier Vialard

2022-11-16 94 citations 60
stat.ML 2210.12774

Manifold Alignment with Label Information

MALI leverages label-guided diffusion maps and optimal transport for manifold alignment, outperforming state-of-the-art methods.

Andres F. Duque, Myriam Lizotte, Guy Wolf et al.

2022-10-24 42
stat.ML 2209.14863

Neural Networks Efficiently Learn Low-Dimensional Representations with SGD

This paper proves that two-layer neural networks trained with SGD converge their first-layer weights to the k-dimensional principal subspace spanned by the target model's index vectors, enabling low-dimensional feature learning.

Alireza Mousavi-Hosseini, Sejun Park, Manuela Girotti et al.

2022-09-29 45
stat.ML 2205.14987

A Continuous Time Framework for Discrete Denoising Models

Proposes a continuous-time diffusion framework for discrete data using CTMCs, with Tau-leaping for efficient sampling, outperforming discrete methods.

Andrew Campbell, Joe Benton, Valentin De Bortoli et al.

2022-05-30 471 citations 34
stat.ML 2111.10510

Bayesian Learning via Neural Schrödinger-Föllmer Flows

Neural Schrödinger-Föllmer flows enable finite-time, low-variance Bayesian inference in high dimensions via stochastic control and neural network parametrization.

Francisco Vargas, Andrius Ovsianas, David Fernandes et al.

2021-11-20 72 citations 36