cs.LG 2207.09090

Actor-Critic based Improper Reinforcement Learning

Proposes Actor-Critic-based improper RL algorithms for combining multiple controllers to optimize unknown MDPs, with proven convergence rates.

Mohammadi Zaki, Avinash Mohan, Aditya Gopalan et al.

2022-07-19 36
cs.LG 2207.02505

Pure Transformers are Powerful Graph Learners

This paper introduces TokenGT, a pure Transformer for graphs using node and edge tokens, theoretically matching or surpassing 2-IGN in expressive power.

Jinwoo Kim, Tien Dat Nguyen, Seonwoo Min et al.

2022-07-06 29
cs.LG 2206.15474

Forecasting Future World Events with Neural Networks

Introduces Autocast dataset with news retrieval, using large models (T5, GPT-2) for future event forecasting; accuracy 65% vs. 92% human baseline.

Andy Zou, Tristan Xiao, Ryan Jia et al.

2022-07-01 36
cs.LG 2206.15144

Neural Networks can Learn Representations with Gradient Descent

This paper proves that neural networks trained via gradient descent can efficiently learn high-degree polynomials depending on few features, with sample complexity much lower than kernel methods.

Alex Damian, Jason D. Lee, Mahdi Soltanolkotabi

2022-06-30 55
cs.LG 2206.11251

Behavior Transformers: Cloning $k$ modes with one stone

Proposes Behavior Transformer (BeT), combining action discretization and multi-task residual correction, to model multi-modal behaviors with high accuracy.

Nur Muhammad Mahi Shafiullah, Zichen Jeff Cui, Ariuntuya Altanzaya et al.

2022-06-23 43
cs.LG 2206.10935

A Study on the Evaluation of Generative Models

This study uses a synthetic dataset to compare FID, IS, and classical f-divergences, revealing that divergence-based metrics are more stable for model evaluation.

Eyal Betzalel, Coby Penso, Aviv Navon et al.

2022-06-22 19
cs.LG 2206.09914

A Langevin-like Sampler for Discrete Distributions

Proposes Discrete Langevin Proposal (DLP), a gradient-based high-dimensional discrete sampler with zero asymptotic bias, outperforming Gibbs in efficiency.

Ruqi Zhang, Xingchao Liu, Qiang Liu

2022-06-21 34
cs.LG 2206.09348

Nested bandits

Proposes Nested Exponential Weights (NEW) algorithm leveraging hierarchical similarity structures, achieving regret bounds of O(√neff log n · T).

Matthieu Martin, Panayotis Mertikopoulos, Thibaud Rahier et al.

2022-06-19 32
cs.LG 2206.05668

Federated Learning on Riemannian Manifolds

Proposed RFedSVRG algorithm achieves O(1/ε²) convergence for federated optimization on Riemannian manifolds, handling non-convex constraints effectively.

Jiaxiang Li, Shiqian Ma

2022-06-12 38
cs.LG 2206.05262

Meta Optimal Transport

Meta OT leverages meta-learning to predict optimal transport maps, significantly accelerating multiple similar OT problem solutions with minimal computation.

Brandon Amos, Samuel Cohen, Giulia Luise et al.

2022-06-11 38 citations 38