cs.LG 2209.15571

Building Normalizing Flows with Stochastic Interpolants

Proposes InterFlow, a stochastic interpolant-based continuous-time normalizing flow, optimizing path length and surpassing traditional methods in high-resolution image generation.

Michael S. Albergo, Eric Vanden-Eijnden

2022-10-01 1061 citations 36
cs.CL 2209.15189

Learning by Distilling Context

Proposes 'Context Distillation' to internalize reasoning, instructions, and examples, boosting model performance by 9-30% on key benchmarks.

Charlie Snell, Dan Klein, Ruiqi Zhong

2022-09-30 110 citations 28
cs.CL 2209.15162

Linearly Mapping from Image to Text Space

LiMBeR method linearly maps image features to text prompts, enhancing visual question answering performance.

Jack Merullo, Louis Castricato, Carsten Eickhoff et al.

2022-09-30 9
cs.AI 2209.15111

Quantifying Harm

Proposes a causal-model-based framework for quantifying harm, integrating decision-theoretic probability weighting, applicable at individual and societal levels.

Sander Beckers, Hana Chockler, Joseph Y. Halpern

2022-09-30 42
stat.ML 2209.14863

Neural Networks Efficiently Learn Low-Dimensional Representations with SGD

This paper proves that two-layer neural networks trained with SGD converge their first-layer weights to the k-dimensional principal subspace spanned by the target model's index vectors, enabling low-dimensional feature learning.

Alireza Mousavi-Hosseini, Sejun Park, Manuela Girotti et al.

2022-09-29 46
cs.CV 2209.14860

Bridging the Gap to Real-World Object-Centric Learning

DINOSAUR leverages self-supervised feature reconstruction with Slot Attention, outperforming existing models, scalable to COCO and PASCAL VOC datasets.

Maximilian Seitzer, Max Horn, Andrii Zadaianchuk et al.

2022-09-29 45
cs.LG 2209.14734

DiGress: Discrete Denoising diffusion for graph generation

DiGress employs discrete diffusion for graph generation, achieving up to 99% validity on molecular datasets and scaling to 1.3 million molecules.

Clement Vignac, Igor Krawczuk, Antoine Siraudin et al.

2022-09-29 716 citations 32
cs.LG 2209.11895

In-context Learning and Induction Heads

Proposes induction heads as the primary mechanism for in-context learning in large transformers, supported by six lines of evidence including training phase shifts and causal ablations.

Catherine Olsson, Nelson Elhage, Neel Nanda et al.

2022-09-24 48