cs.RO 2209.07753

Code as Policies: Language Model Programs for Embodied Control

This work transforms large language models (LLMs) into robot policy generators via hierarchical code synthesis, achieving 39.8% on HumanEval and enabling spatial reasoning and task generalization.

Jacky Liang, Wenlong Huang, Fei Xia et al.

2022-09-16 1818 citations 39
cs.LG 2209.06788

Small Transformers Compute Universal Metric Embeddings

Using small neural networks (probabilistic transformers) to embed arbitrary metric spaces into Gaussian mixture spaces with low distortion, ensuring bi-Hölder and bi-Lipschitz guarantees.

Anastasis Kratsios, Valentin Debarnot, Ivan Dokmanić

2022-09-15 52
cs.LG 2209.06203

Normalizing Flows for Interventional Density Estimation

Proposes Interventional Normalizing Flows (INF) for density estimation of potential outcomes, combining bias correction and scalable deep models.

Valentyn Melnychuk, Dennis Frauen, Stefan Feuerriegel

2022-09-14 61
cs.CL 2209.02535

Analyzing Transformers in Embedding Space

Proposes embedding-space parameter interpretation for Transformer models, enabling zero-shot model alignment and transfer, validated on GPT-2 with significant results.

Guy Dar, Mor Geva, Ankit Gupta et al.

2022-09-06 27
cs.AI 2208.14271

Faithful Reasoning Using Large Language Models

Proposes a selection-inference framework with search and halting mechanisms, achieving 88.1% accuracy on Proof Writer and 78.1% on EntailmentBank.

Antonia Creswell, Murray Shanahan

2022-08-30 52