cs.CV 2001.10773

Virtual KITTI 2

Enhanced Virtual KITTI 2 with Unity HDRP, stereo camera, and weather variations; validated with deep learning models showing high transferability.

Yohann Cabon, Naila Murray, Martin Humenberger

2020-01-29 51
cs.LG 2001.08361

Scaling Laws for Neural Language Models

This study formulates power-law scaling laws for neural language models, linking model size, data, and compute to performance, guiding efficient training strategies.

Jared Kaplan, Sam McCandlish, Tom Henighan et al.

2020-01-23 28
cs.LG 2001.07457

Learning to Control PDEs with Differentiable Physics

Hierarchical predictor-corrector framework with differentiable PDE solver enables long-term control of nonlinear PDE systems like Navier-Stokes.

Philipp Holl, Vladlen Koltun, Nils Thuerey

2020-01-21 35
q-bio.NC 2001.07203

Active inference on discrete state-spaces: a synthesis

Proposes a discrete state-space active inference model using variational Bayesian inference, unifying perception, action, and learning.

Lancelot Da Costa, Thomas Parr, Noor Sajid et al.

2020-01-21 283 citations 59
cs.LG 2001.04451

Reformer: The Efficient Transformer

Reformer combines reversible residual layers and locality-sensitive hashing (LSH) attention, reducing complexity from O(L^2) to O(L log L) for long sequences.

Nikita Kitaev, Łukasz Kaiser, Anselm Levskaya

2020-01-14 53
cs.LG 2001.03040

Deep Network Approximation for Smooth Functions

This paper establishes near-optimal approximation bounds for deep ReLU networks approximating smooth functions, with errors of O(N^{-2s/d}L^{-2s/d}) when width and depth are optimized.

Jianfeng Lu, Zuowei Shen, Haizhao Yang et al.

2020-01-09 317 citations 29