cs.LG 2107.07702

Neural Contextual Anomaly Detection for Time Series

NCAD combines representation learning and deep anomaly detection, achieving SOTA on univariate/multivariate time series with semi-supervised capability.

Chris U. Carmona, François-Xavier Aubet, Valentin Flunkert et al.

2021-07-16 36
cs.LG 2107.03374

Evaluating Large Language Models Trained on Code

Codex, a GPT-based model fine-tuned on GitHub code, achieves 28.8% success on HumanEval, with 70.2% using 100 samples, significantly surpassing GPT-3.

Mark Chen, Jerry Tworek, Heewoo Jun et al.

2021-07-08 40
cs.LG 2107.00630

Variational Diffusion Models

Proposes Variational Diffusion Models (VDM) achieving state-of-the-art likelihoods on image density benchmarks by optimizing noise schedules and incorporating Fourier features.

Diederik P. Kingma, Tim Salimans, Ben Poole et al.

2021-07-02 39
cs.LG 2106.13948

Core Challenges in Embodied Vision-Language Planning

Unified EVLP taxonomy, analyzing algorithms, datasets, and challenges; emphasizing model generalization and real-world deployment.

Jonathan Francis, Nariaki Kitamura, Felix Labelle et al.

2021-06-26 62
cs.LG 2106.12575

Weisfeiler and Lehman Go Cellular: CW Networks

Proposes CW networks with cell complexes, surpassing WL test, for enhanced graph expressivity, especially in molecular graphs.

Cristian Bodnar, Fabrizio Frasca, Nina Otter et al.

2021-06-24 36
cs.LG 2106.08441

Online Learning with Uncertain Feedback Graphs

Proposes algorithms Exp3-IP and Exp3-GR for online learning with uncertain feedback graphs, achieving sublinear regret bounds under mild conditions.

Pouya M Ghari, Yanning Shen

2021-06-16 4 citations 40
cs.LG 2106.04426

Hash Layers For Large Sparse Models

Efficient parameter allocation in large sparse models using Hash Layers, improving performance.

Stephen Roller, Sainbayar Sukhbaatar, Arthur Szlam et al.

2021-06-08 0