cs.LG 1906.01076

Episodic Memory in Lifelong Language Learning

Proposes an episodic memory model using sparse experience replay and local adaptation to mitigate catastrophic forgetting, reducing space complexity by 50-90%.

Cyprien de Masson d'Autume, Sebastian Ruder, Lingpeng Kong et al.

2019-06-04 4
stat.ML 1906.00945

Adversarial Robustness as a Prior for Learned Representations

Using adversarial robustness as a prior, the paper achieves near-invertible, interpretable feature representations with improved visualization and manipulation, surpassing standard models.

Logan Engstrom, Andrew Ilyas, Shibani Santurkar et al.

2019-06-04 55
cs.LG 1905.13177

Graph Normalizing Flows

Graph Normalizing Flows: a novel reversible GNN model with reduced memory footprint for large-scale graphs.

Jenny Liu, Aviral Kumar, Jimmy Ba et al.

2019-05-31 41
cs.LG 1905.12265

Strategies for Pre-training Graph Neural Networks

Proposes node- and graph-level pretraining with self-supervised tasks, achieving up to 9.4% ROC-AUC improvement on molecular datasets.

Weihua Hu, Bowen Liu, Joseph Gomes et al.

2019-05-29 52
stat.ML 1905.11600

GraphNVP: An Invertible Flow Model for Generating Molecular Graphs

GraphNVP employs invertible normalizing flows for molecular graph generation, decomposing structure and attributes, achieving high validity and uniqueness with exact likelihood maximization.

Kaushalya Madhawa, Katushiko Ishiguro, Kosuke Nakago et al.

2019-05-28 31