cs.CL 2104.06598

AR-LSAT: Investigating Analytical Reasoning of Text

AR-LSAT combines Transformer and symbolic reasoning, revealing deep reasoning gaps in current models with accuracy below 35%. ARM achieves 65%, still behind humans.

Wanjun Zhong, Siyuan Wang, Duyu Tang et al.

2021-04-14 68 citations 36
cs.CV 2104.03916

Field Convolutions for Surface CNNs

Introduced Field Convolution for surface CNNs, achieving state-of-the-art accuracy in geometry processing tasks.

Thomas W. Mitchel, Vladimir G. Kim, Michael Kazhdan

2021-04-09 9
cs.CL 2104.14337

Dynabench: Rethinking Benchmarking in NLP

Dynabench introduces a dynamic adversarial data collection platform, significantly reducing model error rates across four NLP tasks by leveraging multi-round human-model interactions.

Douwe Kiela, Max Bartolo, Yixin Nie et al.

2021-04-08 41
cs.LG 2104.03113

Scaling Scaling Laws with Board Games

By applying AlphaZero to Hex, the study reveals performance scales exponentially with board size and compute, enabling prediction of large-scale results from small experiments.

Andy L. Jones

2021-04-07 54
cs.CL 2104.02112

Efficient Attentions for Long Document Summarization

HEPOS employs head-wise positional strides, reducing complexity and enabling processing of ten times longer documents for improved ROUGE scores.

Luyang Huang, Shuyang Cao, Nikolaus Parulian et al.

2021-04-06 49
cs.SD 2104.01778

AST: Audio Spectrogram Transformer

AST is the first convolution-free, attention-based model for audio classification, achieving 0.485 mAP on AudioSet.

Yuan Gong, Yu-An Chung, James Glass

2021-04-05 14
cs.CV 2104.00743

Towards General Purpose Vision Systems

GPV-1 unifies vision tasks through language-conditioned shared heads, reaching 62.5 VQA and 1.023 CIDEr-D on COCO.

Tanmay Gupta, Amita Kamath, Aniruddha Kembhavi et al.

2021-04-02 26