cs.CL 2010.01869

Linguistic Profiling of a Neural Language Model

Using 68 probing tasks, the study finds BERT loses linguistic information after fine-tuning, while more readable representations improve NLI accuracy.

Alessio Miaschi, Dominique Brunato, Felice Dell'Orletta et al.

2020-10-05 35
cs.RO 2010.01083

Integrated Task and Motion Planning

Proposes an integrated task and motion planning (TAMP) algorithm combining discrete task structures with continuous motion parameters, achieving 85% success in complex object manipulation tasks.

Caelan Reed Garrett, Rohan Chitnis, Rachel Holladay et al.

2020-10-03 54
cs.CL 2010.00710

Nearest Neighbor Machine Translation

kNN-MT enhances translation via nearest neighbor search, improving German-English BLEU by 1.5.

Urvashi Khandelwal, Angela Fan, Dan Jurafsky et al.

2020-10-02 37
cs.LG 2009.14794

Rethinking Attention with Performers

Performer introduces a linear-time Transformer using FAVOR+ to unbiasedly approximate softmax attention, enabling scalable long-sequence modeling.

Krzysztof Choromanski, Valerii Likhosherstov, David Dohan et al.

2020-10-01 36
cs.CL 2009.10855

Controlling Style in Generated Dialogue

This work adapts three large-scale controllable dialogue architectures to manage about 200 styles, improving style consistency and diversity.

Eric Michael Smith, Diana Gonzalez-Rico, Emily Dinan et al.

2020-09-23 58