Volume 9

Table of contents

1. Reducing Confusion in Active Learning for Part-Of-Speech Tagging

   Aditi Chaudhary, Zaid Sheikh, Antonis Anastasopoulos, Graham Neubig

   Article at MIT Press Presented at NAACL 2021

2. Revisiting Multi-Domain Machine Translation

   Minh Quang PHAM, Josep CREGO, François YVON

   Article at MIT Press Presented at EACL 2021

3. Conversation Graph: Data Augmentation, Training and Evaluation for Non-Deterministic Dialogue Management

   Milan Gritta, Gerasimos Lampouras, Ignacio Iacobacci

   Article at MIT Press Presented at ACL 2021

4. Efficient Content-Based Sparse Attention with Routing Transformers

   Aurko Roy, Mohammad Saffar, Ashish Vaswani, David Grangier

   Article at MIT Press Presented at ACL 2021

5. Deciphering Undersegmented Ancient Scripts Using Phonetic Prior

   Jiaming Luo, Frederik Hartmann, Enrico Santus, Yuan Cao, Regina Barzilay

   Article at MIT Press Presented at EACL 2021

6. Augmenting Transformers with KNN-Based Composite Memory for Dialog

   Angela Fan, Claire Gardent, Chloe Braud, Antoine Bordes

   Presented at EACL 2021 Article at MIT Press

7. Modeling Content and Context with Deep Relational Learning

   Maria Leonor Pacheco, Dan Goldwasser

   Article at MIT Press Presented at NAACL 2021

8. Recursive Non-Autoregressive Graph-to-Graph Transformer for Dependency Parsing with Iterative Refinement

   Alireza Mohammadshahi, James Henderson

   Presented at EACL 2021

9. On the Relationships Between the Grammatical Genders of Inanimate Nouns and Their Co-Occurring Adjectives and Verbs

   Adina Williams, Lawrence Wolf-Sonkin, Damian Blasi, Hanna Wallach, Ryan D Cotterell

   Article at MIT Press Presented at EMNLP 2021

10. Amnesic Probing: Behavioral Explanation With Amnesic Counterfactuals

    Yanai Elazar, Shauli Ravfogel, Alon Jacovi, Yoav Goldberg

    Article at MIT Press Presented at ACL 2021

11. KEPLER: A Unified Model for Knowledge Embedding and Pre-trained Language Representation

    Xiaozhi Wang, Tianyu Gao, Zhaocheng Zhu, Zhengyan Zhang, Zhiyuan Liu, Juanzi Li, Jian Tang

    Article at MIT Press Presented at ACL 2021

12. Latent Compositional Representations Improve Systematic Generalization in Grounded Question Answering

    Ben Bogin, Sanjay Subramanian, Matt Gardner, Jonathan Berant

    Presented at NAACL 2021 Article at MIT Press

13. WikiAsp: A Dataset for Multi-domain Aspect-based Summarization

    Hiroaki Hayashi, Prashant Budania, Peng Wang, Chris Ackerson, Raj Neervannan, Graham Neubig

    Presented at NAACL 2021 Article at MIT Press

14. Infusing Finetuning with Semantic Dependencies

    Zhaofeng Wu, Hao Peng, Noah Smith

    Article at MIT Press Presented at ACL 2021

15. Supertagging the Long Tail with Tree-Structured Decoding of Complex Categories

    Jakob Prange, Nathan Schneider, Vivek Srikumar

    Presented at EACL 2021 Article at MIT Press

16. Morphology Matters: A Multilingual Language Modeling Analysis

    Hyunji Hayley Park, Katherine J. Zhang, Coleman Haley, Kenneth Steimel, Han Liu, Lane Schwartz

    Article at MIT Press Presented at EACL 2021

17. Extractive Opinion Summarization in Quantized Transformer Spaces

    Stefanos Angelidis, Reinald Kim Amplayo, Yoshihiko Suhara, Xiaolan Wang, Mirella Lapata

    Presented at NAACL 2021 Article at MIT Press

18. Aligning Faithful Interpretations with their Social Attribution

    Alon Jacovi, Yoav Goldberg

    Article at MIT Press Presented at EMNLP 2021

19. EDITOR: an Edit-Based Transformer with Repositioning for Neural Machine Translation with Soft Lexical Constraints

    Weijia Xu, Marine Carpuat

    Article at MIT Press Presented at ACL 2021

20. Sparse, Dense, and Attentional Representations for Text Retrieval

    Yi Luan, Jacob Eisenstein, Kristina Toutanova, Michael Collins

    Presented at NAACL 2021 Article at MIT Press

21. Did Aristotle Use a Laptop? A Question Answering Benchmark with Implicit Reasoning Strategies

    Mor Geva, Daniel Khashabi, Elad Segal, Tushar Khot, Dan Roth, Jonathan Berant

    Presented at NAACL 2021 Article at MIT Press

22. Adaptive Semiparametric Language Models

    Dani Yogatama, Cyprien de Masson d'Autume, Lingpeng Kong

    Article at MIT Press

23. Unsupervised Learning of KB Queries in Task-Oriented Dialogs

    Dinesh Raghu, Nikhil Gupta, . Mausam

    Article at MIT Press Presented at ACL 2021

24. SummEval: Re-evaluating Summarization Evaluation

    Alexander R. Fabbri, Wojciech Kryscinski, Bryan McCann, Caiming Xiong, Richard Socher, Dragomir Radev

    Article at MIT Press Presented at ACL 2021

25. Parameter Space Factorization for Zero-Shot Learning across Tasks and Languages

    Edoardo M. Ponti, Ivan Vulić, Ryan Cotterell, Marinela Parovic, Roi Reichart, Anna Korhonen

    Presented at NAACL 2021 Article at MIT Press

26. An Error Analysis Framework for Shallow Surface Realisation

    Anastasia Shimorina, Claire Gardent, Yannick Parmentier

    Presented at NAACL 2021 Article at MIT Press

27. Decontextualization: Making Sentences Stand-Alone

    Eunsol Choi, Jennimaria Palomaki, Matthew Lamm, Tom Kwiatkowski, Dipanjan Das, Michael Collins

    Article at MIT Press

28. A Computational Framework for Slang Generation

    Zhewei Sun, Richard Zemel, Yang Xu

    Article at MIT Press Presented at ACL 2021

29. Neural OCR Post-Hoc Correction of Historical Corpora

    Lijun Lyu, Maria Koutraki, Besnik Fetahu, Martin Krickl

    Article at MIT Press Presented at ACL 2021

30. Iterative Paraphrastic Augmentation with Discriminative Span Alignment

    Ryan Culkin, J. Edward Hu, Elias Stengel-Eskin, Guanghui Qin, Benjamin Van Durme

    Article at MIT Press Presented at EMNLP 2021

31. Data-to-text Generation with Macro Planning

    Ratish Puduppully, Mirella Lapata

    Presented at ACL 2021 Article at MIT Press

32. Optimizing over Subsequences Generates Context-Sensitive Languages

    Andrew Lamont

    Presented at ACL 2021 Article at MIT Press

33. Dialogue State Tracking with Incremental Reasoning

    Lizi Liao, Le Hong Long, Yunshan Ma, Wenqiang Lei, Tat-Seng Chua

    Presented at NAACL 2021 Article at MIT Press

34. Decoupling the Role of Data, Attention, and Losses in Multimodal Transformers

    Lisa Anne Hendricks, John Mellor, Rosalia Schneider, Jean-Baptiste Alayrac, Aida Nematzadeh

    Presented at ACL 2021 Article at MIT Press

35. Context-aware Adversarial Training for Name Regularity Bias in Named Entity Recognition

    Abbas Ghaddar, Philippe Langlais, Ahmad Rashid, Mehdi Rezagholizadeh

    Presented at ACL 2021 Article at MIT Press

36. There Once Was a Really Bad Poet, It Was Automated but You Didn’t Know It

    Jianyou Wang, Cynthia Rudin, Yuren Zhou, Chris Suh, Xiaoxuan Zhang

    Presented at NAACL 2021 Article at MIT Press

37. Evaluating Document Coherence Modelling

    Aili Shen, Meladel Mistica, Bahar Salehi, Hang Li, Timothy Baldwin, Jianzhong Qi

    Presented at NAACL 2021 Article at MIT Press

38. Characterizing English Variation across Social Media Communities with BERT

    Li Lucy, David Bamman

    Presented at NAACL 2021 Article at MIT Press

39. Self-supervised Regularization for Text Classification

    Meng Zhou, Zechen Li, Pengtao Xie

    Presented at NAACL 2021 Article at MIT Press

40. Pretraining the Noisy Channel Model for Task-Oriented Dialogue

    Qi Liu, Lei Yu, Laura Rimell, Phil Blunsom

    Presented at ACL 2021 Article at MIT Press

41. Efficient Computation of Expectations under Spanning Tree Distributions

    Ran Zmigrod, Tim Vieira, Ryan Cotterell

    Article at MIT Press Presented at EMNLP 2021

42. Revisiting Few-shot Relation Classification: Evaluation Data and Classification Schemes

    Ofer Sabo, Yanai Elazar, Yoav Goldberg, Ido Dagan

    Article at MIT Press Presented at EMNLP 2021

43. Strong Equivalence of TAG and CCG

    Lena Katharina Schiffer, Andreas Maletti

    Presented at ACL 2021 Article at MIT Press

44. Classifying Argumentative Relations Using Logical Mechanisms and Argumentation Schemes

    Yohan Jo, Seojin Bang, Chris Reed, Eduard Hovy

    Presented at ACL 2021 Article at MIT Press

45. Revisiting Negation in Neural Machine Translation

    Gongbo Tang, Philipp Rönchen, Rico Sennrich, Joakim Nivre

    Presented at ACL 2021 Article at MIT Press

46. Joint Universal Syntactic and Semantic Parsing

    Elias Stengel-Eskin, Kenton Murray, Sheng Zhang, Aaron Steven White, Benjamin Van Durme

    Article at MIT Press Presented at EMNLP 2021

47. Towards Question-Answering as an Automatic Metric for Evaluating the Content Quality of a Summary

    Daniel Deutsch, Tania Bedrax-Weiss, Dan Roth

    Presented at ACL 2021 Article at MIT Press

48. QED: A Framework and Dataset for Explanations in Question Answering

    Matthew Lamm, Jennimaria Palomaki, Chris Alberti, Daniel Andor, Eunsol Choi, Livio Baldini Soares, Michael Collins

    Presented at ACL 2021 Article at MIT Press

49. SOLOIST: Building Task Bots at Scale with Transfer Learning and Machine Teaching

    Baolin Peng, Chunyuan Li, Jinchao Li, Shahin Shayandeh, Lars Liden, Jianfeng Gao

    Presented at ACL 2021 Article at MIT Press

50. Let’s Play Mono-Poly: BERT Can Reveal Words’ Polysemy Level and Partitionability into Senses

    Aina Garí Soler, Marianna Apidianaki

    Presented at ACL 2021 Article at MIT Press

51. Gender Bias in Machine Translation

    Beatrice Savoldi, Marco Gaido, Luisa Bentivogli, Matteo Negri, Marco Turchi

    Presented at ACL 2021 Article at MIT Press

52. Neural Event Semantics for Grounded Language Understanding

    Shyamal Buch, Li Fei-Fei, Noah Goodman

    Presented at ACL 2021 Article at MIT Press

53. Sensitivity as a Complexity Measure for Sequence Classification Tasks

    Michael Hahn, Dan Jurafsky, Richard Futrell

    Article at MIT Press Presented at EMNLP 2021

54. Neural Modeling for Named Entities and Morphology (NEMO^2)

    Dan Bareket, Reut Tsarfaty

    Article at MIT Press

55. Relevance-guided Supervision for OpenQA with ColBERT

    Omar Khattab, Christopher Potts, Matei Zaharia

    Presented at ACL 2021 Article at MIT Press

56. Unsupervised Abstractive Opinion Summarization by Generating Sentences with Tree-Structured Topic Guidance

    Masaru Isonuma, Junichiro Mori, Danushka Bollegala, Ichiro Sakata

    Article at MIT Press Presented at EMNLP 2021

57. How Can We Know When Language Models Know? On the Calibration of Language Models for Question Answering

    Zhengbao Jiang, Jun Araki, Haibo Ding, Graham Neubig

    Article at MIT Press Presented at EMNLP 2021

58. Multimodal Pretraining Unmasked: A Meta-Analysis and a Unified Framework of Vision-and-Language BERTs

    Emanuele Bugliarello, Ryan Cotterell, Naoaki Okazaki, Desmond Elliott

    Article at MIT Press Presented at EMNLP 2021

59. Maintaining Common Ground in Dynamic Environments

    Takuma Udagawa, Akiko Aizawa

    Article at MIT Press Presented at EMNLP 2021

60. Measuring and Improving Consistency in Pretrained Language Models

    Yanai Elazar, Nora Kassner, Shauli Ravfogel, Abhilasha Ravichander, Eduard Hovy, Hinrich Schütze, Yoav Goldberg

    Presented at EMNLP 2021 Article at MIT Press

61. Narrative Question Answering with Cutting-Edge Open-Domain QA Techniques: A Comprehensive Study

    Xiangyang Mou, Chenghao Yang, Mo Yu, Bingsheng Yao, Xiaoxiao Guo, Saloni Potdar, Hui Su

    Article at MIT Press Presented at NAACL 2022

62. Provable Limitations of Acquiring Meaning from Ungrounded Form: What will Future Language Models Understand?

    William Cooper Merrill, Yoav Goldberg, Roy Schwartz, Noah A. Smith

    Presented at EMNLP 2021 Article at MIT Press

63. Compressing Large-Scale Transformer-Based Models: A Case Study on BERT

    Prakhar Ganesh, Yao Chen, Xin Lou, Mohammad Ali Khan, Yin Yang, Hassan Sajjad, Preslav Nakov, Deming Chen, Marianne Winslett

    Article at MIT Press Presented at ACL 2022

64. He Thinks He Knows Better than the Doctors: BERT for Event Factuality Fails on Pragmatics

    Nanjiang Jiang, Marie-Catherine de Marneffe

    Article at MIT Press Presented at NAACL 2022

65. PAQ: 65 Million Probably-Asked Questions and What You Can Do With Them

    Patrick Lewis, Yuxiang Wu, Linqing Liu, Pasquale Minervini, Heinrich Küttler, Aleksandra Piktus, Pontus Stenetorp, Sebastian Riedel

    Presented at EMNLP 2021 Article at MIT Press

66. MasakhaNER: Named Entity Recognition for African Languages

    David Ifeoluwa Adelani, Jade Abbott, Graham Neubig, Daniel D'souza, Julia Kreutzer, Constantine Lignos, Chester Palen-Michel, Happy Buzaaba, Shruti Rijhwani, Sebastian Ruder, Stephen Mayhew, Israel Abebe Azime, Shamsuddeen Hassan Muhammad, Chris Emezue, Joyce Nakatumba-Nabende, Perez Ogayo, Aremu Anuoluwapo, Catherine Gitau, Derguene Mbaye, Jesujoba Alabi, Seid Muhie Yimam, Tajuddeen Gwadabe, Ignatius Ezeani, Andre Rubungo Niyongabo, Jonathan Mukiibi, Verrah Otiende, Iroro Orife, Davis David, Samba Ngom, Tosin Adewumi, Paul Rayson, Mofetoluwa Adeyemi, Gerald Muriuki, Emmanuel Anebi, Chiamaka Ijeoma Chukwuneke, Nkiruka Odu, Eric Peter Wairagala, Samuel Abiodun Oyerinde, Clemencia Siro, Tobius Saul Bateesa, Temilola Oloyede, Yvonne Wambui, Victor Akinode, Deborah Nabagereka, Maurice Katusiime, Ayodele Awokoya, Mouhamadane Mboup, Dibora Haile, Henok Tilaye, Kelechi Nwaike, Degaga Wolde, Abdoulaye Faye, Blessing K. Sibanda, Orevaoghene Ahia, Bonaventure Dossou, Kelechi Ogueji, Thierno Ibrahima Diop, Abdoulaye Diallo, Adewale Akinfaderin, Tendai Marengereke, Salomey Osei

    Presented at EMNLP 2021 Article at MIT Press

67. A Statistical Analysis of Summarization Evaluation Metrics Using Resampling Methods

    Daniel Deutsch, Rotem Dror, Dan Roth

    Presented at EMNLP 2021 Article at MIT Press

68. ParsiNLU: A Suite of Language Understanding Challenges for Persian

    Daniel Khashabi, Arman Cohan, Siamak Shakeri, Pedram Hosseini, Pouya Pezeshkpour, Malihe Alikhani, Moin Aminnaseri, Marzieh Bitaab, Faeze Brahman, Sarik Ghazarian, Mozhdeh Gheini, Arman Kabiri, Rabeeh Karimi Mahabadi, Omid Memarrast, Ahmadreza Mosallanezhad, Erfan Noury, Shahab Raji, Mohammad Sadegh Rasooli, Sepideh Sadeghi, Erfan Sadeqi Azer, Niloofar Safi Samghabadi, Mahsa Shafaei, Saber Sheybani, Ali Tazarv, Yadollah Yaghoobzadeh

    Presented at EMNLP 2021 Article at MIT Press

69. What Helps Transformers Recognize Conversational Structure? Importance of Context, Punctuation, and Labels in Dialog Act Recognition

    Piotr Zelasko, Raghavendra Pappagari, Najim Dehak

    Article at MIT Press

70. Identity-Based Patterns in Deep Convolutional Networks: Generative Adversarial Phonology and Reduplication

    Gašper Beguš

    Presented at EMNLP 2021 Article at MIT Press

71. Memory-Based Semantic Parsing

    Parag Jain, Mirella Lapata

    Presented at EMNLP 2021 Article at MIT Press

72. Controllable Summarization with Constrained Markov Decision Process

    Hou Pong Chan, Lu Wang, Irwin King

    Presented at EMNLP 2021 Article at MIT Press

73. On the Difficulty of Translating Free-Order Case-Marking Languages

    Arianna Bisazza, Stephan Sportel, Ahmet Ustun

    Presented at EMNLP 2021 Article at MIT Press

74. Quantifying Social Biases in NLP: A Generalization and Empirical Comparison of Extrinsic Fairness Metrics

    Paula Czarnowska, Yogarshi Vyas, Kashif Shah

    Article at MIT Press Presented at ACL 2022

75. Structured Self-Supervised Pretraining for Commonsense Knowledge Graph Completion

    Jiayuan Huang, Yangkai Du, Shuting Tao, Kun Xu, Pengtao Xie

    Article at MIT Press

76. Lexically-Aware Semi-Supervised Learning for OCR Post-Correction

    Shruti Rijhwani, Daisy Rosenblum, Antonios Anastasopoulos, Graham Neubig

    Presented at EMNLP 2021 Article at MIT Press

77. Continual Learning for Grounded Instruction Generation by Observing Human Following Behavior

    Noriyuki Kojima, Alane Suhr, Yoav Artzi

    Presented at EMNLP 2021 Article at MIT Press

78. Partially Supervised Named Entity Recognition via the Expected Entity Ratio Loss

    Thomas Effland, Michael Collins

    Presented at EMNLP 2021 Article at MIT Press

79. On Generative Spoken Language Modeling from Raw Audio

    Kushal Lakhotia, Evgeny Kharitonov, Wei-Ning Hsu, Yossi Adi, Adam Polyak, Benjamin Bolte, Tu-Anh Nguyen, Jade Copet, Alexei Baevski, Abdelrahman Mohamed, Emmanuel Dupoux

    Presented at EMNLP 2021 Article at MIT Press

80. Model Compression for Domain Adaptation through Causal Effect Estimation

    Guy Rotman, Amir Feder, Roi Reichart

    Presented at EMNLP 2021 Article at MIT Press

81. A Biologically Plausible Parser

    Daniel Mitropolsky, Michael Collins, Christos Papadimitriou

    Article at MIT Press Presented at ACL 2022

82. MKQA: A Linguistically Diverse Benchmark for Multilingual Open Domain Question Answering

    Shayne Longpre, Yi Lu, Joachim Daiber

    Presented at EMNLP 2021 Article at MIT Press

83. Erratum: Measuring and Improving Consistency in Pretrained Language Models

    Yanai Elazar, Nora Kassner, Shauli Ravfogel, Abhilasha Ravichander, Eduard Hovy, Hinrich Schütze, Yoav Goldberg

    Article at MIT Press

84. Self-Diagnosis and Self-Debiasing: A Proposal for Reducing Corpus-Based Bias in NLP

    Timo Schick, Sahana Udupa, Hinrich Schütze

    Article at MIT Press Presented at ACL 2022

85. Weisfeiler-Leman in the BAMBOO: Novel AMR Graph Metrics and a Benchmark for AMR Graph Similarity

    Juri Opitz, Anette Frank, Angel Daza

    Article at MIT Press Presented at ACL 2022

86. Differentiable Subset Pruning of Transformer Heads

    Jiaoda Li, Ryan Cotterell, Mrinmaya Sachan

    Presented at EMNLP 2021 Article at MIT Press

87. Experts, Errors, and Context: A Large-Scale Study of Human Evaluation for Machine Translation

    Markus Freitag, George Foster, David Grangier, Viresh Ratnakar, Qijun Tan, Wolfgang Macherey

    Article at MIT Press Presented at ACL 2022

88. Planning with Learned Entity Prompts for Abstractive Summarization

    Shashi Narayan, Yao Zhao, Joshua Maynez, Gonçalo Simões, Vitaly Nikolaev, Ryan McDonald

    Article at MIT Press Presented at ACL 2022

89. Instance-Based Dependency Parsing

    Hiroki Ouchi, Jun Suzuki, Sosuke Kobayashi, Sho Yokoi, Tatsuki Kuribayashi, Masashi Yoshikawa, Kentaro Inui

    Article at MIT Press Presented at ACL 2022

90. Explanation-Based Human Debugging of NLP Models: A Survey”

    Piyawat Lertvittayakumjorn, Francesca Toni

    Article at MIT Press Presented at NAACL 2022

91. Quantifying Cognitive Factors in Lexical Decline

    David Francis, Ella Rabinovich, Samir Farhan, David Mortensen, Suzanne Stevenson

    Article at MIT Press Presented at ACL 2022

92. Idiomatic Expression Identification using Semantic Compatibility”

    Ziheng Zeng, Suma Bhat

    Article at MIT Press

93. Word Representation Learning in Multimodal Pre-Trained Transformers: An Intrinsic Evaluation

    Sandro Pezzelle, Ece Takmaz, Raquel Fernández

    Article at MIT Press Presented at ACL 2022