Computation and Language

Authors and titles for cs.CL in Jan 2021

[1]  arXiv:2101.00010 [pdf, other]

Title: UnNatural Language Inference

Authors: Koustuv Sinha, Prasanna Parthasarathi, Joelle Pineau, Adina Williams

Comments: Accepted at ACL 2021 (Long Paper), 9 pages + Appendix

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[2]  arXiv:2101.00027 [pdf, other]

Title: The Pile: An 800GB Dataset of Diverse Text for Language Modeling

Authors: Leo Gao, Stella Biderman, Sid Black, Laurence Golding, Travis Hoppe, Charles Foster, Jason Phang, Horace He, Anish Thite, Noa Nabeshima, Shawn Presser, Connor Leahy

Subjects: Computation and Language (cs.CL)

[3]  arXiv:2101.00036 [pdf, other]

Title: KART: Parameterization of Privacy Leakage Scenarios from Pre-trained Language Models

Authors: Yuta Nakamura (1), Shouhei Hanaoka (1 and 2), Yukihiro Nomura (3 and 4), Naoto Hayashi (3), Osamu Abe (1 and 2), Shuntaro Yada (5), Shoko Wakamiya (5), Eiji Aramaki (5) ((1) The University of Tokyo, (2) The Department of Radiology, The University of Tokyo Hospital, (3) The Department of Computational Diagnostic Radiology and Preventive Medicine, The University of Tokyo Hospital, (4) Chiba University, (5) Nara Institute of Science and Technology)

Subjects: Computation and Language (cs.CL)

[4]  arXiv:2101.00056 [pdf, other]

Title: Towards Modelling Coherence in Spoken Discourse

Authors: Rajaswa Patil, Yaman Kumar Singla, Rajiv Ratn Shah, Mika Hama, Roger Zimmermann

Comments: 12 pages

Subjects: Computation and Language (cs.CL)

[5]  arXiv:2101.00063 [pdf, other]

Title: EarlyBERT: Efficient BERT Training via Early-bird Lottery Tickets

Authors: Xiaohan Chen, Yu Cheng, Shuohang Wang, Zhe Gan, Zhangyang Wang, Jingjing Liu

Comments: Accepted at ACL-IJCNLP 2021

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[6]  arXiv:2101.00078 [pdf, other]

Title: Controlled Analyses of Social Biases in Wikipedia Bios

Authors: Anjalie Field, Chan Young Park, Kevin Z. Lin, Yulia Tsvetkov

Comments: Accepted to the Web Conference 2022 (WWW '22)

Subjects: Computation and Language (cs.CL)

[7]  arXiv:2101.00117 [pdf, other]

Title: Multi-task Retrieval for Knowledge-Intensive Tasks

Authors: Jean Maillard, Vladimir Karpukhin, Fabio Petroni, Wen-tau Yih, Barlas Oğuz, Veselin Stoyanov, Gargi Ghosh

Subjects: Computation and Language (cs.CL)

[8]  arXiv:2101.00121 [pdf, other]

Title: WARP: Word-level Adversarial ReProgramming

Authors: Karen Hambardzumyan, Hrant Khachatrian, Jonathan May

Comments: Accepted ACL 2021 Long Paper

Subjects: Computation and Language (cs.CL)

[9]  arXiv:2101.00123 [pdf, other]

Title: Intent Classification and Slot Filling for Privacy Policies

Authors: Wasi Uddin Ahmad, Jianfeng Chi, Tu Le, Thomas Norton, Yuan Tian, Kai-Wei Chang

Comments: ACL 2021 (camera ready)

Subjects: Computation and Language (cs.CL)

[10]  arXiv:2101.00124 [pdf, other]

Title: Discourse-level Relation Extraction via Graph Pooling

Authors: I-Hung Hsu, Xiao Guo, Premkumar Natarajan, Nanyun Peng

Comments: 12 pages, page 10-12 appendix

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI); Machine Learning (cs.LG)

[11]  arXiv:2101.00130 [pdf, other]

Title: Sensei: Self-Supervised Sensor Name Segmentation

Authors: Jiaman Wu, Dezhi Hong, Rajesh Gupta, Jingbo Shang

Subjects: Computation and Language (cs.CL)

[12]  arXiv:2101.00133 [pdf, other]

Title: NeurIPS 2020 EfficientQA Competition: Systems, Analyses and Lessons Learned

Authors: Sewon Min, Jordan Boyd-Graber, Chris Alberti, Danqi Chen, Eunsol Choi, Michael Collins, Kelvin Guu, Hannaneh Hajishirzi, Kenton Lee, Jennimaria Palomaki, Colin Raffel, Adam Roberts, Tom Kwiatkowski, Patrick Lewis, Yuxiang Wu, Heinrich Küttler, Linqing Liu, Pasquale Minervini, Pontus Stenetorp, Sebastian Riedel, Sohee Yang, Minjoon Seo, Gautier Izacard, Fabio Petroni, Lucas Hosseini, Nicola De Cao, Edouard Grave, Ikuya Yamada, Sonse Shimaoka, Masatoshi Suzuki, Shumpei Miyawaki, Shun Sato, Ryo Takahashi, Jun Suzuki, Martin Fajcik, Martin Docekal, Karel Ondrej, Pavel Smrz, Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao, Barlas Oguz, Xilun Chen, Vladimir Karpukhin, Stan Peshterliev, Dmytro Okhonko, Michael Schlichtkrull, Sonal Gupta, Yashar Mehdad, Wen-tau Yih

Comments: 26 pages; Published in Proceedings of Machine Learning Research (PMLR), NeurIPS 2020 Competition and Demonstration Track

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[13]  arXiv:2101.00146 [pdf]

Title: De-identifying Australian Hospital Discharge Summaries: An End-to-End Framework using Ensemble of Deep Learning Models

Authors: Leibo Liu, Oscar Perez-Concha, Anthony Nguyen, Vicki Bennett, Louisa Jorm

Journal-ref: Journal of Biomedical Informatics 135 (2022) 104215

Subjects: Computation and Language (cs.CL); Information Retrieval (cs.IR)

[14]  arXiv:2101.00148 [pdf, other]

Title: Bilingual Lexicon Induction via Unsupervised Bitext Construction and Word Alignment

Authors: Haoyue Shi, Luke Zettlemoyer, Sida I. Wang

Comments: ACL-IJCNLP 2021 camera-ready version, with full supplementary material

Subjects: Computation and Language (cs.CL)

[15]  arXiv:2101.00153 [pdf, other]

Title: A Graph Total Variation Regularized Softmax for Text Generation

Authors: Liu Bin, Wang Liang, Yin Guosheng

Subjects: Computation and Language (cs.CL)

[16]  arXiv:2101.00154 [pdf, other]

Title: DISCOS: Bridging the Gap between Discourse Knowledge and Commonsense Knowledge

Authors: Tianqing Fang, Hongming Zhang, Weiqi Wang, Yangqiu Song, Bin He

Comments: WWW 2021 paper. 12 pages and 6 Figures

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[17]  arXiv:2101.00160 [pdf, other]

Title: How Do Your Biomedical Named Entity Recognition Models Generalize to Novel Entities?

Authors: Hyunjae Kim, Jaewoo Kang

Comments: IEEE Access 2022

Subjects: Computation and Language (cs.CL)

[18]  arXiv:2101.00167 [pdf, other]

Title: Unifying Discourse Resources with Dependency Framework

Authors: Yi Cheng, Sujian Li, Yueyuan Li

Subjects: Computation and Language (cs.CL)

[19]  arXiv:2101.00178 [pdf, other]

Title: UnitedQA: A Hybrid Approach for Open Domain Question Answering

Authors: Hao Cheng, Yelong Shen, Xiaodong Liu, Pengcheng He, Weizhu Chen, Jianfeng Gao

Comments: ACL 2021 camera-ready

Subjects: Computation and Language (cs.CL); Artificial Intelligence (cs.AI)

[20]  arXiv:2101.00180 [pdf, other]

Title: Transformer based Automatic COVID-19 Fake News Detection System

Authors: Sunil Gundapu, Radhika Mamidi

Comments: First Workshop on Combating Online Hostile Posts in Regional Languages during Emergency Situation, 12 pages

Subjects: Computation and Language (cs.CL)

[21]  arXiv:2101.00190 [pdf, other]

Title: Prefix-Tuning: Optimizing Continuous Prompts for Generation

Authors: Xiang Lisa Li, Percy Liang

Subjects: Computation and Language (cs.CL)

[22]  arXiv:2101.00196 [pdf, other]

Title: On Explaining Your Explanations of BERT: An Empirical Study with Sequence Classification

Authors: Zhengxuan Wu, Desmond C. Ong

Subjects: Computation and Language (cs.CL)

[23]  arXiv:2101.00204 [pdf, other]

Title: BanglaBERT: Language Model Pretraining and Benchmarks for Low-Resource Language Understanding Evaluation in Bangla

Authors: Abhik Bhattacharjee, Tahmid Hasan, Wasi Uddin Ahmad, Kazi Samin, Md Saiful Islam, Anindya Iqbal, M. Sohel Rahman, Rifat Shahriyar

Comments: Findings of North American Chapter of the Association for Computational Linguistics, NAACL 2022 (camera-ready)

Subjects: Computation and Language (cs.CL)

[24]  arXiv:2101.00234 [pdf, other]

Title: Subformer: Exploring Weight Sharing for Parameter Efficiency in Generative Transformers

Authors: Machel Reid, Edison Marrese-Taylor, Yutaka Matsuo

Comments: EMNLP 2021 Findings

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)

[25]  arXiv:2101.00259 [pdf, other]

Title: Code Generation from Natural Language with Less Prior and More Monolingual Data

Authors: Sajad Norouzi, Keyi Tang, Yanshuai Cao

Comments: ACL 2021

Subjects: Computation and Language (cs.CL); Machine Learning (cs.LG)