Publications

Refereed Conference Publications

TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answering

Yushi Hu, Benlin Liu, Jungo Kasai, Yizhong Wang, Mari Ostendorf, Ranjay Krishna, and Noah A. Smith. 2023. "TIFA: Accurate and Interpretable Text-to-Image Faithfulness Evaluation with Question Answering." Proceedings of the IEEE International Conference on Computer Vision (ICCV).

BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting

Zheng-Xin Yong, Hailey Schoelkopf, Niklas Muennighoff, Alham Fikri Aji, David Ifeoluwa Adelani, Khalid Almubarak, M Saiful Bari, Lintang Sutawika, Jungo Kasai, Ahmed Baruwa, Genta Indra Winata, Stella Biderman, Edward Raff, Dragomir Radev, and Vassilina Nikoulina. 2023. "BLOOM+1: Adding Language Support to BLOOM for Zero-Shot Prompting." Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL).

NarrowBERT: Accelerating Masked Language Model Pretraining and Inference

Haoxin Li, Phillip Keung, Daniel Cheng, Jungo Kasai, and Noah A. Smith. 2023. "NarrowBERT: Accelerating Masked Language Model Pretraining and Inference." Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL).

One Embedder, Any Task: Instruction-Finetuned Text Embeddings

Hongjin Su, Weijia Shi, Jungo Kasai, Yizhong Wang, Yushi Hu, Mari Ostendorf, Wen-tau Yih, Noah A Smith, Luke Zettlemoyer, and Tao Yu. 2023. "One Embedder, Any Task: Instruction-Finetuned Text Embeddings." Findings of the Association for Computational Linguistics: ACL 2023.

Selective Annotation Makes Language Models Better Few-Shot Learners

Hongjin Su, Jungo Kasai, Chen Henry Wu, Weijia Shi, Tianlu Wang, Jiayi Xin, Rui Zhang, Mari Ostendorf, Luke Zettlemoyer, Noah A. Smith, and Tao Yu. 2023. "Selective Annotation Makes Language Models Better Few-Shot Learners." Proceedings of the International Conference on Learning Representations (ICLR).

Twist Decoding: Diverse Generators Guide Each Other

Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Hao Peng, Ximing Lu, Dragomir Radev, Yejin Choi, and Noah A. Smith. 2022. "Twist Decoding: Diverse Generators Guide Each Other." Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP).

GENIE: Toward Reproducible and Standardized Human Evaluation for Text Generation

Daniel Khashabi, Gabriel Stanovsky, Jonathan Bragg, Nicholas Lourie, Jungo Kasai, Yejin Choi, Noah A. Smith, and Daniel S. Weld. 2022. "GENIE: Toward Reproducible and Standardized Human Evaluation for Text Generation." Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP).

How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers

Michael Hassid, Hao Peng, Daniel Rotem, Jungo Kasai, Ivan Montero, Noah A. Smith, and Roy Schwartz. 2022. "How Much Does Attention Actually Attend? Questioning the Importance of Attention in Pretrained Transformers." Findings of the Association for Computational Linguistics: EMNLP 2022.

Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand

Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Lavinia Dunagan, Jacob Morrison, Alexander R. Fabbri, Yejin Choi, and Noah A. Smith. 2022. "Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand." Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics (NAACL).

Transparent Human Evaluation for Image Captioning

Jungo Kasai, Keisuke Sakaguchi, Lavinia Dunagan, Jacob Morrison, Ronan Le Bras, Yejin Choi, and Noah A. Smith. 2022. "Transparent Human Evaluation for Image Captioning." Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics (NAACL).

NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristics

Ximing Lu, Sean Welleck, Peter West, Liwei Jiang, Jungo Kasai, Daniel Khashabi, Ronan Le Bras, Lianhui Qin, Youngjae Yu, Rowan Zellers, Noah A. Smith, and Yejin Choi. 2022. "NeuroLogic A*esque Decoding: Constrained Text Generation with Lookahead Heuristics." Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics (NAACL). Best Paper Award.

ABC: Attention with Bounded-memory Control

Hao Peng, Jungo Kasai, Nikolaos Pappas, Dani Yogatama, Zhaofeng Wu, Lingpeng Kong, Roy Schwartz, and Noah A. Smith. 2022. "ABC: Attention with Bounded-memory Control." Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL).

Finetuning Pretrained Transformers into RNNs

Jungo Kasai, Hao Peng, Yizhe Zhang, Dani Yogatama, Gabriel Ilharco, Nikolaos Pappas, Yi Mao, Weizhu Chen, and Noah A. Smith. 2021. "Finetuning Pretrained Transformers into RNNs." Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP).

Probing Across Time: What Does RoBERTa Know and When?

Leo Z. Liu, Yizhong Wang, Jungo Kasai, Hannaneh Hajishirzi, and Noah A. Smith. 2021. "Probing Across Time: What Does RoBERTa Know and When?" Findings of the Association for Computational Linguistics: EMNLP 2021.

One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrieval

Akari Asai, Xinyan Yu, Jungo Kasai, and Hanna Hajishirzi. 2021. "One Question Answering Model for Many Languages with Cross-lingual Dense Passage Retrieval." Proceedings of Advances in Neural Information Processing Systems (NeurIPS).

Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation

Jungo Kasai, Nikolaos Pappas, Hao Peng, James Cross, and Noah A. Smith. 2021. "Deep Encoder, Shallow Decoder: Reevaluating the Speed-Quality Tradeoff in Machine Translation." Proceedings of the Conference of the International Conference on Learning Representations (ICLR).

XOR QA: Cross-lingual Open-Retrieval Question Answering

Akari Asai, Jungo Kasai, Jonathan H. Clark, Kenton Lee, Eunsol Choi, and Hannaneh Hajishirzi. 2021. "XOR QA: Cross-lingual Open-Retrieval Question Answering." Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistics (NAACL).

Findings of the Conference on Machine Translation (WMT21)

Farhad Akhbardeh, Arkady Arkhangorodsky, Magdalena Biesialska, Ondřej Bojar, Rajen Chatterjee, Vishrav Chaudhary, Marta R. Costa-jussa, Cristina España-Bonet, Angela Fan, Christian Federmann, Markus Freitag, Yvette Graham, Roman Grundkiewicz, Barry Haddow, Leonie Harter, Kenneth Heafield, Christopher Homan, Matthias Huck, Kwabena Amponsah-Kaakyire, Jungo Kasai, Daniel Khashabi, Kevin Knight, Tom Kocmi, Philipp Koehn, Nicholas Lourie, Christof Monz, Makoto Morishita, Masaaki Nagata, Ajay Nagesh, Toshiaki Nakazawa, Matteo Negri, Santanu Pal, Allahsera Auguste Tapo, Marco Turchi, Valentin Vydrin, and Marcos Zampieri. 2021. "Findings of the Conference on Machine Translation (WMT21)." Proceedings of the Conference on Machine Translation (WMT).

Non-Autoregressive Machine Translation with Disentangled Context Transformer

Jungo Kasai, James Cross, Marjan Ghazvininejad, and Jiatao Gu. 2020. "Non-Autoregressive Machine Translation with Disentangled Context Transformer." Proceedings of the International Conference on Machine Learning (ICML).

Low-Resource Parsing with Crosslingual Contextualized Representations

Phoebe Mulcaire,^* Jungo Kasai,^* and Noah A. Smith. 2019. "Low-Resource Parsing with Crosslingual Contextualized Representations." Proceedings of the Conference on Computational Natural Language Learning (CoNLL).

Low-resource Deep Entity Resolution with Transfer and Active Learning

Jungo Kasai, Kun Qian, Sairam Gurajada, Yunyao Li, and Lucian Popa. 2019. "Low-resource Deep Entity Resolution with Transfer and Active Learning." Proceedings of the Annual Meeting of the Association for Computational Linguistics (ACL).

Syntax-aware Neural Semantic Role Labeling with Supertags

Jungo Kasai, Dan Friedman, Robert Frank, Dragomir Radev, and Owen Rambow. 2019. "Syntax-aware Neural Semantic Role Labeling with Supertags." Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistic (NAACL).

Polyglot Contextual Representations Improve Crosslingual Transfer

Phoebe Mulcaire, Jungo Kasai, and Noah A. Smith. 2019. "Polyglot Contextual Representations Improve Crosslingual Transfer." Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistic (NAACL).

ScisummNet: A Large Annotated Corpus and Content-Impact Models for Scientific Paper Summarization with Citation Networks

Michihiro Yasunaga, Jungo Kasai, Rui Zhang, Alexander R. Fabbri, Irene Li, Dan Friedman, and Dragomir Radev. 2019. "ScisummNet: A Large Annotated Corpus and Content-Impact Models for Scientific Paper Summarization with Citation Networks." Proceedings of the Conference of the Conference on Artificial Intelligence (AAAI).

Jabberwocky Parsing: Dependency Parsing with Lexical Noise

Jungo Kasai and Robert Frank. 2019. "Jabberwocky Parsing: Dependency Parsing with Lexical Noise." Proceedings of the Society for Computation in Linguistics (SCiL).

End-to-end Graph-based TAG Parsing with Neural Networks

Jungo Kasai, Robert Frank, Pauli Xu, William Merrill, and Owen Rambow. 2018. "Robust Multilingual Part-of-Speech Tagging via Adversarial Training." Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistic (NAACL).

Robust Multilingual Part-of-Speech Tagging via Adversarial Training

Michihiro Yasunaga, Jungo Kasai, and Dragomir Radev. 2018. "Robust Multilingual Part-of-Speech Tagging via Adversarial Training." Proceedings of the Conference of the North American Chapter of the Association for Computational Linguistic (NAACL).

TAG Parsing with Neural Networks and Vector Representations of Supertags

Jungo Kasai, Robert Frank, R. Thomas McCoy, Owen Rambow, and Alexis Nasr. 2017. "TAG Parsing with Neural Networks and Vector Representations of Supertags." Proceedings of the Conference on Empirical Methods in Natural Language Processing (EMNLP).

^* Equal authorship.

Preprints

Evaluating GPT-4 and ChatGPT on Japanese Medical Licensing Examinations

Jungo Kasai, Yuhei Kasai, Keisuke Sakaguchi, Yutaro Yamada, and Dragomir Radev. 2023. "Evaluating GPT-4 and ChatGPT on Japanese Medical Licensing Examinations." Under review.

Large Language Models as Tax Attorneys: A Case Study in Legal Capabilities Emergence

John J. Nay, David Karamardian, Sarah B. Lawsky, Wenting Tao, Meghana Bhat, Raghav Jain, Aaron Travis Lee, Jonathan H. Choi, and Jungo Kasai. 2023. "Large Language Models as Tax Attorneys: A Case Study in Legal Capabilities Emergence." Under review.

Batch Prompting: Efficient Inference with Large Language Model APIs

Zhoujun Cheng, Jungo Kasai, and Tao Yu. 2023. "Batch Prompting: Efficient Inference with Large Language Model APIs." Under review.

Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Models

Orevaoghene Ahia, Sachin Kumar, Hila Gonen, Jungo Kasai, David R. Mortensen, Noah A. Smith, and Yulia Tsvetkov. 2023. "Do All Languages Cost the Same? Tokenization in the Era of Commercial Language Models." Under review.

Beam Decoding with Controlled Patience

Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Dragomir Radev, Yejin Choi, and Noah A. Smith. 2022. "Beam Decoding with Controlled Patience." Under review.

FOLIO: Natural Language Reasoning with First-Order Logic

Simeng Han, Hailey Schoelkopf, Yilun Zhao, Zhenting Qi, Martin Riddell, Luke Benson, Lucy Sun, Ekaterina Zubova, Yujie Qiao, Matthew Burtell, David Peng, Jonathan Fan, Yixin Liu, Brian Wong, Malcolm Sailor, Ansong Ni, Linyong Nan, Jungo Kasai, Tao Yu, Rui Zhang, Shafiq Joty, Alexander R. Fabbri, Wojciech Kryscinski, Xi Victoria Lin, Caiming Xiong, and Dragomir Radev. 2022. "FOLIO: Natural Language Reasoning with First-Order Logic." Under review.

^* Equal authorship.

Refereed Workshop Publications

Cracking the Contextual Commonsense Code: Understanding Commonsense Reasoning Aptitude of Deep Contextual Representations

Jeff Da and Jungo Kasai. 2019. "Cracking the Contextual Commonsense Code: Understanding Commonsense Reasoning Aptitude of Deep Contextual Representations." In Proceedings of the Workshop on Commonsense Inference in Natural Language Processing (COIN).

Linguistically Rich Vector Representations of Supertags for TAG Parsing

Dan Friedman,^* Jungo Kasai,^* R. Thomas McCoy,^* Robert Frank, Owen Rambow, and Forrest Davis. 2017. "Linguistically Rich Vector Representations of Supertags for TAG Parsing." In Proceedings of the Workshop on Tree Adjoining Grammars and Related Formalisms (TAG+).

TAG Parsing Evaluation using Textual Entailment

Pauli Xu, Robert Frank, Jungo Kasai, and Owen Rambow. 2017. "TAG Parsing Evaluation using Textual Entailment." In Proceedings of the Workshop on Tree Adjoining Grammars and Related Formalisms (TAG+).

^* Equal authorship.

Other Publications (Work in Cardiology with My Brother, Yuhei Kasai, M.D.)

Successful Catheter Ablation for Verapamil-Sensitive Idiopathic Left Ventricular Tachycardia Guided by Dual Post-QRS Wave P1 Potentials After Catheter-Induced Mechanical Block

Yuhei Kasai, Takayuki Kitai, Junji Morita, Takuya Okada, Jungo Kasai, and Tsutomu Fujita. 2023. "Successful Catheter Ablation for Verapamil-Sensitive Idiopathic Left Ventricular Tachycardia Guided by Dual Post-QRS Wave P1 Potentials After Catheter-Induced Mechanical Block." Heart Rhythm Case Reports.

Lock and dock: Two-step transvenous retrieval of a fractured femoral sheath with a vascular snare via the right internal jugular vein

Yuhei Kasai, Jungo Kasai, Takuya Haraguchi, Takayuki Kitai, Junji Morita, Takuya Okadac, Masanaga Tsujimoto, and Tsutomu Fujita. 2023. "Lock and dock: Two-step transvenous retrieval of a fractured femoral sheath with a vascular snare via the right internal jugular vein." Journal of Cardiology Cases.

Iatrogenic Aortic Regurgitation After Catheter Ablation of Aortic Right-left Interleaflet Triangle

Takayuki Kitai, Yuhei Kasai, Jungo Kasai, Ryo Otake, Ryo Horita, Hidemasa Shitan, Junji Morita, and Tsutomu Fujita. 2023. "Iatrogenic Aortic Regurgitation After Catheter Ablation of Aortic Right-left Interleaflet Triangle." JACC Clinical Electrophysiology.

Silent steam pop detected by transesophageal echocardiography for premature ventricular contractions originating from the aortomitral continuity

Yuhei Kasai, Jungo Kasai, Takayuki Kitai, Ryo Horita, Junji Morita, and Tsutomu Fujita. 2023. "Silent steam pop detected by transesophageal echocardiography for premature ventricular contractions originating from the aortomitral continuity." Journal of Echocardiography.

Iatrogenic left ventricular pseudoaneurysm after successful radiofrequency catheter ablation for premature ventricular contraction originating from the posterior papillary muscles

Yuhei Kasai, Jungo Kasai, Takayuki Kitai, Junji Morita, and Tsutomu Fujita. 2022. "Iatrogenic left ventricular pseudoaneurysm after successful radiofrequency catheter ablation for premature ventricular contraction originating from the posterior papillary muscles." Circulation Journal.

Mediastinal Hematoma Associated With Radiofrequency Catheter Ablation of Atrial Fibrillation

Takayuki Kitai, Yuhei Kasai, Jungo Kasai, Junji Morita, and Tsutomu Fujita. 2022. "Mediastinal Hematoma Associated With Radiofrequency Catheter Ablation of Atrial Fibrillation." Circulation Journal.

Removing pericardial drainage tube for acute cardiac tamponade associated with catheter ablation of atrial fibrillation can trigger hemoperitoneum from severe liver bleeding

Yuhei Kasai, Jungo Kasai, So Asano, Takahiko Nagase, Yukio Sekiguchi, and Junichi Nitta. 2022. "Removing pericardial drainage tube for acute cardiac tamponade associated with catheter ablation of atrial fibrillation can trigger hemoperitoneum from severe liver bleeding." Heart Rhythm Case Reports.

Revisiting where to apply preimplant mapping to improve P-wave sensing of insertable cardiac monitors

Yuhei Kasai, Jungo Kasai, Syuichi Sahashi, Sandeep Shakya, Hiroki Kuji, Naoki Hayakawa, Kotaro Miyaji, and Junji Kanda. 2022. "Revisiting where to apply preimplant mapping to improve P-wave sensing of insertable cardiac monitors." Journal of Arrhythmia.

Idiopathic premature ventricular contractions originating from the distal Purkinje fiber network of the right bundle branch

Yuhei Kasai, Jungo Kasai, Yukio Sekiguchi, Takahiko Nagase, and Junichi Nitta. 2022. "Idiopathic premature ventricular contractions originating from the distal Purkinje fiber network of the right bundle branch." Journal of Arrhythmia.

Apple Watch facilitates single-session catheter ablation of coexisting atrioventricular nodal reentrant tachycardia and atrioventricular reentrant tachycardia

Yuhei Kasai, Jungo Kasai, Yukio Sekiguchi, So Asano, Hiroshi Fukunaga, Takahiko Nagase, and Junichi Nitta. 2021. "Apple Watch facilitates single-session catheter ablation of coexisting atrioventricular nodal reentrant tachycardia and atrioventricular reentrant tachycardia." Clinical Case Reports.