Source-side Prediction for Neural Headline Generation. - Shun Kiyono; Sho Takase; Jun Suzuki 001; Naoaki Okazaki; Kentaro Inui; Masaaki Nagata (CoRR, 2017)

Unsupervised Token-wise Alignment to Improve Interpretation of Encoder-Decoder Models. - Shun Kiyono; Sho Takase; Jun Suzuki 001; Naoaki Okazaki; Kentaro Inui; Masaaki Nagata (BlackboxNLP@EMNLP, 2018)

Reducing Odd Generation from Neural Headline Generation. - Shun Kiyono; Sho Takase; Jun Suzuki 001; Naoaki Okazaki; Kentaro Inui; Masaaki Nagata (PACLIC, 2018)

Mixture of Expert/Imitator Networks: Scalable Semi-Supervised Learning Framework. - Shun Kiyono; Jun Suzuki 001; Kentaro Inui (AAAI, 2019)

Effective Adversarial Regularization for Neural Machine Translation. - Motoki Sato; Jun Suzuki 001; Shun Kiyono (ACL (1), 2019)

An Empirical Study of Incorporating Pseudo Data into Grammatical Error Correction. - Shun Kiyono; Jun Suzuki 001; Masato Mita; Tomoya Mizumoto; Kentaro Inui (EMNLP/IJCNLP (1), 2019)

ESPnet How2 Speech Translation System for IWSLT 2019: Pre-training, Knowledge Distillation, and Going Deeper. - Hirofumi Inaguma; Shun Kiyono; Nelson Enrique Yalta Soplin; Jun Suzuki 001; Kevin Duh; Shinji Watanabe 001 (IWSLT, 2019)

Riposte! A Large Corpus of Counter-Arguments. - Paul Reisert; Benjamin Heinzerling; Naoya Inoue; Shun Kiyono; Kentaro Inui (CoRR, 2019)

ESPnet-ST: All-in-One Speech Translation Toolkit. - Hirofumi Inaguma; Shun Kiyono; Kevin Duh; Shigeki Karita; Nelson Yalta; Tomoki Hayashi; Shinji Watanabe 001 (ACL (demo), 2020)

Encoder-Decoder Models Can Benefit from Pre-trained Masked Language Models in Grammatical Error Correction. - Masahiro Kaneko; Masato Mita; Shun Kiyono; Jun Suzuki 001; Kentaro Inui (ACL, 2020)

An Empirical Study of Contextual Data Augmentation for Japanese Zero Anaphora Resolution. - Ryuto Konno; Yuichiroh Matsubayashi; Shun Kiyono; Hiroki Ouchi; Ryo Takahashi; Kentaro Inui (COLING, 2020)

A Self-Refinement Strategy for Noise Reduction in Grammatical Error Correction. - Masato Mita; Shun Kiyono; Masahiro Kaneko; Jun Suzuki 001; Kentaro Inui (EMNLP (Findings), 2020)

Tohoku-AIP-NTT at WMT 2020 News Translation Task. - Shun Kiyono; Takumi Ito; Ryuto Konno; Makoto Morishita; Jun Suzuki 001 (WMT@EMNLP, 2020)

Massive Exploration of Pseudo Data for Grammatical Error Correction. - Shun Kiyono; Jun Suzuki 001; Tomoya Mizumoto; Kentaro Inui (IEEE ACM Trans. Audio Speech Lang. Process., 2020)

SHAPE : Shifted Absolute Position Embedding for Transformers. - Shun Kiyono; Sosuke Kobayashi; Jun Suzuki 001; Kentaro Inui (EMNLP (1), 2021)

Pseudo Zero Pronoun Resolution Improves Zero Anaphora Resolution. - Ryuto Konno; Shun Kiyono; Yuichiroh Matsubayashi; Hiroki Ouchi; Kentaro Inui (EMNLP (1), 2021)

Rethinking Perturbations in Encoder-Decoders for Fast Training. - Sho Takase; Shun Kiyono (NAACL-HLT, 2021)

NT5 at WMT 2022 General Translation Task. - Makoto Morishita; Keito Kudo; Yui Oka; Katsuki Chousa; Shun Kiyono; Sho Takase; Jun Suzuki 001 (WMT, 2022)

Diverse Lottery Tickets Boost Ensemble from a Single Pretrained Model. - Sosuke Kobayashi; Shun Kiyono; Jun Suzuki 001; Kentaro Inui (CoRR, 2022)

On Layer Normalizations and Residual Connections in Transformers. - Sho Takase; Shun Kiyono; Sosuke Kobayashi; Jun Suzuki 001 (CoRR, 2022)

B2T Connection: Serving Stability and Performance in Deep Transformers. - Sho Takase; Shun Kiyono; Sosuke Kobayashi; Jun Suzuki 001 (ACL (Findings), 2023)

Bridging the Gap between Subword and Character Segmentation in Pretrained Language Models. - Shun Kiyono; Sho Takase; Shengzhe Li; Toshinori Sato (RANLP, 2023)

Lessons on Parameter Sharing across Layers in Transformers. - Sho Takase; Shun Kiyono (SustaiNLP, 2023)

Spike No More: Stabilizing the Pre-training of Large Language Models. - Sho Takase; Shun Kiyono; Sosuke Kobayashi; Jun Suzuki 001 (CoRR, 2023)

Self-Translate-Train: A Simple but Strong Baseline for Cross-lingual Transfer of Large Language Models. - Ryokan Ri; Shun Kiyono; Sho Takase (CoRR, 2024)

Large Vocabulary Size Improves Large Language Models. - Sho Takase; Ryokan Ri; Shun Kiyono; Takuya Kato (ACL (Findings), 2025)

Efficient Construction of Model Family through Progressive Training Using Model Expansion. - Kazuki Yano; Sho Takase; Sosuke Kobayashi; Shun Kiyono; Jun Suzuki 001 (CoRR, 2025)