Stochastic Tokenization with a Language Model for Neural Text Classification. - Tatsuya Hiraoka; Hiroyuki Shindo; Yuji Matsumoto 001 (ACL (1), 2019)

Optimizing Word Segmentation for Downstream Task. - Tatsuya Hiraoka; Sho Takase; Kei Uchiumi; Atsushi Keyaki; Naoaki Okazaki (EMNLP (Findings), 2020)

Named Entity Recognition and Relation Extraction using Enhanced Table Filling by Contextualized Representations. - Youmi Ma; Tatsuya Hiraoka; Naoaki Okazaki (CoRR, 2020)

Joint Optimization of Tokenization and Downstream Model. - Tatsuya Hiraoka; Sho Takase; Kei Uchiumi; Atsushi Keyaki; Naoaki Okazaki (ACL/IJCNLP (Findings), 2021)

Joint Entity and Relation Extraction Based on Table Labeling Using Convolutional Neural Networks. - Youmi Ma; Tatsuya Hiraoka; Naoaki Okazaki (SPNLP@ACL, 2022)

Word-level Perturbation Considering Word Length and Compositional Subwords. - Tatsuya Hiraoka; Sho Takase; Kei Uchiumi; Atsushi Keyaki; Naoaki Okazaki (ACL (Findings), 2022)

Single Model Ensemble for Subword Regularized Models in Low-Resource Machine Translation. - Sho Takase; Tatsuya Hiraoka; Naoaki Okazaki (ACL (Findings), 2022)

MaxMatch-Dropout: Subword Regularization for WordPiece. - Tatsuya Hiraoka (COLING, 2022)

Recurrent Neural Hidden Markov Model for High-order Transition. - Tatsuya Hiraoka; Sho Takase; Kei Uchiumi; Atsushi Keyaki; Naoaki Okazaki (ACM Trans. Asian Low Resour. Lang. Inf. Process., 2022)

Vocabulary Replacement in SentencePiece for Domain Adaptation. - Teruno Kajiura; Shiho Takano; Tatsuya Hiraoka; Kimio Kuramitsu (PACLIC, 2023)

Downstream Task-Oriented Neural Tokenizer Optimization with Vocabulary Restriction as Post Processing. - Tatsuya Hiraoka; Tomoya Iwakura (CoRR, 2023)

Tokenization Tractability for Human and Machine Learning Model: An Annotation Study. - Tatsuya Hiraoka; Tomoya Iwakura (CoRR, 2023)

Knowledge of Pretrained Language Models on Surface Information of Tokens. - Tatsuya Hiraoka; Naoaki Okazaki (CoRR, 2024)

An Analysis of BPE Vocabulary Trimming in Neural Machine Translation. - Marco Cognetta; Tatsuya Hiraoka; Naoaki Okazaki; Rico Sennrich; Yuval Pinter (CoRR, 2024)

Constructing Multilingual Visual-Text Datasets Revealing Visual Multilingual Ability of Vision Language Models. - Jesse Atuhurra; Iqra Ali; Tatsuya Hiraoka; Hidetaka Kamigaito; Tomoya Iwakura; Taro Watanabe (CoRR, 2024)

LLM-jp: A Cross-organizational Project for the Research and Development of Fully Open Japanese LLMs. - Akiko Aizawa; Eiji Aramaki; Bowen Chen; Fei Cheng 002; Hiroyuki Deguchi 002; Rintaro Enomoto; Kazuki Fujii; Kensuke Fukumoto; Takuya Fukushima; Namgi Han; Yuto Harada; Chikara Hashimoto; et al. (CoRR, 2024)

Library-Like Behavior In Language Models is Enhanced by Self-Referencing Causal Cycles. - Munachiso Nwadike; Zangir Iklassov; Toluwani Aremu; Tatsuya Hiraoka; Benjamin Heinzerling; Velibor Bojkovic; Hilal AlQuabeh; Martin Takác 001; Kentaro Inui (ACL (1), 2025)

SubRegWeigh: Effective and Efficient Annotation Weighing with Subword Regularization. - Kohei Tsuji; Tatsuya Hiraoka; Yuchang Cheng; Tomoya Iwakura (COLING, 2025)

The Geometry of Numerical Reasoning: Language Models Compare Numeric Properties in Linear Subspaces. - Ahmed Oumar El-Shangiti; Tatsuya Hiraoka; Hilal AlQuabeh; Benjamin Heinzerling; Kentaro Inui (NAACL (Short Papers), 2025)

Repetition Neurons: How Do Language Models Produce Repetitions? - Tatsuya Hiraoka; Kentaro Inui (NAACL (Short Papers), 2025)

RECALL: Library-Like Behavior In Language Models is Enhanced by Self-Referencing Causal Cycles. - Munachiso Nwadike; Zangir Iklassov; Toluwani Aremu; Tatsuya Hiraoka; Velibor Bojkovic; Benjamin Heinzerling; Hilal Alqaubeh; Martin Takác 001; Kentaro Inui (CoRR, 2025)

Number Representations in LLMs: A Computational Parallel to Human Perception. - H. V. AlquBoj; Hilal AlQuabeh; Velibor Bojkovic; Tatsuya Hiraoka; Ahmed Oumar El-Shangiti; Munachiso Nwadike; Kentaro Inui (CoRR, 2025)

Investigating Neurons and Heads in Transformer-based LLMs for Typographical Errors. - Kohei Tsuji; Tatsuya Hiraoka; Yuchang Cheng; Eiji Aramaki; Tomoya Iwakura (CoRR, 2025)

Do LLMs Need to Think in One Language? Correlation between Latent Language and Task Performance. - Shintaro Ozaki; Tatsuya Hiraoka; Hiroto Otake; Hiroki Ouchi; Masaru Isonuma; Benjamin Heinzerling; Kentaro Inui; Taro Watanabe; Yusuke Miyao; Yohei Oseki; Yu Takagi (CoRR, 2025)

Bit-level BPE: Below the byte boundary. - Sangwhan Moon; Tatsuya Hiraoka; Naoaki Okazaki (CoRR, 2025)

Spelling-out is not Straightforward: LLMs' Capability of Tokenization from Token to Characters. - Tatsuya Hiraoka; Kentaro Inui (CoRR, 2025)

Understanding and Controlling Repetition Neurons and Induction Heads in In-Context Learning. - Nhi Hoai Doan; Tatsuya Hiraoka; Kentaro Inui (CoRR, 2025)