A pre-training technique to localize medical BERT and enhance BioBERT. - Shoya Wada; Toshihiro Takeda; Shiro Manabe; Shozo Konishi; Jun Kamohara; Yasushi Matsumura (CoRR, 2020)

Oversampling effect in pretraining for bidirectional encoder representations from transformers (BERT) to localize medical BERT and enhance biomedical BERT. - Shoya Wada; Toshihiro Takeda; Katsuki Okada; Shirou Manabe; Shozo Konishi; Jun Kamohara; Yasushi Matsumura (Artif. Intell. Medicine, 2024)