Forgetting Curve: A Reliable Method for Evaluating Memorization Capability for Long-Context Models. - Xinyu Liu; Runsong Zhao; Pengcheng Huang 004; Chunyang Xiao; Bei Li; Jingang Wang; Tong Xiao; JingBo Zhu (EMNLP, 2024)

More Effective LLM Compressed Tokens with Uniformly Spread Position Identifiers and Compression Loss. - Runsong Zhao; Pengcheng Huang 004; Xinyu Liu; Chunyang Xiao; Tong Xiao; Jingbo Zhu (CoRR, 2024)