Improving Adversarial Transferability via Neuron Attribution-based Attacks. - Jianping Zhang 002; Weibin Wu 002; Jen-tse Huang 001; Yizhan Huang; Wenxuan Wang 001; Yuxin Su 001; Michael R. Lyu (CVPR, 2022)

AEON: a method for automatic evaluation of NLP test cases. - Jen-tse Huang 001; Jianping Zhang 002; Wenxuan Wang 001; Pinjia He; Yuxin Su 001; Michael R. Lyu (ISSTA, 2022)

Tencent's Multilingual Machine Translation System for WMT22 Large-Scale African Languages. - Wenxiang Jiao; Zhaopeng Tu; Jiarui Li; Wenxuan Wang 001; Jen-tse Huang 001; Shuming Shi 001 (WMT, 2022)

Improving the Transferability of Adversarial Samples by Path-Augmented Method. - Jianping Zhang 002; Jen-tse Huang 001; Wenxuan Wang 001; Yichen Li 003; Weibin Wu 002; Xiaosen Wang; Yuxin Su 001; Michael R. Lyu (CVPR, 2023)

ParroT: Translating during Chat using Large Language Models tuned with Human Translation and Feedback. - Wenxiang Jiao; Jen-tse Huang 001; Wenxuan Wang 001; Zhiwei He 002; Tian Liang; Xing Wang 007; Shuming Shi 001; Zhaopeng Tu (EMNLP (Findings), 2023)

MTTM: Metamorphic Testing for Textual Content Moderation Software. - Wenxuan Wang 001; Jen-tse Huang 001; Weibin Wu 002; Jianping Zhang 002; Yizhan Huang; Shuqing Li 001; Pinjia He; Michael R. Lyu (ICSE, 2023)

An Image is Worth a Thousand Toxic Words: A Metamorphic Testing Framework for Content Moderation Software. - Wenxuan Wang 001; Jingyuan Huang; Jen-tse Huang 001; Chang Chen; Jiazhen Gu; Pinjia He; Michael R. Lyu (ASE, 2023)

Is ChatGPT A Good Translator? A Preliminary Study. - Wenxiang Jiao; Wenxuan Wang 001; Jen-tse Huang 001; Xing Wang 007; Zhaopeng Tu (CoRR, 2023)

ParroT: Translating During Chat Using Large Language Models. - Wenxiang Jiao; Jen-tse Huang 001; Wenxuan Wang 001; Xing Wang 007; Shuming Shi 001; Zhaopeng Tu (CoRR, 2023)

ChatGPT an ENFJ, Bard an ISTJ: Empirical Study on Personalities of Large Language Models. - Jen-tse Huang 001; Wenxuan Wang 001; Man Ho Lam; Eric John Li; Wenxiang Jiao; Michael R. Lyu (CoRR, 2023)

Emotionally Numb or Empathetic? Evaluating How LLMs Feel Using EmotionBench. - Jen-tse Huang 001; Man Ho Lam; Eric John Li; Shujie Ren; Wenxuan Wang 001; Wenxiang Jiao; Zhaopeng Tu; Michael R. Lyu (CoRR, 2023)

All Languages Matter: On the Multilingual Safety of Large Language Models. - Wenxuan Wang 001; Zhaopeng Tu; Chang Chen; Youliang Yuan; Jen-tse Huang 001; Wenxiang Jiao; Michael R. Lyu (CoRR, 2023)

Who is ChatGPT? Benchmarking LLMs' Psychological Portrayal Using PsychoBench. - Jen-tse Huang 001; Wenxuan Wang 001; Eric John Li; Man Ho Lam; Shujie Ren; Youliang Yuan; Wenxiang Jiao; Zhaopeng Tu; Michael R. Lyu (CoRR, 2023)

Leveraging Word Guessing Games to Assess the Intelligence of Large Language Models. - Tian Liang; Zhiwei He 002; Jen-tse Huang 001; Wenxuan Wang 001; Wenxiang Jiao; Rui Wang 015; Yujiu Yang; Zhaopeng Tu; Shuming Shi 001; Xing Wang 007 (CoRR, 2023)

Not All Countries Celebrate Thanksgiving: On the Cultural Dominance in Large Language Models. - Wenxuan Wang 001; Wenxiang Jiao; Jingyuan Huang; Ruyi Dai; Jen-tse Huang 001; Zhaopeng Tu; Michael R. Lyu (ACL (1), 2024)

All Languages Matter: On the Multilingual Safety of LLMs. - Wenxuan Wang 001; Zhaopeng Tu; Chang Chen; Youliang Yuan; Jen-tse Huang 001; Wenxiang Jiao; Michael R. Lyu (ACL (Findings), 2024)

InCharacter: Evaluating Personality Fidelity in Role-Playing Agents through Psychological Interviews. - Xintao Wang 001; Yunze Xiao; Jen-tse Huang 001; Siyu Yuan; Rui Xu 026; Haoran Guo; Quan Tu; Yaying Fei; Ziang Leng; Wei Wang 009; Jiangjie Chen; Cheng Li; et al. (ACL (1), 2024)

On the Reliability of Psychological Scales on Large Language Models. - Jen-tse Huang 001; Wenxiang Jiao; Man Ho Lam; Eric John Li; Wenxuan Wang 001; Michael R. Lyu (EMNLP, 2024)

InterIntent: Investigating Social Intelligence of LLMs via Intention Understanding in an Interactive Game Context. - Ziyi Liu; Abhishek Anand; Pei Zhou; Jen-tse Huang 001; Jieyu Zhao 001 (EMNLP, 2024)

LogicAsker: Evaluating and Improving the Logical Reasoning Ability of Large Language Models. - Yuxuan Wan; Wenxuan Wang 001; Yiliu Yang; Youliang Yuan; Jen-tse Huang 001; Pinjia He; Wenxiang Jiao; Michael R. Lyu (EMNLP, 2024)

On the Humanity of Conversational AI: Evaluating the Psychological Portrayal of LLMs. - Jen-tse Huang 001; Wenxuan Wang 001; Eric John Li; Man Ho Lam; Shujie Ren; Youliang Yuan; Wenxiang Jiao; Zhaopeng Tu; Michael R. Lyu (ICLR, 2024)

GPT-4 Is Too Smart To Be Safe: Stealthy Chat with LLMs via Cipher. - Youliang Yuan; Wenxiang Jiao; Wenxuan Wang 001; Jen-tse Huang 001; Pinjia He; Shuming Shi 001; Zhaopeng Tu (ICLR, 2024)

New Job, New Gender? Measuring the Social Bias in Image Generation Models. - Wenxuan Wang 001; Haonan Bai; Jen-tse Huang 001; Yuxuan Wan; Youliang Yuan; Haoyi Qiu; Nanyun Peng 001; Michael R. Lyu (ACM Multimedia, 2024)

Apathetic or Empathetic? Evaluating LLMs' Emotional Alignments with Humans. - Jen-tse Huang 001; Man Ho Lam; Eric John Li; Shujie Ren; Wenxuan Wang 001; Wenxiang Jiao; Zhaopeng Tu; Michael R. Lyu (NeurIPS, 2024)

A & B == B & A: Triggering Logical Reasoning Failures in Large Language Models. - Yuxuan Wan; Wenxuan Wang 001; Yiliu Yang; Youliang Yuan; Jen-tse Huang 001; Pinjia He; Wenxiang Jiao; Michael R. Lyu (CoRR, 2024)

The Earth is Flat? Unveiling Factual Errors in Large Language Models. - Wenxuan Wang 001; Juluan Shi; Zhaopeng Tu; Youliang Yuan; Jen-tse Huang 001; Wenxiang Jiao; Michael R. Lyu (CoRR, 2024)

How Far Are We on the Decision-Making of LLMs? Evaluating LLMs' Gaming Ability in Multi-Agent Environments. - Jen-tse Huang 001; Eric John Li; Man Ho Lam; Tian Liang; Wenxuan Wang 001; Youliang Yuan; Wenxiang Jiao; Xing Wang 007; Zhaopeng Tu; Michael R. Lyu (CoRR, 2024)

How Well Can LLMs Echo Us? Evaluating AI Chatbots' Role-Play Ability with ECHO. - Man Tik Ng; Hui Tung Tse; Jen-tse Huang 001; Jingjing Li 007; Wenxuan Wang 001; Michael R. Lyu (CoRR, 2024)

A Unified Debugging Approach via LLM-Based Multi-Agent Synergy. - Cheryl Lee; Chunqiu Steven Xia; Jen-tse Huang 001; Zhouruixin Zhu; Lingming Zhang 001; Michael R. Lyu (CoRR, 2024)

On the Resilience of Multi-Agent Systems with Malicious Agents. - Jen-tse Huang 001; Jiaxu Zhou; Tailin Jin; Xuhui Zhou; Zixi Chen; Wenxuan Wang 001; Youliang Yuan; Maarten Sap; Michael R. Lyu (CoRR, 2024)

Learning to Ask: When LLMs Meet Unclear Instruction. - Wenxuan Wang 001; Juluan Shi; Chaozheng Wang; Cheryl Lee; Youliang Yuan; Jen-tse Huang 001; Michael R. Lyu (CoRR, 2024)

Chain-of-Jailbreak Attack for Image Generation Models via Editing Step by Step. - Wenxuan Wang 001; Kuiyi Gao; Zihan Jia; Youliang Yuan; Jen-tse Huang 001; Qiuzhi Liu; Shuai Wang 011; Wenxiang Jiao; Zhaopeng Tu (CoRR, 2024)

InstantIR: Blind Image Restoration with Instant Generative Reference. - Jen-Yuan Huang; Haofan Wang; Qixun Wang 001; Xu Bai; Hao Ai; Peng Xing; Jen-Tse Huang 001 (CoRR, 2024)

Chain-of-Jailbreak Attack for Image Generation Models via Step by Step Editing. - Wenxuan Wang 001; Kuiyi Gao; Youliang Yuan; Jen-tse Huang 001; Qiuzhi Liu; Shuai Wang 001; Wenxiang Jiao; Zhaopeng Tu (ACL (Findings), 2025)

Can't See the Forest for the Trees: Benchmarking Multimodal Safety Awareness for Multimodal LLMs. - Wenxuan Wang 001; Xiaoyuan Liu; Kuiyi Gao; Jen-tse Huang 001; Youliang Yuan; Pinjia He; Shuai Wang 011; Zhaopeng Tu (ACL (1), 2025)

Insight Over Sight: Exploring the Vision-Knowledge Conflicts in Multimodal LLMs. - Xiaoyuan Liu; Wenxuan Wang 001; Youliang Yuan; Jen-tse Huang 001; Qiuzhi Liu; Pinjia He; Zhaopeng Tu (ACL (1), 2025)

Refuse Whenever You Feel Unsafe: Improving Safety in LLMs via Decoupled Refusal Training. - Youliang Yuan; Wenxiang Jiao; Wenxuan Wang 001; Jen-tse Huang 001; Jiahao Xu; Tian Liang; Pinjia He; Zhaopeng Tu (ACL (1), 2025)

Competing Large Language Models in Multi-Agent Gaming Environments. - Jen-tse Huang 001; Eric John Li; Man Ho Lam; Tian Liang; Wenxuan Wang 001; Youliang Yuan; Wenxiang Jiao; Xing Wang 007; Zhaopeng Tu; Michael R. Lyu (ICLR, 2025)

On the shortcut learning in multilingual neural machine translation. - Wenxuan Wang 001; Wenxiang Jiao; Jen-tse Huang 001; Zhaopeng Tu; Michael R. Lyu (Neurocomputing, 2025)

FairCode: Evaluating Social Bias of LLMs in Code Generation. - Yongkang Du; Jen-tse Huang 001; Jieyu Zhao 001; Lu Lin (CoRR, 2025)

Fact-or-Fair: A Checklist for Behavioral Testing of AI Models on Fairness-Related Queries. - Jen-tse Huang 001; Yuhang Yan 002; Linqi Liu; Yixin Wan; Wenxuan Wang 001; Kai-Wei Chang; Michael R. Lyu (CoRR, 2025)

CoSER: Coordinating LLM-Based Persona Simulation of Established Roles. - Xintao Wang 001; Heng Wang; Yifei Zhang; Xinfeng Yuan; Rui Xu 026; Jen-tse Huang 001; Siyu Yuan; Haoran Guo; Jiangjie Chen; Wei Wang 009; Yanghua Xiao; Shuchang Zhou 003 (CoRR, 2025)

VLMs as GeoGuessr Masters: Exceptional Performance, Hidden Biases, and Privacy Risks. - Jingyuan Huang; Jen-tse Huang 001; Ziyi Liu; Xiaoyuan Liu; Wenxuan Wang 001; Jieyu Zhao 001 (CoRR, 2025)

VisFactor: Benchmarking Fundamental Visual Cognition in Multimodal Large Language Models. - Jen-tse Huang 001; Dasen Dai; Jen-Yuan Huang; Youliang Yuan; Xiaoyuan Liu; Wenxuan Wang 001; Wenxiang Jiao; Pinjia He; Zhaopeng Tu (CoRR, 2025)

VisBias: Measuring Explicit and Implicit Social Biases in Vision Language Models. - Jen-tse Huang 001; Jiantong Qin; Jianping Zhang 002; Youliang Yuan; Wenxuan Wang 001; Jieyu Zhao 001 (CoRR, 2025)

Can LLMs Grasp Implicit Cultural Values? Benchmarking LLMs' Metacognitive Cultural Intelligence with CQ-Bench. - Ziyi Liu; Priyanka Dey; Zhenyu Zhao; Jen-tse Huang 001; Rahul Gupta; Yang Liu 084; Jieyu Zhao 001 (CoRR, 2025)

BIASINSPECTOR: Detecting Bias in Structured Data through LLM Agents. - Haoxuan Li; Mingyu Derek Ma; Jen-tse Huang 001; Zhaotian Weng; Wei Wang 010; Jieyu Zhao 001 (CoRR, 2025)

CODECRASH: Stress Testing LLM Reasoning under Structural and Semantic Perturbations. - Man Ho Lam; Chaozheng Wang; Jen-tse Huang 001; Michael R. Lyu (CoRR, 2025)

A Comprehensive Survey in LLM(-Agent) Full Stack Safety: Data, Training and Deployment. - Kun Wang 056; Guibin Zhang; Zhenhong Zhou; Jiahao Wu; Miao Yu; Shiqian Zhao; Chenlong Yin; Jinhu Fu; Yibo Yan; Hanjun Luo; Liang Lin; Zhihao Xu; et al. (CoRR, 2025)

SOTOPIA-S4: a user-friendly system for flexible, customizable, and large-scale social simulation. - Xuhui Zhou; Zhe Su; Sophie Feng; Jiaxu Zhou; Jen-tse Huang 001; Hsien-Te Kao; Spencer Lynch; Svitlana Volkova; Tongshuang Sherry Wu; Anita Woolley; Hao Zhu 011; Maarten Sap (CoRR, 2025)

A Survey on the Safety and Security Threats of Computer-Using Agents: JARVIS or Ultron? - Ada Chen; Yongjiang Wu; Junyuan Zhang; Jingyu Xiao; Shu Yang 010; Jen-tse Huang 001; Kun Wang 056; Wenxuan Wang 001; Shuai Wang 011 (CoRR, 2025)

Towards Evaluating Proactive Risk Awareness of Multimodal Language Models. - Youliang Yuan; Wenxiang Jiao; Yuejin Xie; Chihao Shen; Menghan Tian; Wenxuan Wang 001; Jen-tse Huang 001; Pinjia He (CoRR, 2025)