Lifu Huang

Computer Science Department,

UC Davis

Email: lfuhuang@ucdavis.edu

Davis, CA, US

Google Scholar

Github

Twitter



Selected Publications (Full Publications: Google Scholar)

2026

  1. Haibo Wang, Zihao Lin, Zhiyang Xu, Lifu Huang. Think, Act, Build: An Agentic Framework with Vision Language Models for Zero-Shot 3D Visual Grounding. In arXiv.
  2. Mohammad Beigi, Ming Jin, Junshan Zhang, Qifan Wang, Lifu Huang. Adversarial Reward Auditing for Active Detection and Mitigation of Reward Hacking. In arXiv.
  3. Mohammad Beigi, Ming Jin, Junshan Zhang, Jiaxin Zhang, Qifan Wang, Lifu Huang. IR^3: Contrastive Inverse Reinforcement Learning for Interpretable Detection and Mitigation of Reward Hacking. In arXiv.
  4. Yuexi Shen, Minqian Liu, Dawei Zhou, Lifu Huang. Navigating Ideation Space: Decomposed Conceptual Representations for Positioning Scientific Ideas. In arXiv.
  5. Zihao Lin, Haibo Wang, Zhiyang Xu, Siyao Dai, Huanjie Dong, Xiaohan Wang, Yolo Y Tang, Yixin Wang, Qifan Wang, Lifu Huang. GLANCE: A Global-Local Coordination Multi-Agent Framework for Music-Grounded Non-Linear Video Editing. In arXiv.

2025

  1. Mohammad Beigi, Ying Shen, Parshin Shojaee, QifanWang, ZichaoWang, Chandan K. Reddy, Ming Jin, Lifu Huang. Sycophancy Mitigation Through Reinforcement Learning with Uncertainty-Aware Adaptive Reasoning Trajectories. In the 2025 Conference on Empirical Methods in Natural Language Processing (EMNLP 2025).
  2. HaiboWang, Zhiyang Xu, Yu Cheng, Shizhe Diao, Yufan Zhou, Yixin Cao, QifanWang, Weifeng Ge, Lifu Huang. Grounded-VideoLLM: Sharpening Fine-grained Temporal Grounding in Video Large Language Models. In the 2025 Conference on Empirical Methods in Natural Language Processing (EMNLP 2025).
  3. Kaijie Chen, Zihao Lin, Zhiyang Xu, Ying Shen, Yuguang Yao, Joy Rimchala, Jiaxin Zhang, Lifu Huang. R2I-Bench: Benchmarking Reasoning-Driven Text-to-Image Generation. In the 2025 Conference on Empirical Methods in Natural Language Processing (EMNLP 2025).
  4. Jingyuan Qi, Zhiyang Xu, Qifan Wang, Lifu Huang. AR-RAG: Autoregressive Retrieval Augmentation for Image Generation. In The Thirty-ninth Annual Conference on Neural Information Processing Systems (NeurIPS'2025).
  5. Ying Shen, Lifu Huang. LLM Braces: Straightening Out LLM Predictions with Relevant Sub-Updates.. In The 63rd Annual Meeting of the Association for Computational Linguistics (ACL 2025).
  6. Zhiyang Xu, Minqian Liu, Ying Shen, Joy Rimchala, Jiaxin Zhang, Qifan Wang, Yu Cheng, Lifu Huang. Modality-Specialized Synergizers for Interleaved Vision-Language Generalists. ICLR'2025.
  7. Yue Zhang, Zhiyang Xu, Ying Shen, Parisa Kordjamshidi, Lifu Huang. Spartun3d: Situated spatial understanding of 3d world in large language models. ICLR'2025
  8. Jingyuan Qi, Zian Jia, Minqian Liu, Wangzhi Zhan, Junkai Zhang, Xiaofei Wen, Jingru Gan, Jianpeng Chen, Qin Liu, Mingyu Derek Ma, Bangzheng Li, Haohui Wang, Adithya Kulkarni, Muhao Chen, Dawei Zhou, Ling Li, Wei Wang, Lifu Huang. MetaScientist: A Human-AI Synergistic Framework for Automated Mechanical Metamaterial Design.. NAACL'2025, Demo Track.
  9. Minqian Liu, Zhiyang Xu, Xinyi Zhang, Heajun An, Sarvech Qadir, Qi Zhang, Pamela J Wisniewski, Jin-Hee Cho, Sang Won Lee, Ruoxi Jia, Lifu Huang. LLM Can be a Dangerous Persuader: Empirical Study of Persuasion Safety in Large Language Models.. In COLM'2025.

2024

  1. Zhiyang Xu, Chao Feng, Rulin Shao, Trevor Ashby, Ying Shen, Di Jin, Yu Cheng, Qifan Wang, Lifu Huang. Vision-Flan: Scaling Human-Labeled Tasks in Visual Instruction Tuning. In ACL'2024.
  2. Ying Shen, Zhiyang Xu, Qifan Wang, Yu Cheng, Wenpeng Yin, Lifu Huang. Multimodal Instruction Tuning with Conditional Mixture of LoRA. In ACL'2024.
  3. Zihao Lin, Mohammad Beigi, Hongxuan Li, Yufan Zhou, Yuxiang Zhang, Qifan Wang, Wenpeng Yin, Lifu Huang. Navigating the Dual Facets: A Comprehensive Evaluation of Sequential Memory Editing in Large Language Models . In ACL'2024.
  4. Minqian Liu, Zhiyang Xu, Zihao Lin, Trevor Ashby, Joy Rimchala, Jiaxin Zhang, Lifu Huang. Holistic Evaluation for Interleaved Text-and-Image Generation. In EMNLP'2024.
  5. Mohammad Beigi, Ying Shen, Runing Yang, Zihao Lin, Qifan Wang, Ankith Mohan, Jianfeng He, Ming Jin, Chang-Tien Lu, Lifu Huang. InternalInspector I^2: Robust Confidence Estimation in LLMs through Internal States. In EMNLP'2024.

2023

  1. Jingyuan Qi, Zhiyang Xu, Ying Shen, Minqian Liu, Di Jin, Qifan Wang, Lifu Huang. The Art of SOCRATIC QUESTIONING: Recursive Thinking with Large Language Models. In EMNLP'2023. [Project Page]
  2. Zhiyang Xu*, Ying Shen*, Lifu Huang. MultiInstruct: Improving Multi-Modal Zero-Shot Learning via Instruction Tuning. In ACL'23. Outstanding Paper Award [Project Page]
  3. Minqian Liu, Lifu Huang. Teamwork Is Not Always Good: An Empirical Study of Classifier Drift in Class-incremental Information Extraction. In ACL'23. [Project Page]
  4. Zhiyang Xu, Jay Yoon Lee and Lifu Huang. Learning from a Friend: Improving Event Extraction via Self-Training with Feedback from Abstract Meaning Representation. In ACL'23. [Project Page]
  5. Barry Menglong Yao, Aditya Shah, Lichao Sun, Jin-Hee Cho, Lifu Huang. End-to-End Multimodal Fact-Checking and Explanation Generation: A Challenging Dataset and Models. In The 46th International ACM SIGIR Conference on Research and Development in Information Retrieval. (SIGIR'2023) Best Paper Award Honorable Mention[Project Page]

2022

  1. Minqian Liu, Shiyu Chang, Lifu Huang. Incremental Prompting: Episodic Memory Prompt for Lifelong Event Detection. In Proceedings of the 29th International Conference On Computational Linguistics (COLING'2022). [Project Page]
  2. Sijia Wang, Mo Yu, Shiyu Chang, Lichao Sun, Lifu Huang. Query and Extract: Refining Event Extraction as Type-oriented Binary Decoding. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (ACL'2022). [Project Page]
  3. Zhe Hu, Hou Pong Chan and Lifu Huang A Multi-Task Training Approach for Long Text Generation from Cognitive Perspective. In The 2022 Conference on Empirical Methods in Natural Language Processing (EMNLP'2022).
  4. Zhe Hu, Hou Pong Chan, Jiachen Liu, Xinyan Xiao, Hua Wu, Lifu Huang. PLANET: Dynamic Content Planning in Autoregressive Transformers for Long-form Text Generation. In Proceedings of the 60th Annual Meeting of the Association for Computational Linguistics (ACL'2022). [Project Page], [Data], [Code]
  5. Shuaicheng Zhang, Lifu Huang, Qiang Ning. Extracting Temporal Event Relation with Syntactic-Guided Temporal Graph Transformer. In Proceedings of NAACL'2022. [Project Page]