Yixia Li (李乙侠)

Ph.D. Candidate at SUSTech

Efficient LLMs Controllable Generation Multi-Modal

👋 Hi there, I'm Yixia Li, a second-year Ph.D. student at SUSTech. My research interest mainly focuses on Efficient LLMs, Controllable Generation and Multi-Modal.

Latest News

[2025.05.26]
I will start my internship with the GenAI group at Microsoft Research Asia in June
[2025.05.15]
Two papers accepted to ACL 2025 (ImPart, FANNO)
[2025.01.23]
Two papers accepted to NAACL 2025 (MiLoRA, LayAlign)
[2024.11.29]
One paper accepted to TNNLS 2024 (UniPoll)
[2024.09.26]
One paper accepted to NeurIPS 2024 (SeTAR)
[2024.05.16]
One paper accepted to ACL 2024 (PACIT)
[2024.04.19]
One paper accepted to Journal of Language Resources and Evaluation (Cantonese NLP Survey)

Publications

ImPart Paper Image

ImPart: Importance-Aware Delta-Sparsification for Improved Model Compression and Merging in LLMs

Yan Yang*, Yixia Li*, Hongru Wang, Xuetao Wei, Jianqiao Yu, Yun Chen, Guanhua Chen
ACL 2025 Main (2025.05.15) | CCF-A
PDF
MiLoRA Paper Image

MiLoRA: Harnessing Minor Singular Components for Parameter-Efficient LLM Finetuning

Hanqing Wang, Yixia Li, Shuo Wang, Guanhua Chen, Yun Chen
NAACL 2025 Main (2025.01.23) | CCF-B
PDF Code OpenReview
LayAlign Paper Image

LayAlign: Enhancing Multilingual Reasoning in LLMs via Layer-Wise Adaptive Fusion...

Zhiwen Ruan*, Yixia Li*, He Zhu, Longyue Wang, Weihua Luo, Kaifu Zhang, Yun Chen, Guanhua Chen
NAACL 2025 Findings (2025.01.23)
PDF Code OpenReview
SeTAR Paper Image

SeTAR: Out-of-Distribution Detection with Selective Low-Rank Approximation

Yixia Li*, Boya Xiong*, Guanhua Chen, Yun Chen
NeurIPS 2024 (2024.09.26) | CCF-A
PDF Project Poster Code OpenReview
PACIT Paper Image

PACIT: Unlocking the Power of Examples for Better In-Context Instruction Tuning

Tianci Xue, Ziqi Wang, Yixia Li, Yun Chen, Guanhua Chen
ACL 2024 Findings (2024.05.16)
PDF Code Anthology
UniPoll Paper Image

UniPoll: A Unified Social Media Poll Generation Framework via Multi-Objective Optimization

Yixia Li, Rong Xiang, Yanlin Song, Jing Li
IEEE TNNLS (2024.11.29) | CCF-B
PDF Project Demo Code
Cantonese NLP Survey Image

Cantonese Natural Language Processing in the Transformers Era, Survey and Challenges

Rong Xiang, Emmanuele Chersoni, Yixia Li, Jing Li, Chu-Ren Huang
Journal of Language Resources and Evaluation (2024.06.08)
PDF
Electric Power Grid Paper Image

Electric Power Grid Invulnerability Under Intentional Edge-Based Attacks

Yixia Li, Shudong Li, Yanshan Chen, Peiyan He, Xiaobo Wu, Weihong Han
DependSys 2019 (2019.11.05)
PDF

Education

Southern University of Science and Technology

Sept 2023 - July 2027

Ph.D. Candidate

Department of Statistics

Supervisor: Dr. Guanhua Chen

The Hong Kong Polytechnic University

Sept 2021 - July 2023

M.Sc. in Data Science with Distinction

Department of Applied Mathematics

Rank: Top 5%; GPA: 3.8/4.0

Guangzhou University

Sept 2017 - Jun 2021

B.Sc. in Statistics

Department of Statistics

Rank: Top 5%; GPA: 3.7/4.0

Research Experience

Microsoft Research Asia

June 2025 - Now

Research Internship

Supervisor: Dr. Dongdong Zhang

  • Efficient Large Language Models
  • Reasoning Models

PolyU SMART Lab

Feb 2022 - Jan 2023

Research Assistant

Supervisor: Dr. Jing Li

  • Automatic Poll Generation for Social Media Posts [Project]
  • Task-oriented Dialogue System Development [Demo]

Huawei AARC Dept

June 2022 - Aug 2022

Research Internship

Supervisor: Jingyuan Yang

  • Extractive Long Document Q&A
  • Knowledge-enhanced Dialogue System
  • Chinese ASR Entity Correction

Academic Services

Reviewer: ACL Rolling Review (ARR)

Reviewer: Conference on Neural Information Processing Systems (NeurIPS)

Reviewer: IEEE Transactions on Neural Networks and Learning Systems (TNNLS)

Reviewer: International Conference on Natural Language Processing and Chinese Computing (NLPCC)

Honors and Awards

[2023.09] Dean’s Honors List (Postgraduate) (Top 5%)

[2020.12] National Scholarship (Undergraduate) (Top 1%)

[2020.11] Outstanding Student (Undergraduate) (Top 5%)