X(Twitter) / Google Scholar / Github / Huggingface
<aside>
Qingyu is an undergraduate student from Zhejiang University, class of 2022.
I am actively working on (1) scaling foundational models and (2) building trustworthy methods.
</aside>
Conference Papers
Constraining Alignment with Sparse AutoEncoders [ICML’25] ArXiv / Github / X(Twitter) Qingyu Yin*, Chak Tou Leong*, Hongbo Zhang, Minjun Zhu, Hanqi Yan, Qiang Zhang, Yulan He, Wenjie Li, Jun Wang, Yue Zhang, Linyi Yang
StableMask: Refining Causal Masking in Decoder-only Transformer [ICML'24] ArXiv / Github / X(Twitter) Qingyu Yin, Xuzheng He, Xiang Zhuang, Yu Zhao, Jianhua Yao, Xiaoyu Shen, Qiang Zhang
Deeper Insights Without Updates: The Power of In-Context Learning Over Fine-Tuning [EMNLP'24 Findings] ArXiv / Github / X(Twitter) Qingyu Yin, Xuzheng He, Chak Tou Leong, Fan Wang, Yanzhao Yan, Xiaoyu Shen, Qiang Zhang
Why Safeguarded Ships Run Aground? Aligned Large Language Models' Safety Mechanisms Tend to Be Anchored in The Template Region [ACL’25 Oral] ArXiv / Github / X(Twitter) / Project Page Chak Tou Leong, Qingyu Yin, Jian Wang, Wenjie Li
ModRWKV: Transformer Multimodality in Linear Time [EMNLP’25 Oral] ArXiv / Github / X(Twitter) / Huggingface Jiale Kang*, Ziyin Yue*, Qingyu Yin*, Jiang Rui, Weile Li, Zening Lu, Zhouran Ji
Preprints
Refusal Falls off a Cliff: How Safety Alignment Fails in Reasoning Models [Preprint] ArXiv / Github / X(Twitter) Qingyu Yin, Chak Tou Leong, Linyi Yang, Wenxuan Huang, Wenjie Li, Xiting Wang, Jaehong Yoon, YunXing, XingYu, Jinjin Gu
Balancing LoRA Performance and Efficiency with Simple Shard Sharing [Preprint] ArXiv / Github / X(Twitter) / PEFT Jiale Kang, Qingyu Yin
Technical Reports
MagicInfinite: Generating Infinite Talking Videos with Your Words and Voice [Preprint] ArXiv / Github / X(Twitter) / Huggingface Hongwei Yi, Tian Ye, Shitong Shao, Xuancheng Yang, Jiantong Zhao, Hanzhong Guo, Terrance Wang, Qingyu Yin, Zeke Xie, Lei Zhu, Wei Li, Michael Lingelbach, Daquan Zhou
Ace Top Talent Internship Research Scientist, RedNote(Xiaohongshu Inc.) Hi Lab
Research Intern, Hedra Inc.
Research Intern, WestlakeNLP
Research Intern, ZJUKG
2025.07 - 2025.12
2024.10 - 2025.05
2024.07 - 2024.10
2023.05 - 2024.07
Awesome Undergraduate Research Award at ZJU (Grand Prize)
Zhejiang Province University New Seed Talent Program
2024.12
2024.04
https://embed.notionlytics.com/wt/ZXlKM2IzSnJjM0JoWTJWVWNtRmphMlZ5U1dRaU9pSnpiSHB2U21scmNVUnpOVnBhUVVWcldrUnJXU0lzSW5CaFoyVkpaQ0k2SW1VNE9HVm1NRGszTjJOak5UUXpNVE5oWlRRM05UWXpOR1kyWVdObVltRTBJbjA9