X(Twitter) / Google Scholar / Github / Huggingface
<aside> <img src="https://prod-files-secure.s3.us-west-2.amazonaws.com/7af8f684-8d20-4c20-a9b6-e6c975b8cb4c/f44c448b-c9eb-445b-8a71-5c84d57223ec/WX20240909-1323252x.png" alt="https://prod-files-secure.s3.us-west-2.amazonaws.com/7af8f684-8d20-4c20-a9b6-e6c975b8cb4c/f44c448b-c9eb-445b-8a71-5c84d57223ec/WX20240909-1323252x.png" width="40px" />
Nijika: Qingyu is an undergraduate student from Zhejiang University, class of 2022. He is pursuing a dual degree in English and Computer Science. His research is centered on achieving efficiency and trustworthiness in machine learning models.
</aside>
Conference Papers
Constraining Alignment with Sparse AutoEncoders [ICML’25] ArXiv / Github / X(Twitter) Qingyu Yin*, Chak Tou Leong*, Hongbo Zhang, Minjun Zhu, Hanqi Yan, Qiang Zhang, Yulan He, Wenjie Li, Jun Wang, Yue Zhang, Linyi Yang
StableMask: Refining Causal Masking in Decoder-only Transformer [ICML'24] ArXiv / Github / X(Twitter) Qingyu Yin, Xuzheng He, Xiang Zhuang, Yu Zhao, Jianhua Yao, Xiaoyu Shen, Qiang Zhang
Deeper Insights Without Updates: The Power of In-Context Learning Over Fine-Tuning [EMNLP'24 Findings] ArXiv / Github / X(Twitter) Qingyu Yin, Xuzheng He, Chak Tou Leong, Fan Wang, Yanzhao Yan, Xiaoyu Shen, Qiang Zhang
Why Safeguarded Ships Run Aground? Aligned Large Language Models' Safety Mechanisms Tend to Be Anchored in The Template Region [ACL’25 Oral] ArXiv / Github / X(Twitter) / Project Page Chak Tou Leong, Qingyu Yin, Jian Wang, Wenjie Li
Preprints
Balancing LoRA Performance and Efficiency with Simple Shard Sharing [Preprint] ArXiv / Github / X(Twitter) / PEFT Jiale Kang, Qingyu Yin
ModRWKV: Transformer Multimodality in Linear Time [Preprint] ArXiv / Github / X(Twitter) / Huggingface Jiale Kang*, Ziyin Yue*, Qingyu Yin*, Jiang Rui, Weile Li, Zening Lu, Zhouran Ji
Technical Reports
MagicInfinite: Generating Infinite Talking Videos with Your Words and Voice [Preprint] ArXiv / Github / X(Twitter) / Huggingface Hongwei Yi, Tian Ye, Shitong Shao, Xuancheng Yang, Jiantong Zhao, Hanzhong Guo, Terrance Wang, Qingyu Yin, Zeke Xie, Lei Zhu, Wei Li, Michael Lingelbach, Daquan Zhou
Awesome Undergraduate Research Award at ZJU (Grand Prize)
Zhejiang Province University Students Science and Technology Innovation Program (New Seed Talent Program)
2024.12
2024.04
https://embed.notionlytics.com/wt/ZXlKM2IzSnJjM0JoWTJWVWNtRmphMlZ5U1dRaU9pSnpiSHB2U21scmNVUnpOVnBhUVVWcldrUnJXU0lzSW5CaFoyVkpaQ0k2SW1VNE9HVm1NRGszTjJOak5UUXpNVE5oWlRRM05UWXpOR1kyWVdObVltRTBJbjA9
