X(Twitter) / Google Scholar / Github / Huggingface
<aside> <img src="https://prod-files-secure.s3.us-west-2.amazonaws.com/7af8f684-8d20-4c20-a9b6-e6c975b8cb4c/f44c448b-c9eb-445b-8a71-5c84d57223ec/WX20240909-1323252x.png" alt="https://prod-files-secure.s3.us-west-2.amazonaws.com/7af8f684-8d20-4c20-a9b6-e6c975b8cb4c/f44c448b-c9eb-445b-8a71-5c84d57223ec/WX20240909-1323252x.png" width="40px" />
Nijika: Qingyu is an undergraduate student from Zhejiang University, class of 2022. He is pursuing a dual degree in English and Computer Science.
His research is centered on achieving efficiency ⚙️ and trustworthiness 🛡️ in machine learning models.
He is currently a research intern @Hedra. Before that , he was a research intern @Westlake University working ****with Linyi Yang @UCL , Jun Wang @UCL, and Yue Zhang @WestlakeNLP. He also collaborates closely with Qiang Zhang @ZJUI and @ZJUNLP.
</aside>
Constraining Alignment with Sparse AutoEncoders 🛡️ [ICML’25] ArXiv / Github / X(Twitter) Qingyu Yin*, Chak Tou Leong*, Hongbo Zhang, Minjun Zhu, Hanqi Yan, Qiang Zhang, Yulan He, Wenjie Li, Jun Wang, Yue Zhang, Linyi Yang
StableMask: Refining Causal Masking in Decoder-only Transformer ⚙️ [ICML'24] ArXiv / Github / X(Twitter) Qingyu Yin, Xuzheng He, Xiang Zhuang, Yu Zhao, Jianhua Yao, Xiaoyu Shen, Qiang Zhang
Deeper Insights Without Updates: The Power of In-Context Learning Over Fine-Tuning 🛡️ [EMNLP'24 Findings] ArXiv / Github / X(Twitter) Qingyu Yin, Xuzheng He, Chak Tou Leong, Fan Wang, Yanzhao Yan, Xiaoyu Shen, Qiang Zhang
Why Safeguarded Ships Run Aground? Aligned Large Language Models' Safety Mechanisms Tend to Be Anchored in The Template Region 🛡️ [ACL’25] ArXiv / Github / X(Twitter) / Project Page Chak Tou Leong, Qingyu Yin, Jian Wang, Wenjie Li
Balancing LoRA Performance and Efficiency with Simple Shard Sharing ⚙️ [Preprint] ArXiv / Github / X(Twitter) / Huggingface Jiale Kang, Qingyu Yin
Magic 1-For-1: Generating One Minute Video Clips within One Minute ⚙️ [Preprint] ArXiv / Github / X(Twitter) / Project Page Hongwei Yi, Shitong Shao, Tian Ye, Jiantong Zhao, Qingyu Yin, Michael Lingelbach, Li Yuan, Yonghong Tian, Enze Xie, Daquan Zhou
Awesome Undergraduate Research Award at ZJU (Grand Prize)
Zhejiang Province University Students Science and Technology Innovation Program (New Seed Talent Program)
2024.12
2024.04
https://embed.notionlytics.com/wt/ZXlKM2IzSnJjM0JoWTJWVWNtRmphMlZ5U1dRaU9pSnpiSHB2U21scmNVUnpOVnBhUVVWcldrUnJXU0lzSW5CaFoyVkpaQ0k2SW1VNE9HVm1NRGszTjJOak5UUXpNVE5oWlRRM05UWXpOR1kyWVdObVltRTBJbjA9
