X(Twitter) / Zhihu / Google Scholar / Github / Huggingface / CV
<aside> <img src="https://prod-files-secure.s3.us-west-2.amazonaws.com/7af8f684-8d20-4c20-a9b6-e6c975b8cb4c/f44c448b-c9eb-445b-8a71-5c84d57223ec/WX20240909-1323252x.png" alt="https://prod-files-secure.s3.us-west-2.amazonaws.com/7af8f684-8d20-4c20-a9b6-e6c975b8cb4c/f44c448b-c9eb-445b-8a71-5c84d57223ec/WX20240909-1323252x.png" width="40px" />
Nijika: Qingyu is an undergraduate student from Zhejiang University, class of 2022. He is currently pursuing a dual degree in English and Computer Science.
He is also a research intern @Hedra where he is in charge of fundamental model development and pretraining.
</aside>
<aside> <img src="https://prod-files-secure.s3.us-west-2.amazonaws.com/7af8f684-8d20-4c20-a9b6-e6c975b8cb4c/f44c448b-c9eb-445b-8a71-5c84d57223ec/WX20240909-1323252x.png" alt="https://prod-files-secure.s3.us-west-2.amazonaws.com/7af8f684-8d20-4c20-a9b6-e6c975b8cb4c/f44c448b-c9eb-445b-8a71-5c84d57223ec/WX20240909-1323252x.png" width="40px" />
Nijika: His research interests and works lie at building:
September 10, 2024 One paper accepted by EMNLP’24 as Findings!
July 23, 2024 Attending ICML’24 to share our poster!
May 1, 2024 Our paper StableMask has been accepted by ICML'24!
<aside> <img src="https://prod-files-secure.s3.us-west-2.amazonaws.com/7af8f684-8d20-4c20-a9b6-e6c975b8cb4c/f44c448b-c9eb-445b-8a71-5c84d57223ec/WX20240909-1323252x.png" alt="https://prod-files-secure.s3.us-west-2.amazonaws.com/7af8f684-8d20-4c20-a9b6-e6c975b8cb4c/f44c448b-c9eb-445b-8a71-5c84d57223ec/WX20240909-1323252x.png" width="40px" />
Nijika: Here check the newest ones!→ 📖 Google Scholar (Recommended)
</aside>
StableMask: Refining Causal Masking in Decoder-only Transformer [ICML'24] Qingyu Yin, Xuzheng He, Xiang Zhuang, Yu Zhao, Jianhua Yao, Xiaoyu Shen, Qiang Zhang
****ArXiv / Github / X(Twitter)
Deeper Insights Without Updates: The Power of In-Context Learning Over Fine-Tuning [EMNLP'24 Findings] Qingyu Yin, Xuzheng He, Chak Tou Leong, Fan Wang, Yanzhao Yan, Xiaoyu Shen, Qiang Zhang
****ArXiv / Github / X(Twitter)
Direct Preference Optimization Using Sparse Feature-level Constraints [Preprint] Qingyu Yin*, Chak Tou Leong*, Hongbo Zhang, Minjun Zhu, Hanqi Yan, Qiang Zhang, Yulan He, Wenjie Li, Jun Wang, Yue Zhang, Linyi Yang
****ArXiv / Github / X(Twitter)
Scientific Large Language Models: A Survey on Biochemical Domain [Preprint] Qiang Zhang*, Keyan Ding*, Tianwen Lyu, Xinda Wang, Qingyu Yin, Yiwen Zhang, Jing Yu, Zhouyi Xiang, Xiang Zhuang, Zeyuan Wang, Mengyao Zhang, Ming Qin, Renjun Xu, Huajun Chen†
ArXiv / Github / X(Twitter)
MMM: Multilingual Mutual Reinforcement Effect Mix Datasets & Test with Open-domain Information Extraction Large Language Models [Preprint] Chengguang Gan, Qingyu Yin, Xinyang He, Hanjun Wei, Yunhao Liang, Younghun Lim, Shijian Wang, Hexiang Huang, Qinghao Zhang, Shiwen Ni, Tatsunori Mori
****ArXiv / Github / X(Twitter)
April 1, 2023 → June 1, 2026 ZJUNLP (ZJUKG) [Research Intern]
July 1, 2024 → May 1, 2025 Hedra Inc. [Research Intern]
July 1, 2024 → October 1, 2024 Westlake University, WestlakeNLP [Research Intern]
October 1, 2024 ICLR’25 [Reviewer]
