CV
General Information
Full Name | Kaijian Wang |
Emails | kaw072 [AT] ucsd.edu, wangkaijian [AT] mail.ustc.edu.cn kaijianwang2003 [AT] gmail.com |
Twitter(X) | @Kaijian_Wang |
Education
-
2021 - 2025 B.S. in Information Security
University of Science and Technology of China, Anhui, China
Publications
- RecDM: Efficient Training System for Large-Scale Recommendation Models on Disaggregated Memory. (Under Review)
Z.Wang, Z.Yu, K.Wang, Y.Lin, Y.Li, L.Liu, X.Tang, Y.Wang, Y.Kang, Y.Ding
Experience
-
2024 - Now Research on LLM Serving System
UC San Diego, USA - Advisors Prof. Yufei Ding
- We developed an inference method combining speculative models with a tool engine, speculative model engine, and LLM decoding engine to optimize memory allocation and request scheduling, significantly improving the efficiency of CoT and tool-usage LLM inference serving.
- Achieved 30-40% speedup over using only large models by incorporating collaborative reasoning between large and small models on the overall improvement.
- I played a key role in implementing the entire code framework over vLLM, writing over 5k lines of Python code and around 1k lines of CUDA/C++ code, profiling system data, performing evaluations and optimizing inefficient kernel to achieve a 2x speedup on this kernel.
- NOTE: Preparing for submission, SOSP 2025
-
2024 - Now Research on DLRM System
UC San Diego, USA - Advisors Prof. Yufei Ding
- We proposed a novel solution to optimize DLRM training on disaggregated memory, achieving an average speedup of 5.34× over traditional frameworks leveraging host DRAM and outperformed state-of-the-art GPU-only DLRM training frameworks.
- Our approach leverages CXL technology for flexible memory expansion and introduces an access-aware strategy for embedding placement and communication routing.
- I was responsible for formulating the approach, designing and coding the solver, and running the experiments to validate our solution.
- NOTE: Under Review, ISCA 2025
-
2023 - 2024 Research on Robust Image Watermark
WMGroup, USTC, China - Adivisors Dr. Kejiang Chen
- Proposed a watermark recovery module based on image hiding, designed to restore information-embedded images subjected to cropping and spatial manipulation.
- Completed experiments on the reproduction of related research and developed the code for the module framework as proposed by coworker.
-
2022 - Now CTF Player
USTC-NEBULA, USTC, China - Member of USTC-NEBULA
- Our team ranks 16th/1655(~0.97%) in China in the CTFTime rating during 2023-2024!
- Mainly focus on Misc (Steganograpy and Forensics)
Projects
-
2024 Tiny-C Compiler
- Developed a simplified C compiler in C, implementing lexical analysis, syntax analysis, and Intermediate Representation (IR) generation for the Tiny-C language.
- Supported key C language features in Tiny-C, including assignment, arithmetic operations, while loops, and if-else statements.
- Github repo Tiny-C Compiler
-
2024 Semantic Guidance for Diffusion Model
- Conducted a detailed investigation into the semantic guidance of diffusion models, focusing on understanding both the theoretical underpinnings and experimental outcomes.
- Identified existing issues within the semantic guidance provided by diffusion models, particularly emphasizing the loss of positional information.
- Developed a straightforward method to address the loss of positional information in the semantic guidance of diffusion models, enhancing model accuracy and interpretability.
- Blog post Semantic Guidance for Diffusion Model
Selected CTF Awards
-
2024 - Top 5th(~1.5%) in Hackergame2024
- 3rd prize(~20%) in D^3CTF
- Top 9th(~1%) in L3HCTF
-
2023 - Top 3rd(~1%) in TPCTF
- 3rd prize(~20%) in D^3CTF
- 3rd prize(~6.5%) in Hackergame2023
Honors and Awards
-
2024 - Outstanding Student Scholarship
- DAS Scholarship(Top 10 in the department)
-
2023 - Outstanding Student Scholarship
-
2022 - Zhang Zongzhi Scholarship
Teaching Assistant
-
2024 Information Security Design and Practice
USTC, China - Information hiding in multimedia and file analysis
-
2023 Data Structure and Algorithm
USTC, China
Other Interests
- Anime: Mushoku Tensei, Oshinoko, etc.