CV

General Information

Full Name Kaijian Wang
Emails kaw072 [AT] ucsd.edu, wangkaijian [AT] mail.ustc.edu.cn
kaijianwang2003 [AT] gmail.com
Twitter(X) @Kaijian_Wang

Education

  • 2021 - 2025
    B.S. in Information Security
    University of Science and Technology of China, Anhui, China

Publications

  • RecDM: Efficient Training System for Large-Scale Recommendation Models on Disaggregated Memory. (Under Review)
    Z.Wang, Z.Yu, K.Wang, Y.Lin, Y.Li, L.Liu, X.Tang, Y.Wang, Y.Kang, Y.Ding

Experience

  • 2024 - Now
    Research on LLM Serving System
    UC San Diego, USA
    • Advisors Prof. Yufei Ding
    • We developed an inference method combining speculative models with a tool engine, speculative model engine, and LLM decoding engine to optimize memory allocation and request scheduling, significantly improving the efficiency of CoT and tool-usage LLM inference serving.
    • Achieved 30-40% speedup over using only large models by incorporating collaborative reasoning between large and small models on the overall improvement.
    • I played a key role in implementing the entire code framework over vLLM, writing over 5k lines of Python code and around 1k lines of CUDA/C++ code, profiling system data, performing evaluations and optimizing inefficient kernel to achieve a 2x speedup on this kernel.
    • NOTE: Preparing for submission, SOSP 2025
  • 2024 - Now
    Research on DLRM System
    UC San Diego, USA
    • Advisors Prof. Yufei Ding
    • We proposed a novel solution to optimize DLRM training on disaggregated memory, achieving an average speedup of 5.34× over traditional frameworks leveraging host DRAM and outperformed state-of-the-art GPU-only DLRM training frameworks.
    • Our approach leverages CXL technology for flexible memory expansion and introduces an access-aware strategy for embedding placement and communication routing.
    • I was responsible for formulating the approach, designing and coding the solver, and running the experiments to validate our solution.
    • NOTE: Under Review, ISCA 2025
  • 2023 - 2024
    Research on Robust Image Watermark
    WMGroup, USTC, China
    • Adivisors Dr. Kejiang Chen
    • Proposed a watermark recovery module based on image hiding, designed to restore information-embedded images subjected to cropping and spatial manipulation.
    • Completed experiments on the reproduction of related research and developed the code for the module framework as proposed by coworker.
  • 2022 - Now
    CTF Player
    USTC-NEBULA, USTC, China
    • Member of USTC-NEBULA
    • Our team ranks 16th/1655(~0.97%) in China in the CTFTime rating during 2023-2024!
    • Mainly focus on Misc (Steganograpy and Forensics)

Projects

  • 2024
    Tiny-C Compiler
    • Developed a simplified C compiler in C, implementing lexical analysis, syntax analysis, and Intermediate Representation (IR) generation for the Tiny-C language.
    • Supported key C language features in Tiny-C, including assignment, arithmetic operations, while loops, and if-else statements.
    • Github repo Tiny-C Compiler
  • 2024
    Semantic Guidance for Diffusion Model
    • Conducted a detailed investigation into the semantic guidance of diffusion models, focusing on understanding both the theoretical underpinnings and experimental outcomes.
    • Identified existing issues within the semantic guidance provided by diffusion models, particularly emphasizing the loss of positional information.
    • Developed a straightforward method to address the loss of positional information in the semantic guidance of diffusion models, enhancing model accuracy and interpretability.
    • Blog post Semantic Guidance for Diffusion Model

Selected CTF Awards

  • 2024
    • Top 5th(~1.5%) in Hackergame2024
    • 3rd prize(~20%) in D^3CTF
    • Top 9th(~1%) in L3HCTF
  • 2023
    • Top 3rd(~1%) in TPCTF
    • 3rd prize(~20%) in D^3CTF
    • 3rd prize(~6.5%) in Hackergame2023

Honors and Awards

  • 2024
    • Outstanding Student Scholarship
    • DAS Scholarship(Top 10 in the department)
  • 2023
    • Outstanding Student Scholarship
  • 2022
    • Zhang Zongzhi Scholarship

Teaching Assistant

  • 2024
    Information Security Design and Practice
    USTC, China
    • Information hiding in multimedia and file analysis
  • 2023
    Data Structure and Algorithm
    USTC, China

Other Interests

  • Anime: Mushoku Tensei, Oshinoko, etc.