Jiarui Wang

I’m a Ph.D. student in Computer Science at the School of Computer Science, Shanghai Jiao Tong University (SJTU), advised by Prof. Zhouhan Lin in Language Understanding and Machine Intelligence Algorithms (LUMIA) Group. I received my B.S. in Computer Science from SJTU.

My research focuses on machine learning and large language models (LLMs), with particular interests in:

  • Next-Generation LLM Architectures — exploring new architectural paradigms that decouple knowledge storage from reasoning to improve knowledge acquisition, reasoning, and generalization.

  • Parametric Memory — developing parametric memory modules for LLMs that efficiently acquire, retain, and update knowledge.

I’m always open to discussing research, collaboration, and new ideas. Please feel free to reach out!

🔥 News

📚 Publications

  • MemSFT architecture: memory training, router training, and inference

    MemSFT: Mitigating Alignment Tax with an External Parametric Memory
    Jiarui Wang*, Xiang Shi*, Jiaqi Cao, Rubin Wei, Xiquan Wang, Hao Sun, Jingzhi Wang, Zhiqi Yang, Qipeng Guo, Bowen Zhou, Zhouhan Lin
    arXiv preprint (2026)
    🔗 arXiv · GitHub · Hugging Face · * Equal Contribution

  • Intern-S2-Preview memory architecture

    Intern-S2-Preview: Scientific Agentic Foundation Model
    Intern-S2-Preview Team, Shanghai AI Laboratory
    Co-author; arXiv preprint (2026)
    🔗 arXiv · GitHub · Hugging Face

  • Memory Decoder at Scale results

    Memory Decoder at Scale: A Pretrained, Parametric Long-Term Memory
    Rubin Wei, Jiaqi Cao, Jiarui Wang, Junming Zhang, Qipeng Guo, Bowen Zhou, Zhouhan Lin
    arXiv preprint (2026)
    🔗 arXiv · GitHub · Hugging Face

  • Deep Fusion Memory architecture

    Deep Fusion Memory: A Chunk-Level Parametric Memory for Large Language Models
    Rubin Wei, Siyuan Sun, Hao Sun, Yuliang Liu, Xiang Shi, Jiarui Wang, Junming Zhang, Zhouhan Lin
    arXiv preprint (2026)
    🔗 arXiv

  • HABIT-Bench framework

    HABIT-Bench: Evaluating Habit Induction from Longitudinal Weak Evidence in Agent Memory
    Junming Zhang, Rubin Wei, Xu Cheng, Hao Sun, Jiarui Wang, Ruoxi Cheng, Xiquan Wang, Peisong Wu, Mingsong Chen, Zhouhan Lin
    arXiv preprint (2026)
    🔗 arXiv

  • MLP Memory training and inference architecture

    MLP Memory: A Retriever-Pretrained Memory for Large Language Models
    Rubin Wei*, Jiaqi Cao*, Jiarui Wang, Jushi Kai, Qipeng Guo, Bowen Zhou, Zhouhan Lin
    ICLR 2026
    🔗 arXiv · GitHub · Hugging Face · * Equal Contribution

  • Memory Decoder compared with domain-adaptive pretraining and retrieval augmentation

    Memory Decoder: A Pretrained, Plug-and-Play Memory for Large Language Models
    Jiaqi Cao*, Jiarui Wang*, Rubin Wei, Qipeng Guo, Kai Chen, Bowen Zhou, Zhouhan Lin
    NeurIPS 2025
    🔗 arXiv · GitHub · Hugging Face · * Equal Contribution

🎓 Education

💼 Internships

🏅 Honors and Awards

  • Second Place, RoboCup China Open - Small Size League, 2024
  • Third Prize, Prototype System Competition, CCF Chinasoft, 2023
  • Provincial First Prize, Senior Group, National Olympiad in Informatics in Provinces (NOIP), 2018