Siyuan Zhuang
Tech Lead of AI at SAIR Foundation
Today, I am Tech Lead of AI at SAIR Foundation. I work on the scientific foundations of artificial general intelligence and the virtuous cycle between AI and science: using scientific methods to better understand intelligence, then using better AI to accelerate discovery.
My broader goal is to understand what distinguishes humans from AI, what AI can teach us about ourselves and intelligence, and how humans and AI should relate in the future. My current work approaches these questions through three capabilities that I believe are still missing:
- Continual learning: acquiring knowledge and skills over time without forgetting what came before.
- Learning from experience: moving beyond fitting human-generated data toward creative adaptation through interaction with the world.
- Eliminating plausible hallucinations: understanding why models produce convincing falsehoods and making reliable truth-seeking a scientific objective.
I earned my PhD in Computer Science from UC Berkeley, where I was advised by Ion Stoica and Dawn Song. During my PhD, I was affiliated with the Sky Computing Lab and RISELab, and contributed to open-source community projects including Ray, SkyPilot, vLLM, and Chatbot Arena. These projects grew into widely used infrastructure for the AI community and industry.
Before Berkeley, I completed the Computer Science Honors Program at the University of Science and Technology of China. Across each chapter, I have returned to the same underlying question: what can the intelligent systems we build teach us about intelligence, ourselves, and the future relationship between humans and AI?
Selected work
Research that became infrastructure.
SOSP · 2023
vLLM: Efficient Memory Management for Large Language Model Serving with PagedAttention
High-throughput LLM serving through a paging-inspired approach to key-value cache management.
NeurIPS · 2023
Judging LLM-as-a-Judge with MT-Bench and Chatbot Arena
A systematic study of LLM-based evaluation that introduced MT-Bench and Chatbot Arena.
OSDI · 2023
ExoFlow: A Universal Workflow System for Exactly-Once DAGs
Flexible recovery semantics for heterogeneous workflows, separated cleanly from execution.
ICLR · 2024
LMSYS-Chat-1M: A Large-Scale Real-World LLM Conversation Dataset
One million real-world conversations for understanding and advancing language-model capabilities.
USENIX ATC · 2024
Starburst: A Cost-Aware Scheduler for Hybrid Cloud
Hybrid-cloud scheduling that balances cluster utilization, completion time, and cloud cost.
SIGCOMM · 2021
Hoplite: Efficient Collective Communication for Task-Based Distributed Systems
Fault-tolerant collective communication designed for asynchronous, dynamic distributed workloads.
NSDI · 2023
SkyPilot: An Intercloud Broker for Sky Computing
An intercloud broker that makes heterogeneous clouds feel like one integrated sky of computing.