vLLM Semantic Router

AI & ML interests

A programmable Mixture-of-Models router for heterogeneous LLM inference

Recent Activity

subin  updated a model about 22 hours ago

vllm-sr/Decision-1.0-Route-0.6B

subin  published a dataset about 22 hours ago

vllm-sr/router-signal-suite

Xunzhuo  updated a collection 1 day ago

🎲 Decision 2.0

View all activity

Team members 48