Semantic routing with vLLM Semantic Router

The vLLM Semantic Router is an optional add-on that routes incoming inference requests to different backend models based on the semantic content of the prompt. This enables use cases such as directing simple queries to a smaller, cost-efficient model while routing complex or domain-specific prompts to a more capable one.

To deploy the router alongside a web dashboard, see the vLLM Semantic Router deployment guide.