Browse Docs GitHub

Previewof vllm-project/vllm#62585 at 1342f76.

Providers

Black Forest Labs

Seed (ByteDance)

LongCat (Meituan)

MindLab Research

MiniCPM (OpenBMB)

InternVL (OpenGVLab)

Preferred Networks

Step-5-Preview Step-3.7-Flash Step-3.5-Flash

Hunyuan (Tencent)

Thinking Machines Lab

vLLM Semantic Router

StepFun

stepfun-ai·3 recipesHuggingFace

Multimodal

2

FP8773GNVFP4473G

BF16475GFP8238GNVFP4119G

Text

1

BF16470GFP8235GINT4118GINT8235G

GitHub Request a recipe Documentation Supported Models & Hardware Install vLLM JSON API