vllm serve mistralai/Mistral-7B-Instruct-v0.3 --port 8001

Category: AI/ML Tooling

vllm serve mistralai/Mistral-7B-Instruct-v0.3 --port 8001

Serve on a custom port

Runs the Mistral-7B-Instruct-v0.3 model on port 8001 instead of the default 8000, letting several vLLM servers share one machine. Point clients at http://localhost:8001/v1 and set their base_url accordingly. Use --host 0.0.0.0 to accept connections from other machines.
Looking for more? Search all 7,657 commands — works offline, in English or Spanish, and fixes typos.