vllm serve meta-llama/Llama-3.1-8B-Instruct --tensor-parallel-size 2

Splits the model across two GPUs with tensor parallelism, letting you serve models too large for one card. Each GPU holds half the weights and they cooperate on every forward pass. Requires GPUs on the same machine or fast interconnect, and a model with enough parameters to justify it.