Find GPUsL40
Choose the resources and software for your workload.
L40 · 48 GB GDDR6 per GPU
Keep your compute close to your data.
Choose the tools for your workload.
vLLM with OpenAI-compatible server on port 8000, Hugging Face cache on the persistent disk.
Local NVMe is included. Add persistent storage for data you want to keep.
Persistent storage: $0.08/GB-month, including while the instance is stopped. Set to 0 to use only the included local disk.