Find GPUsRTX 3070
Choose the resources and software for your workload.
RTX 3070 · 8 GB GDDR6 per GPU
Keep your compute close to your data.
Choose the tools for your workload.
vLLM with OpenAI-compatible server on port 8000, Hugging Face cache on the persistent disk.
Local NVMe is included. Add persistent storage for data you want to keep.
Persistent storage: $0.08/GB-month, including while the instance is stopped. Set to 0 to use only the included local disk.