GPU Server Comparison
ServerSearcher tracks 61 GPU server configurations from 3 providers we cover, with GPUs including NVIDIA_A16, NVIDIA H100 80GB NVLink, NVIDIA_L40S, NVIDIA RTX PRO 6000 Server Edition, NVIDIA A100 80GB NVLink. Compare on-demand (hourly) and monthly pricing below.
Select GPU models...
| Provider | Plan | GPU | Total VRAM | CPU & RAM | Price |
|---|---|---|---|---|---|
| Vultr | Vultr NVIDIA_A16 - 6 vCPU 64GB RAM 1x NVIDIA_A16 (16GB VRAM/card), 6 vCPUs, 64GB RAM, 350GB CLOUDGPU | 1x NVIDIA_A16 (16GB each) Vultr | 16GB $0.029/hourly/GB | 3 vCPUs 64GB RAM | $0.47/hr Order |
| Vultr | Vultr NVIDIA_A16 - 12 vCPU 128GB RAM 2x NVIDIA_A16 (16GB VRAM/card), 12 vCPUs, 128GB RAM, 700GB CLOUDGPU | 2x NVIDIA_A16 (16GB each) Vultr | 32GB $0.029/hourly/GB | 6 vCPUs 128GB RAM | $0.94/hr Order |
| Vultr | Vultr NVIDIA_L40S - 16 vCPU 180GB RAM 1x NVIDIA_L40S (48GB VRAM/card), 16 vCPUs, 180GB RAM, 1200GB CLOUDGPU | 1x NVIDIA_L40S (48GB each) Vultr | 48GB $0.035/hourly/GB | 8 vCPUs 180GB RAM | $1.67/hr Order |
| Vultr | Vultr NVIDIA_A40 - 24 vCPU 120GB RAM 1x NVIDIA_A40 (48GB VRAM/card), 24 vCPUs, 120GB RAM, 1400GB CLOUDGPU | 1x NVIDIA_A40 (48GB each) Vultr | 48GB $0.036/hourly/GB | 12 vCPUs 120GB RAM | $1.71/hr Order |
| Vultr | Vultr NVIDIA_A16 - 24 vCPU 256GB RAM 4x NVIDIA_A16 (16GB VRAM/card), 24 vCPUs, 256GB RAM, 1200GB CLOUDGPU | 4x NVIDIA_A16 (16GB each) Vultr | 64GB $0.029/hourly/GB | 12 vCPUs 256GB RAM | $1.88/hr Order |
| Latitude.sh | g3.h100.small | 1x NVIDIA H100 80GB (80GB each) Latitude.sh | 80GB $0.025/hourly/GB | 16 vCPUs 192GB RAM | $1.99/hr Order |
| Latitude.sh | g3.h100.small | 1x NVIDIA H100 80GB (80GB each) Latitude.sh | 80GB $0.025/hourly/GB | 16 vCPUs 192GB RAM | $1.99/hr Order |
| Latitude.sh | g3.h100.small | 1x NVIDIA H100 80GB (80GB each) Latitude.sh | 80GB $0.026/hourly/GB | 16 vCPUs 192GB RAM | $2.09/hr Order |
| Latitude.sh | g3.h100.small | 1x NVIDIA H100 80GB (80GB each) Latitude.sh | 80GB $0.028/hourly/GB | 16 vCPUs 192GB RAM | $2.28/hr Order |
| Latitude.sh | g3.h100.small | 1x NVIDIA H100 80GB (80GB each) Latitude.sh | 80GB $0.030/hourly/GB | 16 vCPUs 192GB RAM | $2.41/hr Order |
| Latitude.sh | g3.h100.small | 1x NVIDIA H100 80GB (80GB each) Latitude.sh | 80GB $0.030/hourly/GB | 16 vCPUs 192GB RAM | $2.41/hr Order |
| Latitude.sh | g3.h100.small | 1x NVIDIA H100 80GB (80GB each) Latitude.sh | 80GB $0.032/hourly/GB | 16 vCPUs 192GB RAM | $2.53/hr Order |
| Vultr | Vultr NVIDIA_L40S - 32 vCPU 375GB RAM 2x NVIDIA_L40S (48GB VRAM/card), 32 vCPUs, 375GB RAM, 2200GB CLOUDGPU | 2x NVIDIA_L40S (48GB each) Vultr | 96GB $0.035/hourly/GB | 16 vCPUs 375GB RAM | $3.34/hr Order |
| Latitude.sh | g3.h100.small | 1x NVIDIA H100 80GB (80GB each) Latitude.sh | 80GB $0.042/hourly/GB | 16 vCPUs 192GB RAM | $3.37/hr Order |
| Vultr | Vultr NVIDIA_A16 - 48 vCPU 496GB RAM 8x NVIDIA_A16 (16GB VRAM/card), 48 vCPUs, 496GB RAM, 1500GB CLOUDGPU | 8x NVIDIA_A16 (16GB each) Vultr | 128GB $0.029/hourly/GB | 24 vCPUs 496GB RAM | $3.77/hr Order |
| Latitude.sh | g3.gh200 | 1x NVIDIA GH200 (96GB each) Latitude.sh | 96GB $0.044/hourly/GB | 72 vCPUs 480GB RAM | $4.23/hr Order |
| Vultr | Vultr NVIDIA_L40S - 64 vCPU 750GB RAM 4x NVIDIA_L40S (48GB VRAM/card), 64 vCPUs, 750GB RAM, 2600GB CLOUDGPU | 4x NVIDIA_L40S (48GB each) Vultr | 192GB $0.035/hourly/GB | 32 vCPUs 750GB RAM | $6.68/hr Order |
| Vultr | Vultr NVIDIA_A40 - 96 vCPU 480GB RAM 4x NVIDIA_A40 (48GB VRAM/card), 96 vCPUs, 480GB RAM, 1400GB CLOUDGPU | 4x NVIDIA_A40 (48GB each) Vultr | 192GB $0.036/hourly/GB | 48 vCPUs 480GB RAM | $6.85/hr Order |
| Latitude.sh | g3.l40s.large | 8x NVIDIA L40S 48GB (48GB each) Latitude.sh | 384GB $0.018/hourly/GB | 64 vCPUs 1536GB RAM | $6.97/hr Order |
| Latitude.sh | g3.l40s.large | 8x NVIDIA L40s 48GB (48GB each) Latitude.sh | 384GB $0.018/hourly/GB | 64 vCPUs 1536GB RAM | $6.97/hr Order |
| Vultr | Vultr NVIDIA_A16 - 96 vCPU 960GB RAM 16x NVIDIA_A16 (16GB VRAM/card), 96 vCPUs, 960GB RAM, 1700GB CLOUDGPU | 16x NVIDIA_A16 (16GB each) Vultr | 256GB $0.029/hourly/GB | 48 vCPUs 960GB RAM | $7.53/hr Order |
| Latitude.sh | g3.l40s.large | 8x NVIDIA L40s 48GB (48GB each) Latitude.sh | 384GB $0.020/hourly/GB | 64 vCPUs 1536GB RAM | $7.75/hr Order |
| Latitude.sh | g3.a100.large | 8x NVIDIA A100 80GB NVLink (80GB each) Latitude.sh | 640GB $0.012/hourly/GB | 64 vCPUs 1536GB RAM | $7.82/hr Order |
| Latitude.sh | g3.h100.medium | 4x NVIDIA H100 80GB NVLink (80GB each) Latitude.sh | 320GB $0.025/hourly/GB | 64 vCPUs 768GB RAM | $7.97/hr Order |
| Latitude.sh | g3.h100.medium | 4x NVIDIA H100 80GB NVLink (80GB each) Latitude.sh | 320GB $0.025/hourly/GB | 64 vCPUs 768GB RAM | $7.97/hr Order |
| Latitude.sh | g3.h100.medium | 4x NVIDIA H100 80GB NVLink (80GB each) Latitude.sh | 320GB $0.025/hourly/GB | 64 vCPUs 768GB RAM | $7.97/hr Order |
| Latitude.sh | g3.a100.large | 8x NVIDIA A100 80GB NVLink (80GB each) Latitude.sh | 640GB $0.013/hourly/GB | 64 vCPUs 1536GB RAM | $8.28/hr Order |
| Latitude.sh | g3.a100.large | 8x NVIDIA A100 80GB NVLink (80GB each) Latitude.sh | 640GB $0.013/hourly/GB | 64 vCPUs 1536GB RAM | $8.28/hr Order |
| Latitude.sh | g3.a100.large | 8x NVIDIA A100 80GB NVLink (80GB each) Latitude.sh | 640GB $0.014/hourly/GB | 64 vCPUs 1536GB RAM | $9.21/hr Order |
| Latitude.sh | g3.h100.medium | 4x NVIDIA H100 80GB NVLink (80GB each) Latitude.sh | 320GB $0.031/hourly/GB | 64 vCPUs 768GB RAM | $9.97/hr Order |
| Latitude.sh | g3.a100.large | 8x NVIDIA A100 80GB NVLink (80GB each) Latitude.sh | 640GB $0.016/hourly/GB | 64 vCPUs 1536GB RAM | $10.23/hr Order |
| Latitude.sh | g3.a100.large | 8x NVIDIA A100 80GB NVLink (80GB each) Latitude.sh | 640GB $0.016/hourly/GB | 64 vCPUs 1536GB RAM | $10.23/hr Order |
| Latitude.sh | g3.a100.large | 8x NVIDIA A100 80GB NVLink (80GB each) Latitude.sh | 640GB $0.016/hourly/GB | 64 vCPUs 1536GB RAM | $10.23/hr Order |
| Latitude.sh | g3.h100.medium | 4x NVIDIA H100 80GB NVLink (80GB each) Latitude.sh | 320GB $0.035/hourly/GB | 64 vCPUs 768GB RAM | $11.15/hr Order |
| Latitude.sh | g3.a100.large | 8x NVIDIA A100 80GB NVLink (80GB each) Latitude.sh | 640GB $0.018/hourly/GB | 64 vCPUs 1536GB RAM | $11.36/hr Order |
| Vultr | Vultr NVIDIA_L40S - 128 vCPU 1500GB RAM 8x NVIDIA_L40S (48GB VRAM/card), 128 vCPUs, 1500GB RAM, 3400GB CLOUDGPU | 8x NVIDIA_L40S (48GB each) Vultr | 384GB $0.035/hourly/GB | 64 vCPUs 1500GB RAM | $13.37/hr Order |
| Latitude.sh | g3.h100.large | 8x NVIDIA H100 80GB NVLink (80GB each) Latitude.sh | 640GB $0.021/hourly/GB | 64 vCPUs 1536GB RAM | $13.53/hr Order |
| Latitude.sh | g3.h100.large | 8x NVIDIA H100 80GB NVLink (80GB each) Latitude.sh | 640GB $0.022/hourly/GB | 64 vCPUs 1536GB RAM | $14.34/hr Order |
| Latitude.sh | g3.h100.large | 8x NVIDIA H100 80GB NVLink (80GB each) Latitude.sh | 640GB $0.022/hourly/GB | 64 vCPUs 1536GB RAM | $14.34/hr Order |
| Latitude.sh | g3.h100.large | 8x NVIDIA H100 80GB NVLink (80GB each) Latitude.sh | 640GB $0.025/hourly/GB | 64 vCPUs 1536GB RAM | $15.94/hr Order |
| Latitude.sh | g3.h100.large | 8x NVIDIA H100 80GB NVLink (80GB each) Latitude.sh | 640GB $0.028/hourly/GB | 64 vCPUs 1536GB RAM | $17.71/hr Order |
| Latitude.sh | g4.rtx6kpro.large | 8x NVIDIA RTX PRO 6000 Server Edition Latitude.sh | 0GB $0.000/hourly/GB | 64 vCPUs 1536GB RAM | $19.50/hr Order |
| Latitude.sh | g4.rtx6kpro.large | 8x NVIDIA RTX PRO 6000 Server Edition Latitude.sh | 0GB $0.000/hourly/GB | 64 vCPUs 1536GB RAM | $19.50/hr Order |
| Latitude.sh | g3.h100.large | 8x NVIDIA H100 80GB NVLink (80GB each) Latitude.sh | 640GB $0.031/hourly/GB | 64 vCPUs 1536GB RAM | $19.67/hr Order |
| Latitude.sh | g4.rtx6kpro.large | 8x NVIDIA RTX PRO 6000 Server Edition Latitude.sh | 0GB $0.000/hourly/GB | 64 vCPUs 1536GB RAM | $21.21/hr Order |
| Latitude.sh | g3.h100sxm.large | 8x NVIDIA H100 SXM5 (80GB each) Latitude.sh | 640GB $0.038/hourly/GB | 52 vCPUs 1024GB RAM | $24.34/hr Order |
| Latitude.sh | g4.rtx6kpro.large | 8x NVIDIA RTX PRO 6000 Server Edition Latitude.sh | 0GB $0.000/hourly/GB | 64 vCPUs 1536GB RAM | $26.60/hr Order |
| Latitude.sh | g4.rtx6kpro.large | 8x NVIDIA RTX PRO 6000 Server Edition Latitude.sh | 0GB $0.000/hourly/GB | 64 vCPUs 1536GB RAM | $27.28/hr Order |
| Latitude.sh | g4.rtx6kpro.large | 8x NVIDIA RTX PRO 6000 Server Edition Latitude.sh | 0GB $0.000/hourly/GB | 64 vCPUs 1536GB RAM | $29.67/hr Order |
| Latitude.sh | g4.rtx6kpro.large | 8x NVIDIA RTX PRO 6000 Server Edition Latitude.sh | 0GB $0.000/hourly/GB | 64 vCPUs 1536GB RAM | $37.21/hr Order |
| Latitude.sh | g4.rtx6kpro.large | 8x NVIDIA RTX PRO 6000 Latitude.sh | 0GB $0.000/hourly/GB | 64 vCPUs 1536GB RAM | $47.98/hr Order |
| Latitude.sh | g4.rtx6kpro.large | 8x NVIDIA RTX PRO 6000 Latitude.sh | 0GB $0.000/hourly/GB | 64 vCPUs 1536GB RAM | $52.18/hr Order |
| Latitude.sh | g4.rtx6kpro.large | 8x NVIDIA RTX PRO 6000 Latitude.sh | 0GB $0.000/hourly/GB | 64 vCPUs 1536GB RAM | $65.44/hr Order |
GPU servers — frequently asked questions
How many GPU servers does ServerSearcher track?
ServerSearcher tracks 61 GPU server configurations from 3 providers.
Which GPU models can I rent?
Tracked GPU servers include NVIDIA_A16, NVIDIA H100 80GB NVLink, NVIDIA_L40S, NVIDIA RTX PRO 6000 Server Edition, NVIDIA A100 80GB NVLink.
Which tracked GPU server has the most GPUs?
The tracked configuration with the most GPUs is Vultr Vultr NVIDIA_A16 - 96 vCPU 960GB RAM with 16x NVIDIA_A16 (256 GB total GPU VRAM). Confirm availability on the provider's site.
Disclosure: some links on ServerSearcher are affiliate links — if you sign up with a provider through them, we may earn a commission at no extra cost to you. Prices and result rankings reflect the plan data and the filters and sort you choose, not commissions.