Choose the right instance family and instance type
https://cloud.google.com/blog/products/compute/choose-the-right-google-compute-engine-machine-type-for-you
Chose the right instance family
- General purpose: right balance between price and performance, vCPU and Memory ratio.
- Compute optimized: for workloads that need more compute vs. memory such as HPC (high performance computing), game servers, latency-sensitive API serving.
- Memory optimized: for workloads that need ore memory such as SAP HANA, database.
- Accelerator optimized: NVIDIA GPU for workloads such as CUDA-enabled AIML training and inference, and HPC.
- Custom machine types: custom ratio.
Chose the right instance type
General purpose family
- E2:
- More cost effective specifically compared to N1, but with limitations on large instance sizes, GPUs, local SSD.
- E2 already includes SUD, and is eligible for CUD. Can offer up to 31% savings compared to on-demand TCO or CUD. E2 together with CUD (3 years) can bring savings up to 55%.
- N2: is the second generation vs. N1
- Up to ~30% higher performance compared to same specs VMs on prem.
- N2D:
- Offers largest general purpose VM with up to 224 vCPUs.
- Up to 13% price-performance compared to other N-series instances.
- vs N1:
- Higher memory to vCPU ratio.
- Up to 20% price-performance improvement vs. N1.
- Up to 2.82x faster than N1 on AIML workloads.
- N1: required for specific GPU workloads.
Compute-optimized (C2) family
Memory-optimized (M2, M1) family
- vs. N-series: smallest M-series instance offers ~900 GB of memory. For smaller workload, choose N-series instances instead.
- Suitable for SAP HANA workloads.
- M1 offers up to 4TB of memory, M2 offers up to 12TB of memory.
Accelerator-optimized (A2) family
- Suitable for specific GPU workloads.
Choose the right pricing model
On-demand: Pay as you go
- SUD offers discount while resources are being used, in term of active time per month, without any commitment. Discount starts from day 7-8 (25% of month), and goes up to 30% for a full-month active duration.
- Sustained use discounts do not apply to VMs created using the App Engine flexible environment and Dataflow.
- Sustained use discounts do not apply to E2 machine types.
- SUD discount can be viewed from the bill at the end of the billing cycle.
- CUD applies to GKE, Dataproc, and Compute Engine.
- With CUD, resources such as vCPU, memory, GPU and local SSD will be at discounted rate.
- Commitment term is for 1 year or 3 years.
- The discount is up to 57% for most resources like machine types or GPUs. The discount is up to 70% for memory-optimized machine types.
- CUD is regional.
- CUD can be enabled to be shared across projects (or just for a specific project) under the same billing account.
- CUD does not renew, a new CUD must be created to continue receiving discounts.
- For SAP on SLES, CUD can offer further discount on pooled licences.
- CUD can be purchased together with reserved resources, which applies to a specific zone.
- Limitations:
- CUDs do not apply to VMs created using the App Engine flexible environment and Dataflow.
- CUD respects resource quota.
- Purchasing commitment for GPU and SSD require a reservation with the same GPU or local SSD.
- RR is zonal.
- RR is charged based on on-demand rates, which include SUD.
- RR is eligible for CUD.