The future of memory management in VMware vSphere is here, and it’s set to revolutionize how we handle workloads and optimize our infrastructure. The “Advanced NVMe Memory Tiering” feature is now generally available with the GA release of VCF 9, a feature that promises to significantly boost memory capacity and reduce your total cost of ownership (TCO).
(Announcement: https://blogs.vmware.com/cloud-foundation/2025/06/19/advanced-memory-tiering-now-available/ )
What is NVMe Memory Tiering?
NVMe Memory Tiering allows you to use NVMe devices as a secondary memory tier alongside traditional DRAM. This innovative approach dramatically increases the available memory capacity of your ESXi hosts. Imagine expanding from 64GB of DRAM to several hundred GB with NVMe – the possibilities are immense!
Key Benefits of NVMe Memory Tiering
- Massive Memory Expansion: Significantly increase your host’s memory capacity, enabling you to run more and larger virtual machines (VMs).
- Cost Efficiency: NVMe is significantly cheaper per GB than DRAM, allowing for larger memory footprints at a fraction of the cost.
- Improved Workload Consolidation: Run more VMs on a single host, enhancing utilization and consolidation ratios.
- Reduced TCO: Lower overall hardware costs by supplementing DRAM with NVMe, reducing the need for expensive DRAM upgrades.
- Sizing for Average Usage: Optimize memory sizing for average workloads instead of peak demand, saving on resources and costs.
Real-World Scenarios and Cost Savings
The following diagram shows a cost comparison between 32GB, 48GB, 64GB, 96GB & 128GB Modules, for a Host with 32 Modules (net prices)

The result: 128GB, 96GB & 48GB modules are currently not economic compared to 64GB and 32GB Modules.
Consider an environment with low CPU utilization but high memory usage. Without NVMe Tiering, you’d likely need to purchase additional servers, increasing both capital expenditure (Capex) and operational expenditure (Opex). With NVMe Tiering, you can avoid this, enhancing workload density on existing hardware.
A comparison shows significant cost savings:
- Scenario 1 (RAM Modules Only): Using traditional RAM upgrades to achieve a +4TB memory increase can lead to a 5-year cost of over €110,000, including hardware and operational expenses.
- Scenario 2 (NVMe Memory Tiering): Utilizing NVMe for memory tiering can reduce the 5-year cost to approximately €58,000, nearly halving your expenditure.
Details:
Component | Costs | |
Scenario 1w/ RAM Modules only | HPE GreenLake 380 Gen122 Socket with 24 Core eachMemory 32x64GB (2TB) moderate discount5yrs Hardware refresh | 2x €20.000 |
Opex (Facility, annually) Power, Cooling, Rack | 2x €6.000 | |
Opex (Labor, annually) 1h/month per ServerWith Fully burdened salary = €150k | 2x €1.020 | |
Sum (over 5yrs) | €110.200 | |
Scenario 2w/ NVMe Memory Tiering for suitable workloads | HPE GreenLake 380 Gen122 Socket with 24 Core eachMemory 32x64GB (2TB) moderate discount5yrs Hardware refresh | €20.000 |
Additional NVMe for Memory Tiering (2x 3.84TB) moderate discount2x because of RAID13.84 TB recommend due to performance & lifetime | €2.835 | |
Opex (Facility, annually) Power, Cooling, Rack | €6.000 | |
Opex (Labor, annually) 1h/month per ServerWith Fully burdened salary = €150k | €1.020 | |
Sum (over 5yrs) | €57.935 |
Yes, you are reading it right, with NVMe Memory Tiering we can talk about a DRAM:NVMe Ratio of 1:1!
Of course, not all workloads are suitable for NVMe Tiering. It’s necessary to categorize the existing and planned workloads due to their characteristics. Below you will find some more information that needs to be considered before using the technology. Important to note, that NVMe RAM will be available as unmappable RAM in ESXi. That means, NVMe Tiering cannot be addressed directly like DRAM and therefore has different characteristics in terms of latency and access speed:
- Higher Latency than DRAM: NVMe is fast, but still much slower than traditional memory. Latency-sensitive workloads (e.g., databases) may experience performance degradation.
- Dedicated NVMe Devices Required: The NVMe device cannot be used for other purposes (e.g., as a datastore) at the same time.
- Compatibility and Support: Chosen Hardware must follow the VMware compatibility guidelines
- Lifespan and Heat Generation: NVMe SSDs have a limited lifespan and can generate more heat under heavy load compared to DRAM, potentially requiring additional cooling.
Suitable Workloads
NVMe Memory Tiering is ideal for:
- Virtual Desktop Infrastructure (VDI)
- Modern Apps workloads
- Workloads with high memory requirements but low latency sensitivity
- Workloads with infrequent high memory activity, such as end-of-week transactions or backups
- SQL Server and Oracle deployments (specific configurations recommended)
However, it’s currently not recommended for:
- Latency- and performance-critical applications like real-time analytics
- Real-time environments
- In-memory databases
Conclusion: Optimize Your Infrastructure with NVMe Memory Tiering
NVMe Memory Tiering is set to be an optimization boost for environments where DRAM is limited, cost is a major concern, and workloads have large but not extremely latency-sensitive memory needs. Now that NVMe Memory Tiering is generally available, it offers substantial TCO reductions and improved workload density.