Skip to content

Commit 92aeacc

Browse files
authored
Merge pull request #2603 from iamwilliew/patch-44
ND GB300 v6 Series [Ignite]
2 parents 491148d + 02eb332 commit 92aeacc

File tree

4 files changed

+149
-0
lines changed

4 files changed

+149
-0
lines changed

articles/virtual-machines/TOC.yml

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -553,6 +553,8 @@
553553
href: ./sizes/gpu-accelerated/ndv2-series.md
554554
- name: ND-GB200-v6 series
555555
href: ./sizes/gpu-accelerated/nd-gb200-v6-series.md
556+
- name: ND-GB300-v6 series
557+
href: ./sizes/gpu-accelerated/nd-gb300-v6-series.md
556558
- name: ND-H100-v5 series
557559
href: ./sizes/gpu-accelerated/ndh100v5-series.md
558560
- name: ND-H200-v5 series
Lines changed: 22 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,22 @@
1+
---
2+
title: ND GB300 v6 series specs include
3+
description: Include file containing specifications of ND GB300 v6 series VM sizes.
4+
author: iamwilliew
5+
ms.topic: include
6+
ms.service: azure-virtual-machines
7+
ms.subservice: sizes
8+
ms.date: 11/13/2025
9+
ms.author: wwilliams
10+
ms.reviewer: mattmcinnes
11+
ms.custom: include file
12+
# Customer intent: "As a cloud architect, I want to review the specifications of the ND GB300 v6 series VMs, so that I can ensure they meet the performance requirements for my high-demand workloads."
13+
---
14+
15+
| Part | Quantity <br><sup>Count Units | Specs <br><sup>SKU ID, Performance Units, etc. |
16+
|---|---|---|
17+
| Processor | 128 vCPUs | Nvidia Grace CPU |
18+
| Memory | 864 VM | LPDDR |
19+
| Local Storage | 4 Disks | 16TB NVME Direct |
20+
| Remote Storage | 16 Disks | 80000 IOPS/1200 MBps |
21+
| Network | 1 NICs | 160Gb/s Ethernet |
22+
| Accelerators | 4 GPUs | Nvidia Blackwell Ultra GPU (288GB) |
Lines changed: 18 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,18 @@
1+
---
2+
title: ND GB300-v6 size series
3+
description: Information on and specifications of the ND GB300-v6-series sizes
4+
author: iamwilliew
5+
ms.service: azure-virtual-machines
6+
ms.subservice: sizes
7+
ms.topic: concept-article
8+
ms.date: 11/13/2025
9+
ms.author: wwilliams
10+
ms.reviewer: mattmcinnes
11+
# Customer intent: As a cloud architect, I want to assess the specifications and features of the ND GB300-v6 series, so that I can choose the optimal virtual machine size for our high-performance computing needs.
12+
---
13+
14+
The NDGB300v6 series is Azure’s next-generation GPU VM line purpose-built for large-scale AI, especially high-throughput inference for reasoning and agentic systems. These VMs are powered by NVIDIA GB300 NVL72 rackscale systems (Blackwell Ultra GPUs + Grace CPUs).  Each ND-GB300-v6 VM has two NVIDIA Grace CPUs and four NVIDIA Blackwell B300 GPUs. The GPUs are interconnected via fifth-generation NVLINK, providing a total of 4× 1.8 TB/s NVLINK bandwidth per VM. Each GPU also has 800 Gb/s InfiniBand connectivity, enabling cluster-scale performance with low latency. There are 18 VMs per rack, so effectively 72 NVIDIA Blackwell Ultra GPUs with 36 NVIDIA Grace CPUs, exposing ~37 TB of fast memory (~20TB High Bandwidth Memory, ~17TB of CPU Memory), 130 TB/s of intrarack NVLink bandwidth.
15+
16+
At rack scale, ND GB300 v6 delivers up to 1.44 exaFLOPS FP4 Tensor Core performance per NVL72 domain and has demonstrated ~1.1 million tokens/second LLM inference throughput per rack, which is ~27% higher than ND GB200 v6. See here for more details. Compared to GB200, GB300 provides ~1.5× FP4 compute, 50% higher HBM capacity (288 GB HBM3E per GPU vs. 192 GB), and 2x the back-end network bandwidth per GPU (800Gbps vs 400 Gbps).
17+
18+
The ND GB300 v6 architecture builds on the ND v6 GB200 to efficiently distribute workloads and memory demands across multiple GPUs, driving markedly higher inference throughput for long context and multimodal workloads AI and scientific applications. These instances deliver best-in-class performance for AI, ML, and analytics workloads with out-of-the-box support for frameworks like PyTorch, Tensorflow, JAX, RAPIDS, and more.
Lines changed: 107 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,107 @@
1+
---
2+
title: ND GB300-v6 size series
3+
description: Information on and specifications of the ND GB300-v6-series sizes
4+
author: iamwilliew
5+
ms.service: azure-virtual-machines
6+
ms.subservice: sizes
7+
ms.topic: concept-article
8+
ms.date: 11/12/2025
9+
ms.author: wwilliams
10+
ms.reviewer: mattmcinnes
11+
# Customer intent: As a cloud architect, I want to assess the specifications and features of the ND GB300-v6 series, so that I can choose the optimal virtual machine size for our high-performance computing needs.
12+
---
13+
14+
# ND GB300-v6 sizes series
15+
16+
[!INCLUDE [nd-gb300-v6--summary](./includes/nd-gb300-v6-series-summary.md)]
17+
18+
## Host specifications
19+
[!INCLUDE [nd-gb300-v6-series-specs](./includes/nd-gb300-v6-series-specs.md)]
20+
21+
## Feature support
22+
[Premium Storage](../../premium-storage-performance.md): Supported <br>[Premium Storage caching](../../premium-storage-performance.md): Supported <br>[Live Migration](../../maintenance-and-updates.md): Not Supported <br>[Memory Preserving Updates](../../maintenance-and-updates.md): Not Supported <br>[Generation 2 VMs](../../generation-2.md): Supported <br>[Generation 1 VMs](../../generation-2.md): Not Supported <br>[Accelerated Networking](/azure/virtual-network/create-vm-accelerated-networking-cli): Supported <br>[Ephemeral OS Disk](../../ephemeral-os-disks.md): Supported <br>[Nested Virtualization](/virtualization/hyper-v-on-windows/user-guide/nested-virtualization): Not Supported <br>
23+
24+
## Sizes in series
25+
26+
### [Basics](#tab/sizebasic)
27+
28+
vCPUs (Qty.) and Memory for each size
29+
30+
| Size Name | vCPUs (Qty.) | Memory (GB) |
31+
| --- | --- | --- |
32+
| Standard_ND128isr_NDR_GB300_v6 | 128 | 864 |
33+
34+
#### VM Basics resources
35+
- [Check vCPU quotas](../../../virtual-machines/quotas.md)
36+
37+
### [Local storage](#tab/sizestoragelocal)
38+
39+
Local (temp) storage info for each size
40+
41+
| Size Name | Max Temp Storage Disks (Qty.) | Temp Disk Size (TB) |
42+
| --- | --- | --- |
43+
| Standard_ND128isr_NDR_GB300_v6 | 4 | 16 |
44+
45+
#### Storage resources
46+
- [Introduction to Azure managed disks](../../../virtual-machines/managed-disks-overview.md)
47+
- [Azure managed disk types](../../../virtual-machines/disks-types.md)
48+
- [Share an Azure managed disk](../../../virtual-machines/disks-shared.md)
49+
50+
#### Table definitions
51+
- Temp disk speed often differs between RR (Random Read) and RW (Random Write) operations. RR operations are typically faster than RW operations. The RW speed is usually slower than the RR speed on series where only the RR speed value is listed.
52+
- Storage capacity is shown in units of GiB or 1024^3 bytes. When you compare disks measured in GB (1000^3 bytes) to disks measured in GiB (1024^3) remember that capacity numbers given in GiB may appear smaller. For example, 1023 GiB = 1098.4 GB.
53+
- Disk throughput is measured in input/output operations per second (IOPS) and MBps where MBps = 10^6 bytes/sec.
54+
- To learn how to get the best storage performance for your VMs, see [Virtual machine and disk performance](../../../virtual-machines/disks-performance.md).
55+
56+
### [Remote storage](#tab/sizestorageremote)
57+
58+
Remote (uncached) storage info for each size
59+
60+
| Size Name | Max Remote Storage Disks (Qty.) | Uncached Disk IOPS | Uncached Disk Speed (MBps) |
61+
| --- | --- | --- | --- |
62+
| Standard_ND128isr_NDR_GB300_v6 | 16 | 80000 | 1200 |
63+
64+
#### Storage resources
65+
- [Introduction to Azure managed disks](../../../virtual-machines/managed-disks-overview.md)
66+
- [Azure managed disk types](../../../virtual-machines/disks-types.md)
67+
- [Share an Azure managed disk](../../../virtual-machines/disks-shared.md)
68+
69+
#### Table definitions
70+
- Some sizes support [bursting](../../disk-bursting.md) to temporarily increase disk performance. Burst speeds can be maintained for up to 30 minutes at a time.
71+
- Special Storage refers to either [Ultra Disk](../../../virtual-machines/disks-enable-ultra-ssd.md) or [Premium SSD v2](../../../virtual-machines/disks-deploy-premium-v2.md) storage.
72+
- Storage capacity is shown in units of GiB or 1024^3 bytes. When you compare disks measured in GB (1000^3 bytes) to disks measured in GiB (1024^3) remember that capacity numbers given in GiB may appear smaller. For example, 1023 GiB = 1098.4 GB.
73+
- Disk throughput is measured in input/output operations per second (IOPS) and MBps where MBps = 10^6 bytes/sec.
74+
- Data disks can operate in cached or uncached modes. For cached data disk operation, the host cache mode is set to ReadOnly or ReadWrite. For uncached data disk operation, the host cache mode is set to None.
75+
- To learn how to get the best storage performance for your VMs, see [Virtual machine and disk performance](../../../virtual-machines/disks-performance.md).
76+
77+
78+
### [Network](#tab/sizenetwork)
79+
80+
Network interface info for each size
81+
82+
| Size Name | Max Front-end NICs (Qty.) | Max Front-end Bandwidth (Mbps) | Max Scale-up NICS (Qty.) | Max Scale-Up Bandwidth (TBps)<sup>1</sup> | Max Scale-out NICS (Qty.) | Max Scale-Out Bandwidth (Gbps)<sup>2</sup> |
83+
| --- | --- | --- | --- | --- | --- | --- |
84+
| Standard_ND128isr_NDR_GB300_v6 | 1 | 160 | 4 | 1.8 | 4 | 4x800 |
85+
86+
#### Networking resources
87+
- [Virtual networks and virtual machines in Azure](/azure/virtual-network/network-overview)
88+
- [Virtual machine network bandwidth](/azure/virtual-network/virtual-machine-network-throughput)
89+
90+
#### Table definitions
91+
- <sup>1</sup> Bandwidth is per NIC to up to 100,000 of GPUs through InfiniBand
92+
- <sup>2</sup> Bandwidth is up to 72 GPUs per domain through NVLINK
93+
- Expected network bandwidth is the maximum aggregated bandwidth allocated per VM type across all NICs, for all destinations. For more information, see [Virtual machine network bandwidth](/azure/virtual-network/virtual-machine-network-throughput)
94+
- Upper limits aren't guaranteed. Limits offer guidance for selecting the right VM type for the intended application. Actual network performance will depend on several factors including network congestion, application loads, and network settings. For information on optimizing network throughput, see [Optimize network throughput for Azure virtual machines](/azure/virtual-network/virtual-network-optimize-network-bandwidth).
95+
- To achieve the expected network performance on Linux or Windows, you may need to select a specific version or optimize your VM. For more information, see [Bandwidth/Throughput testing (NTTTCP)](/azure/virtual-network/virtual-network-bandwidth-testing).
96+
97+
### [Accelerators](#tab/sizeaccelerators)
98+
99+
Accelerator (GPUs, FPGAs, etc.) info for each size
100+
101+
| Size Name | Accelerators (Qty.) | Accelerator-Memory (GB) |
102+
| --- | --- | --- |
103+
| Standard_ND128isr_NDR_GB300_v6 | 4 | 288 |
104+
105+
---
106+
107+
[!INCLUDE [sizes-footer](../includes/sizes-footer.md)]

0 commit comments

Comments
 (0)