Chapter 1 · Part I
Introduction: What You Are Building
The DGX Spark Bundle
The NVIDIA DGX Spark Bundle is two DGX Spark personal AI supercomputers sold together with everything needed to link them into a single distributed cluster.
| Resource | Per Spark | Combined |
|---|---|---|
| GPU | 1× NVIDIA GB10 Blackwell | 2× GPUs |
| GPU Memory | 128GB unified | 256GB unified |
| CPU Cores | 20 (ARM64) | 40 cores |
| Interconnect | — | ConnectX-7 RDMA (QSFP) |
| OS | DGX OS (Ubuntu 24.04.4 LTS) | |
Software Stack
DGX OS
Ubuntu 24.04.4 LTS with NVIDIA-optimized kernel and CUDA 13.0
Kernel 6.17
k3s
Lightweight Kubernetes — full API, minimal footprint, containerd runtime
v1.35.5
GPU Operator
Automatically deploys device plugin, DCGM exporter, container toolkit
NVIDIA Helm
KubeRay
Kubernetes operator managing the distributed Ray cluster lifecycle
Ray 2.49.2
vLLM
High-performance LLM inference — PagedAttention, tensor parallelism, OpenAI API
0.10.1.1
AIBrix
AI inference gateway — routing, multi-tenancy, agent lifecycle management
v0.6.0
Cluster Architecture
Time Estimates
| Chapter | Estimated Time |
|---|---|
| Hardware Setup | 60–90 min |
| CUDA Updates | 30–60 min |
| k3s + GPU Operator | 20–30 min |
| KubeRay | 15–20 min |
| vLLM (incl. model download) | 30–60 min |
| AIBrix | 10–15 min |
| Monitoring | 20–30 min |
| Total | 3–5 hours |