Hardware
Training Host (Required)
| Component | Minimum | Recommended |
|---|
| GPU | AMD RDNA3 | AMD Strix Halo (gfx1151) |
| VRAM/Memory | 24GB | 128GB unified |
| CPU | 8 cores | 16+ cores |
| Storage | 100GB SSD | 500GB+ NVMe |
The AMD Strix Halo’s 128GB unified memory allows loading 7B+ models without quantization.
Windows DEVBOX (Required)
| Component | Requirement |
|---|
| OS | Windows 10/11 (64-bit) |
| Compiler | Visual Studio Build Tools 2022 |
| Network | SSH accessible from training host |
| Storage | 50GB free |
Elastic Controller (Optional)
| Component | Requirement |
|---|
| OS | Linux (Docker support) |
| RAM | 8GB minimum, 16GB recommended |
| Storage | 100GB for Elasticsearch |
Windows VM Pool (Optional)
| Component | Requirement |
|---|
| Hypervisor | Proxmox VE recommended |
| VMs | 2-4 Windows 11 VMs |
| RAM per VM | 4GB minimum |
Software
Training Host
- ROCm 6.0+ (7.0 recommended with TheRock)
- Python 3.10+
- PyTorch 2.1+ (ROCm build)
- Toolbox (Fedora container system)
Windows DEVBOX
- Visual Studio Build Tools 2022
- OpenSSH Server (Windows feature)
- ThreatCheck.exe (optional, for legacy mode)
Elastic Stack (Optional)
- Docker & Docker Compose
- Elastic Stack 8.14+
Network Architecture
Training Host ───SSH──→ Windows DEVBOX
│ │
│ │ (compiled binaries)
│ ▼
└─────────────→ Windows VM Pool
│
│ (Elastic Agent)
▼
Elastic Controller