Workbench / Online

BUILD YOUR COMPUTE STACK

Start with the model. MuseBoard maps the memory and hardware. Settings are mirrored to the URL, so any configuration can be shared.

Workbench / Online

Model / Qwen 72BMode / EstimateUnits / GB (10⁹ B)

A / Model configuration

ModelAlibaba

Parameters (billions)

Editing the count switches to a custom model with an estimated architecture.

Precision0.5 B / param

Context length8,192 tokens

Batch sizeConcurrent sequences

Workload

Target hardwarePinned

Architecture / published config

Layers: 80
Hidden: 8,192
KV heads: 8 × 128
KV / token: 320 KB

B / Estimated VRAM

Inference

42.7GB

Serving: weights + KV cache + runtime overhead. Estimate — not a guarantee.

Model weights72.7B params × 0.5 B36.4 GB
KV cache8,192 tokens × batch 12.7 GB
Runtime overhead≈10% of weights3.6 GB

Memory headroom

Free after estimated load

Utilization

Target ≤ 90% of 80.0 GB

Decode ceiling

~86 tok/s

Theoretical, batch 1, bandwidth-bound

VRAM usage

42.7 GB / 80.0 GB

0 GB2 × 40 GB

Pinned configuration

2 × NVIDIA A100 40GB

Total VRAM: 80.0 GB
Topology: Single node · TP
Interconnect: NVLink 3 · 600 GB/s
Board power: 800 W

Compatibility / 2 × A100 40GB

Inference
42.7 GB · 53% of 2 × A100 40GB
Ready
Fine-tuning
66.2 GB · 83% of 2 × A100 40GB
Ready
Training
1,299 GB · Needs 40 × A100 40GB (5 nodes)
Cluster

Alternative configurations

MuseBoard gives first-order estimates for planning conversations. It does not replace profiling, capacity testing or detailed ML infrastructure planning.