Skip to content
MUSEBOARD

Workbench / Online

BUILD YOUR COMPUTE STACK

Start with the model. MuseBoard maps the memory and hardware. Settings are mirrored to the URL, so any configuration can be shared.

Compute workbench

Workbench / Online
Model / Qwen 3BUnits / GB (10⁹ B)

A / Model configuration

Alibaba
B

Editing the count switches to a custom model with an estimated architecture.

Precision0.5 B / param
Context length8,192 tokens
Batch sizeConcurrent sequences
Workload
Pinned

Architecture / published config

Layers
36
Hidden
2,048
KV heads
2 × 128
KV / token
36 KB

B / Estimated VRAM

Inference

2.0GB

Serving: weights + KV cache + runtime overhead. Estimate — not a guarantee.

  • Model weights1.5 GB
  • KV cache0.30 GB
  • Runtime overhead0.15 GB

Memory headroom

78.0 GB

Free after estimated load

Utilization

3%

Target ≤ 90% of 80.0 GB

Decode ceiling

~2,168 tok/s

Theoretical, batch 1, bandwidth-bound

VRAM usage

2.0 GB / 80.0 GB

0 GB80 GB

Pinned configuration

1 × NVIDIA H100 SXM 80GB

Total VRAM
80.0 GB
Topology
Single GPU
Interconnect
NVLink 4 · 900 GB/s
Board power
700 W

Compatibility / 1 × H100 SXM

  • Inference

    2.0 GB · 3% of 1 × H100 SXM

    Ready

  • Fine-tuning

    9.4 GB · 12% of 1 × H100 SXM

    Ready

  • Training

    61.8 GB · 77% of 1 × H100 SXM

    Ready

Alternative configurations

MuseBoard gives first-order estimates for planning conversations. It does not replace profiling, capacity testing or detailed ML infrastructure planning.