Skip to content
MUSEBOARD

Workbench / Online

BUILD YOUR COMPUTE STACK

Start with the model. MuseBoard maps the memory and hardware. Settings are mirrored to the URL, so any configuration can be shared.

Compute workbench

Workbench / Online
Model / NeMo 12BUnits / GB (10⁹ B)

A / Model configuration

Mistral AI
B

Editing the count switches to a custom model with an estimated architecture.

Precision0.5 B / param
Context length8,192 tokens
Batch sizeConcurrent sequences
Workload
Pinned

Architecture / published config

Layers
40
Hidden
5,120
KV heads
8 × 128
KV / token
160 KB

B / Estimated VRAM

Inference

8.1GB

Serving: weights + KV cache + runtime overhead. Estimate — not a guarantee.

  • Model weights6.1 GB
  • KV cache1.3 GB
  • Runtime overhead0.61 GB

Memory headroom

23.9 GB

Free after estimated load

Utilization

25%

Target ≤ 90% of 32.0 GB

Decode ceiling

~294 tok/s

Theoretical, batch 1, bandwidth-bound

VRAM usage

8.1 GB / 32.0 GB

0 GB32 GB

Pinned configuration

1 × NVIDIA GeForce RTX 5090

Total VRAM
32.0 GB
Topology
Single GPU
Interconnect
PCIe 5.0
Board power
575 W

Compatibility / 1 × RTX 5090

  • Inference

    8.1 GB · 25% of 1 × RTX 5090

    Ready
  • Fine-tuning

    17.8 GB · 56% of 1 × RTX 5090

    Ready
  • Training

    224.7 GB · Needs 8 × RTX 5090

    Limited

Alternative configurations