NVIDIA RTX A6000

Cat. no. gpu-rtx-a6000

Curator note

48 GB on one two-slot, 300 W card: two of them hold a quantised 70B model, four give 192 GB. It is the workstation answer to dense multi-GPU builds, and it costs far more than two used RTX 3090s with the same total VRAM. It is Ampere, so it is slower than a 4090 or 5090. Note the power plug: it takes an 8-pin CPU (EPS) cable, not a PCIe 8-pin, so check your PSU has enough EPS outputs for every card.

No paid placement

Specifications

VRAM	48 GB	Source
Memory bandwidth	768 GB/s	Source
TDP	300 W	Source
Slot width	2 slots	Source
Length	266.7 mm	Source
Power connectors	1x EPS 8-pin	Source

Derived metrics

VRAM/W	0.160 GB/W	Computed
VRAM/slot	24.0 GB	Computed

Used in build tiers

Not part of a build tier yet.