GPU Numbers

25 Aug, 2026

NVIDIA numbers

• regs / SM (32 bit): 65,536 (256KB)
• max regs / thread: 255
• max threads / SM: 1,536 (48 warps)
• CUDA cores / SM: 128
• Tensor cores / SM: 4

RTX 5090 numbers

• SM: 170
• CTA / SM: 32 (some reports 24)
• shared memory + L1 / SM: 128 KB
• max shared / CTA: 99 KB

B200 numbers

• SM: 148 (or 144)
• CTA / SM: 32
• shared memory / SM: 228 KB
• max shared / CTA: 227 KB
• max warps / SM = 64 warps (vs 48 warps normal)

#blog #cuda #gpu