NVIDIA RTX 40 SUPER gets first CUDA core spec rumors Initial specs for RTX 40 SUPER from ‘several weeks’ ago. This week has been filled with a surge of RTX 40 SUPER speculations, culminating in detailed specifications shared by a prominent NVIDIA insider, Kopite7kimi. The disclosed information includes the CUDA core details and potential GPU […]
Nvidia’s already announced a GH200 with 141 GB (presumably for partially defective stacks) of HBM3e. No additional cores enabled but I suspect memory performance is the biggest bottleneck anyway
I wonder if we will also see the full GH100 chip soon.
Its quite scary that the current H100 is actually a cut down chip and is still that powerful
The full GH100 has 10% more cores, 20% more L2 cache and 1 more extra HBM3 stack.
Nvidia’s already announced a GH200 with 141 GB (presumably for partially defective stacks) of HBM3e. No additional cores enabled but I suspect memory performance is the biggest bottleneck anyway
EDIT: And H100 NVL with 96 GB of HBM3