Never-released GeForce RTX 3080 20GB and Radeon RX 580 16GB now available in China Chinese companies are making new cards from used hardware.  Recently, we have discussed the topic of RTX 4090 GPUs that are currently being disassembled and reassembled as AI-accelerators for the emerging AI market. This has been happening in China for a […]
  • M34L@alien.topBEnglish
    1·
    1 year ago

    It’s for AI acceleration. In AI training (and with LLMs, inference), the VRAM is basically hard limit of the complexity of the AI model you can run on the GPU. 20GB is enough to train some small LLMs, 10GB is not.