Assuming the training software could be run on the hardware and that we could distribute the load as if it was 2023, would it be possible to train a modern LLM on hardware from 1985?
Assuming the training software could be run on the hardware and that we could distribute the load as if it was 2023, would it be possible to train a modern LLM on hardware from 1985?
Do you mean one computer from 1985? No. There is no computer from that year that had enough RAM. If you mean all the computers from 1985, working together, then yes. You only need sufficient RAM, a Turing-complete machine, and probably some centuries to do it.
Yeah - you got it right. I’m looking to see if it was hyoothetically feasible, not whether it was practical. I know it wouldn’t be practical