minus-squareVariantComputers@alien.topBtoApple•Inside Apple’s Big Plan to Bring Generative AI to All Its DeviceslinkfedilinkEnglisharrow-up1·1 year agoWell I don’t know about phone chips but using the metal api the cores in the m1 and up chips are fast enough to run 7B models nearly as fast as gpt4 runs. linkfedilink
Well I don’t know about phone chips but using the metal api the cores in the m1 and up chips are fast enough to run 7B models nearly as fast as gpt4 runs.