• 0 Posts
  • 9 Comments
Joined 11 months ago
cake
Cake day: October 23rd, 2023

help-circle




  • I believe the M2 Max gpu is at the level of a 4070ti at best, but the larger issue is not many tools support metal for compute. On the other hand, all memory is shared on the mac so you (theoretically) get up to 192gigs of video memory, along with the neural engine for basic inferencing and matrix extensions on the CPU.

    Essentially, the max is simultaneously excellent and falling behind in different industries, but you won’t know until you optimize and test your software for the specific usecase, and after that you’re beholden to whatever hardware puts out

    Cuda is well supported and nvidia/amd scale well for different applications, unless apple picks up their software I don’t think the hardware matters much