The ratio of how much we should care about train flops versus inference flops: DeepSeek reports that it took about 2.8 million H800 hours to train DeepSeek V3, and they do about 43,000 H800 hours per day, and that's old data, right? This is not recent data. So it's probably much more than that. But even those numbers are about 6x more flops on inference than train for that weight file per year. And if you believe the useful life of a weight file is, I don't know, say 2 years, then it should be 12x more important.
★ In the digest▶ 1:32