Tracked topic
… Presumably, AWS doesn’t have enough Graviton3 cores laying around to run the test on C7g instances, but if it did, we presume the wall clock time would come down quite a bit and the scale would go out as far and with about the same steepness. …
… With the HPC7g instances, which are based on the HPC-tuned Graviton3E variant of the AWS-designed Graviton3 processor and which were launched in December 2022 , and with the HPC7a instances based on the custom Genoa Epyc 9R14 processors, which launched in August 2023, AWS did something different. …
… The upshot is that if AWS wants to cover its Trainium and Graviton and Nitro costs, it is going to have to sell systems to the likes of Anthropic and OpenAI, with which it has a deal for 2 gigawatts of Trainium gear, ramping in 2027 and representing maybe $60 billion to $70 billion in datacenter co… …
… And, because AWS is smart with Trainium as it has been with Graviton with core compute, homegrown chips can undercut Nvidia and AMD capacity rentals and still probably run AWS an equal or better operating profit. AWS is in a win-win scenario here, as long as the money holds out. …
… Here is the speedup of the Modular Inference Engine compared to TensorFlow and PyToch on various AWS instances using Intel Xeon SP, AMD Epyc, and Graviton2 instances running on Amazon Web Services: While Modular AI is focusing its attention on the AI sector right now, there is nothing to say that M… …