… While Nvidia’s chips and systems are better on most fronts, Trainium2 fits perfectly into Anthropic’s roadmap. They’re the most aggressive AI Lab on scaling post-training techniques like Reinforcement Learning . Their roadmap is more memory-bandwidth-bound than FLOPs bound. …
… We are on the cusp of 12-high HBM becoming the mainstream configuration Adding more HBM stacks per package adds more bandwidth and capacity Here we can see this in Nvidia’s roadmap. …
… With this announcement, all of Nvidia’s competitors will be sent back to the drawing board to reconfigure their entire roadmaps again in a repeat of how Oberon changed roadmaps across the industry. …
… Nvidia and Huawei: Blackwell and the H20 The US government previously banned the Nvidia H20 chip from going into China, but recently indicated that Nvidia will be granted a license to be able to export the chip. …
… The isolation boundaries should be on VLANs and each tenant getting their own Kubernetes cluster. https://www.wiz.io/blog/nvidia-ai-vulnerability-deep-dive-cve-2024-0132 https://www.wiz.io/blog/wiz-research-critical-nvidia-ai-vulnerability https://nvidia.custhelp.com/app/answers/detail/a id/5614 ht… …