… Meanwhile, the companies did not disclose performance targets for their Jalapeño ASIC, so these claims should be taken with a grain of salt. …
… The AI company claims that so far, Jalapeño is offering "performance per watt substantially better than current state-of-the-art" in chip technology. …
… If these initial claims prove accurate, it could mean we’ll get to see much faster AI development from OpenAI. …
… With the Jalapeño chip, OpenAI claims that it will mark the beginning of their vision of the future of LLM inference. …
… The companies claim that early testing shows Jalapeño will deliver substantially better performance per watt than today’s best systems. …
… OpenAI claims that “early testing shows that Jalapeño will deliver performance per watt substantially better than current state-of-the-art,” but notes that it is not done measuring performance, and that a “detailed technical report will be presented in the coming months.” Until then, we don’t have … …
… OpenAI frames Jalapeño as Gen 1 of a multi-generation roadmap that compounds learnings over time. Gen 2 targets better performance per watt, and Gen 3 aims for economical, low-latency serving, as the architecture unlocks aggregate HBM bandwidth rather than simply adding more raw bandwidth. …
