Nvidia Will Spend $26 Billion to Build Open-Weight AI Models, Filings Show
… Nvidia released the first Nemotron model in November 2023. He adds that Nvidia recently finished pretraining a 550-billion-parameter model. Pretraining involves feeding huge quantities of data into a model spread across vast numbers of specialized chips running in parallel. …