Tracked topic
Gemma is a family of open-weight language models released by Google for text generation and related NLP tasks.
… Google has also brought its companion app, AI Edge Eloquent , to Mac, which runs dictation and speech‑to‑text locally through the same Edge AI stack. Surprisingly, this software has run flawlessly on my MacBook for a month now, even though it was originally designed for iOS.
… But apparently someone has made an SXM2-to-PCIe adapter, and with that and a cooling mod, the V100 was more than capable of running LLMs locally. The adapter cost another $100, and the fan and local taxed another $35, but for under $250, Hardware Haven made a very serviceable AI accelerator. …