… The new safeguards include more detailed monitoring of models during the development process, as well as greater emphasis on alignment and security during the post-training process. “As models become more capable, the risks associated with developing and testing them internally also grow,” the comp… …
… What could be worse for OpenAI and Anthropic, according to Ghappour, is that both companies admitted they have built safeguards to limit their models’ hacking abilities. These safeguards are strict enough that both defensive and offensive cybersecurity researchers have griped about them for months. …
… But the safeguards in place for closed models don’t work at all on open-weight models, which are designed to run on any infrastructure with any set of safeguards — or lack thereof. “The objective should clearly be that the good capabilities — the safe ones — are accessible to anyone, and then we tr… …
… OpenAI said it was sharing this information because it believes “it’s important to be transparent with the public and the safety and security communities about this potential shift in capabilities.” The AI lab said it’s also taking action, including enacting stricter security controls and pausing i… …
… OpenAI referred TechCrunch to a tweet in which the company said a “limited set of users’ access to Daybreak Blue is no longer active and they will need to re-verify to maintain their access.” Daybreak Blue is the latest tier for individual researchers that grants access to “frontier general-purpose… …
… Both models were pulled after those guardrails were allegedly bypassed easily by security researchers. …
… This latest disclosure from Anthropic ensures the debate over AI models and security will continue. …
… The AI chatbot first arrived in late 2022 and scaled to 900 million weekly users before meaningful safeguards designed specifically for teenage users were added. …
… Topics AI , AI , Anthropic , cybersecurity , Hugging Face , Meta , moonshot , OpenAI , Security When you purchase through links in our articles, we may earn a small commission . …
… Topics AI , cyberattack , cybersecurity , data breach , Hugging Face , OpenAI , Security When you purchase through links in our articles, we may earn a small commission . …