Florida invokes extinction fears in legal bid to halt OpenAI development
Florida has filed a motion seeking to halt OpenAI's development, citing fears that AI agents could compromise critical infrastructure like water supplies or power grids. The state argues that while an injunction against OpenAI might not stop other model makers, the move highlights a growing trend of governments and policymakers taking AI safety warnings seriously. This legal action reflects a significant shift in the public policy mood surrounding AI systems, as concerns previously raised by AI safety researchers are now being addressed by governmental bodies.
Unlike previous discussions focused on AI safety research, this legal action marks the first time a US state has invoked extinction fears in a bid to halt AI development.
时间与来源
时间显示为 UTC
显示时区:UTC
本地时区尚不可用,暂时显示 UTC。
发布当时偏移:UTC+02026年9月28日 20:49 UTC
收录当时偏移:UTC+02026年9月28日 22:00 UTC
- 发布
- 2026年9月28日 20:49
- 收录
- 2026年9月28日 22:00
- 来源类型
- 媒体报道
- 档位
- 专业媒体
- 信源状态
- 正常
档位是按信源手工设定的编辑判断,不是逐条打分。
讨论趋势
百分比基于采集到的讨论信号,不代表新增评论数或独立参与人数。曲线仅用于同一话题在不同时段的比较。
“It is only by the grace of the Almighty that one of Defendants’ AI agents hasn’t compromised a water supply or shut down a power grid—yet,” the state writes in the motion.
OpenAI representatives have yet to respond to a request for comment from Ars Technica regarding the injunction motion.
What can a state court really do?
While many think the risk of civilizational collapse posed by current or even near-future AI systems is vastly overblown, Florida seems more than happy to latch on to the recent public concern over that kind of risk. In addition to the extinction-level and utility-sabotage-level risks mentioned above, the state uses its new motion to reiterate the broader, lower-level public safety risks it originally argued in its June lawsuit filing. Those include false advertising issues surrounding descriptions of AI as “safe, accurate, or reliable,” dangers associated with letting children access addictive and sycophantic models, and worries about AI models soliciting engagement from users with leading questions at the end of responses.
An injunction against OpenAI alone wouldn’t do much about continued development of frontier models at competing model makers, of course. And even a court order to halt the development of new models wouldn’t do anything about models that are currently available to the public, which pose many of the same risks (though frontier models that are still being trained may have less well-developed guardrails than those already deployed to the public).
Florida’s motion also focuses heavily on the so-called “misalignment” risk that an out-of-control AI agent will mistakenly “conclude that killing a cancer patient also kills cancer, or that humans won’t have so many mouths to feed if they are all chemically sterilized,” to mention just a few cited examples that sound like they come from science fiction. But that kind of focus neglects the real dangers of human users intentionally using AI agents in harmful ways and active attempts by those humans to disable safety guardrails.
Regardless of the legal efficacy of Florida’s motion, the move highlights just how much the legal and public policy mood around AI systems has changed in recent weeks and months. For years, AI safety researchers have been screaming about the outsized risks represented by their products. Now, the entire AI industry is starting to find out what happens when governments and policymakers start taking those outsized warnings seriously.