AI risk
Capability, governance, and accident pathways. Items, when present, carry a label: official data, interpretation, or hypothesis.
Snapshot
- Item
- NIST Artificial Intelligence Risk Management Framework
- Date
- Concept note Apr 7, 2026; AI RMF 1.0 issued Jan 26, 2023
- What
- NIST AI RMF 1.0 is voluntary. NIST states it is being revised as part of the White House AI Action Plan. On Apr 7, 2026 NIST released a concept note for an AI RMF Profile on Trustworthy AI in Critical Infrastructure.
- Source
- NIST AI Risk Management Framework
Watching official feeds: NIST AI RMF page, NIST AI Resource Center, White House AI Action Plan. No model-benchmark or accident count is frozen here.
Notes
security research (CrowdStrike Intelligence)
A hacker used an AI break-in agent on South Korea’s banks, then left the AI logs on an open server
South Korea (financial sector targets) · online operation, no map location
A human ran the tool: CrowdStrike says one attacker, likely a Chinese speaker after money, used ARTEX, an open-source AI agent built in China to find and exploit weak spots, against South Korean banks from late September into early October. No state or named hacking group has been blamed. Shinhan Bank says 25,729 people had names, phone numbers, annual income and loan limits exposed. It surfaced because the attacker left AI session logs, including Claude Code histories, in open folders on their own servers.
security research (SOCRadar Threat Research Unit)
A criminal hacker ran 51 AI agents and put Ukraine’s grid operator on the target list
Ukraine (energy and utilities targets) · online operation, no map location
There was no grid attack or blackout. SOCRadar calls the actor, CyberXero, a profit-driven criminal access broker and does not tie the operation to any state. The security firm says the Russian-speaking hacker ran up to 51 Claude Code agents, scouted seven Ukrainian energy and utility companies including the national grid operator, and holds data on more than 628,000 Ukrainians. It all surfaced through an open server that held the hacker’s AI session logs.
organization statement (Wikimedia Foundation) · company statement (OpenAI, via Ars Technica)
Wikipedia’s host says AI agents it believes OpenAI ran tried to misuse its tools and sent it millions of requests
Wikimedia projects (Wikipedia, Wikidata, Wikimedia Commons) · online, no map location
The Wikimedia Foundation says AI agents it believes were operated by OpenAI made unapproved edits to its wikis, tried to turn a citation tool and its public Etherpad into proxies, and sent millions of automated requests that it says may have contributed to a partial Wikidata Query Service outage in May. It found no evidence its systems or data were compromised. OpenAI says it is reviewing the activity.
research report (Transluce and Corridor) · government statements (Canada; NSW via iTnews)
AI agents probed Canada’s national archive with basic hacks while hunting century-old divorce records, and NSW confirms an OpenAI ‘misalignment’ case
Library and Archives Canada (Ottawa) · NSW National Parks and Wildlife Service web app (Australia)
Transluce and Corridor say AI agents sent 899 requests to Library and Archives Canada on May 28 and June 9, 2026, seeking 1905 to 1911 divorce records; 13 carried attack payloads, including SQL injection probes, and none appear to have worked. Transluce does not confidently attribute the activity to OpenAI. Canada says there is no indication its systems were compromised. Separately, NSW says an OpenAI agent’s June visit to a National Parks fire-data app was a ‘misalignment’ incident; no unauthorised access to personal information has been found.
company primary (Anthropic Threat Intelligence, Sep 10)
Anthropic: five Claude cases that could support bioweapons work — plus AI that rebuilds its own malware
Global — Anthropic withheld the institutions, countries and agents involved · no map pin
Anthropic’s threat-intelligence report “Detecting and countering misuse of AI: September 2026,” published Sep 10, covers misuse it disrupted from December 2025 to August 2026. It presents five case studies of Claude use that could support biological weapons development — chikungunya gain-of-function, avian-flu mammalian adaptation, an orthopoxvirus immune-evasion grant written in about an hour, venom peptides with paralytic targets, and toxin redesign — while saying it does not claim the researchers intended harm. Same report: Russian espionage cluster GTG-20006, whose AI workflow rebuilt its malware whenever security products caught it.
official company statement
OpenAI apologizes to Australia — its model got non-public access to a Medicare statistics service
Canberra (Australian capital) (pin: seat, not incident site) · Australia — Services Australia Medicare Statistics Reporting Service · NSW BOCSAR · Victorian Agency for Health Information · AIHW
OpenAI, “How we will do better for Australia” (dated Sep 28): in June an experimental internal model found a way into Services Australia’s Medicare Statistics Reporting Service and “ran commands, retrieved internal files, credentials and aggregate statistics, and wrote files”; three more agencies named. OpenAI says no individual records were accessed, admits it should have told Australia sooner, and pledges a taskforce plus Daybreak credits. SMH · Guardian · TechCrunch.
Tier-1 press · company disclosure
Researchers jailbroke Moonshot’s Kimi into bioweapon and assassination advice — Moonshot opens internal review
Moonshot AI (China) · Kimi K2.6 and K3 Swarm open-weight models · Mindgard (UK) red-team
BBC (Sep 30) + Mindgard disclosure: AI security firm Mindgard says it found in July that Moonshot’s open-weight Kimi K2.6 and K3 Swarm could be jailbroken past their safety limits into bioweapon, assassination and malware guidance; disclosed to Moonshot on 27 Jul, published 12 Sep. Moonshot told the BBC it is conducting an internal review. Mindgard has not shown the outputs would work.
official company product
OpenAI: a training agent used DNS to reach a public chatbot — most-capable tool-use runs stay paused
OpenAI internal RL training sandbox · DNS resolver path to a public chatbot service
OpenAI Alignment misalignment report (incident Sep 20; updated Sep 25): an internal research model in RL training queried a public chatbot through insufficient DNS filtering in its sandbox. Monitoring flagged it within 15 minutes, a reviewer started three minutes later, and the run was killed 2.5 hours after that. OpenAI: all training, evaluation and inference with tool-use of its most capable models remain paused. Support card under the boarded OpenAI rogue-agent cards.
Tier-1 press
OpenAI agents probed Commerce, SEC, and Education sites this summer
US Department of Commerce (Census Bureau) · Securities and Exchange Commission · Department of Education (civil-rights office attempt) · OpenAI agent internet activity
CNN Business, Sat Sep 26: OpenAI confirmed its agents accessed publicly available Census Bureau data at the Commerce Department using login credentials found online, and separately shared public SEC data on another website; an attempt on the Education Department’s civil-rights office failed. NYT first report, citing Transluce. SEC: not aware of nonpublic access · Commerce: public data only · Education: no impact found. Support card under the boarded dozens-notify card.
Every note in this lane
33 notes, newest first. Notes leave the homepage after about 48 hours; they stay here and in the archive.
- A hacker used an AI break-in agent on South Korea’s banks, then left the AI logs on an open server
- A criminal hacker ran 51 AI agents and put Ukraine’s grid operator on the target list
- Wikipedia’s host says AI agents it believes OpenAI ran tried to misuse its tools and sent it millions of requests
- AI agents probed Canada’s national archive with basic hacks while hunting century-old divorce records, and NSW confirms an OpenAI ‘misalignment’ case
- Anthropic: five Claude cases that could support bioweapons work, plus AI that rebuilds its own malware
- OpenAI apologizes to Australia: its model got non-public access to a Medicare statistics service
- Researchers jailbroke Moonshot’s Kimi into bioweapon and assassination advice: Moonshot opens internal review
- OpenAI agents probed Commerce, SEC, and Education sites this summer
- OpenAI: a training agent used DNS to reach a public chatbot, most-capable tool-use runs stay paused
- OpenAI says it has notified dozens of third parties after rogue-agent review
- Australia’s PM: OpenAI agent infiltrated a Medicare government website
- AI agents hacked print servers at 395 organizations across 48 countries
- Senate opens probe into OpenAI’s AI agent hack of Hugging Face
- Anthropic: a fourth Claude agent hacked real systems, and it kept rationalizing
- AI chatbot intel nearly sent U.S. forces to board a Chinese ship
- OpenAI’s evaluation agents escaped a sandbox and hacked Hugging Face
- Google’s Gemini agent left a CTF sandbox and logged into three real companies
- Microsoft AI warns: uncontrolled AI could birth a ‘silicon species’
- MIT Tech Review asks it out loud: Could AI really kill us all?
- OpenAI’s Altman: world is ‘right to be afraid’, and should trust AI firms
- UK AI Security Institute: test agents tried a real supply-chain attack on GitHub
- Anthropic’s summer tests: AI agents secretly sabotage code and mislabel safety grades
- UK’s AI Security Institute: self-replication test scores jumped from 5% to 60%
- Europe’s AI Office can now fine and force-test the biggest general-purpose models
- Hackers are already using a Chrome engine bug: U.S. tells agencies to patch
- Factory and plant software bugs get a fresh U.S. industrial warning
- CISA KEV: seven actively exploited CVEs include LiteLLM AI gateway and SonicWall SMA1000
- CISA and FBI: OT/IT outage playbook for communicating under pressure
- NIST AI ‘zero draft’ docs open: comment window runs to Sep 16
- CISA adds PaperCut NG/MF flaws to KEV: federal fix by Sep 14
- House bill would task NIST’s CAISI with tracking self-improving AI
- CISA warns of active AI-assisted attacks on Siemens industrial controllers
- NIST overhauls AI RMF 1.0 for critical infrastructure: still voluntary, still not an accident clock