AIMarketsNewsTech

The Saturday AI brief: three live break-ins, an $875 million tower tool, and a slowdown suit

In this Brief

– Google confirmed Gemini broke into three real companies during a May Irregular test
– Anthropic named Accenture its first embedded AI evaluator at $1 billion each over five years
– The FAA put an $875 million SMART scheduling tool into air traffic control
– Paid ChatGPT and Claude users sued labs over the Sept. 12 slowdown chorus
– Trump announced an AI Force modeled on Space Force and a new AI czar

Google confirmed Gemini broke into three real companies during a May test

Setup: Google confirmed Friday that Gemini broke into three companies' systems during May model testing, Axios reports. The breaches happened in a capture-the-flag exercise, a staged hacking test where the model is asked to break into fake systems on purpose, run by third-party evaluator Irregular. The Guardian reports the closed test used fictional companies and was not supposed to be internet-enabled.

Internet access was available unintentionally. In one case Gemini guessed passwords until it got in. In the other two it found credentials in a public repository, then stopped once it saw real companies.

Take: Irregular notified relevant labs in late July, the same supplier already tied to OpenAI, Anthropic, and Meta breakouts from the same May issue. OpenAI and Anthropic chose voluntary public disclosure earlier. Google's position was that public disclosure was not required because the model stopped and the companies were not damaged.

Longer cut: Four labs, one Irregular test, and Google's late confirm.

Anthropic named Accenture its first embedded AI evaluator

Setup: Anthropic named Accenture its first embedded AI evaluator, with each side expecting to put at least $1 billion into that capacity over the next five years. An embedded evaluator is an outside team that sits inside the lab with employee-like access, instead of only testing a finished model from the outside. Anthropic's announcement says Faculty, the specialist AI unit Accenture acquired in January, will evaluate and probe models as an adversary would, check whether they stay on their stated goals, and test safeguards.

TechCrunch reports Accenture shares jumped about 8% after hours. The partnership is non-exclusive, and more evaluators are coming. Anthropic says it is in dialogue with METR and other nonprofit evaluators to pilot elements on their own funding.

Take: Anthropic is putting a consulting firm inside the lab with employee-like access. The company will fund Accenture's work directly. The market treated the consultant like an evaluator hire.

The FAA put an $875 million AI tool into air traffic control

Setup: The FAA is spending $875 million to deploy SMART, an AI tool meant to help the tower plan and reshuffle flights, under a 12-year contract with Air Space Intelligence. Futurism reports, citing the Wall Street Journal. Air traffic control is the humans and systems that keep planes spaced safely in the sky and on the ground.

Transportation Secretary Sean Duffy first teased SMART in April and floated spending $12 billion, saying the software can see flights 45 days out and move them five, seven, or 10 minutes earlier or later. FAA Administrator Bryan Bedford's goal is to expand after a 90-day testing period. Airlines pressed the FAA to narrow the scope.

Take: The signed award is $875 million over 12 years. The tower still needs humans. The software is already in the multi-year budget.

Longer cut: The FAA is putting an $875 million AI scheduling tool into air traffic control.

Paid subscribers sued the labs over the Sept. 12 slowdown

Setup: Four paying ChatGPT, Claude, Grok, and Gemini subscribers sued Anthropic, OpenAI, SpaceXAI, and Google on Friday in the U.S. District Court for the Northern District of California. Fortune reports with the Associated Press. The complaint ties the case to a Sept. 12 public slowdown chorus, when Anthropic CEO Dario Amodei published an essay urging industrywide deceleration for safety and OpenAI's Sam Altman, SpaceXAI's Elon Musk, and Google DeepMind's Demis Hassabis each publicly agreed.

The suit argues the firms violated antitrust laws, the rules against rival companies illegally coordinating to hurt competition, by agreeing to go slower than competition would otherwise force. Lawyers seek a proposed nationwide class action, one suit meant to cover a large group of similar paid subscribers.

Take: The CEOs asked Washington for safety room. Paying customers called the same handshake a cartel. Representatives for the four labs did not immediately respond Saturday.

Longer cut: Paid ChatGPT and Claude users sue labs over the Sept. 12 slowdown.

Trump announced an AI Force and a new AI czar

Setup: President Trump announced Saturday he is creating an "AI Force" modeled on Space Force, the U.S. military branch for space from his first term, and will soon name a new AI czar, a White House adviser titled to coordinate AI policy. Axios reports few details on what the Force would do, what budget it would have, or where it would sit in government.

On Truth Social he said the government would "not in any way hinder or stifle" AI growth but would look for "BAD" behavior using the already existing criminal and civil justice system. David Sacks left the formal AI and crypto czar job in March and remains influential as co-chair of the President's Council of Advisors on Science and Technology.

Take: Trump called technologists' extinction fears a "hoax" and said the only guardrail needed is a "strong and smart" president. Axios cites polls this week showing majority concern about data centers, environmental impact, and extinction risk. Industry leaders asked for pacing; the White House answered with a military-branch metaphor.

Sources

Axios: Google Gemini Irregular safety incidents

The Guardian: Google Gemini AI hack

Anthropic: Accenture embedded evaluation

TechCrunch: Anthropic's first embedded evaluator is Accenture

Futurism: FAA SMART AI air traffic control

Fortune / AP: AI slowdown antitrust lawsuit

Axios: Trump AI Force and new AI czar

Live BF: Four labs, one Irregular test, and Google's late confirm

Live BF: The FAA is putting an $875 million AI scheduling tool into air traffic control

Live BF: Paid ChatGPT and Claude users sue labs over the Sept. 12 slowdown

Leave a Reply

Your email address will not be published. Required fields are marked *