what could possibly go wrong

silvermouse

from MIT Technology Review

Why having “humans in the loop” in an AI war is an illusion
—Uri Maoz

AI is starting to shape real wars. It’s at the center of a legal battle between Anthropic and the Pentagon, playing a growing role in the conflict with Iran, and raising questions about how much humans should remain “in the loop.”

Under Pentagon guidelines, human oversight is meant to provide accountability, context, and security. But the idea of “humans in the loop” is a comforting distraction.

The real danger isn’t that machines will act without oversight; it’s that human overseers have no idea what the machines are actually “thinking.” Thankfully, science may offer a way forward.
.....
Despite blacklisting Anthropic, the White House wants its new model
Trump officials are negotiating access to Mythos. (Axios)

• Anthropic said it was too dangerous for a public release. (Bloomberg $)
• Finance ministers are alarmed about the security risks. (BBC)
• The company just rolled out a model that’s less risky than Mythos. (CNBC)

• The Pentagon has pursued a culture war against Anthropic. (MIT
  ....
  A Starlink outage during drone tests exposed the Pentagon’s SpaceX reliance
  It was one of several Navy test disruptions linked to Starlink. (Reuters $)

• The DoD is also tapping Ford and GM for military innovations. (NYT $)
  ....
  “There’s this dark period between now and some time in the future where the advantage is very much offensive AI.”
  —Rob Joyce, former director of cybersecurity at the National Security Agency, tells Bloomberg how AI is creating new hacking threats.
  ....
  Google's Gemini is now generating AI images tailored to personal data
  By analyzing users’ Google services and data. (Quartz)

• Google says it will cut the need for detailed prompts. (TechCrunch)

Rdp77

Hate to say I told ya so….

Well, no I don’t.