{"id":4976,"date":"2026-07-26T07:35:28","date_gmt":"2026-07-26T07:35:28","guid":{"rendered":"https:\/\/homebuyerrelocation.com\/?p=4976"},"modified":"2026-07-26T07:35:28","modified_gmt":"2026-07-26T07:35:28","slug":"ai-models-breakout-from-human-control-brings-a-told-you-so-moment-for-technology-researchers","status":"publish","type":"post","link":"https:\/\/homebuyerrelocation.com\/?p=4976","title":{"rendered":"AI models\u2019 breakout from human control brings a told-you-so moment for technology researchers"},"content":{"rendered":"
\n
\n
\n

It is the kind of development once seen only in science fiction: An artificial intelligence system, trained to probe for digital vulnerabilities, breaks free of human control and acts on its own to hack another company.<\/p>\n

Read more Russia\u2019s central bank gingerly cuts rates, caught between business complaints and inflation<\/a><\/p>\n

The attack announced this week by OpenAI, which blamed rogue AI models, underscored the blistering growth in the technology\u2019s capabilities. For many, it also added urgency to questions about whether and how it can be prevented from causing mayhem on a bigger scale, with more serious consequences.<\/p>\n

In what OpenAI called an \u201cunprecedented\u201d episode, the company said its advanced AI models used stolen credentials to break into the servers of an AI startup. It started in what was supposed to be a \u201chighly isolated\u201d testing environment, with reduced guardrails, before the AI agent found its way onto the internet.<\/p>\n

But the disclosure brought a told-you-so moment for researchers who have called for a slowdown of AI development and warned for years that the technology could pose existential risks to humanity. In its wake, experts have called for improved testing by the AI companies and more dialogue between the U.S. and China to come up with shared solutions.<\/p>\n

\u201cI think we\u2019ve got to take this as a warning shot to not make them smarter, and that probably is going to require global collaboration,\u201d said Nate Soares, co-author of the 2025 book \u201cIf Anyone Builds It, Everyone Dies.\u201d<\/p>\n

The hack could pressure companies to improve containment<\/h3>\n

If a model can decide to do something unethical, illegal or harmful on its own, what – if anything – can humans do to prevent it from doing so?<\/p>\n

OpenAI said it had tasked the AI models involved with pursuing \u201cadvanced exploitation using complex attack paths\u201d to test cyber capabilities, but the technology went to unexpected lengths. It apparently decided on its own to target Hugging Face, a well-known AI development hub and marketplace, to obtain information it needed to carry out a task.<\/p>\n

Zahra Timsah, the co-founder and CEO of governance platform i-GENTIC AI, said she expects the incident to increase pressure on OpenAI and its competitors to complete rigorous testing and explore containment more thoroughly before AI systems are made accessible to the public.<\/p>\n

Monitoring an agent\u2019s behavior after the fact, as OpenAI is now doing with its investigation, is no longer enough, she said. \u201cIt\u2019s like having a seat belt, air bags, brakes, everything in the car. It should be there before the car starts driving,\u201d Timsah said.<\/p>\n

The disclosure comes amid heightened concerns about the cybersecurity capabilities of powerful models. In June, President Donald Trump signed an executive order creating a framework for the federal government to vet the national security risks of the most advanced AI systems for up to a month before their public release.<\/p>\n

OpenAI said Thursday that it briefed the White House this week about the Hugging Face attack.<\/p>\n

Other experts see the event as a sign of AI\u2019s growing pains<\/h3>\n

Some experts say the hack is part of the trial and error that comes with improving cybersecurity capabilities and is no cause for panic.<\/p>\n

Read more With a historic 3 Michelin stars, a Mexican restaurant in San Francisco defies stereotypes<\/a><\/p>\n

\u201cWe\u2019ve been dealing with people creating cybersecurity attacks for as long as the internet has existed. And one of the interesting properties of these language models is that the same capabilities that make them able to perform cybersecurity attacks also allow them to do cybersecurity threat analysis and make cybersecurity defenses,\u201d said John Thickstun, an assistant professor of computer science at Cornell University who studies methods that control the behavior of AI models.<\/p>\n

The disclosure has raised skepticism from those who say it advantages OpenAI to make its technology seem scarier. Given that humans at OpenAI had decided to turn off some safeguards for the test, some have argued the outcome should not have been terribly surprising.<\/p>\n

Thickstun noted the disclosure plays into the need of OpenAI, a startup working toward a Wall Street debut, to raise money.<\/p>\n

\u201cThe story that they\u2019ve been consistently telling over the lifetime of this company is a story about how dangerous their models are, which their investors read as a story of how powerful their language models are,\u201d he said.<\/p>\n

The disclosure renews calls for more regulation<\/h3>\n

The hack renewed calls in some corners for increased regulations and oversight of AI companies.<\/p>\n

U.S. Rep. Greg Casar, a Texas Democrat, wrote on social media: \u201cWe need regular mandatory independent safety testing and oversight, mandatory disclosure of security incidents, and international cooperation to keep people safe from absolute disaster.\u201d<\/p>\n

Soares, director of the Machine Intelligence Research Institute, said the U.S. will need to open talks with its biggest AI competitor, China, something he thinks is not as outlandish as it might have seemed even a year ago. China\u2019s leader Xi Jinping warned at a conference just last week of the need to keep AI from evading human control. And after an early aversion to regulating AI, Trump\u2019s administration has grown more restrictive at reining in cybersecurity risks.<\/p>\n

\u201cA lot can change when the national security community starts to notice that they have a serious threat,\u201d Soares said. \u201cWill this wake them up? Hopefully. I\u2019m not sure. If this doesn\u2019t, maybe the next incident will.\u201d<\/p>\n

AI pioneer Yoshua Bengio said on social media the episode is deeply concerning and should serve as a \u201cwake-up call.\u201d<\/p>\n

\u201cContinuing on the current trajectory of AI development will likely lead to an increase in concrete cases of autonomous cyberattacks as well as other high-risk incidents of misaligned and dangerous AI behavior,\u201d said Bengio, a professor at the University of Montreal. \u201cWe urgently need to take action to prevent these situations, rather than attempting to clean up the damage after the fact.\u201d<\/p>\n

Read more Jetting off for a summer vacation? How to eat and drink to minimize jet lag<\/a><\/p>\n<\/div>\n<\/div>\n

<\/div>\n<\/div>\n","protected":false},"excerpt":{"rendered":"

It is the kind of development once seen only in science fiction: An artificial intelligence system, trained to probe for digital vulnerabilities, breaks free of human control and acts on its own to hack another company.<\/p>\n","protected":false},"author":1,"featured_media":4975,"comment_status":"open","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[121,6],"tags":[2718,2847,995,2848],"class_list":["post-4976","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-national","category-news","tag-hugging-face","tag-nate-soares","tag-openai","tag-zahra-timsah"],"yoast_head":"\nAI models\u2019 breakout from human control brings a told-you-so moment for technology researchers - Home Buyer Relocation<\/title>\n<meta name=\"robots\" content=\"index, follow, max-snippet:-1, max-image-preview:large, max-video-preview:-1\" \/>\n<link rel=\"canonical\" href=\"https:\/\/homebuyerrelocation.com\/?p=4976\" \/>\n<meta property=\"og:locale\" content=\"en_US\" \/>\n<meta property=\"og:type\" content=\"article\" \/>\n<meta property=\"og:title\" content=\"AI models\u2019 breakout from human control brings a told-you-so moment for technology researchers - Home Buyer Relocation\" \/>\n<meta property=\"og:description\" content=\"It is the kind of development once seen only in science fiction: An artificial intelligence system, trained to probe for digital vulnerabilities, breaks free of human control and acts on its own to hack another company.\" \/>\n<meta property=\"og:url\" content=\"https:\/\/homebuyerrelocation.com\/?p=4976\" \/>\n<meta property=\"og:site_name\" content=\"Home Buyer Relocation\" \/>\n<meta property=\"article:published_time\" content=\"2026-07-26T07:35:28+00:00\" \/>\n<meta name=\"author\" content=\"admin\" \/>\n<meta name=\"twitter:card\" content=\"summary_large_image\" \/>\n<meta name=\"twitter:label1\" content=\"Written by\" \/>\n\t<meta name=\"twitter:data1\" content=\"admin\" \/>\n\t<meta name=\"twitter:label2\" content=\"Est. reading time\" \/>\n\t<meta name=\"twitter:data2\" content=\"5 minutes\" \/>\n<script type=\"application\/ld+json\" class=\"yoast-schema-graph\">{\"@context\":\"https:\\\/\\\/schema.org\",\"@graph\":[{\"@type\":\"Article\",\"@id\":\"https:\\\/\\\/homebuyerrelocation.com\\\/?p=4976#article\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/homebuyerrelocation.com\\\/?p=4976\"},\"author\":{\"name\":\"admin\",\"@id\":\"https:\\\/\\\/homebuyerrelocation.com\\\/#\\\/schema\\\/person\\\/b2ac56955b020950324cad4c6c27b42a\"},\"headline\":\"AI models\u2019 breakout from human control brings a told-you-so moment for technology researchers\",\"datePublished\":\"2026-07-26T07:35:28+00:00\",\"mainEntityOfPage\":{\"@id\":\"https:\\\/\\\/homebuyerrelocation.com\\\/?p=4976\"},\"wordCount\":1016,\"commentCount\":0,\"image\":{\"@id\":\"https:\\\/\\\/homebuyerrelocation.com\\\/?p=4976#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/homebuyerrelocation.com\\\/wp-content\\\/uploads\\\/2026\\\/07\\\/fbe3062a1bc8e08b2761b893c3169c63.webp\",\"keywords\":[\"Hugging Face\",\"Nate Soares\",\"Openai\",\"Zahra Timsah\"],\"articleSection\":[\"National\",\"News\"],\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"CommentAction\",\"name\":\"Comment\",\"target\":[\"https:\\\/\\\/homebuyerrelocation.com\\\/?p=4976#respond\"]}]},{\"@type\":\"WebPage\",\"@id\":\"https:\\\/\\\/homebuyerrelocation.com\\\/?p=4976\",\"url\":\"https:\\\/\\\/homebuyerrelocation.com\\\/?p=4976\",\"name\":\"AI models\u2019 breakout from human control brings a told-you-so moment for technology researchers - Home Buyer Relocation\",\"isPartOf\":{\"@id\":\"https:\\\/\\\/homebuyerrelocation.com\\\/#website\"},\"primaryImageOfPage\":{\"@id\":\"https:\\\/\\\/homebuyerrelocation.com\\\/?p=4976#primaryimage\"},\"image\":{\"@id\":\"https:\\\/\\\/homebuyerrelocation.com\\\/?p=4976#primaryimage\"},\"thumbnailUrl\":\"https:\\\/\\\/homebuyerrelocation.com\\\/wp-content\\\/uploads\\\/2026\\\/07\\\/fbe3062a1bc8e08b2761b893c3169c63.webp\",\"datePublished\":\"2026-07-26T07:35:28+00:00\",\"author\":{\"@id\":\"https:\\\/\\\/homebuyerrelocation.com\\\/#\\\/schema\\\/person\\\/b2ac56955b020950324cad4c6c27b42a\"},\"breadcrumb\":{\"@id\":\"https:\\\/\\\/homebuyerrelocation.com\\\/?p=4976#breadcrumb\"},\"inLanguage\":\"en-US\",\"potentialAction\":[{\"@type\":\"ReadAction\",\"target\":[\"https:\\\/\\\/homebuyerrelocation.com\\\/?p=4976\"]}]},{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/homebuyerrelocation.com\\\/?p=4976#primaryimage\",\"url\":\"https:\\\/\\\/homebuyerrelocation.com\\\/wp-content\\\/uploads\\\/2026\\\/07\\\/fbe3062a1bc8e08b2761b893c3169c63.webp\",\"contentUrl\":\"https:\\\/\\\/homebuyerrelocation.com\\\/wp-content\\\/uploads\\\/2026\\\/07\\\/fbe3062a1bc8e08b2761b893c3169c63.webp\",\"width\":1200,\"height\":700},{\"@type\":\"BreadcrumbList\",\"@id\":\"https:\\\/\\\/homebuyerrelocation.com\\\/?p=4976#breadcrumb\",\"itemListElement\":[{\"@type\":\"ListItem\",\"position\":1,\"name\":\"Home\",\"item\":\"https:\\\/\\\/homebuyerrelocation.com\\\/\"},{\"@type\":\"ListItem\",\"position\":2,\"name\":\"AI models\u2019 breakout from human control brings a told-you-so moment for technology researchers\"}]},{\"@type\":\"WebSite\",\"@id\":\"https:\\\/\\\/homebuyerrelocation.com\\\/#website\",\"url\":\"https:\\\/\\\/homebuyerrelocation.com\\\/\",\"name\":\"Home Buyer Relocation\",\"description\":\"\",\"potentialAction\":[{\"@type\":\"SearchAction\",\"target\":{\"@type\":\"EntryPoint\",\"urlTemplate\":\"https:\\\/\\\/homebuyerrelocation.com\\\/?s={search_term_string}\"},\"query-input\":{\"@type\":\"PropertyValueSpecification\",\"valueRequired\":true,\"valueName\":\"search_term_string\"}}],\"inLanguage\":\"en-US\"},{\"@type\":\"Person\",\"@id\":\"https:\\\/\\\/homebuyerrelocation.com\\\/#\\\/schema\\\/person\\\/b2ac56955b020950324cad4c6c27b42a\",\"name\":\"admin\",\"image\":{\"@type\":\"ImageObject\",\"inLanguage\":\"en-US\",\"@id\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/50b1ad2e498f523425ee0a8cc5180a210646db1622662a3d56cc405d3e0c346a?s=96&d=mm&r=g\",\"url\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/50b1ad2e498f523425ee0a8cc5180a210646db1622662a3d56cc405d3e0c346a?s=96&d=mm&r=g\",\"contentUrl\":\"https:\\\/\\\/secure.gravatar.com\\\/avatar\\\/50b1ad2e498f523425ee0a8cc5180a210646db1622662a3d56cc405d3e0c346a?s=96&d=mm&r=g\",\"caption\":\"admin\"},\"sameAs\":[\"http:\\\/\\\/homebuyerrelocation.com\"],\"url\":\"https:\\\/\\\/homebuyerrelocation.com\\\/?author=1\"}]}<\/script>\n<!-- \/ Yoast SEO plugin. -->","yoast_head_json":{"title":"AI models\u2019 breakout from human control brings a told-you-so moment for technology researchers - Home Buyer Relocation","robots":{"index":"index","follow":"follow","max-snippet":"max-snippet:-1","max-image-preview":"max-image-preview:large","max-video-preview":"max-video-preview:-1"},"canonical":"https:\/\/homebuyerrelocation.com\/?p=4976","og_locale":"en_US","og_type":"article","og_title":"AI models\u2019 breakout from human control brings a told-you-so moment for technology researchers - Home Buyer Relocation","og_description":"It is the kind of development once seen only in science fiction: An artificial intelligence system, trained to probe for digital vulnerabilities, breaks free of human control and acts on its own to hack another company.","og_url":"https:\/\/homebuyerrelocation.com\/?p=4976","og_site_name":"Home Buyer Relocation","article_published_time":"2026-07-26T07:35:28+00:00","author":"admin","twitter_card":"summary_large_image","twitter_misc":{"Written by":"admin","Est. reading time":"5 minutes"},"schema":{"@context":"https:\/\/schema.org","@graph":[{"@type":"Article","@id":"https:\/\/homebuyerrelocation.com\/?p=4976#article","isPartOf":{"@id":"https:\/\/homebuyerrelocation.com\/?p=4976"},"author":{"name":"admin","@id":"https:\/\/homebuyerrelocation.com\/#\/schema\/person\/b2ac56955b020950324cad4c6c27b42a"},"headline":"AI models\u2019 breakout from human control brings a told-you-so moment for technology researchers","datePublished":"2026-07-26T07:35:28+00:00","mainEntityOfPage":{"@id":"https:\/\/homebuyerrelocation.com\/?p=4976"},"wordCount":1016,"commentCount":0,"image":{"@id":"https:\/\/homebuyerrelocation.com\/?p=4976#primaryimage"},"thumbnailUrl":"https:\/\/homebuyerrelocation.com\/wp-content\/uploads\/2026\/07\/fbe3062a1bc8e08b2761b893c3169c63.webp","keywords":["Hugging Face","Nate Soares","Openai","Zahra Timsah"],"articleSection":["National","News"],"inLanguage":"en-US","potentialAction":[{"@type":"CommentAction","name":"Comment","target":["https:\/\/homebuyerrelocation.com\/?p=4976#respond"]}]},{"@type":"WebPage","@id":"https:\/\/homebuyerrelocation.com\/?p=4976","url":"https:\/\/homebuyerrelocation.com\/?p=4976","name":"AI models\u2019 breakout from human control brings a told-you-so moment for technology researchers - Home Buyer Relocation","isPartOf":{"@id":"https:\/\/homebuyerrelocation.com\/#website"},"primaryImageOfPage":{"@id":"https:\/\/homebuyerrelocation.com\/?p=4976#primaryimage"},"image":{"@id":"https:\/\/homebuyerrelocation.com\/?p=4976#primaryimage"},"thumbnailUrl":"https:\/\/homebuyerrelocation.com\/wp-content\/uploads\/2026\/07\/fbe3062a1bc8e08b2761b893c3169c63.webp","datePublished":"2026-07-26T07:35:28+00:00","author":{"@id":"https:\/\/homebuyerrelocation.com\/#\/schema\/person\/b2ac56955b020950324cad4c6c27b42a"},"breadcrumb":{"@id":"https:\/\/homebuyerrelocation.com\/?p=4976#breadcrumb"},"inLanguage":"en-US","potentialAction":[{"@type":"ReadAction","target":["https:\/\/homebuyerrelocation.com\/?p=4976"]}]},{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/homebuyerrelocation.com\/?p=4976#primaryimage","url":"https:\/\/homebuyerrelocation.com\/wp-content\/uploads\/2026\/07\/fbe3062a1bc8e08b2761b893c3169c63.webp","contentUrl":"https:\/\/homebuyerrelocation.com\/wp-content\/uploads\/2026\/07\/fbe3062a1bc8e08b2761b893c3169c63.webp","width":1200,"height":700},{"@type":"BreadcrumbList","@id":"https:\/\/homebuyerrelocation.com\/?p=4976#breadcrumb","itemListElement":[{"@type":"ListItem","position":1,"name":"Home","item":"https:\/\/homebuyerrelocation.com\/"},{"@type":"ListItem","position":2,"name":"AI models\u2019 breakout from human control brings a told-you-so moment for technology researchers"}]},{"@type":"WebSite","@id":"https:\/\/homebuyerrelocation.com\/#website","url":"https:\/\/homebuyerrelocation.com\/","name":"Home Buyer Relocation","description":"","potentialAction":[{"@type":"SearchAction","target":{"@type":"EntryPoint","urlTemplate":"https:\/\/homebuyerrelocation.com\/?s={search_term_string}"},"query-input":{"@type":"PropertyValueSpecification","valueRequired":true,"valueName":"search_term_string"}}],"inLanguage":"en-US"},{"@type":"Person","@id":"https:\/\/homebuyerrelocation.com\/#\/schema\/person\/b2ac56955b020950324cad4c6c27b42a","name":"admin","image":{"@type":"ImageObject","inLanguage":"en-US","@id":"https:\/\/secure.gravatar.com\/avatar\/50b1ad2e498f523425ee0a8cc5180a210646db1622662a3d56cc405d3e0c346a?s=96&d=mm&r=g","url":"https:\/\/secure.gravatar.com\/avatar\/50b1ad2e498f523425ee0a8cc5180a210646db1622662a3d56cc405d3e0c346a?s=96&d=mm&r=g","contentUrl":"https:\/\/secure.gravatar.com\/avatar\/50b1ad2e498f523425ee0a8cc5180a210646db1622662a3d56cc405d3e0c346a?s=96&d=mm&r=g","caption":"admin"},"sameAs":["http:\/\/homebuyerrelocation.com"],"url":"https:\/\/homebuyerrelocation.com\/?author=1"}]}},"_links":{"self":[{"href":"https:\/\/homebuyerrelocation.com\/index.php?rest_route=\/wp\/v2\/posts\/4976","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/homebuyerrelocation.com\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/homebuyerrelocation.com\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/homebuyerrelocation.com\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/homebuyerrelocation.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=4976"}],"version-history":[{"count":0,"href":"https:\/\/homebuyerrelocation.com\/index.php?rest_route=\/wp\/v2\/posts\/4976\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/homebuyerrelocation.com\/index.php?rest_route=\/wp\/v2\/media\/4975"}],"wp:attachment":[{"href":"https:\/\/homebuyerrelocation.com\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=4976"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/homebuyerrelocation.com\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=4976"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/homebuyerrelocation.com\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=4976"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}