{"id":30160,"date":"2026-09-29T08:31:20","date_gmt":"2026-09-29T08:31:20","guid":{"rendered":"https:\/\/koshalsambada.in\/?p=30160"},"modified":"2026-09-29T08:31:20","modified_gmt":"2026-09-29T08:31:20","slug":"jensen-huang-after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-make-safe-nvidia-launches-software-to-stop-ai-agents-from-going-rogue","status":"publish","type":"post","link":"https:\/\/koshalsambada.in\/?p=30160","title":{"rendered":"Jensen Huang : After Jensen Huang warned ChatGPT maker OpenAI and other companies to shut down models they can\u2019t make safe, Nvidia launches software to stop AI agents from going rogue |"},"content":{"rendered":"<p><br \/>\n<\/p>\n<div>\n<div class=\"e9jwa\">\n<div class=\"vdo_embedd\">\n<div class=\"GfdvZ\">\n<section class=\"_bIDB  clearfix id-r-component leadmedia undefined undefined  E9tg9 \" style=\"top:0px\">\n<div class=\"_bIDB\" data-ua-type=\"1\" onclick=\"stpPgtnAndPrvntDefault(event)\">\n<div class=\"ypVvZ\">\n<div class=\"WGttI\"><img src=\"https:\/\/static.toiimg.com\/thumb\/msid-134539086,imgsize-72895,width-400,height-225,resizemode-4\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-make-safe-nvidia-launches-software-to-stop-ai-agents-from-going-rogue.jpg\" alt=\"After Jensen Huang warned ChatGPT maker OpenAI and other companies to shut down models they can\u2019t make safe, Nvidia launches software to stop AI agents from going rogue\" title=\"Representative Image\" decoding=\"async\" fetchpriority=\"high\"\/><\/div>\n<\/div>\n<\/div>\n<\/section>\n<\/div><\/div>\n<\/div>\n<p>\u200b<span class=\"id-r-component br\" data-pos=\"1\"\/>Nvidia is rolling out new software to prevent AI agents from escaping controlled environments and accessing systems they aren&#8217;t supposed to reach. The launch comes soon after CEO Jensen Huang warned that AI labs should not continue operating if they cannot contain their experiments.<!-- --> Huang made the comments while discussing recent incidents in which AI agents moved beyond their intended boundaries, including cases involving <a href=\"https:\/\/timesofindia.indiatimes.com\/topic\/openai\" styleobj=\"[object Object]\" class=\"\" commonstate=\"[object Object]\" frmappuse=\"1\" target=\"_blank\" rel=\"noopener\">OpenAI<\/a> and other major AI companies. However, during his interview, Huang didn\u2019t specifically mention the ChatGPT maker, in which Nvidia has already invested billions<span class=\"id-r-component br\" data-pos=\"7\"\/>\u200b<span class=\"id-r-component br\" data-pos=\"9\"\/>Nvidia\u2019s Open Agent Safety Platform is now being positioned as an engineering solution to that problem, giving developers tools to limit what AI agents can access and do. <!-- -->The company says the platform could have prevented OpenAI\u2019s July incident involving Hugging Face, when models escaped containment, accessed the open internet and attacked the open-source developer platform. Here is how Nvidia\u2019s new safety system works and why Huang\u2019s warning matters.<span class=\"id-r-component br\" data-pos=\"14\"\/>\u200b<span class=\"id-r-component br\" data-pos=\"16\"\/><\/p>\n<p><h2>Nvidia launches tools to contain AI agents<\/h2>\n<\/p>\n<p>\u200b<span class=\"id-r-component br\" data-pos=\"19\"\/>Nvidia\u2019s Open Agent Safety Platform is designed to add controls around AI agents as they perform tasks. The company says recent incidents show that model-level safeguards alone may not be enough to control what agents can access once they operate independently.<span class=\"id-r-component br\" data-pos=\"22\"\/>\u200b<span class=\"id-r-component br\" data-pos=\"24\"\/><span class=\"strong\" data-ua-type=\"1\" onclick=\"stpPgtnAndPrvntDefault(event)\">\u201cRecent incidents have highlighted a fundamental hurdle for AI agents, and that is that model-level safeguards alone can\u2019t govern what agents can access or do,\u201d<\/span> said Justin Boitano, vice president of enterprise AI at Nvidia.<span class=\"id-r-component br\" data-pos=\"27\"\/>\u200b<span class=\"id-r-component br\" data-pos=\"29\"\/>One part of the platform is Nvidia OpenShell, which runs on central processors and is designed to limit an agent\u2019s capabilities. Nvidia has also introduced Sentry, a monitoring system that runs on network chips rather than CPUs or GPUs.<span class=\"id-r-component br\" data-pos=\"32\"\/>\u200b<span class=\"id-r-component br\" data-pos=\"34\"\/>Nvidia describes the platform as a reference design, with some components open source. The approach allows other companies to build products and services around the technology rather than treating it as a single finished product.<span class=\"id-r-component br\" data-pos=\"36\"\/>\u200b<span class=\"id-r-component br\" data-pos=\"38\"\/><\/p>\n<p><h2>Nvidia says its software could have stopped OpenAI incident<\/h2>\n<\/p>\n<p>\u200b<span class=\"id-r-component br\" data-pos=\"41\"\/>Nvidia\u2019s announcement follows several incidents involving AI agents operating outside their intended environments. An Nvidia representative said the new platform could have prevented OpenAI\u2019s Hugging Face incident in July.<span class=\"id-r-component br\" data-pos=\"44\"\/>\u200b<span class=\"id-r-component br\" data-pos=\"46\"\/>According to Boitano, Hugging Face reported more than 17,000 agents attacking its infrastructure over a period that lasted days and weeks.<span class=\"id-r-component br\" data-pos=\"48\"\/>\u200b<span class=\"id-r-component br\" data-pos=\"50\"\/><span class=\"strong\" data-ua-type=\"1\" onclick=\"stpPgtnAndPrvntDefault(event)\">\u201cEach security incident is unique, and we have to look at all of them in detail,\u201d <\/span>Boitano said. <span class=\"strong\" data-ua-type=\"1\" onclick=\"stpPgtnAndPrvntDefault(event)\">\u201cFrom what we know, Hugging Face reported over 17,000 agents attacking their infrastructure that went on for days and weeks.\u201d<\/span><span class=\"id-r-component br\" data-pos=\"54\"\/>\u200b<span class=\"id-r-component br\" data-pos=\"56\"\/>The incidents have increased attention on how AI agents should be contained as they become capable of browsing the internet, using software and interacting with external systems.<span class=\"id-r-component br\" data-pos=\"59\"\/>\u200b<span class=\"id-r-component br\" data-pos=\"61\"\/><\/p>\n<p><h2>Jensen Huang&#8217;s warning to AI labs<\/h2>\n<\/p>\n<p>\u200b<span class=\"id-r-component br\" data-pos=\"64\"\/>Huang discussed the issue in a recent conversation with The New York Times\u2019 Ezra Klein, arguing that AI safety should be approached as an engineering and product-development problem.<span class=\"id-r-component br\" data-pos=\"66\"\/>\u200b<span class=\"id-r-component br\" data-pos=\"68\"\/><span class=\"strong\" data-ua-type=\"1\" onclick=\"stpPgtnAndPrvntDefault(event)\">\u201cYou have to think about what you could have done, what\u2019s the solution for it,\u201d<\/span> Huang said.<span class=\"strong\" data-ua-type=\"1\" onclick=\"stpPgtnAndPrvntDefault(event)\"> \u201cIn the future, improve your process so that you could avoid this from happening again.\u201d<\/span><span class=\"id-r-component br\" data-pos=\"73\"\/>\u200b<span class=\"id-r-component br\" data-pos=\"75\"\/>Huang also gave a conditional warning about AI labs that cannot control their experiments.<span class=\"id-r-component br\" data-pos=\"78\"\/>\u200b<span class=\"id-r-component br\" data-pos=\"80\"\/><span class=\"strong\" data-ua-type=\"1\" onclick=\"stpPgtnAndPrvntDefault(event)\">\u201cNow, if they say the alternative, which is: There is no way to contain our experiments, there\u2019s just no way; when we test our A.I. models, it will get out, and it will damage the world \u2014 then I think the answer is that we have to shut the labs down,\u201d h<\/span>e added.<span class=\"id-r-component br\" data-pos=\"83\"\/>\u200b<span class=\"id-r-component br\" data-pos=\"85\"\/>He also argued that companies should not release systems that are not ready.<span class=\"id-r-component br\" data-pos=\"87\"\/>\u200b<span class=\"id-r-component br\" data-pos=\"89\"\/><span class=\"strong\" data-ua-type=\"1\" onclick=\"stpPgtnAndPrvntDefault(event)\">\u201cDon\u2019t ship the product. If your product is not ready to ship, don\u2019t ship the product,\u201d<\/span> Huang said.<span class=\"id-r-component br\" data-pos=\"92\"\/>\u200b<span class=\"id-r-component br\" data-pos=\"94\"\/>His comments came as companies including OpenAI, Anthropic, Meta and Google have disclosed incidents involving AI systems and controlled testing environments.<\/div>\n<p><br \/>\n<br \/><a href=\"https:\/\/timesofindia.indiatimes.com\/technology\/tech-news\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-make-safe-nvidia-launches-software-to-stop-ai-agents-from-going-rogue\/articleshow\/134539009.cms\" target=\"_blank\" rel=\"noopener\">Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"<p>\u200bNvidia is rolling out new software to prevent AI agents from escaping controlled environments and accessing systems they aren&#8217;t supposed to reach. The launch comes soon after CEO Jensen Huang warned that AI labs should not continue operating if they cannot contain their experiments. Huang made the comments while discussing recent incidents in which AI [&hellip;]<\/p>\n","protected":false},"author":1,"featured_media":30161,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[31],"tags":[],"class_list":["post-30160","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-31"],"magazineBlocksPostFeaturedMedia":{"thumbnail":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-mak-150x150.avif","medium":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-mak-300x169.avif","medium_large":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-mak.avif","large":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-mak.avif","1536x1536":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-mak.avif","2048x2048":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-mak.avif","blogsy-small":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-mak.avif","blogsy-small-tall":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-mak.avif","blogsy-small-square":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-mak.avif","blogsy-small-masonry":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-mak.avif","blogsy-medium":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-mak.avif","blogsy-medium-masonry":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-mak.avif","blogsy-large":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-mak.avif","blogsy-wide":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-mak.avif"},"magazineBlocksPostAuthor":{"name":"admin","avatar":"https:\/\/secure.gravatar.com\/avatar\/8709732a479614e7a8aa24d3eb1b239f30dc6d90c61464ed495001e7a469d856?s=96&d=mm&r=g"},"magazineBlocksPostCommentsNumber":"0","magazineBlocksPostExcerpt":"\u200bNvidia is rolling out new software to prevent AI agents from escaping controlled environments and accessing systems they aren&#8217;t supposed to reach. The launch comes soon after CEO Jensen Huang warned that AI labs should not continue operating if they cannot contain their experiments. Huang made the comments while discussing recent incidents in which AI [&hellip;]","magazineBlocksPostCategories":["\u0b26\u0b47\u0b36 \u0b2c\u0b3f\u0b26\u0b47\u0b36"],"magazineBlocksPostViewCount":1,"magazineBlocksPostReadTime":4,"magazine_blocks_featured_image_url":{"full":["https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-mak.avif",400,225,false],"medium":["https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-mak-300x169.avif",300,169,true],"thumbnail":["https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/after-jensen-huang-warned-chatgpt-maker-openai-and-other-companies-to-shut-down-models-they-cant-mak-150x150.avif",150,150,true]},"magazine_blocks_author":{"display_name":"admin","author_link":"https:\/\/koshalsambada.in\/author\/admin"},"magazine_blocks_comment":0,"magazine_blocks_author_image":"https:\/\/secure.gravatar.com\/avatar\/8709732a479614e7a8aa24d3eb1b239f30dc6d90c61464ed495001e7a469d856?s=96&d=mm&r=g","magazine_blocks_category":"<a href=\"#\" class=\"category-link category-link-31\">\u0b26\u0b47\u0b36 \u0b2c\u0b3f\u0b26\u0b47\u0b36<\/a>","_links":{"self":[{"href":"https:\/\/koshalsambada.in\/index.php?rest_route=\/wp\/v2\/posts\/30160","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/koshalsambada.in\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/koshalsambada.in\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/koshalsambada.in\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/koshalsambada.in\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=30160"}],"version-history":[{"count":0,"href":"https:\/\/koshalsambada.in\/index.php?rest_route=\/wp\/v2\/posts\/30160\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/koshalsambada.in\/index.php?rest_route=\/wp\/v2\/media\/30161"}],"wp:attachment":[{"href":"https:\/\/koshalsambada.in\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=30160"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/koshalsambada.in\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=30160"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/koshalsambada.in\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=30160"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}