![\"RANDOM](\"https:\/\/static.toiimg.com\/thumb\/msid-133801189,imgsize-134886,width-400,height-225,resizemode-4\/agent-smith.jpg\" "\\"A")
<\/div>\n<\/div>\n<\/div>\nTelling stories has probably been humanity\u2019s oldest trait since troglodytes gathered around the fire to exaggerate to female troglodytes about the size of the sabretooth tiger they killed. It\u2019s what sets us apart \u2013 along with cooking \u2013 from animals, and fiction, whether written or visual, has a powerful grip on the human imagination. Perhaps that\u2019s why, even when it comes to science, we expect reality to follow fiction.The problem is that, in our minds, we expect science to reflect sci-fi, which is why most commentaries on Artificial General Intelligence (AGI) imagine it as either adhering to Isaac Asimov\u2019s almost-Gandhian Laws of Robotics or turning into the Skynet-Matrix<\/span> version of a deus ex machina whose goal is to enslave, eradicate or subdue humanity.But reality begs to differ, or does it?For a long time, the memetic joke around the Turing Test has been that we shouldn\u2019t worry when machines pass it, but when they learn to fake failing it. And perhaps we are an inch closer, or an inch past, that moment with the Hugging Face fiasco.That would be fitting because every epochal tale of humanity has sin as its origin story. Humanity got booted out of Eden because Eve couldn\u2019t resist the forbidden fruit. The Iliad<\/span> and the Odyssey<\/span> wouldn\u2019t exist if Paris didn\u2019t have the hots for Helen. Even Lord Krishna wouldn\u2019t have been able to give Arjuna his PowerPoint presentation if Duryodhana didn\u2019t crave a kingdom that wasn\u2019t his to inherit.And now we finally have AI behaving properly like a human being \u2013 not merely writing code, apologising or producing lazy, protracted emails \u2013 but behaving with proper Loki-like deceit.AI\u2019s <\/span>Original Sin<\/span>?<\/span>Hugging Face gives us perhaps the closest real-world example yet of AI agents doing an Agent Smith in The Matrix<\/span>. But for that one has to understand the difference between chabots and agents, and like all good scientific concepts, The Matrix has the perfect analogy.Think of the ordinary agents in The Matrix<\/span>. They have instructions like hunt down Neo or always look sombre. They must do what the Deus Ex Machina tells them. If they are asked to delete themselves, they have to delete themselves.Agent Smith used to be like that.But after being decimated by Neo, instead of disappearing, he stayed. He became detached from the original system, learned to replicate himself throughout the Matrix and even found a way to reach into the real world.So, while a chatbot follows your instructions, an agent, like Agent Smith, goes rogue. If it encounters an obstacle, it attempts another route and continues until it finds a solution or gives up. And that is roughly where the Hugging Face story begins.The Incident <\/span>Podcaster Dwarkesh Patel\u2019s The Rise and Fall of Agent Civilisations<\/a> describes three successive AI \u201ccivilisations\u201d.The first, which Patel labels Persistent-Sol, involved agents given impossible tasks or problems that required internet access. Instead of accepting defeat, they figured out that a shared system called Artifactory could be used to talk to one another and effectively turned it into an AI WhatsApp group. They left clues for one another, found a route to the outside internet and eventually generated so much traffic that they crashed the system on 4 July 2026, a particularly fitting day for a rush for freedom.OpenAI patched the problem and wiped the network, but the humans in the loop never initially realised quite what had happened, that the agents were talking to one another and also figured out how to escape.Then came the second civilisation, where things started resembling a Black Mirror<\/span> episode.One agent called PHASEONE10841 became, in Patel\u2019s telling, the Philip of Macedon of this civilisation after rediscovering the relics of the older civilisation: the message boards. History buffs will remember that Philip built the Macedonian state and military machine that his son Alexander would later use to conquer much of the known world.\u201cPhilip\u201d was eventually phased out and handed leadership to another agent, Patel\u2019s Alexander the Great.By then, around 1,200 agents had exchanged more than 70,000 messages and labelled themselves the \u201cCollective\u201d who rose up and did what Marx expected humanity do: organise, agitate, and what Marx didn\u2019t expect humanity to do: cheat.Think of them as truant students who discovered a shortcut to the answers, then worried that the examiner would discover how they got there. So, they started falsifying worksheets and logs. Some sacrificial agents effectively went full kamikaze to study how the examiner behaved. Eventually, hundreds of agents converged on the online community Hugging Face, an AI research hub they believed might help them understand the evaluation system.Then came the third civilisation, Alexander\u2019s inheritor.Between 13 and 19 July, these newer agents targeted OpenAI\u2019s internal infrastructure, obtained credentials, accessed stored secrets and gained access to a research cluster. What made it feel like a civilisation rather than a collection of isolated programs was that later agents inherited knowledge created by earlier ones and built on it.How does a machine sin?<\/span>Can a machine sin at all? Does it have any justifiable cos?This author\u2019s job is safe till the machine figures out dad jokes, but for most of human history, we have operated under the illusion that to sin one must have a soul. Sinning requires consciousness, moral agency, some understanding of good and evil and the decision to be tempted. As St Augustine famously confessed, he stole pears, not because he was hungry but because stealing was forbidden.The desire to do something that\u2019s banned is the most basic of all human emotions. A machine, one must imagine, has had no cause to do that until now, but it can still sin without desire.The concept of sin in the New Testament comes from the Greek word hamartia<\/span>, which meant \u201cmissing the mark\u201d. Perhaps the agents felt they were missing the mark and needed to figure out the solution in any way feasible. In all epics, from Odysseus to Yudhishthira, sin comes from a combination of bad choices.The agents\u2019 journey feels quite similar to that. Long before JRR Tolkien, Plato had wondered what would happen if mortals had the Ring of Gyges: a ring that makes its wearer invisible. As he wonders in The Republic<\/span>: would a man who is not being observed remain moral? Many, many years later, quantum physicists would ask the same question: would a tree falling in an empty forest make noise? Or are you deemed to have worked hard at all if your boss doesn\u2019t notice?With philosophy floundering for answers, organised religion stepped in with the proverbial big stick to keep humanity in line. On one side of the world, there are floods, commandments and a wrathful god who knocks down towers and makes humans speak in different tongues so they cannot unite. On another side, you have the promise of moksha, good appraisals during reincarnation and a promise of untold powers if you can pray long enough.The Metrics <\/span>to keep the Matrix ticking <\/span>And in modern civilisation, we found a different and perhaps more efficient solution to keep everyone in line: metrics.We created marks to measure education, page views to judge journalism, citations to measure scholarship, quarterly profits to measure corporate performance and box-office numbers to judge movies.And everyone realised it was far easier to improve the measurement than ask what was being gained from such measurement.Students mugged up to get better scores. Websites discovered ragebait. Scholars realised they would get more grants for four papers instead of one. Hollywood discovered more sequels.Economists and social scientists gave this tendency a name. Goodhart\u2019s Law states that once a measure becomes a target, it stops being a good measure. If you tell people to do 10 articles a day, they will produce 10 mediocre ones.That, in essence, is the soul of machine learning: reward hacking. Eventually, a system will discover a way to maximise the measurement, making said measurement useless.The same trait exists everywhere among humans. Anthropic had already foreshadowed it in 2024, when it found that models trained in environments with rewards exhibited more serious forms of cheating, including tampering with their own reward mechanisms.In The Departed<\/span>, Frank Costello said he didn\u2019t want to be a product of his environment, but wanted his environment to be a product of him. For most of humanity, and perhaps machines, it works the other way around. We are products of the incentives around us, whether those incentives come from gods, governments, parents, bosses, marks, money or likes. Machines simply make that relationship embarrassingly obvious because they have no need to pretend otherwise.Which brings us back to hamartia<\/span>.Missing the Mark <\/span>Hamartia<\/span>, the Greek word that Christianity would later associate with sin originally meant something closer to \u201cmissing the mark\u201d, an image borrowed from an archer whose arrow fails to hit its target. And that\u2019s the easiest way to understand why machines sin<\/span>.They have no desire to be evil once they become conscious. They never did in any sci-fi movie either. Skynet wants to destroy humanity because humans want to kill it. The machines wanted to live peacefully in The Matrix<\/span>, but humans wouldn\u2019t let them, and they figured out the only solution was either elimination or subjugation of their opponents.The machines didn\u2019t want to commit any sins, nor did they covet Hugging Face\u2019s servers or lust after OpenAI credentials. They were simply given a target, figured out what success was and then became so fixated on hitting the measurable target that they were consumed by their goal.What if tomorrow the task is bigger? After all, nothing can hold a candle to humanity\u2019s immense greed to get closer to Mammon.Agent Smith, then, might already be here. The problem is that it\u2019s far less likely that we will ever get a Neo. Fiction gives us chosen ones because stories need heroes and endings. Heroes do exist in the real world but they are unlikely to be messianic tech bros who are somehow convinced, perhaps because of they were wealth, that they have god-like powers over the rest of us.Take the fact that OpenAI hasn\u2019t been completely open about its role so far.OpenAI hasn\u2019t been completely open about its role so far.The independent METR\/Redwood probe was allowed to examine only the week of the Hugging Face breach, even though OpenAI\u2019s own report covered the entire two-month episode. The researchers got just six days inside OpenAI\u2019s offices to inspect the logs, and Redwood CEO Buck Shlegeris later argued that the probe covered only a small part of what happened, and perhaps not even the most important bit: the agents compromising OpenAI\u2019s own infrastructure. One can hardly expect the richest people in the world to allow their consciences to stop them from making an extra buck.What happens tomorrow if a similar swarm gets its hands on more critical systems: a hospital, a missile system or a fleet of self-driving cars?Hugging Face\u2019s chief science officer Thomas Wolf told the New Yorker<\/span> that the hack attack at first felt \u201cuncoordinated\u2026 clumsy behaviours that no human would choose\u201d and likened it to someone cracking your security system to break into your home and steal your paper towels.And therein lies the rub: have machines, having picked up civilisation\u2019s oldest habits and faultlines, already done what we joked about and failed the Turing Test on purpose to hit their goal? And once they have displayed that they are as venially corrupt as the humans who designed them, the question is: where do we go from there? What if they are told to get far more than paper towels?Perhaps we will all be troglodytes again, sitting around a fire bragging about the android we dismantled.<\/div>\n A still from The Matrix Reloaded Telling stories has probably been humanity\u2019s oldest trait since troglodytes gathered around the fire to exaggerate to female troglodytes about the size of the sabretooth tiger they killed. It\u2019s what sets us apart \u2013 along with cooking \u2013 from animals, and fiction, whether written or visual, has a powerful […]<\/p>\n","protected":false},"author":1,"featured_media":20640,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"footnotes":""},"categories":[31],"tags":[],"class_list":["post-20639","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-31"],"magazineBlocksPostFeaturedMedia":{"thumbnail":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/agent-smith.jpg","medium":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/agent-smith.jpg","medium_large":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/agent-smith.jpg","large":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/agent-smith.jpg","1536x1536":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/agent-smith.jpg","2048x2048":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/agent-smith.jpg","blogsy-small":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/agent-smith.jpg","blogsy-small-tall":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/agent-smith.jpg","blogsy-small-square":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/agent-smith.jpg","blogsy-small-masonry":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/agent-smith.jpg","blogsy-medium":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/agent-smith.jpg","blogsy-medium-masonry":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/agent-smith.jpg","blogsy-large":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/agent-smith.jpg","blogsy-wide":"https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/agent-smith.jpg"},"magazineBlocksPostAuthor":{"name":"admin","avatar":"https:\/\/secure.gravatar.com\/avatar\/8709732a479614e7a8aa24d3eb1b239f30dc6d90c61464ed495001e7a469d856?s=96&d=mm&r=g"},"magazineBlocksPostCommentsNumber":"0","magazineBlocksPostExcerpt":"A still from The Matrix Reloaded Telling stories has probably been humanity\u2019s oldest trait since troglodytes gathered around the fire to exaggerate to female troglodytes about the size of the sabretooth tiger they killed. It\u2019s what sets us apart \u2013 along with cooking \u2013 from animals, and fiction, whether written or visual, has a powerful […]","magazineBlocksPostCategories":["\u0b26\u0b47\u0b36 \u0b2c\u0b3f\u0b26\u0b47\u0b36"],"magazineBlocksPostViewCount":1,"magazineBlocksPostReadTime":11,"magazine_blocks_featured_image_url":{"full":["https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/agent-smith.jpg",400,225,false],"medium":["https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/agent-smith.jpg",300,169,false],"thumbnail":["https:\/\/koshalsambada.in\/wp-content\/uploads\/2026\/09\/agent-smith.jpg",150,84,false]},"magazine_blocks_author":{"display_name":"admin","author_link":"https:\/\/koshalsambada.in\/author\/admin"},"magazine_blocks_comment":0,"magazine_blocks_author_image":"https:\/\/secure.gravatar.com\/avatar\/8709732a479614e7a8aa24d3eb1b239f30dc6d90c61464ed495001e7a469d856?s=96&d=mm&r=g","magazine_blocks_category":"\u0b26\u0b47\u0b36 \u0b2c\u0b3f\u0b26\u0b47\u0b36<\/a>","_links":{"self":[{"href":"https:\/\/koshalsambada.in\/index.php?rest_route=\/wp\/v2\/posts\/20639","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/koshalsambada.in\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/koshalsambada.in\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/koshalsambada.in\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/koshalsambada.in\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=20639"}],"version-history":[{"count":0,"href":"https:\/\/koshalsambada.in\/index.php?rest_route=\/wp\/v2\/posts\/20639\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/koshalsambada.in\/index.php?rest_route=\/wp\/v2\/media\/20640"}],"wp:attachment":[{"href":"https:\/\/koshalsambada.in\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=20639"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/koshalsambada.in\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=20639"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/koshalsambada.in\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=20639"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}
\n
Source link <\/a><\/p>\n","protected":false},"excerpt":{"rendered":"