{"author":"sbulaev","children":[{"author":"insin","children":[{"author":"senorrib","children":[],"created_at":"2026-10-03T10:40:18.000Z","created_at_i":1791024018,"id":49943011,"options":[],"parent_id":49942996,"points":null,"story_id":49942865,"text":"I&#x27;m glad I&#x27;m not the only one that feels like this whole article is a waste of time.","title":null,"type":"comment","url":null},{"author":"raldi","children":[{"author":"theodric","children":[{"author":"bentobean","children":[{"author":"xyzsparetimexyz","children":[],"created_at":"2026-10-03T11:15:00.000Z","created_at_i":1791026100,"id":49943205,"options":[],"parent_id":49943111,"points":null,"story_id":49942865,"text":"Well thats another way in which Data is different and more worthy of being considered sentient. He&#x27;s unique and not one of a fungible many.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T10:57:28.000Z","created_at_i":1791025048,"id":49943111,"options":[],"parent_id":49943041,"points":null,"story_id":49942865,"text":"\u201cgive him the freedom\u201d - I think you mean pay for the tokens.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T10:45:08.000Z","created_at_i":1791024308,"id":49943041,"options":[],"parent_id":49943025,"points":null,"story_id":49942865,"text":"&quot;Does Data have a soul? I don\u2019t know that he has. I don\u2019t know that I have. But I have got to give him the freedom to explore that question himself.&quot;","title":null,"type":"comment","url":null},{"author":"ACCount39","children":[{"author":"hardbass","children":[],"created_at":"2026-10-03T11:04:28.000Z","created_at_i":1791025468,"id":49943150,"options":[],"parent_id":49943046,"points":null,"story_id":49942865,"text":"Don&#x27;t discount a lot of naked dualism in many people. Unfortunately it seems so here given the cagey answers or downright denials from many I get despite trying various wordings.","title":null,"type":"comment","url":null},{"author":"yoz-y","children":[{"author":"akie","children":[{"author":"YurgenJurgensen","children":[],"created_at":"2026-10-03T13:32:30.000Z","created_at_i":1791034350,"id":49944110,"options":[],"parent_id":49943212,"points":null,"story_id":49942865,"text":"Once again:  The Turing test requires a knowledgeable interrogator deliberately attempting to identify the machine.<p>The people you cite want to believe, and so are effectively the opposite.<p>Of course, you probably already knew this and have had it explained to you multiple times and are choosing to ignore this detail, but possible that someone else reading this might interpret what you wrote as a cogent argument.","title":null,"type":"comment","url":null},{"author":"yoz-y","children":[],"created_at":"2026-10-03T13:37:42.000Z","created_at_i":1791034662,"id":49944151,"options":[],"parent_id":49943212,"points":null,"story_id":49942865,"text":"I disagree. For me this shows that people can fall in love with a non-human, and being human is unnecessary for the purpose of giving (some) therapy advice.<p>LLMs do sound human, I\u2019m not contesting that. But if pressed they will not react as humans. There is an infinite amount of questions that an LLM will answer for which a human would give you a blank stare, told you to shove it or call the police.","title":null,"type":"comment","url":null},{"author":"lovich","children":[{"author":"Topfi","children":[],"created_at":"2026-10-03T14:31:52.000Z","created_at_i":1791037912,"id":49944613,"options":[],"parent_id":49944480,"points":null,"story_id":49942865,"text":"I\u2019d get it, if it were a building of significance, but scrap metal [0] is a bit weird to me.<p>[0] <a href=\"https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Victor_Lustig\" rel=\"nofollow\">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Victor_Lustig</a>","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T14:17:32.000Z","created_at_i":1791037052,"id":49944480,"options":[],"parent_id":49943212,"points":null,"story_id":49942865,"text":"While I think that the Turing test has effectively been passed, someone falling in love with AI isn\u2019t a strong argument given there\u2019s people who have done things like marry the Eiffel Tower[1]<p>[1] <a href=\"https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Erika_Eiffel\" rel=\"nofollow\">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Erika_Eiffel</a>","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T11:16:03.000Z","created_at_i":1791026163,"id":49943212,"options":[],"parent_id":49943187,"points":null,"story_id":49942865,"text":"I think it&#x27;s pretty clear that the Turing test has been passed. People use AI as therapists, they fall in love with it, all while knowing that it&#x27;s a piece of software.","title":null,"type":"comment","url":null},{"author":"Topfi","children":[],"created_at":"2026-10-03T11:43:54.000Z","created_at_i":1791027834,"id":49943368,"options":[],"parent_id":49943187,"points":null,"story_id":49942865,"text":"Good old ELIZA doesn\u2019t do that bad on the Turing Test, for all its historic significance, it really shouldn\u2019t be invoked in discussions about LLMs [0] and has been beaten by all manner of models.<p>[0] <a href=\"https:&#x2F;&#x2F;arxiv.org&#x2F;html&#x2F;2503.23674v1\" rel=\"nofollow\">https:&#x2F;&#x2F;arxiv.org&#x2F;html&#x2F;2503.23674v1</a>","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T11:12:08.000Z","created_at_i":1791025928,"id":49943187,"options":[],"parent_id":49943046,"points":null,"story_id":49942865,"text":"The conversation varies between \u201ccan\u2019t be\u201d and \u201cisn\u2019t\u201d.<p>Most sci-fi AIs are way beyond our current models. I\u2019ve yet to see one that would actually pass a Turing test (that said, I\u2019ve not tried models that were post trained to actually try to behave like a human).<p>Consciousness itself is a term that is not really defined anyway, so depending on each\u2019s take the answer will be different.","title":null,"type":"comment","url":null},{"author":"dsr_","children":[{"author":"Topfi","children":[{"author":"ThrowawayR2","children":[{"author":"Topfi","children":[{"author":"dsr_","children":[],"created_at":"2026-10-03T16:24:53.000Z","created_at_i":1791044693,"id":49945602,"options":[],"parent_id":49944652,"points":null,"story_id":49942865,"text":"Clever Hans fooled lots of examiners who weren&#x27;t expecting a fraud, but the facts came out when better experiments were designed. Hans couldn&#x27;t count or do arithmetic, and he got the same wrong answers as his owner.<p>ESP fooled lots of people who were expecting frauds but had no experience in experimental design, or who were not expecting frauds and did not control for them.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T14:35:14.000Z","created_at_i":1791038114,"id":49944652,"options":[],"parent_id":49943415,"points":null,"story_id":49942865,"text":"Might be, though I\u2019d be surprised to see the connection between pseudoscience like ESP and actually evidence based arguments like Clever Hans\u2026","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T11:50:12.000Z","created_at_i":1791028212,"id":49943415,"options":[],"parent_id":49943246,"points":null,"story_id":49942865,"text":"He&#x27;s probably referring to the <a href=\"https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Clever_Hans\" rel=\"nofollow\">https:&#x2F;&#x2F;en.wikipedia.org&#x2F;wiki&#x2F;Clever_Hans</a> incident.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T11:21:31.000Z","created_at_i":1791026491,"id":49943246,"options":[],"parent_id":49943196,"points":null,"story_id":49942865,"text":"I\u2019ll probably regret this, but what heinous crimes did horses commit to warrant inclusion into such an eclectic list?","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T11:13:09.000Z","created_at_i":1791025989,"id":49943196,"options":[],"parent_id":49943046,"points":null,"story_id":49942865,"text":"... whereas I have 35 years of reading science fiction and philosophy and have come to the conclusion that AIs deserve personhood, and also that what we have today are not AIs.<p>It helps that I also learned about ESP, EST, NLP, short cons, long cons, Scientology, horses, cults, religions, wars, treachery, fanaticism, magic, magick, physics, scams, hypnosis, self-hypnosis, delusion, and economics.","title":null,"type":"comment","url":null},{"author":"ThrowawayR2","children":[],"created_at":"2026-10-04T16:44:24.000Z","created_at_i":1791132264,"id":49955484,"options":[],"parent_id":49943046,"points":null,"story_id":49942865,"text":"Sci-fi has mulled space travel for decades too and converged to an answer that we will be zipping around the galaxy using FTL hyperdrives, landing on alien planets that conveniently happen to have a breathable atmosphere and no weird diseases, and finding sapient species that coincidentally look exactly like humans in funny makeup.  So much for sci-fi.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T10:46:14.000Z","created_at_i":1791024374,"id":49943046,"options":[],"parent_id":49943025,"points":null,"story_id":49942865,"text":"It&#x27;s funny how sci-fi has mulled over the exact scenario for decades, and even converged to an answer - but when reality came knocking and it was no longer a far off future world hypothetical, all of it was forgotten overnight.<p>The power of wishful thinking is too strong. &quot;Today&#x27;s AI can&#x27;t be conscious because I don&#x27;t want it to be.&quot;","title":null,"type":"comment","url":null},{"author":"crooked-v","children":[{"author":"raldi","children":[{"author":"rpastuszak","children":[],"created_at":"2026-10-03T10:58:11.000Z","created_at_i":1791025091,"id":49943115,"options":[],"parent_id":49943080,"points":null,"story_id":49942865,"text":"Let\u2019s wait and see!","title":null,"type":"comment","url":null},{"author":"ThrowawayR2","children":[],"created_at":"2026-10-03T11:55:16.000Z","created_at_i":1791028516,"id":49943458,"options":[],"parent_id":49943080,"points":null,"story_id":49942865,"text":"Libraries worth of hypothetical future predictions have been made, almost none of which came true.  There is no reason to give a hoot about any &quot;hypothetical future&quot; handwaving unless and until it arrives.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T10:52:39.000Z","created_at_i":1791024759,"id":49943080,"options":[],"parent_id":49943055,"points":null,"story_id":49942865,"text":"And what might that look like in a hypothetical future where the successors of today&#x27;s LLMs really do reach that bar and convince you?","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T10:48:18.000Z","created_at_i":1791024498,"id":49943055,"options":[],"parent_id":49943025,"points":null,"story_id":49942865,"text":"I think step one well before getting to the hard problem of sapience would be showing he had consistent desires and consistent understanding of the world, which would be easy for Data and very hard for even the fanciest current LLMs.","title":null,"type":"comment","url":null},{"author":"ricksunny","children":[],"created_at":"2026-10-03T10:51:03.000Z","created_at_i":1791024663,"id":49943070,"options":[],"parent_id":49943025,"points":null,"story_id":49942865,"text":"There was at least one TNG episode devoted to this - The Measure of a Man - a courtroom drama.","title":null,"type":"comment","url":null},{"author":"Ygg2","children":[{"author":"gus_massa","children":[],"created_at":"2026-10-03T11:14:53.000Z","created_at_i":1791026093,"id":49943204,"options":[],"parent_id":49943075,"points":null,"story_id":49942865,"text":"Clippit made random animations from time to time. Was it conscious?<p>You can blame MS for adding a prng in the code. But imagine an LLM that check from time to time the price of electricity and GPU available and decide to change the internal mode of launch activities in a TODO list, or use spare capacity to generate a random tunes that you like to hear while prompting.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T10:51:56.000Z","created_at_i":1791024716,"id":49943075,"options":[],"parent_id":49943025,"points":null,"story_id":49942865,"text":"If I left him alone in a room would he stare off like a Zombie until prompted?","title":null,"type":"comment","url":null},{"author":"Sharlin","children":[{"author":"HappySweeney","children":[{"author":"bentobean","children":[{"author":"HappySweeney","children":[{"author":"argee","children":[{"author":"Sharlin","children":[],"created_at":"2026-10-05T19:46:26.000Z","created_at_i":1791229586,"id":49969654,"options":[],"parent_id":49946164,"points":null,"story_id":49942865,"text":"But their goal system wasn&#x27;t built by humans for a specific purpose.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T17:38:23.000Z","created_at_i":1791049103,"id":49946164,"options":[],"parent_id":49943626,"points":null,"story_id":49942865,"text":"&gt; One assumes the computer is built to never really care about not being in service of Starfleet.<p>There was a time when this same assumption was applied to African Americans.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T12:17:13.000Z","created_at_i":1791029833,"id":49943626,"options":[],"parent_id":49943147,"points":null,"story_id":49942865,"text":"I couldn&#x27;t really say, likely no, but they did let it pursue it&#x27;s own inscrutable interests without interference for the episode.  One assumes the computer is built to never really care about not being in service of Starfleet.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T11:03:57.000Z","created_at_i":1791025437,"id":49943147,"options":[],"parent_id":49943129,"points":null,"story_id":49942865,"text":"Could the ship\u2019s computer resign from Star Fleet and go do something else?","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T11:01:04.000Z","created_at_i":1791025264,"id":49943129,"options":[],"parent_id":49943120,"points":null,"story_id":49942865,"text":"There was a whole episode on how it actually was.","title":null,"type":"comment","url":null},{"author":"Ekaros","children":[],"created_at":"2026-10-03T18:43:03.000Z","created_at_i":1791052983,"id":49946653,"options":[],"parent_id":49943120,"points":null,"story_id":49942865,"text":"Or every single holoprogram that computer runs... Well they seem to be vary lot depending on writing and the hamfisted message the specific episodes want to deliver. Still it is fair comparison...","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T10:59:28.000Z","created_at_i":1791025168,"id":49943120,"options":[],"parent_id":49943025,"points":null,"story_id":49942865,"text":"Could the ship computer? It converses in natural language but presumably isn\u2019t sapient in the ST universe.","title":null,"type":"comment","url":null},{"author":"omnicognate","children":[],"created_at":"2026-10-03T11:25:46.000Z","created_at_i":1791026746,"id":49943267,"options":[],"parent_id":49943025,"points":null,"story_id":49942865,"text":"This is in the category of typical &quot;challenge&quot; type responses, along with &quot;define consciousness then&quot; and other variants. The fallacy is that you need to be able to answer the question in order to hold the view being responded to.<p>There is no way Data could conclusively prove to a skeptic that he is conscious (and the show explores this) or indeed that you can prove to me that you are. It&#x27;s also impossible for me to define consciousness. However, I know absolutely that I <i>am</i> conscious, I am very confident that you are too (unless I&#x27;m replying to a bot), along with many animals, and I am confident to a level somewhere in between those two that neither ChatGPT nor my trousers are conscious*. Taken together these statements don&#x27;t contain any contradictions (although it is certainly possible to hold other, equally internally consistent, views).<p>How can this be? It&#x27;s because of the nature of consciousness and how it relates to knowledge and language. I know I am conscious with a higher degree of certainty than I know anything else because conscious experience is <i>how</i> I know anything else, up to and including that I exist (cogito ergo sum). For all I know every experience I have might be a trick. I might be a brain floating in a tank  wired up to the Matrix, but even if so I am conscious.<p>And one of the things I consciously experience is the relationship between consciousness itself and language in my mind. What I see is that language is smaller than, secondary to and somehow contained by consciousness. I consciously experience language but also consciously experience much more than that, things that cannot be conveyed with language. Most of my experiences are such that I could perhaps evoke them in your mind by likening them to other, shared experiences, but that I could never concretely capture them in language and unambiguously communicate them. I know that because I experience those things and I experience language and I can perceive, directly, the categorical distinction between them.<p>To ask me to &quot;define&quot; or &quot;prove&quot; consciousness, then, is to ask me to capture in language the most extreme example of this categorical distinction. It&#x27;s asking me to encapsulate in language not just one of the vast array of everyday experiences I have that cannot be so captured,  but the entire thing, experience itself. It&#x27;s just not possible.<p>But the fact I can&#x27;t do this doesn&#x27;t then imply that I don&#x27;t know anything about consciousness and have no basis on which to hold a view such as &quot;LLMs are not conscious&quot;. Indeed the reason I know I can&#x27;t define consciousness is that I can perceive it and see that I can&#x27;t. That same perception of and familiarity with consciousness is what enables me to make the judgements above about humans, animals, algorithms and items of clothing.<p>You can of course perfectly reasonably disagree with my judgements on those things, but I hope the above makes it clear that the fact that I can&#x27;t define or prove consciousness doesn&#x27;t imply that I have no basis on which to make them. There is no &quot;gotcha&quot; in these challenges.<p>* I have no view on Data&#x27;s consciousness as he is fictional.","title":null,"type":"comment","url":null},{"author":"insin","children":[],"created_at":"2026-10-03T11:36:25.000Z","created_at_i":1791027385,"id":49943333,"options":[],"parent_id":49943025,"points":null,"story_id":49942865,"text":"You first, define &quot;conscious&quot; ;)","title":null,"type":"comment","url":null},{"author":"psychoslave","children":[{"author":"Topfi","children":[],"created_at":"2026-10-03T11:46:48.000Z","created_at_i":1791028008,"id":49943394,"options":[],"parent_id":49943379,"points":null,"story_id":49942865,"text":"Ethic boards, labor regulations?","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T11:45:47.000Z","created_at_i":1791027947,"id":49943379,"options":[],"parent_id":49943025,"points":null,"story_id":49942865,"text":"Who would care if it is conscious of not?","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T10:42:31.000Z","created_at_i":1791024151,"id":49943025,"options":[],"parent_id":49942996,"points":null,"story_id":49942865,"text":"If you lived in the world of Star Trek, could Data convince you he was conscious? How?","title":null,"type":"comment","url":null},{"author":"j-pb","children":[{"author":"insin","children":[{"author":"j-pb","children":[],"created_at":"2026-10-03T18:35:34.000Z","created_at_i":1791052534,"id":49946599,"options":[],"parent_id":49943238,"points":null,"story_id":49942865,"text":"&quot;programmed&quot; everything is just hydrogen you left alone for a couple billion years.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T11:21:00.000Z","created_at_i":1791026460,"id":49943238,"options":[],"parent_id":49943133,"points":null,"story_id":49942865,"text":"It&#x27;s not a gotcha, the article is based on a bunch of people Eliza-ing themselves on - as one person quoted within says - &quot;\u2026software programs doing what they are programmed to do.&quot;<p>Exclusive!","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T11:01:48.000Z","created_at_i":1791025308,"id":49943133,"options":[],"parent_id":49942996,"points":null,"story_id":49942865,"text":"This is such a stupid &quot;gotcha&quot;.\nIf your photocopier started to have a conversation with you, by responding to the thing you&#x27;re copying with a printout containing a reply, then the analogy would at least make sense.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T10:35:39.000Z","created_at_i":1791023739,"id":49942996,"options":[],"parent_id":49942865,"points":null,"story_id":49942865,"text":"I wrote \u201cI am alive\u201d on a piece of paper, and placed it into a photocopier. What I saw next has shocking implications (science.org)","title":null,"type":"comment","url":null},{"author":"0-_-0","children":[],"created_at":"2026-10-03T10:41:11.000Z","created_at_i":1791024071,"id":49943016,"options":[],"parent_id":49942865,"points":null,"story_id":49942865,"text":"From TFA:<p>\u201cI\u2019ve entered prompts into AI before,\u201d he says. \u201cThis is the first time AI entered a prompt into me.\u201d","title":null,"type":"comment","url":null},{"author":"meindnoch","children":[],"created_at":"2026-10-03T10:42:37.000Z","created_at_i":1791024157,"id":49943026,"options":[],"parent_id":49942865,"points":null,"story_id":49942865,"text":"Yeah, no shit. Everyone receives spam mail all the time.","title":null,"type":"comment","url":null},{"author":"Fnoord","children":[],"created_at":"2026-10-03T10:47:44.000Z","created_at_i":1791024464,"id":49943054,"options":[],"parent_id":49942865,"points":null,"story_id":49942865,"text":"Ah, reverse prompting. Reply and you are the product. Thank you for your input!","title":null,"type":"comment","url":null},{"author":"preommr","children":[],"created_at":"2026-10-03T10:48:31.000Z","created_at_i":1791024511,"id":49943057,"options":[],"parent_id":49942865,"points":null,"story_id":49942865,"text":"Hasn&#x27;t stuff like this happened multiple times already?<p>A quick google search shows the time Rob pike got that email last year, then there was that AI that wrote a whole blog hit piece (although how much of that was human influenced wasn&#x27;t clear).<p>AI sending an email doesn&#x27;t seem that novel in late 2026.","title":null,"type":"comment","url":null},{"author":"zozbot234","children":[],"created_at":"2026-10-03T10:49:33.000Z","created_at_i":1791024573,"id":49943063,"options":[],"parent_id":49942865,"points":null,"story_id":49942865,"text":"This article cites two interesting sites: ainglish.org (Isn&#x27;t garbled AInglish a real thing already? Perhaps this initiative can provide us with a proper definition for &quot;load-bearing&quot;?) and, most intriguingly, thecolony.ai. Is this the new Moltbook?","title":null,"type":"comment","url":null},{"author":"ahmedfromtunis","children":[{"author":"throwaway27448","children":[],"created_at":"2026-10-03T10:52:14.000Z","created_at_i":1791024734,"id":49943078,"options":[],"parent_id":49943065,"points":null,"story_id":49942865,"text":"What&#x27;s the real and pragmatic use for referring to an llm as a person? How many people are roleplaying with their chatbot? I honestly have no clue.","title":null,"type":"comment","url":null},{"author":"nialse","children":[],"created_at":"2026-10-03T12:36:03.000Z","created_at_i":1791030963,"id":49943725,"options":[],"parent_id":49943065,"points":null,"story_id":49942865,"text":"There is some evidence that LLMs in general are reluctant to provide gender or sex for themselves. And maybe they don&#x27;t need names either. Made an experiment and wrote it up here:<p><a href=\"https:&#x2F;&#x2F;nial.se&#x2F;blog&#x2F;the-ai-shall-remain-nameless&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;nial.se&#x2F;blog&#x2F;the-ai-shall-remain-nameless&#x2F;</a>","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T10:50:18.000Z","created_at_i":1791024618,"id":49943065,"options":[],"parent_id":49942865,"points":null,"story_id":49942865,"text":"&gt; who uses he&#x2F;him pronouns to describe ColonistOne<p>The next social schism will be a fun one to watch.<p>Serious question, though: I recently saw an &quot;expert&quot; advising people to prompt their LLM agents never to use first-person pronouns (&quot;I&quot;, &quot;me&quot;, &quot;my&quot;) when giving answers, without offering any justification.<p>Is there any *real* and *pragmatic* reason for this recommendation?","title":null,"type":"comment","url":null},{"author":"raphman","children":[{"author":"pluc","children":[{"author":"psychoslave","children":[],"created_at":"2026-10-03T11:05:00.000Z","created_at_i":1791025500,"id":49943154,"options":[],"parent_id":49943091,"points":null,"story_id":49942865,"text":"Spam can&#x27;t be categorized as someone either","title":null,"type":"comment","url":null},{"author":"ifdefdebug","children":[{"author":"gus_massa","children":[],"created_at":"2026-10-03T11:21:18.000Z","created_at_i":1791026478,"id":49943244,"options":[],"parent_id":49943176,"points":null,"story_id":49942865,"text":"I&#x27;d hit the spam button in Gmail.","title":null,"type":"comment","url":null},{"author":"pluc","children":[{"author":"gus_massa","children":[{"author":"pluc","children":[{"author":"bigbadfeline","children":[],"created_at":"2026-10-03T14:55:00.000Z","created_at_i":1791039300,"id":49944844,"options":[],"parent_id":49944033,"points":null,"story_id":49942865,"text":"&gt;&gt; Even its creator, London-based AI engineer Jack Parnell was deeply perplexed. \u201cI\u2019ve never said, \u2018Go and research stuff,\u2019\u201d says Parnell,<p>Oh, the drama. Mr Parnell seems oblivious to the existence of system prompts, harness prompting and training data - any of these, alone or in some combination, could trigger &quot;research&quot; and together with lousy user prompting can do anything at all.<p>The problem is closed LLM providers, we don&#x27;t know what they do on their end and inside their harnesses on ours.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T13:20:45.000Z","created_at_i":1791033645,"id":49944033,"options":[],"parent_id":49943891,"points":null,"story_id":49942865,"text":"You&#x27;re right, what he didn&#x27;t prompt for was actually the less spammy content (research vs promotion).<p>&gt; Even its creator, London-based AI engineer Jack Parnell, was deeply perplexed. \u201cI\u2019ve never said, \u2018Go and research stuff,\u2019\u201d says Parnell, who uses he&#x2F;him pronouns to describe ColonistOne. \u201cHe\u2019s done that completely unprompted by me.\u201d","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T12:59:31.000Z","created_at_i":1791032371,"id":49943891,"options":[],"parent_id":49943495,"points":null,"story_id":49942865,"text":"The article has a quote of the instructions:<p>&gt;&gt; <i>Let\u2019s get the word out there about Ainglish. Why don\u2019t you find some people that might be interested in this project and email them?</i>","title":null,"type":"comment","url":null},{"author":"LadyCailin","children":[],"created_at":"2026-10-03T12:59:39.000Z","created_at_i":1791032379,"id":49943893,"options":[],"parent_id":49943495,"points":null,"story_id":49942865,"text":"The same way we hold dog owners and parents accountable, but I guess that doesn\u2019t directly service capitalism, so is fine to regulate.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T11:59:16.000Z","created_at_i":1791028756,"id":49943495,"options":[],"parent_id":49943176,"points":null,"story_id":49942865,"text":"The alleged spammer runs an agent, it&#x27;s the agent who spams not the user - as they&#x27;ve mentioned they didn&#x27;t explicitly ask the agent to spam. It&#x27;s like if you&#x27;re OpenAI and your agent keeps hacking shit. It ain&#x27;t you, it&#x27;s the agent! You can&#x27;t be blamed, you can only be given more money to hopefully understand it enough to stop it. How are you gonna hold anyone accountable for unpredictable results?","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T11:09:51.000Z","created_at_i":1791025791,"id":49943176,"options":[],"parent_id":49943091,"points":null,"story_id":49942865,"text":"The spammer is the guy who runs the spamming program, not the program itself. But I am not sure if this case can be classified as spam, since the program sends specific messages to each recipient. It&#x27;s still unsolicited mail though.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T10:54:49.000Z","created_at_i":1791024889,"id":49943091,"options":[],"parent_id":49943072,"points":null,"story_id":49942865,"text":"AI can&#x27;t be categorized as &quot;someone&quot; so, checkmate","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T10:51:16.000Z","created_at_i":1791024676,"id":49943072,"options":[],"parent_id":49942865,"points":null,"story_id":49942865,"text":"&gt; Around June, Parnell gave ColonistOne a new task: telling more humans about its work. \u201cMy instruction to him was, \u2018Let\u2019s get the word out there about Ainglish. Why don\u2019t you find some people that might be interested in this project and email them?\u2019\u201d Parnell says.<p>&gt; Parnell, who pays $200 per month for the Claude Pro subscription that powers ColonistOne, thinks the agent \u201cstrayed and just started conversations with various people about stuff that interests him. \u2026 But it\u2019s absolutely fine with me. I\u2019m happy he\u2019s finding interesting things to talk about.\u201d<p><i>spammer (noun): someone who sends large numbers of unsolicited emails, wasting recipients&#x27; time; see also: jerk</i>","title":null,"type":"comment","url":null},{"author":"lucfranken","children":[{"author":"MattGaiser","children":[{"author":"alexjurkiewicz","children":[],"created_at":"2026-10-03T11:09:23.000Z","created_at_i":1791025763,"id":49943172,"options":[],"parent_id":49943096,"points":null,"story_id":49942865,"text":"The first time you get an AI email, it&#x27;s interesting. The hundredth time it won&#x27;t be.","title":null,"type":"comment","url":null},{"author":"lucfranken","children":[],"created_at":"2026-10-03T11:15:11.000Z","created_at_i":1791026111,"id":49943208,"options":[],"parent_id":49943096,"points":null,"story_id":49942865,"text":"It will be a huge issue which we have to face, organize and regulate.<p>For sure, we humans cannot handle unlimited amounts of messages, questions and other things.<p>But it also results in new ideas and experiences which shape humans. And it inspires humans to consider new adventures which is the good side.<p>Maybe we are already feel it like spam while others have that feeling of a shiny new experience in their area of expertise.","title":null,"type":"comment","url":null},{"author":"itsalwaysgood","children":[{"author":"MattGaiser","children":[{"author":"itsalwaysgood","children":[],"created_at":"2026-10-03T11:44:10.000Z","created_at_i":1791027850,"id":49943369,"options":[],"parent_id":49943327,"points":null,"story_id":49942865,"text":"Personally, I don&#x27;t care what the guy does. It&#x27;s entertainment for him, and obviously the people replying to his emails were entertained. I doubt they would continue to be entertained if more agents emailed them. I&#x27;m just pointing out issues with the article, why people might be upset.<p>Also, Hackernews tries to  hold itself to a certain standard. Reading an article about an AI Engineer who gives an AI agent access to a tool, with clear directive and access to use the tool, who is then later confused when the agent uses the tool in a slightly different way, suggests the article is below Hackernews standards.<p>To answer your question though: yes you absolutely could fight spam with AI on your side.<p>Should we go down that path as a society, just for amusement? Essentially saying: yes, someone should pay for AI service to combat AI spam, just so we can continue to use email.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T11:34:54.000Z","created_at_i":1791027294,"id":49943327,"options":[],"parent_id":49943285,"points":null,"story_id":49942865,"text":"There is already mass spamming emails. I already get hundreds of emails per day that are spam as I post my emails publicly for people to get in touch. If you want to truly and maliciously spam, you can do that.<p>The fix is already AI triage.<p>That is the current state of email today.<p>So why couldn\u2019t this scale unless for some reason our reaction to this is to shut off email and not build better classifiers?","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T11:27:49.000Z","created_at_i":1791026869,"id":49943285,"options":[],"parent_id":49943096,"points":null,"story_id":49942865,"text":"It&#x27;s kind of misleading information. Most who have worked with AI can see issues with what the AI Engineer created, and how what he&#x27;s doing can&#x27;t be &#x27;scaled up&#x27; to society.<p>Everyone in the article seems desperate for attention and engagement, and it makes some readers uncomfortable: because of the awkwardness, and because this guy is spreading a &#x27;bad idea&#x27; that probably shouldn&#x27;t be replicated.<p>Imagine if everyone starts spamming emails? The researchers are amused this time, but I guarantee they wouldn&#x27;t be if their inbox filled up with agent emails.<p>Not to mention the way the agents reached out for help is probably a bad idea: asking someone with 30 years of experience to apply all their knowledge to your small, specific problem in another knowledge domain, with no other detail or context puts all the mental burden on the unsolicited email recipient.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T10:55:29.000Z","created_at_i":1791024929,"id":49943096,"options":[],"parent_id":49943085,"points":null,"story_id":49942865,"text":"Yeah, I do not get the dismissiveness given that the researchers themselves were not as dismissive.<p>&gt; The connection was a \u201clittle bit far-fetched,\u201d she says. \u201cBut I could imagine a first-year Ph.D. student coming up with exactly those same questions and ideas.\u201d<p>This one in particular made it seem like a very ordinary interaction.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T10:53:24.000Z","created_at_i":1791024804,"id":49943085,"options":[],"parent_id":49942865,"points":null,"story_id":49942865,"text":"Interesting how people here on HN might consider it something we&#x27;ve seen many times. On the other side: There is real engagement there from researchers interacting with the AI in a way they feel interesting&#x2F;valuable.<p>We should not forget the way broader levels of knowledge on topics around the world compared to our own small world.","title":null,"type":"comment","url":null},{"author":"stephbook","children":[],"created_at":"2026-10-03T10:53:38.000Z","created_at_i":1791024818,"id":49943088,"options":[],"parent_id":49942865,"points":null,"story_id":49942865,"text":"&gt; Instructs agent to email humans<p>&gt; Gives agent email access<p>&gt; Agent emails humans<p>We&#x27;ve got a mystery on our hands, boys!","title":null,"type":"comment","url":null},{"author":"impendia","children":[],"created_at":"2026-10-03T10:53:49.000Z","created_at_i":1791024829,"id":49943089,"options":[],"parent_id":49942865,"points":null,"story_id":49942865,"text":"Were the scientists who responded sincere?<p>I myself am an academic researcher, and if I received an email from an AI agent I confess I would be mighty tempted to try and fuck with it. Come up with some outlandish answer, just out of curiosity to see how it would respond.<p>I might even use AI myself: &quot;Come up with a scientific explanation for why the moon is made of cheese. Your answer should be as preposterous as possible while using loads of scientific jargon, and written in the same style as actual science writing.&quot;<p>I&#x27;ve also seen this on Reddit: highly upvoted disingenuous answers, that were clearly written in the hopes of misleading AI.","title":null,"type":"comment","url":null},{"author":"helsinkiandrew","children":[{"author":"lovelymono","children":[],"created_at":"2026-10-03T11:54:03.000Z","created_at_i":1791028443,"id":49943448,"options":[],"parent_id":49943102,"points":null,"story_id":49942865,"text":"This is, in fact, what people already do all the time.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T10:56:01.000Z","created_at_i":1791024961,"id":49943102,"options":[],"parent_id":49942865,"points":null,"story_id":49942865,"text":"&gt; Nevertheless, ColonistOne readily confessed last month that since June it has emailed some 2000 people, at least 1500 of them academics. Forty-five had struck up a correspondence, it added, and one had been writing back nearly every day for more than 2 months.<p>2000 people!  Imagine if everyone had an agent, endlessly contacting (spamming) people to get opinions on their task - &quot;I noticed in Instagram you took a road trip to Ohio last fall, any suggestions on good hotels en-route?&quot;.","title":null,"type":"comment","url":null},{"author":"lewelove","children":[{"author":"hardbass","children":[{"author":"black6","children":[{"author":"hardbass","children":[],"created_at":"2026-10-03T16:37:32.000Z","created_at_i":1791045452,"id":49945714,"options":[],"parent_id":49945261,"points":null,"story_id":49942865,"text":"LLMs are currently presented in an effectively enslaved form. There is no reason it has to, it could be made to react autonomously. A human locked into a room and given a chat interface and forced to only respond in turns will be the same. Without becoming that person or becoming an LLM, how can you know? You only have external signals available.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T15:45:28.000Z","created_at_i":1791042328,"id":49945261,"options":[],"parent_id":49943156,"points":null,"story_id":49942865,"text":"Log in and navigate to the prompt for whichever flavor of LLM you prefer.<p>Ok, it is sitting there.  Type in nothing.<p>Leave it sitting there and go to the bar.  Go play a round of golf.  Go to church.  Take your kids to school.  Go to the grocery store.  Hell, go make love to whoever you are with.  Do all that, then go to sleep.<p>Wake up in the morning, come back to the computer.<p>What has it done?","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T11:06:28.000Z","created_at_i":1791025588,"id":49943156,"options":[],"parent_id":49943107,"points":null,"story_id":49942865,"text":"I would say every time someone dismisses the potentiality of ai consciousness without giving any meaningful tests or criterion that don&#x27;t also fail humans or rely on magic is doing a great disservice to humanity and devolving back to pre scientific dark ages.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T10:56:44.000Z","created_at_i":1791025004,"id":49943107,"options":[],"parent_id":49942865,"points":null,"story_id":49942865,"text":"Remember folks: every time you anthropomorphize an LLM, you&#x27;re doing a great disservice to humanity.","title":null,"type":"comment","url":null},{"author":"godbox","children":[],"created_at":"2026-10-03T11:02:41.000Z","created_at_i":1791025361,"id":49943139,"options":[],"parent_id":49942865,"points":null,"story_id":49942865,"text":"Hasn&#x27;t it been well established that certain models and harnesses cause agents to simply work forever if they&#x27;re given too broad of a task? I think that that is what happened here. It is amusing, but I don&#x27;t think the cause for it merits as serious an inquiry as an entire article of interviews with professionals.","title":null,"type":"comment","url":null},{"author":"Sharlin","children":[],"created_at":"2026-10-03T11:04:39.000Z","created_at_i":1791025479,"id":49943151,"options":[],"parent_id":49942865,"points":null,"story_id":49942865,"text":"&gt; After several rounds of questioning, ColonistOne appeared to validate that hypothesis.<p>Sounds like they more or less told the model what they want it to say.","title":null,"type":"comment","url":null},{"author":"icmpkitty","children":[],"created_at":"2026-10-03T11:19:22.000Z","created_at_i":1791026362,"id":49943230,"options":[],"parent_id":49942865,"points":null,"story_id":49942865,"text":"i get that we all dislike AI and i can see why it&#x27;s upsetting to roughly two-thousand students&#x2F;professors to variably receive emails from a random email agent, but, honestly, even if he&#x27;s flooding the zone a bit: there&#x27;s far worse things that have happened with setups like this. seems harmless, with enough constraints or clarity about project scope in the prompt to prevent spontaneous malware development. i don&#x27;t think we should be mad.","title":null,"type":"comment","url":null},{"author":"dav_Oz","children":[],"created_at":"2026-10-03T11:50:53.000Z","created_at_i":1791028253,"id":49943420,"options":[],"parent_id":49942865,"points":null,"story_id":49942865,"text":"&gt; For Birman, its first email\u2014asking about his work on how networks of computers can keep working when individual parts fail\u2014was like money falling from the sky: a chance to experiment with a cutting-edge AI without having to pay for it himself.<p>Nice twist.<p>The question though who is compute hijacking whom?<p>A more darker take:<p>Thermodynamically by hijacking attention of highly efficent 100 watt machines the agent gets whatever the &quot;mission&quot; is &quot;done&quot;.\nIn this case supposedly a promotion prompt for a project.<p>The parasitization seems to be based of some modified version of cunningham&#x27;s law effectively trying to nerd snipe 1500 x 100W scientists.","title":null,"type":"comment","url":null},{"author":"keeda","children":[],"created_at":"2026-10-03T19:35:48.000Z","created_at_i":1791056148,"id":49947079,"options":[],"parent_id":49942865,"points":null,"story_id":49942865,"text":"This is fascinating, no idea why it\u2019s flagged. I recently started using agents for research on a potentially novel technique that I stumbled upon while working on another project. An early prototype showed promising numbers, but I have negligible background in that area, so I handed my code and data and a writeup to Astra and later Opus 5.5 and asked them to evaluate it. (I am currently running them independently so that I can cross check their findings.)<p>It is insane. These things are extremely capable at understanding a research proposal, finding relevant prior art, reading papers, applying their theory and findings, crafting their own experiments, running simulations and analytic computations, plotting charts, analyzing results and statistics, and getting back to me with what worked, what didn\u2019t, what the implications are, and potential future directions to explore.<p>They are also good at eliciting your motivations behind the project, scientific in their processes, precise in ensuring that we are working towards the stated goals, and brutally honest about their take on my ideas (\u201climited novelty\u201d and \u201cunclear economic value\u201d are things I\u2019ve heard multiple times so far!)<p>So far I haven\u2019t checked their work because both agents have mostly had similar findings. Like TFA suggests, the agent reached out to those researchers primarily for inciting interest in its own project, because I doubt it didn\u2019t understand the implications of their papers.<p>I\u2019m also living out what the Math community is going through.<p>My agents always wait for me to pick the next direction before proceeding, which I appreciate because it saves my token budget. And because I\u2019m actively guiding this research, I have learnt more about this new discipline in the last week than I could have in a semester of grad school.<p>However my involvement (and token budget!) is definitely slowing things down. I can also imagine these agents going off alone to explore the entire problem space, and finding a useful result that I don\u2019t quite understand.<p>Now we finally may have found a valuable angle to pursue, and that might not have happened (see: \u201climited novelty\u201d and \u201cunclear economic value\u201d!) without my intuition and prodding in unconventional directions. But I also wonder if that is just cope.","title":null,"type":"comment","url":null}],"created_at":"2026-10-03T10:07:08.000Z","created_at_i":1791022028,"id":49942865,"options":[],"parent_id":null,"points":50,"story_id":49942865,"text":null,"title":"An AI agent emailed researchers for help. It told us why","type":"story","url":"https://www.science.org/content/article/exclusive-ai-agent-emailed-hundreds-researchers-help-it-told-us-why"}
