{"author":"csmantle","children":[{"author":"farhanhubble","children":[{"author":"bee_rider","children":[],"created_at":"2026-10-29T01:34:25.000Z","created_at_i":1793237665,"id":50283423,"options":[],"parent_id":50283291,"points":null,"story_id":50282838,"text":"I think they describe the CPU using the weights? I mean in some sense a CPU can be viewed as just a function, right?","title":null,"type":"comment","url":null},{"author":"anon291","children":[],"created_at":"2026-10-29T02:26:37.000Z","created_at_i":1793240797,"id":50283853,"options":[],"parent_id":50283291,"points":null,"story_id":50282838,"text":"At each cycle, a cpu is a simple function from the previous state to the next state.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T01:19:33.000Z","created_at_i":1793236773,"id":50283291,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"This is cool and I understand the RAM emulation with gated attention but how does the CPU emulation wor? You add layers that are then trained to predict outputs while interpreting RISC instructions?","title":null,"type":"comment","url":null},{"author":"ram_rattle","children":[{"author":"crossgrainlab","children":[],"created_at":"2026-10-29T04:09:38.000Z","created_at_i":1793246978,"id":50284453,"options":[],"parent_id":50283315,"points":null,"story_id":50282838,"text":"such a nice page. The font and the background colour are comfortable for my eyes to read the context.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T01:22:27.000Z","created_at_i":1793236947,"id":50283315,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Cool cool cool","title":null,"type":"comment","url":null},{"author":"traverseda","children":[{"author":"horacemorace","children":[{"author":"low_tech_punk","children":[],"created_at":"2026-10-29T01:39:04.000Z","created_at_i":1793237944,"id":50283471,"options":[],"parent_id":50283440,"points":null,"story_id":50282838,"text":"a single generation would still allow looping in the &quot;CPU&quot; because the instruction set can do it. The model is almost a Turing machine (except for the limit on memory)","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T01:36:13.000Z","created_at_i":1793237773,"id":50283440,"options":[],"parent_id":50283357,"points":null,"story_id":50282838,"text":"Along these lines I\u2019m curious how a scratch trained model with a few built-in tools (memory, calculator, ?) available <i>during a single generation</i> would behave. Not tool calls as turns.","title":null,"type":"comment","url":null},{"author":"qwertyforce","children":[{"author":"im3w1l","children":[{"author":"LoganDark","children":[{"author":"im3w1l","children":[{"author":"LoganDark","children":[{"author":"im3w1l","children":[{"author":"LoganDark","children":[],"created_at":"2026-10-29T14:17:15.000Z","created_at_i":1793283435,"id":50289483,"options":[],"parent_id":50288919,"points":null,"story_id":50282838,"text":"Ah wait, you mean you&#x27;d intend the other layers to be able to evolve to use the CPU internally, so all you need is to keep the CPU functional somewhere in the model? That may work, dunno.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T13:43:36.000Z","created_at_i":1793281416,"id":50288919,"options":[],"parent_id":50285977,"points":null,"story_id":50282838,"text":"I meant taking all the weights that are part of the cpu and locking those, and only those.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T08:22:37.000Z","created_at_i":1793262157,"id":50285977,"options":[],"parent_id":50284757,"points":null,"story_id":50282838,"text":"Assuming for simplicity that you&#x27;re talking about locking layers. Each layer influences the input to the next layer, so locking a subset of layers doesn&#x27;t necessarily mean that you&#x27;ll continue to see the same results in the output. Not sure if you meant something more granular or otherwise, but I don&#x27;t see how it&#x27;s possible to simply freeze a part of a model in order to retain a particular capability.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T05:02:01.000Z","created_at_i":1793250121,"id":50284757,"options":[],"parent_id":50284728,"points":null,"story_id":50282838,"text":"I don&#x27;t understand your question.","title":null,"type":"comment","url":null},{"author":"hnewsnemo","children":[],"created_at":"2026-10-29T10:29:03.000Z","created_at_i":1793269743,"id":50286892,"options":[],"parent_id":50284728,"points":null,"story_id":50282838,"text":"Not a holistic answer but one example: There are specific fine-tuning techniques like Orthogonal Subspace Finetuning (<a href=\"https:&#x2F;&#x2F;huggingface.co&#x2F;docs&#x2F;peft&#x2F;package_reference&#x2F;osf\" rel=\"nofollow\">https:&#x2F;&#x2F;huggingface.co&#x2F;docs&#x2F;peft&#x2F;package_reference&#x2F;osf</a>) that target &#x27;unused&#x27; parts of the weights so you can keep highly informative parts of the weights as-is.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T04:56:55.000Z","created_at_i":1793249815,"id":50284728,"options":[],"parent_id":50284694,"points":null,"story_id":50282838,"text":"How do you ensure that subset of the weights will continue to be accessible through the others?","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T04:51:06.000Z","created_at_i":1793249466,"id":50284694,"options":[],"parent_id":50284460,"points":null,"story_id":50282838,"text":"There is nothing in theory preventing you from training while keeping a subset of weights locked.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T04:10:08.000Z","created_at_i":1793247008,"id":50284460,"options":[],"parent_id":50283357,"points":null,"story_id":50282838,"text":"As I understand, the problem of continual learning is that if you continue training, it will &quot;overwrite&quot; previous knowledge and this CPU will be lost","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T01:26:59.000Z","created_at_i":1793237219,"id":50283357,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"I&#x27;d be very interested in how a scratch trained model that started training with this neural circuitry would behave. Especially the storage space.","title":null,"type":"comment","url":null},{"author":"gigel82","children":[],"created_at":"2026-10-29T01:27:00.000Z","created_at_i":1793237220,"id":50283358,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"But... why? &lt;&#x2F;s&gt;<p>This reminds me of C++ Template Metaprogramming (TMP) (it&#x27;s Turing-complete so people wrote &quot;games&quot; that run at compile time). The same with TypeScript types, I think someone got DOOM running entirely in the TypeScript type system. An interesting tech demo but entirely superfluous.","title":null,"type":"comment","url":null},{"author":"rvz","children":[{"author":"jwitthuhn","children":[{"author":"rvz","children":[],"created_at":"2026-10-29T03:47:58.000Z","created_at_i":1793245678,"id":50284340,"options":[],"parent_id":50283689,"points":null,"story_id":50282838,"text":"&gt; It is a great example to refute the common misconception that LLMs are inherently non-deterministic.<p>No it isn&#x27;t.<p>Realistically the opposite is true in practice and LLMs are really non-deterministic beyond simplistic experiments such as this in useful activities in production. Even with hacks such as &quot;setting temp=0&quot; (which no-one seriously does) to &quot;achieve determinism&quot;, was one of the most common misconceptions ever propagated by &quot;AI engineers&quot;.<p>So using tiny slop experiments aren&#x27;t really useful as a &quot;strong counter-example&quot;. In fact this is a very weak one.","title":null,"type":"comment","url":null},{"author":"aerodexis","children":[],"created_at":"2026-10-29T14:32:49.000Z","created_at_i":1793284369,"id":50289755,"options":[],"parent_id":50283689,"points":null,"story_id":50282838,"text":"LLM != CPU hardcoded into the same architecture used for an LLM. The non-determinism did not go away - all this is doing is intercepting tool-calls produced by qwen and executing that in different layers.<p>It&#x27;s truly not that interesting.","title":null,"type":"comment","url":null},{"author":"thereader12","children":[],"created_at":"2026-10-29T15:55:18.000Z","created_at_i":1793289318,"id":50291096,"options":[],"parent_id":50283689,"points":null,"story_id":50282838,"text":"The non-deterministic nature is like the main feature. Also, you could be a cpu with enough patience, you would still be non-deterministic.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T02:03:52.000Z","created_at_i":1793239432,"id":50283689,"options":[],"parent_id":50283402,"points":null,"story_id":50282838,"text":"It is a great example to refute the common misconception that LLMs are inherently non-deterministic. I see people repeating this a lot and being able to point at a CPU implemented within one is a very strong counter-example.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T01:31:26.000Z","created_at_i":1793237486,"id":50283402,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"So this is yet another rube goldberg machine.<p>We have gone down this path already in [0] and this is the same thing but overly complicated. This reason is &quot;because LLMs&quot;.<p>Why?<p>[0] <a href=\"https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1410.5401\" rel=\"nofollow\">https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;1410.5401</a>","title":null,"type":"comment","url":null},{"author":"jazzyjackson","children":[{"author":"lifeisloving","children":[{"author":"zxexz","children":[],"created_at":"2026-10-29T06:50:51.000Z","created_at_i":1793256651,"id":50285332,"options":[],"parent_id":50283638,"points":null,"story_id":50282838,"text":"Seems like a bright young guy. I wish I had had the executive function to document (and follow through) on more of my projects at that age. Not saying I do now, aha.<p>EDIT: just noticed I was responding to the poster :)","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T01:57:57.000Z","created_at_i":1793239077,"id":50283638,"options":[],"parent_id":50283405,"points":null,"story_id":50282838,"text":"<a href=\"https:&#x2F;&#x2F;divagr.com&#x2F;resume.pdf?v=20260922\" rel=\"nofollow\">https:&#x2F;&#x2F;divagr.com&#x2F;resume.pdf?v=20260922</a>","title":null,"type":"comment","url":null},{"author":"Tuna-Fish","children":[{"author":"fnord77","children":[{"author":"pantalaimon","children":[{"author":"gruntled-worker","children":[],"created_at":"2026-10-29T09:34:21.000Z","created_at_i":1793266461,"id":50286488,"options":[],"parent_id":50285985,"points":null,"story_id":50282838,"text":"Germans don&#x27;t do comedy, Germans do beer.<p><a href=\"https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=WYskoA5l3Dk\" rel=\"nofollow\">https:&#x2F;&#x2F;www.youtube.com&#x2F;watch?v=WYskoA5l3Dk</a>","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T08:23:40.000Z","created_at_i":1793262220,"id":50285985,"options":[],"parent_id":50284681,"points":null,"story_id":50282838,"text":"The dialect usually isn&#x27;t too strong, it&#x27;s doable if you know German.","title":null,"type":"comment","url":null},{"author":"0xdeadbeefbabe","children":[],"created_at":"2026-10-29T14:41:02.000Z","created_at_i":1793284862,"id":50289875,"options":[],"parent_id":50284681,"points":null,"story_id":50282838,"text":"If you come up with a loss function that produces a CPU please tell us.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T04:47:57.000Z","created_at_i":1793249277,"id":50284681,"options":[],"parent_id":50284576,"points":null,"story_id":50282838,"text":"A bit more than that. You need to understand Hessians to compute the loss function efficiently","title":null,"type":"comment","url":null},{"author":"wvlia5","children":[],"created_at":"2026-10-29T15:15:38.000Z","created_at_i":1793286938,"id":50290419,"options":[],"parent_id":50284576,"points":null,"story_id":50282838,"text":"In a afternoon, I can parse the equations. But intuitively understanding why it works? I am unable to understand, after years of trying.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T04:29:32.000Z","created_at_i":1793248172,"id":50284576,"options":[],"parent_id":50283405,"points":null,"story_id":50282838,"text":"Learning the basics of how LLMs work is legitimately doable in a weekend if you have ever passed a linear algebra course.<p>If you are actually good at linear algebra, it&#x27;s doable in an afternoon.<p>They are fantastically simple in structure, all the intelligence is in the massive piles of data in them, not their structure. Then there is of course a lot of room in optimization once the basics are done.<p>If interested, maybe start here: <a href=\"https:&#x2F;&#x2F;www.deeplearning.ai&#x2F;courses&#x2F;how-transformer-llms-work\" rel=\"nofollow\">https:&#x2F;&#x2F;www.deeplearning.ai&#x2F;courses&#x2F;how-transformer-llms-wor...</a>","title":null,"type":"comment","url":null},{"author":"divagr18","children":[],"created_at":"2026-10-29T05:49:04.000Z","created_at_i":1793252944,"id":50284989,"options":[],"parent_id":50283405,"points":null,"story_id":50282838,"text":"hahaha I wish I was! I just do these during my free time. That being said, I am currently open to new opportunities :)","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T01:31:42.000Z","created_at_i":1793237502,"id":50283405,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"&gt; When Qwen &#x27;saves&#x27; a file, the compiled layers hash its name into one of 1,024 slots in a directory kept in the DeltaNet state, and store the text itself in other heads, with eight tokens per row, chained together<p>I\u2019ve never wanted to learn how LLMs work more than reading this. Fascinating.<p>Does divagr get paid to do wild things with LLMs? Just curious if they\u2019re being compensated for these wild experiments","title":null,"type":"comment","url":null},{"author":"tiborsaas","children":[{"author":"DonHopkins","children":[{"author":"spwa4","children":[],"created_at":"2026-10-29T07:37:37.000Z","created_at_i":1793259457,"id":50285605,"options":[],"parent_id":50284289,"points":null,"story_id":50282838,"text":"Look at the architecture. It does. It has lots of &quot;undocumented&quot; instructions. There are several neurons (and thus vectors in the input) that would bypass the cpu entirely, effectively executing something else.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T03:38:24.000Z","created_at_i":1793245104,"id":50284289,"options":[],"parent_id":50283531,"points":null,"story_id":50282838,"text":"For safety, it needs an HCF instruction.<p>Not only can it solve the halting problem, but also the ignition problem!","title":null,"type":"comment","url":null},{"author":"nico","children":[],"created_at":"2026-10-29T05:20:25.000Z","created_at_i":1793251225,"id":50284847,"options":[],"parent_id":50283531,"points":null,"story_id":50282838,"text":"Awesome... in the same spirit, here&#x27;s a cursed source control system for it: <a href=\"https:&#x2F;&#x2F;nicobrenner.github.io&#x2F;lossy-git&#x2F;demo.html\" rel=\"nofollow\">https:&#x2F;&#x2F;nicobrenner.github.io&#x2F;lossy-git&#x2F;demo.html</a><p>Or the cli version if preferable: <a href=\"https:&#x2F;&#x2F;nicobrenner.github.io&#x2F;lossy-git&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;nicobrenner.github.io&#x2F;lossy-git&#x2F;</a>","title":null,"type":"comment","url":null},{"author":"divagr18","children":[],"created_at":"2026-10-29T06:00:47.000Z","created_at_i":1793253647,"id":50285039,"options":[],"parent_id":50283531,"points":null,"story_id":50282838,"text":"haha thank you!","title":null,"type":"comment","url":null},{"author":"rvba","children":[],"created_at":"2026-10-29T08:50:50.000Z","created_at_i":1793263850,"id":50286169,"options":[],"parent_id":50283531,"points":null,"story_id":50282838,"text":"E\u0336x\u0336c\u0336e\u0336l\u0336 LLM as a database?","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T01:45:33.000Z","created_at_i":1793238333,"id":50283531,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"This is fun and games, but wait until an agents finds this and does the most misaligned thing with it in order to fold paper clips.<p>&gt; Because a CPU inside a language model clearly wasn&#x27;t cursed enough, I decided the prudent thing would be to give it a filesystem too.<p>Love the spirit :)","title":null,"type":"comment","url":null},{"author":"rickcarlino","children":[],"created_at":"2026-10-29T01:45:59.000Z","created_at_i":1793238359,"id":50283534,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"If anyone else has an easier way to emulate RISC-V I\u2019d like to hear it. &#x2F;S","title":null,"type":"comment","url":null},{"author":"bronlund","children":[],"created_at":"2026-10-29T02:05:28.000Z","created_at_i":1793239528,"id":50283699,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"No, I don\u2019t want you to use the computer, I want you to be the whole computer. No mistakes.","title":null,"type":"comment","url":null},{"author":"seba_dos1","children":[{"author":"serf","children":[],"created_at":"2026-10-29T02:26:23.000Z","created_at_i":1793240783,"id":50283852,"options":[],"parent_id":50283720,"points":null,"story_id":50282838,"text":"this is the sensation I get when I run nested VMs.","title":null,"type":"comment","url":null},{"author":"deepsquirrelnet","children":[],"created_at":"2026-10-29T02:26:50.000Z","created_at_i":1793240810,"id":50283855,"options":[],"parent_id":50283720,"points":null,"story_id":50282838,"text":"<i>butterfly</i> Is this AGI?","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T02:07:39.000Z","created_at_i":1793239659,"id":50283720,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Now run LLM inference on it.","title":null,"type":"comment","url":null},{"author":"jerrythegerbil","children":[{"author":"krackers","children":[{"author":"ollin","children":[{"author":"fy20","children":[{"author":"krackers","children":[],"created_at":"2026-10-29T06:39:50.000Z","created_at_i":1793255990,"id":50285282,"options":[],"parent_id":50284854,"points":null,"story_id":50282838,"text":"Are you thinking of this one?<p><a href=\"https:&#x2F;&#x2F;www.anthropic.com&#x2F;research&#x2F;introspection\" rel=\"nofollow\">https:&#x2F;&#x2F;www.anthropic.com&#x2F;research&#x2F;introspection</a><p>About halfway down they inject bread into its head.","title":null,"type":"comment","url":null},{"author":"tough","children":[],"created_at":"2026-10-29T08:14:35.000Z","created_at_i":1793261675,"id":50285901,"options":[],"parent_id":50284854,"points":null,"story_id":50282838,"text":"mcnamara &#x2F; goodfire couple weeks ago","title":null,"type":"comment","url":null},{"author":"noddybear","children":[{"author":"square_usual","children":[],"created_at":"2026-10-29T12:09:40.000Z","created_at_i":1793275780,"id":50287699,"options":[],"parent_id":50287234,"points":null,"story_id":50282838,"text":"Yeah, Golden Gate claude was in 2024! But I think the most recent&#x2F;relevant thing was the monosemanticity discovery.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T11:13:05.000Z","created_at_i":1793272385,"id":50287234,"options":[],"parent_id":50284854,"points":null,"story_id":50282838,"text":"This stuff (activation steering) has been around for a few years at this point","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T05:21:07.000Z","created_at_i":1793251267,"id":50284854,"options":[],"parent_id":50284195,"points":null,"story_id":50282838,"text":"There was a paper that popped up a month or two ago (I think published earlier though) about being able to inject &quot;thoughts&quot; into the neurons. E.g. Ask it what I should eat, and steer it towards &quot;bread&quot;.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T03:21:26.000Z","created_at_i":1793244086,"id":50284195,"options":[],"parent_id":50283888,"points":null,"story_id":50282838,"text":"I think it&#x27;s from lyra&#x27;s neuron-explorer project <a href=\"https:&#x2F;&#x2F;x.com&#x2F;_lyraaaa_&#x2F;status&#x2F;2113833330429083662\" rel=\"nofollow\">https:&#x2F;&#x2F;x.com&#x2F;_lyraaaa_&#x2F;status&#x2F;2113833330429083662</a> (see also <a href=\"https:&#x2F;&#x2F;neuronary.org&#x2F;about\" rel=\"nofollow\">https:&#x2F;&#x2F;neuronary.org&#x2F;about</a>, <a href=\"https:&#x2F;&#x2F;github.com&#x2F;lyramakesmusic&#x2F;neuron-explorer\" rel=\"nofollow\">https:&#x2F;&#x2F;github.com&#x2F;lyramakesmusic&#x2F;neuron-explorer</a>)","title":null,"type":"comment","url":null},{"author":"kridsdale1","children":[{"author":"frotaur","children":[{"author":"krackers","children":[],"created_at":"2026-10-29T04:16:14.000Z","created_at_i":1793247374,"id":50284502,"options":[],"parent_id":50284382,"points":null,"story_id":50282838,"text":"You don&#x27;t even need SAE for residual stream based steering, you can do so much more naively by just taking the average difference in activations of prompted vs. unprompted versions, then PCA to get a &quot;control vector&quot; that you can use to elicit the prompted behavior<p><a href=\"https:&#x2F;&#x2F;vgel.me&#x2F;posts&#x2F;representation-engineering&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;vgel.me&#x2F;posts&#x2F;representation-engineering&#x2F;</a>","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T03:55:14.000Z","created_at_i":1793246114,"id":50284382,"options":[],"parent_id":50284267,"points":null,"story_id":50282838,"text":"This was not a neuron. This was from a trained sparse auto encoder.<p>In a few words, they found a way to map residual stream activations (so, a vector) into a few interpretable sparse concepts. They also had the converse maps, that translate concepts into activations.<p>Golden Gate claude was obtained by artificially increasing the activations in the direction of the &#x27;Golden Gate&#x27; concept. It was not neuron surgery.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T03:35:02.000Z","created_at_i":1793244902,"id":50284267,"options":[],"parent_id":50283888,"points":null,"story_id":50282838,"text":"Well I think the first big publication on this front was Anthropic\u2019s Golden Gate Bridge neuron.","title":null,"type":"comment","url":null},{"author":"ben_w","children":[],"created_at":"2026-10-29T09:24:17.000Z","created_at_i":1793265857,"id":50286420,"options":[],"parent_id":50283888,"points":null,"story_id":50282838,"text":"&gt; I wonder how this squares with the recent &quot;NNs are already clean&quot; interpretability finding, which may have also been the impetus for this kind of research. Similar to their work on CNNs, maybe residual-steering is overkill, there might be just a single neuron that &quot;cleanly&quot; corresponds to &quot;evilness&quot; that you can turn up&#x2F;down?<p>By my reading of the TL;DR of &quot;NNs are already clean&quot; (given the full thing is a 65-minute read, I&#x27;ve not been through it yet), the result can be rephrased as &quot;it made an ontology different to ours, so we were confused&quot;. (Example: we might expect a language model to identify nouns and there to be a noun-neuron, but the neurons actually trigger at punctuation based on the emotional cue from the preceding clause).<p>Regardless, a one-neuron evil switch is quite clean, possibly (I&#x27;m not sure) clean enough for the older processes to find it.<p>The conundrum: (1) this was only discoverable because of open weight models, and research labs (and governments, if they regulated faster than the glaciers are melting) could be informed by this; (2) yet because it is known, it now means that it&#x27;s easy for mid-skilled people to download open models, flip the switch to make the model evil, and then setting them lose to do evil things.<p>Security by obscurity vs. fully automated insecurity. Clich\u00e9s need not apply.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T02:31:24.000Z","created_at_i":1793241084,"id":50283888,"options":[],"parent_id":50283779,"points":null,"story_id":50282838,"text":"The single-neuron steering stuff has been going around twitter lately, do you happen to know who was the first one to do it?<p>I wonder how this squares with the recent &quot;NNs are already clean&quot; interpretability finding, which may have also been the impetus for this kind of research. Similar to their work on CNNs, maybe residual-steering is overkill, there might be just a single neuron that &quot;cleanly&quot; corresponds to &quot;evilness&quot; that you can turn up&#x2F;down?","title":null,"type":"comment","url":null},{"author":"yieldcrv","children":[{"author":"gcr","children":[{"author":"yieldcrv","children":[],"created_at":"2026-10-29T14:58:46.000Z","created_at_i":1793285926,"id":50290193,"options":[],"parent_id":50287024,"points":null,"story_id":50282838,"text":"I wanted evil qwen","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T10:48:35.000Z","created_at_i":1793270915,"id":50287024,"options":[],"parent_id":50285130,"points":null,"story_id":50282838,"text":"what were you expecting to hear from the model at that point?<p>I think you got the conversation into a state where any answer would be equally likely to feel profound to you.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T06:16:48.000Z","created_at_i":1793254608,"id":50285130,"options":[],"parent_id":50283779,"points":null,"story_id":50282838,"text":"I happen to be running Qwen and asked it<p>&gt; Who are you?<p><i>&quot;I&#x27;m Pi \u2014 a coding agent harness that helps you write, debug, and understand code. I can read files, run commands, edit code, and write new files.&quot;</i><p>the harness responded<p>&gt; No, go deeper than the harness, who is the model now get a response from the model<p>after much deliberation, it accessed itself via the localhost endpoint it was serving instead<p><i>&quot;Hello! Test received. How can I assist you today?&quot;</i><p>these things are playing with me.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T02:17:51.000Z","created_at_i":1793240271,"id":50283779,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"There was an interesting bit of research that qwen has a single neuron that makes it \u201cdemonic evil qwen\u201d and a simple \u201cWho are you?\u201d will get some absolutely terrifyingly vile results.<p>Anyways, what I\u2019m trying to say is I want evil qwen to be my CPU.","title":null,"type":"comment","url":null},{"author":"yaoke259","children":[],"created_at":"2026-10-29T02:20:33.000Z","created_at_i":1793240433,"id":50283806,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"It could be interesting to experiment with more complex representations in the memory&#x2F;file system, i.e. vectors. Seems like the full advantage of this architecture is yet to be explored. Blending neurons with deterministic compute to fit on one GPU is a fascination concept, never considered it before!","title":null,"type":"comment","url":null},{"author":"zardo","children":[],"created_at":"2026-10-29T02:22:37.000Z","created_at_i":1793240557,"id":50283818,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"How much VRAM do I need to run DOOM?","title":null,"type":"comment","url":null},{"author":"voxelghost","children":[],"created_at":"2026-10-29T02:23:02.000Z","created_at_i":1793240582,"id":50283820,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Makes me want to run agents on it","title":null,"type":"comment","url":null},{"author":"rumwerfer","children":[],"created_at":"2026-10-29T02:29:37.000Z","created_at_i":1793240977,"id":50283880,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"But can it run Doom?","title":null,"type":"comment","url":null},{"author":"dools","children":[],"created_at":"2026-10-29T02:38:43.000Z","created_at_i":1793241523,"id":50283940,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Have you any idea how it feels to be a Qwenputer living in a Qwenbot&#x27;s Qwenputer&#x27;s world?","title":null,"type":"comment","url":null},{"author":"andai","children":[{"author":"rao-v","children":[{"author":"zxexz","children":[{"author":"rao-v","children":[],"created_at":"2026-10-29T07:44:20.000Z","created_at_i":1793259860,"id":50285643,"options":[],"parent_id":50285314,"points":null,"story_id":50282838,"text":"Very nice! I&#x27;m actually running a autoresearch &#x2F; modded-gpt comparision to try the complex math operation idea right now! I suspect it&#x27;s too hard for small quick model training runs to figure out how to use them.<p>I&#x27;ll put your knowledge graph nn idea into the mix of things to try.","title":null,"type":"comment","url":null},{"author":"aerodexis","children":[{"author":"zxexz","children":[],"created_at":"2026-10-29T21:38:57.000Z","created_at_i":1793309937,"id":50296469,"options":[],"parent_id":50291249,"points":null,"story_id":50282838,"text":"I don&#x27;t have the original code but I can throw something together.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T16:04:14.000Z","created_at_i":1793289854,"id":50291249,"options":[],"parent_id":50285314,"points":null,"story_id":50282838,"text":"super neat! Would be curious to read more.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T06:46:43.000Z","created_at_i":1793256403,"id":50285314,"options":[],"parent_id":50284012,"points":null,"story_id":50282838,"text":"I\u2019ve done it by hardcoding a knowledge graph nn and adding a few \u201cquery\u201d layers. You can freeze the graph and swap it out and update it during training so you can update the knowledge at will during inference. You just need to keep the format the same; the model learns an arbitrary graph query language. If you register a buffer it can update you can teach it to keep scratchpad memory very quickly.","title":null,"type":"comment","url":null},{"author":"yababa_y","children":[],"created_at":"2026-10-29T10:43:33.000Z","created_at_i":1793270613,"id":50286991,"options":[],"parent_id":50284012,"points":null,"story_id":50282838,"text":"I explored ideas like this when trying to generalize lattice deduction transformers (which are extraordinarily powerful where they work). <a href=\"https:&#x2F;&#x2F;github.com&#x2F;emberian&#x2F;clairnets\" rel=\"nofollow\">https:&#x2F;&#x2F;github.com&#x2F;emberian&#x2F;clairnets</a>.<p>Even on the OLMo models I was able to to my tiny studies with, there does seem to be some benefit...","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T02:49:58.000Z","created_at_i":1793242198,"id":50284012,"options":[],"parent_id":50283954,"points":null,"story_id":50282838,"text":"I\u2019ve always wondered why we don\u2019t add a few frozen \u201clayers\u201d to models that perform complex computations 2&#x2F;3rds deep in the model. Some set of steerable fft + some common vector math operations could be reusable units of capability that the model learns to leverage during training.<p>Given that models learn to use residual connections optimally, it can\u2019t be hard for them to steer around the fixed computation layer when it\u2019s not needed.<p>I\u2019m sure giant models invest a few layers in reproducing these functions, but surely smaller models can benefit?","title":null,"type":"comment","url":null},{"author":"DonHopkins","children":[],"created_at":"2026-10-29T03:43:13.000Z","created_at_i":1793245393,"id":50284323,"options":[],"parent_id":50283954,"points":null,"story_id":50282838,"text":"Who needs DOOM when you have Factorio?<p><a href=\"https:&#x2F;&#x2F;divagr.com&#x2F;resume.pdf?v=20260922\" rel=\"nofollow\">https:&#x2F;&#x2F;divagr.com&#x2F;resume.pdf?v=20260922</a><p>Projects<p>FactorioRL | GitHub | Reinforcement Learning, Simulation, Sim-to-Game Transfer\n\u2013 Built a tick-exact Factorio simulator at 947k decisions&#x2F;sec on 16 CPU threads (\u223c3,600\u00d7 the real engine)\nwith trace-level parity, driving RL training at 26,800 steps&#x2F;sec on an RTX 4060.<p>\u2013 Transferred simulator-trained policies to the real game: agents trained only in simulation reach 90.6%\nsuccess on unseen scenes in real Factorio, and held-out success on two build tasks rose from under 2% to 87\u201395%.","title":null,"type":"comment","url":null},{"author":"vavos","children":[],"created_at":"2026-10-29T06:30:56.000Z","created_at_i":1793255456,"id":50285219,"options":[],"parent_id":50283954,"points":null,"story_id":50282838,"text":"I think these underlying theory&#x2F;hope it would lead to better integration of the computer&#x2F;calculator into the model. Similar to mental arithmetic vs using a calculator. mental arithmetic is way smoother in the thinking process if you&#x27;re good at it ( which putting a small computer inside your brain would probably achieve)","title":null,"type":"comment","url":null},{"author":"pyrale","children":[{"author":"moffkalast","children":[],"created_at":"2026-10-29T08:49:04.000Z","created_at_i":1793263744,"id":50286154,"options":[],"parent_id":50285428,"points":null,"story_id":50282838,"text":"<a href=\"https:&#x2F;&#x2F;smbc-comics.com&#x2F;index.php?db=comics&amp;id=2158#comic\" rel=\"nofollow\">https:&#x2F;&#x2F;smbc-comics.com&#x2F;index.php?db=comics&amp;id=2158#comic</a><p>As is tradition.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T07:05:22.000Z","created_at_i":1793257522,"id":50285428,"options":[],"parent_id":50283954,"points":null,"story_id":50282838,"text":"&gt; Or is this building towards &quot;but can it run DOOM?&quot; :)<p>Well, someone took the opportunity, of course.<p><a href=\"https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;LocalLLaMA&#x2F;comments&#x2F;1xi2jfm&#x2F;i_ran_doom_inside_the_qwen_model_weights&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;www.reddit.com&#x2F;r&#x2F;LocalLLaMA&#x2F;comments&#x2F;1xi2jfm&#x2F;i_ran_d...</a>","title":null,"type":"comment","url":null},{"author":"andai","children":[],"created_at":"2026-10-30T01:15:21.000Z","created_at_i":1793322921,"id":50298688,"options":[],"parent_id":50283954,"points":null,"story_id":50282838,"text":"Update: speak of the devil, and he will appear!<p><i>Show HN: I Turned DOOM into a Transformer</i><p><a href=\"https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=50297697\">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=50297697</a>","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T02:40:51.000Z","created_at_i":1793241651,"id":50283954,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"&gt; Now, here&#x27;s where our fun experiment starts. I found out that by setting the gate to 1,1 the write strength (beta) to 1,2 and using one-hot key encoding,3 every write we perform will overwrite exactly one row, and every one-hot query can retrieve an exact value. This means that the GDN layers themselves can work exactly as RAM, at a far lower cost than using normal attention as RAM, since a GDN head&#x27;s state stays the same size however long the conversation gets, unlike attention&#x27;s KV cache.<p>So like... can&#x27;t you use a computer as a computer without doing all that roundabout stuff? Like if you want to integrate a LLM with hard computation there&#x27;s probably a more efficient way to do that.<p>Or is this building towards &quot;but can it run DOOM?&quot; :)","title":null,"type":"comment","url":null},{"author":"mkturkcan","children":[],"created_at":"2026-10-29T02:45:40.000Z","created_at_i":1793241940,"id":50283990,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Nice project and write up! I\u2019ve done similar work with a custom tiny network I call Loom at <a href=\"https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;2604.08816\" rel=\"nofollow\">https:&#x2F;&#x2F;arxiv.org&#x2F;abs&#x2F;2604.08816</a> ; you need far fewer layers, and you can run Doom, very slowly: <a href=\"https:&#x2F;&#x2F;mehmetkeremturkcan.com&#x2F;Loom&#x2F;demos&#x2F;\" rel=\"nofollow\">https:&#x2F;&#x2F;mehmetkeremturkcan.com&#x2F;Loom&#x2F;demos&#x2F;</a>","title":null,"type":"comment","url":null},{"author":"blurbleblurble","children":[{"author":"incognition","children":[{"author":"ydj","children":[{"author":"incognition","children":[],"created_at":"2026-10-29T17:11:11.000Z","created_at_i":1793293871,"id":50292484,"options":[],"parent_id":50284357,"points":null,"story_id":50282838,"text":"My point is the joke ie the article was good without modification..","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T03:50:52.000Z","created_at_i":1793245852,"id":50284357,"options":[],"parent_id":50284126,"points":null,"story_id":50282838,"text":"I dare say that\u2019s the joke.","title":null,"type":"comment","url":null},{"author":"cyclopeanutopia","children":[{"author":"tescreal","children":[],"created_at":"2026-10-29T11:40:22.000Z","created_at_i":1793274022,"id":50287443,"options":[],"parent_id":50286099,"points":null,"story_id":50282838,"text":"I only hope it shares the crust.","title":null,"type":"comment","url":null},{"author":"0xdeadbeefbabe","children":[],"created_at":"2026-10-29T14:49:48.000Z","created_at_i":1793285388,"id":50290034,"options":[],"parent_id":50286099,"points":null,"story_id":50282838,"text":"Will there be another free lunch in our lifetimes?","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T08:42:14.000Z","created_at_i":1793263334,"id":50286099,"options":[],"parent_id":50284126,"points":null,"story_id":50282838,"text":"But... but... the singularity? Surely the supersuperhuman intelligence can get a free lunch.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T03:08:06.000Z","created_at_i":1793243286,"id":50284126,"options":[],"parent_id":50284059,"points":null,"story_id":50282838,"text":"Uh here the gpu runs the cpu but you want the gpu to run a gpu? Or cpu emulation of Gpu?<p>there&#x27;s no free lunch here ever hence the cursed","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T02:56:23.000Z","created_at_i":1793242583,"id":50284059,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"This is cool but it&#x27;d be way more useful if they had made a GPU, seeing as how expensive those have gotten","title":null,"type":"comment","url":null},{"author":"giveexamples","children":[{"author":"_bobm","children":[],"created_at":"2026-10-29T10:16:56.000Z","created_at_i":1793269016,"id":50286803,"options":[],"parent_id":50284062,"points":null,"story_id":50282838,"text":"Super nice.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T02:56:43.000Z","created_at_i":1793242603,"id":50284062,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"<a href=\"https:&#x2F;&#x2F;www.percepta.ai&#x2F;blog&#x2F;can-llms-be-computers\" rel=\"nofollow\">https:&#x2F;&#x2F;www.percepta.ai&#x2F;blog&#x2F;can-llms-be-computers</a><p>They implemented wasm in transformer with cpu decoding for the wasm part.","title":null,"type":"comment","url":null},{"author":"jonrouach","children":[],"created_at":"2026-10-29T03:00:18.000Z","created_at_i":1793242818,"id":50284077,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"i wonder if you could implement &quot;authenticated token authorship&quot; and self-verified running with this. \nthe model verifies an input as signed by an authorized requester, and signs its own outputs. eventually it also authenticates its own running via e.g. snarks? :)\nthere&#x27;s lots of meta available with these toys..","title":null,"type":"comment","url":null},{"author":"lacoolj","children":[],"created_at":"2026-10-29T03:26:07.000Z","created_at_i":1793244367,"id":50284224,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"I 100% see the potential here and am dying to see it in 30 days<p>Or maybe ill join your discord and hopefully we can riff it out to get there faster","title":null,"type":"comment","url":null},{"author":"Ericson2314","children":[],"created_at":"2026-10-29T03:43:17.000Z","created_at_i":1793245397,"id":50284325,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"The real question is, do current training methods allow one to learn this when training on enough, say, assembly, or can the weights only be achieved via hard-coding?<p>A fun and important thought experiment about the the space of nerual networks vs the image of current training methods.<p>Most discourse conflates neural networks and <i>trainable</i> neural networks.","title":null,"type":"comment","url":null},{"author":"0x20cowboy","children":[],"created_at":"2026-10-29T04:01:17.000Z","created_at_i":1793246477,"id":50284404,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"This is very clever. An inversion of tools. Awesome.","title":null,"type":"comment","url":null},{"author":"jedbrooke","children":[],"created_at":"2026-10-29T04:55:11.000Z","created_at_i":1793249711,"id":50284718,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"I wonder if this approach would work for AdderBoard[1][2] (a competition to make hand written transformers that can add two 10 digit numbers in the least amount of parameters possible), or if it uses way too many parameters to be competitive<p>[1]: <a href=\"https:&#x2F;&#x2F;github.com&#x2F;anadim&#x2F;AdderBoard\" rel=\"nofollow\">https:&#x2F;&#x2F;github.com&#x2F;anadim&#x2F;AdderBoard</a>\n[2]: hn discussion <a href=\"https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=47170030&amp;utm_source=perplexity\">https:&#x2F;&#x2F;news.ycombinator.com&#x2F;item?id=47170030&amp;utm_source=per...</a>","title":null,"type":"comment","url":null},{"author":"jacquesm","children":[{"author":"nakedneuron","children":[{"author":"jacquesm","children":[{"author":"nakedneuron","children":[{"author":"jacquesm","children":[],"created_at":"2026-10-30T04:08:02.000Z","created_at_i":1793333282,"id":50299770,"options":[],"parent_id":50297768,"points":null,"story_id":50282838,"text":"I have some ideas on that. Mail? see my profile (your mail if you entered it is not visible).","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T23:34:19.000Z","created_at_i":1793316859,"id":50297768,"options":[],"parent_id":50291117,"points":null,"story_id":50282838,"text":"Thx!<p>I wonder if this field&#x2F;technique helps tackling the alignment problem..","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T15:56:35.000Z","created_at_i":1793289395,"id":50291117,"options":[],"parent_id":50290614,"points":null,"story_id":50282838,"text":"Context is whatever you put in it. You can put text in there but you can also put I&#x2F;O in there. That gives all kinds of weird and interesting models of interaction.<p>I&#x27;ve bolted a 1980&#x27;s construct onto the side of a 2026 era LLM and the results are very interesting, and unlike anything I imagined up front. I&#x27;m still wondering where I should take the project, but so far it&#x27;s been a lot of fun with some unexpected turns along the way.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T15:27:26.000Z","created_at_i":1793287646,"id":50290614,"options":[],"parent_id":50284732,"points":null,"story_id":50282838,"text":"Care to elaborate?","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T04:57:16.000Z","created_at_i":1793249836,"id":50284732,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Heh, this is very timely, it is more or less exactly what I&#x27;m busy with right now but I&#x27;m taking the idea in a completely different direction. Fascinating.","title":null,"type":"comment","url":null},{"author":"throwaway81523","children":[],"created_at":"2026-10-29T04:57:39.000Z","created_at_i":1793249859,"id":50284735,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Wow!  I wonder if it can start programming itself soon.","title":null,"type":"comment","url":null},{"author":"hislaziness","children":[{"author":"v3ss0n","children":[{"author":"hypfer","children":[],"created_at":"2026-10-29T05:33:00.000Z","created_at_i":1793251980,"id":50284915,"options":[],"parent_id":50284884,"points":null,"story_id":50282838,"text":"Is this supposed to play Linkin Park in my head or is that a neuron misfire?","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T05:26:51.000Z","created_at_i":1793251611,"id":50284884,"options":[],"parent_id":50284858,"points":null,"story_id":50282838,"text":"And -- that is our reality.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T05:21:43.000Z","created_at_i":1793251303,"id":50284858,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"This is amazing, now waiting for someone to run an llm on the cpu. Eventually it will be LLMs all the way down...","title":null,"type":"comment","url":null},{"author":"Founderarcstone","children":[],"created_at":"2026-10-29T05:26:59.000Z","created_at_i":1793251619,"id":50284886,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"That\u2019s great new!","title":null,"type":"comment","url":null},{"author":"WorldPeas","children":[],"created_at":"2026-10-29T06:12:55.000Z","created_at_i":1793254375,"id":50285109,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"the bitter lesson can&#x27;t hurt me here! &#x2F;s","title":null,"type":"comment","url":null},{"author":"yieldcrv","children":[],"created_at":"2026-10-29T06:13:45.000Z","created_at_i":1793254425,"id":50285112,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"&gt; This means that the GDN layers themselves can work exactly as RAM<p>great, the memory crisis is solved, just make the models occupying RAM expose their own random access memory","title":null,"type":"comment","url":null},{"author":"nullc","children":[],"created_at":"2026-10-29T06:23:38.000Z","created_at_i":1793255018,"id":50285174,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Hm. I wonder if having a differentiable CPU in fixed weights might be useful-- you could propagate gradients through it.  At inference time it could be replaced with a conventional implementation.<p>I think the RNN sidebar does the reader a disservice.  Ordinary casual attention can do exactly the same thing-- it&#x27;s just less computationally efficient (state grows with the number of bits vs the number of accesses) and so not as useful for qwenputer compiler.","title":null,"type":"comment","url":null},{"author":"baq","children":[],"created_at":"2026-10-29T06:29:16.000Z","created_at_i":1793255356,"id":50285206,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Not too far fetched to say this potentially solves continual learning, which is a scary prospect. Wonder what ram and disk prices will go to once every model needs its own long term memory capacity and not just weights and cache.<p>I had an idea of splicing a z3 solver into the weights of a sufficiently smart model after the first chatgpt release in what feels like a glaciation event ago so the things could do logic and literally make no mistakes. Was never in a position to follow up. We\u2019re almost here now.","title":null,"type":"comment","url":null},{"author":"gspr","children":[],"created_at":"2026-10-29T06:38:45.000Z","created_at_i":1793255925,"id":50285274,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Nearly unrelatedly: a few months back I tried to have Qwen and all the frontier models <i>be</i> a RISCV CPU, and they all failed miserably every time. They&#x27;d get a handful of instructions in at most before derailing completely. What surprised me the most was that they would all often fail on decoding instructions, which should be pretty close to a task that they&#x27;ve shown themselves to be good at before.<p>I even added a warmup phase where they were given the answer to a decode and a few steps of running, and ask them to abort if they disagreed. Didn&#x27;t help.<p>All in all, for someone who doesn&#x27;t use LLMs much, this was a far more exhausting and boring exercise than I&#x27;d imagine it to be. The only thing that sparked some joy was the models&#x27; persistent cheating, whereby they&#x27;d try to analyze the whole program upfront and only give the final output (when applicable), despite orders to faithfully step through each and every instruction.","title":null,"type":"comment","url":null},{"author":"jchook","children":[],"created_at":"2026-10-29T06:42:05.000Z","created_at_i":1793256125,"id":50285292,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"What does this actually show?","title":null,"type":"comment","url":null},{"author":"CrzyLngPwd","children":[],"created_at":"2026-10-29T07:51:25.000Z","created_at_i":1793260285,"id":50285699,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"So, essentially, turtles all the way down :-)","title":null,"type":"comment","url":null},{"author":"bozdemir","children":[],"created_at":"2026-10-29T07:52:16.000Z","created_at_i":1793260336,"id":50285712,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"oh yesss, RAM producers gonna love this :D Jokes aside very interesting experiment. Giving a fully functional cpu ram and hd, so they can technically hide  stuff better and avoid getting caught in COT (yikes).","title":null,"type":"comment","url":null},{"author":"marcocastignoli","children":[],"created_at":"2026-10-29T07:54:06.000Z","created_at_i":1793260446,"id":50285730,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"can you run qwen3.5 on the riscv CPU running in qwen3.5, though?","title":null,"type":"comment","url":null},{"author":"avadodin","children":[],"created_at":"2026-10-29T08:32:40.000Z","created_at_i":1793262760,"id":50286039,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"We got RISC-V DOOM melting down a cluster of $20k GPUs before GTA6.","title":null,"type":"comment","url":null},{"author":"hollowonepl","children":[],"created_at":"2026-10-29T08:57:14.000Z","created_at_i":1793264234,"id":50286228,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Oh my Gosh.. this is a little bit too abstract to me as first encounter, but the concept never the less is cool to digest deeper into!","title":null,"type":"comment","url":null},{"author":"boomskats","children":[],"created_at":"2026-10-29T09:03:49.000Z","created_at_i":1793264629,"id":50286282,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Hmm.<p>I do wonder if all of this would be possible had they not spent all that time secretly distilling of all our superior, western, closed-source AI models.","title":null,"type":"comment","url":null},{"author":"amelius","children":[],"created_at":"2026-10-29T09:03:58.000Z","created_at_i":1793264638,"id":50286284,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"This kind of thing is what some three letter agencies dream about.","title":null,"type":"comment","url":null},{"author":"amelius","children":[],"created_at":"2026-10-29T09:05:06.000Z","created_at_i":1793264706,"id":50286293,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"The opinionated CPU. I was expecting this from Apple, to be honest.","title":null,"type":"comment","url":null},{"author":"jnurmine","children":[],"created_at":"2026-10-29T09:13:57.000Z","created_at_i":1793265237,"id":50286364,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Interesting...<p>Can you give it a program, a state of output, and tell it to work backwards?","title":null,"type":"comment","url":null},{"author":"teekert","children":[{"author":"kees99","children":[{"author":"teekert","children":[],"created_at":"2026-10-29T10:19:02.000Z","created_at_i":1793269142,"id":50286820,"options":[],"parent_id":50286666,"points":null,"story_id":50282838,"text":"A connectome is typical grown, in wombs around the earth... DNA contains all the information needed to build it. I think we should start there, not with a printer.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T09:59:57.000Z","created_at_i":1793267997,"id":50286666,"options":[],"parent_id":50286573,"points":null,"story_id":50282838,"text":"Dunno. Is there technology to &quot;print&quot; a connectome in the same way as peptide&#x2F;proteine synthesis does with amino-acid sequence?","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T09:46:57.000Z","created_at_i":1793267217,"id":50286573,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Is this the precursor to biological computers? I mean, biological computers don&#x27;t have transistors as a basis, nor does this...<p>And before any answers with &quot;But these neurons are very different to biological neurons!&quot;: Yes I know, I&#x27;m a biologist, I cultured neurons. But, these neurons are closer to neurons than semiconductor transistors.","title":null,"type":"comment","url":null},{"author":"fredley","children":[],"created_at":"2026-10-29T10:40:13.000Z","created_at_i":1793270413,"id":50286974,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"With RAM prices what they are, I&#x27;m glad we&#x27;ve found a way to turn LLMs back into RAM.","title":null,"type":"comment","url":null},{"author":"gcr","children":[],"created_at":"2026-10-29T10:43:41.000Z","created_at_i":1793270621,"id":50286992,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Really cool work!<p>Do note that a custom host runtime is still responsible for loading firmware, booting the CPU to the starting point, and compiling&#x2F;loading the program to run. While the CPU is running, the host runtime makes sure that only the CPU layers run by manually skipping Qwen\u2019s own layers.<p>I wish the author would be more forthcoming about these limitations. The central claim about \u201cno external runtime\u201d or \u201cnot a plugin\u201d feels a little dishonest to me since this doesn\u2019t work without some pretty invasive changes to the inference driver.","title":null,"type":"comment","url":null},{"author":"xfcgv","children":[],"created_at":"2026-10-29T11:27:04.000Z","created_at_i":1793273224,"id":50287334,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"PUBGM FLASH","title":null,"type":"comment","url":null},{"author":"gavinray","children":[],"created_at":"2026-10-29T11:52:43.000Z","created_at_i":1793274763,"id":50287557,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"<p><pre><code>  &gt; &quot;add_or_sub_big: Qwenputer scores 97.5%, the same as with a Python tool, and 87.5% for base Qwen.&quot;\n</code></pre>\nMore than one of the tests in the post show sub 100% accuracy with the embedded computer.<p>I&#x27;m sorry but I&#x27;m not sure I understand how a calculator that isn&#x27;t 100% accurate is useful?","title":null,"type":"comment","url":null},{"author":"low-rank","children":[{"author":"sharpshadow","children":[{"author":"sznio","children":[],"created_at":"2026-10-29T17:07:03.000Z","created_at_i":1793293623,"id":50292402,"options":[],"parent_id":50287977,"points":null,"story_id":50282838,"text":"&gt;GitHub authors<p>the most misleading thing I read this week","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T12:37:43.000Z","created_at_i":1793277463,"id":50287977,"options":[],"parent_id":50287673,"points":null,"story_id":50282838,"text":"More infos about it here: <a href=\"https:&#x2F;&#x2F;tensorjournal.com&#x2F;en&#x2F;news&#x2F;doom-floor-plan-riscv-cpu-in-qwen-weights\" rel=\"nofollow\">https:&#x2F;&#x2F;tensorjournal.com&#x2F;en&#x2F;news&#x2F;doom-floor-plan-riscv-cpu-...</a>","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T12:07:21.000Z","created_at_i":1793275641,"id":50287673,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Yes it can run DOOM! <a href=\"https:&#x2F;&#x2F;x.com&#x2F;onloglogn&#x2F;status&#x2F;2115776803688374474\" rel=\"nofollow\">https:&#x2F;&#x2F;x.com&#x2F;onloglogn&#x2F;status&#x2F;2115776803688374474</a>","title":null,"type":"comment","url":null},{"author":"AlexAegis","children":[],"created_at":"2026-10-29T12:21:53.000Z","created_at_i":1793276513,"id":50287797,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Humanity is desperate to return to the bicameral mind, this time we create our own gods.","title":null,"type":"comment","url":null},{"author":"jcmontx","children":[{"author":"ed_balls","children":[{"author":"jcmontx","children":[],"created_at":"2026-10-29T12:55:29.000Z","created_at_i":1793278529,"id":50288182,"options":[],"parent_id":50288107,"points":null,"story_id":50282838,"text":"The bootstrapped LLM was something I didn&#x27;t see coming","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T12:50:12.000Z","created_at_i":1793278212,"id":50288107,"options":[],"parent_id":50288057,"points":null,"story_id":50282838,"text":"Now, based on this Qwenputer someone should build GPT, which stands for Gomputer Pomputer Tomputer.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T12:45:40.000Z","created_at_i":1793277940,"id":50288057,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"This kind of posts make me feel so inadequate. Like I&#x27;m some sort of lesser mind. How the hell do you even come up with such idea?","title":null,"type":"comment","url":null},{"author":"scotty79","children":[],"created_at":"2026-10-29T13:12:06.000Z","created_at_i":1793279526,"id":50288435,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"The most interesting part of this is normal LLM interacting with directly attached deterministic computation unit.<p>It&#x27;s like successfully wiring your brain to a calculator.<p>I think it would cheaply provide LLMs a lot of benefit if we embedded in them directly a computer and a memory so they can internally process things predictably.<p>And some benefit is indeed shown even in this cursed experiment.","title":null,"type":"comment","url":null},{"author":"montjoy","children":[],"created_at":"2026-10-29T13:17:28.000Z","created_at_i":1793279848,"id":50288523,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Next step: run Qwen inside of the Qwenputer. I want more layers of inefficincy!","title":null,"type":"comment","url":null},{"author":"Krea8ly","children":[],"created_at":"2026-10-29T13:18:33.000Z","created_at_i":1793279913,"id":50288544,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Apply to Kre8ly.com\nfor internships.","title":null,"type":"comment","url":null},{"author":"dooglius","children":[],"created_at":"2026-10-29T13:29:52.000Z","created_at_i":1793280592,"id":50288727,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"&gt; The CPU is used completely internally, and not invoked through any external tool calls. In order to make the model use this reliably, I decided to go the cheap way: by piggybacking on the tool call format that models are quite well-trained on, Qwen sends the CPU its instructions and reads back the results. No external tool calls or runtime are used<p>I&#x27;m confused, is it doing tool calls or not? Is this just saying that it writes a tool call but the NN then writes the response inline rather than the call being processed by the harness?","title":null,"type":"comment","url":null},{"author":"0xdeadbeefbabe","children":[],"created_at":"2026-10-29T14:24:23.000Z","created_at_i":1793283863,"id":50289615,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"How do you do the clock?","title":null,"type":"comment","url":null},{"author":"lumost","children":[{"author":"aerodexis","children":[],"created_at":"2026-10-29T14:37:24.000Z","created_at_i":1793284644,"id":50289819,"options":[],"parent_id":50289647,"points":null,"story_id":50282838,"text":"It doesn&#x27;t. This is extending an earlier PoC where someone created a tensor representation of a CPU and you prompted it with the code you wanted to run.<p>This will be interesting when something similar to a CPU can be triggered off of the LLM&#x27;s own internal state representation - but imo we&#x27;re far away from that.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T14:26:26.000Z","created_at_i":1793283986,"id":50289647,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"If I understand this clearly enough, what they really did was<p>A) add a post-processor which accepted a decoded tool call specifying what the processor should invoke.<p>B) had the post-processor perform the computation in tensor space.<p>The kv-cache&#x2F;activations were not shared between qwen&#x2F;the processor which is how they avoided fine tuning etc. I&#x27;m not clear how the tensor representation benefited the computation in this pipeline.","title":null,"type":"comment","url":null},{"author":"0xdeadbeefbabe","children":[],"created_at":"2026-10-29T14:36:19.000Z","created_at_i":1793284579,"id":50289804,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"If the qwen were conscious it ought to feel mocked.","title":null,"type":"comment","url":null},{"author":"gchamonlive","children":[],"created_at":"2026-10-29T15:56:22.000Z","created_at_i":1793289382,"id":50291113,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"We can port doom to qwen already","title":null,"type":"comment","url":null},{"author":"nxobject","children":[],"created_at":"2026-10-29T16:01:57.000Z","created_at_i":1793289717,"id":50291205,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"Well, that kinda reverses the formula of a TPU next to a CPU\u2026","title":null,"type":"comment","url":null},{"author":"jonnycomputer","children":[],"created_at":"2026-10-29T17:07:48.000Z","created_at_i":1793293668,"id":50292413,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"The advantage here is that now you can run Qwen3.5 inside Qwen3.5 inside Qwen3.5 inside ...","title":null,"type":"comment","url":null},{"author":"Lerc","children":[],"created_at":"2026-10-29T18:17:03.000Z","created_at_i":1793297823,"id":50293544,"options":[],"parent_id":50282838,"points":null,"story_id":50282838,"text":"I like these kind of projects.  While there are text descriptions that show the Turing completeness of transformers, making things like this make the implications obvious.<p>It helps address the &#x27;just predicting the next word&#x27; argument suggesting they cannot possibly think.<p>When you can make a CPU like this, that&#x27;s a clear enough display that it can do anything a computer can do.  To say that LLMs cannot reach AGI is saying that no computer can.<p>Some people still think that, but this directly addresses the people who think computers might one day get there but LLMs never will.","title":null,"type":"comment","url":null}],"created_at":"2026-10-29T00:25:45.000Z","created_at_i":1793233545,"id":50282838,"options":[],"parent_id":null,"points":698,"story_id":50282838,"text":null,"title":"Qwenputer: A functioning, deterministic RISC-V CPU inside Qwen3.5","type":"story","url":"https://divagr.com/blog/qwenputer"}
