I appreciate being able to see changes I make as soon as possible, so Aurora comes with hot reloading and incremental static regeneration for development. Refreshes and reloads are ~200ms, and trigger automatically.
You can see a demo at:
https://github.com/capjamesg/aurora/assets/37276661/39f62bd8...
Aurora comes with a "hooks" API that lets you control state before page generation and after site build. I use the former feature to read locally-cached link previews. There is also a feature to load data from JSON and CSV files.
I would love feedback!
[1] https://jamesg.blog\n [2] https://jamesg.blog/2024/06/16/aurora-isr/I appreciate being able to see changes I make as soon as possible, so Aurora comes with hot reloading and incremental static regeneration for development. Refreshes and reloads are ~200ms, and trigger automatically.
You can see a demo at:
https://github.com/capjamesg/aurora/assets/37276661/39f62bd8...
Aurora comes with a "hooks" API that lets you control state before page generation and after site build. I use the former feature to read locally-cached link previews. There is also a feature to load data from JSON and CSV files.
I would love feedback!
[1] https://jamesg.blog\n [2] https://jamesg.blog/2024/06/16/aurora-isr/With this spirit of exploring text data in different ways in mind, I have been working on KGL, a query language for knowledge graphs. Using GPT, I ingested my personal website into semantic ("subject, predicate, object") triples. I then turned these into a graph that I could query.
KGL is designed for unstructured data, whereas RDF was designed for explicitly structured data (and thus suffers from significant verbosity that is not necessary for my application). SPARQL, which is used to query RDF, is similarly complex. SPARQL as conducive to play, the intent for this language.
The language is processed as pointers between concepts, like:
{ taylor swift -> created }!\nYou can create queries of arbitrary length, like:
{ taylor swift -> created -> have }\nDemo video: https://jamesg.blog/assets/kgl-interpreter-demo.mp4
Playground with which you can experiment: https://jamesg.blog/kgl/
[1]: https://jamesg.blog/2023/06/03/website-index/
[2]: https://jamesg.blog/2024/03/22/kgl/"},"title":{"matchLevel":"none","matchedWords":[],"value":"Show HN: KGL, a query language for knowledge graphs"},"url":{"matchLevel":"none","matchedWords":[],"value":"https://github.com/capjamesg/knowledge-graph-language"}},"_tags":["story","author_zerojames","story_39827078","show_hn"],"author":"zerojames","created_at":"2024-03-26T12:37:07Z","created_at_i":1711456627,"num_comments":0,"objectID":"39827078","points":3,"story_id":39827078,"story_text":"I am fascinated by different ways to explore corpora of texts. A few months ago, I built an index for my blog [1], inspired by physical book indices, which lets you explore blog posts by key word.
With this spirit of exploring text data in different ways in mind, I have been working on KGL, a query language for knowledge graphs. Using GPT, I ingested my personal website into semantic ("subject, predicate, object") triples. I then turned these into a graph that I could query.
KGL is designed for unstructured data, whereas RDF was designed for explicitly structured data (and thus suffers from significant verbosity that is not necessary for my application). SPARQL, which is used to query RDF, is similarly complex. SPARQL as conducive to play, the intent for this language.
The language is processed as pointers between concepts, like:
{ taylor swift -> created }!\nYou can create queries of arbitrary length, like:
{ taylor swift -> created -> have }\nDemo video: https://jamesg.blog/assets/kgl-interpreter-demo.mp4
Playground with which you can experiment: https://jamesg.blog/kgl/
[1]: https://jamesg.blog/2023/06/03/website-index/
[2]: https://jamesg.blog/2024/03/22/kgl/","title":"Show HN: KGL, a query language for knowledge graphs","updated_at":"2024-09-20T16:39:32Z","url":"https://github.com/capjamesg/knowledge-graph-language"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"zerojames"},"story_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"One of my favourite features of Wikipedia is the hovercard. You can hover over a link and see a preview of the content at the link destination.
I made a small JavaScript utility that accepts a JSON object with link information and enables hovercards on a personal website. I am "eating what I cook" per se by running this on my website. You can hover over any link in blog posts on my personal website and see hovercard.js in action.
Here's an example:
https://jamesg.blog/2023/05/19/airport-pianos/\n[1] https://jamesg.blog/2022/10/12/hovercards/"},"title":{"matchLevel":"none","matchedWords":[],"value":"Show HN: Hovercard.js, simple hovercard utility for web pages"},"url":{"matchLevel":"none","matchedWords":[],"value":"https://github.com/capjamesg/hovercard.js"}},"_tags":["story","author_zerojames","story_37408386","show_hn"],"author":"zerojames","children":[37409728],"created_at":"2023-09-06T17:41:10Z","created_at_i":1694022070,"num_comments":1,"objectID":"37408386","points":2,"story_id":37408386,"story_text":"One of my favourite features of Wikipedia is the hovercard. You can hover over a link and see a preview of the content at the link destination.
I made a small JavaScript utility that accepts a JSON object with link information and enables hovercards on a personal website. I am "eating what I cook" per se by running this on my website. You can hover over any link in blog posts on my personal website and see hovercard.js in action.
Here's an example:
https://jamesg.blog/2023/05/19/airport-pianos/\n[1] https://jamesg.blog/2022/10/12/hovercards/","title":"Show HN: Hovercard.js, simple hovercard utility for web pages","updated_at":"2024-09-20T14:57:47Z","url":"https://github.com/capjamesg/hovercard.js"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"zerojames"},"story_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"Over the last two weeks, I have been learning more about how NoSQL databases work. I decided to make a database, with the intent to use it on my personal website.
JameSQL supports several query types, including and/or, range, span, and wildcard. It also has a text-based query language with support for operators that is transpiled back into a JSON query to be executed.
You can try it out at:
https://jamesg.blog/search-pages/?q=category_lower:%27indiew...
Under the hood, I use a reverse index for text and boolean searches, a b-tree for range queries (using the btrees Python package), and a trie for string prefix queries (using the pygtrie package). Most queries are executed in < 0.01s."},"title":{"matchLevel":"none","matchedWords":[],"value":"Show HN: A Python-based, in-memory NoSQL database"},"url":{"matchLevel":"none","matchedWords":[],"value":"https://github.com/capjamesg/jamesql"}},"_tags":["story","author_zerojames","story_41339480","show_hn"],"author":"zerojames","created_at":"2024-08-24T16:45:49Z","created_at_i":1724517949,"num_comments":0,"objectID":"41339480","points":1,"story_id":41339480,"story_text":"Over the last two weeks, I have been learning more about how NoSQL databases work. I decided to make a database, with the intent to use it on my personal website.
JameSQL supports several query types, including and/or, range, span, and wildcard. It also has a text-based query language with support for operators that is transpiled back into a JSON query to be executed.
You can try it out at:
https://jamesg.blog/search-pages/?q=category_lower:%27indiew...
Under the hood, I use a reverse index for text and boolean searches, a b-tree for range queries (using the btrees Python package), and a trie for string prefix queries (using the pygtrie package). Most queries are executed in < 0.01s.","title":"Show HN: A Python-based, in-memory NoSQL database","updated_at":"2024-09-20T17:38:39Z","url":"https://github.com/capjamesg/jamesql"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"zerojames"},"story_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"I have been experimenting with procedural text generation. I made an application that uses the words on the front-page of the HN homepage to generate poems.
The poems are generated with Tracery, which lets you specify grammars for generating text. Poems are regenerated hourly.
In testing, some poems are delightful (i.e. "for all the radiant night" and "like a zip in the hypothesis", and "my compiler is mathematical", whereas others are... not-so-great.
I wrote about how it works on my blog [0]. I would love to know what rules I could use to improve this tool.
[0]: https://jamesg.blog/hn-poetry/"},"title":{"matchLevel":"none","matchedWords":[],"value":"Show HN: Hacker News Poetry"},"url":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"https://hnpoetry.jamesg.blog/"}},"_tags":["story","author_zerojames","story_39589400","show_hn"],"author":"zerojames","created_at":"2024-03-04T11:59:38Z","created_at_i":1709553578,"num_comments":0,"objectID":"39589400","points":1,"story_id":39589400,"story_text":"I have been experimenting with procedural text generation. I made an application that uses the words on the front-page of the HN homepage to generate poems.
The poems are generated with Tracery, which lets you specify grammars for generating text. Poems are regenerated hourly.
In testing, some poems are delightful (i.e. "for all the radiant night" and "like a zip in the hypothesis", and "my compiler is mathematical", whereas others are... not-so-great.
I wrote about how it works on my blog [0]. I would love to know what rules I could use to improve this tool.
[0]: https://jamesg.blog/hn-poetry/","title":"Show HN: Hacker News Poetry","updated_at":"2024-09-20T16:34:23Z","url":"https://hnpoetry.jamesg.blog/"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"GarnetFloride"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"Warning: opening a can of worms.\nAnn Blair is a great source on general, but there are so many facets to this topic here's a list that I have read or am going to read.
* The Notebook: A History of Thinking on Paper by Roland Allen \n* The Carrier Bag Theory of Fiction by Ursula K. Le Guin\n* Too Much To Know: Managing Scholarly Information Before the Modern Age by \nAnn M. Blair\n* Communicating with Slip Boxes: An Empirical Account by Niklas Luhmann\n* Akin's Laws of Spacecraft Design\n* Writing the Laboratory Notebook by Howard M Kanare\n* Paper Machines: About Cards & Catalogs by Markus Krajewski\n* A System for Writing by Bob Doto\n* Building a Second Brain By Tiago Forte\n* Index, a History of the by Dennis Duncan\n* Forgetting Machines: Knowledge Management Evolution in Early Modern Europe\nby Alberto Cevolini\n* The Filing Cabinet: A Vertical History of Information by Craig Robertson \n* How to Take Smart Notes by Sonke Ahrens\n* Filing and Database Systems by Jeffrey Robert Stewart, Judith A. Scharle, Judith Scharle Greene\n* Organizing from the Inside Out by Julie Morgenstern\n* The Library: A Fragile History by Andrew Pettegree, Arthur der Weduwen\n* The Extended Mind by Annie Murphy Paul \n* Stolen Focus: Why You Can't Pay Attention by Johann Hari\n* Papyrus: The Invention of Books in the Ancient World by Irene Vallejo\n* Filing by Jeffrey Robert Stewart, Judith A. Scharle\n* How Romantics and Victorians Organized Information by Jillian M. Hess\n* A Writer's Notebook by W. Somerset Maugham\n* The Bullet Journal Method by Ryder Carroll \n* The Medieval Scriptorium by Sara J. Charles\n* Chance Particulars by Sara Mansfield Taber, Maud Taber-Thomas \n* The Great Mental Models Volume 1- General Thinking Concepts by Parrish, Shane; Beaubien, Rhiannon \n* The Product is Docs by Christopher Gales\n* Antinet Zettelkasten by Scott P. Scheper \nArticulating design decisions by Tom Greever \n The Card System at the Office by J Kaiser\n* Systematic Indexing by J Kaiser\n* Commonplace Books and the Teaching of Style by Lynee Lewis Gaillet\n* Magic and hypersystems : constructing the information-sharing library by\nHarold Billings.\n* The Magical Number Seven, Plus or Minus Two: Some Limits on our Capacity for\nProcessing Information by George A. Miller \n* The Commonplace Book by Elizabeth Smither\n* The Oxford Handbook of Expertise\n* Trees, maps, and theorems: Effective communication for rational minds by\nJean-luc Doumont\n* Applied Secretarial Practice by Rupert P. Sorelle and John Robert Gregg \n* The Card Catalog by Carla Hayden\n* What is a Document by Michael Buckland\n* The Commonplace Book by Ann Blair\n* Make Better Documents by Anil Dash\n* A Core Calculus for Documents by Will Crichton and Shriram Krishnamurthi\n* The Craft of Research by Wayne C. Booth, Gregory G. Colomb, Joseph M. Williams\n* Information by Anthony Grafton\n* The Card Catalog by Carla Hayden\n* Files: Law and Media Technology by Cornelia Vismann\n* Living Documentation: Continuous Knowledge by Cyrille Martraire\n* Living in Information by Jorge Arango\n* How to Write a Technical Paper: Structure and Style of the Epitome of your Research\u2020 by Georgios Varsamopoulos\n* Information Development: Managing Your Documentation Projects, Portfolio, and People by JoAnn T. Hackos\n* Information Architecture: For the Web and Beyond by Louis Rosenfeld, Peter Morville, Jorge Arango\n* Software Technical Writing: A Guidebook by James (jamesg.blog)"},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Ask HN: What did you find out or explore today?"}},"_tags":["comment","author_GarnetFloride","story_46619464"],"author":"GarnetFloride","children":[46644840],"comment_text":"Warning: opening a can of worms.\nAnn Blair is a great source on general, but there are so many facets to this topic here's a list that I have read or am going to read.
* The Notebook: A History of Thinking on Paper by Roland Allen \n* The Carrier Bag Theory of Fiction by Ursula K. Le Guin\n* Too Much To Know: Managing Scholarly Information Before the Modern Age by \nAnn M. Blair\n* Communicating with Slip Boxes: An Empirical Account by Niklas Luhmann\n* Akin's Laws of Spacecraft Design\n* Writing the Laboratory Notebook by Howard M Kanare\n* Paper Machines: About Cards & Catalogs by Markus Krajewski\n* A System for Writing by Bob Doto\n* Building a Second Brain By Tiago Forte\n* Index, a History of the by Dennis Duncan\n* Forgetting Machines: Knowledge Management Evolution in Early Modern Europe\nby Alberto Cevolini\n* The Filing Cabinet: A Vertical History of Information by Craig Robertson \n* How to Take Smart Notes by Sonke Ahrens\n* Filing and Database Systems by Jeffrey Robert Stewart, Judith A. Scharle, Judith Scharle Greene\n* Organizing from the Inside Out by Julie Morgenstern\n* The Library: A Fragile History by Andrew Pettegree, Arthur der Weduwen\n* The Extended Mind by Annie Murphy Paul \n* Stolen Focus: Why You Can't Pay Attention by Johann Hari\n* Papyrus: The Invention of Books in the Ancient World by Irene Vallejo\n* Filing by Jeffrey Robert Stewart, Judith A. Scharle\n* How Romantics and Victorians Organized Information by Jillian M. Hess\n* A Writer's Notebook by W. Somerset Maugham\n* The Bullet Journal Method by Ryder Carroll \n* The Medieval Scriptorium by Sara J. Charles\n* Chance Particulars by Sara Mansfield Taber, Maud Taber-Thomas \n* The Great Mental Models Volume 1- General Thinking Concepts by Parrish, Shane; Beaubien, Rhiannon \n* The Product is Docs by Christopher Gales\n* Antinet Zettelkasten by Scott P. Scheper \nArticulating design decisions by Tom Greever \n The Card System at the Office by J Kaiser\n* Systematic Indexing by J Kaiser\n* Commonplace Books and the Teaching of Style by Lynee Lewis Gaillet\n* Magic and hypersystems : constructing the information-sharing library by\nHarold Billings.\n* The Magical Number Seven, Plus or Minus Two: Some Limits on our Capacity for\nProcessing Information by George A. Miller \n* The Commonplace Book by Elizabeth Smither\n* The Oxford Handbook of Expertise\n* Trees, maps, and theorems: Effective communication for rational minds by\nJean-luc Doumont\n* Applied Secretarial Practice by Rupert P. Sorelle and John Robert Gregg \n* The Card Catalog by Carla Hayden\n* What is a Document by Michael Buckland\n* The Commonplace Book by Ann Blair\n* Make Better Documents by Anil Dash\n* A Core Calculus for Documents by Will Crichton and Shriram Krishnamurthi\n* The Craft of Research by Wayne C. Booth, Gregory G. Colomb, Joseph M. Williams\n* Information by Anthony Grafton\n* The Card Catalog by Carla Hayden\n* Files: Law and Media Technology by Cornelia Vismann\n* Living Documentation: Continuous Knowledge by Cyrille Martraire\n* Living in Information by Jorge Arango\n* How to Write a Technical Paper: Structure and Style of the Epitome of your Research\u2020 by Georgios Varsamopoulos\n* Information Development: Managing Your Documentation Projects, Portfolio, and People by JoAnn T. Hackos\n* Information Architecture: For the Web and Beyond by Louis Rosenfeld, Peter Morville, Jorge Arango\n* Software Technical Writing: A Guidebook by James (jamesg.blog)","created_at":"2026-01-16T02:59:07Z","created_at_i":1768532347,"objectID":"46642499","parent_id":46633117,"story_id":46619464,"story_title":"Ask HN: What did you find out or explore today?","updated_at":"2026-03-05T23:25:37Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"KTallguy"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"I\u2019ve been using Artemis ever since it was posted here earlier this year. I love it because there is very little pressure to read everything and it updates infrequently so I don\u2019t impulsively check it. Great product.
https://news.ycombinator.com/item?id=42471913
https://artemis.jamesg.blog/"},"story_title":{"matchLevel":"none","matchedWords":[],"value":"RSS is awesome"},"story_url":{"matchLevel":"none","matchedWords":[],"value":"https://evanverma.com/rss-is-awesome"}},"_tags":["comment","author_KTallguy","story_45058024"],"author":"KTallguy","comment_text":"I\u2019ve been using Artemis ever since it was posted here earlier this year. I love it because there is very little pressure to read everything and it updates infrequently so I don\u2019t impulsively check it. Great product.
https://news.ycombinator.com/item?id=42471913
https://artemis.jamesg.blog/","created_at":"2025-08-29T22:30:00Z","created_at_i":1756506600,"objectID":"45070126","parent_id":45058024,"story_id":45058024,"story_title":"RSS is awesome","story_url":"https://evanverma.com/rss-is-awesome","updated_at":"2026-03-05T22:34:28Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"kayvulpe"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"https://artemis.jamesg.blog/app
Really like this."},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Show HN: Artemis, a Calm Web Reader"},"story_url":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"https://artemis.jamesg.blog/"}},"_tags":["comment","author_kayvulpe","story_42471913"],"author":"kayvulpe","comment_text":"https://artemis.jamesg.blog/app
Really like this.","created_at":"2024-12-21T10:34:44Z","created_at_i":1734777284,"objectID":"42478810","parent_id":42471913,"story_id":42471913,"story_title":"Show HN: Artemis, a Calm Web Reader","story_url":"https://artemis.jamesg.blog/","updated_at":"2024-12-21T10:38:36Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"exprez135"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"The tool actually is open source, so you could self-host it if you wish. MIT license, in Python. The repository [1] is linked in the blog post the author wrote about the project [2].
[1]: https://github.com/capjamesg/web-reader
[2]: https://jamesg.blog/2024/11/30/designing-a-calm-web-reader/"},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Show HN: Artemis, a Calm Web Reader"},"story_url":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"https://artemis.jamesg.blog/"}},"_tags":["comment","author_exprez135","story_42471913"],"author":"exprez135","children":[42473603],"comment_text":"The tool actually is open source, so you could self-host it if you wish. MIT license, in Python. The repository [1] is linked in the blog post the author wrote about the project [2].
[1]: https://github.com/capjamesg/web-reader
[2]: https://jamesg.blog/2024/11/30/designing-a-calm-web-reader/","created_at":"2024-12-20T18:00:59Z","created_at_i":1734717659,"objectID":"42473244","parent_id":42472027,"story_id":42471913,"story_title":"Show HN: Artemis, a Calm Web Reader","story_url":"https://artemis.jamesg.blog/","updated_at":"2024-12-22T19:46:13Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"rakoo"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"For reference, and not implying it's better or worse than your work OP, I've pleasantly used Fraidycat (https://fraidyc.at/) in the past. It's a webextension, so completely local, and also incorporates the idea of having a "calmer" experience: no infinite list of links to check, different update rates, ...
I love your philosophy page, OP ! (https://jamesg.blog/2024/11/30/designing-a-calm-web-reader/)"},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Show HN: Artemis, a Calm Web Reader"},"story_url":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"https://artemis.jamesg.blog/"}},"_tags":["comment","author_rakoo","story_42471913"],"author":"rakoo","children":[42472863,42473119],"comment_text":"For reference, and not implying it's better or worse than your work OP, I've pleasantly used Fraidycat (https://fraidyc.at/) in the past. It's a webextension, so completely local, and also incorporates the idea of having a "calmer" experience: no infinite list of links to check, different update rates, ...
I love your philosophy page, OP ! (https://jamesg.blog/2024/11/30/designing-a-calm-web-reader/)","created_at":"2024-12-20T16:52:01Z","created_at_i":1734713521,"objectID":"42472647","parent_id":42471913,"story_id":42471913,"story_title":"Show HN: Artemis, a Calm Web Reader","story_url":"https://artemis.jamesg.blog/","updated_at":"2024-12-20T23:14:19Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"fabianholzer"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"Well, it is hard to change a company from the oral/meeting-driven style to an async writing-based culture and a fear even the best resource won't really help with that. But since you've asked also on an indiviual level, I found some nuggets on technical writing in https://jamesg.blog/2024/01/03/software-technical-writing/ - certainly way better than a SEOed listicle"},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Ask HN: Technical Writing Resources"}},"_tags":["comment","author_fabianholzer","story_41299817"],"author":"fabianholzer","comment_text":"Well, it is hard to change a company from the oral/meeting-driven style to an async writing-based culture and a fear even the best resource won't really help with that. But since you've asked also on an indiviual level, I found some nuggets on technical writing in https://jamesg.blog/2024/01/03/software-technical-writing/ - certainly way better than a SEOed listicle","created_at":"2024-08-21T09:04:11Z","created_at_i":1724231051,"objectID":"41308311","parent_id":41299817,"story_id":41299817,"story_title":"Ask HN: Technical Writing Resources","updated_at":"2024-09-20T17:35:31Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"tmtvl"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"Link seems broken? I assume you meant this: https://jamesg.blog/2024/06/18/designing-software/"},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Designing Software"},"story_url":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"https://jamesg.blog/404.html/"}},"_tags":["comment","author_tmtvl","story_40722088"],"author":"tmtvl","children":[40722723],"comment_text":"Link seems broken? I assume you meant this: https://jamesg.blog/2024/06/18/designing-software/","created_at":"2024-06-18T20:58:48Z","created_at_i":1718744328,"objectID":"40722150","parent_id":40722088,"story_id":40722088,"story_title":"Designing Software","story_url":"https://jamesg.blog/404.html/","updated_at":"2024-09-20T17:13:43Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"zerojames"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"Another day, another story on HN that will have me down a rabbit hole (yesterday's was a three-hour tangent into ternary bit compression after the Microsoft paper) :D
Your project is delightful -- thank you for sharing. I have explored this realm a bit before [0] [1], but in Python. The tool I made was for personal use, but streaming every keystroke through a network connection added a lot of unnecessary latency.
I used word surprisals (entropy) to calculate the most likely candidates, and gave a boost to words from my own writing (thus, the predictive engine was "fine-tuned" on my writing). The result is a dictionary of words with their probabilities of use. This can be applied to bigrams, too. Your project has me thinking: how could that be pruned, massively, to create the smallest possible structure. Your engine feels like the answer.
My use case is technical writing: you know what you want to say, including long words you have to repeat over again, but you want a quicker way of typing.
[0]: https://jamesg.blog/2023/12/15/auto-write/
[1]: https://github.com/capjamesg/autowrite"},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Show HN: Predictive text using only 13kb of JavaScript. no LLM"},"story_url":{"matchLevel":"none","matchedWords":[],"value":"https://www.adamgrant.info/tiny-predictive-text"}},"_tags":["comment","author_zerojames","story_39556956"],"author":"zerojames","comment_text":"Another day, another story on HN that will have me down a rabbit hole (yesterday's was a three-hour tangent into ternary bit compression after the Microsoft paper) :D
Your project is delightful -- thank you for sharing. I have explored this realm a bit before [0] [1], but in Python. The tool I made was for personal use, but streaming every keystroke through a network connection added a lot of unnecessary latency.
I used word surprisals (entropy) to calculate the most likely candidates, and gave a boost to words from my own writing (thus, the predictive engine was "fine-tuned" on my writing). The result is a dictionary of words with their probabilities of use. This can be applied to bigrams, too. Your project has me thinking: how could that be pruned, massively, to create the smallest possible structure. Your engine feels like the answer.
My use case is technical writing: you know what you want to say, including long words you have to repeat over again, but you want a quicker way of typing.
[0]: https://jamesg.blog/2023/12/15/auto-write/
[1]: https://github.com/capjamesg/autowrite","created_at":"2024-03-01T09:53:45Z","created_at_i":1709286825,"objectID":"39560264","parent_id":39556956,"story_id":39556956,"story_title":"Show HN: Predictive text using only 13kb of JavaScript. no LLM","story_url":"https://www.adamgrant.info/tiny-predictive-text","updated_at":"2024-09-20T16:31:06Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"Crestwave"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"> curl -sL -H "Accept: text/roff" https://jamesg.blog/2024/02/28/programming-projects/ > post.page && man ./post.page && rm post.page
What if I have a post.page in my current directory?
> curl -sL -H "Accept: text/roff" https://jamesg.blog/2024/02/28/programming-projects/ > /tmp/post.page && man /tmp/post.page
What if another user runs the command at the same time, then?
Or what if a malicious user creates a 666 mode /tmp/post.page file beforehand, detects when you finish writing to it, then attaches a payload right before `man` reads it?
Unfortunately, there is no perfect solution for this problem; I run arbitrary html, css, and javascript every day by browsing the web. It's debatable whether switching to command chains instead of piping results in overall benefits. Of course, the same goes for vice versa as well."},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Serving my blog posts as Linux manual pages"},"story_url":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"https://jamesg.blog/2024/02/29/linux-manual-pages/"}},"_tags":["comment","author_Crestwave","story_39548410"],"author":"Crestwave","children":[39564236],"comment_text":"> curl -sL -H "Accept: text/roff" https://jamesg.blog/2024/02/28/programming-projects/ > post.page && man ./post.page && rm post.page
What if I have a post.page in my current directory?
> curl -sL -H "Accept: text/roff" https://jamesg.blog/2024/02/28/programming-projects/ > /tmp/post.page && man /tmp/post.page
What if another user runs the command at the same time, then?
Or what if a malicious user creates a 666 mode /tmp/post.page file beforehand, detects when you finish writing to it, then attaches a payload right before `man` reads it?
Unfortunately, there is no perfect solution for this problem; I run arbitrary html, css, and javascript every day by browsing the web. It's debatable whether switching to command chains instead of piping results in overall benefits. Of course, the same goes for vice versa as well.","created_at":"2024-03-01T09:23:10Z","created_at_i":1709284990,"objectID":"39560112","parent_id":39557740,"story_id":39548410,"story_title":"Serving my blog posts as Linux manual pages","story_url":"https://jamesg.blog/2024/02/29/linux-manual-pages/","updated_at":"2024-09-20T16:31:06Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"godelski"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"1. Regardless, it is bad practice. It isn't a good idea to teach people to pipe downloaded content into any command. Regardless of how naive and safe the command seems. You may not know. Especially considering how you aren't guaranteed to run the full contents and may even run partial lines. Just don't get in the habit of streaming anything into a command. Because you'll be more tempted to stream into a different one which might have issues. Running two commands (or &&) just isn't a big deal. Low cost for high reward.
2. The person replying to me mentioned ffmpeg and well... see the reply to them. Parsers may not seem like a big deal, but see this about `cat`[0] or this about `less`[1] (a quick search shows a lot of pipe and pager type of vulnerabilities, including privilege escalation). Programs that look simple and a non-risk are probably actually prime targets for hackers because it can lull someone into a false sense of security.
3. You can detect bash piping server side. There's been a bunch of HN and reddit posts, several have been shared already so I won't repeat.
I'm sticking to:
Friends don't let friends pipe streams into commands\n curl -sL -H "Accept: text/roff" https://jamesg.blog/2024/02/28/programming-projects/ > post.page && man ./post.page && rm post.page\n curl -sL -H "Accept: text/roff" https://jamesg.blog/2024/02/28/programming-projects/ > /tmp/post.page && man /tmp/post.page\n[1] https://ubuntu.com/security/notices/USN-6664-1
Edit:
groff vulns: https://www.cvedetails.com/vulnerability-list/vendor_id-72/p..."},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Serving my blog posts as Linux manual pages"},"story_url":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"https://jamesg.blog/2024/02/29/linux-manual-pages/"}},"_tags":["comment","author_godelski","story_39548410"],"author":"godelski","children":[39559486,39560112],"comment_text":"1. Regardless, it is bad practice. It isn't a good idea to teach people to pipe downloaded content into any command. Regardless of how naive and safe the command seems. You may not know. Especially considering how you aren't guaranteed to run the full contents and may even run partial lines. Just don't get in the habit of streaming anything into a command. Because you'll be more tempted to stream into a different one which might have issues. Running two commands (or &&) just isn't a big deal. Low cost for high reward.
2. The person replying to me mentioned ffmpeg and well... see the reply to them. Parsers may not seem like a big deal, but see this about `cat`[0] or this about `less`[1] (a quick search shows a lot of pipe and pager type of vulnerabilities, including privilege escalation). Programs that look simple and a non-risk are probably actually prime targets for hackers because it can lull someone into a false sense of security.
3. You can detect bash piping server side. There's been a bunch of HN and reddit posts, several have been shared already so I won't repeat.
I'm sticking to:
Friends don't let friends pipe streams into commands\n curl -sL -H "Accept: text/roff" https://jamesg.blog/2024/02/28/programming-projects/ > post.page && man ./post.page && rm post.page\n curl -sL -H "Accept: text/roff" https://jamesg.blog/2024/02/28/programming-projects/ > /tmp/post.page && man /tmp/post.page\n[1] https://ubuntu.com/security/notices/USN-6664-1
Edit:
groff vulns: https://www.cvedetails.com/vulnerability-list/vendor_id-72/p...","created_at":"2024-03-01T02:11:03Z","created_at_i":1709259063,"objectID":"39557740","parent_id":39556658,"story_id":39548410,"story_title":"Serving my blog posts as Linux manual pages","story_url":"https://jamesg.blog/2024/02/29/linux-manual-pages/","updated_at":"2024-09-20T16:30:48Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"jasomill"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"
curl -sL -H "Accept: text/roff" https://jamesg.blog/2024/02/28/programming-projects/ | mandoc -a\n curl -sL -H "Accept: text/roff" https://jamesg.blog/2024/02/28/programming-projects/ | mandoc -a\ncurl -sL -H "Accept: text/roff" https://jamesg.blog/2024/02/28/programming-projects/ > post.page && man ./post.page
If curl's process is interupted, it'll generate a non-0 exit code and the man command won't be exectued. That's how double ampersands work in shell."},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Serving my blog posts as Linux manual pages"},"story_url":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"https://jamesg.blog/2024/02/29/linux-manual-pages/"}},"_tags":["comment","author__joel","story_39548410"],"author":"_joel","children":[39557785],"comment_text":"From the post
curl -sL -H "Accept: text/roff" https://jamesg.blog/2024/02/28/programming-projects/ > post.page && man ./post.page
If curl's process is interupted, it'll generate a non-0 exit code and the man command won't be exectued. That's how double ampersands work in shell.","created_at":"2024-02-29T23:23:30Z","created_at_i":1709249010,"objectID":"39556551","parent_id":39555529,"story_id":39548410,"story_title":"Serving my blog posts as Linux manual pages","story_url":"https://jamesg.blog/2024/02/29/linux-manual-pages/","updated_at":"2024-09-20T16:30:41Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"zerojames"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"This is now in progress.
https://github.com/capjamesg/jamesg.blog.deb has all you need to build a man-page-only deb file using:
git clone https://github.com/capjamesg/jamesg.blog.deb\ncd jamesg.blog.deb\ndpkg-deb --build --root-owner-group jamesg.blog\nsudo dpkg -i jamesg.blog.deb
You should see:
...\nProcessing triggers for man-db (2.9.1-1) ...
Which indicates the man page for `man jamesg.blog` is available. There is just a placeholder in there for now. I will perhaps finish this tomorrow!
NB: This may become a blog post soon :D"},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Serving my blog posts as Linux manual pages"},"story_url":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"https://jamesg.blog/2024/02/29/linux-manual-pages/"}},"_tags":["comment","author_zerojames","story_39548410"],"author":"zerojames","children":[39559341],"comment_text":"This is now in progress.
https://github.com/capjamesg/jamesg.blog.deb has all you need to build a man-page-only deb file using:
git clone https://github.com/capjamesg/jamesg.blog.deb\ncd jamesg.blog.deb\ndpkg-deb --build --root-owner-group jamesg.blog\nsudo dpkg -i jamesg.blog.deb
You should see:
...\nProcessing triggers for man-db (2.9.1-1) ...
Which indicates the man page for `man jamesg.blog` is available. There is just a placeholder in there for now. I will perhaps finish this tomorrow!
NB: This may become a blog post soon :D","created_at":"2024-02-29T21:30:18Z","created_at_i":1709242218,"objectID":"39555396","parent_id":39553082,"story_id":39548410,"story_title":"Serving my blog posts as Linux manual pages","story_url":"https://jamesg.blog/2024/02/29/linux-manual-pages/","updated_at":"2024-09-20T16:30:35Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"Gormo"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"There's no need to fork or use an intermediate file; you can just pipe straight into `man`:
`curl -sL -H "Accept: text/roff" https://jamesg.blog/2024/02/28/programming-projects/ | man -l -`"},"story_title":{"matchLevel":"none","matchedWords":[],"value":"Serving my blog posts as Linux manual pages"},"story_url":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"https://jamesg.blog/2024/02/29/linux-manual-pages/"}},"_tags":["comment","author_Gormo","story_39548410"],"author":"Gormo","children":[39554195,39556047],"comment_text":"There's no need to fork or use an intermediate file; you can just pipe straight into `man`:
`curl -sL -H "Accept: text/roff" https://jamesg.blog/2024/02/28/programming-projects/ | man -l -`","created_at":"2024-02-29T19:47:50Z","created_at_i":1709236070,"objectID":"39554085","parent_id":39548410,"story_id":39548410,"story_title":"Serving my blog posts as Linux manual pages","story_url":"https://jamesg.blog/2024/02/29/linux-manual-pages/","updated_at":"2024-09-20T16:30:29Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"salviati"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["jamesg",".","blog"],"value":"You can save a few chars with a process sostitution instead of a pipe if you're using bash:
man -l <(curl -sL -H "Accept: text/roff" https://jamesg.blog/2024/02/28/programming-projects/) man -l <(curl -sL -H "Accept: text/roff" https://jamesg.blog/2024/02/28/programming-projects/)