With crul you can crawl and transform web pages into csv tables, explore and dynamically query APIs, filter and organize data, and push data sets to third party data lakes and analytics tools. Here\u2019s a demo video, we\u2019ve been told Nic sounds like John Mayer (lol) (https://www.crul.com/demo-video)
We\u2019ve personally struggled wrangling data from the web using puppeteer/playwright/selenium, jq or cobbling together python scripts, client libraries, and schedulers to consume APIs. The reality is that shit is hard, doesn\u2019t scale (classic blocking for-loop or async saturation), and comes with thorny maintenance/security issues. The tools we love to hate.
Crul\u2019s value prop is simple: Query any Webpage or API for free.
At its core, crul is based on the foundational linked nature of Web/API content. It consists of a purpose built map/expand/reduce engine for hierarchical Web/API content (kind of like postman but with a membership to Gold's Gym) with a familiar parser expression grammar that naturally gets the job done (and layered caching to make it quick to fix when it doesn\u2019t on the first try). There\u2019s a boatload of other features like domain policies, scheduler, checkpoints, templates, REST API, Web UI, vault, OAuth for third parties and 20+ stores to send your data to.
Our goal is to open source crul as time and resources permit. At the end of the day it\u2019s just the two of us trying to figure things out as we go! We\u2019re just getting started.
Crul is one bad mother#^@%*& and the web is finally yours!
Download crul for free as a Mac OS desktop application or as a Docker image (https://www.crul.com) and let us know if you love it or hate it. (https://forms.gle/5BXb5bLC1D5QG7i99) And come say hello to us on our slack channel - we\u2019re a friendly bunch! (https://crulinc.slack.com/)
Nic and Carl (https://www.crul.com/early-days)"},"title":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["crul","show","hn"],"value":"Show HN: Crul \u2013 Query Any Webpage or API"},"url":{"fullyHighlighted":false,"matchLevel":"partial","matchedWords":["crul"],"value":"https://www.crul.com/"}},"_tags":["story","author_portInit","story_34970917","show_hn"],"author":"portInit","children":[34970922,34971106,34972765,34972781,34973272,34973741,34974612,34974690,34974860,34975742,34975858,34976006,34977090,34977290,34977350,34978259,34978263,34979088,34979124,34979895,34980217,34986709,34990569],"created_at":"2023-02-28T16:12:58Z","created_at_i":1677600778,"num_comments":79,"objectID":"34970917","points":241,"story_id":34970917,"story_text":"Hi HN, we\u2019re Carl and Nic, the creators of crul (https://www.crul.com), and we\u2019ve been hard at work for the last year and a half building our dream of turning the web into a dataset. In a nutshell crul is a tool for querying and building web and api data feeds from anywhere to anywhere.
With crul you can crawl and transform web pages into csv tables, explore and dynamically query APIs, filter and organize data, and push data sets to third party data lakes and analytics tools. Here\u2019s a demo video, we\u2019ve been told Nic sounds like John Mayer (lol) (https://www.crul.com/demo-video)
We\u2019ve personally struggled wrangling data from the web using puppeteer/playwright/selenium, jq or cobbling together python scripts, client libraries, and schedulers to consume APIs. The reality is that shit is hard, doesn\u2019t scale (classic blocking for-loop or async saturation), and comes with thorny maintenance/security issues. The tools we love to hate.
Crul\u2019s value prop is simple: Query any Webpage or API for free.
At its core, crul is based on the foundational linked nature of Web/API content. It consists of a purpose built map/expand/reduce engine for hierarchical Web/API content (kind of like postman but with a membership to Gold's Gym) with a familiar parser expression grammar that naturally gets the job done (and layered caching to make it quick to fix when it doesn\u2019t on the first try). There\u2019s a boatload of other features like domain policies, scheduler, checkpoints, templates, REST API, Web UI, vault, OAuth for third parties and 20+ stores to send your data to.
Our goal is to open source crul as time and resources permit. At the end of the day it\u2019s just the two of us trying to figure things out as we go! We\u2019re just getting started.
Crul is one bad mother#^@%*& and the web is finally yours!
Download crul for free as a Mac OS desktop application or as a Docker image (https://www.crul.com) and let us know if you love it or hate it. (https://forms.gle/5BXb5bLC1D5QG7i99) And come say hello to us on our slack channel - we\u2019re a friendly bunch! (https://crulinc.slack.com/)
Nic and Carl (https://www.crul.com/early-days)","title":"Show HN: Crul \u2013 Query Any Webpage or API","updated_at":"2024-09-20T13:29:29Z","url":"https://www.crul.com/"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"jamesbhe"},"title":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["crul","show","hn"],"value":"Show HN: cRUL-like network tool to test server timeouts with ease"},"url":{"matchLevel":"none","matchedWords":[],"value":"http://getmintbox.com/"}},"_tags":["story","author_jamesbhe","story_22784198","show_hn"],"author":"jamesbhe","created_at":"2020-04-05T06:55:23Z","created_at_i":1586069723,"num_comments":0,"objectID":"22784198","points":4,"story_id":22784198,"title":"Show HN: cRUL-like network tool to test server timeouts with ease","updated_at":"2024-09-20T05:57:14Z","url":"http://getmintbox.com/"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"docyes"},"story_text":{"matchLevel":"none","matchedWords":[],"value":"Semantically search Hacker News comments, assign a sentiment score to each comment and calculate the sentiment frequency distribution."},"title":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["crul","show","hn"],"value":"Show HN: Web/API retrieval for LLM's using Crul"},"url":{"matchLevel":"none","matchedWords":[],"value":"https://www.loom.com/share/51c60672021c407c90aeb8aed1dd9ade"}},"_tags":["story","author_docyes","story_40462930","show_hn"],"author":"docyes","created_at":"2024-05-24T04:58:14Z","created_at_i":1716526694,"num_comments":0,"objectID":"40462930","points":2,"story_id":40462930,"story_text":"Semantically search Hacker News comments, assign a sentiment score to each comment and calculate the sentiment frequency distribution.","title":"Show HN: Web/API retrieval for LLM's using Crul","updated_at":"2024-09-20T17:06:01Z","url":"https://www.loom.com/share/51c60672021c407c90aeb8aed1dd9ade"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"mdaniel"},"comment_text":{"fullyHighlighted":false,"matchLevel":"full","matchedWords":["crul","show","hn"],"value":"I'm sorry to hear that your searches for that very specific name didn't provide the information you were looking for
its show hn: https://news.ycombinator.com/item?id=34970917
tfl: https://www.crul.com/"},"story_title":{"fullyHighlighted":false,"matchLevel":"partial","matchedWords":["show","hn"],"value":"Show HN: Flyscrape \u2013 A standalone and scriptable web scraper in Go"},"story_url":{"matchLevel":"none","matchedWords":[],"value":"https://github.com/philippta/flyscrape"}},"_tags":["comment","author_mdaniel","story_38230476"],"author":"mdaniel","comment_text":"I'm sorry to hear that your searches for that very specific name didn't provide the information you were looking for
its show hn: https://news.ycombinator.com/item?id=34970917
tfl: https://www.crul.com/","created_at":"2023-11-11T19:40:50Z","created_at_i":1699731650,"objectID":"38233755","parent_id":38232425,"story_id":38230476,"story_title":"Show HN: Flyscrape \u2013 A standalone and scriptable web scraper in Go","story_url":"https://github.com/philippta/flyscrape","updated_at":"2024-09-20T15:36:26Z"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"bhalp1"},"story_text":{"matchLevel":"none","matchedWords":[],"value":""},"title":{"fullyHighlighted":false,"matchLevel":"partial","matchedWords":["show","hn"],"value":"Show HN: Same Picture of Dave Coulier Chrome Extension for pranking"},"url":{"fullyHighlighted":false,"matchLevel":"partial","matchedWords":["crul"],"value":"https://chrome.google.com/webstore/detail/same-picture-of-dave-coul/cgeabdckhppkgainjcafbhljmemhaaek"}},"_tags":["story","author_bhalp1","story_7543213","show_hn"],"author":"bhalp1","created_at":"2014-04-06T21:53:37Z","created_at_i":1396821217,"num_comments":0,"objectID":"7543213","points":2,"story_id":7543213,"story_text":"","title":"Show HN: Same Picture of Dave Coulier Chrome Extension for pranking","updated_at":"2023-09-06T22:37:09Z","url":"https://chrome.google.com/webstore/detail/same-picture-of-dave-coul/cgeabdckhppkgainjcafbhljmemhaaek"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"pouya1dev"},"story_text":{"fullyHighlighted":false,"matchLevel":"partial","matchedWords":["crul"],"value":"Hi everyone. Today I\u2019m here to introduce "Ever". a language aiming to be something like a modern-day Turbo C. It features high-level syntax but operates at a low level, designed to run on modern systems.
By the way, don't download the release. That release is from three months ago\u2014back when I created the previous thread\u2014and work on the new version isn't finished yet, so I haven't released it. I started this thread to get your opinions and feedback on the new version.
I can no longer say that the entire language is written in D, because I\u2019ve written the libraries and the Windows interpreter in various languages. However, I can still say that the core of the project is largely written in D.
Ever is made possible thanks to the D community. arsd.simpledisplay and arsd.minigui provides high-level graphics functions, making it easy to create graphical applications. I'm also working on integrating Raylib with Ever to make game development possible.
And to test and build the language, simply run the following command.\ncurl -sL https://raw.githubusercontent.com/evrlang/ever/main/install.... | bash
Or clone the repo and run compile.sh.
I sincerely apologize that the documentation isn't finished yet and I haven't had time to add more examples. However, if you have any questions, feel free to reach out to me here so I can help you.
Github link: https://github.com/evrlang/ever\nWebsite: https://evrlang.github.io/ever\nA very special thank you to everyone who gave me technical advice on the previous thread and prompted me to reconsider the language syntax."},"title":{"fullyHighlighted":false,"matchLevel":"partial","matchedWords":["show","hn"],"value":"Show HN: Ever \u2013 A High-Level Language for Low-Level Purposes"},"url":{"matchLevel":"none","matchedWords":[],"value":"https://github.com/evrlang/ever"}},"_tags":["story","author_pouya1dev","story_50063003","show_hn"],"author":"pouya1dev","created_at":"2026-10-12T21:00:28Z","created_at_i":1791838828,"num_comments":0,"objectID":"50063003","points":1,"story_id":50063003,"story_text":"Hi everyone. Today I\u2019m here to introduce "Ever". a language aiming to be something like a modern-day Turbo C. It features high-level syntax but operates at a low level, designed to run on modern systems.
By the way, don't download the release. That release is from three months ago\u2014back when I created the previous thread\u2014and work on the new version isn't finished yet, so I haven't released it. I started this thread to get your opinions and feedback on the new version.
I can no longer say that the entire language is written in D, because I\u2019ve written the libraries and the Windows interpreter in various languages. However, I can still say that the core of the project is largely written in D.
Ever is made possible thanks to the D community. arsd.simpledisplay and arsd.minigui provides high-level graphics functions, making it easy to create graphical applications. I'm also working on integrating Raylib with Ever to make game development possible.
And to test and build the language, simply run the following command.\ncurl -sL https://raw.githubusercontent.com/evrlang/ever/main/install.... | bash
Or clone the repo and run compile.sh.
I sincerely apologize that the documentation isn't finished yet and I haven't had time to add more examples. However, if you have any questions, feel free to reach out to me here so I can help you.
Github link: https://github.com/evrlang/ever\nWebsite: https://evrlang.github.io/ever\nA very special thank you to everyone who gave me technical advice on the previous thread and prompted me to reconsider the language syntax.","title":"Show HN: Ever \u2013 A High-Level Language for Low-Level Purposes","updated_at":"2026-10-12T21:05:39Z","url":"https://github.com/evrlang/ever"},{"_highlightResult":{"author":{"matchLevel":"none","matchedWords":[],"value":"jakemanger"},"story_text":{"fullyHighlighted":false,"matchLevel":"partial","matchedWords":["crul"],"value":"Hi everyone, I made whatmodel. It's a simple site that can be visited in the browser or used from the terminal via a:
curl whatmodel.sh
To use it,
1. Enter your RAM and GPU
2. See what models you can run locally with its rank and the command to run it
3. Compare them with API models on the same score
Building it made me realise a 32GB Mac can now run a model that scores on par with GPT-5, completely locally and for free (e.g. Qwen 3.8 27B at 4-bit).
Each model gets one score fitted across 18,731 published benchmark results, and every result links to its source.
The method is at https://whatmodel.sh/method and the data, scoring code and bench script are open source: https://github.com/jakemanger/whatmodel
If you'd like to contribute, there's a bench script to collect real-world tok/s and you can also submit any new models and benchmark scores along with their source on github."},"title":{"fullyHighlighted":false,"matchLevel":"partial","matchedWords":["show","hn"],"value":"Show HN: An open source AI leaderboard of the best models your machine can run"},"url":{"matchLevel":"none","matchedWords":[],"value":"https://whatmodel.sh"}},"_tags":["story","author_jakemanger","story_50053608","show_hn"],"author":"jakemanger","created_at":"2026-10-12T09:18:42Z","created_at_i":1791796722,"num_comments":0,"objectID":"50053608","points":1,"story_id":50053608,"story_text":"Hi everyone, I made whatmodel. It's a simple site that can be visited in the browser or used from the terminal via a:
curl whatmodel.sh
To use it,
1. Enter your RAM and GPU
2. See what models you can run locally with its rank and the command to run it
3. Compare them with API models on the same score
Building it made me realise a 32GB Mac can now run a model that scores on par with GPT-5, completely locally and for free (e.g. Qwen 3.8 27B at 4-bit).
Each model gets one score fitted across 18,731 published benchmark results, and every result links to its source.
The method is at https://whatmodel.sh/method and the data, scoring code and bench script are open source: https://github.com/jakemanger/whatmodel
If you'd like to contribute, there's a bench script to collect real-world tok/s and you can also submit any new models and benchmark scores along with their source on github.","title":"Show HN: An open source AI leaderboard of the best models your machine can run","updated_at":"2026-10-12T10:35:07Z","url":"https://whatmodel.sh"}],"hitsPerPage":20,"nbHits":7,"nbPages":1,"page":0,"params":"query=crul+show+hn&advancedSyntax=true&analyticsTags=backend","processingTimeMS":13,"processingTimingsMS":{"_request":{"queue":5,"roundTrip":21},"afterFetch":{"format":{"highlighting":1,"total":1},"merge":{"mergeLoop":{"prepareNextHit":1,"total":1},"total":1},"total":1},"fetch":{"query":7,"scanning":2,"total":10},"total":13},"query":"crul show hn","serverTimeMS":20}