Think about your coding harness: the model reads a bunch of files into the context, and it generally doesn\u2019t forget/hallucinate which lines came from which file.","title":null,"type":"comment","url":null},{"author":"chollida1","children":[],"created_at":"2026-08-02T12:44:41.000Z","created_at_i":1785674681,"id":49144059,"options":[],"parent_id":49143918,"points":null,"story_id":49143630,"text":"> It is architecturally impossible for an LLM to associate a link or citation that it crawled with a response that comes out the other end.
I mean, its not. Lots of LLM's focused on finance do this already.
Bloomberg's own ASKB produces results and provides links back to the source documents or urls that it references so people who care about correctness can verify the results.","title":null,"type":"comment","url":null},{"author":"jefftk","children":[{"author":"knollimar","children":[],"created_at":"2026-08-02T13:13:44.000Z","created_at_i":1785676424,"id":49144383,"options":[],"parent_id":49144071,"points":null,"story_id":49143630,"text":"I don't understand why verifying isn't in the loop. If you gave an LLM: "is this statement consistent with this RAG data?" it would do well.
It feels lazy that this isn't built into the harness in some adversarial citation review checkbox.
Also the questions LLMs ask are so inhuman. It's like it's some contrarian trying to win an argument over getting an answer.","title":null,"type":"comment","url":null}],"created_at":"2026-08-02T12:46:04.000Z","created_at_i":1785674764,"id":49144071,"options":[],"parent_id":49143918,"points":null,"story_id":49143630,"text":"You can do it the same way human does: recall a fact from memory, and then search to identify a citation. The citation isn't "here's why I think this" but instead "here's where you can verify this".","title":null,"type":"comment","url":null},{"author":"amelius","children":[{"author":"brookst","children":[{"author":"amelius","children":[],"created_at":"2026-08-02T13:20:08.000Z","created_at_i":1785676808,"id":49144444,"options":[],"parent_id":49144330,"points":null,"story_id":49143630,"text":"Yes. Whatever makes their lawyers nervous.","title":null,"type":"comment","url":null}],"created_at":"2026-08-02T13:09:32.000Z","created_at_i":1785676172,"id":49144330,"options":[],"parent_id":49144095,"points":null,"story_id":49143630,"text":"So an HTML page with a list of essentially every page on every site on the internet? What do you think, maybe a trillion URLs?","title":null,"type":"comment","url":null}],"created_at":"2026-08-02T12:47:52.000Z","created_at_i":1785674872,"id":49144095,"options":[],"parent_id":49143918,"points":null,"story_id":49143630,"text":"Then the least they can do is cite ALL their sources. At least somewhere on their website.","title":null,"type":"comment","url":null},{"author":"WarmWash","children":[],"created_at":"2026-08-02T12:49:26.000Z","created_at_i":1785674966,"id":49144114,"options":[],"parent_id":49143918,"points":null,"story_id":49143630,"text":"This is why it's dumb when inferencing with a model to ask "...and cite all sources". Total waste of time and likely to make the response worse.
BUT
On models with web search, they can scan the sources in context, and those are pretty good at correct citations. However it's still a "trust, but verify" situation.","title":null,"type":"comment","url":null},{"author":"ordersofmag","children":[],"created_at":"2026-08-02T13:00:03.000Z","created_at_i":1785675603,"id":49144218,"options":[],"parent_id":49143918,"points":null,"story_id":49143630,"text":"99% of AI users these days aren't using a 'raw' LLM. They are interacting with a harness that includes tools to do search of the live (or recently crawled) web. And so the output users actually see could absolutely include correct citation of sources. So the 'architecturally impossible' bit may be technically correct but it is not practically relevant. Now whether those harnesses do a good job of orchestrating LLM output to get accurate citations (and whether they are transparent about their process) is another thing entirely. But if you're contemplating 'what LLM's can do' and aren't taking into account the harness and tooling ecosystem they are embedded in then you're missing the point.","title":null,"type":"comment","url":null},{"author":"ssl-3","children":[],"created_at":"2026-08-02T13:02:05.000Z","created_at_i":1785675725,"id":49144242,"options":[],"parent_id":49143918,"points":null,"story_id":49143630,"text":"> It is perfectly common to find that a "source" does not contain the statements.
It is commonly this way right now, but it doesn't have to stay this way forever.
It is also common, in my usage at least, to iteratively brow-beat the bot into paring its statements down to those that which are supportable by its sources. Doing so just takes repetition, and that repetition takes time and burns more tokens.
With the present state of things, the prompts to get moving on this and to guide the ultimate response into something that is verifiably supportable by outside sources can usually be simple and largely generic.
They're easy enough prompts that a subagent can produce them.
(I've done it myself with Codex subagents and it worked very well, aside from the unsustainable burn rate that did not fit my budget.)","title":null,"type":"comment","url":null},{"author":"razodactyl","children":[],"created_at":"2026-08-02T13:15:55.000Z","created_at_i":1785676555,"id":49144401,"options":[],"parent_id":49143918,"points":null,"story_id":49143630,"text":"Are you sure? Because this sounds like GPT3-era understandings of LLM-isms","title":null,"type":"comment","url":null}],"created_at":"2026-08-02T12:30:34.000Z","created_at_i":1785673834,"id":49143918,"options":[],"parent_id":49143630,"points":null,"story_id":49143630,"text":"It is architecturally impossible for an LLM to associate a link or citation that it crawled with a response that comes out the other end. Every link they're giving you to support their statements is tacked on because it may vaguely match the tokens it just generated. It is perfectly common to find that a "source" does not contain the statements. You cannot expect an LLM to write you a Wikipedia article, much less a legal or medical opinion supported by research.","title":null,"type":"comment","url":null},{"author":"eterm","children":[{"author":"SpikeyCoder","children":[],"created_at":"2026-08-02T12:41:12.000Z","created_at_i":1785674472,"id":49144017,"options":[],"parent_id":49143953,"points":null,"story_id":49143630,"text":"I get that pushback. My goal with this index/report wasn't to write a new 'AI SEO' playbook or encourage people to start gaming the system. The goal was simply to shine a bit of light on what's going on. Right now, there is a massive information asymmetry: AI companies are turning their assistants into primary search engines, but webmasters have zero visibility into whether their sites are actually being cited in those live answers.
You're absolutely right to be concerned about an arms race. If the data showed that doing X, Y, and Z guaranteed a citation, we'd be right back to the worst days of keyword stuffing.
But what this data actually shows is the opposite: even if you do everything 'right' (allow the retrieval bots, provide perfect machine-readable schema, don't block anything), you still have a 94.8% chance of never being cited. How LLMs cite is entirely opaque.
I built this to give site owners a baseline measurement of what is actually happening to their content today (as a free, anonymous view), so they can make an informed decision on whether keeping their doors open to these crawlers is actually worth it.","title":null,"type":"comment","url":null},{"author":"passwordoops","children":[],"created_at":"2026-08-02T12:57:50.000Z","created_at_i":1785675470,"id":49144188,"options":[],"parent_id":49143953,"points":null,"story_id":49143630,"text":"LLM's were obviously going be ruined by two factors:
1- LLM Crawler Optimization: the new SEO
2- Weightings-For-Pay: for a fee have your product or service come up more frequently in associated answers","title":null,"type":"comment","url":null},{"author":"PunchyHamster","children":[],"created_at":"2026-08-02T13:23:21.000Z","created_at_i":1785677001,"id":49144467,"options":[],"parent_id":49143953,"points":null,"story_id":49143630,"text":"> Are we saying that it's now a problem that we're not getting scraped?
No, it is saying that even the ones that are being scraped are not being included in results","title":null,"type":"comment","url":null}],"created_at":"2026-08-02T12:34:17.000Z","created_at_i":1785674057,"id":49143953,"options":[],"parent_id":49143630,"points":null,"story_id":49143630,"text":"Are we saying that it's now a problem that we're not getting scraped?
This appears to be a new generation of "SEO", marking itself as a service for getting into AI results?
This is not the future I want to be a part of.
Perhaps it's inevitable that after a break from everything being driven by money that LLMs will now be ruined by people spending $X to get into AI to make back $X+1, leading to an arms race of ever increasing X, to the detriment of users.","title":null,"type":"comment","url":null},{"author":"josh-wrale","children":[],"created_at":"2026-08-02T12:43:09.000Z","created_at_i":1785674589,"id":49144048,"options":[],"parent_id":49143630,"points":null,"story_id":49143630,"text":"Makes me wonder if paid Medium and paid news are input to AI training. Surely, they are.","title":null,"type":"comment","url":null},{"author":"pfdietz","children":[],"created_at":"2026-08-02T12:48:16.000Z","created_at_i":1785674896,"id":49144100,"options":[],"parent_id":49143630,"points":null,"story_id":49143630,"text":"> 94.8%
This seems consistent with Sturgeon's Law.","title":null,"type":"comment","url":null},{"author":"mohamedkoubaa","children":[],"created_at":"2026-08-02T12:48:42.000Z","created_at_i":1785674922,"id":49144104,"options":[],"parent_id":49143630,"points":null,"story_id":49143630,"text":"We don't have a page rank mechanism. Most likely people are paying or threatening AI companies to boost certain sources as authoritative","title":null,"type":"comment","url":null},{"author":"lorreyfum","children":[],"created_at":"2026-08-02T12:53:19.000Z","created_at_i":1785675199,"id":49144148,"options":[],"parent_id":49143630,"points":null,"story_id":49143630,"text":"Call it web 4.0","title":null,"type":"comment","url":null},{"author":"brookst","children":[{"author":"DrDeese","children":[],"created_at":"2026-08-02T12:56:44.000Z","created_at_i":1785675404,"id":49144176,"options":[],"parent_id":49144165,"points":null,"story_id":49143630,"text":"I wouldn't even consider it a complaint. For a builder, I would consider it an opportunity...","title":null,"type":"comment","url":null},{"author":"kyleblarson","children":[{"author":"embedding-shape","children":[],"created_at":"2026-08-02T13:09:27.000Z","created_at_i":1785676167,"id":49144327,"options":[],"parent_id":49144238,"points":null,"story_id":49143630,"text":"That's a "problem" of the harness that you use those, not a question of the model. The model can "know" things like "Linus Torvalds created Linux" but things like "Is X available in Y right now?" it obviously cannot, leading to this being a completely different thing compared to "just knowing" something and providing references to "how it knows".","title":null,"type":"comment","url":null}],"created_at":"2026-08-02T13:01:28.000Z","created_at_i":1785675688,"id":49144238,"options":[],"parent_id":49144165,"points":null,"story_id":49143630,"text":"The question is very important. What if you ask/tell an AI "I need a 2 bedroom vacation rental in Park City for a trip this fall". If you only get Airbnb results you are missing a lot of the true answer.","title":null,"type":"comment","url":null},{"author":"SpikeyCoder","children":[{"author":"johndhi","children":[{"author":"SpikeyCoder","children":[],"created_at":"2026-08-02T13:12:14.000Z","created_at_i":1785676334,"id":49144368,"options":[],"parent_id":49144290,"points":null,"story_id":49143630,"text":"Small businesses don't. You're right. But somehow those larger companies seem to get cited. Wouldn't it be nice if we all knew how we were being influenced, both potential consumer and small business owner? Let's have the lid off!","title":null,"type":"comment","url":null}],"created_at":"2026-08-02T13:06:33.000Z","created_at_i":1785675993,"id":49144290,"options":[],"parent_id":49144247,"points":null,"story_id":49143630,"text":"Makes sense! Good point.
You're effectively reminding us that brands don't get understand well how to influence ai seo","title":null,"type":"comment","url":null},{"author":"spiderfarmer","children":[],"created_at":"2026-08-02T13:07:05.000Z","created_at_i":1785676025,"id":49144299,"options":[],"parent_id":49144247,"points":null,"story_id":49143630,"text":"That\u2019s why I, from now on, only allow citable information to be scraped. The return of cloaking, lol.","title":null,"type":"comment","url":null},{"author":"altmanaltman","children":[{"author":"martinald","children":[],"created_at":"2026-08-02T13:25:26.000Z","created_at_i":1785677126,"id":49144489,"options":[],"parent_id":49144384,"points":null,"story_id":49143630,"text":"It depends. If you are doing blog content with the idea of upselling users to your product, probably not as much (because the LLM can just give the user the answer).
However, if you are looking for the best product/service/whatever, then yes it really does matter. I've bought _so_ many products because of LLM recommendations. For example, I wanted a new webcam, I asked the LLM to find me the best ones with a large sensor and Linux compatibility. It gave me a shortlist then I chose one and then I bought it.
This experience is far better than trailing through dozens of pages of (even pre LLM) SEO slop.I just tried the same on Google search and all the links recommended a camera with ~10% the sensor size that I bought.","title":null,"type":"comment","url":null}],"created_at":"2026-08-02T13:13:47.000Z","created_at_i":1785676427,"id":49144384,"options":[],"parent_id":49144247,"points":null,"story_id":49143630,"text":"Not really, ahrefs has already started working on this and there are several tools out there that track GEO.
Also what is the incentive for me to rank on LLMs? People do not use it to click sources or even take action. Do you have any proof that being ranked as the best roofer in houston drives sales more than not being ranked as it? If not, why should i care as the roofer?","title":null,"type":"comment","url":null},{"author":"martinald","children":[],"created_at":"2026-08-02T13:19:33.000Z","created_at_i":1785676773,"id":49144438,"options":[],"parent_id":49144247,"points":null,"story_id":49143630,"text":"That's not _entirely_ true. Search Console now has a Generative AI page where you can see impressions per page now. Bing has something similar.
Also, I would assume that really "GEO" is just like "SEO". If you rank on the '1st page' of results for whatever common searches, you are _very_ likely to rank the same way for LLM questions, because all the LLM is doing (nearly all of the time for 'best roofers in Houston') is doing a web search and summarising the first x results. So if you are on page 1 for that term, it's very likely IME that you will get mentioned on LLM answers for that.","title":null,"type":"comment","url":null},{"author":"phoghed","children":[{"author":"philipallstar","children":[{"author":"orbital-decay","children":[],"created_at":"2026-08-02T13:41:51.000Z","created_at_i":1785678111,"id":49144632,"options":[],"parent_id":49144545,"points":null,"story_id":49143630,"text":"The model does it in this case, not "we". Classic SEO does influence it because it relies on traditional search, but then it estimates the best according to whatever cognitive capabilities it has, to its understanding of user's request, to what its harness tells it to do, and to its character engineered during post-training (and models' biases are very carefully engineered).
I would expect a judgement of a modern model to be superficial for this request, but still better than nothing. A deep research agent might be a lot better and much less susceptible to "optimization".","title":null,"type":"comment","url":null}],"created_at":"2026-08-02T13:32:15.000Z","created_at_i":1785677535,"id":49144545,"options":[],"parent_id":49144451,"points":null,"story_id":49143630,"text":"How are we defining the best roofers?","title":null,"type":"comment","url":null}],"created_at":"2026-08-02T13:21:09.000Z","created_at_i":1785676869,"id":49144451,"options":[],"parent_id":49144247,"points":null,"story_id":49143630,"text":"Good, let\u2019s hope there\u2019s no SEO arms race for this too. Maybe the best roofers have a chance of getting cited over the ones with the best SEO agency. Seems unlikely though.","title":null,"type":"comment","url":null},{"author":"orbital-decay","children":[],"created_at":"2026-08-02T13:25:01.000Z","created_at_i":1785677101,"id":49144480,"options":[],"parent_id":49144247,"points":null,"story_id":49143630,"text":">But if I ask an LLM 'who are the best commercial roofers in Houston?', there isn't one right answer. When an LLM answers that roofing question, it typically cites 3 to 5 businesses. The other 40 legitimate roofing companies in the area are left out.
I don't see how mentioning the other 40 should follow from that fact. You get exactly what you're asking for - the best, according to agent's judgement. Judgement and processing of simple search results is exactly what you're using the intelligent agent for. Ask for a list of all commercial roofers in Houston and then you can expect a list.
It can be argued that models are clustering their replies around a few options when asked to choose from a list of equally valid ones (due to mode collapse, distribution biases, primacy/recency biases etc), but these options are not equally valid for the agent, it looks at their sites or possibly in some other places like review sites to rank them. Its ranking criteria might be not good at all, but that's another question.","title":null,"type":"comment","url":null}],"created_at":"2026-08-02T13:02:22.000Z","created_at_i":1785675742,"id":49144247,"options":[],"parent_id":49144165,"points":null,"story_id":49143630,"text":"If the goal of the web was just to transmit objective facts like 'who created Linux', this wouldn't be a problem at all. Wikipedia handles that pretty dece.
The issue arises when we move away from objective trivia and into subjective, localized buying intent, which is where the web monetizes itself.
If I ask an LLM 'who created Linux?', there is one right answer. But if I ask an LLM 'who are the best commercial roofers in Houston?', there isn't one right answer. There are dozens of highly qualified local businesses that do possess unique value, unique pricing, and unique availability.
When an LLM answers that roofing question, it typically cites 3 to 5 businesses. The other 40 legitimate roofing companies in the area are left out. My study isn't arguing that every single one of those 40 companies deserves to be in the answer; it's pointing out that those 40 companies currently have no idea they are being left out.
In the Google era, if you weren't on page 1, you could look at Search Console, see your ranking, check your backlinks, and understand why. In the AI Search era, businesses are being scraped to build these answers, but they have zero telemetry on whether they are actually making the cut. This index is just an attempt to provide that missing telemetry.","title":null,"type":"comment","url":null},{"author":"tiffanyh","children":[],"created_at":"2026-08-02T13:03:57.000Z","created_at_i":1785675837,"id":49144266,"options":[],"parent_id":49144165,"points":null,"story_id":49143630,"text":"I just asked ChatGPT-5.6 that question, no source was given.
Not even Wikipedia.","title":null,"type":"comment","url":null},{"author":"altmanaltman","children":[{"author":"SpikeyCoder","children":[],"created_at":"2026-08-02T13:16:22.000Z","created_at_i":1785676582,"id":49144408,"options":[],"parent_id":49144351,"points":null,"story_id":49143630,"text":"I disclosed on my first comment how I got my data. I thought it was an interesting find, and one that really hinders the non-technical small business owner from figuring out how to ensure their company finds their way to the right customer.","title":null,"type":"comment","url":null}],"created_at":"2026-08-02T13:11:19.000Z","created_at_i":1785676279,"id":49144351,"options":[],"parent_id":49144165,"points":null,"story_id":49143630,"text":"Its a marketing post for a tool that offers visibility to site owners. Honestly these type of "neutral data reports" masquerades should be flagged or adequately disclosed.","title":null,"type":"comment","url":null},{"author":"llm_nerd","children":[],"created_at":"2026-08-02T13:15:38.000Z","created_at_i":1785676538,"id":49144399,"options":[],"parent_id":49144165,"points":null,"story_id":49143630,"text":"It isn't a complaint. It's an ad. This is literally an ad for some sort of "get cited by AI" service.","title":null,"type":"comment","url":null},{"author":"netcan","children":[],"created_at":"2026-08-02T13:23:17.000Z","created_at_i":1785676997,"id":49144466,"options":[],"parent_id":49144165,"points":null,"story_id":49143630,"text":"This is not a complaint.
I think your assessment of this result being as expected... but this is about the LLM equivalent of SEO becoming an area of interest","title":null,"type":"comment","url":null}],"created_at":"2026-08-02T12:55:23.000Z","created_at_i":1785675323,"id":49144165,"options":[],"parent_id":49143630,"points":null,"story_id":49143630,"text":"This is a weird complaint.
Let\u2019s say I ask \u201cwho created Linux?\u201d Claude correctly tells me Linus Torvalds, and links to Wikipedia.
There are probably thousands, maybe hundreds of thousands of other sites that have that some piece of information. Are LLMs supposed to link to every site?
Most sites do not have unique information at all, and even sites that do rarely contain only unique information. Implying that most sites deserve links because they were crawled seems like a statistical fallacy. You could say the same thing about the percent of sites crawled by Google versus ever showing up on first page of results.","title":null,"type":"comment","url":null},{"author":"sparkling","children":[],"created_at":"2026-08-02T12:59:03.000Z","created_at_i":1785675543,"id":49144206,"options":[],"parent_id":49143630,"points":null,"story_id":49143630,"text":"Blocking known bot identifiers via robots.txt does nothing by the way. Too many labs are running sneaky crawlers that do not respect robots.txt. You will need to take extreme measures: blocking basically all datacenter IP ranges, VPN IPs, aggressive rate limiting, etc.
Blocking LLM crawlers has become the number one use case for our IP database customers at https://focsec.com/","title":null,"type":"comment","url":null},{"author":"ermantrout","children":[],"created_at":"2026-08-02T13:00:45.000Z","created_at_i":1785675645,"id":49144225,"options":[],"parent_id":49143630,"points":null,"story_id":49143630,"text":"This makes sense. Why would everyone be coted for the same answer","title":null,"type":"comment","url":null},{"author":"mark_l_watson","children":[],"created_at":"2026-08-02T13:01:18.000Z","created_at_i":1785675678,"id":49144236,"options":[],"parent_id":49143630,"points":null,"story_id":49143630,"text":"Odd results for me. Last month I tested five AI chat sites, with web search turned off, and four of them had a shadow of information about me as a person (what kind of books I write, what tech I use, and a random bit of other information). The linked site gave me a zero score because it was testing if the AI models recommended my site for business or sales queries.","title":null,"type":"comment","url":null},{"author":"alsetmusic","children":[],"created_at":"2026-08-02T13:09:16.000Z","created_at_i":1785676156,"id":49144324,"options":[],"parent_id":49143630,"points":null,"story_id":49143630,"text":"This makes sense. A handful of websites hold most of the \u201ctrusted\u201d info because they\u2019re massive. I don\u2019t expect you to quote my blog with only three entries. The real trick would be getting AI companies to stop hammering sites that don\u2019t show up in answers, but even if they don\u2019t use a source for an answer, crawling still provides value.","title":null,"type":"comment","url":null},{"author":"deadbabe","children":[{"author":"phoghed","children":[{"author":"deadbabe","children":[],"created_at":"2026-08-02T16:12:35.000Z","created_at_i":1785687155,"id":49145836,"options":[],"parent_id":49144486,"points":null,"story_id":49143630,"text":"Do you want to be cited, or do you want to make money?","title":null,"type":"comment","url":null}],"created_at":"2026-08-02T13:25:22.000Z","created_at_i":1785677122,"id":49144486,"options":[],"parent_id":49144403,"points":null,"story_id":49143630,"text":"Seems like the opposite if the problem you\u2019re trying to solve is \u201cmy site isn\u2019t cited over someone else\u2019s\u201d. HTTP 467 - pls cite me, I\u2019ll pay you.","title":null,"type":"comment","url":null},{"author":"ndriscoll","children":[{"author":"deadbabe","children":[{"author":"ndriscoll","children":[],"created_at":"2026-08-02T16:59:02.000Z","created_at_i":1785689942,"id":49146198,"options":[],"parent_id":49145849,"points":null,"story_id":49143630,"text":"In a sense, that already exists. e.g. spotify or youtube premium. In practice only extremely exceptional individuals are going to see anything from it because creative markets are oversaturated, it's trivial to enter them, and people have finite time, so almost everyone is just not worth anyone's attention, let alone compensation.","title":null,"type":"comment","url":null}],"created_at":"2026-08-02T16:14:15.000Z","created_at_i":1785687255,"id":49145849,"options":[],"parent_id":49144624,"points":null,"story_id":49143630,"text":"Yes but imagine a platform instead where watching any YouTube video is paid for by a micro transaction. Transparently.","title":null,"type":"comment","url":null}],"created_at":"2026-08-02T13:40:01.000Z","created_at_i":1785678001,"id":49144624,"options":[],"parent_id":49144403,"points":null,"story_id":49143630,"text":"The problems with micropayments are
1. The market for lemons. In fact sites trying to "monetize their content" are the most likely to be lemons, so just asking is a signal that your "content" is not worth anything.
2. If your information does have value, it competes in a market with other sites full of high quality information that aren't trying to monetize it, meaning your specific information has to be specifically very valuable and not available yet for free elsewhere. If it is valuable as information (i.e. not something like creative writing), it will quickly spread and become freely available.
Lots of "content" just isn't worth anything (or has negative worth: it wastes your time). e.g. consider youtubers begging to get viewers to like/subscribe to increase their reach, and people generally don't despite it costing them nothing. Because it's not even worth a click to them.","title":null,"type":"comment","url":null}],"created_at":"2026-08-02T13:16:01.000Z","created_at_i":1785676561,"id":49144403,"options":[],"parent_id":49143630,"points":null,"story_id":49143630,"text":"This is why we need the HTTP 402 standard to become common.
If websites charge pennies per AI crawl, they will make more money than ever being reference in that 6.2% of websites that get cited (of which even another small percent get any follow through that leads to a sale or ad click)
HTTP 402 also basically extends the pay per token model people have gotten used to with AI model providers, except applied to the whole web, with the added privacy benefit in that there is no need for sellers of content to \u201cknow their customer\u201d, and indeed it may even be impossible to do so because of how the payment gateways operate.","title":null,"type":"comment","url":null},{"author":"Rabbit504030201","children":[],"created_at":"2026-08-02T13:34:23.000Z","created_at_i":1785677663,"id":49144565,"options":[],"parent_id":49143630,"points":null,"story_id":49143630,"text":"Nice study :) Keep updating!
The title is very misleading - authors openly state the low and slewed sample pool.","title":null,"type":"comment","url":null}],"created_at":"2026-08-02T11:53:52.000Z","created_at_i":1785671632,"id":49143630,"options":[],"parent_id":null,"points":40,"story_id":49143630,"text":null,"title":"Only 8.9% of sites block AI crawlers, but 94.8% are never cited in AI answers","type":"story","url":"https://website-auditor.io/ai-visibility-index"}