DaAnalyst
What happens if/when AI/LLMs lose access to the sources of information?
Note: Not a strictly Elixir question but relates to us as well.
A year or so ago I asked Grok (or ChatGPT, can’t remember) what would happen when itself and other models lose access to up to date information due to the diminishing incentive for such sources of information to continue to exist, or exist outside of a paywall (e.g. websites, forums, ..)?
It didn’t have a finite answer. Actually, it asked me back the same question.
To what extent have your personal habits changed when looking for answers on the web? Do you still Google or do you just Grok/ChatGPT, ..? Yes, Google added their own LLM in the top left corner, but it changes nothing because the effect is the same if the user is no longer looking at the offered search results (or ads).
Do you share the view that this may substantially affect the incentives for sites to provide access to new information free of charge (i.e. free for access to the LLM scrapers)?
Most Liked
Mostafa86
It sure would especially for content that is publicly available on the internet where the main source of monetisation is through advertising and the main source of traffic source is search engines. Because monetisation required eye balls which would most likely move to using LLMs and less traffic source as search engines are already incorporating those LLMs so it is a double whammy !
Just moving it behind a paywall doesn’t solve anything because a single paying user can end up scraping all the content as well if there are no other limiting measures in place.
joelpaulkoch
I guess people will adapt to it in one way or the other. Here’s for instance an new way to monetize content from cloudflare Introducing pay per crawl: Enabling content owners to charge AI crawlers for access
(@FlyingNoodle and I think then it would be cloudflare’s job to go up against openai)
FlyingNoodle
So let’s assume open ai uses a single account to scrape all the hosted sites.
You then want to charge their credit card 100’000 x some amount ? Come on…
My point is that whatever license you can dream up, the big ones will simply ignore it because it’s too profitable for them to do so, and sueing them is borderline impossible as you are going up against Goliath.
It’s a bit like copyright or having a patent. Yeah, you can have it on something but unless you have the means to actually enforce it, it’s meaningless.
dogweather
Maybe I’m a special case because I’m publishing legal info. It and medical advice are the two areas that LLMs tend to shy away from. (For liability reasons, I’d guess.)
My monetization strategy is:
- Ad-driven public content - always up-to-date access to the law
- Subscriptions for legal researchers - hide ads, other features the general public wouldn’t care about.
- API access for other content publishers.
So, I dunno, when I see AI give an answer, there’s usually links to the sources. So I’m kind of expecting those to bring traffic.
But yeah, this being legal content, it’s kind of its own walled garden, by nature.
DaAnalyst
That’s simply not true. Big companies often get sued and lose for far less than a clear-cut copyright infringement.







