DaAnalyst

DaAnalyst

What happens if/when AI/LLMs lose access to the sources of information?

Note: Not a strictly Elixir question but relates to us as well.

A year or so ago I asked Grok (or ChatGPT, can’t remember) what would happen when itself and other models lose access to up to date information due to the diminishing incentive for such sources of information to continue to exist, or exist outside of a paywall (e.g. websites, forums, ..)?

It didn’t have a finite answer. Actually, it asked me back the same question.

To what extent have your personal habits changed when looking for answers on the web? Do you still Google or do you just Grok/ChatGPT, ..? Yes, Google added their own LLM in the top left corner, but it changes nothing because the effect is the same if the user is no longer looking at the offered search results (or ads).

Do you share the view that this may substantially affect the incentives for sites to provide access to new information free of charge (i.e. free for access to the LLM scrapers)?

Most Liked

Mostafa86

Mostafa86

It sure would especially for content that is publicly available on the internet where the main source of monetisation is through advertising and the main source of traffic source is search engines. Because monetisation required eye balls which would most likely move to using LLMs and less traffic source as search engines are already incorporating those LLMs so it is a double whammy !

Just moving it behind a paywall doesn’t solve anything because a single paying user can end up scraping all the content as well if there are no other limiting measures in place.

joelpaulkoch

joelpaulkoch

I guess people will adapt to it in one way or the other. Here’s for instance an new way to monetize content from cloudflare Introducing pay per crawl: Enabling content owners to charge AI crawlers for access

(@FlyingNoodle and I think then it would be cloudflare’s job to go up against openai)

FlyingNoodle

FlyingNoodle

So let’s assume open ai uses a single account to scrape all the hosted sites.

You then want to charge their credit card 100’000 x some amount ? Come on…

My point is that whatever license you can dream up, the big ones will simply ignore it because it’s too profitable for them to do so, and sueing them is borderline impossible as you are going up against Goliath.

It’s a bit like copyright or having a patent. Yeah, you can have it on something but unless you have the means to actually enforce it, it’s meaningless.

dogweather

dogweather

Maybe I’m a special case because I’m publishing legal info. It and medical advice are the two areas that LLMs tend to shy away from. (For liability reasons, I’d guess.)

My monetization strategy is:

  1. Ad-driven public content - always up-to-date access to the law
  2. Subscriptions for legal researchers - hide ads, other features the general public wouldn’t care about.
  3. API access for other content publishers.

So, I dunno, when I see AI give an answer, there’s usually links to the sources. So I’m kind of expecting those to bring traffic.

But yeah, this being legal content, it’s kind of its own walled garden, by nature.

DaAnalyst

DaAnalyst

That’s simply not true. Big companies often get sued and lose for far less than a clear-cut copyright infringement.

Where Next?

Popular in Dev Env & Tools Top

xiaoqiang
These past few days, I’ve tried switching from Neovim to Helix, and so far the experience has been great. Compared to neovim, which requi...
New
renews
Hello everyone, today I created a simple Neovim plugin to check for new versions of packages used in the project, not sure if it is usefu...
New
AstonJ
Welcome to our thread for Mac users :smiley: Windows users please use this thread Linux users please use this thread For those who dis...
New
AstonJ
Following on from part of the discussion in the Digital Nomads & Frequent Travellers (Tips/Advice/Chat) thread, I thought it might be...
New
calebjosue
What sort of libraries are available to integrate LLMs into your Phoenix Web Framework applications? e.g. Mistral, since these guys have ...
New
AstonJ
Following on from this post in Do you use LittleSnitch or the equivalent on your OS? I think it might be worth us creating this thread so...
New
AstonJ
Welcome to our new Dev Environment & Tools section! We had originally pencilled this in for inclusion later in the year (closer to o...
New
AstonJ
With AI being a hot topic in the mainstream right now and with our industry at its helm (so making us the people who might be able to do...
#ai
New
dogweather
First, the downsides. I periodically fire the AI. :smiling_face_with_tear: ^^ This was earlier today in Cursor AI, working with “Clau...
New
mkunikow
SpaceVim is a community-driven vim distribution that seeks to provide layer feature, especially for neovim. It offers a variety of layers...
New

Other popular topics Top

Qqwy
Update: How to use the Blogs & Podcasts section You can post links to your blog posts or podcasts either in one of the Official Blog...
3268 119930 1237
New
shahryarjb
Hello, I get Persian date from my client and convert it to normal calendar like this: def jalali_string_to_miladi_english_number(persi...
New
sorentwo
Hello! tl;dr Announcing Oban, an Ecto based job processing library with a focus on reliability and historical observability. After spen...
977 41022 311
New
bsollish-terakeet
Credo is smart enough to check for (something like) this: assert length(the_list) == 0 with this response: Checking if an enum is empt...
New
ashish173
I am using Ecto timestamps with postgres, I can see the timestamps() use the :naive_dateime but for my use case I wanted to store the ti...
New
vonH
When I run the Plug and I recompile I wind up having to use Ctrl C to quit iex and start again. Witht the help of rlwrap I can use the cu...
New
stefanluptak
Hello everybody, usually, I use a 29" ultra-wide monitor for VSCode which can easily accomodate explorer (files panel) + file with code ...
New
electic
Hi, I am new to Elixir. I am trying to use the DateTime component to insert a date into MySQL however the there seems to be no way to fo...
New
belgoros
I’m not a pro in using Regex and can’t figure out why the following behaviour happens, especially if we take into account the difference ...
New
vrod
I am using the Starship cross-shell prompt – it seems pretty nice, but I get some errors: [WARN] - (starship::utils): Executing command ...
New

We're in Beta

About us Mission Statement