More importantly, doing this will quickly get throttled on the provider side (if using chat UI) or costs will skyrocket (if using APIs).

The right way to use LLMs here is to have them write (and perhaps maintain) scraping scripts and run those.