Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
RockRobotRock
on Aug 11, 2023
|
parent
|
context
|
favorite
| on:
Git scraping: track changes over time by scraping ...
It's tough when there's a cat and mouse game to spoof your UA so you don't get blocked. I wish webmasters had better relationships with scrapers and could accept the realities that your data will be scraped no matter how much you try and stop it.
hosteur
on Aug 11, 2023
[–]
IMO, We should really just get rid of the user agent header altogether.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: