Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

It's tough when there's a cat and mouse game to spoof your UA so you don't get blocked. I wish webmasters had better relationships with scrapers and could accept the realities that your data will be scraped no matter how much you try and stop it.


IMO, We should really just get rid of the user agent header altogether.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: