Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Yeah we had to roll through a bunch of proxy servers on top of all the other tricks you mentioned to reliably download at a decent pace


What are your thoughts on the load scrapers are putting on website operators?


What are your thoughts on the load website operators are putting on themselves to block scrapers?




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: