Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

Regular Cloudflare + heavy caching should solve all crawling problems, no?

For most bot visits, there should not be a single database request.



Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: