Hacker Newsnew | past | comments | ask | show | jobs | submitlogin

There's also a fixed amount of time google's crawler will spend indexing your site; the faster your pages load, the more of them will get indexed.


That being said, if you return results too quickly then Google will hit your site more frequently. In our case, it's been frequently enough such that we'll give Googlegot a 429 response. Interestingly enough, the Google Search Console does not acknowledge 429s, but misreports them as 500s.




Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact

Search: