May 26: 211,000 requests. GPTBot 102,000, Meta crawler 75,000, ClaudeBot 18,000. May 27: 234,000 requests. GPTBot 81,000, ClaudeBot 80,000, Meta crawler 59,000. May 28: 102,000 requests. ClaudeBot 79,000. May 29–31: mostly Amazonbot, including 20,000 requests on May 30.
It is likely, normal, and we stopped blocking crawling on request or suggestion by Jacob, which is likely what led to the surge.
We are indexed fast and fine, and get traffic.
We are working on editing 2023, on April, will work on it, before publishing. There was a big tag failure because of me, I'm fixing it right away
I'll fix Trump's real, but template WH letter prominence too
