Because of the recent pushback against AI bots, I’ve added a help page to Micro.blog with details about how to block crawling of your blog.
Because of the recent pushback against AI bots, I’ve added a help page to Micro.blog with details about how to block crawling of your blog.
@manton thanks for this! answers something I've been wondering about but hadn't gotten around to asking yet
@manton Thanks Manton. I was literally thinking an hour ago that I really should look into stopping AI bots on my blog. 👍
@manton that’s great, thank you! Do you know if it’ll be enough to stop perplexity.ai? According to MacStories and Wired, it seems Perplexity uses sneaky tactics to evade the usual server-side rules against robots.