@anniegreens @sod Really good points. I should've been more clear about how this works: Micro.blog itself downloads the text for a web page, not OpenAI, and we already check for robots.txt. If a site doesn't want to be indexed, we will not send it to OpenAI either. There might be holes, though… I'm going to review this.