I’ve switched on robots.txt files for all Micro.blog-hosted blogs, by default allowing full indexing. It’ll appear the next time your blog updates. I also wrote a help page with how to disable or customize the file.
@manton More customisation is great. My only concern is managing the feature; did I misread the guide or is this switched on by default?
@simonwoods It has effectively always been on because Google will index everything if you don’t say not to. Now it can be controlled (and it could be a checkbox later).
@manton Why not make someone create a custom theme to turn on robots.txt instead of creating one to turn it off?
Will turning it off affect anything on Micro.Blog if I use Disallow: /_?
@manton Ah, excellent! My cynical view was completely wrong. 👍🏻 This is a great start; hopefully one day it'll be a switch, for those who are unlikely to get involved in themes even at a basic level.