@leeS In a way, it is already highly configurable as you have full control over the robots.txt content. What kind of configuration options do you wish for?
@sod Looking to disallow ChatGPT, Google Bard, and Perplexity. Something like this:
User-agent: ChatGPT-User Disallow: / User-agent: GPTBot Disallow: / User-agent: Google-Extended Disallow: / User-agent: CCBot Disallow: / User-agent: PerplexityBot Disallow: /
It would be good to allow general indexing for discoverability, but from what I've read, this might not be possible if I want to disallow bots from training on my material.
@leeS You should be able to paste that snippet into the plug-in's setting named robots.txt Content. That will discourage those bots from crawling your site but allow others, like Google.