Cybersecurity

Robots Txt

When the user wants to configure, audit, or optimize robots.txt. Also use when the user mentions "robots.txt," "crawler rules," "block crawlers," "AI crawlers," "GPTBot," "allow/disallow," "disallow path," "crawl directives," "user-agent," "block Googlebot," "fix robots.txt," "robots.txt blocking," or "search engine crawling." For indexing, use indexing.

Publisher / source

kostja94/marketing-skills (found on skills.sh)

Upstream record

kostja94/marketing-skills

Version

Version 3

Published

2026-11-03

Publication review

Approved for publication

Content fingerprint

06ade22de023dc686b08cf7776d0df5781ecca227dfe0dfd5d0b495df85ed0c4