# https://www.robotstxt.org/robotstxt.html User-agent: * Allow: /$ Allow: /how-to$ Disallow: * sitemap: https://crab.fit/sitemap.xml