If essential, you are able to include your Sitemap to the robots.txt file. This makes it a lot easier for bots to crawl Internet site written content. The Sitemap file is located at . You need to add a directive with the URL of your respective Sitemap as proven underneath: https://rankingseotoolz.com/robots-txt-generator