Verify the Robots.txt File in B2C Commerce

After you generate or upload a robots.txt file, confirm that your storefront serves it correctly by requesting the file in a browser and testing its directives in Google Search Console.

1. In your browser, enter the hostname of the instance, a slash, and then robots.txt. For example, https://www.yourshophere.com/robots.txt or https://staging.realm.company.demandware.net/robots.txt.
2. Check that the contents of your robots.txt file appear. If you get a blank page, the file isn't being served. In this case, verify that the static content page cache was invalidated.