Disallow Search Engine Spiders to Index Second Website

Scenario

When having multiple websites on the account, there will be scenarios that user would want to disallow the search engine indexing on the second website.

Note: From 2020.2 onward, the Multiple Website feature is automatically enabled for all accounts. You no longer need to enable it and it is not possible to disable it. However, you may need additional site licenses to create more than one website.

Solution

Create new folders for the each website under hosting root to host the robots.txt file

1. Create a text file with the name robots.txt
2. Double-click to open the file
3. Add the example code below
4. User-agent: *
5.  Disallow: /
6. Navigate to Commerce > Hosting > Website Hosting Files
7. Click New Folder
8. Folder Name: Enter Folder Name
9. Example: Website B
10. Click Save
11. On the newly created folder: Click to open
12. Click Add File
13. Select robots.txt file
14. Click Open to upload file
15. Navigate to Commerce > Hosting > Domains
16. On desired domain: Click Edit
17. Web Site: Select Web Site
18. Hosting Root: Select Hosting Root Example: Website B
19. Click Save