How can I customize the robots.txt file?


#1

I could not find any information on how to modify the robots.txt file which is automatically generated in Ember. My robots file looks like:

# http://www.robotstxt.org
User-agent: *
Disallow:

I would like to disallow robots i.e. something like:

# http://www.robotstxt.org
User-agent: *
Disallow: /

#2

Did you review the information on the website mentioned in the inline comment (http://www.robotstxt.org/)? It seems to have loads of information on what are valid contents of the file…


#3

If you were asking “how do I edit that file?”, the answer is that you just edit public/robots.txt directly and there’s no magic.


#4

Thanks, I had not realized the file was just sitting there :-/