# How can I customize the robots.txt file?

**URL:** <https://discuss.emberjs.com/t/how-can-i-customize-the-robots-txt-file/15662>\
**Category:** Build Issues\
**Created:** [October 16, 2018, 1:35pm UTC](https://discuss.emberjs.com/t/how-can-i-customize-the-robots-txt-file/15662 "2018-10-16T13:35:13Z")\
**Posts on this page:** 4\
**Page:** 1

<div class="post-metadata">

**Author:** ![jfschaff](https://sea1.discourse-cdn.com/flex019/user_avatar/discuss.emberjs.com/jfschaff/32/13920_2.png) [@jfschaff](https://discuss.emberjs.com/u/jfschaff)\
**Post date:** [October 16, 2018, 1:35pm UTC](https://discuss.emberjs.com/t/how-can-i-customize-the-robots-txt-file/15662/1 "2018-10-16T13:35:13Z")

</div>

I could not find any information on how to modify the robots.txt file which is automatically generated in Ember. My robots file looks like:

```
# http://www.robotstxt.org
User-agent: *
Disallow:

```

I would like to disallow robots i.e. something like:

```
# http://www.robotstxt.org
User-agent: *
Disallow: /

```

---

<div class="post-metadata">

**Author:** ![rwjblue](https://sea1.discourse-cdn.com/flex019/user_avatar/discuss.emberjs.com/rwjblue/32/9411_2.png) [@rwjblue](https://discuss.emberjs.com/u/rwjblue)\
**Post date:** [October 16, 2018, 2:05pm UTC](https://discuss.emberjs.com/t/how-can-i-customize-the-robots-txt-file/15662/2 "2018-10-16T14:05:07Z")

</div>

Did you review the information on the website mentioned in the inline comment ([http://www.robotstxt.org/](http://www.robotstxt.org/))? It seems to have loads of information on what are valid contents of the file…

---

<div class="post-metadata">

**Author:** ![ef4](https://sea1.discourse-cdn.com/flex019/user_avatar/discuss.emberjs.com/ef4/32/13470_2.png) [@ef4](https://discuss.emberjs.com/u/ef4)\
**Post date:** [October 16, 2018, 4:30pm UTC](https://discuss.emberjs.com/t/how-can-i-customize-the-robots-txt-file/15662/3 "2018-10-16T16:30:59Z")

</div>

If you were asking “how do I edit that file?”, the answer is that you just edit public/robots.txt directly and there’s no magic.

---

<div class="post-metadata">

**Author:** ![jfschaff](https://sea1.discourse-cdn.com/flex019/user_avatar/discuss.emberjs.com/jfschaff/32/13920_2.png) [@jfschaff](https://discuss.emberjs.com/u/jfschaff)\
**Post date:** [October 18, 2018, 12:24pm UTC](https://discuss.emberjs.com/t/how-can-i-customize-the-robots-txt-file/15662/4 "2018-10-18T12:24:37Z")

</div>

Thanks, I had not realized the file was just sitting there :-/
