Discource-C
/
discourse
mirror of https://github.com/discourse/discourse.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

add a warning in robots.txt when using subfolder

This commit is contained in:
Régis Hanol 2018-04-12 00:00:15 +02:00
parent 062bf8bad3
commit 1a9271dd2f
1 changed files with 4 additions and 1 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

5
app/views/robots_txt/index.erb
View File

@ -1,4 +1,7 @@
# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file # See http://www.robotstxt.org/robotstxt.html for documentation on how to use the robots.txt file
<% if Discourse.base_uri.present? %>
# This robots.txt file is not used. Please append the content below in the robots.txt file located at the root
<% end %>
# #
<% @allowed_user_agents.each do |user_agent| %> <% @allowed_user_agents.each do |user_agent| %>
User-agent: <%= user_agent %> User-agent: <%= user_agent %>