Discource-C
/
discourse
mirror of https://github.com/discourse/discourse.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity

FIX: Don't crawl non-http/s links

This commit is contained in:
Robin Ward 2017-05-19 16:57:19 -04:00
parent 558a274187
commit ea9f93dcc5
1 changed files with 2 additions and 0 deletions
Show Stats Download Patch File Download Diff File Expand all files Collapse all files

2
app/jobs/regular/crawl_topic_link.rb
View File

@ -27,6 +27,8 @@ module Jobs
uri = URI(url) uri = URI(url)
return if uri.blank? || uri.host.blank? return if uri.blank? || uri.host.blank?
return unless ['https', 'http'].include?(uri.scheme)
headers = CrawlTopicLink.request_headers(uri) headers = CrawlTopicLink.request_headers(uri)
head = Excon.head(url, read_timeout: 20, headers: headers) head = Excon.head(url, read_timeout: 20, headers: headers)