427d54b2b0
DEV: Upgrading Discourse to Zeitwerk ( #8098 )
...
Zeitwerk simplifies working with dependencies in dev and makes it easier reloading class chains.
We no longer need to use Rails "require_dependency" anywhere and instead can just use standard
Ruby patterns to require files.
This is a far reaching change and we expect some followups here.
2019-10-02 14:01:53 +10:00
d9413a61d2
PERF: move crawl_topic_links to the low queue
...
Crawling topic links can be somewhat delayed no need to run it in the default
queue.
2019-05-22 10:18:49 +10:00
30990006a9
DEV: enable frozen string literal on all files
...
This reduces chances of errors where consumers of strings mutate inputs
and reduces memory usage of the app.
Test suite passes now, but there may be some stuff left, so we will run
a few sites on a branch prior to merging
2019-05-13 09:31:32 +08:00
e1b16e445e
Rename `FileHelper.is_image?` -> `FileHelper.is_supported_image?`.
2018-09-12 09:22:28 +08:00
4ba5e678d8
Require dependencies to enable live reload in dev for Sidekiq.
2017-10-06 11:39:00 +08:00
2f8f2aa1dd
FEATURE: Whitelists for inline oneboxing
2017-07-21 15:41:47 -04:00
2e7753c27f
User 'FileHelper.is_image?' to check wether a link is poiting to an image
2017-06-22 12:54:42 +02:00
b23fc2bf84
Helper to find the final destination for a URL
2017-05-22 15:52:41 -04:00
773445b8df
FIX: Topic Crawling should only crawl HTTP/S urls
2017-05-22 11:57:20 -04:00
ea9f93dcc5
FIX: Don't crawl non-http/s links
2017-05-19 16:57:41 -04:00
add6e12ce4
FIX: topic links with long titles can not be crawled
...
0..255 == 256 numbers column fits 255
2015-08-18 17:34:46 +10:00
1434e46ed2
FIX: Excon was wrapping our `ReadOnly` exception
...
This was preventing the crawling of many topic links
2015-05-27 14:29:52 -04:00
cd9e499b77
Don't try loading embeds on deleted topics
2015-05-06 16:53:28 +10:00
bb20f64cb2
use standard error so its easier to catch
2015-03-23 12:20:50 +11:00
6301a43d57
Not initializing variable for looping if unused in loop
2014-08-15 03:24:55 +05:30
a2e2d0e886
Merge pull request #2316 from mutiny/refactor-where-first
...
Refactor `where(...).first` to `find_by(...)`
2014-05-08 09:10:45 +10:00
f14c71b9d4
Fix the Amazon links regex
2014-05-06 19:19:32 +02:00
e77e7f23ca
Update the Amazon links regexp
...
Added all the countries displayed in the Amazon footer
2014-05-06 18:36:07 +02:00
1574485443
Perform the where(...).first to find_by(...) refactoring.
...
This refactoring was automated using the command: bundle exec "ruby refactorings/where_dot_first_to_find_by/app.rb"
2014-05-06 14:41:59 +01:00
a57f802048
If there's a `TopicEmbed` record for a url, we don't have to crawl it.
...
This should help sites like Boing Boing where sometimes links are
crawled before saved in WordPress.
2014-04-17 14:00:22 -04:00
e80851b0fa
Special case: When crawling a link to an image, just put the filename as
...
the title.
2014-04-10 13:45:13 -04:00
99e2bab62d
Use `update_all` to prevent `after_commit` from executing again.
2014-04-10 13:19:57 -04:00
aa63868d5e
FIX: Problem crawling amazon titles
2014-04-08 16:39:47 -04:00
1e3faddfe4
FIX: Change crawl size to 10k. Youtube for example doesn't work with the
...
first 1k
2014-04-07 16:03:47 -04:00
7e0028ba50
FIX: Don't crawl in test mode, raise correct exception when parameters
...
are missing
2014-04-07 14:38:18 -04:00
7e3ea5d644
Support for crawling topic links
2014-04-07 14:08:34 -04:00
Krzysztof Kotlarek
Sam Saffron
Guo Xiang Tan
Robin Ward
Régis Hanol
Akshay
Camille Roux
Louis Rose