Neil Lalonde
6e8bf1271f
increase purge site settings for imports in case jobs like clean_up_uploads cause a mess
2018-04-09 12:44:59 -04:00
Gerhard Schlager
8412a96acb
Do not create empty files when pulling from Transifex
2018-04-06 14:47:25 +02:00
Gerhard Schlager
09c4491f73
Add remaining core plugins to Transifex
2018-04-06 14:15:47 +02:00
Neil Lalonde
17f9c5494d
add discourse-chronos to plugin-translations.rb
2018-04-05 16:41:29 -04:00
Gerhard Schlager
f2d00e5eff
FEATURE: Use Message-ID for detecting email replies to group
...
Ignores the site setting "find_related_post_with_key" and always tries to honor the `In-Reply-To` and `References` header for emails sent to a group.
The senders email address must be included in the `To` or `CC` header of a previous email sent to the group and the `Message-ID` of that email must be included in the current email's `In-Reply-To` or `References` header.
2018-04-05 11:00:38 +02:00
Miro Michalicka
8d283e78e7
Fix broken queries in Drupal 6 migration.
2018-03-31 17:53:40 +02:00
Gerhard Schlager
cf9965fd54
Add rake task for reordering posts by creation_date
2018-03-29 14:42:41 +02:00
Gerhard Schlager
37fa843efc
Allow pulling of Urdu translations from Transifex again
...
The translations have been fixed.
2018-03-27 11:56:40 +02:00
Neil Lalonde
baba45a369
ur translations still break the build, so stop pulling them from Transifex for now
2018-03-26 11:03:14 -04:00
Gerhard Schlager
a0d5e243fd
Improve the import script for "Get Satisfaction"
...
* Works with the current column layout exported as Excel file
* Tries to fix invalid CSV when it wasn't exported from Excel
* Imports categories
* Imports topics into the correct category
* Allows skipping archived topics
* Allows skipping private topics
* Makes use of the latest features from the base importer
* Some minor fixes and documentation updates
2018-03-19 14:58:17 +01:00
Régis Hanol
dad1e4b17d
don't import data only available in a plugin in phpBB 3 importer
2018-03-17 00:36:12 +01:00
Gerhard Schlager
2834705bd1
Improve base import script
...
* Make sure the category description is imported correctly
(the about topic usually had the wrong excerpt).
* Allow import scripts to mark topics as closed or archived.
* Allow import scripts to store the topic's original id.
It will be stored in topic_custom_fields as import_topic_id.
2018-03-16 22:39:06 +01:00
Régis Hanol
bb6ac51607
Update PHPBB3 importer
...
- Extract name from profile_fields_data table
- Use 'posts.poster_ip' to track topic views
2018-03-16 18:32:27 +01:00
Sam
cb7f3c6537
partial upload support for scss
2018-03-14 13:01:52 +11:00
Gerhard Schlager
9b651adadb
FIX: mbox importer should ignore emails without date
2018-03-13 13:42:57 +01:00
Sam
8ad7f8b44f
updates to theme watcher
2018-03-13 17:39:53 +11:00
Sam
8229cc2ff1
shuffle vars forward
2018-03-12 18:40:14 +11:00
Sam
758b9a7dda
FEATURE: prototype of local theme directory watcher
...
(note this will be documented a bit late)
2018-03-12 18:36:06 +11:00
Neil Lalonde
7aa93b84c1
FIX: bulk importers shouldn't insert rows with id less than 1
2018-03-09 14:26:18 -05:00
Neil Lalonde
200c6673f1
FIX: bulk importers wiping all email addresses without warning or errors
2018-03-08 23:36:39 -05:00
Sam
ddcca1d5cc
lint
2018-03-08 15:16:12 +11:00
neerajmalve
4b8ff7a057
Update xenforo.rb ( #5622 )
...
#Fix for the error: xenforo.rb: 160: in `gsub!': invalid byte sequence in UTF-8 (ArgumentError)
2018-03-07 22:57:38 -05:00
Régis Hanol
07bc52dc69
import topic views in phpbb3
2018-03-07 19:27:03 +01:00
Neil Lalonde
1093dacc03
FIX: bulk importers need to create category description topics
2018-03-07 12:10:22 -05:00
Gerhard Schlager
dc32ee5cbf
Improvements to mbox import script
...
* Ignore errors during indexing and show information about the message causing the problem
* Always activate imported users if they aren't staged
2018-03-06 11:32:12 +01:00
Régis Hanol
49400337b6
Improve IPBoard3 importer
...
- fix encoding issues
- close topics
- don't import queued & not approved topics
- don't import deleted posts
2018-03-05 10:24:42 +01:00
Neil Lalonde
d7bd69583f
fix vanilla bulk importer resume categories and private topics
2018-03-01 15:29:38 -05:00
Régis Hanol
ae9b1e8554
FEATURE: IP.Board 3 importer
2018-03-01 09:43:32 +01:00
Neil Lalonde
e997cc7b77
add more image extensions to downsize_uploads.rb
2018-02-27 22:05:35 -05:00
Neil Lalonde
931caa4335
add a script that can downsize uploads
2018-02-27 16:23:48 -05:00
Régis Hanol
82e68670bf
FIX: SimplePress importer wasn't handling increment imports properly
2018-02-24 00:42:17 +01:00
Sam
720e1965e3
FEATURE: add category suppress from latest
...
In the past we used suppress_from_homepage, it had mixed semantics
it would remove from category list if category list was on home and
unconditionally remove from latest.
New setting explicitly only removes from latest list but leaves the
category list alond
2018-02-22 09:56:35 +11:00
Sam
73a492f721
minor changes to discourse bench
...
Ruby master is not compatible with bootsnap atm
2018-02-20 14:41:21 +11:00
Sam
a3c7ee09b6
FIX: ruby bench not working properly
...
- Remove thin which is no longer supported
- Bypass admin api rate limiting in profile environment
- Admin password was too short
- Run by default in concurrency 1 mode
- A skip bundle assets flag to speed up local testing
2018-02-19 11:37:16 +11:00
Sam
5faffeeb82
demo script for profiling middleware stack
2018-02-15 14:36:40 +11:00
Sam
c89b42c488
PERF: only require the rss library if used
...
Before:
Total allocated: 257909321 bytes (2514134 objects)
Total retained: 39681579 bytes (343387 objects)
allocated memory by gem
-----------------------------------
42875979 rss
retained memory by gem
-----------------------------------
2080188 rss
retained objects by gem
-----------------------------------
13052 rss
After:
Total allocated: 210562047 bytes (2252030 objects)
Total retained: 37433816 bytes (328635 objects)
----
So, 2 less megabytes on boot and 13000 objects stuck in ruby heaps forever.
2018-02-15 13:11:33 +11:00
Gerhard Schlager
479f7ed18f
Ignore case when removing mailing list name from subject
2018-02-12 21:41:58 +01:00
Régis Hanol
31f5ca6180
improve simple press importer
2018-02-07 17:37:51 +01:00
Neil Lalonde
0edd386b48
FEATURE: Vanilla bulk importer
2018-02-02 16:28:51 -05:00
Arpit Jalan
25ec077eca
rename 'min_private_message_{post/title}_length' to 'min_personal_message_{post/title}_length'
2018-02-01 13:25:29 +05:30
Neil Lalonde
421713f1be
include saved-searches in plugin-translations.rb
2018-01-31 11:19:21 -05:00
Neil Lalonde
cc830f7119
sorry rubocop
2018-01-30 14:37:15 -05:00
Jay Pfaffman
db17c531d6
Feature: Invision Power Board Importer
2018-01-30 08:44:02 -08:00
Gerhard Schlager
192a0886e2
FIX: BBCode to Markdown conversion in phpBB3 importer was broken
...
This fixes the conversion for quotes, code blocks and lists (except for nested lists). It also discourages the usage of the ruby-bbcode-to-md gem.
2018-01-30 12:50:42 +01:00
Gerhard Schlager
c26db2116c
FIX: phpBB3 importer imported some users as anonymous users
2018-01-30 12:50:42 +01:00
Neil Lalonde
a224459960
bulk importer shouldn't try to update primary key sequences to -1
2018-01-19 15:01:00 -05:00
Neil Lalonde
db287ad58e
FIX: invalid SQL in vanilla_mysql import script
2018-01-19 11:53:07 -05:00
Gerhard Schlager
6500343431
FIX: mbox importer didn't detected already indexed files
2018-01-17 17:03:53 +01:00
Gerhard Schlager
bb54eb1192
Improvements to mbox importer
...
* store time it took to index message in DB (to find performance issues)
* ignore listserv specific files
* better examples for split_regex
* first email in mbox shouldn't contain the split string
* always lock the DB in exclusive mode
* save email within transaction
* messages can be grouped by subject and use original order (for Listserv)
* adds option to index emails without running the import
2018-01-17 12:04:57 +01:00
Sam
fc05164667
demo script for demonizing using fork exec
...
minor refinements to demon
2018-01-11 13:51:52 +11:00