Commit Graph

20 Commits

Author SHA1 Message Date
Vinoth Kannan cd9262b7d3
DEV: minor improvements in the vanilla import script. (#14026)
We're parsing the post raw based on the record format now.
2021-08-12 15:07:44 +05:30
Justin DiRose 1aaf588fb7
DEV: Improvements to vanilla_mysql importer (#12308)
Made some improvements to the Vanilla MySQL script -- mainly because not all SQL imports require use of the VanillaBodyParser. Still left it as an option to turn on and use if so desired. Also added subcategory support, importing of likes, and solve status.
2021-03-11 10:21:56 -06:00
Arpit Jalan bd7cbcd8f8
Improve Vanilla import script. (#11701)
- import groups and group users
- import uploads/attachments
- improved code tag parsing
- improved text formatting
- mark topics as solved
2021-01-13 23:10:00 +05:30
Rachel Carvalho 812e0d6b5e
FIX: improve Vanilla importing (#10478)
* ensure emails don't have spaces
* import banned users as suspended for 1k yrs
* upgrade users to TL2 if they have comments
* topic: import views, closed and pinned info
* import messages
* encode vanilla usernames for permalinks. Vanilla usernames can contain spaces and special characters.
* parse Vanilla's new rich body format
2020-08-24 16:19:57 -04:00
Sam Saffron 30990006a9 DEV: enable frozen string literal on all files
This reduces chances of errors where consumers of strings mutate inputs
and reduces memory usage of the app.

Test suite passes now, but there may be some stuff left, so we will run
a few sites on a branch prior to merging
2019-05-13 09:31:32 +08:00
Neil Lalonde db287ad58e FIX: invalid SQL in vanilla_mysql import script 2018-01-19 11:53:07 -05:00
Guo Xiang Tan 5012d46cbd Add rubocop to our build. (#5004) 2017-07-28 10:20:09 +09:00
Melroy Neil Dsouza 420abce549 Optimize import script - vanilla_mysql.rb
Use WHERE id > last_id instead of OFFSET because OFFSET causes performance issues
2017-06-19 10:30:55 +05:30
Neil Lalonde 3b119dac6d FIX: importer performance of update_tl0, and give feedback during vanilla_mysql's create_permalinks 2016-07-06 10:58:43 -04:00
Neil Lalonde 32b22996d0 FEATURE: vanilla_mysql importer can import tags 2016-06-27 16:17:00 -04:00
Neil Lalonde fe42b189c9 FIX: vanilla_mysql importer removes everything between the first and last img tags in a post 2016-05-25 12:41:32 -04:00
Neil Lalonde d96ca0a985 FIX: vanilla_mysql importer shouldn't exit when creating duplicate permalink 2016-05-17 18:39:04 -04:00
Neil Lalonde e1061acd32 vanilla_mysql faster users when resuming, create_permalinks 2016-05-17 11:16:51 -04:00
Neil Lalonde 66cf27a7e0 FEATURE: import script for vanilla_mysql can import user avatars if you have the files 2016-04-01 15:57:30 -04:00
Neil Lalonde 6e3d52901a Vanilla importer: add an option for whether vanilla_mysql.rb should convert html markup into literals 2016-01-15 16:47:05 -05:00
Neil Lalonde 70c8ce2f23 cache_rows: false causes segfault 2016-01-12 18:45:51 -05:00
Neil Lalonde f19c95bcf7 Vanilla MySQL: improve performance when the db is full of users with the same username: [Deleted User] 2016-01-12 18:45:51 -05:00
Neil Lalonde 42d05ecfb2 fix wrong variable name in vanilla_mysql import script 2016-01-11 14:20:07 -05:00
Kane York 821124f3fd FEATURE: Skip batches if all records exist
Update all import scripts to take advantage of all_records_exist?
2015-09-21 17:13:02 -07:00
Arpit Jalan b0b08c932b add Vanilla (MySQL) importer 2015-07-17 08:24:53 +05:30