Guo Xiang Tan
24347ace10
FIX: Properly associate user_profiles background urls via upload id.
...
`Upload#url` is more likely and can change from time to time. When it
does changes, we don't want to have to look through multiple tables to
ensure that the URLs are all up to date. Instead, we simply associate
uploads properly to `UserProfile` so that it does not have to replicate
the URLs in the table.
2019-05-02 14:58:24 +08:00
MMX
5d4aa256be
FIX: category logo upload error in Discuz importer.( #7453 )
2019-04-29 17:01:15 +02:00
Michael K Johnson
9fc3de01bb
FEATURE: Add import script for Friends+Me Google+ Exporter JSON archives ( #7334 )
...
This script has been used to import over 50,000 Google+ posts
and over 300,000 comments from 29 communities into a single
Discourse instance, as well as for at least three other
imports. Google+ has closed for the public, but it is still
available at this time for GSuite customers. If GSuite customers
decide to migrate from Google+ to Discourse, or if Google
"sunsets" Google+ for GSuite customers, this importer may be
useful.
https://www.reddit.com/r/FMGE_Support/comments/b8sa5h/fmge_for_gsuite/
Development and use of this script has been discussed in detail:
https://meta.discourse.org/t/bounty-google-private-communities-export-screenscraper-importer/108029
2019-04-23 14:04:09 +10:00
Robin Ward
b58867b6e9
FEATURE: New 'Reviewable' model to make reviewable items generic
...
Includes support for flags, reviewable users and queued posts, with REST API
backwards compatibility.
Co-Authored-By: romanrizzi <romanalejandro@gmail.com>
Co-Authored-By: jjaffeux <j.jaffeux@gmail.com>
2019-03-28 12:45:10 -04:00
Gerhard Schlager
453ba2da7b
Make Google Groups scraper work with latest chromedriver
2019-03-25 16:11:22 +01:00
Gerhard Schlager
2349ba3bc4
Improve Google Groups scraper
...
* Better error detection during login phase
* Experimental support for 2FA and SMS codes
* Detect missing permissions to scrape email addresses
2019-03-24 23:15:13 +01:00
Penar Musaraj
0db2846a5b
Add user bios to NodeBB importer
2019-03-20 16:40:26 -04:00
Penar Musaraj
b6a7b851c7
Nodebb importer: add permalinks, exclude disabled categories
2019-03-18 21:59:02 -04:00
Penar Musaraj
9334d2f4f7
FEATURE: add more granular user option levels for email notifications ( #7143 )
...
Migrates email user options to a new data structure, where `email_always`, `email_direct` and `email_private_messages` are replace by
* `email_messages_level`, with options: `always`, `only_when_away` and `never` (defaults to `always`)
* `email_level`, with options: `always`, `only_when_away` and `never` (defaults to `only_when_away`)
2019-03-15 10:55:11 -04:00
Gerhard Schlager
941e096df4
Fix error in base import script
...
Follow-up to 655a08dbbd
2019-03-06 21:58:25 +01:00
maulkin
655a08dbbd
FIX: Return actual errors if PostCreator fails ( #7096 )
2019-03-06 21:29:37 +01:00
Penar Musaraj
b1035cc691
FIX: NodeBB import details
...
- mark imported users as active
- do not strip @ from usernames in post content
- improve uploads path matching
2019-03-06 12:30:36 -05:00
Gerhard Schlager
c36c9c2ee5
FEATURE: Import script for AnswerBase
...
Improves the generic database used by some import scripts:
* Adds additional columns for users
* Adds support for attachments
* Allows setting the data type for keys (numeric or string) to ensure correct sorting
2019-02-28 22:08:12 +01:00
Gerhard Schlager
24369a8166
Improve phpBB3 importer
...
* Log errors when mapping of posts, messages, etc. fails
* Allow permalink normalizations for old subfolder installation
* Disable importing of polls for now. It's broken.
2019-02-17 23:20:20 +01:00
Gerhard Schlager
8d5dfe1e01
FIX: Don't import parts of the email address as name
2019-02-17 22:59:18 +01:00
Régis Hanol
1e67bcb456
PERF: bulk feature topic users & reset topic counters after an import
2019-01-17 21:48:23 +01:00
Régis Hanol
788719d271
DEV: speed up posts base imports
2019-01-04 15:30:17 +01:00
Arpit Jalan
71a5369fef
FIX: do not convert quote tags to markdown
2018-12-11 20:09:46 +05:30
Régis Hanol
3c9c95ac83
Update Rubocop to 0.60
2018-12-04 10:48:16 +01:00
David Taylor
9248ad1905
DEV: Enable `Style/SingleLineMethods` and `Style/Semicolon` in Rubocop ( #6717 )
2018-12-04 11:48:13 +08:00
Guo Xiang Tan
5076487eaf
Update `discuz_x` import script to not use `Category#logo_url`.
2018-11-09 14:15:31 +08:00
Gerhard Schlager
d6f89a85ef
Make Rubocop happy
2018-10-31 01:30:14 +01:00
Gerhard Schlager
65db9326b4
FEATURE: Add download script for Google Groups
2018-10-31 01:12:05 +01:00
Gerhard Schlager
efa265cbc8
Rename mbox import script
2018-10-31 01:12:05 +01:00
Gerhard Schlager
edbc004a9a
Remove old mbox import script
2018-10-31 01:12:05 +01:00
Régis Hanol
c39a1022cc
PERF: user imports would slow down the more users were imported
2018-10-22 11:14:13 +02:00
Régis Hanol
afa22a0c6f
REFACTOR: more 'fake_email' to base importer
2018-10-22 11:12:40 +02:00
Régis Hanol
8b20e2500a
Remove unnecessary line
2018-10-19 15:48:48 +02:00
Régis Hanol
637123ff6f
Merge users based on their email in vBulletin importer
2018-10-19 15:16:45 +02:00
Régis Hanol
53aa0344bf
FIX: properly import vBulletin's hashed password
2018-10-18 10:22:55 +02:00
Régis Hanol
5f2fb0fe33
Show original options when an error happens while importing an user
2018-10-18 10:21:12 +02:00
Gerhard Schlager
341836eb42
Fix the rake task and importer instead
2018-10-17 16:48:09 +02:00
Gerhard Schlager
ee18d9ace0
FIX: mbox importer and rake task were broken
2018-10-17 16:34:18 +02:00
Neil Lalonde
a68032835a
FEATURE: XenForo importer can import categories from the xf_node table and convert sub-categories beyond second level to tags
2018-10-11 12:04:15 -04:00
Guo Xiang Tan
71185c13b5
Merge pull request #6377 from tgxworld/remove_tif_tiff
...
Drop `tif`, `tiff`, `webp` and `bmp` from supported images.
2018-09-12 09:32:32 +08:00
Guo Xiang Tan
e1b16e445e
Rename `FileHelper.is_image?` -> `FileHelper.is_supported_image?`.
2018-09-12 09:22:28 +08:00
Carsten Brandt
921e2213b8
FEATURE: Updated IPB import script
...
* IPB import script replace PHP code tags with proper markdown
remove excess newlines in code blocks
decode HTML entities in code blocks
add replacement for list items
proper handling of attachments that are not images
fix typo
improved quote handling
fix code style complaint from travis-ci build
2018-09-12 11:12:28 +10:00
Guo Xiang Tan
434035f167
FIX: Link post to uploads in `PostCreator`.
...
* This ensures that uploads are linked to their post on creation
instead of a background job which may be delayed if Sidekiq
is facing difficulties.
2018-09-06 11:18:11 +08:00
Guo Xiang Tan
8dc1463ab3
Enable `Lint/ShadowingOuterLocalVariable` for Rubocop.
2018-09-04 10:16:42 +08:00
Neil Lalonde
15f657309a
FEATURE: Zendesk importer that uses its API to get data
2018-08-28 10:21:39 -04:00
Gerhard Schlager
ac743dab10
Improve mbox import script
...
* emails weren't sorted in correct order
* better default regex for splitting mbox files
* output Message-ID if email is skipped because it doesn't have a Date
2018-08-23 09:46:28 +02:00
Gerhard Schlager
7f4ef3db9e
Improve Telligent importer
...
* Try multiple filenames and do lots of guessing when searching for attachments
* Unescape HTML in filenames and replace invalid characters in filenames
* Existing permalinks prevented resuming of import
* Prevent duplicate attachments in same post
2018-08-13 15:28:11 +02:00
Gerhard Schlager
8513605421
Fix the import of avatars and attachments
...
This time for real ;-)
2018-08-12 22:26:07 +02:00
Gerhard Schlager
6d813c2b52
FIX: Importers failed to import avatars
2018-08-12 22:02:17 +02:00
Gerhard Schlager
1794aea939
FEATURE: Add import script for Telligent
2018-08-12 22:01:23 +02:00
Vinoth Kannan
1390eb2957
Disable bootstrap mode before start importing
2018-07-25 12:12:26 +05:30
Régis Hanol
e8e9b5cea4
FIX: clean URLs in SMF1 importer
2018-07-19 13:17:43 +02:00
Régis Hanol
63e5349209
FIX: [img] BBCode tags might have parameters
2018-07-19 13:11:01 +02:00
Régis Hanol
5434cf02a3
FIX: smf1 importer was swallowing some data
2018-07-19 10:29:54 +02:00
Régis Hanol
c818550172
Support custom avatar in SMF1 importer
2018-07-12 17:38:07 +02:00