Commit Graph

258 Commits

Author SHA1 Message Date
Jens Maier b74a7d271a FIX: made SMF2 importer compatible with Ruby 2.0 2014-09-30 21:01:50 +02:00
coren d1806649d2 initial version, mostly inspired from phpbb script 2014-09-29 20:37:35 +02:00
Robin Ward f4f54fd49b First stab at Importer for Drupal QA 2014-09-10 14:27:40 -04:00
Régis Hanol 78bcea5247 PERF: improve perf on consistency query in importers 2014-09-08 22:08:41 +02:00
Robin Ward f2cca140b4 FIX: Don't break out of remap action if there is a DB error. Display it
and continue.
2014-09-08 14:21:46 -04:00
Régis Hanol 9964955e88 FEATURE: fix consistency of users.last_posted_at in importers 2014-09-08 19:36:55 +02:00
Régis Hanol d1608bdfe9 FIX: better error handling in vBulletin importer 2014-09-08 11:02:54 +02:00
Régis Hanol 4907053cc4 FIX: vBulletin pre-processing regexes order 2014-09-05 18:44:34 +02:00
Sam 59d04c0695 Internal renaming of elder,leader,regular,basic to numbers
Changed internals so trust levels are referred to with

TrustLevel[1], TrustLevel[2] etc.

This gives us much better flexibility naming trust levels, these names
are meant to be controlled by various communities.
2014-09-05 15:20:52 +10:00
Régis Hanol 7a7a38c78e FIX: always show the progress bars when skipping posts/users in importers 2014-09-04 19:18:22 +02:00
Régis Hanol a0569a22be FEATURE: reset topic counters at the end of the import 2014-09-04 19:08:57 +02:00
Régis Hanol 85cbb001ae FIX: properly close topics in vBulletin importer
FEATURE: add backtrace when an exception happen (importers)
FIX: post-processing should also happen on first posts (vBulletin
importer)
PERF: faster topic bypass when already imported
2014-09-04 17:55:05 +02:00
Gerhard Schlager 5a769c7c48 FIX: Reset changed site settings after import is complete
After an import has finished the site settings should be reset to their
previous values. For example, since 'disable_emails' was set to false
before any import, it wasn't possible to login after the import
(sending email for password reset didn't work).
2014-08-31 18:09:21 +02:00
Neil Lalonde cd74829d55 FIX: Kunena import script no longer requires a csv file with Joomla user records. MySQL is used for all data. 2014-08-29 14:55:28 -04:00
Régis Hanol e823f568a7 FIX: preprocessing regexes in vBulletin importer 2014-08-29 13:11:56 +02:00
Régis Hanol 9b86d1507d VBULLETIN: add some stats about the imported groups 2014-08-25 12:33:08 +02:00
Régis Hanol 7aaf718cf3 update bbcode dialect and fix vBulletin importer 2014-08-25 10:48:29 +02:00
Régis Hanol 76824cda31 FIX: completely disable emails in importers 2014-08-23 11:12:01 +02:00
Régis Hanol 071325ab98 VANILLA: the name is actually the username (WAT) 2014-08-22 10:11:12 +02:00
Régis Hanol e3640060fc FIX: don't use the user's discovery text as bio in vanilla importer 2014-08-20 23:15:55 +02:00
Régis Hanol 841d547a48 FIX: vBulletin wasn't importing posters... 2014-08-20 23:04:43 +02:00
Régis Hanol d58d04f595 disable digest emails when importing a forum 2014-08-20 19:29:17 +02:00
Régis Hanol 6ca4983463 VANILLA: use latest activity as user's profile by default 2014-08-20 11:38:35 +02:00
Régis Hanol b84198af6a FIX: vanilla importer when private topic had no first post (WAT) 2014-08-18 15:07:14 +02:00
Régis Hanol 66aaa9329e FEATURE: vBulletin importer 2014-08-18 13:04:08 +02:00
Akshay 6301a43d57 Not initializing variable for looping if unused in loop 2014-08-15 03:24:55 +05:30
Neil Lalonde 5d9a389966 FIX: handle importing usernames that are too short, too long, or have invalid characters 2014-08-14 14:04:28 -04:00
Régis Hanol 61842157bf FIX: avatar_url should only be a custom field 2014-08-14 09:43:32 +02:00
Régis Hanol c97f18dec0 FIX: users are 'active' by default in imports 2014-08-13 23:57:07 +02:00
Régis Hanol 4c4ce05964 FIX & PERF: vanilla import
PERF: disabled refresh_avatar callback when importing users
PERF: avoid using UsernameSuggester when not needed
FIX: categories wasn't working
FIX: posts from deleted users are now from the system user
2014-08-13 22:20:06 +02:00
Régis Hanol d0095ce041 FEATURE: migrate vanilla importer to new import architecture 2014-08-11 18:44:17 +02:00
Neil Lalonde 21aa126181 Add more comments to the Drupal import script since there seems to be a lot of variation in the db schema 2014-08-06 14:09:28 -04:00
Sam bc48094d9a Merge pull request #2622 from gschlager/fix_memstats
handle permission denied errors
2014-08-06 13:58:45 +10:00
Robin Ward 8b79e0f6de Merge pull request #2620 from Elberet/smf2-import
Fix: messages imported in wrong order
2014-08-05 11:55:40 -04:00
Robin Ward 72e099afaa Merge pull request #2618 from martykube/phpbb_import_category_name_too_long
phpbb category names can be longer than 50 chars and are rejected during...
2014-08-05 11:55:24 -04:00
Jens Maier b075b9937f Fix: messages imported in wrong order 2014-08-05 17:40:26 +02:00
Régis Hanol 925a15c9aa FIX: proper exit status code for backup/restore scripts 2014-08-04 17:55:09 +02:00
Marty Kube b2826e9189 phpbb category names can be longer than 50 chars and are rejected during import 2014-08-03 20:44:02 -04:00
Gerhard Schlager abe657dfce guard against permission denied errors
reading from /proc/<pid>/smaps is not available inside of Docker container
2014-08-03 11:40:31 +02:00
Sam 49bf6f3075 Merge pull request #2612 from lazywei/installation_refine
Installation refine (REDO)
2014-08-01 09:04:15 +10:00
Jens Maier 31a517616c Feature: import attachments with support for SMF2 inline attachments mod 2014-07-30 06:19:46 +02:00
Jens Maier e93de81d32 Support more legacy SMF2 attachment naming schemes 2014-07-30 06:19:46 +02:00
Jens Maier 7f68cb5bb0 Allow multiple mysql connections 2014-07-30 06:19:46 +02:00
Jens Maier b17611f2db Fix: defaults should be defaults and not override parsed settings. 2014-07-30 06:19:46 +02:00
Neil Lalonde 8cb4442527 FIX: import scripts: bbcode_to_md should not be escaping html in post.raw 2014-07-23 15:16:01 -04:00
Neil Lalonde b0dc7db18f Merge pull request #2548 from Elberet/smf2-import
Import script for Simple Machines 2 forums
2014-07-23 10:33:03 -04:00
Neil Lalonde 78ea81afb6 Revert "Pretend to allow full path to backup files". This breaks our jobs that backup to a full path. 2014-07-22 10:08:59 -04:00
Jens Maier 44eb9fbd70 improved option handling 2014-07-16 23:18:52 +02:00
Jens Maier f40510b93e made postprocessing of posts with delay quotes conversion resumable 2014-07-16 21:40:52 +02:00
Jens Maier 7b5e6ff744 FEATURE: smf2 import script 2014-07-16 20:02:58 +02:00
riking 2ad2dee0e9 Pretend to allow full path to backup files 2014-07-15 10:23:24 -07:00
Sam a5ad2411ef FIX: bypass views 2014-07-14 08:44:26 +10:00
Neil Lalonde a9788bc4fe FIX: instructions in import script 2014-07-11 13:36:11 -04:00
Neil Lalonde 02158e59b2 FEATURE: phpbb import script: update links to other topics so they refer to the new site; fix weird links that break after import 2014-07-10 19:21:56 -04:00
Régis Hanol fab2c8f816 Create vbulletin.rb 2014-07-09 22:44:06 +02:00
Régis Hanol 5212c1785d Create vanilla.rb 2014-07-09 22:43:40 +02:00
Neil Lalonde c113b5d270 FEATURE: phpbb 3 import script 2014-07-09 11:18:29 -04:00
Neil Lalonde 7d5d5862c1 Import optimizations for topic creation: Prevent queuing of most jobs when importing posts and topics. Only do some recalculations at the end of the import. 2014-07-03 16:24:47 -04:00
Neil Lalonde 4e1f76d3b9 Merge pull request #2497 from BenLubar/benlubar-import-id-on-imported-posts
set import_id on imported posts
2014-07-03 10:22:25 -04:00
Neil Lalonde 67b9fec204 FEATURE: option to use ruby-bbcode-to-md to convert bbcode to markdown before importing posts 2014-07-02 16:53:53 -04:00
Ben Lubar 1dafad580d set import_id on imported posts 2014-06-26 12:33:56 -05:00
Sam 7289e0b5fd Refactor: split out update process from docker test 2014-06-20 09:26:44 +10:00
Andrew Bezzub e3fcd3fa80 update import script to save bio to UserProfile 2014-06-13 14:55:32 -04:00
Neil Lalonde 916252483b FIX: in import scripts, fix a case where post author lookup fails for some reason 2014-06-11 13:59:21 -04:00
Neil Lalonde 1e0d29273a Import scripts: handle when a topic has been closed 2014-06-10 17:12:50 -04:00
Régis Hanol 0781531e3c Merge pull request #2415 from techAPJ/bulk-invite-users-5
FEATURE: Bulk Invite
2014-06-10 19:11:11 +02:00
Sam 96f3ced4f9 Merge pull request #2391 from devinrhode2/patch-2
Update rvm install command
2014-06-10 15:20:05 +10:00
Arpit Jalan 727184641e FEATURE: Bulk Invite 2014-06-09 01:43:39 +05:30
Neil Lalonde f085770ed4 Import scripts: add update_feature_topic_users 2014-06-05 15:31:05 -04:00
Neil Lalonde 9bd76b0c16 Import scripts: relax our posting rules before the import starts 2014-06-05 15:31:05 -04:00
Neil Lalonde 2f706d084f FIX: in import scripts, don't generate names for users based on their emails. It's basically the same as publicizing their emails. 2014-06-05 14:15:52 -04:00
Neil Lalonde 08346974cf Import scripts: don't include moderator_action posts when calculating bumped_at 2014-06-04 18:22:19 -04:00
Neil Lalonde 35834a9c40 Import scripts: add method close_inactive_topics 2014-06-04 10:38:25 -04:00
Neil Lalonde daceea73a8 Import scripts for Drupal and Kunena/Joomla. A new base class for import scripts. 2014-06-02 14:38:40 -04:00
Bert Chang eefc150c00 Use apt-get instead of tasksel to prevent unexpected bug. 2014-05-29 12:35:41 +08:00
Bert Chang 87c63f290e Install tasksel before using it. 2014-05-29 12:10:34 +08:00
Bert Chang 7b402442f2 Add requirement for Ubuntu >= 12.10 in bench.rb 2014-05-29 12:05:58 +08:00
Devin Rhode 539aa3efc0 Update rvm install command
1. Prefer homebrew (otherwise macports gets used if installed)
2. It seems that the command has been updated to `\curl -sSL` instead of `curl -L` for clearly specific reasons.
2014-05-27 19:15:56 -05:00
Arpit Jalan dbe525b9de update Transifex project link 2014-05-20 22:24:19 +05:30
Sam 55e5515657 fallback to email lookup if needed 2014-05-18 11:49:36 +10:00
Sam 4f7e960e49 raw bbpress import script
amend post_creator to support custom fields
2014-05-18 11:33:59 +10:00
Neil Lalonde 69dee799e9 Add plugins/poll and discourse_imgur translation files to transifex 2014-04-24 10:53:03 -04:00
Sam a92f839aaf Merge pull request #2267 from Supermathie/emailtest
Ghetto script to test if email settings work
2014-04-17 16:16:04 +10:00
Neil Lalonde 1cddfd64c9 Add a flag to pull_translations.rb to force pull of all translations 2014-04-16 10:35:27 -04:00
Michael Brown 313130a7fc Ghetto script to test if email settings work 2014-04-15 23:50:15 -04:00
Neil Lalonde 9e947df747 Add script/pull_translations. It pulls translations from Transifex, and does some post-processing on the files. 2014-04-14 11:53:25 -04:00
Sam 81908035d0 Temporary, include git badge grant script, will be moved to a plugin 2014-04-14 16:07:53 +10:00
Dee Zsombor 568e16f3fb Remove documentation references to "pg_dumps/development-image.sql".
There is no such file. Seeding is accomplised via the rake tasks as of
9ab743f351.
2014-03-24 14:05:36 +01:00
Robin Ward 5b0d8d5ffd Trivial typo 2014-03-17 13:13:05 -04:00
riking bb634bd4f5 Add request_refresh to script/discourse 2014-03-06 20:26:34 -08:00
Régis Hanol 4c941495e5 FEATURE: add readonly mode CLI 2014-02-21 17:10:53 +01:00
Régis Hanol 0caee99e8b REFACTOR: moved the export.rake task into script/discourse script 2014-02-21 16:17:00 +01:00
Régis Hanol 438f97d8b0 BUGFIX: backup/restore rake tasks weren't working 2014-02-19 15:25:31 +01:00
Sam 5777423b05 diff heaps used for memory leak detection 2014-02-17 10:44:37 +11:00
Sam c0d947aa98 allow bench to run with unicorn optionally
memstats can output yaml now
2014-02-16 16:44:51 +11:00
Sam f7d5a561ec remove randomisation for now from bench 2014-02-16 15:11:25 +11:00
Sam b75620973f FEATURE: memory stats route for diagnostics in admin 2014-02-14 15:45:12 +11:00
Régis Hanol 50273ba815 rename site setting to 2014-02-13 13:31:14 -08:00
Régis Hanol d92c6ece63 fix script/discourse script 2014-02-13 13:31:13 -08:00
Sam 8a15e89d9d better var names 2014-01-31 16:37:05 +11:00
Sam 44dc578ff9 FEATURE: task for global rewrite, used post migration to multisite 2014-01-31 14:53:25 +11:00
Nick Ragaz be24d6f48a Update the OS X development documentation
* Remove some outdated information from the guide
* Add scripts/osx_dev to bootstrap a working development environment
* Add a Brewfile to track binary dependencies
2014-01-23 22:34:29 -05:00
Sander Datema 261860fd4b Typo in scripts/discourse 2014-01-19 18:54:49 +01:00
Sam 5a499b586f FEATURE: script/discourse import AND export 2014-01-17 12:33:42 +11:00
Sam Saffron 1ed7c4b0c2 update bench 2014-01-10 17:43:43 +11:00
Sam Saffron 51ddd99449 update bench 2014-01-10 16:11:10 +11:00
Sam 1b8a32ba19 correct nginx rule forwarding header 2014-01-09 16:39:30 +11:00
Sam d4cc367a6f Disable cache for a bit to see if its killing the build 2014-01-09 16:08:59 +11:00
Sam 1c3fc39525 bench improvements 2014-01-09 15:56:03 +11:00
Sam d635d888ba fix typo 2014-01-03 13:03:58 +11:00
Sam 90a7cb9dc3 FEATURE: add rss to bench
BUGFIX: profile db generator require ordering
2014-01-03 11:51:42 +11:00
Sam 6a0072d36e don't keep installing gabbler from bench
fix ab detection
2014-01-02 10:21:01 +11:00
Sam b8184d8b92 speed up bench add param for iterations 2013-12-30 15:15:30 +11:00
Sam 31ea259624 extend bench somewhat 2013-12-27 10:20:50 +11:00
Sam c53873110f improve bench script 2013-12-11 10:32:40 +11:00
Sam 0e9c34ff12 memory profiling script 2013-11-28 12:40:10 +11:00
Régis Hanol 52160179f8 add a tombstone for extra safety 2013-11-27 22:05:11 +01:00
Régis Hanol 8a62381268 migration script 2013-11-27 22:05:06 +01:00
Neil Lalonde c9c7dc2002 A better script for bumping the version 2013-10-29 12:30:29 -04:00
Sam 60284d8a9a add custom clean env 2013-10-13 08:07:45 +11:00
Régis Hanol 42d9b0ca46 Oopps. Regis doesn't know how to count 2013-09-30 15:12:46 +02:00
Régis Hanol abe4a19824 fix profile db generator to run even with the system account 2013-09-30 15:10:30 +02:00
Sam 6183e9bb6c flamegraph upgrade 2013-09-17 21:34:38 +10:00
Sam 3c2b10ddaf tidy up method 2013-09-17 10:24:15 +10:00
Sam 9c6c0f2a3d enable eager loading in profile mode
correct bench script
2013-09-10 16:22:58 +10:00
Sam ad0bef5ef6 improve bench to measure admin as well 2013-09-10 16:03:11 +10:00
Sam fb66dd7953 playing with my script, feel free to ignore 2013-09-06 18:17:46 +10:00
Sam 5dd199df26 bench fix and new arel patches for rails 4 2013-09-03 18:58:56 +10:00
Sam cc5b958d9e update with some facts 2013-08-29 21:34:32 +10:00
Sam b41fa4988a update rails 4
ensure you clear the tmp/cache folder on each bench (so results are correct, there is an incompat upgrade)
add facter gem which will be used to collect hardware data from the bencher
2013-08-29 21:23:00 +10:00
Sam 47c6ba2f51 mucking with my measure script 2013-08-29 15:27:59 +10:00
Sam b6028c39d7 user simulator was bust 2013-08-28 10:52:06 +10:00
Sam 38e80b999f benching script, work in progress 2013-08-22 09:01:45 +10:00
Sam beeb86bf91 correct user simulator 2013-08-19 11:33:24 +10:00
Régis Hanol 032bdceeef FIX: bench script is not working on OS X 2013-08-17 11:36:41 +02:00
Sam 9e20a99afd more info logged 2013-08-15 17:48:11 +10:00
Sam 5d4d72c19d also bench a topic page 2013-08-15 17:13:05 +10:00
Sam d753cdb2f7 add db population 2013-08-15 16:59:38 +10:00
Sam 40ef4b6907 add time it takes to load rails 2013-08-15 16:35:57 +10:00
Sam 8f5866d9e8 prereqs 2013-08-15 15:37:33 +10:00
Sam 1c4b1eba08 we need the output of bundle 2013-08-15 15:32:07 +10:00
Sam 5d05b96ca0 work in progress, benching script 2013-08-15 15:19:23 +10:00
Sam 1fb160d30f credit where it is due 2013-08-05 14:29:04 +10:00
Sam 2d0ec364db unbundled_require for gabbler 2013-08-05 14:27:19 +10:00
Sam 10b02b1288 Create profile db generator for use when benchmarking a local install http://meta.discourse.org/t/benchmarking-discourse-locally/9070 2013-08-05 07:22:13 +10:00
Sam 8d947535a8 add descriptive comment 2013-07-16 15:44:38 +10:00
Sam d3b544bbff check in a basic require profiler script only used in dev ... 2013-07-16 15:44:38 +10:00
Sam c6c8246399 added sample unicorn config
added utility to measure real memory usage
don't require thin by default
2013-07-07 14:31:07 +10:00
Sam d176b1d723 A simple setup dev enviroment script 2013-06-20 15:55:18 +10:00
Sam d20056ad0e correct watcher, live updates for unread 2013-05-30 16:49:58 +10:00