discourse/script
Leonardo Mosquera c83914e2e5
FIX: fix normalize_raw method for nil inputs in migration scripts (#22304)
Various migration scripts define a normalize_raw method to do custom processing of post contents before storing it in the Post.raw and other fields.

They normally do not handle nil inputs, but it's a relatively common occurrence in data dumps.

Since this method is used from various points in the migration script, as it stands, the experience of using a migration script is that it will fail multiple times at different points, forcing you to fix the data or apply logic hacks every time then restarting.

This PR generalizes handling of nil input by returning a <missing> string.

Pros:

    no more messy repeated crashes + restarts
    consistency

Cons:

    it might hide data issues
        OTOH we can't print a warning on that method because it will flood the console since it's called from inside loops.

* FIX: zendesk import script: support nil inputs in normalize_raw
* FIX: return '<missing>' instead of empty string; do it for all methods
2023-06-29 13:22:47 -03:00
..
benchmarks DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
bulk_import DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
demon_test FIX: Revert Demon::DemonBase back to Demon::Base (#8132) 2019-10-02 14:54:08 +10:00
import_scripts FIX: fix normalize_raw method for nil inputs in migration scripts (#22304) 2023-06-29 13:22:47 -03:00
.gitignore improvements to the mbox import script 2017-11-18 17:16:44 +01:00
alice.txt
analyse_message_bus.rb DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
analyze_sidekiq_queues.rb DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
bench.rb DEV: Remove `RUBY_GLOBAL_METHOD_CACHE_SIZE` (#21249) 2023-04-26 10:39:39 +02:00
biggest_objects.rb DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
boot_mem.rb DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
cache_critical_dns FIX(cache_critical_dns): use DB port sourced from environment 2023-03-10 10:09:07 +10:00
check_forking.rb DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
copyright-deposit Add script for compiling copyright deposits (#9646) 2020-05-06 12:51:45 -04:00
db_timestamps_mover.rb FIX: require date db_timestamps_mover script (#21248) 2023-04-26 17:59:20 +10:00
diff_heaps.rb DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
discourse DEV: Be more lenient in CLI confirmation (#16290) 2022-03-25 20:14:41 +00:00
docker_test.rb DEV: Update docker_test to checkout specific branch by default (#20684) 2023-03-15 10:54:47 +00:00
i18n_lint.rb REFACTOR: Fix pluralized strings in chat plugin (#20357) 2023-02-20 10:31:02 +01:00
measure.rb DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
memory-analysis DEV: enable frozen string literal on all files 2019-05-13 09:31:32 +08:00
memstats.rb DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
micro_bench.rb DEV: Replace #pluck_first freedom patch with AR #pick in core (#19893) 2023-02-13 12:39:45 +08:00
mwrap_sidekiq PERF: avoid shelling to get hostname aggressively 2020-02-18 15:13:19 +11:00
profile_db_generator.rb DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
promote_migrations DEV: Promote historic post_deploy migrations (#19492) 2022-12-16 13:36:30 +02:00
rails DEV: enable frozen string literal on all files 2019-05-13 09:31:32 +08:00
redis_memory.rb DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
require_profiler.rb DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
spawn_backup_restore.rb DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
start_test_db.rb DEV: Wait for initdb to complete in docker.rake (#15614) 2022-01-17 17:45:39 +00:00
switch_container_ruby DEV: add script to switch ruby version from inside container 2019-03-25 17:41:24 +11:00
test_email_settings.rb DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
test_mem.rb DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
test_memory_leak.rb DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
test_pretty_text.rb DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
thread_detective.rb DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00
user_simulator.rb DEV: Apply syntax_tree formatting to `script/*` 2023-01-09 11:13:22 +00:00