Commit Graph

286 Commits

Author SHA1 Message Date
Ken Stevens c7bd11ed0d migration version validation tested 2019-10-29 14:54:35 -04:00
Ken Stevens 788f386ce4 added version order validation 2019-10-29 14:30:17 -04:00
Ken Stevens c8c89d976f Flyway integration test passes 2019-10-29 14:18:41 -04:00
Ken Stevens 94c8f96856 Add equals and hashcode to tasks for flyway 2019-10-29 13:34:11 -04:00
Ken Stevens dd2cb39fd1 tests pass but now need to renumber 2019-10-28 17:45:36 -04:00
Ken Stevens a123bfe564 All tests pass except createTableByColumns 2019-10-28 17:28:26 -04:00
Ken Stevens f8e15ea69e added final String release field to migration BaseTask 2019-10-28 16:09:18 -04:00
Ken Stevens 1aabe9bf40 added final String version field to migration BaseTask 2019-10-28 15:34:21 -04:00
Ken Stevens 18e8604494 Merge remote-tracking branch 'remotes/origin/master' into ks-flyway
# Conflicts:
#	hapi-fhir-cli/hapi-fhir-cli-api/pom.xml
2019-10-27 08:29:52 -04:00
James Agnew 464c6c5b45
Upgrade dependencies and addess Semmle issues (#1554)
* Version bumps

* FIx build issues

* Address a few Semmle issues

* Work on tests

* Some test fixes

* Test fix

* Fix deletions

* Test fix

* Fix intermittent test failure

* One more dependency bump

* Add some test logging

* Remove bad import

* Add some tests

* Test updates
2019-10-22 17:10:58 -04:00
James Agnew 13b80a294a Test fix 2019-10-18 07:13:11 -04:00
James Agnew 5dcbed0438 Fix foreign key handling when dropping tables 2019-10-17 15:52:35 -04:00
James Agnew 839f935401 remove unnecessary index 2019-10-15 19:07:37 -04:00
James Agnew e727769988 FIx a migration task 2019-10-15 18:16:22 -04:00
James Agnew 2725797610
Implement Terminology Delta Operations (#1536)
* Start refactoring terminology delta operations

* Work on delta operations

* Work on concept saving

* Split term services into smaller services

* Work on term delta operations

* Work on term svcs

* Work on term operations

* More work on delta uploader

* Add a test

* Wrk on term service

* Fix compile error

* Some refactoring

* Test fix

* Test fix

* Test fixes

* Test fix

* Test fixes

* Test fixes

* Work on delta

* Work on tests#

* Test fixes

* Improve resequencing logic

* Build test

* More testing

* More build testing

* More work on tests

* CHange test logging

* Fix term service PID issue

* Update src/changes/changes.xml

Co-Authored-By: Diederik Muylwyk <diederik.muylwyk@gmail.com>

* Address review comment

* Some cleanup

* Test fix

* Fix some tests

* Test fixes
2019-10-14 19:14:41 -04:00
Diederik Muylwyk 3c24e14a71 Fixed test based on wrong assumption. 2019-10-08 13:39:13 -04:00
Diederik Muylwyk 23264f497f Added test. 2019-10-08 13:19:35 -04:00
Diederik Muylwyk 175c0781eb Add case for handling JDBC type CLOB in JdbcUtils. 2019-10-08 11:55:03 -04:00
Ken Stevens 790f655a95 flyway initial implementation (with FIXMEs) 2019-10-06 17:55:10 -04:00
James Agnew 2193a30b45
CodeSystem Delta Uploader (#1520)
* Terminology Delta Uploading

* Add delta operations

* Fix up tests

* Improve test coverage a bit

* Improve test coverage reporting

* fix yaml

* A couple of test enhancements

* FIx intermittent test failure
2019-10-03 07:19:00 -04:00
James Agnew 260cee023a Account for longer resource type names 2019-10-02 10:00:45 -04:00
Diederik Muylwyk 826cb0ff10 Fix migration task for TermConceptProperty; should be BLOB, not CLOB. Good job! 2019-09-30 20:18:20 -04:00
Diederik Muylwyk 396f358f2d Support for long concept property values has been added. 2019-09-30 14:40:31 -04:00
James Agnew 8657afb01e
Fix intermittent test failures regarding search (#1509)
* Add some logging

* Add more test logging

* Work on some test logging

* Fix compile error

* Work on codecov

* Work on codecov

* Remove test debug messages
2019-09-25 20:15:21 -04:00
Ken Stevens 945cc6419f fixed npe 2019-09-24 18:13:53 -04:00
James Agnew f5788341f2
Add no-shrink-columns option to migrator (#1500)
* Add no-shrink-columns option to migrator

* Address review comments
2019-09-23 18:44:51 -04:00
James Agnew f4252cdeaa Merge branch 'master' of github.com:jamesagnew/hapi-fhir 2019-09-21 08:54:59 -04:00
James Agnew 0cbb33eded Fix up migratiom tasks for 4.1.0 2019-09-21 08:54:33 -04:00
Diederik Muylwyk e1e8ec981b Replaced migration task column length constants with literals because they are not necessarily constant across schema versions. 2019-09-20 12:31:54 -04:00
James Agnew 6b21e8cd90 Add some testing to the bulk export service 2019-09-18 14:43:00 -04:00
James Agnew 4a751cbfc5
Integrate Bulk Export (#1487)
* Start working on subscription processor

* Work on new scheduler

* Test fixes

* Scheduler refactoring

* Fix test failure

* One more test fix

* Updates to scheduler

* More scheduler work

* Tests now all passing

* Ongoing work on export

* Ongoing scheduler work

* Ongoing testing

* Work on export task

* Sync master

* Ongoing work

* Bump xml patch version

* Work on provider

* Work on bulk

* Work on export scheduler

* More test fies

* More test fixes

* Compile fix

* Reduce logging

* Improve logging

* Reuse bulk export jobs

* Export provider

* Improve logging in bulk export

* Work on bulk export service

* One more bugfix

* Ongoing work on Bulk Data

* Add changelog
2019-09-17 16:01:35 -04:00
Diederik Muylwyk 67d24eedff Merging master into working branch.
# Conflicts:
#	hapi-fhir-jpaserver-base/src/main/java/ca/uhn/fhir/jpa/entity/TermValueSetConceptDesignation.java
#	hapi-fhir-jpaserver-migrate/src/main/java/ca/uhn/fhir/jpa/migrate/tasks/HapiFhirJpaMigrationTasks.java
2019-09-09 19:01:29 -04:00
Ken Stevens dded46d220 fixed bug in drop fk migration task 2019-09-06 10:27:20 -04:00
Ken Stevens c88e6a6fa7
Merge pull request #1442 from jamesagnew/ja_20190822_1440_infinispan_query_cache
Externalize query cache into its own service
2019-09-06 08:28:12 -04:00
James Agnew 785d40a777 Accuont for a few schema changes 2019-09-05 21:29:47 -04:00
Ken Stevens b1421b1d60 @NotNull (hope I picked the right one!) 2019-09-05 16:20:24 -04:00
Ken Stevens 2a08808935 final PR cleanup 2019-09-05 16:11:58 -04:00
Ken Stevens 14fadd3004 fix drop foreign key task 2019-09-05 15:51:38 -04:00
Ken Stevens fa62ab9c9e Merge remote-tracking branch 'remotes/origin/master' into ja_20190822_1440_infinispan_query_cache
# Conflicts:
#	hapi-fhir-jpaserver-migrate/src/main/java/ca/uhn/fhir/jpa/migrate/tasks/HapiFhirJpaMigrationTasks.java
#	src/changes/changes.xml
2019-09-04 13:31:00 -04:00
Diederik Muylwyk ea19b46f60 Added an indexed order column to TermValueSetConcept for improved fetching. 2019-09-03 20:36:16 -04:00
Diederik Muylwyk b42b598d01 Added pre-fetch for concept designations, improved paging for expanded ValueSets, and columns on TermValueSet for number of concepts and designations. 2019-09-03 16:02:28 -04:00
Ken Stevens 259426b0dd Merge remote-tracking branch 'remotes/origin/master' into ja_20190822_1440_infinispan_query_cache
# Conflicts:
#	hapi-fhir-jpaserver-migrate/src/main/java/ca/uhn/fhir/jpa/migrate/tasks/HapiFhirJpaMigrationTasks.java
#	src/changes/changes.xml
2019-08-28 10:37:17 -04:00
Diederik Muylwyk 890555a77d Incremental work on large ValueSet expansion support; transaction boundaries need to be broken up. 2019-08-23 11:46:32 -04:00
James Agnew 6fa27934a8 Tests all seem to be working 2019-08-23 10:14:13 -04:00
James Agnew 9428430822
Add support for Resource.meta.source (#1438)
* Work on indexing source

* Work on tests

* Refactor query count tests

* Unit test fixes

* Add some tests

* DAO fix

* Fix compile error

* Unit test fix

* Cleanup

* Test fix

* Fix compile error

* One more test fix
2019-08-21 11:17:43 -04:00
jamesagnew e1b43d811f Version bump to 4.1.0-SNAPSHOT 2019-08-14 14:06:06 -04:00
jamesagnew 3f22456b0f Bump version to 4.0.0 2019-08-14 11:06:26 -04:00
Ruslan_Zinovyev a839a645db Skip ModifyColumn migration tasks for columns that don't exist 2019-08-12 17:19:25 -04:00
Ken Stevens af9fc882c1 fix log message 2019-08-01 19:11:06 -04:00
Ken Stevens f05d212a40 Fixed a data migration error KHS & DM 2019-08-01 17:22:18 -04:00
Diederik Muylwyk 8475aa4cc8 Add TRM_CODESYSTEM_VER.CS_DISPLAY to migration tool. 2019-08-01 14:44:03 -04:00
Diederik Muylwyk 78842164fd Addressing review comments. 2019-08-01 13:37:46 -04:00
Diederik Muylwyk a8489f4331 Added TRM_VALUESET.EXPANSION_STATUS column, index, fields to entity, and migration tasks. 2019-07-29 19:30:46 -04:00
James Agnew 7e3d062d15
Switch default client to JSON (#1392)
* Start work on changing over

* Update tests

* More test fixes

* Work on generalizing binary access provider a bit

* Add expunge capability to binary storage, and also support actual binary
resources

* Work on binary provider

* Get the DB bound binary storage service working

* Test fixes

* Compile fix

* Fix compile error

* Test fix

* Test tweak

* Trying to figure out an intermittent failure

* Work on tests

* More work on tests

* Another test fix
2019-07-22 21:27:10 -04:00
James Agnew 03918fe29a Add some javadoc 2019-07-19 13:42:01 -04:00
James Agnew d304a8fb6c Add a safety check to rename column task 2019-07-19 12:13:35 -04:00
James Agnew 6ff8484914 One migrator tweak 2019-07-19 10:17:42 -04:00
James Agnew f53746cd63 One more set of migrator tweaks to account for latest changes 2019-07-19 10:10:00 -04:00
James Agnew fd23190b4c Fix on drop table task 2019-07-19 09:38:13 -04:00
James Agnew cf68efb826 Add drop table task to migrator 2019-07-19 09:33:01 -04:00
James Agnew ee7cff9445 Rename a few columns to not conflict with res´rved words 2019-07-18 05:47:32 -04:00
Diederik Muylwyk 456aac5e16
Resolve "experimental implementation for storing and expanding large ValuetSets cont'd..." (#1376)
* Added experimental implementation for storing expanded ValueSets in terminology tables.

* Minor tweak to log message for consistency.

* Another minor tweak to log message for consistency.

* Renamed test.

* Initial work on ValueSetCodeAccumulator.

* Renamed addCode() to includeCode(); added excludeCode().

* Incremental work on large ValueSet expansion support; refactoring.

* Incremental work on large ValueSet expansion support; accounting for designations.

* Incremental work on large ValueSet expansion support; fixed missing designation.language in expanded ValueSets.

* Incremental work on large ValueSet expansion support; now actually populating TermConceptDesignation; added TermValueSetConceptDesignation as well.

* Missed a word.

* Tweak changelog entries.
2019-07-16 17:12:21 -04:00
James Agnew 120b93f204
Use HL7 FHIR Core Structures (#1382)
* Ongoing work on core structures suport

* Ongoing work on this merge

* Ongoing work to clean up structures

* Credit for #1179

* Address compile issues

* Latest changes

* Work on parallel execution

* Work on getting tests passing

* Add H2 to migrator

* Test fix
2019-07-14 10:16:40 -04:00
Ken Stevens 8d817b364c Merge remote-tracking branch 'remotes/origin/master' into expunge-hooks
# Conflicts:
#	hapi-fhir-jpaserver-base/src/main/java/ca/uhn/fhir/jpa/dao/expunge/ExpungeEverythingService.java
2019-07-12 13:27:11 -04:00
Diederik Muylwyk 0729e38e6e
Resolve "experimental implementation for storing expanded ValueSets in terminology tables" (#1369)
* Added experimental implementation for storing expanded ValueSets in terminology tables.

* Minor tweak to log message for consistency.

* Another minor tweak to log message for consistency.

* Renamed test.

* Addressing review comments.

* Added migration tasks.
2019-07-11 16:52:19 -04:00
jamesagnew dff2fdd3cf GET RID OF TRAILING LICENSE HEADER SPACES ONCE AND FOR ALL
YESSSSSSSSSSSSS
2019-07-05 11:19:51 -04:00
jamesagnew f160fbb36f License updates 2019-07-05 10:24:56 -04:00
James Agnew 2a6436af23 Rename columns in code mapping 2019-07-05 09:03:03 -04:00
jamesagnew b72f1c4555 Roll back derby upgrade 2019-06-08 09:27:28 -04:00
James Agnew 517b68882c Fix derby dependencies for tests 2019-06-07 11:11:25 -04:00
James Agnew 78e6a7ba6f Add suport for float type to migrator 2019-06-06 09:21:17 -04:00
James Agnew 50a8c66bf5 Version bump to 4.0.0-SNAPSHOT 2019-05-30 17:13:03 -04:00
jamesagnew 73aa53be8f Release 3.8.0 2019-05-30 16:50:04 -04:00
James Agnew c7a224c99d
Merge branch 'master' into upgrade-25-to-33 2019-05-29 21:33:02 -04:00
James Agnew 37b9e1a42c Improve validation of enableWhen questionnaires 2019-04-29 14:43:42 -04:00
James Agnew 738c2c1797
Interceptor framework refactoring (#1287)
Interceptor framework overhaul
2019-04-24 14:32:30 -04:00
James Agnew 75b6857902 Add ability to execute arbitrary SQL to migrator tool 2019-04-04 09:24:51 -04:00
jamesagnew 1311ded7de Fix compile issue 2019-02-15 14:55:25 -05:00
James Agnew 09920ad545 Reduce thread contention during tests 2019-02-15 14:18:34 -05:00
James Agnew c4dd06ad0c Make it easier to add tables with migrator tools 2019-02-15 13:27:07 -05:00
James Agnew 4a6345d7c4 Improve command chaining in migrator tool 2019-02-15 12:54:41 -05:00
James Agnew 0f8c8d18e2 Bump version to 3.8.0-SNAPSHOT 2019-02-06 20:02:28 -05:00
jamesagnew 207015c3af Version bump to 3.7.0 2019-02-05 21:36:38 -05:00
James Agnew a2d0168671 Fix handling of sequences in migrator tool 2019-01-15 11:31:18 -06:00
jamesagnew 98d93df12a License header updates 2019-01-04 16:22:15 -05:00
jamesagnew 49e418edf0 Adjust migrator to handle updated Hibernate version 2018-12-23 15:11:44 -05:00
James Agnew a0cb7edd08 Version bump a few dependencies 2018-12-22 20:13:03 -05:00
James Agnew 5824826eff Add support for booleans in the migrator 2018-12-20 10:24:17 -05:00
jamesagnew 86b3e45a32 License header updates 2018-12-18 14:08:01 -05:00
James Agnew 11b8304cb4 Fix case sensitivity issue 2018-12-13 08:31:35 -05:00
Graham, Gary 4fea74cfa2 Fix incorrectly grabbed table 2018-12-13 00:49:17 -05:00
Graham, Gary a01d6cf302 Add init330() to migrate from 2.5 -> 3.3 2018-12-12 21:00:41 -05:00
James Agnew 8c7f249a21 Migrator enhancements and adjust reindexer to account for missing
versions
2018-12-04 17:33:29 -05:00
Ken Stevens 6baee4dc3f
Standalone subscription (#1125) 2018-11-30 17:19:16 -05:00
James Agnew b2179b1696 Syntax fixes for the JPA migrator 2018-11-30 12:39:37 -05:00
James Agnew 650872cd3e Address SQL syntax issue 2018-11-29 08:37:50 -05:00
jamesagnew cc57bacab8 Version bump to 3.7.0-SNAPSHOT 2018-11-12 10:07:28 -05:00
James Agnew 63af04a7b4 Prepare for 3.6.0 release 2018-11-12 05:40:55 -05:00
jamesagnew 896568c0f7 License updates 2018-11-04 16:06:53 -05:00
James Agnew bc72093555 Add reindexing support based on table instead of column 2018-11-04 20:00:27 +01:00
jamesagnew 8c2d868f16 License updates 2018-11-01 16:13:34 -04:00
James Agnew 9906243d2d More migrator updates 2018-11-01 13:58:09 -04:00
James Agnew c8834cd29a Merge branch 'philips-3.6.0' of github.com:jamesagnew/hapi-fhir into philips-3.6.0 2018-10-31 17:19:28 -04:00
James Agnew 721c1cd405 Drop column that should have been dropped in 3.4 to 3.5 migration 2018-10-31 16:47:40 -04:00
jamesagnew 8955a9e54d Add threading to migrator 2018-10-31 05:50:50 -04:00
James Agnew 8b46257423 Add warm cache module 2018-10-14 09:32:07 -04:00
James Agnew eb7b5ca02a One more missing index 2018-10-12 11:07:15 -04:00
James Agnew 7665e472ad Add missing migration task 2018-10-12 11:02:01 -04:00
jamesagnew 970c48ec37 A bit more test cleanup 2018-10-04 13:29:09 -04:00
James Agnew 9d1e8aa246 Merge branch 'master' of github.com:jamesagnew/hapi-fhir 2018-10-01 21:36:52 -04:00
James Agnew 12b23fbf23 Make JPA searches more efficient by prefetching a much smaller number of
resources
2018-10-01 21:36:10 -04:00
jamesagnew caf7c8b2e1 Header updates 2018-10-01 17:04:50 -04:00
James Agnew 3e445faf47 Squashed commit of the following:
commit df641506885e09e63f80efc6c658d01a1a3a8142
Author: James Agnew <jamesagnew@gmail.com>
Date:   Sat Sep 29 13:47:22 2018 -0400

    Shrink validation resources

commit 4c1550eafa26f4235b4b8804741aecc03276b5c6
Author: James Agnew <jamesagnew@gmail.com>
Date:   Fri Sep 28 22:45:28 2018 -0400

    Updates to get R4 working

commit 8332f15291006691ed9b07ead3e3524b0fc85510
Author: jamesagnew <jamesagnew@gmail.com>
Date:   Fri Sep 28 09:02:13 2018 -0400

    Ongoing work on gettign R4 working

commit f7146cab7aed937bb625a8aec95744d76db00041
Author: James Agnew <jamesagnew@gmail.com>
Date:   Fri Sep 28 05:21:01 2018 -0400

    More work on sync

commit f48de4a10b1bab2584fee813017d9b27b237bfa9
Merge: 9e4f3cc722 aacb78b779
Author: James Agnew <jamesagnew@gmail.com>
Date:   Thu Sep 27 20:11:29 2018 -0400

    Merge branch 'sync_r4' of github.com:jamesagnew/hapi-fhir into sync_r4

commit 9e4f3cc722668aae31a77b19bf9b032af3ae01b0
Author: James Agnew <jamesagnew@gmail.com>
Date:   Thu Sep 27 20:11:19 2018 -0400

    Fix compile error

commit 7ec29e0ceda8f9013cbabb95767cbe15b4b81303
Merge: 23f7517325 002c4b3ff7
Author: James Agnew <jamesagnew@gmail.com>
Date:   Thu Sep 27 20:04:23 2018 -0400

    Merge branch 'master' into sync_r4

commit aacb78b7793ab2c71e0a2a774240ee2b5d3f9e7f
Author: jamesagnew <jamesagnew@gmail.com>
Date:   Thu Sep 27 20:01:42 2018 -0400

    Keep working on getting R4 building

commit 4950de46d99897e74d41dfdb10d3d8a3435cb0c9
Author: jamesagnew <jamesagnew@gmail.com>
Date:   Tue Sep 25 13:11:27 2018 -0400

    Ongoing work to get R4 working

commit 819d69c20e112dd3c72569ec50114ddb8263c300
Author: jamesagnew <jamesagnew@gmail.com>
Date:   Thu Sep 20 08:15:36 2018 -0400

    Work on getting build working

commit 2c61b6cd1205ced5d7b822cf10942c69272ea078
Merge: 16b5bb06c8 dfb4de86f1
Author: jamesagnew <jamesagnew@gmail.com>
Date:   Thu Sep 20 05:16:53 2018 -0400

    Merge branch 'master' into sync_r4

commit 16b5bb06c8cdaf8d67c3b80f5aa9be9fccd99aef
Author: jamesagnew <jamesagnew@gmail.com>
Date:   Mon Sep 17 05:30:39 2018 -0400

    Work on R4 sync

commit 23f7517325a14dd2ca1eb5641296ead2776634ae
Author: James Agnew <jamesagnew@gmail.com>
Date:   Sun Sep 16 10:19:00 2018 -0400

    Work on sync

commit 6cc413c1f1dea538295aa4c16c21a5677494ac4c
Author: James Agnew <jamesagnew@gmail.com>
Date:   Fri Sep 14 17:28:28 2018 -0400

    Work on R$ sync

commit df6f6ad2ce783b07ccc383134705d874bc5d2cf1
Author: jamesagnew <jamesagnew@gmail.com>
Date:   Fri Sep 14 08:33:07 2018 -0400

    Work on R4
2018-09-29 13:48:35 -04:00
James Agnew dc4c0809a4 Automatically detect suitable database drivers 2018-09-25 09:58:08 -04:00
James Agnew 27137ef5b1 Merge branch 'master' of github.com:jamesagnew/hapi-fhir 2018-09-19 10:25:20 -04:00
James Agnew 706e004b9d Bump to 3.6.0-SNAPSHOT 2018-09-19 10:24:48 -04:00
jamesagnew 65fc66466c Deploy the migrator tool 2018-09-19 08:07:22 -04:00
jamesagnew 3bfce11d2c Add OSGI dependency for commons-text 2018-09-17 16:06:11 -04:00
James Agnew 7bbe33cffc Finalizing 3.5.0 release 2018-09-17 16:04:52 -04:00
James Agnew 664fd2fede Correct foreign key upgrading on PG 2018-09-17 14:37:49 -04:00
James Agnew 125176cd75 Add indexes 2018-09-17 14:34:35 -04:00
James Agnew efe2b8e93d Correct PG migrator syntax 2018-09-17 13:52:22 -04:00
James Agnew 798982773a Restore old driver logic 2018-09-17 13:46:21 -04:00
James Agnew fd5854ea85 Migrator enhancements 2018-09-17 13:33:44 -04:00
James Agnew c34dfda413 Update migration tasks 2018-09-17 13:19:40 -04:00
James Agnew 44dccb8e3f Migrator 2018-09-17 12:53:44 -04:00
James Agnew 2dc6159af5 Fix drop column command 2018-09-17 11:35:05 -04:00
James Agnew 7e4d6afc5f Migrator enhancements 2018-09-17 09:24:04 -04:00
James Agnew bb7fca19a3 Work on migrator 2018-09-14 08:34:39 -04:00
James Agnew daef975734 Version bump to 3.5.0 2018-09-08 07:22:21 +08:00
James Agnew 4852b0b60f Work on migration 2018-09-08 07:14:43 +08:00
James Agnew f5d567cd00 Work on migrator 2018-09-08 03:30:35 +08:00
James Agnew 77305eb570 Work on migrator 2018-09-04 10:32:08 +08:00
James Agnew 07cfed14b8 Work on migrator 2018-08-27 08:21:20 -04:00
jamesagnew 1ff8f45a3e Start working on migrator 2018-08-26 12:29:05 -04:00
jamesagnew 67fede9eda Start work on migrator 2018-08-23 05:24:13 -04:00