Commit Graph

772 Commits

Author SHA1 Message Date
Tadgh 9e20d62380
Issue 3237 delete expunge performance (#3239)
* Initial test looking for bad deletes

* Add indexes, add migration, add test'

* Fix npe

* Add provider test

* fix up comments, tighten test

* Update hapi-fhir-jpaserver-base/src/main/java/ca/uhn/fhir/jpa/delete/job/DeleteExpungeProcessor.java

Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>

* Add changelog

* Remove unnecessary migration

Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>
2021-12-15 06:53:26 +00:00
Tadgh 50a3005c23
Fix flag name (#3247)
* Fix flag name

* Bump hapi version
2021-12-14 19:20:03 +00:00
longma1 a56603daa2
2480 partition aware subscription (#3218)
* some fixmes to start

* Added some FIXMEs

* added RequestPartitionId to reosurceDelivryMessage and ResourceModifiedMessage

* ResourceDeliveryMessage and ResourceModifiedMessage tests

* fixed issue with test missing partitionHelperSvc mocked bean

* Added tests and implemented SubscriptionMatchingSubscriber for partition aware subscription

* modified implementation of partitionId in CanonicalSubscription

* Moved PartitionablePartitionId, and refactored all calls to getUserData(Constants.RESOURCE_PARTITION_ID) and setUserData(Constants.RESOURCE_PARTITION_ID)

* Revert "Moved PartitionablePartitionId, and refactored all calls to getUserData(Constants.RESOURCE_PARTITION_ID) and setUserData(Constants.RESOURCE_PARTITION_ID)"

This reverts commit fe40fb9733.

* Got added partitionId to subscriptions, added changes to make SubscriptionMatchingSubscriberTest work

* added SubscriptionTriggering test, also added partition support to subscriptionLoader

* Changed implementation for storing partition id of subscriptions from messages, refactored tests to new implementation

* added all subscription systemRequestDetails with all partition to subscription reader

* refactored a generic system request details with default all partition request

* Added test for dao subscriptions, fixes to get the test working

* added partition support for latest version delivery

* added doc changes and changelog for multitenancy subscription

* cleanup and added partitioned subscription manually trigger test

* fixed mocked subscriptionDao

* added package-info for subscription module

* some code review changes

* removed AllPartitionSystemRequestDetail, added new text for multitenant subscription

* renamed method for code review

* version bump to 5.7.0PRE7

Co-authored-by: Michael Buckley <michael.buckley@smilecdr.com>
Co-authored-by: Ken Stevens <khstevens@gmail.com>
Co-authored-by: Long Ma <long@smilecdr.com>
Co-authored-by: Steven Li <steven@smilecdr.com>
2021-12-13 08:45:30 -07:00
VK-SMILECDR bd89cf022b
Improve mail service (#3230)
* move mail config to mail service constructor

* update subscription email sender

* added license text

* [2669] bump HAPI version to 5.7.0-PRE6-SNAPSHOT

* add changelog
2021-12-09 17:05:42 -05:00
Ken Stevens 9753b66610
2564 contained resource validation flag (#3225)
* First cut at multithreading bundle validation

* javadoc

* change test to a red-green test

* add daoconfig

* move bundle concurrency config from validationsupport to request validator

* Moved concurrent details from ValidationOptions to FhirValidator

* Remove bundleValidationThreadCount (it's set by creating an appropriate executor)

* validate threadpool prefixes

* FIXME cleanup

* reassign FIXMEs to JB

* only create the threadpool if it will be used

* Add the MdcTaskDectorator to all threadpools

* Add bundle path to concurrently validated bundle resource validation messages.

* Add test to check bundle entry path being added to validation messages

* Threaded validation of contained resources initial checkin

* FHIR validator refactored to maintain correct bundle path and async validation task

* Refactored to use validation complete invoke callback to support raw string resource or resource object

* switch from XML to JSON

* # Conflicts:
#	hapi-fhir-base/src/main/java/ca/uhn/fhir/validation/FhirValidator.java
#	hapi-fhir-validation/src/test/java/org/hl7/fhir/r4/validation/FhirInstanceValidatorR4Test.java

* Updated to use new HAPI-FHIR version

* merge 'validate_contains_change' into issue-3144-multi-threaded-bundle-validation

* Updated to use new HAPI-FHIR version

* Revert "Updated to use new HAPI-FHIR version"

This reverts commit 910b7f676b.

* Revert "merge 'validate_contains_change' into issue-3144-multi-threaded-bundle-validation"

This reverts commit c7d60fc3e6.

* Revert "Updated to use new HAPI-FHIR version"

This reverts commit aa8a7af455.

# Conflicts:
#	hapi-fhir-validation/src/test/java/org/hl7/fhir/r4/validation/FhirInstanceValidatorR4Test.java

* Fix Test dependencies after reverting changes.

* merge 'validate_contains_change' to 2564-contained-resource-validation-flag

* Disable threadpool prefix name validate check.

* merge master

* fix thread regexp

* pre-review cleanup

* change log

* fix test

* revert to XML as default validation serialization

* fix test

* fix test

Co-authored-by: Jaison B <jaisonb@gmail.com>
2021-12-08 15:18:54 -05:00
Ken Stevens 3397bb6da3 remove reflection from test. 2021-12-06 11:19:50 -05:00
Ken Stevens 0dc6339f64 Merge branch 'master' of github.com:hapifhir/hapi-fhir 2021-12-06 08:55:47 -05:00
Ken Stevens 7e04509f4c add test for authorization 2021-12-05 19:31:19 -05:00
James Agnew d072357c2a
Move graphql provider (#3214)
* Move graphql provider

* Version bump
2021-12-05 17:22:20 -05:00
jmarchionatto d496ca98ad
Issue 3172 support member match operation (#3187)
* Suppress unresolved maven properties errors to avoid IntelliJ complains

* Support for $member-match operation

* Add more reference cases

* Adjust tests

* Add test and handle missed condition

Co-authored-by: juan.marchionatto <juan.marchionatto@smilecdr.com>
2021-11-26 14:20:14 -05:00
Tadgh 41ef7cf961
Support multiple EID systems for MDM. (#3178)
* Add implementation, changelog, docs, and tests

* Fix potential NPE

* Use constant instead of *
2021-11-24 06:05:13 +00:00
TipzCM 5cefa7a6cc
3168 added some nullcheck (#3169)
Co-authored-by: leif stawnyczy <leifstawnyczy@leifs-MacBook-Pro.local>
2021-11-15 20:30:41 +00:00
TipzCM 25c025cdee
3153 update unknowncodesystemwarningvallidationsupport to have configurable severities (#3155)
* 3153 updating the unknowncodesystemwarningvalidationsupport class

* 3153 updating version for smile

* 3153 update broken tests

* 3153 adding log

* 3153 cleanup

* 3153 cleanup

Co-authored-by: leif stawnyczy <leifstawnyczy@leifs-MacBook-Pro.local>
2021-11-10 16:06:09 -05:00
James Agnew 106eb75dc6
Allow GraphQL to work with RequestValidatingInterceptor (#3145)
* Allow GraphQL to work with RequestValidatingInterceptor

* Add test

* Add changelog
2021-11-08 17:47:56 -05:00
TipzCM 59bf8b836f
Issue 3120 support adding retry extension (#3137)
* issue-1134 initial work on adding retry handler

* issue-1134 subdscription creation fixes

* issue-1134 update the test

* issue-1134 retry policy off canonicalsubscription

* issue 1134 base subscription changes

* add failing test

* issue 1134 retry configs on base parameters

* issue 1134 passing forward params

* issue-1134 added more tests for making sure subscriptions create their channels correctly

* issue-1134 updates to get the retry to channels

* issue-1134 updating channel factory

* issue-1134 remove the dlq since it's not defineable

* issue-3120 changelog added

* issue-3120 cleaning up

* issue-3120 test fix

* issue-3120 review fixes

* issue-3120 fixed bad master merge

* issue-3120 updates for new release

Co-authored-by: leif stawnyczy <leifstawnyczy@leifs-MacBook-Pro.local>
Co-authored-by: Ken Stevens <khstevens@gmail.com>
2021-11-03 18:21:10 -04:00
Tadgh a10c58e839
Bump version, add version to versionenum (#3135) 2021-11-02 09:40:56 -04:00
Tadgh 7c63441663
Revert "Issue 1134 retry mechanic on subscriptions (#3121)" (#3128)
This reverts commit 9b23e9e825.
2021-10-30 19:46:42 +00:00
TipzCM 9b23e9e825
Issue 1134 retry mechanic on subscriptions (#3121)
* issue-1134 initial work on adding retry handler

* issue-1134 subdscription creation fixes

* issue-1134 update the test

* issue-1134 retry policy off canonicalsubscription

* issue 1134 base subscription changes

* add failing test

* issue 1134 retry configs on base parameters

* issue 1134 passing forward params

* issue-1134 added more tests for making sure subscriptions create their channels correctly

* issue-1134 updates to get the retry to channels

* issue-1134 updating channel factory

* issue-1134 remove the dlq since it's not defineable

* issue-3120 changelog added

* issue-3120 cleaning up

* issue-3120 test fix

* issue-3120 review fixes

* issue-3120 fixed bad master merge

Co-authored-by: leif stawnyczy <leifstawnyczy@leifs-MacBook-Pro.local>
Co-authored-by: Ken Stevens <khstevens@gmail.com>
2021-10-29 11:21:43 -04:00
James Agnew 5f672bc9e8
Deprecate redundant BaseResourceModifiedMessage myId (#3116)
* Deprecate redundant BaseResourceModifiedMessage myId

* Add changelog

* Test fix

* Test fix
2021-10-28 07:55:46 -04:00
tarekmamdouh 2db1fe2c93
Add support for generic types in synthetic classes such as weld proxies (#2589) (#2754)
Co-authored-by: Tarek Ahmed <tarek.ahmed@agfa.com>
2021-10-27 05:54:52 -04:00
Tadgh b427135b04
Patient/$everything _id parameter (#3077)
* Add tests. Add implementation in R4. Add changelog

* Wip partial fixup of other STU versions

* Updated usages of new patient type everything api

* Partial commit of incomplete documentation

* Remove docs

* Cut to token instead of string

* Bump hapi version due to breaking api changes
2021-10-17 14:34:33 +00:00
James Agnew 310a4cdb58
Migrate CLOB columns to LOB (SMILE-3072) (#3016)
* Migration finished

* Work on LOBS

* Add to ClobMigrated annotation

* Deal with lobs

* Work on new approach

* HAPI FHIR version bump

* Add changelog

* Add license header

* Fix intermittent

* CLeanup

* Cleanup
2021-10-11 16:47:37 -04:00
James Agnew aed718bd6f
Avoid redundant PID lookups in transaction processing (#3061)
* Avoid redundant PID lookups in transaction processing

* Add changelog

* Test fix
2021-10-11 13:45:57 -04:00
katiesmilecdr 3c80dba90e
[3040] finish implementation (#3049)
* [3040] finish implementation

* Update hapi-fhir-docs/src/main/resources/ca/uhn/hapi/fhir/docs/server_jpa_mdm/mdm_operations.md

Co-authored-by: Tadgh <tadgh@cs.toronto.edu>

* Update hapi-fhir-docs/src/main/resources/ca/uhn/hapi/fhir/docs/server_jpa_mdm/mdm_operations.md

Co-authored-by: Tadgh <tadgh@cs.toronto.edu>

* Update hapi-fhir-docs/src/main/resources/ca/uhn/hapi/fhir/docs/server_jpa_mdm/mdm_operations.md

Co-authored-by: Tadgh <tadgh@cs.toronto.edu>

* [3040] throw exception if link exists

* [3040] add matchResult parameter/update documentation

Co-authored-by: Tadgh <tadgh@cs.toronto.edu>
2021-10-07 17:42:21 +00:00
James Agnew eca725afa4
Improve versioned URL support for ValueSet expansion (#2994)
* Add test

* Test fixes

* Work on expansion errors

* Fixes

* Test fixes

* Test fixes

* Test fixes

* Test fixes

* Test fixes

* Test fixes

* Test fixes

* Work on fix

* Test fixes

* Test fixes

* Test fix

* Cleanup

* Test fixes

* Remove accidental commit

* Test fixes

* Version bump

* Add changelog

* Fixes

* Test fix

* Fix conflicts
2021-10-03 19:47:23 -04:00
Jason Roberts 58a2f23c0d Merge branch 'master' into jr-20210922-narrowing-interceptor 2021-09-28 07:41:39 -04:00
Jason Roberts 626c6f855c handle queries on bare ids without explicit types 2021-09-24 14:57:05 -04:00
Jason Roberts 4a53d10c78 Merge branch 'master' into jr-20210922-narrowing-interceptor 2021-09-24 14:39:10 -04:00
katie_smilecdr 8c145d1212 Merge branch 'master' into 3020_Add_documentation_for_$partition-management-create-partition 2021-09-24 13:01:38 -04:00
Ken Stevens 53c7476dae
hapi storage (#3024)
* first pass moving core storage classes to storage-api

* move term service apis

* nearly done

* rename hapi-fhir-storage-api to hapi-fhir-storage and move transaction processor

* rename hapi-fhir-storage-api to hapi-fhir-storage and move transaction processor

* create new SearchConstants class to store platform independent search constants

* move a couple of subscription services

* move transaction processor adapter to storage

* version bump

* move searchparam

* fix test

* fix compile includes

* fix text

* fix docs
2021-09-23 22:04:46 -04:00
katie_smilecdr 8bd14ae024 [3020] add $partition-management-lists-partitions 2021-09-23 16:08:56 -04:00
Jason Roberts 712a6a798f clean up 2021-09-23 12:27:32 -04:00
Jason Roberts 9e8164d73a check search parameters for synonyms 2021-09-23 10:03:24 -04:00
Jason Roberts e52d11b5ba search narrowing interceptor responds with 403 Forbidden instead of creating an impossible query 2021-09-22 14:00:12 -04:00
Tadgh a12ce73797 Add more tests 2021-09-21 15:31:36 -04:00
Tadgh b8ef2f6763 Add changes 2021-09-21 15:25:46 -04:00
James Agnew 7379dee3d8
Merge branch 'master' into add-device-to-patient-compartment 2021-09-21 14:38:39 -04:00
Ken Stevens 060791aeb4
hapi-fhir-storage-api (#3006)
* rename hapi-fhir-jpaserver-migrate to hapi-fhir-sql-migrate and move hapi-tasks into jpaserver-persistence

* rename hapi-fhir-jpaserver-api to hapi-fhir-storage-api

* move bulk import apis

* create hapi-fhir-jpa

* create hapi-fhir-jpa

* move CircularQueueCaptureQueriesListener to japi-fhir-jpa

* move mdm logs to storage-api

* move gziputil to storage-api

* move quartz scheduling to hapi-fhir-jpa

* move default subscription channel factory to storage-api

* consolidated batch constants

* correct accidental Logs change

* remove dependency of cdr-api on cdr-persistence

* fix javadoc

* pom descriptions

* review feedback
2021-09-21 15:36:08 +00:00
Tadgh 5bbe69cd31 Move into data class 2021-09-15 21:17:03 -04:00
Tadgh 171f0f8724 fix rulebuilder 2021-09-15 09:04:45 -04:00
Tadgh 9070aa3571 wip 2021-09-15 01:20:46 -04:00
Tadgh 0a9d5344e3 remove more NPE, fix old test 2021-09-14 02:10:34 -04:00
Tadgh fb8def21ae remove potential NPE 2021-09-14 02:08:42 -04:00
Tadgh 75a16f3b13 Add docs and changelog 2021-09-14 01:54:59 -04:00
Tadgh 3d24a4ce16 Refactor to support arbitrary additional SPs based on Type for a compartment 2021-09-14 01:02:19 -04:00
James Agnew 5554431146
Avoid dead SearchParameter links in CapabilityStatement (#2790)
* Avoid dead SearchParameter links in CapabilityStatement

* Resolve fixmes

* Build fix

* Test fix

* Test fix

* Test fix

* Work on metadata

* Fixes

* Test fixes

* Test fix

* Test fix

* Test fixes

* Test fix

* Work on test fixes

* Test fixes

* Test fixes

* Test fixes

* Test fix

* Fix params

* Resolve fixme

* Adjust changelogs

* Version bump to 5.6.0-PRE7

* Add license header

* Bump version to 5.6.0-PRE5-SNAPSHOT
2021-09-11 18:27:18 -04:00
Ken Stevens 4ab0f7076a remove problematic method 2021-09-09 09:29:45 -04:00
Ken Stevens 661ca02a6a revert clobbered code 2021-09-09 09:28:01 -04:00
Ken Stevens e77d84d008 fix test 2021-09-09 01:35:35 -04:00
Ken Stevens 5bc571d97d fix test 2021-09-09 01:00:12 -04:00
Ken Stevens 81abe26cda improve api 2021-09-08 20:08:06 -04:00
Tadgh 3ec47cb0ba Bump version as we break the localcontainerentitymanagerfactory bean constructors args 2021-09-07 13:58:22 -04:00
Ken Stevens 346e29920a
Issue 2927 convert mdm clear to spring batch (#2929)
* initial roughout of mdm clear batch job

* still roughing out classes

* finished first draft of reader

* most tests passing now

* all tests pass.  now FIXMEs

* FIXMEs done.  Time for regression.

* fix test

* changelog and docs

* fix test

* pre-review cleanup

* version bump

* move spring autowire deps for cdr

* move spring autowire deps for cdr

* finally got beans working phew

* rearrange method calls so persistence module can perform clear operation on its own

* Update hapi-fhir-docs/src/main/resources/ca/uhn/hapi/fhir/docs/server_jpa_mdm/mdm_operations.md

Co-authored-by: Tadgh <tadgh@cs.toronto.edu>

* review feedback

* review feedback

* Remove inheritance

* fix beans

Co-authored-by: Tadgh <tadgh@cs.toronto.edu>
Co-authored-by: Tadgh <garygrantgraham@gmail.com>
2021-09-03 14:58:19 -04:00
Tadgh 2fbe7d7443 Strip broken backport line 2021-08-23 16:39:19 -04:00
Tadgh 37ad73a422 Bump PRE version so we don't conflict downstream 2021-08-23 15:42:18 -04:00
Tadgh 1acaf325c5 Merge branch 'master' into rel_5_5_0 2021-08-23 14:50:29 -04:00
markiantorno 367b338d85 Updating HAPI to use latest core lib changes. 2021-08-18 11:06:14 -04:00
Tadgh cf917d0f82 Version Bump 2021-08-15 16:54:38 -04:00
Vadim Karantayer f68040aae9 fix SimpleJavaMail configuration username and password handling 2021-08-10 10:45:30 -04:00
VK-SMILECDR 1e0f843d6c
2852 - Simplify java mail code (#2874)
* testing

* [2852] adding SimpleJavaEmail

* [2852] refactor email sender code

* [2852] dependency cleanup

* [2852] add missing dependency

* [2852] add missing spring framework test dependency

* [2852] add change log

* [2852] add change log

* Update hapi-fhir-docs/src/main/resources/ca/uhn/hapi/fhir/changelog/5_5_0/2852-simplify-java-mail-code.yaml

Co-authored-by: Tadgh <tadgh@cs.toronto.edu>

* [2852] minor test code cleanup

* [2852] add more tests

Co-authored-by: Tadgh <tadgh@cs.toronto.edu>
2021-08-09 15:59:47 -04:00
Tadgh 4fadc62066 Bump Hapi Version 2021-08-06 13:44:04 -04:00
Ken Stevens f5dfc3a5ed
New reindex spring batch operation (#2845)
* first sweep to add new $reindex job

* first cut done.  next up integration test.

* start roughing out reindex everything

* Failing test

* test passes

* add BundleUtil helper method

* rough in processEverything

* rough in processEverything

* fix mock test

* merge master

* Make BaseJpaTest.mySrd lenient.

* fix test

* reindex everything works with FIXMEs

* reindex everything more tests

* moar tests

* moar tests

* fix test

* fix test

* fix regression and fix test

* fix test cycle

* fixme

* fix test

* test provider layer

* reindex everything partition aware

* yay last fixme!

* run reindex in partitioned threads

* add fixmes for areas that require extra testing

* added transaction and log message

* manual integration testing

* changelog

* reindex all partitions

* bump hapi version

* fix test

* moar test

* pre-review cleanup

* fix javadoc

* review feedback

* review feedback

* review feedback

* Update hapi-fhir-docs/src/main/resources/ca/uhn/hapi/fhir/changelog/5_5_0/2845-reindex-operation.yaml

Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>

* review feedback

* review feedback

* Update hapi-fhir-jpaserver-base/src/test/java/ca/uhn/fhir/jpa/delete/job/ReindexJobTest.java

Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>

* Update hapi-fhir-jpaserver-base/src/test/java/ca/uhn/fhir/jpa/delete/job/ReindexJobTest.java

Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>

* Update hapi-fhir-jpaserver-base/src/test/java/ca/uhn/fhir/jpa/provider/r4/MultitenantBatchOperationR4Test.java

Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>

* Update hapi-fhir-jpaserver-base/src/test/java/ca/uhn/fhir/jpa/provider/r4/MultitenantBatchOperationR4Test.java

Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>

* Update hapi-fhir-jpaserver-searchparam/src/main/java/ca/uhn/fhir/jpa/searchparam/ResourceSearch.java

Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>

* Update hapi-fhir-server/src/main/java/ca/uhn/fhir/rest/api/server/storage/IDeleteExpungeJobSubmitter.java

Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>

Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>
2021-07-29 19:18:49 -04:00
jamesagnew a5e6674e84 Version bump to 5.5.0-PRE7-SNAPSHOT 2021-07-22 08:41:16 -04:00
James Agnew 6d37749be8
Add non unique combo search params (#2809)
* Start work on nonunique combo search params

* Work on SQL

* Version bump

* A fix

* Test fixes

* Fixes

* Undo version bump

* Test fixes

* Resolve fixme
2021-07-21 19:14:14 -04:00
jamesagnew 9f77c57e5a Widen access for utility methods 2021-07-20 17:30:26 -04:00
Nick Goupinets 7d4c39b953 Fixed bug 2021-07-02 18:18:10 -04:00
Tadgh cfcc939caa Fix broken tests, add license 2021-07-01 18:28:29 -04:00
Tadgh de84e3f98d add test for restfulserverutil link generation 2021-07-01 17:02:44 -04:00
Tadgh f66f9b992e Bump pre-version as this will break downstream implementations 2021-06-30 15:37:19 -04:00
Tadgh d407501071 More docs 2021-06-30 15:04:05 -04:00
Tadgh 61260dd1b1 Slightly more portable solution for paging 2021-06-30 11:54:59 -04:00
Ken Stevens 795fb31a3a
fixed mdm rules (#2764)
* fixed mdm rules

* changelog

* review feedback jetbrains

* review feedback
2021-06-28 23:24:37 -04:00
Ken Stevens 9500a1a7de
fix false rule matches (#2762)
* fixed an issue with matching compartments to lists of ids

* change log

* Added extra guards against false rule matches.

* changelog

* fix inCompartment

* cleanup
2021-06-27 10:34:32 -04:00
Ken Stevens 5565bf9930
fixed an issue with matching compartments to lists of ids (#2761)
* fixed an issue with matching compartments to lists of ids

* change log
2021-06-26 20:24:28 -04:00
Ken Stevens ea98e62656
collapse multiple owners for same compartment into shared compartment (#2760)
* collapse multiple owners for same compartment into shared compartment

* changelog

* fix regression

* fix regression

* pre-review cleanup

* pre-review cleanup
2021-06-26 11:48:47 -04:00
James Agnew 7185089c9d
Add forced offset search JPA interceptor (#2756)
* Add support for offset searches

* Tests working

* Add changelog

* Test fixes

* Test fix

* More test fixes

* Add commit counter
2021-06-25 10:40:39 -04:00
James Agnew 6ea1438f1d
Add transaction write semaphore interceptor (#2743)
* Add transaction write semaphore interceptor

* Add changelog

* Test fix
2021-06-20 12:55:49 -04:00
James Agnew 8b205b23d0
Fix history paging (#2741)
* Fix history paging

* Add changelog

* Add license header
2021-06-18 17:47:51 -04:00
Ken Stevens 134631fdee
Convert delete expunge to use Spring Batch (#2697)
* prepare to add $delete-expunge operation that will create a spring batch job

* Add operation

* Wire up jpa provider.  Begin with failing test.

* Copy/paste bulk import job as a starting point.
FIXME with proposed design

* delete expunge job parameter validation with test

* implemented reader
stubbed processor, writer

* wip for master merge

* started implementing reader

* started implementing reader

* working with stubs

* happy path batch delete expunge is done

* Provider done but test not passing.  Guessing batch infrastructure not running in that test.

* IT test works now

* add reader test

* Converted delete _expunge=true to use new batch job

* DeleteExpungeDaoTest passes

* Fix test

* Change batch size to integer

* rename search count to batch size

* Make delete expunge partition aware

* updated docs

* pre-review cleanup

* change log

* add partition id to SystemRequestDetails

* Make RequestPartitionId serializable

* Change delete expunge provider to use partition id instead of tenant name

* fix tests

* test pointcut gets called

* assert on pointcut calls

* Add resource type to STORAGE_PARTITION_SELECTED pointcut

* bump hapi-fhir version
move expunge provider parameters from JpaConstants to ProviderConstants

* bump hapi-fhir version

* copyrights

* restore deleteexpungeservice for mdm

* restore deleteexpungeservice for mdm

* fix test

* public constants

* convert instant to date

* Moved expunge constants to ProviderConstants

* final review

* disabling InMemoryResourceMatcherR5Test.testNowNextMinute() to see if I can get a clean test run

* fix tests

* fix tests

* fix tests

* fix tests

* review feedback

* review feedback

* review feedback

* review feedback

* review feedback

* review feedback

* improve logging

* bump version

* version bump

* recovering from failed merge

* unzip RequestListJson per Gary's suggestion.  I didn't want to do it at first, but as usual Gary was right.

* fix serialization
2021-06-15 10:36:05 -04:00
jamesagnew 376a84d213 Version bump 2021-06-14 13:12:34 -04:00
James Agnew b934abb297
Impropve transaction Performance (#2717)
* Work on changes

* Work on perf

* Work on testing

* Work on perf

* Work on perf

* Work on fix

* Work on perf

* Ongoing work

* Add changelog

* Additional docs

* Test fixes

* Address review comments

* Test fix
2021-06-14 13:08:19 -04:00
jmarchionatto 39d7d4ad03
Use pageSize variable to hold page size (#2719)
* Use pageSize variable to hold page size as previously used variable has other function, so not always hols intended value required for previous link

* Adjust test to standards and use RestfulServerExtension instead of own server

Co-authored-by: juan.marchionatto <juan.marchionatto@smilecdr.com>
2021-06-11 17:29:14 -04:00
James Agnew dc627dc019
Add bulk export authorization layer (#2712)
* Add bulk export authorization layer

* Add docs

* Version bump

* Authorize any

* Add bulk export - all

* Address lgtm issue
2021-06-06 20:47:43 -04:00
jamesagnew 4f6c1eaedb Add license header 2021-06-04 14:50:10 -04:00
Ken Stevens 94d6b15db9
_filter searchparam should not appear in cap stmt if disabled (#2706)
* issue reproduced and fixed

* changelog

* cleanup
2021-06-03 18:45:49 -04:00
Michael Buckley 4d6c35ac12 Hide constructor for static helper 2021-06-03 09:09:54 -04:00
Michael Buckley 80266a20a2 Pull request tracing out for sharing 2021-06-02 21:25:06 -04:00
James Agnew 1d2b47c9fb
Update endpoint validation interceptors (#2698) 2021-06-02 05:39:01 -04:00
jamesagnew f774653239 License header updates 2021-05-26 18:18:42 -04:00
James Agnew 7a83c76e65
Add validation suppression mode (#2675)
* Add validation suppression mode

* Add changelog

* Compile fix
2021-05-26 17:41:48 -04:00
ianmarshall f2627959c2 Add null check on code lookup result. 2021-05-24 22:09:44 -04:00
jamesagnew 926bf393d3 Merge branch 'rel_5_4' 2021-05-17 09:10:58 -04:00
Tadgh e6328dbcae Reflect move in comparison 2021-05-11 10:53:36 -04:00
Tadgh d6252526c3 Move member variable 2021-05-11 10:53:10 -04:00
Tadgh 424ec2118b Add implementation. Add test. Add changelog 2021-05-11 10:31:29 -04:00
jamesagnew 2068372998 Version bump 2021-05-07 17:43:54 -04:00
jamesagnew 63c4b22cd3 Undo bump 2021-05-07 17:42:50 -04:00
jamesagnew 17e41520a4 Version bump 2021-05-07 17:41:39 -04:00
Ken Stevens a4856bba17
fix iBundleProvider.getResources(from,to) throwing a NPE (#2632)
* fix iBundleProvider.getResources(from,to) throwing a NPE

* change log

* review feedback

* rename test to IT that has concurrency failures
2021-05-05 21:50:51 -04:00
James Agnew 970a9884f0
Avoid tag definition constraint (#2620)
* Avoid tag definition constraint failure

* Version bumps

* Add changelog

* Avoid guava issue

* Test fix

* Test fix

* Bump pom
2021-05-01 17:16:15 -04:00
Tuomo Ala-Vannesluoma fbca9f8060
Offset query fixes (#2579)
* Fix new searchbuilder limit similar to legacy searchbuilder

* Fix returning includes when using offset query

* Add unit tests for offset query with include

* Only use count param if offset is given (sometimes we want to search synchronously more if DAO is used directly)

* Throw if offset is tried to use with everything operations

* Do not offer offset paging for everything operations and fix tests to assert that
2021-04-30 19:01:27 -04:00
Nick Goupinets d67537231c Merge branch 'master' into 2566_update_s13n_and_validation_handling 2021-04-29 13:55:48 -04:00
Nick Goupinets d45972abed Added geo accuracy code 2021-04-29 11:46:09 -04:00
Nick Goupinets 4050c42bf4 Treating C addresses as valid 2021-04-28 15:31:34 -04:00
Nick Goupinets ae1c26afea Updated docs 2021-04-28 10:45:15 -04:00
James Agnew 95d7ba6fa8
Streamline Search SQLs (#2576)
* Streamline SQL queries

* SQL query tidying

* Add changelog

* Test fixes

* Tests passing

* Ongoing work

* Test fixes

* Test fixes

* Build fix

* Cleanup

* Fixes
2021-04-28 10:29:09 -04:00
Nick Goupinets 21d8cdfefc Merge branch 'master' into 2566_update_s13n_and_validation_handling 2021-04-28 10:16:27 -04:00
Nick Goupinets 418c1aa2c6 Added avc code to the interceptors 2021-04-28 10:15:38 -04:00
Tadgh ac1d4e3e4f
Merge pull request #2542 from hapifhir/issue-2534-new-tx-pointcut
Add new pointcut for transaction processing completed.
2021-04-27 18:42:19 -04:00
Nick Goupinets a1604c95c9 Updated address validating logic 2021-04-27 18:27:38 -04:00
Nick Goupinets 7cef07b0c1 Improved test coverage 2021-04-27 11:47:57 -04:00
Nick Goupinets 29722ad8ec Fixed exception handling 2021-04-27 10:14:30 -04:00
Nick Goupinets 024f553fc9 Merge branch 'master' into 2566_update_s13n_and_validation_handling 2021-04-27 09:31:42 -04:00
Nick Goupinets 82bf8cdc9d Code review updates 2021-04-27 09:29:08 -04:00
Jari Maijenburg 348198e7af
Made unknown operation exception return an OperationOutcome with issue code "not-supported" (#2384) 2021-04-27 08:39:17 -04:00
Nick Goupinets 08934d2364 Updated standardization logic and removed obsolete validator 2021-04-26 16:27:44 -04:00
Nick Goupinets f6ed93b343 Updated validation logic 2021-04-26 14:17:05 -04:00
Tadgh b200c10ced Merge remote-tracking branch 'origin/master' into issue-2534-new-tx-pointcut 2021-04-26 09:48:30 -04:00
James Agnew 2ba1005762
OpenAPI Support (#2560)
* Start work on OpenAPI

* Fixes

* Work on OpenAPI

* Cleanup

* Cleanup

* More swagger work

* Build fix

* More work

* More work

* Add documentation

* Docs fixes

* Add changelog

* License updates

* Add API

* Cleanup

* Update hapi-fhir-docs/src/main/resources/ca/uhn/hapi/fhir/docs/server_plain/openapi.md

Co-authored-by: patrick-vachon-smilecdr <81274188+patrick-vachon-smilecdr@users.noreply.github.com>

* Work on scripts

* Add docs

* Compile fix

* Work on fixes

* Fix tests

* Test fix

* Test fix

* Build fix

* Tests

* Build fix

* Work on pipeline

* Version bump

* Test fix

* Version bump

* Test fix attempts

* Test fix

* Test fix

* Remove accidentally committed files

* Fixes

* Tets fixes

* Test fix

* Test fix

* Test fix

* Test fixes

* Test fixes

* Test fixes

* License header updates

* test fix

* Test fixes

* Test fix

* Test fixes

* Test fix

* Checkstyle bump

Co-authored-by: patrick-vachon-smilecdr <81274188+patrick-vachon-smilecdr@users.noreply.github.com>
2021-04-25 15:40:50 -04:00
Nick Goupinets ac2aac4342 Updated address validation handling 2021-04-23 18:55:51 -04:00
Nick Goupinets 634522b405 Updated validation ext handling 2021-04-23 10:43:59 -04:00
Tadgh 596196b3e1 Add licenses 2021-04-23 09:08:41 -04:00
Nick Goupinets 902cd94ca2 Updated address and field validation handling 2021-04-22 16:55:34 -04:00
Nick Goupinets 961f16a1be Initial commit 2021-04-22 09:48:40 -04:00
Tadgh a5f81988fc Merge branch 'improve-bundle-builder' into issue-2534-new-tx-pointcut 2021-04-21 16:53:49 -04:00
Tadgh b7166735f9 Merge remote-tracking branch 'origin/master' into issue-2534-new-tx-pointcut 2021-04-21 12:13:54 -04:00
Tadgh ad8921ac4e Add docs, enum, remove prints 2021-04-21 10:39:23 -04:00
Nick Goupinets 4e266462ec Bumped up version due to breaking changes 2021-04-20 16:17:27 -04:00
James Agnew ca2088f3ad
Add framework for Bulk Import (#2538)
* Start work on bul;k import

* Work on bulk import

* Have batch working

* Working

* Working

* More work

* More work on bulk export

* Address fixmes

* License header updates

* Test fixes

* License header updates

* Test fix

* Test fix

* Version bumps

* Work on config

* Test cleanup

* One more version bump

* Version bump

* CLeanup

* A few additions

* Test fixes

* Test fix

* Test fix

* Migration fix

* Test fix

* Test fix
2021-04-14 17:41:32 -04:00
Tadgh 0bc61b72f7 Add new operation type for transcations 2021-04-14 14:04:00 -04:00
Tadgh 63c9e892b6 Fix up the hashmap provider 2021-04-13 11:12:26 -04:00
Tadgh f61d52d199 Should have realized that transactiondetails is an object reference, so we can't change it effectively 2021-04-13 09:26:05 -04:00
Tadgh 28c917b7a2 Flesh out holder object 2021-04-09 11:28:47 -04:00
Tadgh 8f30f7b0f2 Vague skeleton of pointcut 2021-04-09 11:08:47 -04:00
James Agnew edfe1ae8e6
Add lastupdated to capabilitystatement (#2530)
* Add lastupdated to capabilitystatement

* Test fix

* Test fix
2021-04-08 13:23:21 -04:00
James Agnew f70648484a
Avoid a deadlock uploading terminology in postgres (#2529)
* Fix #2493

* Try to fix intermittent test failure
2021-04-08 12:28:42 -04:00
James Agnew a6cbf7eebd
Add support for hierarchycal valueset expansion (#2525)
* Add support for hierarchycal valueset expansion

* Add changelog

* Add tests

* Cleanup

* Test fix

* Test fixes
2021-04-06 17:36:54 -04:00
James Agnew b617c7690d
Search Parameter Infrastructure Cleanup (#2522)
* Search param service cleanup

* Work on collapsing search param

* Search param cleanup

* Work on build

* Test fix

* Test fixes

* Ongoing work

* Test fix

* Compile fix

* Test fixes

* Test fix

* Test fix

* License header updates

* Remove fixme

* Cleanup

* Cleanup
2021-04-05 17:40:10 -04:00
James Agnew 0bf746f23b
Add support for revincludes to CapabilityStatement generator (#2521)
* Add support for revincludes to CapabilotyStatement generator

* Add changelog

* Fixes

* Test fix

* Test fixes

* Test fix

* Test fix

* More fixes to CS cache

* Test fix

* Test fix

* Test fix
2021-04-05 08:29:04 -04:00
jamesagnew 4eb9508e28 One more fix to interceptor 2021-03-30 11:47:03 -04:00
jamesagnew 8759cdae00 Additional cleanup 2021-03-30 08:20:14 -04:00
jamesagnew 06bdefa16c Improve error handling 2021-03-30 07:36:08 -04:00
James Agnew 049097e5b4
Improve CapabilityStatement Generation (#2511)
* Start work

* Work on testing

* Version bump

* Test fix

* Compile fix

* Test Fixes

* Test fix

* Test fix

* Compile fix

* Tst fix

* Test fix

* Test fix

* Test fix
2021-03-30 05:48:03 -04:00
Diederik Muylwyk b720c32c1d Version bump 2021-03-29 18:23:16 -04:00
Nick Goupinets 05c3ca2512 Merge branch 'master' into 2478_add_extension_mdm_matcher 2021-03-25 12:22:23 -04:00
Nick Goupinets bac2e58b90 Added null checks for the request details param 2021-03-24 10:50:26 -04:00
Tadgh 8785a51857 Remove janky interceptor hook 2021-03-23 19:50:05 -04:00
Tadgh a2ab3f5573 rethrow dataformatexception in case of TargetInvocationException 2021-03-23 19:49:06 -04:00
Tadgh 6f669f9ccd wip 2021-03-23 19:29:22 -04:00
Nick Goupinets 8ead3c5f22 Code review fixes 2021-03-23 15:01:22 -04:00
James Agnew dc41d5ad61
Add terminology mapping and display population interceptors (#2488)
* Start work on code mapping interceptors

* Work on generation

* Add terminology mapping and display population interceptors

* Add changelog

* License header updates

* Test fixes

* Fix typo

* Interceptor fixes

* License header update

* Test fixes

* Mapping fixes

* Version bump

* License header updates

* Add null tests

* Add null guard

* Intermittent fix
2021-03-21 12:03:57 -04:00
Nick Goupinets 04a0ecfc2b Added tests 2021-03-15 10:31:38 -04:00
Nick Goupinets 8b8bbcc91f Refactored based on the code review 2021-03-11 17:14:01 -05:00
Nick Goupinets 0013910c53 Removed commented code 2021-03-11 15:48:22 -05:00
Nick Goupinets 01b1210b8a Fixed NPEs on validation 2021-03-11 15:38:45 -05:00
Nick Goupinets 7f8ac36ce0 Headers 2021-03-09 17:31:04 -05:00
Nick Goupinets 9056c95865 Updated docs 2021-03-09 16:41:50 -05:00
Nick Goupinets 052919eb33 Finished tests 2021-03-09 16:17:13 -05:00
Nick Goupinets 02eae95c85 Merge branch 'master' into ng_validation_s13n_interceptors 2021-03-09 14:06:33 -05:00
James Agnew be50a46d76
Tweaks to contained searches (#2461)
* Tweaks to contained searches

* Add changelog

* Build fix
2021-03-09 11:51:30 -05:00
Nick Goupinets 6b387fa0a9 Removed fixme 2021-03-09 10:59:28 -05:00
Nick Goupinets 340341b3a4 Removed fixme 2021-03-09 10:50:09 -05:00
Nick Goupinets ed511565ae Fixing build failure 2021-03-09 09:54:57 -05:00
Nick Goupinets ccb5b1aaad Addresses #2449 2021-03-08 17:40:16 -05:00
James Agnew 3eda19c65a
Version bump (#2400)
* Version bump

* Docs changes

* Docs tweaks

* Docs tweak

* Spelling fixes

* Docs tweaks
2021-02-18 11:07:49 -05:00
jamesagnew 919c1dbddc Version bump to 5.3.0 2021-02-17 07:10:13 -05:00
James Agnew 65ac0e80fb
Add CapabilityStatement customizer (#2387)
* Add CapabilityStatement customizer

* Fix javadocs
2021-02-15 14:58:34 -05:00
Nick Goupinets 9c3f9f84d5
Initial implementation (#2381) 2021-02-12 05:47:49 -05:00
James Agnew dd7a156d19
Call startOperation for paging requests (#2370) 2021-02-09 15:47:11 -05:00
James Agnew c69d741b43
Add CapbilityStatement customizing hook (#2364)
* Add CapbilityStatement customizing hook

* Add additional method

* Interceptor service tweak
2021-02-07 09:12:09 -05:00
Tadgh fc148e9e53 Change name of mimetype to mediatype 2021-02-02 11:46:39 -05:00
James Agnew 0f31d106e5
Allow empty request details in JPA (#2343)
* Allow empty request details in JPA

* Test fixes
2021-02-02 11:00:14 -05:00
Kevin Dougan SmileCDR ca28a4fe6c
Add CQL evaluate-measure operation. (#2339) 2021-02-01 19:55:51 -05:00
Tadgh c5299df4d3 Use constant 2021-02-01 16:31:35 -05:00
Tadgh 5e36d71e41 fix mimetype 2021-02-01 13:43:47 -05:00
Tadgh 3cc9d08ebc Merge remote-tracking branch 'origin/master' into 2325-channel-import-mimetype 2021-01-29 11:02:54 -05:00
Nick Goupinets 3be480c9f0 Merge remote-tracking branch 'origin/master' into ng_20201218_survivorship_poc 2021-01-27 16:47:40 -05:00
James Agnew 909d9f742c
Enable Auto-reference versions in JPA (#2323)
* Automatic reference versions

* Auto reference versions

* resolve fixmes

* Add changelog

* Test fixes

* Test fixes

* Resolve fixmes

* Work on versioning

* Add support for _includes

* Update headers

* Change visibility

* One more tweak

* One more API tweak

* Fixes

* Account for review comments

* Fix errorprone reported issue

* Test fix

* Test fixes

* Test fixes
2021-01-27 14:49:10 -05:00
Nick Goupinets 04db4ed229 Merge remote-tracking branch 'origin/master' into ng_20201218_survivorship_poc 2021-01-26 09:18:20 -05:00
Tadgh 5c0b3ea905 Add mutator for payload 2021-01-25 12:20:38 -05:00
Tadgh 4c9df3f7b4 Add string mimetype to resourceoperationemssage 2021-01-25 11:25:47 -05:00
Ken Stevens 86ea0d60ef
reduce _count to the maximum page size rather than throwing an error. (#2319)
* reduce _count to the maximum page size rather than throwing an error.

Also when setting the paging provider on a restful server, automatically set the default page size and max page sized of the restful server from the paging provider.

* reword log message

* fixing this paging issue has uncovered all sorts of interesting things, including this long hidden bug!

* fix tests in sub-optimal way

* fix NPE

* fix test

* fixed a couple of bugs in SearchCoordinatorSvcImpl that surfaced when i added a default page size to RestfulServer
2021-01-25 08:19:29 -05:00
Nick cfc798cb2b Merge remote-tracking branch 'origin/master' into ng_20201218_survivorship_poc 2021-01-22 09:45:04 -05:00
Tadgh edd9769686 Add documentation fixes for MDM-match 2021-01-22 09:17:51 -05:00
Nick b00f47ef81 Merge remote-tracking branch 'origin/master' into ng_20201218_survivorship_poc 2021-01-18 09:25:58 -05:00
jamesagnew a08392e6b2 Add license header 2021-01-17 19:10:34 -05:00
James Agnew 29cf20aac3
Add repo validation outcome to response (#2293)
* Add repository validating interceptor outcome to response

* Add a doc

* Add a test and some docs
2021-01-17 12:50:13 -05:00
Nick 759f06ce48 Added optional manual override to link update 2021-01-14 14:24:59 -05:00
Nick 57662eedb3 Merge remote-tracking branch 'origin/master' into ng_20201218_survivorship_poc 2021-01-12 09:22:38 -05:00
Ken Stevens 520400d6ea
added IPagingProvider.canSearchByOffset() (#2281)
* init rev

* added IPagingProvider.canSearchByOffset()
consolidated parameters in bundle link methods

* fix refactoring error

* add @Nonnull to BundleLinks parameter

* null check

* fix test

* cleanup

* fix refactoring

* final cleanup

* review feedback

* review feedback

* review feedback
2021-01-11 20:42:41 -05:00
Nick 9338a4e73e Survivorship 5 2021-01-08 19:25:25 -05:00
jamesagnew d20b07c78e Update license headers 2021-01-01 15:50:24 -05:00
jamesagnew f30999b053 License header updates 2021-01-01 15:07:23 -05:00
James Agnew 8f8c5c31f1
Add validation rules interceptor (#2264)
* Start work on validation rules interceptor

* Work on interceptor

* Add tests

* Work on validation interceptor

* Work on interceptor

* Test fix

* Documentation tweaks
2021-01-01 14:29:10 -05:00
Tadgh e79114e2ec
Un-revert the MDM changes, now that issues have been addressed (#2226)
* Backward compatibility changes

* Revert "Revert "Remove all references to Person from EMPI.""

* Updated docs

* Removed mdm channel references

* Initial implementation

* fix coarseness bug. Fix tests. reinitialize silly bean

* Add forgotten json file

* Generic provider PoC

* Refactored provider to use BundleBuilder

* Removed version-specific MDM providers

* Addressed code review comments

* Fixed after merge

* Fixed docs

* MDM SVG for Update Use Cases

* Removed obsolete docs

Co-authored-by: Nick <nick.goupinets@smilecdr.com>
Co-authored-by: Nick Goupinets <73255752+nvg-smile@users.noreply.github.com>
2020-12-17 10:12:53 -05:00
James Agnew 81f6fe9106
Support IBaseBundle as parameetr type for @Transaction method (#2237)
* Support IBaseBundle as parameetr type for @Transaction method

* Add changelog

* Add bundle setter
2020-12-11 18:33:00 -05:00
Tadgh 0938d72b51
Revert "Remove all references to Person from EMPI." 2020-12-09 14:57:00 -05:00
Nick 52fd83c654 Merge remote-tracking branch 'origin/master' into gg_20201105-remove-person-references 2020-12-09 09:14:58 -05:00
jamesagnew 828573b467 Improve synchronization on HashMapResourceProvider 2020-12-09 05:53:47 -05:00
Nick fd90eb699f Review updates 2020-12-07 18:03:56 -05:00