Commit Graph

3935 Commits

Author SHA1 Message Date
TipzCM f0a9b33671
3283 delete will not return a 404 if resource is not found (#3284)
* 3283 delete will not return a 404 if resource is not found

* minor tweaks

* checking if tests fail due to asynchronicity

* 3283 added integration test

* cleanup

* review fixes

* changed id names

* cleanup

Co-authored-by: leif stawnyczy <leifstawnyczy@leifs-MacBook-Pro.local>
2022-01-18 13:07:26 -05:00
Tadgh 9f7c454c6b
Issue 2377 missing entry full url in document (#3304)
* start with failing test

* wip

* add changelog

* Add implementation

* Fix DSTU3 impl

* Fix DSTU2 and R5
2022-01-18 10:40:53 -05:00
TipzCM 221d7ed5b7
3274 transactions with full request url should be rejected (#3280)
* 3274 throw if url is full url

* 3274 will throw on invalid urls

* 3274 fixing the tests

* 3274 cleanup

* anonymize the data

* review fixes

* 3274 fixed for backward compatibility

* added review fixes

* fixing tests

* some more test fixes

* test fixes

* 3274 fixing the check to only look for resource at begining

* 3274 fixed test

* test fixes

Co-authored-by: leif stawnyczy <leifstawnyczy@leifs-MacBook-Pro.local>
2022-01-17 08:46:32 -08:00
Mark Iantorno 10dea0796a
JUnit jupiter fix for @Disabled tag order. (#3300) 2022-01-14 01:43:56 +00:00
IanMMarshall e6fd5c9807
Fix batching of mdm-clear tasks (#3295)
* Fix batching of mdm-clear tasks.

* Fix batching of mdm-clear tasks.

Co-authored-by: ianmarshall <ian@simpatico.ai>
2022-01-13 12:06:27 -05:00
jmarchionatto 737409955a
Issue 3251 terminology reindexing job is never triggered (#3271)
* Run intended job

* Add test ti validate right method is invoked by inner job

* Add changelog

* Make test fail with proper message instead of crash

Co-authored-by: juan.marchionatto <juan.marchionatto@smilecdr.com>
2022-01-06 13:29:01 -05:00
IanMMarshall 095b959917
Fix PatientIdPartitionInterceptor where patient ID has hashCode equal to Integer.MIN_VALUE. (#3275)
* Fix PatientIdPartitionInterceptor for case where patient ID has hashCode equal to Integer.MIN_VALUE

* Fix PatientIdPartitionInterceptor for case where patient ID has hashCode equal to Integer.MIN_VALUE

Co-authored-by: ianmarshall <ian@simpatico.ai>
2022-01-06 10:00:33 -05:00
James Agnew c38fdc4c42
Fix inline resource migration (#3277) 2022-01-06 08:40:51 -05:00
jmarchionatto 2106631718
Disallow operation invocation by GET request (#3272)
Co-authored-by: juan.marchionatto <juan.marchionatto@smilecdr.com>
2022-01-05 16:53:46 -05:00
TipzCM b148121ab3
3242 search content param removed not readded (#3244)
* 3242 initial changes and nonsense tests

* 3242 added changelog

* 3242 cleanup

* cleanup

* 3242 updated for review

* cleanup

* 3242 review fixes

* review fixes

* fix changelog file

* review fixes

Co-authored-by: leif stawnyczy <leifstawnyczy@leifs-MacBook-Pro.local>
2022-01-04 19:38:52 +00:00
jamesagnew aafc42fdd8 License header updates 2022-01-04 13:37:10 -05:00
James Agnew d610d33ac3
Dependency bumps (#3264)
* Bump a number of versions

* Fixes

* Work on version bump

* Bump

* Test fix

* More version bumps

* Build fixes

* Test fixes

* Fixes

* Fixes

* Test fix

* Bump jacoco

* Test fix

* Test fix

* Test fix

* Build fix

* Build fix

* Remove versioned H2

* Build fix

* Avoid memory issue in validation tests

* JDK bump

* Restore compile with errorprone

* Force coloured output

* Force jansi

* Try again to force jansi

* Fix for hardcoded date that just passed

* Fixes to JPA

* Improve changelog

* Work on failing test

* Test fix

* Compile fix

* One more version bump

* Test fixes
2022-01-04 13:21:14 -05:00
James Agnew d9820bfb89
Add inline resource mode (#3267)
* Start work on inline resource text storage mode

* Work on inlining

* Add changelog

* Test fixes

* Fix for hardcoded date that just passed
2022-01-03 11:43:45 -05:00
michaelabuckley 1c318aac1e
Bypass jpa for lastn results (#3226)
* Add flag in DaoConfig to enable storing resources in lucene index

* Update loadResourceByPid to use ElasticSearch for loading observation resource and test added to check it

* Added parsing to elastic search to parse inlined observation resources json to resource object
2021-12-17 22:38:43 +00:00
Ken Stevens a41d79ed22
call delete expunge hook for pid list within delete expunge batch job (#3252)
* call delete expunge hook for pid list within delete expunge batch job

* review feedback
2021-12-16 21:35:23 -05:00
Tadgh 6a333c08bc Fix badly built migrations and indexes 2021-12-16 01:49:28 -08:00
Tadgh 700b614610 Allow system request details to go through MDM 2021-12-15 22:47:33 -08:00
Tadgh 9e20d62380
Issue 3237 delete expunge performance (#3239)
* Initial test looking for bad deletes

* Add indexes, add migration, add test'

* Fix npe

* Add provider test

* fix up comments, tighten test

* Update hapi-fhir-jpaserver-base/src/main/java/ca/uhn/fhir/jpa/delete/job/DeleteExpungeProcessor.java

Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>

* Add changelog

* Remove unnecessary migration

Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>
2021-12-15 06:53:26 +00:00
jmarchionatto ef83777115
Allow Subscription to be configured to send delete messages (#3245)
* Allow Subscription to be configured to send delete messages

* Add tests and implement MR suggestions

Co-authored-by: juan.marchionatto <juan.marchionatto@smilecdr.com>
2021-12-14 16:32:56 -05:00
Tadgh 50a3005c23
Fix flag name (#3247)
* Fix flag name

* Bump hapi version
2021-12-14 19:20:03 +00:00
longma1 a56603daa2
2480 partition aware subscription (#3218)
* some fixmes to start

* Added some FIXMEs

* added RequestPartitionId to reosurceDelivryMessage and ResourceModifiedMessage

* ResourceDeliveryMessage and ResourceModifiedMessage tests

* fixed issue with test missing partitionHelperSvc mocked bean

* Added tests and implemented SubscriptionMatchingSubscriber for partition aware subscription

* modified implementation of partitionId in CanonicalSubscription

* Moved PartitionablePartitionId, and refactored all calls to getUserData(Constants.RESOURCE_PARTITION_ID) and setUserData(Constants.RESOURCE_PARTITION_ID)

* Revert "Moved PartitionablePartitionId, and refactored all calls to getUserData(Constants.RESOURCE_PARTITION_ID) and setUserData(Constants.RESOURCE_PARTITION_ID)"

This reverts commit fe40fb9733.

* Got added partitionId to subscriptions, added changes to make SubscriptionMatchingSubscriberTest work

* added SubscriptionTriggering test, also added partition support to subscriptionLoader

* Changed implementation for storing partition id of subscriptions from messages, refactored tests to new implementation

* added all subscription systemRequestDetails with all partition to subscription reader

* refactored a generic system request details with default all partition request

* Added test for dao subscriptions, fixes to get the test working

* added partition support for latest version delivery

* added doc changes and changelog for multitenancy subscription

* cleanup and added partitioned subscription manually trigger test

* fixed mocked subscriptionDao

* added package-info for subscription module

* some code review changes

* removed AllPartitionSystemRequestDetail, added new text for multitenant subscription

* renamed method for code review

* version bump to 5.7.0PRE7

Co-authored-by: Michael Buckley <michael.buckley@smilecdr.com>
Co-authored-by: Ken Stevens <khstevens@gmail.com>
Co-authored-by: Long Ma <long@smilecdr.com>
Co-authored-by: Steven Li <steven@smilecdr.com>
2021-12-13 08:45:30 -07:00
Ken Stevens d561577a9e
Ks 20211209 xml to java (#3236)
* try xml -> json

* Change from xml serialization to json serialization.  Also fix a deadlock in how the validation cache is used.

* changelog

* back out logback
change

* Update hapi-fhir-docs/src/main/resources/ca/uhn/hapi/fhir/changelog/5_7_0/3236-change-validation-from-xml-to-java.yaml

Co-authored-by: Tadgh <tadgh@cs.toronto.edu>

Co-authored-by: Tadgh <tadgh@cs.toronto.edu>
2021-12-12 00:29:52 +00:00
VK-SMILECDR bd89cf022b
Improve mail service (#3230)
* move mail config to mail service constructor

* update subscription email sender

* added license text

* [2669] bump HAPI version to 5.7.0-PRE6-SNAPSHOT

* add changelog
2021-12-09 17:05:42 -05:00
Ken Stevens 9753b66610
2564 contained resource validation flag (#3225)
* First cut at multithreading bundle validation

* javadoc

* change test to a red-green test

* add daoconfig

* move bundle concurrency config from validationsupport to request validator

* Moved concurrent details from ValidationOptions to FhirValidator

* Remove bundleValidationThreadCount (it's set by creating an appropriate executor)

* validate threadpool prefixes

* FIXME cleanup

* reassign FIXMEs to JB

* only create the threadpool if it will be used

* Add the MdcTaskDectorator to all threadpools

* Add bundle path to concurrently validated bundle resource validation messages.

* Add test to check bundle entry path being added to validation messages

* Threaded validation of contained resources initial checkin

* FHIR validator refactored to maintain correct bundle path and async validation task

* Refactored to use validation complete invoke callback to support raw string resource or resource object

* switch from XML to JSON

* # Conflicts:
#	hapi-fhir-base/src/main/java/ca/uhn/fhir/validation/FhirValidator.java
#	hapi-fhir-validation/src/test/java/org/hl7/fhir/r4/validation/FhirInstanceValidatorR4Test.java

* Updated to use new HAPI-FHIR version

* merge 'validate_contains_change' into issue-3144-multi-threaded-bundle-validation

* Updated to use new HAPI-FHIR version

* Revert "Updated to use new HAPI-FHIR version"

This reverts commit 910b7f676b.

* Revert "merge 'validate_contains_change' into issue-3144-multi-threaded-bundle-validation"

This reverts commit c7d60fc3e6.

* Revert "Updated to use new HAPI-FHIR version"

This reverts commit aa8a7af455.

# Conflicts:
#	hapi-fhir-validation/src/test/java/org/hl7/fhir/r4/validation/FhirInstanceValidatorR4Test.java

* Fix Test dependencies after reverting changes.

* merge 'validate_contains_change' to 2564-contained-resource-validation-flag

* Disable threadpool prefix name validate check.

* merge master

* fix thread regexp

* pre-review cleanup

* change log

* fix test

* revert to XML as default validation serialization

* fix test

* fix test

Co-authored-by: Jaison B <jaisonb@gmail.com>
2021-12-08 15:18:54 -05:00
jamesagnew 90d05a9ed4 Fix accidental commit 2021-12-07 14:55:16 -05:00
jamesagnew 8aef580aed Bump core library 2021-12-07 10:57:43 -05:00
Mark Iantorno d60d07b697
Validate contains change (#3209)
* wip

* The updated changes to the validator that were pulled in from the core dependencies are not backwards compat. Need to bump HAPI version.

* pointing to stable core version

* review feedback

* Add changelog

Co-authored-by: markiantorno <miantorno@pop-os.localdomain>
2021-12-06 11:25:00 -05:00
James Agnew b7bf10ced4
Missed commits from #3214 (#3222)
* Move graphql provider

* Version bump

* Moving things around

* More reworking

* Fix
2021-12-06 06:49:52 -05:00
James Agnew d072357c2a
Move graphql provider (#3214)
* Move graphql provider

* Version bump
2021-12-05 17:22:20 -05:00
katiesmilecdr 2681560598
fixed (#3217)
* fixed

* Add test

* Update test

Co-authored-by: Tadgh <garygrantgraham@gmail.com>
2021-12-04 00:38:51 +00:00
Ken Stevens 0656037c8d
Ks 20211203 mdm possible match (#3216)
* begin with failing test

* fix issue

* change log

* code review
2021-12-03 19:44:25 +00:00
Ken Stevens 2fbbf31431
Ks 20211202 fix major reindex bug (#3211)
* begin with failing test

* fix bug

* change log

* change log
2021-12-02 21:38:54 +00:00
James Agnew aa09e59255
Migrate to OpenAPI (#3206)
* Migrate to OpenAPI

* Update spring

* Test fix
2021-12-02 13:01:50 -05:00
James Agnew aae53d6ec7
Improve loading performance (#3197)
* Synthea perf work

* Cleanup

* Work on performance

* Ongoing perf work

* More perf work

* Perf work

* Test fixes

* Updates

* Test fix

* Test fixes

* Clean up tests

* Test cleanup

* Cleanup

* Add test

* One more perf tweak

* Fixes

* Add changelog

* Add changelog

* License header update

* License header updates
2021-11-28 10:47:30 -05:00
Tadgh 7ef1d159ee
Fix bug loading packages in non-database mode (#3199)
* Add implementation

* Add changelog
2021-11-26 20:17:51 -05:00
Patrick 3363807931
Support https with elastic (#3192)
* 3138 externalized binary packages (#3139)

* Add test and impl

* Add changelog

* Fix test

* Update hapi-fhir-docs/src/main/resources/ca/uhn/hapi/fhir/changelog/5_6_0/3138-support-externalized-binaries.yaml

* add beans to test configs

* Typo

* Update hapi-fhir-jpaserver-base/src/main/java/ca/uhn/fhir/jpa/binstore/IBinaryStorageSvc.java

Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>

* Update hapi-fhir-jpaserver-base/src/main/java/ca/uhn/fhir/jpa/binstore/NullBinaryStorageSvcImpl.java

Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>

Co-authored-by: Kevin Dougan SmileCDR <72025369+KevinDougan-SmileCDR@users.noreply.github.com>
Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>

* 3131 - Added support for the lookup operation in the Remote Terminology code (#3134)

* Remove leading underscores from identifiers (#3146)

* Version bump

* License files

* version.yaml

* Support HTTPs

Co-authored-by: Tadgh <tadgh@cs.toronto.edu>
Co-authored-by: Kevin Dougan SmileCDR <72025369+KevinDougan-SmileCDR@users.noreply.github.com>
Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>
Co-authored-by: Tadgh <garygrantgraham@gmail.com>
Co-authored-by: ppalacin <patrick.palacin@i-atros.com>
2021-11-26 15:08:38 -05:00
jmarchionatto d496ca98ad
Issue 3172 support member match operation (#3187)
* Suppress unresolved maven properties errors to avoid IntelliJ complains

* Support for $member-match operation

* Add more reference cases

* Adjust tests

* Add test and handle missed condition

Co-authored-by: juan.marchionatto <juan.marchionatto@smilecdr.com>
2021-11-26 14:20:14 -05:00
Kevin Dougan SmileCDR 10cad65534
Add NULL-safe check on the myValidationSupportChain as well as a setter method in case it needs to be injected. (#3190) 2021-11-25 07:59:35 -05:00
Kevin Dougan SmileCDR 3c2b4bb397
3136 - Provide RemoteTerminologyServiceValidationSupport Implementation For Operation $validate-code (#3142)
* 3136 - Send validate-code requests to an Instance of IValidationSupport instead of directly to the DAO.

* 3136 - Added support for R4 validate-code calls to a Remote Terminology Server.

* Added more Unit Tests.

* Added NULL checks based on code analysis.

* Adding some cleanup code to the Unit Tests since some other unrelated Unit Tests were failing when running in an Azure Pipeline.

* Adding @Ignore to both of my Unit Test classes to try and see if this is the cause of other unrelated Unit Test failures in the Azure Pipeline.

* Commented out ALL CODE in my Unit Tests to see if this fixes the other Unit Tests.

* Added 1 Unit Tester called RemoteTerminologyServiceResourceProviderR4Test to see if it causes other Unit Test failures.

* Added a Unit Tester called ResourceProviderR4RemoteTerminologyTest with the code that creates a RemoteTerminologyServiceValidationSupport instance commented out for now, just to see if this allows all other Unit Tests to pass.

* Added a Unit test back in to verify how the RemoteTerminologyServiceValidationSupport works when inserted into the front of the IValidation chain. Lets see if this will mess up any other Unit Tests in the Azure Pipeline...

* Added an @AfterEach method to remove the RemoteTerminologyServiceValidationSupport instance from the ValidationSupportChain to see if it allows all the other Unit Tests to work as before.

* Added more Unit tests.

* Added more Unit Tests to increase code coverage.

* Added some NULL checks.

* Added a changelog for this feature add.

* Removed the decision logic in the REST APIs and also the isRemoteTerminologyServiceConfigured() method, and letting the ValidationSupportChain figure out how to perform the validate-code Operation.

* Removed a NULL check that was not needed.

* Reverting the previous change where I tried using the IValidationSupportChain for each and every incoming Operation request. Splitting the implementation between local and remote seems to be required at this time.
2021-11-23 10:39:56 -05:00
Tadgh 0a64294467
Release 5.6.0 (#3174)
* 3138 externalized binary packages (#3139)

* Add test and impl

* Add changelog

* Fix test

* Update hapi-fhir-docs/src/main/resources/ca/uhn/hapi/fhir/changelog/5_6_0/3138-support-externalized-binaries.yaml

* add beans to test configs

* Typo

* Update hapi-fhir-jpaserver-base/src/main/java/ca/uhn/fhir/jpa/binstore/IBinaryStorageSvc.java

Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>

* Update hapi-fhir-jpaserver-base/src/main/java/ca/uhn/fhir/jpa/binstore/NullBinaryStorageSvcImpl.java

Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>

Co-authored-by: Kevin Dougan SmileCDR <72025369+KevinDougan-SmileCDR@users.noreply.github.com>
Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>

* 3131 - Added support for the lookup operation in the Remote Terminology code (#3134)

* Remove leading underscores from identifiers (#3146)

* Version bump

* License files

* version.yaml

Co-authored-by: Kevin Dougan SmileCDR <72025369+KevinDougan-SmileCDR@users.noreply.github.com>
Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>
2021-11-19 15:24:44 +00:00
jmarchionatto 175958de5e
Issue 3108 terminology large codesystem deletion takes days to complete (#3160)
* Add indexes to foreign keys

* Add new version enum

* Add TermCodeSystem and TermCodeSystemVersion deletion job artifacts

* Add Propagation.NOT_SUPPORTED to allow starting jobs from transactional code

* New jobs artifacts

* Improve comments

* Restructure job configurations to avoid bean name collisions

* Restructure job configurations to avoid bean name collisions

* Use new offline deletion by job

* Test using multiple versions

* Retrieve only Pids

* Revert to master

* Maintain deferred functions synchronization as similar as possible to the way it was

* Bypass validations to allow calling an index same as a foreign key to make SchemaMigrationTest happy as H2 adds FK indexes automatically

* Adjust tests

* Add copyrights

* Add test

* Revert to delete CodeSystemVersions using deferred ITermDeferredStorageSvc

* Allow to wait for jobs tentatively

* Organize imports

* Fix tests

* Increase timeout to cover for possible additional heavy DB activity

* Add indexes to two remaining non-indexed foreign key fields to avoid much longer transactions which produce locks on heavy DB load

* Update hapi-fhir-docs/src/main/resources/ca/uhn/hapi/fhir/changelog/5_7_0/3108-terminology-large-code-system-deletion-performance.yaml

Co-authored-by: James Agnew <jamesagnew@gmail.com>

* Remove opening stars from logging messages

* Relax index name checking logic to allow for indexes on FK columns to be called same as the FKs, to make SchemaMigrationTest happy even when H2 adds indexes to FKs automatically.

* Use static array to enumerate platforms which doesn't add indexes to foreign keys automatically.

* Cleanup also job executions when performing test artifact cleanup

* Adjust to property name change

* Add ABANDONED status to the list of waited job statuses to avoid test failures due to wait timeouts

* Add also UNKNOWN status to the list of waited job statuses to avoid test failures due to wait timeouts

* Filter job executions to be stopped

* Set trace to debug test problem

* Add STOPPED status to the list of waited job statuses to avoid test failures due to wait timeouts

Co-authored-by: juan.marchionatto <juan.marchionatto@smilecdr.com>
Co-authored-by: James Agnew <jamesagnew@gmail.com>
2021-11-18 09:49:16 -05:00
IanMMarshall 843517f7ba
Avoid creating ResourcePersistentId for placeholder resources with null ID (#3158)
* Add check before mapping storage ID to resource ID in TransactionDetails.

* Add change log.

* Changed to instead prevent creation of ResourcePersistentId with null ID value.

* Changed to instead prevent ResourcePersistentId being created with null resource ID.

Co-authored-by: ianmarshall <ian@simpatico.ai>
2021-11-15 16:36:30 -05:00
TipzCM 1478abac3a
3164 updating code review points (#3165)
* 3164 updating code review points

* 3164 updating code review points

Co-authored-by: leif stawnyczy <leifstawnyczy@leifs-MacBook-Pro.local>
2021-11-12 20:13:42 +00:00
jamesagnew 2e6fb10df3 Merge branch 'master' of github.com:hapifhir/hapi-fhir 2021-11-11 15:05:37 -05:00
michaelabuckley 7d7865ab17
Mb share jpa date tests (#3154)
* publish test-jar from hapi-fhir-storage

* Extract BaseDateSearchDaoTests up to hapi-fhir-storage.

Share a date search tests between JPA and Mongo.

* Use ITestDataBuilder for setup

* Move Mongo date cases into common set

* cleanup

* More cleanup

* naming
2021-11-10 21:07:36 +00:00
TipzCM 25c025cdee
3153 update unknowncodesystemwarningvallidationsupport to have configurable severities (#3155)
* 3153 updating the unknowncodesystemwarningvalidationsupport class

* 3153 updating version for smile

* 3153 update broken tests

* 3153 adding log

* 3153 cleanup

* 3153 cleanup

Co-authored-by: leif stawnyczy <leifstawnyczy@leifs-MacBook-Pro.local>
2021-11-10 16:06:09 -05:00
jamesagnew 1abd046cc9 Add test 2021-11-09 15:02:01 -05:00
jamesagnew 5de955c3c2 Licence header updates 2021-11-09 08:44:18 -05:00
TipzCM 59bf8b836f
Issue 3120 support adding retry extension (#3137)
* issue-1134 initial work on adding retry handler

* issue-1134 subdscription creation fixes

* issue-1134 update the test

* issue-1134 retry policy off canonicalsubscription

* issue 1134 base subscription changes

* add failing test

* issue 1134 retry configs on base parameters

* issue 1134 passing forward params

* issue-1134 added more tests for making sure subscriptions create their channels correctly

* issue-1134 updates to get the retry to channels

* issue-1134 updating channel factory

* issue-1134 remove the dlq since it's not defineable

* issue-3120 changelog added

* issue-3120 cleaning up

* issue-3120 test fix

* issue-3120 review fixes

* issue-3120 fixed bad master merge

* issue-3120 updates for new release

Co-authored-by: leif stawnyczy <leifstawnyczy@leifs-MacBook-Pro.local>
Co-authored-by: Ken Stevens <khstevens@gmail.com>
2021-11-03 18:21:10 -04:00
Tadgh a10c58e839
Bump version, add version to versionenum (#3135) 2021-11-02 09:40:56 -04:00
michaelabuckley 1a822178b2
Docs and cleanup for #2997 (#3126)
* Docs and cleanup for #2997

Auto-merge triggered too soon.

* Change link extraction to support multi-paths.

Cleanup naming.

* Remove this != null check

* Cleanup and comments

* Update hapi-fhir-docs/src/main/resources/ca/uhn/hapi/fhir/docs/server_jpa/elastic.md

Co-authored-by: Tadgh <tadgh@cs.toronto.edu>

* Update hapi-fhir-docs/src/main/resources/ca/uhn/hapi/fhir/docs/server_jpa_partitioning/partitioning.md

Co-authored-by: Tadgh <tadgh@cs.toronto.edu>

* Reformat and comments

Co-authored-by: Tadgh <garygrantgraham@gmail.com>
Co-authored-by: Tadgh <tadgh@cs.toronto.edu>
2021-11-01 15:31:23 +00:00
Tadgh 7c63441663
Revert "Issue 1134 retry mechanic on subscriptions (#3121)" (#3128)
This reverts commit 9b23e9e825.
2021-10-30 19:46:42 +00:00
StevenXLi 39577ebe11
Spring batch param migration (#3124)
* small change to support change to string length of spring batch execution parameters

* added comment to indicate function is empty on purpose

* added javadoc for this method to note it's for overriding purpose

Co-authored-by: Steven Li <steven@smilecdr.com>
2021-10-29 12:46:36 -04:00
TipzCM 9b23e9e825
Issue 1134 retry mechanic on subscriptions (#3121)
* issue-1134 initial work on adding retry handler

* issue-1134 subdscription creation fixes

* issue-1134 update the test

* issue-1134 retry policy off canonicalsubscription

* issue 1134 base subscription changes

* add failing test

* issue 1134 retry configs on base parameters

* issue 1134 passing forward params

* issue-1134 added more tests for making sure subscriptions create their channels correctly

* issue-1134 updates to get the retry to channels

* issue-1134 updating channel factory

* issue-1134 remove the dlq since it's not defineable

* issue-3120 changelog added

* issue-3120 cleaning up

* issue-3120 test fix

* issue-3120 review fixes

* issue-3120 fixed bad master merge

Co-authored-by: leif stawnyczy <leifstawnyczy@leifs-MacBook-Pro.local>
Co-authored-by: Ken Stevens <khstevens@gmail.com>
2021-10-29 11:21:43 -04:00
Tadgh 8a7b5c1b2f
Multiple improvements (#2997)
* Add failing test

* Tidy test for new tokenparam style

* Add removeByQualifier to SearchParameterMap

* Add new property binder for search terms

* Member move, add test for new parser

* whoops missed an add

* Passing test.

Introduced SearchParamTextWrapper to give a type for the binder.
Enhance FulltextSearchSvcImpl to understand TokenParams as well as StringParams.

* Add more to test, change analyzer for template

* Optimize imports

* Minor refactoring

* added eq and gt test cases

* added missing gt search param tests

* Search all CodeableConcepts

* Extract new LuceneRuntimeSearchParam to mediate indexing and searching.

* Fix up broken test with mock

* Add support for identifier type

* Bump for special maven package

* fix-me to todo

* Prevent version check

* FIx version for test

* DSTU2 does not support fluent path

* Don't accidentally strip SPs in DSTU2

* added lt tests

* Add some high-bound test cases

* More test cases and new compressed format

* More test cases

* More test cases

* Re-order columns for easier reading

* Comments

* Cleanup and comments

* Make support :text for all token SPs

* Make support :text for all token SPs

* Fixed incomplete date issue

* Set to the last millisecond 23:59:59.999

* Disabled 4 failed JVM/TZ related test cases

* add test for failing batch bug, remove bounding on queue

* remove parallelism from non-get batch operations

* Fix count for test

* New index layout

* Notes and cleanup

* Notes and cleanup

* remove the jetbrains

* Demote FIXME to WIP

* Change :text search to be lucene simple search and use standardAnalyzer.

* Change :text to require * for prefix match.

* add prefix negative test

* Bump version

* Added changelog

* Add more search parameters to lucene indexing (#3000)

* dirty the branch

* Add oversight to changelog

* Start using jpa indexing for es

* Correct negative search test

* Update templates, index tokens, write new test. TODO gotta modify SB

* Add test for code token search

* add comment

* Flesh out token search

* minor cleanup and comments

* Extract index handling from FulltextSearchSvcImpl

* D'oh.  Actually use elastic to search.

* Move supported query check closer to query builder

* String search test before activating lucene

* Add string:exact to hibernate search.

* Add string:contains search

* cleanup

* demote fixmes to allow build to run.

* Add unmodified string search.

* empty stubs for quantity and reference

* Ignore magic search params in lucene index

* Support full-text on all FHIR releases

* Include reference lookups in ES

* Fix and/or logic in _text

* Test for string with space

* Cherry-pick the NoFT fix

* Disable advanced indexing in a bunch of tests of emitted sql.

* Stub changelog

* Fix :missing flag

* Move DaoConfig up to BaseJpaTest to share teardown

* Disable new indexing for partition test

* Add a different analyzer and field for default string search vs text

* checkstyle for a pre-build

* Index full prefix for string search when using Lucene

* Update hapi-fhir-docs/src/main/resources/ca/uhn/hapi/fhir/changelog/5_6_0/3000-Extend-lucene-indexing.yaml

Co-authored-by: Tadgh <tadgh@cs.toronto.edu>

* Update hapi-fhir-jpaserver-base/src/main/java/ca/uhn/fhir/jpa/dao/HibernateSearchQueryBuilder.java

Co-authored-by: Tadgh <tadgh@cs.toronto.edu>

* Review feedback.

Co-authored-by: Tadgh <garygrantgraham@gmail.com>
Co-authored-by: Tadgh <tadgh@cs.toronto.edu>

* Remove double-check

* Version bump

* Fix typo

Co-authored-by: Michael Buckley <michael.buckley@smilecdr.com>
Co-authored-by: Long Ma <longma@Longs-MacBook-Pro.local>
Co-authored-by: Frank Tao <frankjtao@gmail.com>
Co-authored-by: michaelabuckley <michaelabuckley@gmail.com>
2021-10-28 15:13:16 -04:00
James Agnew 05f470db18
Paging queries can generate invalid Oracle SQL (#3123)
* Test fix

* Add docs

* Add changelog
2021-10-28 14:42:06 -04:00
longma1 2067ba83ee
minor refactor to extract static string variables into a singel constants class in bulk export (#3117)
Co-authored-by: Long Ma <longma@Longs-MBP.hitronhub.home>
2021-10-28 16:04:31 +00:00
katiesmilecdr 5ee823e829
[3109] fix bug (#3112)
* [3109] fix bug

* [3109] add unit tests for BinaryAccessProvider
2021-10-27 19:52:57 +00:00
James Agnew 9e057574a6
Allow multi-resource Subscription criteria (#3110)
* Allow start criteria subscriptions

* Rework subscription tests

* Subscription cleanup

* Add changelog

* Test fixes

* Test fix
2021-10-26 16:48:13 -04:00
michaelabuckley 2cf8e74414
Introduce standard date search test cases (#3096)
* Introduce standard date search test cases
2021-10-26 19:15:06 +00:00
JasonRoberts-smile 20f31e4854
Jr 20211021 chained references 3 (#3107)
* Create index entries for outbound references of contained resources

* build query for chained reference

* fix case where the contained reference is an explicit id rather than a continued chain

* fix contained index to use path names not search param names

* make qualified search work

* cleanup and changelog

* recurse while creating indexes on contained resources

* double link both contained

* longer contained subchains

* adding some failing test cases to illustrate the limitations of qualified searches

* clean up merge cruft

* changelog

* create recursive resource links

* add test coverage for a more complicated case

* changelog

* remove unnecessary check for _contained flag

* fix broken tests
2021-10-25 10:16:10 -04:00
JasonRoberts-smile b267fdb752
Jr 20211018 chained references 2 (#3099)
* Create index entries for outbound references of contained resources

* build query for chained reference

* fix case where the contained reference is an explicit id rather than a continued chain

* fix contained index to use path names not search param names

* make qualified search work

* cleanup and changelog

* recurse while creating indexes on contained resources

* double link both contained

* longer contained subchains

* adding some failing test cases to illustrate the limitations of qualified searches

* clean up merge cruft

* changelog
2021-10-22 12:41:05 +00:00
Tadgh 2d55af1ec4
Fix postgresql regression (#3101)
* Bump elastic version

* Fix broken types for sql builder in postgres

* Add changelog

* Fix changelog
2021-10-21 16:23:41 -04:00
michaelabuckley f98f3cdaa9
Extend ordinal date search to year and month precision (#3102)
* added eq and gt test cases

* added missing gt search param tests

* added lt tests

* Add some high-bound test cases

* More test cases and new compressed format

* More test cases

* More test cases

* Re-order columns for easier reading

* Comments

* Cleanup and comments

* Fixed incomplete date issue

* Set to the last millisecond 23:59:59.999

* Disabled 4 failed JVM/TZ related test cases

* Added changelog

Co-authored-by: Long Ma <longma@Longs-MacBook-Pro.local>
Co-authored-by: Frank Tao <frankjtao@gmail.com>
2021-10-21 15:32:26 -04:00
jmarchionatto b93f33d4ff
When uploading loinc CodeSystem take copyright from loinc.xml input file. (#3092)
Co-authored-by: juan.marchionatto <juan.marchionatto@smilecdr.com>
2021-10-20 15:05:04 +00:00
JasonRoberts-smile d07764e8e5
Jr 20211013 chained references (#3079)
* Create index entries for outbound references of contained resources

* build query for chained reference

* fix case where the contained reference is an explicit id rather than a continued chain

* fix contained index to use path names not search param names

* make qualified search work

* cleanup and changelog

* code review

* fix broken tests
2021-10-19 18:07:29 +00:00
StevenXLi 34010fa78d
Batch job refactor (#3087)
* added AbstractResourceToFileWriter

* Added AbstractBaseBulkItemReader

* added bulkExportStatusEnum fromBatchStatus test

* Code review name change

Co-authored-by: Long Ma <longma@Longs-MBP.hitronhub.home>
Co-authored-by: Steven Li <steven@smilecdr.com>
2021-10-19 09:07:05 -04:00
JasonRoberts-smile b5e31abf9b
add authorization check to inline matches (#3048)
* add authorization check to inline matches

* code review feedback: cached results case

* Add query count test

* Update hapi-fhir-docs/src/main/resources/ca/uhn/hapi/fhir/changelog/5_6_0/3047-inline-match-security.yaml

Accept code review suggestion

Co-authored-by: James Agnew <jamesagnew@gmail.com>

Co-authored-by: James Agnew <jamesagnew@gmail.com>
2021-10-18 12:21:26 +00:00
Tadgh b427135b04
Patient/$everything _id parameter (#3077)
* Add tests. Add implementation in R4. Add changelog

* Wip partial fixup of other STU versions

* Updated usages of new patient type everything api

* Partial commit of incomplete documentation

* Remove docs

* Cut to token instead of string

* Bump hapi version due to breaking api changes
2021-10-17 14:34:33 +00:00
Tadgh 120443e561
Bump core version (#3067)
* Bump core version

* Changes for version bump

* Resolve NPE:

* Test fix

Co-authored-by: jamesagnew <jamesagnew@gmail.com>
2021-10-16 14:13:13 -04:00
Jing Tang b25b186044
Remove the unused dependency on net.sf.saxon:Saxon-HE (#3043)
* Remove the unused dependency on net.sf.saxon:Saxon-HE

* Remove Saxon-HE dependency in hapi-fhir-jpaserver-base

* Remove unused comment in hapi-fhir-structures-dstu2.1/pom.xml
2021-10-14 16:34:48 -04:00
jamesagnew 818c54f0b9 Squashed commit of the following:
commit 408f2d82b762900de53ebe66dde8eec082e7bae7
Merge: 8da38d1a9e be19acb7c3
Author: jamesagnew <jamesagnew@gmail.com>
Date:   Tue Oct 12 12:00:56 2021 -0400

    Merge branch 'master' into ja_20211011_fix_intermittent

commit 8da38d1a9e
Author: jamesagnew <jamesagnew@gmail.com>
Date:   Mon Oct 11 21:31:42 2021 -0400

    Test fixes

commit c73fd288f0
Author: jamesagnew <jamesagnew@gmail.com>
Date:   Mon Oct 11 20:53:04 2021 -0400

    Fix intermittent failure
2021-10-12 12:01:34 -04:00
jamesagnew b2a4ff2f29 Try to avoid intermittent 2021-10-11 19:14:01 -04:00
jamesagnew a54ebd1d30 License header updates 2021-10-11 17:22:54 -04:00
James Agnew 310a4cdb58
Migrate CLOB columns to LOB (SMILE-3072) (#3016)
* Migration finished

* Work on LOBS

* Add to ClobMigrated annotation

* Deal with lobs

* Work on new approach

* HAPI FHIR version bump

* Add changelog

* Add license header

* Fix intermittent

* CLeanup

* Cleanup
2021-10-11 16:47:37 -04:00
James Agnew 756b0fdc7b
Fix transaction scoping (#2799)
* Work on transaction boundaries

* Test fixes

* Test fixes

* Test fix

* Resolve FIXME

* Test fix

* Test fix

* Test fix

* Test fixes

* Test fix

* Adjust changelog

* Remove unneeded changelog

* Test fix

* Test fixes

* Test fixes

* Test fixes

* Test fixes

* Test fix

* Fixes

* Test fix
2021-10-11 16:45:22 -04:00
James Agnew aed718bd6f
Avoid redundant PID lookups in transaction processing (#3061)
* Avoid redundant PID lookups in transaction processing

* Add changelog

* Test fix
2021-10-11 13:45:57 -04:00
TipzCM a474e88ed4
issue-2397 implementing the mdm expansion on everything and searches (#3044)
* issue-2397 implementing the mdm expansion on everything and searches

* issue-2397 code cleanup and removal of test code

* issue-2397 some tests

* issue-2397 changelog added

* issue-2397 review fixes

* issue-2397 updated change log with example and fixed failing tests

* issue-2397 test fixing

* issue-2397 fixing test

* issue-2397 review fix

* issue 2397 fixing changelog file

Co-authored-by: leif stawnyczy <leifstawnyczy@leifs-MacBook-Pro.local>
Co-authored-by: Tadgh <tadgh@cs.toronto.edu>
2021-10-07 10:46:23 -04:00
jmarchionatto 71e2b82128
Issue 2851 upload terminology valueset parallel versioning (#3051)
* Fix operations for 'loinc-all' ValueSet

* Fix tests

Co-authored-by: juan.marchionatto <juan.marchionatto@smilecdr.com>
2021-10-06 20:56:30 +00:00
Tadgh 59afbe086c
Allow canonical references to support treating given base URLs as local. (#3050)
* Add failling test, works on #2843

* Partial hack to get this working

* Move implementation into pre-processing

* Add changelog

* Move implementation

* Minify Test

* Remove fixmes

* Tidying

* Ensure this only operates on STU versions which support canonical
2021-10-05 11:09:49 -04:00
jamesagnew 2581cd1446 Bump postgres DB version 2021-10-04 10:54:33 -04:00
jamesagnew 15748f4d54 Add setters 2021-10-04 07:41:24 -04:00
James Agnew d320b78ae1
Improve synthea ingest performance (#3033)
* Improve synthea ingest performance

* Tweaks

* Fix param splitting

* Update to test

* Add changelog

* Test fix

* Add some runtime checks

* Remove useless test

* Test fix
2021-10-04 05:46:06 -04:00
James Agnew eca725afa4
Improve versioned URL support for ValueSet expansion (#2994)
* Add test

* Test fixes

* Work on expansion errors

* Fixes

* Test fixes

* Test fixes

* Test fixes

* Test fixes

* Test fixes

* Test fixes

* Test fixes

* Work on fix

* Test fixes

* Test fixes

* Test fix

* Cleanup

* Test fixes

* Remove accidental commit

* Test fixes

* Version bump

* Add changelog

* Fixes

* Test fix

* Fix conflicts
2021-10-03 19:47:23 -04:00
Tadgh cd1a4154c1 Merge branch 'remove-parallel-non-gets' of github.com:hapifhir/hapi-fhir into remove-parallel-non-gets 2021-09-28 09:55:13 -04:00
Tadgh 072c030c2d Remove modifications, defaults work 2021-09-28 09:55:06 -04:00
Tadgh ad05a5ec09
Merge branch 'master' into remove-parallel-non-gets 2021-09-28 09:43:01 -04:00
Tadgh dde0529b07 Remove extra semicolon 2021-09-27 15:36:17 -04:00
Tadgh 0c123384c7 add test for failing batch bug, remove bounding on queue 2021-09-27 15:34:19 -04:00
katie_smilecdr d121f6eff1 Merge branch 'master' into 3020_Add_documentation_for_$partition-management-create-partition 2021-09-27 15:10:19 -04:00
juan.marchionatto 2dec5f0821 Add explicit brackets 2021-09-27 13:47:23 -04:00
juan.marchionatto b4343a9823 Merge branch 'master' into issue-2851-upload-terminology-valueset-parallel-versioning 2021-09-27 09:48:15 -04:00
juan.marchionatto 00ceb3f35d Add tests 2021-09-27 09:47:05 -04:00
michaelabuckley 5ee5b08b50
Merge branch 'master' into mb-fix-NoFt-tests 2021-09-24 16:38:05 -04:00
Ken Stevens b1dd40fdba
Try commenting out clearAllStaticFieldsForUnitTest to see what happens (#3034)
* Try commenting out clearAllStaticFieldsForUnitTest to see what happens

* Rename clearAllStaticFieldsForUnitTest to randomizeLocaleAndTimezone and only do that
2021-09-24 16:01:28 -04:00
juan.marchionatto d03f9cb35b Merge branch 'master' into issue-2851-upload-terminology-valueset-parallel-versioning 2021-09-24 15:40:22 -04:00
juan.marchionatto eb9f29b3f3 Simplify code 2021-09-24 15:05:06 -04:00
katie_smilecdr d067586607 [3020] add documentation/changelog 2021-09-24 14:49:07 -04:00
Michael Buckley 11c5f7ee87 Some configs don't publish and FullText service at all. Make it optional. 2021-09-24 14:32:34 -04:00
Michael Buckley 79e2800f3e Fix cut-n-paste glitch in dstu2 NoFt 2021-09-24 13:48:01 -04:00
katie_smilecdr 8c145d1212 Merge branch 'master' into 3020_Add_documentation_for_$partition-management-create-partition 2021-09-24 13:01:38 -04:00
katie_smilecdr 6431ae4401 [3020] fix implementation/add tests 2021-09-24 13:00:05 -04:00
Michael Buckley db55837c3c Make our NoFt tests actually run without Ft.
Hibernate search was always configured with a lucene heap engine in all JPA tests.
Added a new config param - hapi_test.enable_lucene - to disable with config params on the NoFt tests.
2021-09-24 12:05:16 -04:00
jmarchionatto 4ab60e2f9b
Merge branch 'master' into issue-3017-remove-loincxml-file-from-application-used-as-fallback-when-loading-loinc-terminology 2021-09-24 08:59:15 -04:00
Ken Stevens 0db40c6118 support non-jpa batch 2021-09-24 00:39:15 -04:00
Ken Stevens 53c7476dae
hapi storage (#3024)
* first pass moving core storage classes to storage-api

* move term service apis

* nearly done

* rename hapi-fhir-storage-api to hapi-fhir-storage and move transaction processor

* rename hapi-fhir-storage-api to hapi-fhir-storage and move transaction processor

* create new SearchConstants class to store platform independent search constants

* move a couple of subscription services

* move transaction processor adapter to storage

* version bump

* move searchparam

* fix test

* fix compile includes

* fix text

* fix docs
2021-09-23 22:04:46 -04:00
katie_smilecdr 8bd14ae024 [3020] add $partition-management-lists-partitions 2021-09-23 16:08:56 -04:00
juan.marchionatto 91d9101785 Merge branch 'master' into issue-3017-remove-loincxml-file-from-application-used-as-fallback-when-loading-loinc-terminology 2021-09-23 13:45:28 -04:00
juan.marchionatto d1e9c23c13 Remove loinc.xml file from application. Now it required as input for loinc upload. 2021-09-23 13:43:27 -04:00
juan.marchionatto 9c8fd26692 Merge branch 'master' into issue-2851-upload-terminology-valueset-parallel-versioning 2021-09-23 11:56:44 -04:00
juan.marchionatto 751c5d0d05 Implement revision suggestions. Add changelog. 2021-09-23 11:55:50 -04:00
Tadgh ad9e0f1c9a
Merge branch 'master' into 3014-prevent-delete-expunge-cascade 2021-09-23 09:33:04 -04:00
Jimmy Deng 2436f748aa fix test 2021-09-22 14:38:53 -04:00
Jimmy Deng f9796b9e2a fix test 2021-09-22 12:52:28 -04:00
Jimmy Deng 26ac649946 changelog 2021-09-22 11:11:10 -04:00
Jimmy Deng 9a18422173 fix review 2021-09-22 11:09:50 -04:00
Jimmy Deng 48f73fa1d1 typo 2021-09-22 10:25:57 -04:00
Jimmy Deng c913707599 added header check 2021-09-22 10:15:22 -04:00
juan.marchionatto 81a4f0c78f Rename method for clarity. Increase test coverage. 2021-09-22 09:40:25 -04:00
juan.marchionatto fdf639d353 Merge branch 'master' into issue-2851-upload-terminology-valueset-parallel-versioning 2021-09-22 09:25:48 -04:00
Justin Dar ad5297b714 fix for issue #3014 2021-09-21 13:09:08 -07:00
Ken Stevens 060791aeb4
hapi-fhir-storage-api (#3006)
* rename hapi-fhir-jpaserver-migrate to hapi-fhir-sql-migrate and move hapi-tasks into jpaserver-persistence

* rename hapi-fhir-jpaserver-api to hapi-fhir-storage-api

* move bulk import apis

* create hapi-fhir-jpa

* create hapi-fhir-jpa

* move CircularQueueCaptureQueriesListener to japi-fhir-jpa

* move mdm logs to storage-api

* move gziputil to storage-api

* move quartz scheduling to hapi-fhir-jpa

* move default subscription channel factory to storage-api

* consolidated batch constants

* correct accidental Logs change

* remove dependency of cdr-api on cdr-persistence

* fix javadoc

* pom descriptions

* review feedback
2021-09-21 15:36:08 +00:00
juan.marchionatto 371484a4ea Fix test to add now required id to loinc CodeSystem creation 2021-09-20 17:19:31 -04:00
juan.marchionatto 3d5c863276 Revert creation of test utility class finally not needed 2021-09-20 17:18:45 -04:00
juan.marchionatto 9c790a7374 Revert creation of test utility class finally not needed 2021-09-20 17:18:11 -04:00
juan.marchionatto 8a1d95f348 Add service to get CodeSystem from its forcedId without forcing rollback by ResourceNotFoundException in case not found 2021-09-20 17:14:42 -04:00
Johnson Lu f1f9c672ad
3110 zh disallow unknown extensions (#3009)
* Added allowKnownExtensionsOnly() method such which calls setAnyExtensionsAllowed() to set myAnyExtensionsAllowed to false and modified changelogs to add entry for this ticket.

* Modified docs to remove description for .allowAnyExtensions() and included it within a description for .allowKnownExtensionsOnly() and also added test for .allowKnownExtensionsOnly()

* refactored allowKnownExtensionsOnly() to rejectUnknownExtensions()
2021-09-20 15:40:56 -04:00
juan.marchionatto 1492b9220a Add test comment 2021-09-20 11:15:53 -04:00
juan.marchionatto d706caf949 merge master in 2021-09-20 11:08:17 -04:00
juan.marchionatto d372371f36 Make sure a loinc CodeSystem always has a ForcedId 2021-09-20 08:51:51 -04:00
Tadgh 3b1bf7aa09
Merge branch 'master' into 2849_add_new_mdm_param 2021-09-17 13:27:09 -04:00
Jaison B 8bb9aca8df Merge branch 'master' into 2849_add_new_mdm_param 2021-09-17 10:18:24 -06:00
jmarchionatto 115056800c
Merge branch 'master' into issue-2995-valuesetcomposeincludeversion-is-not-set-when-uploading-terminology 2021-09-17 11:32:18 -04:00
juan.marchionatto 18e3ed68eb Revert loinc.xml deletion until current work gets completed 2021-09-16 15:14:43 -04:00
juan.marchionatto fbd23498fc Adjust test data and fix all test cases implemented so far 2021-09-16 13:41:05 -04:00
juan.marchionatto c9162cba6d Merge in fix for ISSUE-2995 2021-09-16 13:20:00 -04:00
juan.marchionatto 0dfc716a82 Adjust code validation to properly obtain CodeSystem's current version 2021-09-16 13:18:49 -04:00
James Agnew a56c85f780
Eliminate Search Coordinator ThreadPool (#2991)
* Add test

* Remove search coordinator thread pool

* Add changelog

* Add docs

* Test fixes

* Test fixes

* Test fixes

* Test fix
2021-09-16 16:37:34 +00:00
juan.marchionatto 3d3bab5102 merge master into branch 2021-09-16 11:02:17 -04:00
juan.marchionatto 16e329e40c Add version to ValueSet.compose.include when uploading terminology 2021-09-15 14:40:21 -04:00
Tadgh 724e4b37da Fix up test to actually match 2021-09-15 11:24:01 -04:00
Tadgh 171f0f8724 fix rulebuilder 2021-09-15 09:04:45 -04:00
Tadgh a0c8cc4279 fix test 2021-09-15 01:23:43 -04:00
Tadgh 8f0e8b9e51 remove useless DB calls 2021-09-14 18:44:55 -04:00
Tadgh 9bb1558b71 Update query count ttest 2021-09-14 17:45:09 -04:00
Tadgh bb5e04e706 Fix broken test 2021-09-14 17:22:25 -04:00
Tadgh b25bdc1169 Remove crazy double encoding 2021-09-14 13:48:37 -04:00
Tadgh 9771210553 Prefer non-lazy outcomes in map 2021-09-14 13:40:53 -04:00
Tadgh 49debec36a Fix problem with null conditionals 2021-09-14 10:48:56 -04:00
juan.marchionatto bd456dfff2 Enhance test by adding operations use cases. Improve test data with more version differentiators. 2021-09-14 10:00:15 -04:00
juan.marchionatto 8288d12e97 Obtain current CodeSystem from null-pointed ForcedId, as done for ValueSet 2021-09-14 09:58:32 -04:00
Tadgh 9d982c5e08
Merge branch 'master' into conditional-bug 2021-09-14 08:51:58 -04:00
Tadgh 1ca313f8ad lower logging 2021-09-13 21:27:05 -04:00
Tadgh b4e2679872 Remove jetbrains 2021-09-13 21:15:23 -04:00
Tadgh a0cd83398b Bump test java to 16 2021-09-13 20:52:14 -04:00
Tadgh 3ccadd636e
Merge branch 'master' into 2958-consistent-error-handling 2021-09-13 19:38:57 -04:00
Justin Dar 876768718d Remove log 2021-09-13 11:29:36 -07:00
Justin Dar 3ca73f1067 Merge remote-tracking branch 'origin/2958-consistent-error-handling' into 2958-consistent-error-handling 2021-09-13 11:26:39 -07:00
Justin Dar 46936e1704 Fixed code formatting and better way of fixing issue 2021-09-13 11:26:21 -07:00
Tadgh 5f86370c98 Merge branch 'master' into conditional-bug 2021-09-13 13:04:10 -04:00
Tadgh 59c8765e6a Add implementation to validate conditional URLs post-transaction 2021-09-13 13:03:44 -04:00
Ken Stevens eee7d7e455
code cleanup (#2986)
* failed attempt to get it to work

* Use simplified FhirContext.forCached methods

* Update hapi-fhir-base/src/main/java/ca/uhn/fhir/context/FhirContext.java

Co-authored-by: James Agnew <jamesagnew@gmail.com>

Co-authored-by: James Agnew <jamesagnew@gmail.com>
2021-09-13 03:09:18 +00:00
James Agnew 5554431146
Avoid dead SearchParameter links in CapabilityStatement (#2790)
* Avoid dead SearchParameter links in CapabilityStatement

* Resolve fixmes

* Build fix

* Test fix

* Test fix

* Test fix

* Work on metadata

* Fixes

* Test fixes

* Test fix

* Test fix

* Test fixes

* Test fix

* Work on test fixes

* Test fixes

* Test fixes

* Test fixes

* Test fix

* Fix params

* Resolve fixme

* Adjust changelogs

* Version bump to 5.6.0-PRE7

* Add license header

* Bump version to 5.6.0-PRE5-SNAPSHOT
2021-09-11 18:27:18 -04:00
Tadgh 94f157a4ac Start refactoring of basetransactionprocessor 2021-09-11 15:13:05 -04:00
Tadgh b224463d35 add broken test 2021-09-10 22:46:35 -04:00
jdar8 a02a9e0254
Merge branch 'master' into 2958-consistent-error-handling 2021-09-10 17:02:31 -07:00
Justin Dar 2163e6e548 Fixed error that previous fix caused 2021-09-10 12:36:11 -07:00
Justin Dar 77845d66f7 Improved code formatting 2021-09-10 10:54:33 -07:00
juan.marchionatto 5b6ac3e6d6 Refactor to eliminate duplication 2021-09-10 11:22:04 -04:00
Dušan Markovič d6d862015b Address concerns in review for issue 2975 2021-09-10 15:46:27 +02:00
juan.marchionatto d7fde3f984 Simplify implementation. Add tests. 2021-09-10 09:32:47 -04:00
Dušan Markovič cfc0c7e6b3 Add test for validation of multiple hosts in ElasticsearchHibernatePropertiesBuilder 2021-09-10 11:44:15 +02:00
Dušan Markovič 032a9155f0 Merge branch 'master' of https://github.com/hapifhir/hapi-fhir into issue_2975 2021-09-10 09:11:06 +02:00
Justin Dar 836948010f Fixes issue (#2958) where Procedure?patient caused inconsistent results and ensured that such requests gave http 400 2021-09-09 16:10:09 -07:00
Dušan Markovič ed325e9e11 Enable multiple hosts in ElasticsearchHibernatePropertiesBuilder 2021-09-10 00:14:21 +02:00
Tadgh a4ba65a9fd Don't wrap known errors 2021-09-09 12:27:34 -04:00
Tadgh d5f3b5db18 Merge branch 'master' into fix-batch-pool-breaking 2021-09-09 11:28:44 -04:00
Tadgh 41d5e2b8e7 Add failing test, implementation 2021-09-09 10:50:54 -04:00
Ken Stevens 661ca02a6a revert clobbered code 2021-09-09 09:28:01 -04:00
Dušan Markovič c6aa21b915 Enable empty username and password in ElasticsearchHibernatePropertiesBuilder 2021-09-09 12:55:04 +02:00
Ken Stevens 5bc571d97d fix test 2021-09-09 01:00:12 -04:00
Ken Stevens 519244a2ea unit test passes 2021-09-08 19:14:50 -04:00
Tadgh 0ccd71faf8
Merge pull request #2963 from hapifhir/custom-elastic-index
Custom elastic index
2021-09-08 14:29:58 -04:00
Tadgh fbf6b35d2e
Merge branch 'master' into custom-elastic-index 2021-09-08 08:49:26 -04:00
Tadgh 5d5c45e357 Add whitespace 2021-09-08 08:49:19 -04:00
Tadgh f04cf02be7
Merge branch 'master' into issue-2901-npe-in-bundle-transaction 2021-09-08 08:45:47 -04:00
Tadgh c2414d2cae Throw error if misconfigured 2021-09-07 18:35:59 -04:00
Tadgh 436c74616b
Merge branch 'master' into custom-elastic-index 2021-09-07 18:19:35 -04:00
Jason Roberts 34075911ce Merge branch 'master' into jr-20210831-contained-chained-search 2021-09-07 17:28:24 -04:00
Jason Roberts 207558dba3 code review feedback 2021-09-07 17:27:22 -04:00
Kevin Dougan SmileCDR 2dcc4f534f
Resolve Search Causing JOINs on HFJ_RESOURCE Checking RES_TYPE and RES_DELETED_AT Columns (#2964) 2021-09-07 19:38:08 +00:00
jamesagnew a3743fbcca Add utility method 2021-09-07 14:21:50 -04:00
Tadgh 3ec47cb0ba Bump version as we break the localcontainerentitymanagerfactory bean constructors args 2021-09-07 13:58:22 -04:00
Tadgh 6a2a5d5097 Merge branch 'master' into custom-elastic-index 2021-09-07 13:56:56 -04:00
Tadgh eabe3e7c74 Merge branch 'master' into custom-elastic-index 2021-09-07 13:56:44 -04:00
Tadgh ecd93c9e8a Add changelog 2021-09-07 13:54:28 -04:00
Tadgh 16752f393c Finalize implementation 2021-09-07 13:33:03 -04:00
leif stawnyczy 4d7f53851c issue-2901 cleanup of code/imports 2021-09-07 12:08:32 -04:00
leif stawnyczy 69287b6bc3 issue-2901 review fixes - moving methods to idhelperservice 2021-09-07 11:52:11 -04:00
Jari Maijenburg d3d7c6e97e
Merge branch 'master' into npe_fix 2021-09-07 17:36:05 +02:00
Nick Goupinets 35aaa98431 Merge branch 'master' into 2849_add_new_mdm_param 2021-09-07 11:27:49 -04:00
Tadgh ca2a1ff9df Add HsTest replicating boot failure 2021-09-07 10:08:17 -04:00
Jason Roberts 190ca7a2b5 tests for longer chains 2021-09-07 09:40:49 -04:00
Tadgh ad5d56172a Return 2 unused beans 2021-09-07 09:11:48 -04:00
Ken Stevens a1733ed3eb cleanup 2021-09-06 13:55:19 -04:00
Ken Stevens 4281648a33 extract some methods for readability 2021-09-06 13:52:10 -04:00
Ken Stevens ea153334fb extract some methods for readability 2021-09-06 13:50:09 -04:00
Tadgh 710fb3bd89 wip 2021-09-05 00:04:13 -04:00
Tadgh f0a8659653 Fix template and setup static prefix as sample 2021-09-04 23:55:03 -04:00
Jari Maijenburg cdb7ffb0d3 Fixed NPE in PidToIBaseResourceProcessor 2021-09-04 01:44:07 +02:00
Nick Goupinets c63a503841 Updated link processing for MDM events 2021-09-03 16:29:26 -04:00
leif stawnyczy 64270a51e0 issue-2901 review fixes 2021-09-03 15:36:42 -04:00
Jason Roberts 0dad28fb33 tidy up 2021-09-03 15:02:19 -04:00
Ken Stevens 346e29920a
Issue 2927 convert mdm clear to spring batch (#2929)
* initial roughout of mdm clear batch job

* still roughing out classes

* finished first draft of reader

* most tests passing now

* all tests pass.  now FIXMEs

* FIXMEs done.  Time for regression.

* fix test

* changelog and docs

* fix test

* pre-review cleanup

* version bump

* move spring autowire deps for cdr

* move spring autowire deps for cdr

* finally got beans working phew

* rearrange method calls so persistence module can perform clear operation on its own

* Update hapi-fhir-docs/src/main/resources/ca/uhn/hapi/fhir/docs/server_jpa_mdm/mdm_operations.md

Co-authored-by: Tadgh <tadgh@cs.toronto.edu>

* review feedback

* review feedback

* Remove inheritance

* fix beans

Co-authored-by: Tadgh <tadgh@cs.toronto.edu>
Co-authored-by: Tadgh <garygrantgraham@gmail.com>
2021-09-03 14:58:19 -04:00
Jason Roberts 8a9e4e4328 force the resource table to be the root of the query if we might be traversing a contained reference 2021-09-03 11:26:46 -04:00
Vadim Karantayer b29a61df40 update TestUtil to test Embeddable classes, not just Entity classes 2021-09-03 10:40:54 -04:00
leif stawnyczy 78c71ce761 issue-2901 fix tests 2021-09-03 08:38:19 -04:00
Jason Roberts 5604cabbe8 add tests for qualifiers 2021-09-03 07:45:57 -04:00
Jason Roberts 0edf77d214 clean up a bit 2021-09-03 07:31:49 -04:00
Kevin Dougan SmileCDR fed755523f
Resolve - Avoid JOINs on HFJ_RESOURCE Checking RES_TYPE and RES_DELETED_AT Columns (#2944)
* Added the start of a new Unit Test.

* Renamed the Unit Test.

* Fleshed out the Unit Test with additional Resource properties.

* Tweaked the Unit Test more but it is still not working as desired so more changes will be needed to replicate the specific scenario...

* More Unit Test tweaks...

* More Unit Test tweaks.

* More tweaks...

* Reproduced the problem.

* Finally, a Failing Unit Test that exposes the problem.

* Fixed the Unit Test by changing how SearchBuilder manipulates underscore params.

* Added another test scenario.

* Added a third search test.

* Removed the third search example since it was not effective.

* Test fix

Co-authored-by: jamesagnew <jamesagnew@gmail.com>
2021-09-03 05:28:04 -04:00
Tadgh 2ed7019a6c Add another test 2021-09-03 00:08:12 -04:00
Frank Tao 8651990cac Fixed class cast issue 2021-09-02 23:04:30 -04:00
Frank Tao 56890dba93 Reformatted the code 2021-09-02 22:26:55 -04:00
Frank Tao be96adb694 Merge branch 'poc-chained-not-bug' into ft-search-with-not-modifier
# Conflicts:
#	hapi-fhir-jpaserver-base/src/main/java/ca/uhn/fhir/jpa/search/builder/QueryStack.java
#	hapi-fhir-jpaserver-base/src/test/java/ca/uhn/fhir/jpa/provider/r4/ResourceProviderSearchModifierR4Test.java
2021-09-02 22:07:22 -04:00
Frank Tao b81a61e465 Fixed :not modifier issue for the resource 2021-09-02 21:52:37 -04:00
VK-SMILECDR 39f18e1897
Merge branch 'master' into 2948 2021-09-02 17:24:15 -04:00
Vadim Karantayer c28f5e75b3 update TestUtil to recursively scan down into subpackages 2021-09-02 15:35:40 -04:00
Jason Roberts 9fd2746113 fixed the double chain with contained resource second case 2021-09-02 14:38:30 -04:00
Tadgh 26ff15f939
Revert "Fix search of :not modifier" 2021-09-02 14:33:30 -04:00
Tadgh 6c700f9432 Add POC for failure 2021-09-02 13:33:27 -04:00
leif stawnyczy 6f82e3568c issue-2901 remove debug code 2021-09-02 13:20:38 -04:00
leif stawnyczy 49124c298d issue-2901 fixing test 2021-09-02 13:15:24 -04:00
leif stawnyczy ff7433edd7 issue-2901 cleaning up test contexts 2021-09-02 11:43:12 -04:00
leif stawnyczy cbfcc02a92 issue-2901 removing cruft and cleaning up 2021-09-02 11:07:06 -04:00
leif stawnyczy 1a7b101d03 Merge branch 'master' into issue-2901-npe-in-bundle-transaction 2021-09-02 10:13:04 -04:00
leif stawnyczy 0286eb5278 issue-2901 updated some documentation and added support for autocreated placeholder / autoversioned references at paths when in transactios and have not been created yet 2021-09-02 09:15:39 -04:00
Tadgh b1d192637d
Merge pull request #2928 from hapifhir/ft-search-with-not-modifier
Fix search of :not modifier
2021-09-02 08:41:16 -04:00
Ben Li-Sauerwine 6e389d6f59 Merge branch 'memorycacheservicefix' of https://github.com/theGOTOguy/hapi-fhir into memorycacheservicefix 2021-09-01 15:05:32 -04:00
Ben Li-Sauerwine 0724e652bb Refactor to prevent adding additional signatures to expungeEverythingByType. 2021-09-01 15:04:31 -04:00
Ben Li-Sauerwine 3789bc0f75
Merge branch 'master' into memorycacheservicefix 2021-09-01 13:55:03 -04:00
Jason Roberts 2e2048ce52 Add more test cases, not passing 2021-09-01 13:37:45 -04:00
katie_smilecdr 453ef7ec1c Merge branch 'master' into 2935_Search_with_trailing_percent_sign 2021-09-01 11:33:26 -04:00
Ben Li-Sauerwine 7001272e4b Clear out the memory cache whenever we call the ExpungeEverythingService. 2021-09-01 01:26:47 -04:00
Ben Li-Sauerwine 444bc5f330
Merge branch 'master' into memorycacheservicefix 2021-08-31 20:26:31 -04:00
Ben Li-Sauerwine 51fe5ec5e7 Remove extra update from test. 2021-08-31 20:16:22 -04:00
Frank Tao 44b0d3e9e7
Fixed $lookup with displayLanguage caching issue (#2932)
* Fixed $lookup with displayLanguage caching issue

* Added changelog and optimized the test cases
2021-08-31 22:18:40 +00:00
juan.marchionatto 28e3265b6c Merge branch 'master' into issue-2851-upload-terminology-valueset-parallel-versioning 2021-08-31 15:52:24 -04:00
katie_smilecdr a1fbeeacaa [2935] Escape "%" in like expression 2021-08-31 15:11:06 -04:00
Ken Stevens c1dc342659 more logs 2021-08-31 15:06:51 -04:00
Ken Stevens ef4adda527 failing tests 2021-08-31 14:53:05 -04:00
Tadgh d75af14d29 Merge branch 'master' into double-conditionalCreateIssue 2021-08-31 14:25:51 -04:00
Tadgh 765b18013c
Merge branch 'master' into fix-intermittent-in-tests 2021-08-31 14:22:22 -04:00
juan.marchionatto 710343a599 Use ForcedId to get current ValueSet version 2021-08-31 13:33:39 -04:00
Tadgh 825ac1e81c Chnge privacy 2021-08-31 12:58:00 -04:00
Tadgh b1515b5963 Lazy load executor so that tests work safely. 2021-08-31 12:57:45 -04:00
Tadgh c9f5dfd6d3 Swap to SyncTaskExecutor 2021-08-31 11:33:06 -04:00
Tadgh 2f6d8c7b35 Revert logging 2021-08-31 10:56:31 -04:00
Tadgh 0f6ae50105 Fix bug in hashToSearchMap 2021-08-31 10:47:23 -04:00
leif stawnyczy a38b791141 issue-2901 added db access method for existence and setting the version to 1 if createplaceholders is true and object does not exist in db 2021-08-31 10:12:40 -04:00
Tadgh 7534ab58f3 Add failing test 2021-08-31 09:58:38 -04:00
Ben Li-Sauerwine f04ff3fd0a Adds failing test for expunging and recreating a Patient with a profile in its meta field. 2021-08-31 02:04:27 -04:00
leif stawnyczy e7c6ce920d issue-2901 checkin to test 2021-08-30 10:29:59 -04:00
Frank Tao 3f128be34d Update the code 2021-08-28 13:29:00 -04:00
Frank Tao 88d535c608 Update the comment 2021-08-28 13:27:40 -04:00
Frank Tao 9bdef1a9fa Fix search of :not modifier 2021-08-28 13:24:09 -04:00
Tadgh 513bc387e9 Remove essentially duplicate bean definition 2021-08-27 13:20:29 -04:00
Tadgh faf4dfd056 fix other test class 2021-08-27 12:04:56 -04:00
Tadgh c2c6e0b440 Force the caller to run the bundle task if we are operating with <= 1 pool size 2021-08-27 12:01:10 -04:00
juan.marchionatto f63f12e976 Use boolean parameter as DAO misinterprets RequestDetails 2021-08-27 10:57:06 -04:00
juan.marchionatto 3fbae63968 Merge master 2021-08-26 13:09:11 -04:00
Tadgh 0304ea2d62 Add requested test 2021-08-26 12:03:00 -04:00
juan.marchionatto 426315f589 Consider last stored ValueSet not necessarily current version anymore. 2021-08-26 10:40:10 -04:00
leif stawnyczy 99cd865174 test 2021-08-26 08:47:45 -04:00
leif stawnyczy 646592b1b7 issue-2901 some refactoring 2021-08-25 15:56:55 -04:00
Frank Tao 090a8b0821
Impl displayLanguage for $lookup (#2908)
* Impl displayLanguage for $lookup - first cut

* Added original lookupCode method

* Added original lookupCode method to IFhirResourceDaoCodeSystem

* Added more test cases and changelog
2021-08-25 14:47:10 -04:00
leif stawnyczy b51c722755 stashing minor refactors 2021-08-25 10:41:58 -04:00
Tadgh 37ad73a422 Bump PRE version so we don't conflict downstream 2021-08-23 15:42:18 -04:00
Tadgh 1acaf325c5 Merge branch 'master' into rel_5_5_0 2021-08-23 14:50:29 -04:00
Tadgh ee9c630228 Merge branch 'master' into issue-2901-npe-in-bundle-transaction 2021-08-23 12:05:31 -04:00
James Agnew 3ebb374059
Avoid redundant resource type selector in _id query (#2909)
* Fixed

* Add more tests

* Test fixes
2021-08-23 09:04:51 -04:00
Frank Tao 4c2ae513d8
Process bundle batch in parallel (#2905)
* Process batch in parallel

* Added a test case

* Added more test cases

* Default the bundle batch to single thread.

* Tried transaction before multi-thread.

* Updated the test cases

* Update based on review comments and add changelog

* Updated the changelog

* Restore QueueCapacity
2021-08-20 21:14:08 -04:00
Tadgh 3135e82ea7 Strip jetbrains annotations 2021-08-20 18:48:34 -04:00
Tadgh 35440d3b1b
Merge pull request #2900 from hapifhir/bump-hapi-core-for-5-5-0
Bump hapi core for 5 5 0
2021-08-20 18:03:29 -04:00
markiantorno f3fe7130c0 flipped case for code validation test 2021-08-20 14:36:37 -04:00
markiantorno 3cfc41f840 updating all convertor calls to not failfast 2021-08-20 14:11:20 -04:00
markiantorno 770b773761 JPA conversion lib fixes 2021-08-20 11:08:14 -04:00
Tadgh c2e3401185 Move display name 2021-08-19 17:25:51 -04:00
Tadgh 3556299332 Add another failing Test 2021-08-19 17:25:15 -04:00
Tadgh 77c99e47c1 TIL that anyString() wont match nulls in Mockito, but any() will 2021-08-19 15:15:51 -04:00
Tadgh 19d181989c Add another failing test 2021-08-19 14:52:48 -04:00
James Agnew 85517c47e2
Include includes on revincludes (#2902)
* Include includes on revincludes
2021-08-19 12:31:29 -04:00
Tadgh 07937e4431 Start with failing test 2021-08-19 10:35:14 -04:00
markiantorno 367b338d85 Updating HAPI to use latest core lib changes. 2021-08-18 11:06:14 -04:00
Tadgh 1f7fb52d91 set version map to check all partitions 2021-08-17 16:45:12 -04:00
Tadgh cf917d0f82 Version Bump 2021-08-15 16:54:38 -04:00
Frank Tao 4920f0a15d
Don't create designation of all components are empty (#2891)
* Don't create designation of all components are empty

* Fixed typo
2021-08-13 11:01:50 -04:00
Tadgh 669cf05b30 Modify SearchParameterMap toNormalizedQueryString to include value of _contained parameter 2021-08-12 14:25:12 -04:00
juan.marchionatto fb855620da Save version collections also when version is not made current.
Add test covering bug.
2021-08-11 12:49:54 -04:00
Tadgh 41ec1e03c0
Merge pull request #2880 from hapifhir/weird-contained-issue
Contained Issue
2021-08-11 08:27:54 -04:00
Tadgh e311835e8d Revert test 2021-08-10 18:44:42 -04:00