nifi/nifi-nar-bundles/nifi-framework-bundle/nifi-framework
Mark Payne 66d5ab80eb
NIFI-7011: This closes #3983. SwappablePriorityQueue contains two internal data structures: activeQueue, swapQueue. activeQueue is intended to be pulled from for processing. swapQueue is intended to hold FlowFiles that are waiting to be swapped out. SinWe want to ensure that we first swap in any data that has already been swapped out before processing the swap queue, in order to ensure that we process the data in the correct order. This fix ddresses an issue where data was being swapped out by writing the lowest priority data to a swap file, then adding the highest priority data to activeQueue and the 'middle' priority data back to swapQueue. As a result, when polling from the queue we got highest priority data, followed by lowest priority data, followed by middle priority data. This is addressed by avoiding putting anything back on swapQueue when we swap out. Instead, write data to the swap file, then push everything else to activeQueue. This way, any new data that comes in will still go to the swapQueue, as it should, but all data that didn't get written to the Swap file will be processed before the low priority data in the swap file.
NIFI-7011: Addressed corner case where data could be inserted out of order still if added while swapping was taking place
NIFI-7011: Fixed ordering issue with swap queue that can occur if data is migrated from swap queue to active queue instead of being swapped out
2020-01-13 22:02:05 -05:00
..
nifi-administration NIFI-6733 updating to next release version for master branch 2019-11-04 13:31:39 -05:00
nifi-authorizer NIFI-6904 Moving ClassLoader creation before Authorizer instantiation 2019-11-25 13:35:21 -05:00
nifi-client-dto NIFI-6872: 2019-12-18 16:37:47 -05:00
nifi-documentation NIFI-6733 updating to next release version for master branch 2019-11-04 13:31:39 -05:00
nifi-file-authorizer NIFI-6733 updating to next release version for master branch 2019-11-04 13:31:39 -05:00
nifi-flowfile-repo-serialization NIFI-3833 Added encrypted flowfile repository implementation. 2020-01-10 10:44:59 -08:00
nifi-framework-authorization NIFI-6733 updating to next release version for master branch 2019-11-04 13:31:39 -05:00
nifi-framework-cluster NIFI-6839 - Upgrade jackson-databind direct dependencies 2019-11-25 10:58:22 -05:00
nifi-framework-cluster-protocol NIFI-6733 updating to next release version for master branch 2019-11-04 13:31:39 -05:00
nifi-framework-core NIFI-7011: This closes #3983. SwappablePriorityQueue contains two internal data structures: activeQueue, swapQueue. activeQueue is intended to be pulled from for processing. swapQueue is intended to hold FlowFiles that are waiting to be swapped out. SinWe want to ensure that we first swap in any data that has already been swapped out before processing the swap queue, in order to ensure that we process the data in the correct order. This fix ddresses an issue where data was being swapped out by writing the lowest priority data to a swap file, then adding the highest priority data to activeQueue and the 'middle' priority data back to swapQueue. As a result, when polling from the queue we got highest priority data, followed by lowest priority data, followed by middle priority data. This is addressed by avoiding putting anything back on swapQueue when we swap out. Instead, write data to the swap file, then push everything else to activeQueue. This way, any new data that comes in will still go to the swapQueue, as it should, but all data that didn't get written to the Swap file will be processed before the low priority data in the swap file. 2020-01-13 22:02:05 -05:00
nifi-framework-core-api NIFI-6884 - Native library loading fixed/improved: NarClassLoader and InstanceClassLoader can load libraries from their own or their ancestors' NAR-INF/bundled-dependencies/native directory. 2020-01-13 13:59:11 -05:00
nifi-framework-nar-loading-utils NIFI-6884 - Native library loading fixed/improved: NarClassLoader and InstanceClassLoader can load libraries from their own or their ancestors' NAR-INF/bundled-dependencies/native directory. 2020-01-13 13:59:11 -05:00
nifi-framework-nar-utils NIFI-6884 - Native library loading fixed/improved: NarClassLoader and InstanceClassLoader can load libraries from their own or their ancestors' NAR-INF/bundled-dependencies/native directory. 2020-01-13 13:59:11 -05:00
nifi-mock-authorizer NIFI-6733 updating to next release version for master branch 2019-11-04 13:31:39 -05:00
nifi-nar-utils NIFI-6884 - Native library loading fixed/improved: NarClassLoader and InstanceClassLoader can load libraries from their own or their ancestors' NAR-INF/bundled-dependencies/native directory. 2020-01-13 13:59:11 -05:00
nifi-properties-loader NIFI-3833 Added encrypted flowfile repository implementation. 2020-01-10 10:44:59 -08:00
nifi-repository-models NIFI-6733 updating to next release version for master branch 2019-11-04 13:31:39 -05:00
nifi-resources NIFI-3833 Added encrypted flowfile repository implementation. 2020-01-10 10:44:59 -08:00
nifi-runtime NIFI-6707: Addition of nifi-system-tests module. Updates to EmbeddedNiFi, NiFi and SystemBundle to properly support classloader isolation that is needed for creating system-level tests and isolating the classpath of the tests themselves from the NiFi classpath. Fixed bootstrap listener to ensure that it always closes socket before calling shutdown(). Failure to do so can result in RunNiFi sometimes timing out while waiting for a response from NiFi 2019-11-08 12:33:16 -05:00
nifi-security NIFI-6733 updating to next release version for master branch 2019-11-04 13:31:39 -05:00
nifi-shell-authorizer NIFI-6733 updating to next release version for master branch 2019-11-04 13:31:39 -05:00
nifi-site-to-site NIFI-6707: Addition of nifi-system-tests module. Updates to EmbeddedNiFi, NiFi and SystemBundle to properly support classloader isolation that is needed for creating system-level tests and isolating the classpath of the tests themselves from the NiFi classpath. Fixed bootstrap listener to ensure that it always closes socket before calling shutdown(). Failure to do so can result in RunNiFi sometimes timing out while waiting for a response from NiFi 2019-11-08 12:33:16 -05:00
nifi-standard-prioritizers NIFI-6733 updating to next release version for master branch 2019-11-04 13:31:39 -05:00
nifi-stateless NIFI-6839 - Upgrade jackson-databind direct dependencies 2019-11-25 10:58:22 -05:00
nifi-user-actions NIFI-6733 updating to next release version for master branch 2019-11-04 13:31:39 -05:00
nifi-web NIFI-6652 UI Fix overflowing text in variables dialog 2020-01-13 12:12:34 -08:00
pom.xml NIFI-6733 updating to next release version for master branch 2019-11-04 13:31:39 -05:00