fbd3201157
NIFI-2524 - Fixes to improve handling of missing journal files during rollover/merge execution.Includes:
...
This closes #840
Removed partial file check (based on missing first file)
Added condition to merge if at least one journal files available on disk. If all files are missing from disk that is considered an error.
Added retry logic to prevent endless thread execution when encountering errors (such as missing files).
2016-08-15 14:43:38 -04:00
8752d11f18
NIFI-2495 This closes #808 . Ensure that we always close Index Searchers when we're finished with them
2016-08-08 16:54:27 -04:00
16348b071d
NIFI-2452: This closes #771 . Ensure that we keep track of how many references we have to each lucene searcher and only close the underlying index reader if there are no references to the searcher. Also updated to prefer newer provenance events over older provenance events, and calculate FlowFile lineage based on an event id instead of a FlowFile UUID, as it's much more efficient
2016-08-03 08:05:26 -07:00
e9b87dd734
NIFI-2452: Ensure that we do not close Index Readers that are still in use
2016-08-03 07:54:10 -07:00
cfc8a9613c
NIFI-2395 This closes #734 . Ensure that if we fail to index provenance events we do not prevent the repo from continuing to merge journals
2016-07-29 09:33:47 -04:00
69586d8bd0
NIFI-2346:
...
- Introducing data resource for authorizing provenance events and queue listing.
- Authorizing entire proxy chain for data resource and data transfer resource.
NIFI-2338:
- Ensuring that replay authorization only happens once.
- Allowing users with access to policies for a component to be able to access all policies for that component.
-- Includes the component, data, data transfers, and policies.
- Fixing drop request completion to update the correct queued field.
- Fixing access control check for listing and emptying queues.
- Reseting selected policy when re-opening the policy management page.
- Fixing button/link visibility for available actions in policy management page.
- Fixing policy issues with policy removal when the underlying component is deleted.
- Updating file authorizer seeding to grant data access to node's in the cluster.
This closes #720 .
2016-07-26 14:15:36 -04:00
d1129706e2
NIFI-1896 This closes #650 . Refactored nifi-api into nifi-framework-api and other locations. The nifi-api is specific to that which is needed for intended extension points.
2016-07-14 18:24:48 -04:00
2540573d77
NIFI-2087: Do not update the lucene index to delete expired events. Instead, just wait for the entire index to expire and remove the files for that index. This is much more efficient.
...
This closes #652
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-14 14:49:30 -04:00
f987b21609
NIFI-1157 searched for and resolved all remaining references to deprecated items that were clearly addressable.
2016-07-14 09:32:35 -04:00
961be21a38
NIFI-1157 resolved deprecated nifi-api items and ripple effects
2016-07-14 09:32:34 -04:00
ba763b95e8
NIFI-2003 Creating abstract authentication provider and incorporating into existing providers
...
NIFI-2201 Add support for seeding cluster nodes in authorizations.xml
- Passing client address along in user context on authorization requests
- This closes #628
2016-07-12 11:20:29 -04:00
32b8a9b9f4
NIFI-1877, NIFI-1306: Add fields to FlowFile for FIFO Prioritizer, Oldest/Newest FlowFile first prioritizers to work properly
...
This closes #546
2016-07-05 14:59:08 -04:00
ce5330330a
NIFI-1781:
...
- Updating UI according to permissions through out the application.
- Shuffling provenance events, template, and cluster search REST APIs according to resources being authorized.
- Moving template upload controls.
- Removing username where appropriate.
- Addressing issues when authorizing flow configuration actions.
- Code clean up.
2016-07-01 15:10:27 -04:00
ae9e2fdf0b
NIFI-2123: Add authorization of provenance events; refactor core classes so that Authorizable is located within nifi-api. This closes #592
2016-06-30 07:57:17 -04:00
0e085bdddd
NIFI-2065: When a provenance query matches the max number of results requested, stop querying lucene for improved performance
...
This closes #558
2016-06-22 13:27:31 -04:00
a8b42c26b6
NIFI-2006 fixed NPE in PersistentProvenanceRepository
...
Fixed NPE in PersistentProvenanceRepository caused by attribute value being null
added test
This closes #528
2016-06-14 15:15:37 -04:00
55d32ae610
NIFI-1925 Fixed typo
...
This closes #468
2016-06-06 10:33:28 -04:00
2de7f3f884
Updating versions to 1.0.0-SNAPSHOT.
2016-04-04 11:36:20 -04:00
e977729b56
NIFI-1634-rc2 prepare for next development iteration
2016-03-23 18:56:34 -04:00
0b9bd20d31
NIFI-1634-rc2 prepare release nifi-0.6.0-RC2
2016-03-23 18:56:22 -04:00
ad73b5c9d9
NIFI-1379-RC3 prepare for next development iteration
2016-02-12 17:28:10 -05:00
8309dba80b
NIFI-1379-RC3 prepare release nifi-0.5.0-RC3
2016-02-12 17:27:59 -05:00
303f8eabf1
NIFI-1379: Move to 0.5.0-SNAPSHOT, add tkurc code signing key to keys
2016-02-06 08:49:48 -05:00
925138b6c4
NIFI-1404: Fixed NPE that resulted on startup if there was a Provenance file that had no events
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-01-25 21:55:48 -05:00
05dabe034c
NIFI-1433: Once we roll over journal files, don't attempt to roll them over again
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-01-24 15:29:47 -05:00
f4ac8d75c5
NIFI-1312-RC1 prepare for next development iteration
2015-12-19 00:41:04 -05:00
d624ea4866
NIFI-1312-RC1 prepare release nifi-0.4.1-RC1
2015-12-19 00:40:53 -05:00
d755e43ec8
NIFI-1122_nifi-0.4.0-RC2prepare for next development iteration
2015-12-08 13:00:10 -05:00
b66c029090
NIFI-1122_nifi-0.4.0-RC2prepare release nifi-0.4.0-RC2
2015-12-08 12:59:59 -05:00
3a7ddc6a35
NIFI-1054: Fixed DOS line endings in xml, java and js source files
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-12-01 22:49:51 -05:00
08d59e4374
NIFI-1196 Providing handling of FETCH provenance events for their "unique" property, transit URI, within the framework and UI.
...
Reviewed by Tony Kurc (tkurc@apache.org )
2015-11-19 17:42:15 -05:00
15880f9fcc
NIFI-748 addressed PR comments
...
- made DocReader package private
- polished logic in read(..) method to avoid escaping the loop
- added call to sorting logic in LuceneUtil.groupDocsByStorageFileName(..) to ensure that previous behavior and assumptions in read(..) methodd are preserved
- other minor polishing
2015-11-16 08:39:23 -05:00
a4d93c62c8
NIFI-748 Fixed logic around handling partial query results from provenance repository
...
- Ensured that failures derived form correlating Document to its actual provenance event do fail the entire query and produce partial results with warning messages
- Refactored DocsReader.read() operation.
- Added test to validate two conditions where the such failures could occur
2015-11-13 14:23:31 -05:00
73c1671975
NIFI-1132: Limited number of Lineage Identifiers held to 100 and marked the getLineageIdentifiers() method as deprecated
2015-11-09 12:09:56 -05:00
5f8fdae909
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-11-09 12:07:45 -05:00
59a49aea12
Revert "NIFI-1082: Ensure that events returned from the provenance repository are ordered such that newest events are provided first"
...
This reverts commit cf8ca3dc2c
2015-11-08 21:46:06 -05:00
99629646fe
NIFI-1122 moved to 0.4.0-SNAPSHOT
2015-11-06 23:41:15 -05:00
cf8ca3dc2c
NIFI-1082: Ensure that events returned from the provenance repository are ordered such that newest events are provided first
2015-10-28 17:32:51 -04:00
ded74ec94c
NIFI-876 prepare for next development iteration
2015-09-14 21:48:11 -04:00
2ec735e350
NIFI-876 prepare release nifi-0.3.0-RC1
2015-09-14 21:48:00 -04:00
4a7d1fe618
NIFI-936: Ensure that if we fail to write a record to the repository that we do not write to that log file again
2015-09-11 14:55:48 -04:00
85534ca860
NIFI-916 Refactoring how the closed flag is used in PersistentProvenanceRepository to ensure proper shutdown
2015-09-06 13:22:07 -04:00
f8c216b061
NIFI-903: Check for null value before trying to close 'out' OutputStream on StandardRecordWriter.close
2015-08-31 10:50:00 -04:00
1f6805f06d
NIFI-886 purging old events much more frequently
2015-08-21 15:40:26 -04:00
16dc5d5fd9
NIFI-756: Do not remove documents from a Lucene Index; instead, wait until the entire index is 'expired' and delete the index's directory
2015-08-19 13:53:13 -04:00
19f7db6986
NIFI-793: Added multi-threading to the indexing in the Persistent Provenance Repository
2015-08-19 12:24:25 -04:00
aa99884782
NIFI-850 removed nifi parent, updated nifi pom, moved all nifi subdirs up one level, fixed readme.
2015-08-15 13:12:22 -04:00
Yolanda M. Davis
Mark Payne
Matt Gilman
Aldrin Piri
joewitt
Bryan Bende
Oleg Zhurakousky
Simon Elliston Ball
Tony Kurc