Mark Payne
1be0871473
NIFI-2854: Refactor repositories and swap files to use schema-based serialization so that nifi can be rolled back to a previous version after an upgrade.
...
NIFI-2854: Incorporated PR review feedback
NIFI-2854: Implemented feedback from PR Review
NIFI-2854: Ensure that all resources are closed on CompressableRecordReader.close() even if an IOException is thrown when closing one of them
This closes #1202
2016-11-18 14:53:13 -05:00
Oleg Zhurakousky
5fd4a55791
NIFI-2778 added abilty to interrupt Lucene search
...
polishing
This closes #1138
2016-11-07 16:28:16 -05:00
Andre F de Miranda
3b408f5601
NIFI-2816 - Clean typos across the code - Part 2. This closes #1085
2016-10-05 13:07:57 -04:00
Mike Moser
85a1f753a7
NIFI-2787 truncate flowfile attributes that get indexed to fit within Lucene limits
...
Signed-off-by: Joe Skora <jskora@apache.org>
This closes #1043
2016-09-23 16:01:23 -04:00
Mark Payne
088125451b
NIFI-2681: Refactored IndexManager into an interface and renamed the existing implementation to CachingIndexManager. Implemented a new SimpleIndexManager that performs no caching of IndexSearchers.
...
This closes #958 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-06 12:25:28 -04:00
Joseph Percivall
1fe18a1567
NIFI-2676-rc1 prepare for next development iteration
2016-08-26 11:40:58 -04:00
Joseph Percivall
74d5224783
NIFI-2676-rc1 prepare release nifi-1.0.0-RC1
2016-08-26 11:40:44 -04:00
Mark Payne
95b5877f5d
NIFI-2600: Ensure that we do not close Index Searchers prematurely, even if they are poisoned
...
This closes #896
2016-08-22 12:03:47 -04:00
joewitt
7d7401add4
NIFI-2574 Changed NiFiProperties to avoid static initializer and updated all references to it.
2016-08-17 00:10:07 -07:00
Yolanda M. Davis
fbd3201157
NIFI-2524 - Fixes to improve handling of missing journal files during rollover/merge execution.Includes:
...
This closes #840
Removed partial file check (based on missing first file)
Added condition to merge if at least one journal files available on disk. If all files are missing from disk that is considered an error.
Added retry logic to prevent endless thread execution when encountering errors (such as missing files).
2016-08-15 14:43:38 -04:00
Mark Payne
8752d11f18
NIFI-2495 This closes #808 . Ensure that we always close Index Searchers when we're finished with them
2016-08-08 16:54:27 -04:00
Mark Payne
16348b071d
NIFI-2452: This closes #771 . Ensure that we keep track of how many references we have to each lucene searcher and only close the underlying index reader if there are no references to the searcher. Also updated to prefer newer provenance events over older provenance events, and calculate FlowFile lineage based on an event id instead of a FlowFile UUID, as it's much more efficient
2016-08-03 08:05:26 -07:00
Mark Payne
e9b87dd734
NIFI-2452: Ensure that we do not close Index Readers that are still in use
2016-08-03 07:54:10 -07:00
Mark Payne
cfc8a9613c
NIFI-2395 This closes #734 . Ensure that if we fail to index provenance events we do not prevent the repo from continuing to merge journals
2016-07-29 09:33:47 -04:00
Matt Gilman
69586d8bd0
NIFI-2346:
...
- Introducing data resource for authorizing provenance events and queue listing.
- Authorizing entire proxy chain for data resource and data transfer resource.
NIFI-2338:
- Ensuring that replay authorization only happens once.
- Allowing users with access to policies for a component to be able to access all policies for that component.
-- Includes the component, data, data transfers, and policies.
- Fixing drop request completion to update the correct queued field.
- Fixing access control check for listing and emptying queues.
- Reseting selected policy when re-opening the policy management page.
- Fixing button/link visibility for available actions in policy management page.
- Fixing policy issues with policy removal when the underlying component is deleted.
- Updating file authorizer seeding to grant data access to node's in the cluster.
This closes #720 .
2016-07-26 14:15:36 -04:00
Aldrin Piri
d1129706e2
NIFI-1896 This closes #650 . Refactored nifi-api into nifi-framework-api and other locations. The nifi-api is specific to that which is needed for intended extension points.
2016-07-14 18:24:48 -04:00
Mark Payne
2540573d77
NIFI-2087: Do not update the lucene index to delete expired events. Instead, just wait for the entire index to expire and remove the files for that index. This is much more efficient.
...
This closes #652
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-14 14:49:30 -04:00
joewitt
f987b21609
NIFI-1157 searched for and resolved all remaining references to deprecated items that were clearly addressable.
2016-07-14 09:32:35 -04:00
joewitt
961be21a38
NIFI-1157 resolved deprecated nifi-api items and ripple effects
2016-07-14 09:32:34 -04:00
Bryan Bende
ba763b95e8
NIFI-2003 Creating abstract authentication provider and incorporating into existing providers
...
NIFI-2201 Add support for seeding cluster nodes in authorizations.xml
- Passing client address along in user context on authorization requests
- This closes #628
2016-07-12 11:20:29 -04:00
Mark Payne
32b8a9b9f4
NIFI-1877, NIFI-1306: Add fields to FlowFile for FIFO Prioritizer, Oldest/Newest FlowFile first prioritizers to work properly
...
This closes #546
2016-07-05 14:59:08 -04:00
Matt Gilman
ce5330330a
NIFI-1781:
...
- Updating UI according to permissions through out the application.
- Shuffling provenance events, template, and cluster search REST APIs according to resources being authorized.
- Moving template upload controls.
- Removing username where appropriate.
- Addressing issues when authorizing flow configuration actions.
- Code clean up.
2016-07-01 15:10:27 -04:00
Mark Payne
ae9e2fdf0b
NIFI-2123: Add authorization of provenance events; refactor core classes so that Authorizable is located within nifi-api. This closes #592
2016-06-30 07:57:17 -04:00
Mark Payne
0e085bdddd
NIFI-2065: When a provenance query matches the max number of results requested, stop querying lucene for improved performance
...
This closes #558
2016-06-22 13:27:31 -04:00
Oleg Zhurakousky
a8b42c26b6
NIFI-2006 fixed NPE in PersistentProvenanceRepository
...
Fixed NPE in PersistentProvenanceRepository caused by attribute value being null
added test
This closes #528
2016-06-14 15:15:37 -04:00
Simon Elliston Ball
55d32ae610
NIFI-1925 Fixed typo
...
This closes #468
2016-06-06 10:33:28 -04:00
Matt Gilman
2de7f3f884
Updating versions to 1.0.0-SNAPSHOT.
2016-04-04 11:36:20 -04:00
Aldrin Piri
e977729b56
NIFI-1634-rc2 prepare for next development iteration
2016-03-23 18:56:34 -04:00
Aldrin Piri
0b9bd20d31
NIFI-1634-rc2 prepare release nifi-0.6.0-RC2
2016-03-23 18:56:22 -04:00
Tony Kurc
ad73b5c9d9
NIFI-1379-RC3 prepare for next development iteration
2016-02-12 17:28:10 -05:00
Tony Kurc
8309dba80b
NIFI-1379-RC3 prepare release nifi-0.5.0-RC3
2016-02-12 17:27:59 -05:00
Tony Kurc
303f8eabf1
NIFI-1379: Move to 0.5.0-SNAPSHOT, add tkurc code signing key to keys
2016-02-06 08:49:48 -05:00
Mark Payne
925138b6c4
NIFI-1404: Fixed NPE that resulted on startup if there was a Provenance file that had no events
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-01-25 21:55:48 -05:00
Mark Payne
05dabe034c
NIFI-1433: Once we roll over journal files, don't attempt to roll them over again
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-01-24 15:29:47 -05:00
joewitt
f4ac8d75c5
NIFI-1312-RC1 prepare for next development iteration
2015-12-19 00:41:04 -05:00
joewitt
d624ea4866
NIFI-1312-RC1 prepare release nifi-0.4.1-RC1
2015-12-19 00:40:53 -05:00
joewitt
d755e43ec8
NIFI-1122_nifi-0.4.0-RC2prepare for next development iteration
2015-12-08 13:00:10 -05:00
joewitt
b66c029090
NIFI-1122_nifi-0.4.0-RC2prepare release nifi-0.4.0-RC2
2015-12-08 12:59:59 -05:00
Tony Kurc
3a7ddc6a35
NIFI-1054: Fixed DOS line endings in xml, java and js source files
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-12-01 22:49:51 -05:00
Aldrin Piri
08d59e4374
NIFI-1196 Providing handling of FETCH provenance events for their "unique" property, transit URI, within the framework and UI.
...
Reviewed by Tony Kurc (tkurc@apache.org )
2015-11-19 17:42:15 -05:00
Oleg Zhurakousky
15880f9fcc
NIFI-748 addressed PR comments
...
- made DocReader package private
- polished logic in read(..) method to avoid escaping the loop
- added call to sorting logic in LuceneUtil.groupDocsByStorageFileName(..) to ensure that previous behavior and assumptions in read(..) methodd are preserved
- other minor polishing
2015-11-16 08:39:23 -05:00
Oleg Zhurakousky
a4d93c62c8
NIFI-748 Fixed logic around handling partial query results from provenance repository
...
- Ensured that failures derived form correlating Document to its actual provenance event do fail the entire query and produce partial results with warning messages
- Refactored DocsReader.read() operation.
- Added test to validate two conditions where the such failures could occur
2015-11-13 14:23:31 -05:00
Mark Payne
73c1671975
NIFI-1132: Limited number of Lineage Identifiers held to 100 and marked the getLineageIdentifiers() method as deprecated
2015-11-09 12:09:56 -05:00
Mark Payne
5f8fdae909
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-11-09 12:07:45 -05:00
Mark Payne
59a49aea12
Revert "NIFI-1082: Ensure that events returned from the provenance repository are ordered such that newest events are provided first"
...
This reverts commit cf8ca3dc2c
.
2015-11-08 21:46:06 -05:00
joewitt
99629646fe
NIFI-1122 moved to 0.4.0-SNAPSHOT
2015-11-06 23:41:15 -05:00
Mark Payne
cf8ca3dc2c
NIFI-1082: Ensure that events returned from the provenance repository are ordered such that newest events are provided first
2015-10-28 17:32:51 -04:00
Matt Gilman
ded74ec94c
NIFI-876 prepare for next development iteration
2015-09-14 21:48:11 -04:00
Matt Gilman
2ec735e350
NIFI-876 prepare release nifi-0.3.0-RC1
2015-09-14 21:48:00 -04:00
Mark Payne
4a7d1fe618
NIFI-936: Ensure that if we fail to write a record to the repository that we do not write to that log file again
2015-09-11 14:55:48 -04:00