Apache/nifi
1
0
Fork 0
mirror of https://github.com/apache/nifi.git synced 2025-02-22 02:15:56 +00:00
Code Issues Packages Projects Releases Wiki Activity
3,402 Commits 147 Branches 203 Tags
Commit Graph

1786 Commits

Author SHA1 Message Date
Mark Payne
fff0148a0e NIFI-3129: When adding controller services to a snippet, ensure that we don't add the service multiple times, even when it's referenced by child process groups. This closes #1284 2016-11-30 13:07:51 -05:00
Matt Burgess
ba513447d7
NIFI-3076: Fixed handling of 'medium' unsigned integers in JdbcCommon 
This closes #1254.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-11-30 13:05:38 -05:00
Matt Gilman
bc223fa197
NIFI-3117: - Checking referenced services when performing an action with a snippet that requires it. 
- Updating the SnippetManager to automatically expire unused snippets.
- Making the checking of referenced services consistent across component removal.
- Adding checking of referenced services for all nested components in a snippet.
- Updating the REST API docs to clarify when a referenced service is authorized.
- Conditionally authorizing transitive service references.

This closes #1277.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-11-30 12:50:25 -05:00
jpercivall
e3c7611347
NIFI-3112 Revert "NIFI-2199 - allows nifi.sh restart through ssh" 
This reverts commit 88d125137e3bf3faf80b522edf5cf14f99419d60.

This closes #1282.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-11-29 17:32:47 -08:00
Mark Payne
9d6ca6e1e6
NIFI-2975: Only start expiring FlowFiles after FlowFile Repository has been restored 
This closes #1274.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-11-29 09:54:15 -05:00
joewitt
92f17a995b NIFI-3100-rc2 prepare for next development iteration 2016-11-25 23:49:27 -05:00
joewitt
5536f690a8 NIFI-3100-rc2 prepare release nifi-1.1.0-RC2 2016-11-25 23:49:13 -05:00
Joey Frazee
617b62ac7a NIFI-3104 This closes #1273. Removed tests derived from HAPI test data 2016-11-25 19:39:36 -05:00
Koji Kawamura
f4f60c3610 NIFI-3103: This closes #1272. Exclude localhost.cert from RAT check. 2016-11-25 19:33:48 -05:00
Andy LoPresto
2c3714536f
NIFI-3024 Added key migration for sensitive processor properties contained in flow.xml.gz. (nifi.sensitive.props.key) 
This closes #1261.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-11-23 13:26:18 -08:00
Mark Payne
7ff14f7191 NIFI-3091: Ensure that we set the appropriate size on FlowFiles when modifying them 
This closes #1267

Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-23 12:07:44 -05:00
Mark Payne
91ff810dba NIFI-3088: Ensure that on recovery of FlowFile Repository, if we find a FlowFile that maps to an unknown queue that we log a warning that the queue is missing and drop the FlowFile, rather than throwing an NPE 
This closes #1266

Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-23 11:27:14 -05:00
joewitt
22143e386d NIFI-2991 This closes #1265. was allowed to restore twitter4j json.org usage until April. Resolution for that will be in NIFI-3089 2016-11-23 10:21:41 -05:00
Matt Burgess
7fc7494b21 NIFI-3087: This closes #1263. Added unit tests to PutElasticsearch(Http) to illustrate issue 2016-11-23 08:22:34 -05:00
Matt Burgess
d3dbac50a8 NIFI-3087: Fixed issue with partial failure responses in PutElasticsearch(Http) 2016-11-23 08:11:49 -05:00
Jeff Storck
066accc274 NIFI-3086 Updated TailFile.java to deal with windows paths that were breaking the regex parsing Fixed documentation misspelling in TailFile.java Fixed assertions in several tests in TestTailFile that were dependent on the received order of flowfiles, this was differing between Windows and MacOS/Linux 
This closes #1264

Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-23 00:01:12 -05:00
Joseph Percivall
50667ed222 NIFI-3084 Fixing TestPersistentProvenanceRepository and closing a stream leak in RecordReaders. 
This closes #1260.
 2016-11-22 17:31:47 -05:00
Oleg Zhurakousky
913ae91614 Added posix guard to ignore tests on windows 
This closes #1259

Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-22 17:11:25 -05:00
Bryan Bende
78fed3ed56
NIFI-3068 Adding @RequiresInstanceClassLoading to PutHDFS to ensure the security configuration of the Hadoop client is fully isolated between instances of PutHDFS 2016-11-22 16:41:44 -05:00
Koji Kawamura
36796b5440 NIFI-3078: Test InvokeScriptedProcessor with JS. 
This closes #1255.
 2016-11-22 21:42:36 +01:00
Matt Burgess
fa5fed9bb5 NIFI-3082: Fixed status code handling in PutElasticsearchHttp 
This closes #1258.
 2016-11-22 21:32:03 +01:00
Kathik Narayanan
9e884f6120 NiFI-3064 Convert to Avro fails when a MySQL query returns two columns with the same name even with different aliases 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1251
 2016-11-22 11:49:25 -05:00
Mark Payne
aa99cc6822
NIFI-3079: Ensure that in all cases we increment session's bytesRead count when finished reading from Content Repo 
This closes #3079.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-11-22 11:26:22 -05:00
Scott Aslan
ead9205458 [NIFI-3075] remove fixed width from combo options and add max-width css style to display ellipsis when options text is too long. This closes #1253 2016-11-21 17:27:03 -05:00
Mike Moser
15af764dd8 NIFI-2996 
- validate processors only when they are in STOPPED state
- report validation errors via REST API on processors/services/tasks/ports only when they are in the STOPPED state
- This closes #1192
 2016-11-21 17:02:25 -05:00
joewitt
fb9cbccc38 NIFI-2954 This closes #1244. Moved StandardPropertyValidator to nifi-utils, documented scope/purpose of a few util libs, removed deps from nifi-utils. 2016-11-21 16:30:42 -05:00
Matt Burgess
dba9d5924a NIFI-3011: Added Elasticsearch5 processors 
This closes #1233

Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-21 15:58:40 -05:00
Matt Gilman
7f5eabd603
NIFI-3050: Implemented access control logic for restricted components. 
- Addressing comments from PR.
- Adding restricted tags to relevant components.
- Showing a restricted icon overlay on the processor node on the canvas. (+1 squashed commit)
Squashed commits:
[f487682] NIFI-3050:
- Introducing a Restricted annotation for components that require elevated privileges to use.
- Updating the new Processor, Controller Service, and Reporting Task dialogs to include these details and prevent unauthorized selection.
- Including the Restricted description in the generated component documentation.
- Updating processor access control integration test to verify restricted component creation.
- Updating the developer, user, and admin guide to include the restricted component policy.

This closes #1247.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-11-21 12:07:48 -08:00
Matt Burgess
eb5abf809d
NIFI-2927: Added Validation Query to HiveConnectionPool 
This closes #1252.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-11-21 14:21:22 -05:00
Peter Wicks
d65f46f7a5 NIFI-2750 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2750

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2750 Tweaking Property Retrieval

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1001
 2016-11-21 12:58:17 -05:00
Mark Payne
2ee66de1a6 NIFI-3066: Create unit test to reproduce bug that results in IllegalArgumentException: Cannot migrate FlowFiles from a Process Session to itself 
NIFI-3066: Ensure that when a Bin is created, it is always created with its own new session

This closes #1245
 2016-11-21 11:34:14 -05:00
Joey Frazee
e731f09573 NIFI-3061: Bumped azure-eventhubs version to 0.9.0 
This closes #1250.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-11-21 10:30:28 +09:00
Matt Gilman
c8830742ee NIFI-3020: 
- Introducing a strategy for identifying users.
- Fixing issue with the referral strategy error message.
- Adding code to shutdown the application when the authorizer or login identity provider are not initialized successfully.

NIFI-3020:
- Updating the admin guide to document the identity strategy.

NIFI-3020:
- Ensuring the request replicator attempts to shutdown regardless of whether the flow service properly terminates.

This closes #1236
 2016-11-19 08:38:41 -05:00
Mark Payne
1be0871473 NIFI-2854: Refactor repositories and swap files to use schema-based serialization so that nifi can be rolled back to a previous version after an upgrade. 
NIFI-2854: Incorporated PR review feedback

NIFI-2854: Implemented feedback from PR Review

NIFI-2854: Ensure that all resources are closed on CompressableRecordReader.close() even if an IOException is thrown when closing one of them

This closes #1202
 2016-11-18 14:53:13 -05:00
James Wing
7206318ecf NIFI-3033 GenerateFlowFile Dynamic Properties 
This closes #1222.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-11-18 11:06:20 +09:00
Bryan Rosander
e5eda63705
NIFI-2943 - Toolkit uses JKS type over PKCS12 when creating truststore because non-Bouncy Castle providers cannot read certificates from PKCS12 truststore. 
Peer review feedback (+2 squashed commits)
Squashed commits:
[0102c8e] NIFI-2943 - Peer review feedback
[9bcd495] NIFI-2943 - pkcs12 keystore improvements

1. loading pkcs12 keystores with bouncy castle everywhere
2. tls-toolkit client using jks truststore when keystore type is specified differently
3. tests

This closes #1165.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-11-16 17:13:10 -08:00
Scott Aslan
878db82375 [NIFI-2949] update remote process group port styles. This closes #1226 2016-11-16 17:08:06 -05:00
Oleg Zhurakousky
f1eca0a09a NIFI-1002 added L&N entries for Bouncy Castle 
This closes #1235
 2016-11-16 15:30:47 -05:00
Koji Kawamura
31ea50bce9 NIFI-1002: Added WebSocket support. 
- Added LICENSE and NOTICE files.
- Fixed UnitTest errors.

This closes #1231
 2016-11-16 12:17:37 -05:00
Bryan Bende
2f9ec03242 NIFI-2909 Fix logic in AbstractConfiguredComponent setProperties() for setting classpath resources in the InstanceClassLoader 
This closes #1232
 2016-11-16 11:34:52 -05:00
Matt Gilman
49afacc3ab NIFI-3022: 
- Returning the appropriate authorizable when accessing provenance events for a manual DROP event by emptying a queue.
- Populating the component details of a provenance event when the source is a connection.
 2016-11-16 10:13:18 -05:00
joewitt
45a5f5295c NIFI-2374 This closes #712. updated to latest tika versions where possible, updated doc, commented why cannot update media nar 2016-11-15 23:18:55 -05:00
Andre F de Miranda
3e571f9f1f NIFI-2374 - Adjust documentation wording to clarify IdentifyMimeType 
is a non exhaustive list of mime type values
 2016-11-15 22:42:21 -05:00
Koji Kawamura
26a5881d21 NIFI-1002: Added WebSocket support. 
NIFI-1002: Added WebSocket support.

- Reflecting review comments
- Added displayName to peroperty descriptors

NIFI-1002: Added WebSocket support.

This closes #1184

- Reflecting review comments:
  - Removed unnecessary use of NarCloseable.withComponentNarLoader.
  - Removed intermediate on memory queue to make it simpler and more
    robust. Received messages in WebSocket layer now will be transferred
to downstream relationships directly.
 2016-11-15 19:34:59 -05:00
joewitt
b026f0bebe NIFI-2991 removed json.org references as appropriate for build. Twitter proc no longer deployed but reference kept in notice just in case someone uses it 
This closes #1230

Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-15 18:09:27 -05:00
joewitt
6696529c99 Revert "NIFI-1893 Add processor for validating JSON" 
This reverts commit f11682202b57edab585967e033839800d4159f4e.

Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-15 18:09:14 -05:00
joewitt
1c9077334f NIFI-2991 removed usage of json lib and components still using it 
Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-15 18:09:09 -05:00
Mark Payne
721964b7d8 NIFI-3036: When we replay a FlowFile, ensure that we are using the 'golden copy' of the associated Resource Claim, if the claim is still writable. Ensure that StandardResourceClaimManager retains the 'golden copy' of a Resource Claim until it is no longer writable and has a claim count of 0 
This closes #1223

Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-15 16:51:34 -05:00
Scott Aslan
81357d4456 [NIFI-3042] Update class name for disabled combo option. This closes #1228 2016-11-15 16:43:27 -05:00
Mark Payne
9f3bf121f9 NIFI-3040: Fixed bug where we were generating a RepositoryRecord with an 'UPDATE' type instead of a 'CREATE' time for Replay of FlowFiles. This caused FlowFile to have no attributes when restored from the FlowFile Repository. 
This closes #1224
 2016-11-15 16:37:51 -05:00