Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,463 Commits 146 Branches 200 Tags 402 MiB
Commit Graph

2463 Commits

Author SHA1 Message Date
Oleg Zhurakousky 0dbba811f3 NIFI-2298 This closes #687 added Kafka consume attributes to a FlowFile 2016-07-21 22:56:24 -04:00
Rob Moran 99b4af7820 NIFI-2211 This closes #700. This closes #691. Updating NiFi architecture graphics for overview doc 2016-07-21 12:16:21 -04:00
Andrew Lim 0e8e19a479 NIFI-2320 Update existing Getting Starting images with new UI images 2016-07-21 10:57:06 -04:00
jpercivall 4e224c283f NIFI-1899 reworking bi-directional Email processing in ListenSMTP 
This closes #483
 2016-07-21 10:39:21 -04:00
Andre F de Miranda 4f672832c0 NIFI-1899 - Introduce ExtractEmailAttachments and ExtractEmailHeaders processors - Introduce ListenSMTP (allows NiFi to receive data via email) - Addresses @ijokarumawak and @@JPercivall PR comments 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-21 10:26:30 -04:00
Scott Aslan f352ea10b7 [NIFI-2107] [NIFI-2143] Update content-viewer, error, and login pages...Fix Provenance filter combo text. This closes #684 2016-07-21 08:22:22 -04:00
Mark Payne 5eba2b763e NIFI-2334: Delegate requests for cluster info to the cluster coordinator 
This closes #697

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 21:38:53 -04:00
Yolanda M. Davis 35c0e1436e NIFI-2310 - upgraded jolt to 0.0.21 to resolve special character issue 
This closes #674

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-07-21 10:35:42 +09:00
Mark Payne 370d88eeeb NIFI-2333: Consider reporting tasks and controller services when determining whether or not flow is empty 
This closes #693

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 20:06:05 -04:00
Mark Payne 10b91ffe6c NIFI-2332: Ensure that bulletin node address is set when clustered but not overwritten if already set 
This closes #692

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 19:44:32 -04:00
Mark Payne 7f2bda29d9 NIFI-2289: Ensure that we include Node ID's of all nodes when finding cluster coordinator, even if the node is currently still connecting or has not yet joined the cluster, which ccan be the case if all nodes in the cluster are restarting at the same time. 
This closes #681

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 16:50:25 -04:00
Mark Payne 39a4d84a62 NIFI-2330: Ensure that we set ProcessGroupDTO's contents after populating sets of components, as the contents dto now copies the sets 
This closes #686

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 16:05:42 -04:00
joewitt 2a8be95480 NIFI-2326 This closes #685. fixed test breaking static class causing ordering issues. Addressed potential issue in NarClassLoaders for multi-init scenarios - now idempotent for a given config 2016-07-20 15:13:37 -04:00
mans2singh 259f5bba47 NIFI-1972 - Ignite processor 
This closes #502.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
 2016-07-20 18:39:19 +02:00
Mark Payne 2a7f135f1c NIFI-2319: Ensure that when we set cluster node id's and node addresses, that we do so only if they are not already populated 
This closes #680

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 11:39:57 -04:00
Mark Payne 108c815988 NIFI-2324: Log number of requests per URI if we have too many outstanding requests to replicate 
This closes #683

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-20 11:22:24 -04:00
Koji Kawamura 76fe751c22 Added PGP key to KEYS file. 2016-07-21 00:09:16 +09:00
Scott Aslan 8f23afde50 [NIFI-2257] [NIFI-2294] refresh updateattribute processor advanced shell and fix connection config setting tab scrolling issue 
[NIFI-2270] Update splash screen
This closes #646
 2016-07-20 06:59:30 -04:00
Oleg Zhurakousky 6c7c3c0822 NIFI-826 (part 3) 
- fixed ID generation routine that was causing miss-identification of the components
 2016-07-19 15:52:35 -04:00
Bryan Bende 1c6d58b959 NIFI-929 Changing permissions of nifi.pid to be readable by all, writable only by user 
This closes #677

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-19 15:15:16 -04:00
Matt Burgess f1ba240326 NIFI-2156: Add ListDatabaseTables processor 
This closes #642

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-19 13:00:43 -04:00
Bryan Bende 8e2663c54d NIFI-2309 Correcting AmbariReportingTask so it reports total task duration as seconds and as nano-seconds 
This closes #672

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-19 11:35:09 -04:00
Scott Aslan deb2819bfb [NIFI-2105] [NIFI-2106] fix status history dialog issues. This closes #673 2016-07-19 07:33:34 -04:00
Bryan Bende e308c6464c NIFI-929 Changing RunNiFi to write just the pid to nifi.pid and the full status to nifi.status 
This closes #668

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-18 17:27:15 -04:00
Mark Payne 41c0f19e48 NIFI-2305: Do not run processors that are marked as Primary Node Only if disconnected from cluster 
This closes #667

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-18 15:54:14 -04:00
Oleg Zhurakousky f4d2919955 NIFI-826 (part deux) 
- fixed clustering issues discovered after NIFI-826 was applied
 2016-07-18 15:49:24 -04:00
Matt Gilman aa91032cde NIFI-2272: 
- Ensuring the appropriate visibilty of the action in the policy management page.
NIFI-2273:
- Ensuring we load the policy or inform the user of the appropriate permissions of the effective policy.
NIFI-2239:
- Providing help tooltips for the policies in the management page.
NIFI-2283:
- Adding auditing for access policies, users, and groups.
NIFI-2263:
- Not replicating history requests throughout the cluster.
NIFI-2096:
- Fixing upload template file input in Firefox.
NIFI-2301:
- Removing relevant policies after component deletion.
 2016-07-18 15:05:54 -04:00
Mark Payne 5c8636edf4 NIFI-2289: Directly ask ZooKeeper which node is cluster coordinator and add watches on the ZNode rather than relying on Node Status Updates over the cluster protocol because cluster protocol may get the events out-of-order 
This closes #665.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-07-18 10:13:42 -04:00
Matt Burgess 01cae23745 NIFI-2157: Add GenerateTableFetch processor 
This closes #645

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-17 17:54:42 -04:00
joewitt ad02b43099 NIFI-1157 removed methods no longer needed due to deprecation cleanup. In NIFI-2280 also ensure they were deprecated on the 0.x line. This closes #663. 2016-07-16 16:07:12 -04:00
Matt Burgess 1c5975da86 NIFI-2174: Fix handling of time/date types in QueryCassandra 
This closes #661

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-16 13:31:21 -04:00
Oleg Zhurakousky 52a961873b NIFI-826 This closes #617. Added deterministic template support 2016-07-15 20:41:18 -04:00
Mark Payne 4d4c525d9c NIFI-2281: Allow connections to be moved away from running local input ports and funnels 
This closes #662

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 16:36:19 -04:00
Mark Payne c81dc1959a NIFI-1992: 
- Updated site-to-site client and server to support clustered nifi instances
NIFI-2274:
- Ensuring we use the correct URI when updating a connection.

This closes #530
 2016-07-15 16:13:59 -04:00
Joe Gresock b67c9b6f76 NIFI-2250: Enabling EL on GetSQS Queue URL 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 12:59:37 -04:00
Koji Kawamura e89ee11199 NIFI-619: Make MonitorActivity more cluster friendly 
With this commit, MonitorActivity can be configured as:

- Monitor activity per node individually
- Monitor cluster wide activity
  - Send notification flow-file from all of nodes
  - or only from a primary node

Changes:
- Added 'Monitoring Scope' property
- Added 'Reporting Node' property
- Falls back from cluster scope to node scope if necessary
- Persist the latest activity as Cluster state
- Examine cluster state on each node if necessary
- Only update the cluster state if current timestamp is later than existing
  timestamp stored in Zookeeper

This closes #575

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 12:47:37 -04:00
Matt Gilman 5cd5a4ce78 NIFI-2260: 
- Addressing issue searching provenance on a specific node.
- Fixing issues viewing content and replaying events.

This closes #658.
 2016-07-15 12:14:24 -04:00
Koji Kawamura 53326c7f9b NIFI-2267: A way for Processor to know node type 
- Added NodeTypeProvider to expose flowController's isClustered and
  isPrimaryNode so that processor can know if it's running on a cluster
  and if it's a primary node.
- Added mechanism to simulate clustered or not, and primary or not, for testing

This closes #657

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 11:38:50 -04:00
Bryan Bende afc038d2c0 NIFI-2194 This closes #659. Caching metrics in AmbariReportingTask so each iteration sends last iteration's metrics 2016-07-15 11:25:22 -04:00
jpercivall 54574e3889 NIFI-2173 Fixing typo in LDAP referral strategy 
This closes #629
 2016-07-15 09:55:37 -04:00
Aldrin Piri d1129706e2 NIFI-1896 This closes #650. Refactored nifi-api into nifi-framework-api and other locations. The nifi-api is specific to that which is needed for intended extension points. 2016-07-14 18:24:48 -04:00
Yolanda M. Davis 048ba5366c NIFI-2020 - initial commit for custom transformation support 
NIFI-2020 - updates to use lambdas/stream wherever possible and fix potential nullpointer issue.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #564
 2016-07-14 18:04:14 -04:00
Bryan Rosander 1da18a3f40 NIFI-2222 - Fixing SslContextFactory Properties set by keyStorePasswd and keyPasswd 
This closes #632

Signed-off-by: James Wing <jvwing@gmail.com>
 2016-07-14 14:07:24 -07:00
Andy LoPresto 4e3580f58e
NIFI-1688 Resolved issue in PostHTTP -- now uses SSLContextService's protocol setting. Modified construction of SSLSocketFactory to avoid hardcoding supported protocol. Added debug information for supported cipher suites. 
This closes #624.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-07-14 16:43:48 -04:00
Puspendu Banerjee 6d2168049a fixes NIFI-1989 
This closes #514

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-14 15:59:45 -04:00
James Wing a7c5b88a47
NIFI-2062 AWS SDK Update: 
* Updated the AWS SDK dependency version to 1.11.8
* Removed GetDynamoDBTest references to JsonObject class dropped from AWS SDK
* Fixed integration test ITPutSNS.testPublish() - exception from not evaluating expressions
* Ignored integration test ITPutS3Object.testS3MultipartAgeoff() - did not work before or after SDK update

This closes #562.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-07-14 15:27:26 -04:00
Mark Payne f6136b69e5 NIFI-1413: Rebased against master and updated templates endpoint merge to use template entities instead of template dto's 
This closes #649
 2016-07-14 15:19:47 -04:00
Mark Payne 329192a7d3 NIFI-1413: Ensure that if a node's templates don't match the clusters that we take the following actions: -Local templates remain but aren't shown in the cluster's templates. -Any templates from the cluster that don't exist on the node are added to the node. -Any conflicting template definitions are replaced by those in the cluster 
This closes #596
 2016-07-14 15:01:46 -04:00
Scott Aslan 02784b5fca [NIFI-2227] fix race condition for showing the view button on the flow file details dialog 
[NIFI-2109] update check boxes
[NIFI-2226] reset controller services properties table size on dialog open
This closes #653
 2016-07-14 14:50:14 -04:00
Mark Payne 2540573d77 NIFI-2087: Do not update the lucene index to delete expired events. Instead, just wait for the entire index to expire and remove the files for that index. This is much more efficient. 
This closes #652

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-14 14:49:30 -04:00