Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,141 Commits 143 Branches 197 Tags 391 MiB
Commit Graph

2141 Commits

Author SHA1 Message Date
Aldrin Piri e76a75c26b NIFI-1749 This closes #342. Adjusting tests that fail without a connection to the Internet and removing attributable elements from test resources. 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-04-11 13:22:00 -04:00
Oleg Zhurakousky 95dda1d920 NIFI-1748 removed un-used test data 
This closes #341.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-04-11 02:24:45 -04:00
Mike Moser 5625686ea4 NIFI-1746 avoid exceptions if configuration dir is a symbolic link 
Signed-off-by:  Joe Skora <jskora@apache.org>
 2016-04-11 02:05:48 -04:00
Joe Skora 696a12e4e7 Revert "NIFI-1748 removed un-used test data" 
This reverts commit 47cd9ff22c.
 2016-04-11 02:05:24 -04:00
Oleg Zhurakousky 47cd9ff22c NIFI-1748 removed un-used test data 
This closes #341.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-04-10 13:21:37 -04:00
mans2singh e3155a8a4b NIFI-1516 Provide AWS DynamoDB Delete/Put/Get processors 
This closes #224.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-04-08 11:23:04 -04:00
Zachary Jaffee 41583e6dc0 NIFI-400 remove deprecated processor EvaluateRegularExpression 
This closes #77

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-04-08 09:11:20 -04:00
Matt Gilman 5de40ccec3 NIFI-1553: 
- Implementing a file based authorizer.
- Providing an example authorizations files.
- Address comments from PR.
- This closes #330
 2016-04-07 16:28:42 -04:00
Matt Gilman 3f4ac3156c Revert "NIFI-1551:" 
This reverts commit c4d06f203d. Accidently merged wrong branch.
 2016-04-07 16:22:35 -04:00
Matt Gilman c4d06f203d NIFI-1551: 
- Starting to remove the AuthorityProvider.
- This closes #330
 2016-04-07 16:18:36 -04:00
Adam Lamar 2bcc31330c
NIFI-1180: Modify PutS3Object to enable encryption 
This closes #246.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-04-07 11:19:22 -07:00
ijokarumawak 9235a28f82 NIFI-1736 Move kafka.StreamScanner to nifi-utils. This closes #333 2016-04-07 07:37:28 -04:00
Bryan Bende 3adb45eafc NIFI-1630 This closes #332. Making TestPutUDP select an open port for testing to avoid conflicts 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-04-06 23:39:30 -04:00
Mark Payne 84b1c60d54 NIFI-1726: Addressed issue where we can run into an infinite loop if we are expiring data based on a timestamp instead of disk space usage and we have a file whose timestamp is exactly equal to our threshold for deletion 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-04-06 11:27:53 -04:00
Matt Brown b0cc6ae7e8 NIFI-1630 PutUDP processor created. 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-04-06 11:04:01 -04:00
andrewmlim e66315c4db Update getting-started.adoc 
Corrected spelling/grammatical errors

This closes #327.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-04-05 10:47:52 -07:00
Aldrin Piri 3effc6cca5 NIFI-1689 Correcting TimeUnit conversion to be milliseconds instead of the incorrect microseconds and using historical modified times to avoid issues with second granularity of HFS+ 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-04-05 09:38:48 -04:00
Aldrin Piri 0e9e9b36d9 NIFI-1728 Specifying charsets for messages sent to/received from Kafka in Kafka processor and related tests to remedy failures in Windows environments. Specifying EOF as an int instead of a byte. 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-04-05 09:38:39 -04:00
Mike Moser 1c025dd4be NIFI-1714 use standard HttpClient cookie policy instead of default 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-04-04 13:13:17 -04:00
Matt Gilman 9f7dba491f NIFI-1552: 
- Addressing unused imports.
 2016-04-04 11:49:25 -04:00
Matt Gilman 9aa69b242e NIFI-1552: - Introducing the Authorizer API and additional components necessary for discovery and creation of configured instances. - Minor refactoring of existing Authority Provider API code/configuration to avoid some xsd naming conflicts. These components will be removed in NIFI-1551. - Introducing a number of the resource definitions that the Authorizer will make access decisions on. This list is likely not finalized may see some changes in NIFI-1554. - Address comments from PR. - This closes #318. 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-04-04 11:47:43 -04:00
Mark Payne 1ac05266a5 NIFI-483: Use ZooKeeper's Leader Election to determine Primary Node. This closes #301 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-04-04 11:47:08 -04:00
Mark Payne 0d3bd2c401 NIFI-1563: - Federate requests and merge responses from nodes instead of storing bulletins and stats at NCM - Updating UI to support restructured status history DTO. - Return 'Insufficient History' message if aggregate stats don't have enough data points, even if all nodes do (which can be the case if the node performing the aggregation has a different value for the 'nifi.components.status.snapshot.frequency' property than the other nodes) - Bug fixes; code cleanup; replicate requests to bulletin board endpoint - Refactored the <Component>StatusDTO objects into <Component>StatusDTO, <Component>StatusSnapshotDTO, Node<Component>StatusSnapshotDTO objects - Introducing endpoints for accessing individual component status. - Wiring up new endpoints and updated core. - Code clean up. - Starting to handling status merging of individual components. - Nodewise breakdown has been added to Processors but the remaining components still need to be updated. - Refactor so that System Diagnostics requests are replicated to nodes instead of the information being pulled from Heartbeats - Replicate request for counters instead of pulling them from heartbeats - Removed the getCounters / setCounters method from HeartbeatPayload - Implementing component specific endpoints. - Removing unused endpoints. - Supporting nodewise breakdown for system diagnostics and counters. - Updating DTOs to use more consistent naming. - Code clean up. - Addressing contrib issues. - Removed ProcessGroupStatus from HeartbeatPayload - Removing nodewise from the system diagnostics endpoint. Had included it for testing that option but did not intend for it to be committed. - Addressing comments in PR #294. - This closes #294 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-04-04 11:42:39 -04:00
Matt Gilman 2de7f3f884 Updating versions to 1.0.0-SNAPSHOT. 2016-04-04 11:36:20 -04:00
Matt Gilman 16108467c1 NIFI-1695: 
- Removing hidden control characters that were affecting graph styles. This closes #311
 2016-04-04 11:26:55 -04:00
Oleg Zhurakousky 2337f5cad3 Merge branch 'master' of github.com:apache/nifi 2016-04-04 10:43:26 -04:00
Bryan Bende 04c6830937 NIFI-1698 Improving customValidate in AbstractHadoopProcessor and HBaseClient service to not reload Configuration unless it changed. This closes #313 2016-04-04 10:14:05 -04:00
Oleg Zhurakousky bd9519182a Merge branch 'master' of github.com:apache/nifi 2016-04-04 10:10:34 -04:00
Stephen Harper e02c79975e NIFI-1686 - NiFi is unable to populate over 1/4 of AMQP properties from flow properties 
This closes #305
 2016-04-04 10:07:50 -04:00
Stephen Harper b531b97a4d NIFI-1686 - NiFi is unable to populate over 1/4 of AMQP properties from flow properties 2016-04-04 10:05:01 -04:00
Oleg Zhurakousky 25290cedc4 NIFI-1701 fixed StreamScanner, added more tests 
NIFI-1701 additional refactoring, clean up and more tests
 2016-04-04 09:55:16 -04:00
Bryan Bende 65b5c1a5f1 NIFI-1697 Ensuring FlowController appropriately wraps code with NarCloseable. This closes #312 2016-04-04 09:22:55 -04:00
Matt Burgess 65b26e6f41 NIFI-1691: Add Fetch Size property to QueryDatabaseTable 
This closes #307

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-03-29 10:51:30 -04:00
Oleg Zhurakousky c3d54ab724 NIFI-1684 This closes #308. fixed ZKClient connection leak 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-03-29 09:56:24 -04:00
Oleg Zhurakousky 9912f18de5 NIFI-1684 This closes #302. fixed random partitioner initialization 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-03-29 09:56:08 -04:00
Oleg Zhurakousky 1292581ec8 NIFI-1684 added penalization on failure 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-03-29 09:56:04 -04:00
Oleg Zhurakousky 8d960f5243 NIFI-1684 fixed NPE in PutKafka when retrieving key attribute bytes 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-03-29 09:56:04 -04:00
Oleg Zhurakousky e35c40b0fd NIFI-1684 fixed NPE, added tests 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-03-29 09:56:04 -04:00
Mark Payne 8000304e6a NIFI-1442: This closes #306. Use CircularFifoQueue instead of Set to store nodes' bulletins 
Joint effort by Toivo Adams from PR306 and and Mark Payne

Signed-off-by: joewitt <joewitt@apache.org>
 2016-03-28 13:35:36 -04:00
Aldrin Piri e977729b56 NIFI-1634-rc2 prepare for next development iteration 2016-03-23 18:56:34 -04:00
Aldrin Piri 0b9bd20d31 NIFI-1634-rc2 prepare release nifi-0.6.0-RC2 2016-03-23 18:56:22 -04:00
Mark Payne e4b7e47836 Merge branch 'NIFI-1676' 2016-03-23 12:14:35 -04:00
Mark Payne b95a82f4a5 NIFI-1676: Do not allow Processor to be started if state is STOPPING; ensure that it is STOPPED 2016-03-23 11:31:20 -04:00
Mark Payne f7ecb47e29 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2016-03-23 11:24:28 -04:00
Mark Payne 9e39653192 Merge branch 'NIFI-1645' of https://github.com/olegz/nifi into NIFI-1645 2016-03-23 10:31:57 -04:00
Oleg Zhurakousky e0e00ff282 NIFI-1645 refactored PutKafka 
- used newest API available in 0.8.* version
- added PutKafka integration tests
- Kafka module code coverage is at 85%

NIFI-1645 polishing

NIFI-1645 PR comments round 1

NIFI-1645 PR comments round 2

NIFI-1645 change to use async Kafka producer

NIFI-1645 polishing

NIFI-1645 polishing

NIFI-1645 polishing

NIFI-1645 changed from java.util.Scanner to custom StreamScanner

NIFI-1645 polishing

NIFI-1645 final polish
 2016-03-23 10:31:34 -04:00
Oleg Zhurakousky a68f87f96e NIFI-1665 This closes #296. fixed GetKafka to reset consumer in case of timeout 
NIFI-1665 polishing

Signed-off-by: joewitt <joewitt@apache.org>
 2016-03-22 21:48:47 -06:00
Mark Payne f120952ab7 NIFI-1669: Ensure that we take into account the number of 'ready bins' when determining whether or not we have reached out Max Bin threshold for BinFiles 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-03-22 20:49:39 -04:00
Bryan Bende 423b333b71 NIFI-1420 Fixing minor bugs in GetSplunk 
- Adding a Time Zone property so the Managed time ranges use the provided time zone when formatting the date strings
- Adding a Time Field Strategy property to choose between searching event time or index time
- Making the next iteration use previousLastTime + 1 ms to avoid overlap
- Fixing bug where GetSplunk incorrectly cleared state on a restart of NiFi
- This closes #299
 2016-03-22 15:23:42 -04:00
Matt Burgess bbbc77707f NIFI-1666: Fixed bug with EL evaluation in PutElasticsearch processor 2016-03-22 15:10:27 -04:00