Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,188 Commits 143 Branches 197 Tags 391 MiB
Commit Graph

2188 Commits

Author SHA1 Message Date
Joe Skora 696a12e4e7 Revert "NIFI-1748 removed un-used test data" 
This reverts commit 47cd9ff22c.
 2016-04-11 02:05:24 -04:00
Oleg Zhurakousky 47cd9ff22c NIFI-1748 removed un-used test data 
This closes #341.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-04-10 13:21:37 -04:00
mans2singh e3155a8a4b NIFI-1516 Provide AWS DynamoDB Delete/Put/Get processors 
This closes #224.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-04-08 11:23:04 -04:00
Zachary Jaffee 41583e6dc0 NIFI-400 remove deprecated processor EvaluateRegularExpression 
This closes #77

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-04-08 09:11:20 -04:00
Matt Gilman 5de40ccec3 NIFI-1553: 
- Implementing a file based authorizer.
- Providing an example authorizations files.
- Address comments from PR.
- This closes #330
 2016-04-07 16:28:42 -04:00
Matt Gilman 3f4ac3156c Revert "NIFI-1551:" 
This reverts commit c4d06f203d. Accidently merged wrong branch.
 2016-04-07 16:22:35 -04:00
Matt Gilman c4d06f203d NIFI-1551: 
- Starting to remove the AuthorityProvider.
- This closes #330
 2016-04-07 16:18:36 -04:00
Adam Lamar 2bcc31330c
NIFI-1180: Modify PutS3Object to enable encryption 
This closes #246.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-04-07 11:19:22 -07:00
ijokarumawak 9235a28f82 NIFI-1736 Move kafka.StreamScanner to nifi-utils. This closes #333 2016-04-07 07:37:28 -04:00
Bryan Bende 3adb45eafc NIFI-1630 This closes #332. Making TestPutUDP select an open port for testing to avoid conflicts 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-04-06 23:39:30 -04:00
Mark Payne 84b1c60d54 NIFI-1726: Addressed issue where we can run into an infinite loop if we are expiring data based on a timestamp instead of disk space usage and we have a file whose timestamp is exactly equal to our threshold for deletion 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-04-06 11:27:53 -04:00
Matt Brown b0cc6ae7e8 NIFI-1630 PutUDP processor created. 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-04-06 11:04:01 -04:00
andrewmlim e66315c4db Update getting-started.adoc 
Corrected spelling/grammatical errors

This closes #327.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-04-05 10:47:52 -07:00
Aldrin Piri 3effc6cca5 NIFI-1689 Correcting TimeUnit conversion to be milliseconds instead of the incorrect microseconds and using historical modified times to avoid issues with second granularity of HFS+ 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-04-05 09:38:48 -04:00
Aldrin Piri 0e9e9b36d9 NIFI-1728 Specifying charsets for messages sent to/received from Kafka in Kafka processor and related tests to remedy failures in Windows environments. Specifying EOF as an int instead of a byte. 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-04-05 09:38:39 -04:00
Mike Moser 1c025dd4be NIFI-1714 use standard HttpClient cookie policy instead of default 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-04-04 13:13:17 -04:00
Matt Gilman 9f7dba491f NIFI-1552: 
- Addressing unused imports.
 2016-04-04 11:49:25 -04:00
Matt Gilman 9aa69b242e NIFI-1552: - Introducing the Authorizer API and additional components necessary for discovery and creation of configured instances. - Minor refactoring of existing Authority Provider API code/configuration to avoid some xsd naming conflicts. These components will be removed in NIFI-1551. - Introducing a number of the resource definitions that the Authorizer will make access decisions on. This list is likely not finalized may see some changes in NIFI-1554. - Address comments from PR. - This closes #318. 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-04-04 11:47:43 -04:00
Mark Payne 1ac05266a5 NIFI-483: Use ZooKeeper's Leader Election to determine Primary Node. This closes #301 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-04-04 11:47:08 -04:00
Mark Payne 0d3bd2c401 NIFI-1563: - Federate requests and merge responses from nodes instead of storing bulletins and stats at NCM - Updating UI to support restructured status history DTO. - Return 'Insufficient History' message if aggregate stats don't have enough data points, even if all nodes do (which can be the case if the node performing the aggregation has a different value for the 'nifi.components.status.snapshot.frequency' property than the other nodes) - Bug fixes; code cleanup; replicate requests to bulletin board endpoint - Refactored the <Component>StatusDTO objects into <Component>StatusDTO, <Component>StatusSnapshotDTO, Node<Component>StatusSnapshotDTO objects - Introducing endpoints for accessing individual component status. - Wiring up new endpoints and updated core. - Code clean up. - Starting to handling status merging of individual components. - Nodewise breakdown has been added to Processors but the remaining components still need to be updated. - Refactor so that System Diagnostics requests are replicated to nodes instead of the information being pulled from Heartbeats - Replicate request for counters instead of pulling them from heartbeats - Removed the getCounters / setCounters method from HeartbeatPayload - Implementing component specific endpoints. - Removing unused endpoints. - Supporting nodewise breakdown for system diagnostics and counters. - Updating DTOs to use more consistent naming. - Code clean up. - Addressing contrib issues. - Removed ProcessGroupStatus from HeartbeatPayload - Removing nodewise from the system diagnostics endpoint. Had included it for testing that option but did not intend for it to be committed. - Addressing comments in PR #294. - This closes #294 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-04-04 11:42:39 -04:00
Matt Gilman 2de7f3f884 Updating versions to 1.0.0-SNAPSHOT. 2016-04-04 11:36:20 -04:00
Matt Gilman 16108467c1 NIFI-1695: 
- Removing hidden control characters that were affecting graph styles. This closes #311
 2016-04-04 11:26:55 -04:00
Oleg Zhurakousky 2337f5cad3 Merge branch 'master' of github.com:apache/nifi 2016-04-04 10:43:26 -04:00
Bryan Bende 04c6830937 NIFI-1698 Improving customValidate in AbstractHadoopProcessor and HBaseClient service to not reload Configuration unless it changed. This closes #313 2016-04-04 10:14:05 -04:00
Oleg Zhurakousky bd9519182a Merge branch 'master' of github.com:apache/nifi 2016-04-04 10:10:34 -04:00
Stephen Harper e02c79975e NIFI-1686 - NiFi is unable to populate over 1/4 of AMQP properties from flow properties 
This closes #305
 2016-04-04 10:07:50 -04:00
Stephen Harper b531b97a4d NIFI-1686 - NiFi is unable to populate over 1/4 of AMQP properties from flow properties 2016-04-04 10:05:01 -04:00
Oleg Zhurakousky 25290cedc4 NIFI-1701 fixed StreamScanner, added more tests 
NIFI-1701 additional refactoring, clean up and more tests
 2016-04-04 09:55:16 -04:00
Bryan Bende 65b5c1a5f1 NIFI-1697 Ensuring FlowController appropriately wraps code with NarCloseable. This closes #312 2016-04-04 09:22:55 -04:00
Matt Burgess 65b26e6f41 NIFI-1691: Add Fetch Size property to QueryDatabaseTable 
This closes #307

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-03-29 10:51:30 -04:00
Oleg Zhurakousky c3d54ab724 NIFI-1684 This closes #308. fixed ZKClient connection leak 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-03-29 09:56:24 -04:00
Oleg Zhurakousky 9912f18de5 NIFI-1684 This closes #302. fixed random partitioner initialization 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-03-29 09:56:08 -04:00
Oleg Zhurakousky 1292581ec8 NIFI-1684 added penalization on failure 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-03-29 09:56:04 -04:00
Oleg Zhurakousky 8d960f5243 NIFI-1684 fixed NPE in PutKafka when retrieving key attribute bytes 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-03-29 09:56:04 -04:00
Oleg Zhurakousky e35c40b0fd NIFI-1684 fixed NPE, added tests 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-03-29 09:56:04 -04:00
Mark Payne 8000304e6a NIFI-1442: This closes #306. Use CircularFifoQueue instead of Set to store nodes' bulletins 
Joint effort by Toivo Adams from PR306 and and Mark Payne

Signed-off-by: joewitt <joewitt@apache.org>
 2016-03-28 13:35:36 -04:00
Aldrin Piri e977729b56 NIFI-1634-rc2 prepare for next development iteration 2016-03-23 18:56:34 -04:00
Aldrin Piri 0b9bd20d31 NIFI-1634-rc2 prepare release nifi-0.6.0-RC2 2016-03-23 18:56:22 -04:00
Mark Payne e4b7e47836 Merge branch 'NIFI-1676' 2016-03-23 12:14:35 -04:00
Mark Payne b95a82f4a5 NIFI-1676: Do not allow Processor to be started if state is STOPPING; ensure that it is STOPPED 2016-03-23 11:31:20 -04:00
Mark Payne f7ecb47e29 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2016-03-23 11:24:28 -04:00
Mark Payne 9e39653192 Merge branch 'NIFI-1645' of https://github.com/olegz/nifi into NIFI-1645 2016-03-23 10:31:57 -04:00
Oleg Zhurakousky e0e00ff282 NIFI-1645 refactored PutKafka 
- used newest API available in 0.8.* version
- added PutKafka integration tests
- Kafka module code coverage is at 85%

NIFI-1645 polishing

NIFI-1645 PR comments round 1

NIFI-1645 PR comments round 2

NIFI-1645 change to use async Kafka producer

NIFI-1645 polishing

NIFI-1645 polishing

NIFI-1645 polishing

NIFI-1645 changed from java.util.Scanner to custom StreamScanner

NIFI-1645 polishing

NIFI-1645 final polish
 2016-03-23 10:31:34 -04:00
Oleg Zhurakousky a68f87f96e NIFI-1665 This closes #296. fixed GetKafka to reset consumer in case of timeout 
NIFI-1665 polishing

Signed-off-by: joewitt <joewitt@apache.org>
 2016-03-22 21:48:47 -06:00
Mark Payne f120952ab7 NIFI-1669: Ensure that we take into account the number of 'ready bins' when determining whether or not we have reached out Max Bin threshold for BinFiles 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-03-22 20:49:39 -04:00
Bryan Bende 423b333b71 NIFI-1420 Fixing minor bugs in GetSplunk 
- Adding a Time Zone property so the Managed time ranges use the provided time zone when formatting the date strings
- Adding a Time Field Strategy property to choose between searching event time or index time
- Making the next iteration use previousLastTime + 1 ms to avoid overlap
- Fixing bug where GetSplunk incorrectly cleared state on a restart of NiFi
- This closes #299
 2016-03-22 15:23:42 -04:00
Matt Burgess bbbc77707f NIFI-1666: Fixed bug with EL evaluation in PutElasticsearch processor 2016-03-22 15:10:27 -04:00
Aldrin Piri 4babd067c1 NIFI-1664 Preferring System.nanoTime to System.currentTimeMillis and providing explicit handling of timestamps for files in those tests that are testing other attributes of the ListFile process besides timestamp which could lead to erroneous transmissions depending on exactly when files were created. 
Adding unsalted_128_raw.enc and salted_128_raw.enc to the list of exclusions for the RAT plugin which caused issues in the Windows environment for contrib-checks.

This closes #297.
 2016-03-22 14:13:37 -04:00
Mark Payne 736896246c NIFI-1649: Addressed bug in SplitText that resulted in improper handling of input data if Remove Trailing Newlines is true and there is a FlowFile that is only made up of newlines 2016-03-21 13:26:32 -04:00
Mark Payne 38c782c30b NIFI-1650: Ensure that proper size and offset are specified for Content Claim when viewing FlowFiles still in queue 2016-03-21 10:30:24 -04:00