Mark Payne
b59d3ece75
NIFI-1762: Changed Java dependency to 1.8 instead of 1.7 and refactored StandardNiFiServiceFacade to make use of Lambda expressions to simplify code base. Also had to address a unit test because changing to Java 8 results in calls to assertEquals to become ambiguous. This closes #352
2016-04-14 10:38:03 -04:00
Andy LoPresto
378ccf53c2
NIFI-1753 Replaced usage of javax.security.cert.X509Certificate with java.security.cert.X509Certificate and resolved user-reported ClassCastException when handling client certificates during TLS mutual authentication.
...
Fixed nifi-utils pom.xml comment about additional dependencies. (+5 squashed commits)
Squashed commits:
[965b766] NIFI-1753 Removed temporary work-around of duplicate certificate conversion util method and added nifi-security-utils as dependency of nifi-utils.
[cd35f9b] NIFI-1753 Replaced legacy X.509 certificate declarations with new declarations in SSLSocketChannel and EndpointConnectionPool.
Temporary work-around of duplicate certificate conversion util method because nifi-utils cannot depend on nifi-security-utils.
[6420897] NIFI-1753 Replaced legacy X.509 certificate declarations with new declarations in PostHTTP.
[b9868ef] NIFI-1753 Added convenience method for extracting DN from peer certificate chain in SSL socket (canonical implementation to reduce code duplication and references to legacy certificate implementations).
Refactored logic retrieving legacy X.509 certificates with reference to convenience method in NodeProtocolSenderImpl.
Replaced logic retrieving legacy X.509 certificates with reference to convenience method in SocketProtocolListener.
Cleaned up exception handling in SocketProtocolListener.
Replaced legacy X.509 certificate declarations with new declarations in HandleHttpRequest (needs manual test).
[e2d1c35] NIFI-1753 Added convenience methods for converting legacy X.509 certificates and abstract certificates to correct X.509 format.
Added unit tests for certificate manipulation.
Replaced logic retrieving legacy X.509 certificates with new logic in NodeProtocolSenderImpl.
Added bcpkix (Bouncy Castle PKI implementation) dependency to nifi-standard-processors pom.
This closes #346 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-04-13 18:30:21 -07:00
ijokarumawak
dfa27263d2
NIFI-1180 Adding more IT tests.
...
This closes #336 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-04-12 17:44:29 -07:00
Oleg Zhurakousky
bd1f0a82ae
NIFI-1748 removed un-used test data
...
This closes #344 .
Signed-off-by: Joe Skora <jskora@apache.org>
2016-04-11 19:50:22 -04:00
Aldrin Piri
e76a75c26b
NIFI-1749 This closes #342 . Adjusting tests that fail without a connection to the Internet and removing attributable elements from test resources.
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-04-11 13:22:00 -04:00
Oleg Zhurakousky
95dda1d920
NIFI-1748 removed un-used test data
...
This closes #341 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-04-11 02:24:45 -04:00
Mike Moser
5625686ea4
NIFI-1746 avoid exceptions if configuration dir is a symbolic link
...
Signed-off-by: Joe Skora <jskora@apache.org>
2016-04-11 02:05:48 -04:00
Joe Skora
696a12e4e7
Revert "NIFI-1748 removed un-used test data"
...
This reverts commit 47cd9ff22c
.
2016-04-11 02:05:24 -04:00
Oleg Zhurakousky
47cd9ff22c
NIFI-1748 removed un-used test data
...
This closes #341 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-04-10 13:21:37 -04:00
mans2singh
e3155a8a4b
NIFI-1516 Provide AWS DynamoDB Delete/Put/Get processors
...
This closes #224 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-04-08 11:23:04 -04:00
Zachary Jaffee
41583e6dc0
NIFI-400 remove deprecated processor EvaluateRegularExpression
...
This closes #77
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-04-08 09:11:20 -04:00
Matt Gilman
5de40ccec3
NIFI-1553:
...
- Implementing a file based authorizer.
- Providing an example authorizations files.
- Address comments from PR.
- This closes #330
2016-04-07 16:28:42 -04:00
Matt Gilman
3f4ac3156c
Revert "NIFI-1551:"
...
This reverts commit c4d06f203d
. Accidently merged wrong branch.
2016-04-07 16:22:35 -04:00
Matt Gilman
c4d06f203d
NIFI-1551:
...
- Starting to remove the AuthorityProvider.
- This closes #330
2016-04-07 16:18:36 -04:00
Adam Lamar
2bcc31330c
NIFI-1180: Modify PutS3Object to enable encryption
...
This closes #246 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-04-07 11:19:22 -07:00
ijokarumawak
9235a28f82
NIFI-1736 Move kafka.StreamScanner to nifi-utils. This closes #333
2016-04-07 07:37:28 -04:00
Bryan Bende
3adb45eafc
NIFI-1630 This closes #332 . Making TestPutUDP select an open port for testing to avoid conflicts
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-04-06 23:39:30 -04:00
Mark Payne
84b1c60d54
NIFI-1726: Addressed issue where we can run into an infinite loop if we are expiring data based on a timestamp instead of disk space usage and we have a file whose timestamp is exactly equal to our threshold for deletion
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-04-06 11:27:53 -04:00
Matt Brown
b0cc6ae7e8
NIFI-1630 PutUDP processor created.
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-04-06 11:04:01 -04:00
Aldrin Piri
3effc6cca5
NIFI-1689 Correcting TimeUnit conversion to be milliseconds instead of the incorrect microseconds and using historical modified times to avoid issues with second granularity of HFS+
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-04-05 09:38:48 -04:00
Aldrin Piri
0e9e9b36d9
NIFI-1728 Specifying charsets for messages sent to/received from Kafka in Kafka processor and related tests to remedy failures in Windows environments. Specifying EOF as an int instead of a byte.
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-04-05 09:38:39 -04:00
Mike Moser
1c025dd4be
NIFI-1714 use standard HttpClient cookie policy instead of default
...
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-04-04 13:13:17 -04:00
Matt Gilman
9aa69b242e
NIFI-1552: - Introducing the Authorizer API and additional components necessary for discovery and creation of configured instances. - Minor refactoring of existing Authority Provider API code/configuration to avoid some xsd naming conflicts. These components will be removed in NIFI-1551. - Introducing a number of the resource definitions that the Authorizer will make access decisions on. This list is likely not finalized may see some changes in NIFI-1554. - Address comments from PR. - This closes #318 .
...
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2016-04-04 11:47:43 -04:00
Mark Payne
1ac05266a5
NIFI-483: Use ZooKeeper's Leader Election to determine Primary Node. This closes #301
...
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2016-04-04 11:47:08 -04:00
Mark Payne
0d3bd2c401
NIFI-1563: - Federate requests and merge responses from nodes instead of storing bulletins and stats at NCM - Updating UI to support restructured status history DTO. - Return 'Insufficient History' message if aggregate stats don't have enough data points, even if all nodes do (which can be the case if the node performing the aggregation has a different value for the 'nifi.components.status.snapshot.frequency' property than the other nodes) - Bug fixes; code cleanup; replicate requests to bulletin board endpoint - Refactored the <Component>StatusDTO objects into <Component>StatusDTO, <Component>StatusSnapshotDTO, Node<Component>StatusSnapshotDTO objects - Introducing endpoints for accessing individual component status. - Wiring up new endpoints and updated core. - Code clean up. - Starting to handling status merging of individual components. - Nodewise breakdown has been added to Processors but the remaining components still need to be updated. - Refactor so that System Diagnostics requests are replicated to nodes instead of the information being pulled from Heartbeats - Replicate request for counters instead of pulling them from heartbeats - Removed the getCounters / setCounters method from HeartbeatPayload - Implementing component specific endpoints. - Removing unused endpoints. - Supporting nodewise breakdown for system diagnostics and counters. - Updating DTOs to use more consistent naming. - Code clean up. - Addressing contrib issues. - Removed ProcessGroupStatus from HeartbeatPayload - Removing nodewise from the system diagnostics endpoint. Had included it for testing that option but did not intend for it to be committed. - Addressing comments in PR #294 . - This closes #294
...
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2016-04-04 11:42:39 -04:00
Matt Gilman
2de7f3f884
Updating versions to 1.0.0-SNAPSHOT.
2016-04-04 11:36:20 -04:00
Matt Gilman
16108467c1
NIFI-1695:
...
- Removing hidden control characters that were affecting graph styles. This closes #311
2016-04-04 11:26:55 -04:00
Bryan Bende
04c6830937
NIFI-1698 Improving customValidate in AbstractHadoopProcessor and HBaseClient service to not reload Configuration unless it changed. This closes #313
2016-04-04 10:14:05 -04:00
Stephen Harper
e02c79975e
NIFI-1686 - NiFi is unable to populate over 1/4 of AMQP properties from flow properties
...
This closes #305
2016-04-04 10:07:50 -04:00
Oleg Zhurakousky
25290cedc4
NIFI-1701 fixed StreamScanner, added more tests
...
NIFI-1701 additional refactoring, clean up and more tests
2016-04-04 09:55:16 -04:00
Bryan Bende
65b5c1a5f1
NIFI-1697 Ensuring FlowController appropriately wraps code with NarCloseable. This closes #312
2016-04-04 09:22:55 -04:00
Matt Burgess
65b26e6f41
NIFI-1691: Add Fetch Size property to QueryDatabaseTable
...
This closes #307
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-03-29 10:51:30 -04:00
Oleg Zhurakousky
c3d54ab724
NIFI-1684 This closes #308 . fixed ZKClient connection leak
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-03-29 09:56:24 -04:00
Oleg Zhurakousky
9912f18de5
NIFI-1684 This closes #302 . fixed random partitioner initialization
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-03-29 09:56:08 -04:00
Oleg Zhurakousky
1292581ec8
NIFI-1684 added penalization on failure
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-03-29 09:56:04 -04:00
Oleg Zhurakousky
8d960f5243
NIFI-1684 fixed NPE in PutKafka when retrieving key attribute bytes
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-03-29 09:56:04 -04:00
Oleg Zhurakousky
e35c40b0fd
NIFI-1684 fixed NPE, added tests
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-03-29 09:56:04 -04:00
Mark Payne
8000304e6a
NIFI-1442: This closes #306 . Use CircularFifoQueue instead of Set to store nodes' bulletins
...
Joint effort by Toivo Adams from PR306 and and Mark Payne
Signed-off-by: joewitt <joewitt@apache.org>
2016-03-28 13:35:36 -04:00
Aldrin Piri
e977729b56
NIFI-1634-rc2 prepare for next development iteration
2016-03-23 18:56:34 -04:00
Aldrin Piri
0b9bd20d31
NIFI-1634-rc2 prepare release nifi-0.6.0-RC2
2016-03-23 18:56:22 -04:00
Mark Payne
e4b7e47836
Merge branch 'NIFI-1676'
2016-03-23 12:14:35 -04:00
Mark Payne
b95a82f4a5
NIFI-1676: Do not allow Processor to be started if state is STOPPING; ensure that it is STOPPED
2016-03-23 11:31:20 -04:00
Mark Payne
f7ecb47e29
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2016-03-23 11:24:28 -04:00
Mark Payne
9e39653192
Merge branch 'NIFI-1645' of https://github.com/olegz/nifi into NIFI-1645
2016-03-23 10:31:57 -04:00
Oleg Zhurakousky
e0e00ff282
NIFI-1645 refactored PutKafka
...
- used newest API available in 0.8.* version
- added PutKafka integration tests
- Kafka module code coverage is at 85%
NIFI-1645 polishing
NIFI-1645 PR comments round 1
NIFI-1645 PR comments round 2
NIFI-1645 change to use async Kafka producer
NIFI-1645 polishing
NIFI-1645 polishing
NIFI-1645 polishing
NIFI-1645 changed from java.util.Scanner to custom StreamScanner
NIFI-1645 polishing
NIFI-1645 final polish
2016-03-23 10:31:34 -04:00
Oleg Zhurakousky
a68f87f96e
NIFI-1665 This closes #296 . fixed GetKafka to reset consumer in case of timeout
...
NIFI-1665 polishing
Signed-off-by: joewitt <joewitt@apache.org>
2016-03-22 21:48:47 -06:00
Bryan Bende
423b333b71
NIFI-1420 Fixing minor bugs in GetSplunk
...
- Adding a Time Zone property so the Managed time ranges use the provided time zone when formatting the date strings
- Adding a Time Field Strategy property to choose between searching event time or index time
- Making the next iteration use previousLastTime + 1 ms to avoid overlap
- Fixing bug where GetSplunk incorrectly cleared state on a restart of NiFi
- This closes #299
2016-03-22 15:23:42 -04:00
Matt Burgess
bbbc77707f
NIFI-1666: Fixed bug with EL evaluation in PutElasticsearch processor
2016-03-22 15:10:27 -04:00
Aldrin Piri
4babd067c1
NIFI-1664 Preferring System.nanoTime to System.currentTimeMillis and providing explicit handling of timestamps for files in those tests that are testing other attributes of the ListFile process besides timestamp which could lead to erroneous transmissions depending on exactly when files were created.
...
Adding unsalted_128_raw.enc and salted_128_raw.enc to the list of exclusions for the RAT plugin which caused issues in the Windows environment for contrib-checks.
This closes #297 .
2016-03-22 14:13:37 -04:00
Mark Payne
736896246c
NIFI-1649: Addressed bug in SplitText that resulted in improper handling of input data if Remove Trailing Newlines is true and there is a FlowFile that is only made up of newlines
2016-03-21 13:26:32 -04:00