Commit Graph

2712 Commits

Author SHA1 Message Date
Matt Gilman c2bfc4ef24 NIFI-2635: - Re-using the original request during the second phase of the two phase commit. - Forwarding requests to the coordinator when received by a node.
This closes #933

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-24 22:42:10 -04:00
Bryan Rosander e9da90812b NIFI-2650 - Adding dependency on nifi-resources to match maven-dependency-plugin
This closes #936

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-24 21:31:29 -04:00
Koji Kawamura 671301193b NIFI-2525: Fix Proxy auth issue with async send.
Without this fix, NiFi fails to send data via HTTP Site-to-Site through
Proxy which requires authentication due to AsynchronousCloseException.
It happens when async client replays producing contents in order to re-send the
request with auth credential for the proxy server, however the
connection is already closed.
This fix makes NiFi to send actual data only at the second round of requests, so that flow-file
contents can be sent without reading it twice.

Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #915
2016-08-24 20:39:17 -04:00
Matt Gilman 2ceb5c8097
NIFI-2647:
- Referencing correct components when checking if save is required.

This closes #935.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-24 15:52:20 -07:00
Andrew Lim 7bc255b9b1
NIFI-2648 Edit formatting of TLS toolkit section of Admin guide for improved readability and consistency
This closes #934.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-24 14:37:35 -07:00
Koji Kawamura a3586e04d9 NIFI-2459: Site-to-Site bootstrap node failure
Refresh remote peer statuses even if the bootstrap node goes down.

Migrate existing code which handles the situation from
EndpointConnectionPool to PeerSelector, so that both RAW and HTTP
transport protocol has the same capability.

This closes #927.
2016-08-24 17:28:10 -04:00
Andy LoPresto 1a9d505b4e NIFI-2640 Fixed Windows encrypt-config.bat script to correctly invoke ConfigEncryptionTool. - Resolved failing Windows tests by adding OS-agnostic file permission read/write methods and new regex for different date formats. - Ignored tests that fail on Windows due to file permission and line ending issues. These are captured in NIFI-2644.
This closes #925

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-24 17:07:35 -04:00
Andy LoPresto 6331dda8d3 NIFI-2643 Changed null check to !isBlank() for key in RunNiFi.
NIFI-2643 Updated comment in bootstrap.conf template.

This closes #932
2016-08-24 16:20:10 -04:00
Andrew Lim 487f05a2b1
NIFI-2451 Updated Admin Guide with encrypted config documentation.
Changed "the user" to "you" in new sections for consistency. (+3 squashed commits)
Squashed commits:
[aadbbd1] NIFI-2451 Incorporated Drew's final comments to Admin Guide.
[b9a04ea] NIFI-2451 Added new documentation regarding encrypt-config tool after changes in NIFI-1831.
[5c07e68] NIFI-2451 Update Admin guide for encrypt-config command utility, new nifi.sensitive.props.additional.keys property, and removal of Java 7 reference for JCE Unlimited Strength Jurisdiction Policy

This closes #926.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-24 13:08:38 -07:00
Jeff Storck 6475924f53 NIFI-2642 Catches (and ignores) ResourceNotFoundException during the updating of a property value for a controller service when the current value points to a controller service that has been deleted, allowing the assigning of a new controller service to continue.
This closes #931
2016-08-24 15:55:04 -04:00
Mark Payne c2ae7a6d7c NIFI-2605: - Fixing a regression bug where nodes would potentially be elected leader for Cluster Coordinator role when they do not have the correct flow
-  Ensure that we log which node is the cluster coordinator on startup instead of just indicating that there is one. If we later determine that there is none, ensure that we register for the role

This closes #900

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-24 12:30:48 -04:00
jpercivall a2ed0f0610 Github repo is missing the latest Apache repo commit. As per Infra's suggstion pushing a whitespace commit to force an update 2016-08-24 11:30:14 -04:00
Andy LoPresto c638191a47
NIFI-1831 Added internal logic and command-line tool to allow AES-encrypted sensitive configuration values in nifi.properties.
This closes #834.
2016-08-23 20:34:31 -07:00
Sarah Olson 7a4fed189c NIFI-2638: Updated iconProcessor.png with image from new UI.
This closes #924

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-23 18:07:13 -04:00
Matt Burgess ee9bd94082 NIFI-2632: Added fragment attributes to SplitJson and SplitXml
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #919
2016-08-23 16:30:57 -04:00
Matt Burgess 5d1a4f343f
NIFI-2622: Added support for complex types in SelectHiveQL
This closes #922.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-23 15:52:16 -04:00
Andrew Psaltis 0303805c01
NIFI-2620 Adding support for Binary Row Keys for both PutHBaseCell and PutHBaseJSON. This also involved making changes to PutFlowFile and PutColumn to carry around byte[] and not all strings. This closes #914.
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-23 13:25:55 -04:00
Oleg Zhurakousky 4a49587533 NIFI-2610 annotated unstable tests with @Ignore
This closes #918
2016-08-23 13:13:05 -04:00
Matt Burgess fbec3b9c13
NIFI-2623: Fixed support for binary types in SelectHiveQL
This closes #920.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-23 11:43:46 -04:00
Mark Payne 8cc670c8a6 NIFI-2634: Ensure that we check whether or not the Site-to-Site protocol is set when importing template, instead of assuming that it will be
This closes #921

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-23 11:19:44 -04:00
Scott Aslan 3f60eac544 [NIFI-2599] Enhance Status History Dialog. This closes #894 2016-08-23 10:53:10 -04:00
Bryan Rosander 23350543ff
NIFI-2621 - Generating unique serial numbers for certificates
This closes #909.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-23 01:37:25 -07:00
jpercivall 6e82ec738c NIFI-2269 Fixing minor issues with style check, licensing, etc. 2016-08-22 21:34:51 -04:00
Ramiz 376d3c4ef4 NIFI-2269 Added datadog support
This closes #655

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-22 21:34:51 -04:00
Jeff Storck dca3764ed1 NIFI-2626 Fixes jetty server thread leak. This closes #910 2016-08-22 15:58:06 -04:00
Matt Burgess 7123a1a276 NIFI-2619: Added unit test showing bugs, Added logic to ClassLoaderUtils to trim module paths and accept URLs
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #907
2016-08-22 15:29:03 -04:00
James Wing 7884d09948 NIFI-2536 Update User Guide Template section. This closes #852 2016-08-22 15:07:54 -04:00
Joe Gresock 17dec04939 NIFI-2611: Fixing bugs in UnpackContent with flow file unpackers
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #905
2016-08-22 14:47:24 -04:00
Matt Gilman 087622eadc NIFI-2606:
- Addressing issue when fingerprinting ReportingTasks and ControllerServices properties with default values.
- Ensuring the flow is saved when templates are created and imported.
- Ensuring default values are included in templates.
- Fixing unit tests.
This closes #908.
2016-08-22 13:35:15 -04:00
Mark Payne 1fcec3747b NIFI-2617: Instead of retrying an infinite number of times to communicate with ZooKeeper, should try only for a short period in CuratorLeaderElectionManager. This is because web requests may be blocked waiting on a determination of which node is cluster coordinator
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #906
2016-08-22 13:24:22 -04:00
Mark Payne 5fab783b50
NIFI-2609: Ensure that we handle URIs for Remote Process Groups that do not have a path of /nifi or /nifi/
This closes #902.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-22 13:21:42 -04:00
Mark Payne 95b5877f5d NIFI-2600: Ensure that we do not close Index Searchers prematurely, even if they are poisoned
This closes #896
2016-08-22 12:03:47 -04:00
Joe Skora a2d3d0c289 Update to support offsets larger than 2 gigabyte. 2016-08-22 11:02:48 -04:00
Matt Burgess b7dc21bd95 NIFI-2547: Fixed checkstyle errors and updated to reflect KerberosProperties changes 2016-08-21 10:26:40 -04:00
ricky 26d362b144 NIFI-2547: Add DeleteHDFS Processor
This processor adds the capability to delete files or
directories inside of HDFS.

Paths supports both static and expression language values,
as well as glob support (e.g. /data/for/2016/07/*).

This processor may be used standalone, as well as part of a
downstream connection.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

Add Glob Matcher with Tests

Also set displayName on properties.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #850
2016-08-21 10:10:21 -04:00
Koji Kawamura a919844461 NIFI-2567: Site-to-Site to send large data via HTTPS
- It couldn't send data larger than about 7KB due to the mis-use of
  httpasyncclient library
- Updated httpasyncclient from 4.1.1 to 4.1.2
- Let httpasyncclient framework to call produceContent multiple times as
  it gets ready to send more data via SSL session
- Added HTTPS test cases to TestHttpClient, which failed without this
  fix
2016-08-19 14:24:53 -04:00
Joe Skora 02071103d0 * Add "Remove All Content" property, related functionality, and tests to ModifyBytes processor to allow deletion of all flow file content.
* Removed @Ignore annotation on class and unnecessary EOL translation of test data.  Because ModifyBytes treat input as binary data, not text, line endings don't matter as long as they byte offsets are calculated correctly.
* Replace validator with .allowableValues.

This closes #890.
2016-08-19 20:05:14 +02:00
Matt Gilman 3378426f35 NIFI-2581: Keeping context menu and tooltips open when refreshing the canvas.
This closes #899.
2016-08-19 19:36:26 +02:00
Scott Aslan a181c7b9d7 [NIFI-2601] Update bower.json to use specific versions. This closes #897 2016-08-19 10:34:48 -04:00
Jeff Storck 31ca8d02f7 NIFI-2488 Fixed BulletinDTOs not getting their node addresses set properly during bulletin merging. This closes #888 2016-08-19 08:32:00 -04:00
Matt Burgess 46b81058c7 NIFI-2602: Fixed NPE in SelectHiveQL when CSV output and null column value
This closes #898.
2016-08-19 09:56:26 +02:00
Matt Gilman 6b5950647a NIFI-2596:
- Adding tooltip for property descriptor on mouse enter of table cell.

This closes #893.
2016-08-18 17:23:30 -04:00
Matt Gilman 57648308db NIFI-2597:
- Updating the correct object when attempting to create a self loop.
2016-08-18 17:15:16 -04:00
Matt Gilman 87161ab96e
NIFI-2595: - Updating ReportingTasks to use ComponentLogger instead of creating Controller level bulletins.
- Making the bulletin responses consistent in that all bulletins will be included but in redacted form as appropriate.
- Fixing broken unit test.

This closes #892.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-18 17:06:28 -04:00
Matt Gilman f3387426a0 NIFI-2587:
- Adding additional authorization for accessing component property history.
2016-08-18 17:05:32 -04:00
Matt Burgess 6874a5d82d NIFI-2593: This closes #891. Fixed handling of nested records/structs in ConvertAvroToORC 2016-08-18 15:15:51 -04:00
Sarah Olson 4847ed28a1 NIFI-2410: This closes #885. updates to the Controller Services information in the User Guide. 2016-08-18 13:48:00 -04:00
Matt Burgess a74bc2c7c7 NIFI-2598: This closes #889. Fixed issue with static init of properties in HiveConnectionPool 2016-08-18 13:38:22 -04:00
Bryan Bende e0e4b3407a NIFI-2574 This clsoes #887. Fixing NPE when using kerberos keytab location from contexts, and cleaning up hadoop/hbase/hive kerberos variables 2016-08-18 12:19:46 -04:00
Scott Aslan 0e90a0f76a [NIFI-2488] update UI to relect changes to ActionDTO and BulletinDTO. This closes #882 2016-08-18 09:38:16 -04:00