Commit Graph

1265 Commits

Author SHA1 Message Date
Matt Gilman 5dd743947c
NIFI-2768: - Ensuring we correctly enforce authorization when the destination of a connection changes. This includes source, destination, and parent process group. - Ensuring the UI reseting accordingly when a request fails.
This closes #1014.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-13 11:41:51 -04:00
Matt Burgess 6c9291ad53
NIFI-2765: Fixed Kerberos support for PutHiveStreaming
This closes #1012.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-13 11:13:06 -04:00
Matt Gilman b48355e75a
NIFI-2766: - Ensuring the root group is included in /resources.
This closes #1013.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-13 10:59:26 -04:00
Matt Burgess d325773760 NIFI-2262: Added Avro-normalization of table/column names in SQL processors
This closes #994.
2016-09-13 15:46:33 +02:00
Bryan Bende 9ff5c0b25f
NIFI-2760 Specifying jersey-bundle 1.19 for Ranger plugin
This closes #1006.
2016-09-12 14:18:11 -04:00
Kirk Tarou e25885650a NIFI-2440 - Add 'file.lastModifiedTime' attribute to ListSFTP processor
Added 'file.lastModifiedTime' attribute to ListFileTransfer, which is
the abstract class extended by ListSFTP.
String literal attribute names were replaced with static references to
attribute name constants in ListFile.
ListFileTransfer stores the 'file.lastModifiedTime' attribute in the
format specified in ListFile.FILE_MODIFY_DATE_ATTR_FORMAT

Updated WritesAttribute description for file last modify time attribute
to mirror the entry in ListFile

Signed-off-by: Joe Skora <jskora@gmail.com>

This closes #931.
2016-09-09 22:44:23 -04:00
Scott Aslan abaacfa5e5 [NIFI-2721] update CS GoTo. This closes #998 2016-09-09 12:31:46 -04:00
Koji Kawamura ae251c1a6f NIFI-2718: Show HTTP S2S Auth error on bulletin
This commit fixes following two issues, that happens when a Root Group Port
policy for S2S data transfer is removed at a remote NiFi, after a client NiFi has
connected to that port:

1. At client side, Remote Process Group should show that authorization
is failing on its bulletin, but the Exception is caught and
ignored. Nothing is shown on the UI with HTTP transport protocol.
RAW S2S shows error on RPG bulletin. This commit fixes HTTP S2S to
behave the same.

2. At server side, corresponding input-port or output-port should show
that it is accessed by an unauthorized client on its bulletin, but it's
not shown with HTTP transport protocol.
RAW S2S shows warning messages for this. This commit fixes HTTP S2S to
behave the same.

In order to fix the 2nd issue above, request authorization at
DataTransferResource is changed from using DataTransferAuthorizable
directly, to call RootGroupPort.checkUserAuthorization().

Because the blettin is tied to the Port instance and it's
difficult to produce blettin message from this resource.

Since RootGroupPort.checkUserAuthorization uses
DataTransferAuthorizable inside, the check logic stays the same as
before.

Adding a RootGroupPortAuthorizable to provide access to necessary components for performing the authorization.

This closes #996
2016-09-08 13:43:38 -04:00
Mark Payne bc7c42efa5
NIFI-1966: Recreated issue that is outlined in JIRA (the reason for re-opening the ticket) that results in 'java.util.NoSuchElementException: No value present' in unit test - Resolved issue where two flows that are both empty but have different fingerprints (due to root group id being different) causes vote election to fail
This closes #995.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-08 10:48:24 -04:00
Oleg Zhurakousky d36b76cc60 NIFI-2745 added _source destination name_ attribute to ConsumeJMS
This closes #992
2016-09-07 15:28:34 -04:00
Mark Payne 938e32ed97 NIFI-2746: Ensure that the FlowController is injected into all ResourceApplications. This closes #993 2016-09-07 14:11:46 -04:00
vijayk 80224e3e5e
NIFI-2741 Move HBase, Storm, Hive, and Kafka versions into properties.
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-07 12:06:01 -04:00
Mark Payne 8d6e12fdc4 NIFI-2739: Call KafkaConsumer.wakeup() if consumer is blocking for at least 30 seconds when OnUnscheduled is called 2016-09-07 08:56:23 -04:00
Matt Burgess 2afc739ab7 NIFI-2712: Fixed Fetch processors for multiple max-value columns. This closes #976 2016-09-06 16:52:40 -04:00
Mark Payne a7e76cc00a NIFI-1966: When cluster is started up, do not assume that Cluster Coordinator has the golden copy of the flow but instead wait for some period of time or until the required number of nodes have connected, and then choose which flow is correct. This closes #977 2016-09-06 16:31:37 -04:00
joewitt 7a451935a5
NIFI-2732 ensure session and consumer aligned and has registered rebalance listener. Make consumption far more memory and process efficient, fixed extraneous getbundled call
This closes #987.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-06 15:48:40 -04:00
Mark Payne 088125451b
NIFI-2681: Refactored IndexManager into an interface and renamed the existing implementation to CachingIndexManager. Implemented a new SimpleIndexManager that performs no caching of IndexSearchers.
This closes #958.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-06 12:25:28 -04:00
Mark Payne a9d029d74e NIFI-2717: Ensure that when performing site-to-site communications that we always commit the transaction on the remote side before committing it on the local side
This closes #978

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-09-06 10:57:53 +09:00
Joe Gresock 0e64c3ed30 NIFI-2631: Adding page commits and 'Use Versions' to ListS3
This closes #916 and closes #917.

Signed-off-by: James Wing <jvwing@gmail.com>
2016-09-03 16:04:42 -07:00
Jeff Storck 97e2f406da NIFI-2708 Added merging of SiteToSite details
NIFI-2708 Updated to include ports from clientDto for port merging.

This closes #981
2016-09-02 14:55:08 -04:00
Matt Gilman d37480eaff NIFI-2722:
- Updating the component entity as long as the proposed entity is not older than the current one since stats are bundled in the entity too.

This closes #983

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-09-02 22:25:25 +09:00
Scott Aslan 867c84f32c [NIFI-2649] Update CS table upon creation of a CS from the RT or CS properties table
- Ensuring the controller services table to correctly reloaded regardless if its the processor group or controller level controller services. This closes #968
2016-09-01 09:53:12 -04:00
Matt Gilman 96a766464c
NIFI-2678: - Ensuring the most recent version of each component is save for rendering on the canvas.
This closes #979.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-31 15:59:52 -04:00
Matt Gilman 9e10371c8a NIFI-2704:
- Re-using the DataTransferAuthorizable in the DataTransferResource.
- Removing use of the DataTransferResource when obtaining site to site details as it performs additional unnecessary checks.
- Code clean up.
- This closes #971.
2016-08-31 15:09:17 -04:00
Yolanda M. Davis 1bb909ebca NIFI-2703 - Added bootstrap.conf file for running integration tests. This closes #975 2016-08-31 09:28:08 -04:00
Scott Aslan 648ddb6158 [NIFI-2679] User is now able to disable/enable processors that are invalid or stopped through Operate palette. This closes #973 2016-08-31 09:11:46 -04:00
Mark Payne 1213b46632 NIFI-2628: Whenever a flow is inherited from cluster coordinator, save flow immediately to disk
This closes #967
2016-08-30 16:13:45 -04:00
Matt Gilman ba19238757
NIFI-2694: - Addressing instances where phase one objects were being referenced instead of phase two objects. - Code clean up.
This closes #970.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-30 15:50:48 -04:00
Andy LoPresto 8556777bf6
NIFI-2618 Reverted merging PR 955 to master as 1.0.0 requires Java 8. 2016-08-30 09:27:24 -07:00
Andy LoPresto d600b065bb
NIFI-2618 Added logic to unit test to handle default TLS version for Java <= 7.
This closes #955.
2016-08-30 08:25:38 -07:00
jpercivall 1752a57197 Merge branch 'NIFI-2676-rc1' of https://git-wip-us.apache.org/repos/asf/nifi 2016-08-31 14:01:57 +10:00
Koji Kawamura daf4855570 NIFI-2687: RPG Port ID was used instead of RPG ID
It caused "Error: Unable to find remote process group with id 'XXXX'" error with modifying the transmitting toggle switch of an Input or Output port.

This closes #962
2016-08-29 10:14:55 -04:00
Joseph Percivall 1fe18a1567 NIFI-2676-rc1 prepare for next development iteration 2016-08-26 11:40:58 -04:00
Joseph Percivall 74d5224783 NIFI-2676-rc1 prepare release nifi-1.0.0-RC1 2016-08-26 11:40:44 -04:00
Scott Aslan c8ae7fcbe1 [NIFI-2480] remove explicit angular $sanitize to fix multibyte chars in breadcrumbs and flow status bar. All values are escapoed through the angular ng-bind. This closes #957 2016-08-26 11:03:10 -04:00
Koji Kawamura 2ed58912b2 NIFI-2480: Fix for multibyte chars in breadcrumbs. This closes #956
Removed $sanitize from breadcrumbs controller, as it escapes multibyte
chars with numerical reference. Even without $sanitize, html tags can be
escaped when Angular binds the value to text content.
2016-08-26 10:27:27 -04:00
Matt Burgess 0745990c2d NIFI-2604: Added validators and logic for multiple URLs/files/folders for DB driver location
This closes #912

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-25 23:35:41 -04:00
jpercivall 6ef1cca18f NIFI-2269 Fixing Datadog licensing 2016-08-25 22:43:00 -04:00
jpercivall e1da9fc11f NIFI-2667 Adding License and Notice information to Media Bundle Nar and Assembly
This closes #950
2016-08-25 22:42:37 -04:00
joewitt 405252244e NIFI-2670 minor doc edit to remove kafka.key.hex reference 2016-08-25 22:17:07 -04:00
Mark Payne 58e0ce7f92 NIFI-2670: This closes #954. Expose option for how to interpret Kafka Key - hexadeimal encoding or UTF-8 String 2016-08-25 21:39:40 -04:00
Bryan Rosander 102a9a2b74 NIFI-2674 - Always adding flow files to result set flowfiles, catching runtime exceptions while converting to avro
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #953
2016-08-25 21:16:26 -04:00
Oleg Zhurakousky 7879a99206
NIFI-2675 fixed NPE in template generation
This closes #951.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-25 16:44:02 -07:00
Bryan Bende 957c120343 NIFI-2664 Moving System.setProperty for krb5.conf to NiFi startup, and removing conflicting property from KerberosProvider config
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #946
2016-08-25 17:26:37 -04:00
Mark Payne f908ae3c3b NIFI-2669: This closes #949. Ensure that if Exception is thrown during Transaction initialization that the underlying client is closed/cleaned up. Also ensure that we generate bulletins when logging error/warn level log messages 2016-08-25 16:39:00 -04:00
Matt Burgess a84d3c9873 NIFI-2665: This closes #942. Fixed intermittent validation errors in InvokeScriptedProcessor 2016-08-25 15:34:50 -04:00
joewitt 1624dd8e4d NIFI-2666 This closes #947. updated where it says BSD to say MIT for bcrypt 2016-08-25 14:59:46 -04:00
joewitt 218408953a NIFI-2668 Added missing license/notice entries for ignite deps in nar 2016-08-25 14:50:38 -04:00
Matt Burgess 3224b1a5dd NIFI-2668: This closes #945. Replaced JSR-107 JCache API JAR w Geronimo version, updated notices 2016-08-25 14:41:08 -04:00
Matt Burgess ad7808f63d NIFI-2641: This closes #928. Add max values as attributes to QueryDatabaseTable 2016-08-25 14:13:55 -04:00