2afc739ab7
NIFI-2712: Fixed Fetch processors for multiple max-value columns. This closes #976
2016-09-06 16:52:40 -04:00
a7e76cc00a
NIFI-1966: When cluster is started up, do not assume that Cluster Coordinator has the golden copy of the flow but instead wait for some period of time or until the required number of nodes have connected, and then choose which flow is correct. This closes #977
2016-09-06 16:31:37 -04:00
7a451935a5
NIFI-2732 ensure session and consumer aligned and has registered rebalance listener. Make consumption far more memory and process efficient, fixed extraneous getbundled call
...
This closes #987 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-06 15:48:40 -04:00
088125451b
NIFI-2681: Refactored IndexManager into an interface and renamed the existing implementation to CachingIndexManager. Implemented a new SimpleIndexManager that performs no caching of IndexSearchers.
...
This closes #958 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-06 12:25:28 -04:00
a9d029d74e
NIFI-2717: Ensure that when performing site-to-site communications that we always commit the transaction on the remote side before committing it on the local side
...
This closes #978
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-09-06 10:57:53 +09:00
0e64c3ed30
NIFI-2631: Adding page commits and 'Use Versions' to ListS3
...
This closes #916 and closes #917 .
Signed-off-by: James Wing <jvwing@gmail.com>
2016-09-03 16:04:42 -07:00
97e2f406da
NIFI-2708 Added merging of SiteToSite details
...
NIFI-2708 Updated to include ports from clientDto for port merging.
This closes #981
2016-09-02 14:55:08 -04:00
d37480eaff
NIFI-2722:
...
- Updating the component entity as long as the proposed entity is not older than the current one since stats are bundled in the entity too.
This closes #983
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-09-02 22:25:25 +09:00
867c84f32c
[NIFI-2649] Update CS table upon creation of a CS from the RT or CS properties table
...
- Ensuring the controller services table to correctly reloaded regardless if its the processor group or controller level controller services. This closes #968
2016-09-01 09:53:12 -04:00
96a766464c
NIFI-2678: - Ensuring the most recent version of each component is save for rendering on the canvas.
...
This closes #979 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-31 15:59:52 -04:00
9e10371c8a
NIFI-2704:
...
- Re-using the DataTransferAuthorizable in the DataTransferResource.
- Removing use of the DataTransferResource when obtaining site to site details as it performs additional unnecessary checks.
- Code clean up.
- This closes #971 .
2016-08-31 15:09:17 -04:00
1bb909ebca
NIFI-2703 - Added bootstrap.conf file for running integration tests. This closes #975
2016-08-31 09:28:08 -04:00
648ddb6158
[NIFI-2679] User is now able to disable/enable processors that are invalid or stopped through Operate palette. This closes #973
2016-08-31 09:11:46 -04:00
1213b46632
NIFI-2628: Whenever a flow is inherited from cluster coordinator, save flow immediately to disk
...
This closes #967
2016-08-30 16:13:45 -04:00
ba19238757
NIFI-2694: - Addressing instances where phase one objects were being referenced instead of phase two objects. - Code clean up.
...
This closes #970 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-30 15:50:48 -04:00
8556777bf6
NIFI-2618 Reverted merging PR 955 to master as 1.0.0 requires Java 8.
2016-08-30 09:27:24 -07:00
d600b065bb
NIFI-2618 Added logic to unit test to handle default TLS version for Java <= 7.
...
This closes #955 .
2016-08-30 08:25:38 -07:00
1752a57197
Merge branch 'NIFI-2676-rc1' of https://git-wip-us.apache.org/repos/asf/nifi
2016-08-31 14:01:57 +10:00
daf4855570
NIFI-2687: RPG Port ID was used instead of RPG ID
...
It caused "Error: Unable to find remote process group with id 'XXXX'" error with modifying the transmitting toggle switch of an Input or Output port.
This closes #962
2016-08-29 10:14:55 -04:00
1fe18a1567
NIFI-2676-rc1 prepare for next development iteration
2016-08-26 11:40:58 -04:00
74d5224783
NIFI-2676-rc1 prepare release nifi-1.0.0-RC1
2016-08-26 11:40:44 -04:00
c8ae7fcbe1
[NIFI-2480] remove explicit angular $sanitize to fix multibyte chars in breadcrumbs and flow status bar. All values are escapoed through the angular ng-bind. This closes #957
2016-08-26 11:03:10 -04:00
2ed58912b2
NIFI-2480: Fix for multibyte chars in breadcrumbs. This closes #956
...
Removed $sanitize from breadcrumbs controller, as it escapes multibyte
chars with numerical reference. Even without $sanitize, html tags can be
escaped when Angular binds the value to text content.
2016-08-26 10:27:27 -04:00
0745990c2d
NIFI-2604: Added validators and logic for multiple URLs/files/folders for DB driver location
...
This closes #912
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-25 23:35:41 -04:00
6ef1cca18f
NIFI-2269 Fixing Datadog licensing
2016-08-25 22:43:00 -04:00
e1da9fc11f
NIFI-2667 Adding License and Notice information to Media Bundle Nar and Assembly
...
This closes #950
2016-08-25 22:42:37 -04:00
405252244e
NIFI-2670 minor doc edit to remove kafka.key.hex reference
2016-08-25 22:17:07 -04:00
58e0ce7f92
NIFI-2670: This closes #954 . Expose option for how to interpret Kafka Key - hexadeimal encoding or UTF-8 String
2016-08-25 21:39:40 -04:00
102a9a2b74
NIFI-2674 - Always adding flow files to result set flowfiles, catching runtime exceptions while converting to avro
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #953
2016-08-25 21:16:26 -04:00
7879a99206
NIFI-2675 fixed NPE in template generation
...
This closes #951 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-25 16:44:02 -07:00
957c120343
NIFI-2664 Moving System.setProperty for krb5.conf to NiFi startup, and removing conflicting property from KerberosProvider config
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #946
2016-08-25 17:26:37 -04:00
f908ae3c3b
NIFI-2669: This closes #949 . Ensure that if Exception is thrown during Transaction initialization that the underlying client is closed/cleaned up. Also ensure that we generate bulletins when logging error/warn level log messages
2016-08-25 16:39:00 -04:00
a84d3c9873
NIFI-2665: This closes #942 . Fixed intermittent validation errors in InvokeScriptedProcessor
2016-08-25 15:34:50 -04:00
1624dd8e4d
NIFI-2666 This closes #947 . updated where it says BSD to say MIT for bcrypt
2016-08-25 14:59:46 -04:00
218408953a
NIFI-2668 Added missing license/notice entries for ignite deps in nar
2016-08-25 14:50:38 -04:00
3224b1a5dd
NIFI-2668: This closes #945 . Replaced JSR-107 JCache API JAR w Geronimo version, updated notices
2016-08-25 14:41:08 -04:00
ad7808f63d
NIFI-2641: This closes #928 . Add max values as attributes to QueryDatabaseTable
2016-08-25 14:13:55 -04:00
04db806ace
NIFI-2614 This closes #944 . added support for max.request.size
2016-08-25 13:51:08 -04:00
a6133d4ce3
NIFI-2635:
...
- Fixing contrib check issues.
- Clean up pom.
- Addressing issue where reporting task property descriptor using wrong scope.
NIFI-2635:
- Fixing issue with revisions when creating users and user groups.
- Forwarding requests to the coordinator instead of replicating.
- Tweaking verbage in dialog for removing users and groups.
This closes #943
2016-08-25 13:08:35 -04:00
1745c1274b
NIFI-2608 This closes #930 . restructured the ConsumeKafka processor to follow new consumer API. Made nar classloading more precise to support spawned threads NIFI-2660.
2016-08-25 10:09:50 -04:00
626e23e0ab
Adding ConsumerResource and ConsumerPool for ConsumeKafka
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-08-25 09:47:26 -04:00
56e515f7ae
[NIFI-2658] Use bulletinEntity id instead of bulleting id since the ids match but bulletinEntities do not get bulletin objects if user is not authorized. This closes #938
2016-08-25 09:27:41 -04:00
6fd1c17ca4
NIFI-2662 - Fix checkstyle violations introduced by NIFI-2635
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #940
2016-08-25 08:55:34 -04:00
e210172d93
PutSQLBinary
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2591
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2591
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2591 - Added Format option for binary data types. Updated unit tests.
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #883
2016-08-25 08:41:23 -04:00
afb9a0016f
NIFI-2659: Fixed RPG Received stats. This closes #939
...
It was showing the 'Sent' stats as 'Received' stats.
2016-08-25 08:34:17 -04:00
c2bfc4ef24
NIFI-2635: - Re-using the original request during the second phase of the two phase commit. - Forwarding requests to the coordinator when received by a node.
...
This closes #933
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-24 22:42:10 -04:00
2ceb5c8097
NIFI-2647:
...
- Referencing correct components when checking if save is required.
This closes #935 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-24 15:52:20 -07:00
6331dda8d3
NIFI-2643 Changed null check to !isBlank() for key in RunNiFi.
...
NIFI-2643 Updated comment in bootstrap.conf template.
This closes #932
2016-08-24 16:20:10 -04:00
6475924f53
NIFI-2642 Catches (and ignores) ResourceNotFoundException during the updating of a property value for a controller service when the current value points to a controller service that has been deleted, allowing the assigning of a new controller service to continue.
...
This closes #931
2016-08-24 15:55:04 -04:00
c2ae7a6d7c
NIFI-2605: - Fixing a regression bug where nodes would potentially be elected leader for Cluster Coordinator role when they do not have the correct flow
...
- Ensure that we log which node is the cluster coordinator on startup instead of just indicating that there is one. If we later determine that there is none, ensure that we register for the role
This closes #900
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-24 12:30:48 -04:00
c638191a47
NIFI-1831 Added internal logic and command-line tool to allow AES-encrypted sensitive configuration values in nifi.properties.
...
This closes #834 .
2016-08-23 20:34:31 -07:00
ee9bd94082
NIFI-2632: Added fragment attributes to SplitJson and SplitXml
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #919
2016-08-23 16:30:57 -04:00
5d1a4f343f
NIFI-2622: Added support for complex types in SelectHiveQL
...
This closes #922 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-23 15:52:16 -04:00
0303805c01
NIFI-2620 Adding support for Binary Row Keys for both PutHBaseCell and PutHBaseJSON. This also involved making changes to PutFlowFile and PutColumn to carry around byte[] and not all strings. This closes #914 .
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-23 13:25:55 -04:00
4a49587533
NIFI-2610 annotated unstable tests with @Ignore
...
This closes #918
2016-08-23 13:13:05 -04:00
fbec3b9c13
NIFI-2623: Fixed support for binary types in SelectHiveQL
...
This closes #920 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-23 11:43:46 -04:00
8cc670c8a6
NIFI-2634: Ensure that we check whether or not the Site-to-Site protocol is set when importing template, instead of assuming that it will be
...
This closes #921
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-23 11:19:44 -04:00
3f60eac544
[NIFI-2599] Enhance Status History Dialog. This closes #894
2016-08-23 10:53:10 -04:00
6e82ec738c
NIFI-2269 Fixing minor issues with style check, licensing, etc.
2016-08-22 21:34:51 -04:00
376d3c4ef4
NIFI-2269 Added datadog support
...
This closes #655
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-22 21:34:51 -04:00
dca3764ed1
NIFI-2626 Fixes jetty server thread leak. This closes #910
2016-08-22 15:58:06 -04:00
17dec04939
NIFI-2611: Fixing bugs in UnpackContent with flow file unpackers
...
Signed-off-by: Mike Moser <mosermw@apache.org>
This closes #905
2016-08-22 14:47:24 -04:00
087622eadc
NIFI-2606:
...
- Addressing issue when fingerprinting ReportingTasks and ControllerServices properties with default values.
- Ensuring the flow is saved when templates are created and imported.
- Ensuring default values are included in templates.
- Fixing unit tests.
This closes #908 .
2016-08-22 13:35:15 -04:00
1fcec3747b
NIFI-2617: Instead of retrying an infinite number of times to communicate with ZooKeeper, should try only for a short period in CuratorLeaderElectionManager. This is because web requests may be blocked waiting on a determination of which node is cluster coordinator
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #906
2016-08-22 13:24:22 -04:00
5fab783b50
NIFI-2609: Ensure that we handle URIs for Remote Process Groups that do not have a path of /nifi or /nifi/
...
This closes #902 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-22 13:21:42 -04:00
95b5877f5d
NIFI-2600: Ensure that we do not close Index Searchers prematurely, even if they are poisoned
...
This closes #896
2016-08-22 12:03:47 -04:00
a2d3d0c289
Update to support offsets larger than 2 gigabyte.
2016-08-22 11:02:48 -04:00
b7dc21bd95
NIFI-2547: Fixed checkstyle errors and updated to reflect KerberosProperties changes
2016-08-21 10:26:40 -04:00
26d362b144
NIFI-2547: Add DeleteHDFS Processor
...
This processor adds the capability to delete files or
directories inside of HDFS.
Paths supports both static and expression language values,
as well as glob support (e.g. /data/for/2016/07/*).
This processor may be used standalone, as well as part of a
downstream connection.
Signed-off-by: Matt Burgess <mattyb149@apache.org>
Add Glob Matcher with Tests
Also set displayName on properties.
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #850
2016-08-21 10:10:21 -04:00
02071103d0
* Add "Remove All Content" property, related functionality, and tests to ModifyBytes processor to allow deletion of all flow file content.
...
* Removed @Ignore annotation on class and unnecessary EOL translation of test data. Because ModifyBytes treat input as binary data, not text, line endings don't matter as long as they byte offsets are calculated correctly.
* Replace validator with .allowableValues.
This closes #890 .
2016-08-19 20:05:14 +02:00
3378426f35
NIFI-2581: Keeping context menu and tooltips open when refreshing the canvas.
...
This closes #899 .
2016-08-19 19:36:26 +02:00
a181c7b9d7
[NIFI-2601] Update bower.json to use specific versions. This closes #897
2016-08-19 10:34:48 -04:00
31ca8d02f7
NIFI-2488 Fixed BulletinDTOs not getting their node addresses set properly during bulletin merging. This closes #888
2016-08-19 08:32:00 -04:00
46b81058c7
NIFI-2602: Fixed NPE in SelectHiveQL when CSV output and null column value
...
This closes #898 .
2016-08-19 09:56:26 +02:00
6b5950647a
NIFI-2596:
...
- Adding tooltip for property descriptor on mouse enter of table cell.
This closes #893 .
2016-08-18 17:23:30 -04:00
57648308db
NIFI-2597:
...
- Updating the correct object when attempting to create a self loop.
2016-08-18 17:15:16 -04:00
87161ab96e
NIFI-2595: - Updating ReportingTasks to use ComponentLogger instead of creating Controller level bulletins.
...
- Making the bulletin responses consistent in that all bulletins will be included but in redacted form as appropriate.
- Fixing broken unit test.
This closes #892 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-18 17:06:28 -04:00
f3387426a0
NIFI-2587:
...
- Adding additional authorization for accessing component property history.
2016-08-18 17:05:32 -04:00
6874a5d82d
NIFI-2593: This closes #891 . Fixed handling of nested records/structs in ConvertAvroToORC
2016-08-18 15:15:51 -04:00
a74bc2c7c7
NIFI-2598: This closes #889 . Fixed issue with static init of properties in HiveConnectionPool
2016-08-18 13:38:22 -04:00
e0e4b3407a
NIFI-2574 This clsoes #887 . Fixing NPE when using kerberos keytab location from contexts, and cleaning up hadoop/hbase/hive kerberos variables
2016-08-18 12:19:46 -04:00
0e90a0f76a
[NIFI-2488] update UI to relect changes to ActionDTO and BulletinDTO. This closes #882
2016-08-18 09:38:16 -04:00
08735a4f57
NIFI-2488 Wrapping ActionDTO and BulletinDTO in entities to be able to provide readability permission to the client
2016-08-18 09:37:11 -04:00
567535c3d0
NIFI-2382: Fixed typo in documentation
2016-08-18 09:15:55 -04:00
91a59a8a5a
NIFI-2545: Ensure that when @OnUnscheduled and @OnStopped methods are called that the active thread count takes that thread into account
...
This closes #836 .
2016-08-18 08:33:45 -04:00
7bc7b7f683
NIFI-2584 Fixing date format in PutSQL
...
This closes #878 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-17 16:10:56 -04:00
3d1a24ab7d
NIFI-2578:
...
- Ensuring NiFi still attempts to issue a registration request to support 1.x -> 0.x site to site.
2016-08-17 15:35:16 -04:00
a0fab15eb7
NIFI-2519 polishing remote address formatting to avoid NPE and other potential exceptions.
...
This closes #871
2016-08-17 15:13:05 -04:00
e7288af859
NIFI-2519 - ListenSMTP addresses mismatch between smtp.src attribute documentation and attribute.put
2016-08-17 14:58:02 -04:00
0ffdc2eb92
Merge branch 'master' of https://github.com/apache/nifi
...
(Apologies for merge commits, but it was not possible to rebase the 2574 commits (PR 872)).
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-17 10:58:38 -07:00
b2e468ecf8
NIFI-2574 updated to reflect new accessor methods for nifi properties with kerberos service
...
This closes #872 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-17 10:51:55 -07:00
a0d1aae603
NIFI-2583
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2582
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2582
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #877
2016-08-17 13:20:44 -04:00
1470a52b1b
NIFI-2582 NIFI-2583
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2583 Tweaks
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #877
2016-08-17 13:19:56 -04:00
a5261914fb
NIFI-2574 merging latest kerb changes to adjust for NiFiProperties
2016-08-17 09:06:18 -07:00
7c99b5e638
NIFI-2574 fixed queue swap threshold setting
2016-08-17 09:05:36 -07:00
3f7216ab84
NIFI-2561: - Decoupling kerberos service and spnego principles and keytabs.
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #873
2016-08-17 08:14:05 -04:00
d9633757a6
NIFI-2574 fix spring context definitions
2016-08-17 03:38:31 -07:00
6bf7e7f325
NIFI-2574 merging master with cluster changes to updated NiFiProperties approach
2016-08-17 01:23:54 -07:00
7d7401add4
NIFI-2574 Changed NiFiProperties to avoid static initializer and updated all references to it.
2016-08-17 00:10:07 -07:00
e42ea9ad45
NIFI-2566: Refactored to allow just the Leader Election Manager to be responsible for determining who is the Cluster Coordinator
...
NIFI-2566: Removed storage of cluster roles from heartbeats and NodeConnectionStatus; use LeaderElectionManager to determine roles instead
NIFI-2566: Updated Heartbeats so that if a node is out-of-sync with cluster topology, cluster coordinator will provide updated information back to the nodes
NIFI-2566: Fixed issue that prevented standalone instance from starting by creating a standalone-instance version of the Leader Election Manager. Also added Controller Service enabled/disabled state to fingerprint rather than attempting to update the state when joining the cluster, as the implementation was incorrect and the correct implementation will be a rather significant effort that doesn't have to happen for 1.0.0 release
This closes #866
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-16 20:39:04 -04:00
b3f36489ad
NIFI-2534: - Refreshing using component IDs. - Code clean up.
...
This closes #874 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-16 16:05:20 -04:00
b0122c6a73
NIFI-2465 - InferAvroSchema EL support based on incoming FlowFiles
...
This closes #863 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-16 12:50:53 -04:00
26f5c496d1
NIFI-2534 Fix JS error when stopping a process group
...
This closes #867 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-16 11:09:41 -04:00
b22500d0a3
NIFI-2576 Allowing PutSQL to use timestamps in epoch or string format
...
This closes #869 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-16 10:26:24 -04:00
03d3b3961d
NIFI-2577: Increased default stripe size in ConvertAvroToORC to 64MB
...
This closes #870 .
2016-08-16 11:53:05 +02:00
6af768d0a1
NIFI-2551: Addressed a threading issue in the StandardResourceClaimManager and performed some refactoring so that we can ensure thread-safety across different components of the application, such as ProcessSession and WriteAheadFlowFile Repository when interacting with the StandardResourceClaimManager. Update DebugFlow to allow it to write to a FlowFile multiple times, which exposes the concurrency bug. Also avoided calling ContentRepository.remove() from ProcessSession whenever the content is no longer needed, as that can cause problems now that the Resource Claim is backing the content claim.
2016-08-15 17:02:15 -04:00
ed42f2e3e3
NIFI-2552: Updated Curator for HiveQL processors using Zookeeper quorum in URL
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #865
2016-08-15 16:53:57 -04:00
7d8dd27027
NIFI-2554: - Requiring READ permissions on the referenced controller service when creating/updating processors, controller services, and reporting tasks.
...
- Preventing client side selection of unauthorized controller services unless they were the previously configured value.
This closes #860 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-15 16:46:58 -04:00
2a92747046
[NIFI-2559] UI - Controller Service update missing icons
...
This closes #864
2016-08-15 16:27:12 -04:00
d45114e48d
NIFI-2501: - Ensuring users can access the controller service list regardless of permissions on the corresponding process group or controller. - Better handling the case where the user had write permissions but no read permissions. - Returning to the appropriate controller service listing after going to the usage page.
...
This closes #835
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-15 15:16:58 -04:00
51c566ffc8
NIFI-2546 fixed NPE in FlowSnippetDTO fixed NPE caused by non-configured ControllerService
...
This closes #859 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-15 14:55:20 -04:00
fbd3201157
NIFI-2524 - Fixes to improve handling of missing journal files during rollover/merge execution.Includes:
...
This closes #840
Removed partial file check (based on missing first file)
Added condition to merge if at least one journal files available on disk. If all files are missing from disk that is considered an error.
Added retry logic to prevent endless thread execution when encountering errors (such as missing files).
2016-08-15 14:43:38 -04:00
44057f097a
NIFI-2356 ConvertJSONToSQL assumes IS_AUTOINCREMENT
...
This closes #862 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-15 14:17:16 -04:00
fd0dd51ff5
NIFI-2553 Fixing handling of Paths in HDFS processors
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #843
2016-08-15 08:59:42 -04:00
9c7668948c
NIFI-2560 This closes #851 . fixed property handling and added tests using it
2016-08-14 14:35:25 -04:00
b7b56b1cad
NIFI-2560 added connection timeout to IMAP/POP3
2016-08-14 14:06:07 -04:00
d3b96dcac1
NIFI-2519 This closes #856 . aligned threading model with subethastmp
2016-08-14 13:32:00 -04:00
48fa76ecff
NIFI-2519 Fixed and refactored ListenSMTP processor
...
- Removed message queueing which could result in data loss
- Fixed life-cycle issues that coudl put processor in an unstable state
- Fixed PropertyDescriptor translation for Time units and Byte sizes
- Fixed broken tests
- Added additional tests
NIFI-2519 added default for SMTP_MAXIMUM_CONNECTIONS
NIFI-2519 addressed PR comments, polishing
- fixed intermittent deadlock on processor stop and added test for it
- the attributes that can not be extracted from the message but available via MessageContext are written into the outgoing FlowFile
- other minor fixes
NIFI-2519 addressed lates PR comments
NIFI-2519 added better messaging when server closes the connection
NIFI-2519 some polishing and additional tests to validate deadlocks
NIFI-2519 address latest PR comments
fixed deadlock condition for when the consumer is stopped while server is distributing messages
fixed MAX message size issue ensuring it is validated
set max connections to SMTPServer
polished pom
added L&N
NIFI-2519 PR comments
- fixed LICENSE
- Added usage of LimitingInputStream
- simplified SmtpConsumer by removing hasMessage operation
2016-08-14 13:31:46 -04:00
0855cb9bd4
NIFI-2555:
...
- Addressing potential NullPointerException when an AccessDeniedException is thrown from an endpoint that isn't subject to the security filter chain.
This closes #846 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-12 15:08:00 -07:00
6799bd4919
NIFI-1876 fixing counter URI pattern
2016-08-12 17:23:12 -04:00
bbdd087d77
NIFI-1876 Implemented PropertyDescriptorDTO merging
...
NIFI-1876 Updated PermissionsDTO to use boolean primitives instead of Boolean objects for read and write permission
Removed ISE throwing from EntityFactory, it will rely on null checks instead
This closes #694
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-12 17:22:37 -04:00
e81147c92a
NIFI-1876: - Introducing entities for allowable values and process group status.
...
Signed-off-by: Jeff Storck <jtswork@gmail.com>
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-12 17:22:26 -04:00
572dfed78a
NIFI-1876 Implements merging of responses to successful requests based on authorization, returning the most restrictive response - Added StandardHttpResponseMergerSpec for testing response merging - Added Permissible interface - Added nifi-api/controller/archive to ProcessGroupEndpointMerger - Removed AbstractMultiEntityEndpoint.java, not used anymore - Implemented reponse merging for GET requests where there are some successful and problematic responses, returning most restrictive one. - Updated nf-settings.js with ControllerConfigurationEntity property rename from controllerConfiguration to component - Implemented merging of status DTOs based on read permission NIFI-2264 Implemented merging of status history results based on readability permissions - Added StatusHistoryEndpointMergerSpec to test merging of status history based on read permission
...
NIFI-1876 Added merging for labels, funnels, and controller service references.
NIFI-1876 Added Label and Funnel merging to FlowMerger.java
NIFI-1876 Added replication of request for process group controller services
- Updated merging code for Status and Status History based on read permissions
NIFI-1876 Fixed issue with node status snapshots all looking like they came from one node
Updated ProcessGroupStatusSnapshotDTO to contain status snapshot entities to retain readability permission
Added entity classes for ConnectionStatusSnapshotDTO, PortStatusSnapshotDTO, ProcessGroupStatusSnapshotDTO, ProcessorStatusSnapshotDTO, and RemoteProcessGroupStatusSnapshotDTO
Updated PropertyDescriptorDTO to contain AllowableValueEntity to retain readability permission
Added entity class for AllowableValueDTO
Moved AllowableValueDTO to its own top-level class
Updated DtoFactory to get permissions for status snapshot entities
Updated StatusMerger to merge status snapshot entities
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-12 17:22:17 -04:00
a9675552d9
[NIFI-2557] Enhance Modal Plugin. This closes #842
2016-08-12 11:40:45 -04:00
e5e86cf07c
NIFI-2548:
...
- Allowing selection of User/Cluster node when searching and encountering an exact match.
This closes #839
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-08-12 20:41:49 +09:00
fa639e2596
NIFI-2542: - Ensuring transitive referencing components are able to be returned. - Ensuring we can enable/disable services with transitive referencing components. - Ensuring we cannot enable/disable services with unauthorized referencing components.
...
NIFI-2543: - Ensuring we have permissions before attempting to reload a controller service.
This closes #837
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-11 20:42:35 -04:00
25a2fac453
NIFI-2535: Do not include properties that are unset in flow fingerprint. This allows a new property to be added to a processor without affecting the fingerprint, if the value is never set
...
This closes #829 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-11 10:44:28 -04:00
76a4a2c48b
NIFI-2544: Created integration tests for clustering and addressed a few minor bugs that were found in doing so
...
This closes #832 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-11 10:43:38 -04:00
d544274881
NIFI-2531: Fixed JdbcCommon handling of BigInteger objects for Avro
...
This closes #823 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-10 15:19:34 -04:00
2938a5353a
NIFI-1663: Adding attribution for derived work for OrcFlowFileWriter
2016-08-10 14:51:05 -04:00
85877a73dc
NIFI-2540: Exclude from templates the parts of property descriptors that are not necessary. Also ensure that Property Descriptors are not completely removed from Controller Services.
...
This closes #828
2016-08-10 13:27:20 -04:00
d9720239f5
NIFI-1663: Add ConvertAvroToORC processor
...
This closes #727
2016-08-10 12:37:15 -04:00
bb24312709
NIFI-2142 Added Guava cache for XSLT stylesheets in TransformXml
...
This closes #609
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-10 11:13:30 -04:00
557d6365bf
NIFI-2518: Added unit test showing issue
...
NIFI-2518: Added support for fractional seconds to AbstractDatabaseFetchProcessor
This closes #821
2016-08-10 11:10:17 -04:00
219234d001
NIFI-2530: - When no explicit policy is defined, defer to the parent Process Group instead of attempting to match component's within the flow.
...
This closes #826 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-10 11:06:16 -04:00
84cac0daca
NIFI-2299 Add standard services api access for scripting processors
2016-08-09 17:15:44 -04:00
2dc094765d
NIFI-2516 - Extract version info into parent pom, upgrade to commons-io 2.5
...
NIFI-2516 - Removing slf4j-api, version from slf4j-log4j12
This closes #809 .
2016-08-09 22:43:29 +02:00
fbb705e461
NIFI-2511: - Ensuring Process Group bulletins are bubbling up as expected.
...
This closes #822 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-09 16:28:57 -04:00
45c31c8305
NIFI-2507 Added Canned ACL support to PutS3Object
...
This closes #801
Signed-off-by: James Wing <jvwing@gmail.com>
2016-08-09 13:20:52 -07:00
b2401522ea
NIFI-2521 This closes #815 . removed test classes with questionable origin and licensing.
2016-08-09 15:46:58 -04:00
7a1f749f69
NIFI-2475: - Updating UI to better suggest that component specific administrators do not override higher level administrators.
...
This closes #813
2016-08-09 15:40:28 -04:00
7575e87cb1
NIFI-2520 This closes #818 . Added attribution for storm-hive and other Hive dependencies to NOTICEs
2016-08-09 15:27:24 -04:00
42df02f014
NIFI-2406 This closes #820 . Addressed regression introduced in NIFI-2406 where the cluster does not recognize a new Cluster Coordinator when the coordinator is shutdown
2016-08-09 15:19:49 -04:00
18f4150015
NIFI-2515 This closes #814 . fixed Kafka serialization/deserialization settings
2016-08-09 14:28:51 -04:00
f6ba922292
NIFI-1965 This closes #819 . COnvert DNS_TIMEOUT property to TIME_PERIOD
2016-08-09 14:25:07 -04:00
ae8045d99b
NIFI-2505: - Updating the user identity field in the ActionDTO.
...
This closes #800 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-09 13:07:50 -04:00
aae6325603
NIFI-2237: - Reorganizing the refactored REST endpoints. - Tweaking message text.
...
This closes #788 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-09 12:04:31 -04:00
5e5c3f7c3b
NIFI-2504 This closes #810 . fixed template export for RPG
...
- ensured that RPG and connections to it are treated as special case where instance ID is preserved
2016-08-08 16:54:27 -04:00
ed14bf22e7
NIFI-2493 This closes #798 . Do not fingerprint Remote Ports' running state. When synchronizing remote flow with local flow, start/stop remote group ports as appropriate based on the inherited flow
2016-08-08 16:54:27 -04:00
8752d11f18
NIFI-2495 This closes #808 . Ensure that we always close Index Searchers when we're finished with them
2016-08-08 16:54:27 -04:00
d6a2409d71
NIFI-1965 - Implement QueryDNS processor
...
This closes #496 .
2016-08-08 22:27:40 +02:00
493919922e
NIFI-1965 - Rename nifi-geo-bundle to nifi-enrich-bundle
2016-08-08 22:27:22 +02:00
9b647cd538
NIFI-1148 added IMAP/POP3 support added initial set of processors to support consumption of Email via IMAP/IMAPS and POP3 protocols
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-1148 addressed PR comments from @trixpan
NIFI-1148 addressing PR comments
NIFI-1148 addressed PR comments
This closes #710
2016-08-08 11:57:28 -04:00
c1c052af71
NIFI-2406: Ensure that hearbeat monitor continues to run while instance is running. This way if a node sends heartbeat to this node as elected coordinator changes, we notify the node accordingly. Handle Exceptions more gracefully in leader election code. Tweaked some handling of how nodes reconnect to the cluster to ensure more stability with cluster
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #729
2016-08-08 09:15:10 -04:00
d094130a26
NIFI-2237:
...
Extend template handling to read only properties.
* Add read only property handling to type.hbs template.
* Add flag to ProcessorDTO.getRelationships to reflect read only nature of the property.
* Remove explicit "read only" message from ConnectionDTO.getAvailableRelationships to avoid duplicate text.
* This closes #806
2016-08-08 09:06:47 -04:00
e2f649cfea
NIFI-2470 This closes #802 .
...
Fixed WritesAttributes section to include all attributes with the
correct attribute names and descriptions
2016-08-07 23:58:09 -04:00
29f53c07f5
NIFI-2509 This closes #805 . fixed NPE condition in KafkaConsumer
2016-08-07 23:48:57 -04:00
903b1fe465
NIFI-2494 Remove extraneous text that shows on banner line. This closes #793
2016-08-05 16:03:26 -04:00
f2f070c5be
NIFI-2468: Improved UI consistency.
...
- Addressing comments from PR. Moving new service button below the tab pane. (+2 squashed commits)
Squashed commits:
[f746d097d1fb09closes #794 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-05 12:32:06 -07:00
7ffa30d21b
NIFI-2423: Make use of the SSLContextService to provide SSL information
...
Signed-off-by: Oleg Zhurakousky <oleg@suitcase.io>
2016-08-05 14:14:38 -04:00
c39a127ec8
NIFI-2322, NIFI-2423, NIFI-2412 Kafka improvements
...
- Fixed KafkaConsumer's connection block when broker is not available
- Fixed Serializer/Deserializer configs in both Consume/Publish Kafka
- Added sensitive properties for SSL ket/trust stores
NIFI-2322 fixed tests
2016-08-05 14:14:38 -04:00
8d34223265
NIFI-2472: Normalize coordinates for all components in a snippet, not just processors
...
This closes #786
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-04 19:46:39 -04:00
c0a253568e
NIFI-2486: - Authorizing individual bulletins being returned through the bulletin board.
...
This closes #792
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-04 18:41:18 -04:00
04147ac22a
NIFI-2458: - Fixing issue with timezone when the initial provenance result was cancelled.
...
This closes #773 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-04 17:09:21 -04:00
0e0166cec5
NIFI-2483: Removed 'passthrough' relationship
...
This closes #789 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-04 16:12:21 -04:00
7ba10a6dea
NIFI-2484: Ensure that if a Processor throws an Exception from an @OnScheduled method that @OnStopped methods get called
...
This closes #791 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-04 15:34:10 -04:00
aca2a92d6b
Fixing contrib-check in GetHDFSSequenceFileTest
2016-08-04 15:08:08 -04:00
b7b1dc2fe6
NIFI-2471 fix Hadoop configuration resources when talking to multiple Hadoop clusters
...
This closes #779 .
2016-08-04 14:51:03 -04:00
bc6b22389b
NIFI-2407: Fixed NPE
2016-08-04 14:50:30 -04:00
1ea49ad8cf
NIFI-2407 Implements EL support on some properties of processors/services
...
- Added EL support to "Directory" property of ListHDFS and GetHDFS processors
- Added EL support to "Destination" property for ConsumeJMS and PublishJMS processors
- Added EL support to "MQ ConnectionFactory Implementation", "MQ client library path", "Broker URI" properties for the JMS Connection Factory Provider
- Added EL support to "Database Connection URL", "Database Driver Class Name", "DB Driver jar url", "DB username", and "DB password" properties for the DBCP Connection Pool
- Removed NotificationServiceManagerSpec.groovy, previous PR from Joe Witt covers the needed testing for Variable Registry/Value Lookup at this time
This closes #778 .
2016-08-04 14:23:29 -04:00
0d730c5cc1
NIFI-2435 - Wrapping reader call in doAs if necessary
...
This closes #780 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-04 14:01:05 -04:00
321a2398ba
NIFI-2467: - Resetting cached search term when closing the dialog to ensure the same search time works upon re-opening.
...
NIFI-2467: - Fixing issue preventing the selection of an autocomplete result.
This closes #784 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-04 11:22:01 -04:00
3943d72e95
NIFI-1868: Incorporate PutHiveStreaming review comments
...
This closes #706 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-04 10:05:56 -04:00
59659232c7
NIFI-1868: Downgrade to Hive 1.2.1 and remove ConvertAvroToORC
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-04 10:05:45 -04:00
c2019b9339
NIFI-1868: Add PutHiveStreaming processor
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-04 10:05:44 -04:00
cda4310ad8
NIFI-2035: Verify existence of source and destination when creating a connection
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #690
2016-08-04 09:11:25 -04:00
7a7165152e
NIFI-2478 Fixed Zk leaders path to include root.
2016-08-04 08:19:04 -04:00
ed5c44ba53
[NIFI-2053] update open/close palettes. This closes #775
2016-08-04 07:59:13 -04:00
fa4c6ab03c
NIFI-2193 - Added functionality to automate certificate generation, keystore and truststore generation, and nifi.properties keystore and truststore password population. Follow-on changes will be made under NIFI-2476.
...
This closes #695 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
Defaulting to same keyStore, key password (+18 squashed commits)
Squashed commits:
[9d01ba0] NIFI-2193 - Fixing typo
[55440bc] NIFI-2193 - Standalone can run as long as there are no conflicting files/folders
[0ca34ed] NIFI-2193 - Fixing some filename, absolute path issues
[9d4f65b] NIFI-2193 - Incorporating feedback
[f7550b4] NIFI-2193 - Cleaning up imports
[59a7637] NIFI-2193 - Updating umask to allow owner to execute
[cf824e7] NIFI-2193 - Moving DN arg to CA service specific parent class
[921ee13] NIFI-2193 - Making keystore getInstance more consistent
[a283c4b] NIFI-2193 - Updating sample config files in assembly to reflect new structure
[8d3a21d] NIFI-2193 - Making TlsHelper static, adding option to use same password for Key, KeyStore
[b13d247] NIFI-2193 - Addressing PR feedback
[46ef8ed] NIFI-2193 - Removing commons-logging, log4j from notice
[d4cf41a] NIFI-2193 - Adding option to specify output file for CA certificate when using cli client
[b74bf25] NIFI-2193 - Removing Bouncy Castle from notice
[6e34f9a] NIFI-2193 - Adding CLI client for easier generation of client certificates
[2924fca] NIFI-2193 - nifi-toolkit-ssl -> nifi-toolkit-tls, removing unused constants
[886167e] NIFI-2193 - Adding slf4j to avoid runtime issue
[082de46] NIFI-2193 - Command line SSL config utility as well as certificate authority client/server
2016-08-03 21:34:11 -07:00
f0401e4774
NIFI-2419: Ensure that if a node is disconnected that we unregister for 'cluster coordinator' and 'primary node' roles by updating FlowController to know that it is disconnected. Also removed dead code that was needed in the master-worker clustering paradigm but not for zero-master-clustering
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #739
2016-08-03 23:38:50 -04:00
c26398eaba
NIFI-2402: - Removing client side check component move eligibility and instead relaying on verification server side. Cannot check client side as the current user may not have permissions to inspect required fields.
...
This closes #750
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-03 19:08:25 -04:00
83a23f90d4
NIFI-2466: Added option to provide separate key password to StandardSSLContextService.
...
Fixed NPE (+2 squashed commits)
Squashed commits:
[c5d521aaa4d418closes #776 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-03 15:56:12 -07:00
1511887a68
NIFI-2301: - Ensure all component specific policies are removed when the component is removed. - Allowing snippets to be created if the user has read or write access as we don't know what the intended snippet usage. When used the snippet is still authorized accordingly. - Ensuring actions involving Process Groups correctly authorize encapsulated components. - Not requiring read permissions when showing the delete button for Controller Services and Reporting Tasks.
...
This closes #757
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-03 18:06:30 -04:00
9338f102cb
NIFI-2237:
...
- Updating Rest Endpoint documentation specifically regarding access policies.
- Ensuring the resource listing is accurate.
- Removing unnecessary code.
2016-08-03 16:18:30 -04:00
fca59ff9d0
NIFI-2438:
...
- If a node reports forbidden, using an appropriate response failure exception.
This closes #760 .
2016-08-03 15:01:04 -04:00
698cde69ba
NIFI-2453 Making FileAuthorizer perform initial seeding when users and groups are already present
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #772
2016-08-03 11:59:03 -04:00
16348b071d
NIFI-2452: This closes #771 . Ensure that we keep track of how many references we have to each lucene searcher and only close the underlying index reader if there are no references to the searcher. Also updated to prefer newer provenance events over older provenance events, and calculate FlowFile lineage based on an event id instead of a FlowFile UUID, as it's much more efficient
2016-08-03 08:05:26 -07:00
e9b87dd734
NIFI-2452: Ensure that we do not close Index Readers that are still in use
2016-08-03 07:54:10 -07:00
bc5237593e
NIFI-2291: Correct the Content URI for 1.0.0 REST API; added cluster node identifier & whether or not clustered to ReportingContext so that the Reporting Task could make use of it
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #752
2016-08-03 10:35:11 -04:00
54549891e3
NIFI-2444 NIFI-2445 fixed PublishKafka
...
- fixed the logging issue NIFI-2444 by ensuring the ProcessLog is added to KafkaPublisher
- fixed KafkaPublisher's isAllAcked operation to ensure that it properly reports that the flow file has failed.
- added additional test
This closes #758 .
2016-08-02 20:30:34 -04:00
52d97f966d
NIFI-2443: - Addressing issue where reload group deferred was being resolved prematurely.
...
This closes #756
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-02 17:06:25 -04:00
2a6580992b
NIFI-2455 Removing 'Queue Buffering Max Time' as a required property of PutKafka. This closes #765
2016-08-02 17:01:58 -04:00
ecca76099a
NIFI-2427: - Only showing read/write data policies for applicable components. Disabling for labels, controller services, reporting tasks, and templates.
...
This closes #748
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-02 16:25:02 -04:00
a1bb94c08a
NIFI-1869 Cloning controller services when referenced by reporting tasks and upgrading from 0.x to 1.0.0. This closes #767
2016-08-02 16:09:54 -04:00
df11e1d2c0
NIFI-2425 fixed ControllerService referebcing in DTOs/Templates. This closes #770
2016-08-02 13:58:19 -04:00
c10d11d378
NIFI-2339 made exception statements more vague and generally limited to identifiers only to avoid any authorization issues. This closes #764
2016-08-02 12:21:43 -04:00
6bcc415eb8
NIFI-2457 removed old state file mechanism and fixed state reset logic
...
This closes #768 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-02 12:11:43 -04:00
e23b235617
NIFI-2028 This closes #714 . This closes #751 . fixed typo in classname
2016-08-02 09:13:41 -04:00
aae2d27879
NIFI-2259: HTTP Site-to-Site can't handle DEST_FULL
...
HTTP Site-to-Site can't handle TRANSACTION_FINISHED_BUT_DESTINATION_FULL
scenario as expected.
That happens if the remote NiFi's input port destination relationship
becomes full during Site-to-Site client sends data. The data which has
already sent to the remote NiFi has to be committed successfully.
However, the remote NiFi returns 503 as a response of commit HTTP
request. Because it does check port availability.
The port availability check shouldn't be called at commit request, since
the session at source NiFi has already been committed. The remote NiFi
should commit its session as well, and return
TRANSACTION_FINISHED_BUT_DESTINATION_FULL response.
This fix makes a remote NiFi to keep the handshaken properties when it holds
transaction to be committed. Then if a transaction already has
handshaken properties, then use it, instead of doing a handshake process
again.
2016-08-02 09:08:00 -04:00
809f042353
NIFI-2028: Fixed Site-to-Site Transit URI
...
Fixed Site-to-Site Transit URI for HTTP to be consistent with RAW socket.
- Removed url from CommunicationsSession since it's redundant as we have
Peer.url, too. The value was not used from anywhere other than HTTP
Site-to-Site.
- Added createTransitUri method in Communicant interface, so that
implementation can customize transitUri while providing consistent
interface.
2016-08-02 09:08:00 -04:00
09840027a3
NIFI-2304: If node address is not set, default to localhost, as the admin guide says it should
...
This closes #688
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-08-02 12:09:34 +09:00
9a2f8c598e
NIFI-2441 This closes #766 . View state fails with a JS error
...
Removed permission check causing "Cannot read property 'canRead' of
undefined". A given user won't have record level permission
difference for component state. It's not required here.
2016-08-01 22:54:37 -04:00
05a99a93cb
NIFI-2208 This closes #754 . refactored as per comments on JIRA. Reduced API expsosure and tightened lifecycle management.
2016-08-01 14:17:26 -04:00
7f45251bbd
[NIFI-2426] Update visibility of New service/task button in Controller Settings
...
- Ensuring button is hidden when the user doesn't have permissions to modify the controller.
- This closes #759
2016-08-01 13:32:42 -04:00
5d63ba6a19
NIFI-2303 This closes #749 . Update lineage styles
2016-08-01 13:30:58 -04:00
8c011d91e1
NIFI-2060 - fixed unit tests to be compatible with 2.7.x
...
This closes #547
2016-08-01 12:46:51 -04:00
372a316deb
NIFI-2401:
...
- Returning the enabled state of play and stop buttons in the palette. Allowing the user to always press if they have permissions to modify the selection.
- Only attempting to schedule components that are not running, not disabled, and valid.
This closes #745
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-01 11:39:55 -04:00
bfdf94d522
Removing extraneous authorizations.xml from nifi-resources/src/main/resources/conf, created automatically in secure mode
2016-08-01 11:07:26 -04:00
1bf10944ea
NIFI-2366 - Fixed ID generation semantics in clustered environment
...
- added SnippetUtilsTest
- renamed TypeOneUUIDGenerator to ComponentIdGenerator
- changed lsb part of ComponentIdGenerator back to long
- Fixed 'isCopy' condition for clustered environments
This closes #718 .
2016-07-31 15:24:02 -04:00
8412d2662a
NIFI-2208 - initial commit Custom Property Expression Language support with Variable Registry, includes bug fix for NIFI-2057
...
This closes #529
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-29 17:10:20 -04:00
b213ed95e0
NIFI-2422: Fix SelectHiveQL handling of Number types
...
This closes #744 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-07-29 15:38:32 -04:00
a6d259ee01
NIFI-2245:
...
- If a single response exists using it, instead of attempting to merge anything.
This closes #743 .
2016-07-29 15:29:06 -04:00
0c8fc25ba4
NIFI-2430 This closes #737 . Update some tooltip text and context menu text/icon
2016-07-29 12:54:31 -04:00
a8224edb8d
[NIFI-2428] update modal glasspane to always close, even if the dialog we closed by user in close handler
2016-07-29 12:12:00 -04:00
f5dfa580db
[NIFI-2348] When processor is selected, can now copy id from palette
2016-07-29 12:12:00 -04:00
da5e468489
[NIFI-2371] fix cluster page padding
2016-07-29 12:12:00 -04:00
a73c8bba30
NIFI-2302: - Showing a message on the history page when in a cluster to indicate that only the actions from the current node are displayed.
...
This closes #740
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-29 11:27:09 -04:00
70d70732b5
NIFI-2388: Addressed a spot that assumes that Process Group is always set on StandardControllerServiceNode
2016-07-29 11:02:52 -04:00
bc0b5fe154
NIFI-2431: Before registering for the Cluster Coordinator role, check if another node already has this role. If so, do not register for this role until after the node has joined the cluster and inherited the flow.
2016-07-29 09:42:38 -04:00
cfc8a9613c
NIFI-2395 This closes #734 . Ensure that if we fail to index provenance events we do not prevent the repo from continuing to merge journals
2016-07-29 09:33:47 -04:00
cddbe7d41f
NIFI-2388 This closes #728 . Use null for group id if no group specified instead of throwing NPE
2016-07-29 09:14:50 -04:00
3a153d3a48
NIFI-2337 This closes #731 . Turn off logging for org.apache.curator.framework.recipes.leader.LeaderSelector since it logs only a single error, and that error is a but in Curator
2016-07-28 22:29:08 -04:00
da238b16ef
NIFI-2122: - Merging responses for the current user and the flow configuration. - Returning whether NiFi is configured with a policy based authorizer in the flow configuration. - Only showing the users and policy icons when configured with a policy based authorizer. - Failing faster when invoking the users or policies endpoint when not configured with a configurable authorizer.
...
This closes #736
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-28 16:51:40 -04:00
5e4ba04589
NIFI-2390 Separating of users and groups from authorizations.xml into separate file. This closes #735
2016-07-28 16:41:52 -04:00
01adb050f9
NIFI-2421: - Only attempting to clone policies when NiFI supports a configurable authorizer.
...
This closes #738
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-28 13:01:20 -04:00
09b124714e
NIFI-2347: - Ensuring component specific policies are retained when using copy/paste. - This includes the policies for the component, data of the component, data transfers of the component, and policies of the component.
...
This closes #730
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-28 09:43:40 -04:00
25cadf5db1
[NIFI-2396] Update Bulletin Board shell header and filter control position. This closes #732
2016-07-28 09:09:25 -04:00
dedd4fcda1
NIFI-2403
...
- Ensuring uniqueness on user identities and group names
- Ensure errors when updating a group are displayed.
- This closes #724
2016-07-28 08:45:47 -04:00
ae344806c0
NIFI-2224: - Ensuring the template form is reset when the upload template dialog is closed. NIFI-2175: - Not submitting the template form is a template isn't choosen. NIFI-2176: - Ensuring a template is specified during creation. NIFI-2223: - Ensuring templates with the same name cannot be added. NIFI-2296: - Updating the tooltip for the upload template browse button.
...
- Cleaning up un-used parameters to REST endpoints.
This closes #725
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-27 17:38:12 -04:00
f3e49fefa0
[NIFI-2367] Overlapping links repositioned on error/login pages
...
[NIFI-2025] update birdseye after dragging/dropping element on the canvas
[NIFI-2367] update width of content viewer combo
[NIFI-2355] update table sorting based on auth efforts
[NIFI-2027] update EL editors
[NIFI-2387] update bulletin alert backgroud color to actually change the color of the icon not the div background
[NIFI-2141] Hide bulletin icon/background on processors unless a bulletin exists
[NIFI-2400] close any open combos contained within a shell when closing the shell
[NIFI-2404] remove extra scrollbar from #node-events
[NIFI-2027] account for min widths of EL editors
[NIFI-2025] update birdseye after changing color
[NIFI-2027] Update EL editor checkbox text
[NIFI-2027] update checkbox text
[NIFI-2355] update table sorting
[NIFI-2141] Hide bulletin icon/background on processors unless a bulletin exists
[NIFI-2027] update EL editors
[NIFI-2367] Overlapping links repositioned on error/login pages
This closes #715
2016-07-27 16:29:25 -04:00
15d1e1bbf8
NIFI-2405 corrected string equality checks
...
This closes #723 .
2016-07-26 23:04:38 +02:00
c3b4872b55
NIFI-2389 Refactoring identity mapping and applying it to FileAuthorizer for initial admin, cluster nodes, and legacy authorized users. This closes #719
2016-07-26 15:24:50 -04:00
52bc23f5db
NIFI-2316, NIFI-2318: Ensure that we do not save the flow before initializing the Run Status of components. Clarify the Node Event messages
...
This closes #678
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-26 14:24:32 -04:00
69586d8bd0
NIFI-2346:
...
- Introducing data resource for authorizing provenance events and queue listing.
- Authorizing entire proxy chain for data resource and data transfer resource.
NIFI-2338:
- Ensuring that replay authorization only happens once.
- Allowing users with access to policies for a component to be able to access all policies for that component.
-- Includes the component, data, data transfers, and policies.
- Fixing drop request completion to update the correct queued field.
- Fixing access control check for listing and emptying queues.
- Reseting selected policy when re-opening the policy management page.
- Fixing button/link visibility for available actions in policy management page.
- Fixing policy issues with policy removal when the underlying component is deleted.
- Updating file authorizer seeding to grant data access to node's in the cluster.
This closes #720 .
2016-07-26 14:15:36 -04:00
c27763a12f
NIFI-1733 Initial commit for nifi-ranger-bundle
...
- Adding Authorizer implementation for Ranger
- Adding build profile and assembly that controls the inclusion of Ranger in the final assembly
- Add properties to specify ranger admin identity and a flag to indicate if ranger is using kerberos, plugin is updated to perform a UGI login if ranger is using kerberos
- Adding LICENSE and NOTICE for Ranger NAR, and some other licensing clean up
- Adding tests for kerberos properties, adding test for RangerBasePluginWithPolicies, cleaning up code to use Java 8 features
This closes #574
2016-07-26 10:15:22 -04:00
2ec43076fa
NIFI-2344 This closes #711 . fixed StandardControllerServiceNode.getRequiredControllerServices
2016-07-26 00:48:24 -04:00
67876f707b
NIFI-2399 Correcting comparison of maxEventId against lastEventId in SiteToSiteProvenanceReportingTask
2016-07-25 23:37:08 -04:00
7779af69b4
NIFI-2292: Funnel all cluster node status changes through the cluster coordinator instead of having each node broadcast changes to the whole cluster. This gives us the ability to increment the updateId consistently without race conditions.
...
This closes #717
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-25 23:17:37 -04:00
3e9867d5da
NIFI-1950 Updating FileAuthorizer to convert access controls from input and output ports during legacy conversion. This closes #702 .
2016-07-25 12:37:26 -04:00
b082858595
Revert "NIFI-2292: Funnel all cluster node status changes through the cluster coordinator instead of having each node broadcast changes to the whole cluster. This gives us the ability to increment the updateId consistently without race conditions."
...
This reverts commit 35ff0975bf
2016-07-25 12:35:43 -04:00
35ff0975bf
NIFI-2292: Funnel all cluster node status changes through the cluster coordinator instead of having each node broadcast changes to the whole cluster. This gives us the ability to increment the updateId consistently without race conditions.
2016-07-25 12:14:13 -04:00
26ffc6d7ec
[NIFI-2050] update dialog advanced buttons
...
[NIFI-2076] fix Add inline controller service dialog description width
[NIFI-2143] update to combo width
[NIFI-2136] [NIFI-2139] [NIFI-2134] update provenance details dialog
[NIFI-2368] add transparent glasspane when in a shell
[NIFI-2134] update flow-file details padding and .unset font-weight
[NIFI-2349] [NIFI-2351] update policies shell styles
[NIFI-2350] update empty queue dialog styles
[NIFI-2367] update links on message pane
This closes #703
2016-07-25 08:24:23 -04:00
4e08ea6525
NIFI-2376 This closes #713 . Ensure that we don't decrement claimant count more than once when append() throws an Exception
2016-07-24 17:00:21 -04:00
6932a53ec9
NIFI-2360: Leave ZooKeeper running when a node is disconnected. Do not allow the last node in the cluster to be disconnected. Change ClusterProtocoLHeartbeater to use RetryNTime retry strategy instead of RetryForever because web requests could block on this
...
This closes #705
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-22 23:57:00 -04:00
393a3925dd
NIFI-2253 flexibly cleaning zookeeper connect string
...
This closes #704
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-22 18:24:52 -04:00
4179ce6644
NIFI-2090 This closes #669 . Added options for segment names, parse fields in ExtractHL7Attributes
2016-07-22 10:11:03 -04:00
4a4d60e6af
NIFI-2307: - Enforcing connection permissions based on the source and destination comonent. - Removing connection specific access policies. NIFI-2265: - Filtering out sensitive details in component status and status history when appropriate. NIFI-1800: - Adding parent process group id to the Controller Services table. NIFI-2077: - Removing some old un-used icons following the UI refresh. NIFI-2242: - Requiring write permissions for all components in a selection. NIFI-2080: - Updating style of the name in the selection context to handle scroll bars and use available width. NIFI-2331: - Addressing issue when removing a user/group which was causing the tenant policy to be removed. NIFI-2335: - Ensuring the flow is saved after starting/stopping a process group. NIFI-2235: - Ensuring we use consistent conditions between the context menu and the operate palette.
...
- Allowing users with read only access to the tenants page.
- Fixing current user integration test.
- Ensuring schedule methods are locked appropriately.
- Addressing comments from PR.
This closes #698
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-21 23:52:01 -04:00
0dbba811f3
NIFI-2298 This closes #687 added Kafka consume attributes to a FlowFile
2016-07-21 22:56:24 -04:00
4e224c283f
NIFI-1899 reworking bi-directional Email processing in ListenSMTP
...
This closes #483
2016-07-21 10:39:21 -04:00
4f672832c0
NIFI-1899 - Introduce ExtractEmailAttachments and ExtractEmailHeaders processors - Introduce ListenSMTP (allows NiFi to receive data via email) - Addresses @ijokarumawak and @@JPercivall PR comments
...
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-21 10:26:30 -04:00
Matt Burgess
Mark Payne
joewitt
Joe Gresock
Jeff Storck
Matt Gilman
Scott Aslan
Yolanda M. Davis
Andy LoPresto
jpercivall
Koji Kawamura
Bryan Rosander
Oleg Zhurakousky
Bryan Bende
Andre F de Miranda
Peter Wicks
Andrew Psaltis
Ramiz
Joe Skora
ricky
Simon Elliston Ball
Joey Frazee
Tim Reardon
Joe Skora
Kirk Tarou
Scott Aslan
Mike Moser
Pierre Villard