Bartosz Wozniak
f11682202b
NIFI-1893 Add processor for validating JSON
...
This closes #1037 .
2016-09-22 13:08:34 +02:00
Byunghwa Yun
77f8503e98
NIFI-2802 The implementation classes don't support orderByClause.
...
This closes #1044 .
2016-09-22 12:21:43 +02:00
Matt Gilman
5198e70d14
NIFI-2707: - Ensuring that connections are always sorted accordingly to their zIndex. This preserves the 'bring to front' settings.
...
This closes #1023 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-21 17:20:44 -04:00
Matt Gilman
b304f70f3e
NIFI-2785: - Ensure the URL is updated when uploading a template to ensure it's going to the appropriate Process Group.
...
This closes #1029 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-21 14:40:10 -04:00
Nicolas Dupont
be83c0c5b2
NIFI-1844 - Added ListFTP and FetchFTP processors
...
This closes #881 .
2016-09-21 17:40:38 +02:00
Peter Wicks
938c7cccb8
NIFI-2749
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #997
2016-09-21 11:16:57 -04:00
Aldrin Piri
fda15d916d
Removing reference to removed lineage identifier header for ExecuteFlumeSink additional details.
...
THis closes #1039
2016-09-21 10:36:24 -04:00
Matt Gilman
e10b4beb90
NIFI-2797: - Correcting download URIs for OTPs.
...
This closes #1038 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-21 10:33:39 -04:00
Matt Gilman
684f417406
NIFI-2792 - Ensuring the flow is saved when a template is deleted.
...
This closes #1031 .
2016-09-21 16:31:40 +02:00
Pierre Villard
930e95aa00
NIFI-1170 - Improved TailFile processor to support multiple files tailing
...
This closes #980
2016-09-21 10:05:39 -04:00
Matt Burgess
68291636cb
NIFI-1841: Fixed support for CLOB/BLOB types
...
This closes #1035 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-20 15:33:06 -04:00
Toivo Adams
4fc0e9c407
nifi-2381 Connection Pooling Service -Drop invalid connections and create new ones.
...
This closes #986 .
2016-09-20 18:21:42 +02:00
Oleg Zhurakousky
b693a4a561
NIFI-2789, NIFI-2790 - polishing
...
This closes #1027
2016-09-20 09:32:43 -04:00
Joey Frazee
c238676058
NIFI-2789, NIFI-2790 - Read JMS properties and add to FlowFile attributes in ConsumeJMS
...
Remove unused assertEquals import
Move destination from default to send/receive to support EL better
2016-09-20 09:30:14 -04:00
Koji Kawamura
feaa4c9db8
NIFI-2757: Site-to-Site with DN mapping
...
Added DN identity mapping pattern support to Site-to-Site client
authorization.
This closes #1010 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-19 12:56:54 -04:00
Pierre Villard
d838f61291
NIFI-1942 Processor to validate CSV against user-supplied schema
...
This closes #476
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-09-16 11:13:07 -04:00
Andy LoPresto
022f5a506d
NIFI-2266 Refactored GetHTTP processor to use SSLContext protocol vs. hard-coded TLSv1.
...
This closes #999 .
2016-09-16 00:08:08 +02:00
Matt Gilman
abcfbeb062
NIFI-2771:
...
- Using GzipHandler instead of GzipFilter.
This closes #1020
2016-09-15 10:27:39 -04:00
Pierre Villard
c1ad913598
NIFI-1342 Added default User-Agent in PostHttp
...
This closes #1021
2016-09-15 09:57:09 -04:00
Peter Wicks
8a28395e9f
NIFI-2754
...
- Migrating swap to active prior to swapping if necessary.
- This closes #1000 .
2016-09-14 14:27:50 -04:00
Yolanda M. Davis
67a47dbead
NIFI-2251
...
- Initial commit for client side provenance lineage svg download.
- css styling adjustments, changes for svg replace
- Addressing some style/spacing.
- This closes #982 .
2016-09-14 14:23:46 -04:00
Koji Kawamura
bc005e3398
NIFI-2772: Unsecure RAW Site-to-Site fails with User DN is not known
...
This closes #1019 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-14 10:39:11 -04:00
Matt Gilman
36846e0fe7
NIFI-2719: - Caching components recently added/removed in case ajax requests are received out of order. This is not an issue for modifications of existing components as we're able to leverage the revision.
...
This closes #1011 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-14 10:33:10 -04:00
Joe Skora
c72a9aa54b
NIFI-2752 Correct ReplaceText default pattern and unit tests
...
* Corrected the DEFAULT_REGEX pattern.
* Added tests to isolate regex capture group problem and verify corrected functionality.
* Removed short circuit logic that masked configuration errors and created inconsistent processor behavior.
This closes #1007 .
2016-09-13 22:55:55 +02:00
Scott Aslan
02ca2a0d78
[NIFI-2770] fix action details dialog
...
This closes #1017 .
2016-09-13 22:17:37 +02:00
Matt Gilman
5dd743947c
NIFI-2768: - Ensuring we correctly enforce authorization when the destination of a connection changes. This includes source, destination, and parent process group. - Ensuring the UI reseting accordingly when a request fails.
...
This closes #1014 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-13 11:41:51 -04:00
Matt Burgess
6c9291ad53
NIFI-2765: Fixed Kerberos support for PutHiveStreaming
...
This closes #1012 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-13 11:13:06 -04:00
Matt Gilman
b48355e75a
NIFI-2766: - Ensuring the root group is included in /resources.
...
This closes #1013 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-13 10:59:26 -04:00
Matt Burgess
d325773760
NIFI-2262: Added Avro-normalization of table/column names in SQL processors
...
This closes #994 .
2016-09-13 15:46:33 +02:00
Bryan Bende
9ff5c0b25f
NIFI-2760 Specifying jersey-bundle 1.19 for Ranger plugin
...
This closes #1006 .
2016-09-12 14:18:11 -04:00
Kirk Tarou
e25885650a
NIFI-2440 - Add 'file.lastModifiedTime' attribute to ListSFTP processor
...
Added 'file.lastModifiedTime' attribute to ListFileTransfer, which is
the abstract class extended by ListSFTP.
String literal attribute names were replaced with static references to
attribute name constants in ListFile.
ListFileTransfer stores the 'file.lastModifiedTime' attribute in the
format specified in ListFile.FILE_MODIFY_DATE_ATTR_FORMAT
Updated WritesAttribute description for file last modify time attribute
to mirror the entry in ListFile
Signed-off-by: Joe Skora <jskora@gmail.com>
This closes #931 .
2016-09-09 22:44:23 -04:00
Scott Aslan
abaacfa5e5
[NIFI-2721] update CS GoTo. This closes #998
2016-09-09 12:31:46 -04:00
Koji Kawamura
ae251c1a6f
NIFI-2718: Show HTTP S2S Auth error on bulletin
...
This commit fixes following two issues, that happens when a Root Group Port
policy for S2S data transfer is removed at a remote NiFi, after a client NiFi has
connected to that port:
1. At client side, Remote Process Group should show that authorization
is failing on its bulletin, but the Exception is caught and
ignored. Nothing is shown on the UI with HTTP transport protocol.
RAW S2S shows error on RPG bulletin. This commit fixes HTTP S2S to
behave the same.
2. At server side, corresponding input-port or output-port should show
that it is accessed by an unauthorized client on its bulletin, but it's
not shown with HTTP transport protocol.
RAW S2S shows warning messages for this. This commit fixes HTTP S2S to
behave the same.
In order to fix the 2nd issue above, request authorization at
DataTransferResource is changed from using DataTransferAuthorizable
directly, to call RootGroupPort.checkUserAuthorization().
Because the blettin is tied to the Port instance and it's
difficult to produce blettin message from this resource.
Since RootGroupPort.checkUserAuthorization uses
DataTransferAuthorizable inside, the check logic stays the same as
before.
Adding a RootGroupPortAuthorizable to provide access to necessary components for performing the authorization.
This closes #996
2016-09-08 13:43:38 -04:00
Mark Payne
bc7c42efa5
NIFI-1966: Recreated issue that is outlined in JIRA (the reason for re-opening the ticket) that results in 'java.util.NoSuchElementException: No value present' in unit test - Resolved issue where two flows that are both empty but have different fingerprints (due to root group id being different) causes vote election to fail
...
This closes #995 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-08 10:48:24 -04:00
Oleg Zhurakousky
d36b76cc60
NIFI-2745 added _source destination name_ attribute to ConsumeJMS
...
This closes #992
2016-09-07 15:28:34 -04:00
Mark Payne
938e32ed97
NIFI-2746: Ensure that the FlowController is injected into all ResourceApplications. This closes #993
2016-09-07 14:11:46 -04:00
vijayk
80224e3e5e
NIFI-2741 Move HBase, Storm, Hive, and Kafka versions into properties.
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-07 12:06:01 -04:00
Mark Payne
8d6e12fdc4
NIFI-2739: Call KafkaConsumer.wakeup() if consumer is blocking for at least 30 seconds when OnUnscheduled is called
2016-09-07 08:56:23 -04:00
Matt Burgess
2afc739ab7
NIFI-2712: Fixed Fetch processors for multiple max-value columns. This closes #976
2016-09-06 16:52:40 -04:00
Mark Payne
a7e76cc00a
NIFI-1966: When cluster is started up, do not assume that Cluster Coordinator has the golden copy of the flow but instead wait for some period of time or until the required number of nodes have connected, and then choose which flow is correct. This closes #977
2016-09-06 16:31:37 -04:00
joewitt
7a451935a5
NIFI-2732 ensure session and consumer aligned and has registered rebalance listener. Make consumption far more memory and process efficient, fixed extraneous getbundled call
...
This closes #987 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-06 15:48:40 -04:00
Mark Payne
088125451b
NIFI-2681: Refactored IndexManager into an interface and renamed the existing implementation to CachingIndexManager. Implemented a new SimpleIndexManager that performs no caching of IndexSearchers.
...
This closes #958 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-06 12:25:28 -04:00
Mark Payne
a9d029d74e
NIFI-2717: Ensure that when performing site-to-site communications that we always commit the transaction on the remote side before committing it on the local side
...
This closes #978
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-09-06 10:57:53 +09:00
Joe Gresock
0e64c3ed30
NIFI-2631: Adding page commits and 'Use Versions' to ListS3
...
This closes #916 and closes #917 .
Signed-off-by: James Wing <jvwing@gmail.com>
2016-09-03 16:04:42 -07:00
Jeff Storck
97e2f406da
NIFI-2708 Added merging of SiteToSite details
...
NIFI-2708 Updated to include ports from clientDto for port merging.
This closes #981
2016-09-02 14:55:08 -04:00
Matt Gilman
d37480eaff
NIFI-2722:
...
- Updating the component entity as long as the proposed entity is not older than the current one since stats are bundled in the entity too.
This closes #983
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-09-02 22:25:25 +09:00
Scott Aslan
867c84f32c
[NIFI-2649] Update CS table upon creation of a CS from the RT or CS properties table
...
- Ensuring the controller services table to correctly reloaded regardless if its the processor group or controller level controller services. This closes #968
2016-09-01 09:53:12 -04:00
Matt Gilman
96a766464c
NIFI-2678: - Ensuring the most recent version of each component is save for rendering on the canvas.
...
This closes #979 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-31 15:59:52 -04:00
Matt Gilman
9e10371c8a
NIFI-2704:
...
- Re-using the DataTransferAuthorizable in the DataTransferResource.
- Removing use of the DataTransferResource when obtaining site to site details as it performs additional unnecessary checks.
- Code clean up.
- This closes #971 .
2016-08-31 15:09:17 -04:00
Yolanda M. Davis
1bb909ebca
NIFI-2703 - Added bootstrap.conf file for running integration tests. This closes #975
2016-08-31 09:28:08 -04:00
Scott Aslan
648ddb6158
[NIFI-2679] User is now able to disable/enable processors that are invalid or stopped through Operate palette. This closes #973
2016-08-31 09:11:46 -04:00
Mark Payne
1213b46632
NIFI-2628: Whenever a flow is inherited from cluster coordinator, save flow immediately to disk
...
This closes #967
2016-08-30 16:13:45 -04:00
Matt Gilman
ba19238757
NIFI-2694: - Addressing instances where phase one objects were being referenced instead of phase two objects. - Code clean up.
...
This closes #970 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-30 15:50:48 -04:00
Andy LoPresto
8556777bf6
NIFI-2618 Reverted merging PR 955 to master as 1.0.0 requires Java 8.
2016-08-30 09:27:24 -07:00
Andy LoPresto
d600b065bb
NIFI-2618 Added logic to unit test to handle default TLS version for Java <= 7.
...
This closes #955 .
2016-08-30 08:25:38 -07:00
jpercivall
1752a57197
Merge branch 'NIFI-2676-rc1' of https://git-wip-us.apache.org/repos/asf/nifi
2016-08-31 14:01:57 +10:00
Koji Kawamura
daf4855570
NIFI-2687: RPG Port ID was used instead of RPG ID
...
It caused "Error: Unable to find remote process group with id 'XXXX'" error with modifying the transmitting toggle switch of an Input or Output port.
This closes #962
2016-08-29 10:14:55 -04:00
Joseph Percivall
1fe18a1567
NIFI-2676-rc1 prepare for next development iteration
2016-08-26 11:40:58 -04:00
Joseph Percivall
74d5224783
NIFI-2676-rc1 prepare release nifi-1.0.0-RC1
2016-08-26 11:40:44 -04:00
Scott Aslan
c8ae7fcbe1
[NIFI-2480] remove explicit angular $sanitize to fix multibyte chars in breadcrumbs and flow status bar. All values are escapoed through the angular ng-bind. This closes #957
2016-08-26 11:03:10 -04:00
Koji Kawamura
2ed58912b2
NIFI-2480: Fix for multibyte chars in breadcrumbs. This closes #956
...
Removed $sanitize from breadcrumbs controller, as it escapes multibyte
chars with numerical reference. Even without $sanitize, html tags can be
escaped when Angular binds the value to text content.
2016-08-26 10:27:27 -04:00
Matt Burgess
0745990c2d
NIFI-2604: Added validators and logic for multiple URLs/files/folders for DB driver location
...
This closes #912
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-25 23:35:41 -04:00
jpercivall
6ef1cca18f
NIFI-2269 Fixing Datadog licensing
2016-08-25 22:43:00 -04:00
jpercivall
e1da9fc11f
NIFI-2667 Adding License and Notice information to Media Bundle Nar and Assembly
...
This closes #950
2016-08-25 22:42:37 -04:00
joewitt
405252244e
NIFI-2670 minor doc edit to remove kafka.key.hex reference
2016-08-25 22:17:07 -04:00
Mark Payne
58e0ce7f92
NIFI-2670: This closes #954 . Expose option for how to interpret Kafka Key - hexadeimal encoding or UTF-8 String
2016-08-25 21:39:40 -04:00
Bryan Rosander
102a9a2b74
NIFI-2674 - Always adding flow files to result set flowfiles, catching runtime exceptions while converting to avro
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #953
2016-08-25 21:16:26 -04:00
Oleg Zhurakousky
7879a99206
NIFI-2675 fixed NPE in template generation
...
This closes #951 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-25 16:44:02 -07:00
Bryan Bende
957c120343
NIFI-2664 Moving System.setProperty for krb5.conf to NiFi startup, and removing conflicting property from KerberosProvider config
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #946
2016-08-25 17:26:37 -04:00
Mark Payne
f908ae3c3b
NIFI-2669: This closes #949 . Ensure that if Exception is thrown during Transaction initialization that the underlying client is closed/cleaned up. Also ensure that we generate bulletins when logging error/warn level log messages
2016-08-25 16:39:00 -04:00
Matt Burgess
a84d3c9873
NIFI-2665: This closes #942 . Fixed intermittent validation errors in InvokeScriptedProcessor
2016-08-25 15:34:50 -04:00
joewitt
1624dd8e4d
NIFI-2666 This closes #947 . updated where it says BSD to say MIT for bcrypt
2016-08-25 14:59:46 -04:00
joewitt
218408953a
NIFI-2668 Added missing license/notice entries for ignite deps in nar
2016-08-25 14:50:38 -04:00
Matt Burgess
3224b1a5dd
NIFI-2668: This closes #945 . Replaced JSR-107 JCache API JAR w Geronimo version, updated notices
2016-08-25 14:41:08 -04:00
Matt Burgess
ad7808f63d
NIFI-2641: This closes #928 . Add max values as attributes to QueryDatabaseTable
2016-08-25 14:13:55 -04:00
Oleg Zhurakousky
04db806ace
NIFI-2614 This closes #944 . added support for max.request.size
2016-08-25 13:51:08 -04:00
Matt Gilman
a6133d4ce3
NIFI-2635:
...
- Fixing contrib check issues.
- Clean up pom.
- Addressing issue where reporting task property descriptor using wrong scope.
NIFI-2635:
- Fixing issue with revisions when creating users and user groups.
- Forwarding requests to the coordinator instead of replicating.
- Tweaking verbage in dialog for removing users and groups.
This closes #943
2016-08-25 13:08:35 -04:00
joewitt
1745c1274b
NIFI-2608 This closes #930 . restructured the ConsumeKafka processor to follow new consumer API. Made nar classloading more precise to support spawned threads NIFI-2660.
2016-08-25 10:09:50 -04:00
Bryan Bende
626e23e0ab
Adding ConsumerResource and ConsumerPool for ConsumeKafka
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-08-25 09:47:26 -04:00
Scott Aslan
56e515f7ae
[NIFI-2658] Use bulletinEntity id instead of bulleting id since the ids match but bulletinEntities do not get bulletin objects if user is not authorized. This closes #938
2016-08-25 09:27:41 -04:00
Andre F de Miranda
6fd1c17ca4
NIFI-2662 - Fix checkstyle violations introduced by NIFI-2635
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #940
2016-08-25 08:55:34 -04:00
Peter Wicks
e210172d93
PutSQLBinary
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2591
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2591
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2591 - Added Format option for binary data types. Updated unit tests.
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #883
2016-08-25 08:41:23 -04:00
Koji Kawamura
afb9a0016f
NIFI-2659: Fixed RPG Received stats. This closes #939
...
It was showing the 'Sent' stats as 'Received' stats.
2016-08-25 08:34:17 -04:00
Matt Gilman
c2bfc4ef24
NIFI-2635: - Re-using the original request during the second phase of the two phase commit. - Forwarding requests to the coordinator when received by a node.
...
This closes #933
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-24 22:42:10 -04:00
Matt Gilman
2ceb5c8097
NIFI-2647:
...
- Referencing correct components when checking if save is required.
This closes #935 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-24 15:52:20 -07:00
Andy LoPresto
6331dda8d3
NIFI-2643 Changed null check to !isBlank() for key in RunNiFi.
...
NIFI-2643 Updated comment in bootstrap.conf template.
This closes #932
2016-08-24 16:20:10 -04:00
Jeff Storck
6475924f53
NIFI-2642 Catches (and ignores) ResourceNotFoundException during the updating of a property value for a controller service when the current value points to a controller service that has been deleted, allowing the assigning of a new controller service to continue.
...
This closes #931
2016-08-24 15:55:04 -04:00
Mark Payne
c2ae7a6d7c
NIFI-2605: - Fixing a regression bug where nodes would potentially be elected leader for Cluster Coordinator role when they do not have the correct flow
...
- Ensure that we log which node is the cluster coordinator on startup instead of just indicating that there is one. If we later determine that there is none, ensure that we register for the role
This closes #900
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-24 12:30:48 -04:00
Andy LoPresto
c638191a47
NIFI-1831 Added internal logic and command-line tool to allow AES-encrypted sensitive configuration values in nifi.properties.
...
This closes #834 .
2016-08-23 20:34:31 -07:00
Matt Burgess
ee9bd94082
NIFI-2632: Added fragment attributes to SplitJson and SplitXml
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #919
2016-08-23 16:30:57 -04:00
Matt Burgess
5d1a4f343f
NIFI-2622: Added support for complex types in SelectHiveQL
...
This closes #922 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-23 15:52:16 -04:00
Andrew Psaltis
0303805c01
NIFI-2620 Adding support for Binary Row Keys for both PutHBaseCell and PutHBaseJSON. This also involved making changes to PutFlowFile and PutColumn to carry around byte[] and not all strings. This closes #914 .
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-23 13:25:55 -04:00
Oleg Zhurakousky
4a49587533
NIFI-2610 annotated unstable tests with @Ignore
...
This closes #918
2016-08-23 13:13:05 -04:00
Matt Burgess
fbec3b9c13
NIFI-2623: Fixed support for binary types in SelectHiveQL
...
This closes #920 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-23 11:43:46 -04:00
Mark Payne
8cc670c8a6
NIFI-2634: Ensure that we check whether or not the Site-to-Site protocol is set when importing template, instead of assuming that it will be
...
This closes #921
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-23 11:19:44 -04:00
Scott Aslan
3f60eac544
[NIFI-2599] Enhance Status History Dialog. This closes #894
2016-08-23 10:53:10 -04:00
jpercivall
6e82ec738c
NIFI-2269 Fixing minor issues with style check, licensing, etc.
2016-08-22 21:34:51 -04:00
Ramiz
376d3c4ef4
NIFI-2269 Added datadog support
...
This closes #655
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-22 21:34:51 -04:00
Jeff Storck
dca3764ed1
NIFI-2626 Fixes jetty server thread leak. This closes #910
2016-08-22 15:58:06 -04:00
Joe Gresock
17dec04939
NIFI-2611: Fixing bugs in UnpackContent with flow file unpackers
...
Signed-off-by: Mike Moser <mosermw@apache.org>
This closes #905
2016-08-22 14:47:24 -04:00
Matt Gilman
087622eadc
NIFI-2606:
...
- Addressing issue when fingerprinting ReportingTasks and ControllerServices properties with default values.
- Ensuring the flow is saved when templates are created and imported.
- Ensuring default values are included in templates.
- Fixing unit tests.
This closes #908 .
2016-08-22 13:35:15 -04:00
Mark Payne
1fcec3747b
NIFI-2617: Instead of retrying an infinite number of times to communicate with ZooKeeper, should try only for a short period in CuratorLeaderElectionManager. This is because web requests may be blocked waiting on a determination of which node is cluster coordinator
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #906
2016-08-22 13:24:22 -04:00
Mark Payne
5fab783b50
NIFI-2609: Ensure that we handle URIs for Remote Process Groups that do not have a path of /nifi or /nifi/
...
This closes #902 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-22 13:21:42 -04:00
Mark Payne
95b5877f5d
NIFI-2600: Ensure that we do not close Index Searchers prematurely, even if they are poisoned
...
This closes #896
2016-08-22 12:03:47 -04:00
Joe Skora
a2d3d0c289
Update to support offsets larger than 2 gigabyte.
2016-08-22 11:02:48 -04:00
Matt Burgess
b7dc21bd95
NIFI-2547: Fixed checkstyle errors and updated to reflect KerberosProperties changes
2016-08-21 10:26:40 -04:00
ricky
26d362b144
NIFI-2547: Add DeleteHDFS Processor
...
This processor adds the capability to delete files or
directories inside of HDFS.
Paths supports both static and expression language values,
as well as glob support (e.g. /data/for/2016/07/*).
This processor may be used standalone, as well as part of a
downstream connection.
Signed-off-by: Matt Burgess <mattyb149@apache.org>
Add Glob Matcher with Tests
Also set displayName on properties.
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #850
2016-08-21 10:10:21 -04:00
Joe Skora
02071103d0
* Add "Remove All Content" property, related functionality, and tests to ModifyBytes processor to allow deletion of all flow file content.
...
* Removed @Ignore annotation on class and unnecessary EOL translation of test data. Because ModifyBytes treat input as binary data, not text, line endings don't matter as long as they byte offsets are calculated correctly.
* Replace validator with .allowableValues.
This closes #890 .
2016-08-19 20:05:14 +02:00
Matt Gilman
3378426f35
NIFI-2581: Keeping context menu and tooltips open when refreshing the canvas.
...
This closes #899 .
2016-08-19 19:36:26 +02:00
Scott Aslan
a181c7b9d7
[NIFI-2601] Update bower.json to use specific versions. This closes #897
2016-08-19 10:34:48 -04:00
Jeff Storck
31ca8d02f7
NIFI-2488 Fixed BulletinDTOs not getting their node addresses set properly during bulletin merging. This closes #888
2016-08-19 08:32:00 -04:00
Matt Burgess
46b81058c7
NIFI-2602: Fixed NPE in SelectHiveQL when CSV output and null column value
...
This closes #898 .
2016-08-19 09:56:26 +02:00
Matt Gilman
6b5950647a
NIFI-2596:
...
- Adding tooltip for property descriptor on mouse enter of table cell.
This closes #893 .
2016-08-18 17:23:30 -04:00
Matt Gilman
57648308db
NIFI-2597:
...
- Updating the correct object when attempting to create a self loop.
2016-08-18 17:15:16 -04:00
Matt Gilman
87161ab96e
NIFI-2595: - Updating ReportingTasks to use ComponentLogger instead of creating Controller level bulletins.
...
- Making the bulletin responses consistent in that all bulletins will be included but in redacted form as appropriate.
- Fixing broken unit test.
This closes #892 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-18 17:06:28 -04:00
Matt Gilman
f3387426a0
NIFI-2587:
...
- Adding additional authorization for accessing component property history.
2016-08-18 17:05:32 -04:00
Matt Burgess
6874a5d82d
NIFI-2593: This closes #891 . Fixed handling of nested records/structs in ConvertAvroToORC
2016-08-18 15:15:51 -04:00
Matt Burgess
a74bc2c7c7
NIFI-2598: This closes #889 . Fixed issue with static init of properties in HiveConnectionPool
2016-08-18 13:38:22 -04:00
Bryan Bende
e0e4b3407a
NIFI-2574 This clsoes #887 . Fixing NPE when using kerberos keytab location from contexts, and cleaning up hadoop/hbase/hive kerberos variables
2016-08-18 12:19:46 -04:00
Scott Aslan
0e90a0f76a
[NIFI-2488] update UI to relect changes to ActionDTO and BulletinDTO. This closes #882
2016-08-18 09:38:16 -04:00
Jeff Storck
08735a4f57
NIFI-2488 Wrapping ActionDTO and BulletinDTO in entities to be able to provide readability permission to the client
2016-08-18 09:37:11 -04:00
Mark Payne
567535c3d0
NIFI-2382: Fixed typo in documentation
2016-08-18 09:15:55 -04:00
Mark Payne
91a59a8a5a
NIFI-2545: Ensure that when @OnUnscheduled and @OnStopped methods are called that the active thread count takes that thread into account
...
This closes #836 .
2016-08-18 08:33:45 -04:00
Peter Wicks
7bc7b7f683
NIFI-2584 Fixing date format in PutSQL
...
This closes #878 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-17 16:10:56 -04:00
Matt Gilman
3d1a24ab7d
NIFI-2578:
...
- Ensuring NiFi still attempts to issue a registration request to support 1.x -> 0.x site to site.
2016-08-17 15:35:16 -04:00
Oleg Zhurakousky
a0fab15eb7
NIFI-2519 polishing remote address formatting to avoid NPE and other potential exceptions.
...
This closes #871
2016-08-17 15:13:05 -04:00
Andre F de Miranda
e7288af859
NIFI-2519 - ListenSMTP addresses mismatch between smtp.src attribute documentation and attribute.put
2016-08-17 14:58:02 -04:00
Andy LoPresto
0ffdc2eb92
Merge branch 'master' of https://github.com/apache/nifi
...
(Apologies for merge commits, but it was not possible to rebase the 2574 commits (PR 872)).
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-17 10:58:38 -07:00
joewitt
b2e468ecf8
NIFI-2574 updated to reflect new accessor methods for nifi properties with kerberos service
...
This closes #872 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-17 10:51:55 -07:00
Peter Wicks
a0d1aae603
NIFI-2583
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2582
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2582
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #877
2016-08-17 13:20:44 -04:00
Peter Wicks
1470a52b1b
NIFI-2582 NIFI-2583
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2583 Tweaks
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #877
2016-08-17 13:19:56 -04:00
joewitt
a5261914fb
NIFI-2574 merging latest kerb changes to adjust for NiFiProperties
2016-08-17 09:06:18 -07:00
joewitt
7c99b5e638
NIFI-2574 fixed queue swap threshold setting
2016-08-17 09:05:36 -07:00
Matt Gilman
3f7216ab84
NIFI-2561: - Decoupling kerberos service and spnego principles and keytabs.
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #873
2016-08-17 08:14:05 -04:00
joewitt
d9633757a6
NIFI-2574 fix spring context definitions
2016-08-17 03:38:31 -07:00
joewitt
6bf7e7f325
NIFI-2574 merging master with cluster changes to updated NiFiProperties approach
2016-08-17 01:23:54 -07:00
joewitt
7d7401add4
NIFI-2574 Changed NiFiProperties to avoid static initializer and updated all references to it.
2016-08-17 00:10:07 -07:00
Mark Payne
e42ea9ad45
NIFI-2566: Refactored to allow just the Leader Election Manager to be responsible for determining who is the Cluster Coordinator
...
NIFI-2566: Removed storage of cluster roles from heartbeats and NodeConnectionStatus; use LeaderElectionManager to determine roles instead
NIFI-2566: Updated Heartbeats so that if a node is out-of-sync with cluster topology, cluster coordinator will provide updated information back to the nodes
NIFI-2566: Fixed issue that prevented standalone instance from starting by creating a standalone-instance version of the Leader Election Manager. Also added Controller Service enabled/disabled state to fingerprint rather than attempting to update the state when joining the cluster, as the implementation was incorrect and the correct implementation will be a rather significant effort that doesn't have to happen for 1.0.0 release
This closes #866
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-16 20:39:04 -04:00
Matt Gilman
b3f36489ad
NIFI-2534: - Refreshing using component IDs. - Code clean up.
...
This closes #874 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-16 16:05:20 -04:00
Simon Elliston Ball
b0122c6a73
NIFI-2465 - InferAvroSchema EL support based on incoming FlowFiles
...
This closes #863 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-16 12:50:53 -04:00
Scott Aslan
26f5c496d1
NIFI-2534 Fix JS error when stopping a process group
...
This closes #867 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-16 11:09:41 -04:00
Peter Wicks
b22500d0a3
NIFI-2576 Allowing PutSQL to use timestamps in epoch or string format
...
This closes #869 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-16 10:26:24 -04:00
Matt Burgess
03d3b3961d
NIFI-2577: Increased default stripe size in ConvertAvroToORC to 64MB
...
This closes #870 .
2016-08-16 11:53:05 +02:00
Mark Payne
6af768d0a1
NIFI-2551: Addressed a threading issue in the StandardResourceClaimManager and performed some refactoring so that we can ensure thread-safety across different components of the application, such as ProcessSession and WriteAheadFlowFile Repository when interacting with the StandardResourceClaimManager. Update DebugFlow to allow it to write to a FlowFile multiple times, which exposes the concurrency bug. Also avoided calling ContentRepository.remove() from ProcessSession whenever the content is no longer needed, as that can cause problems now that the Resource Claim is backing the content claim.
2016-08-15 17:02:15 -04:00
Matt Burgess
ed42f2e3e3
NIFI-2552: Updated Curator for HiveQL processors using Zookeeper quorum in URL
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #865
2016-08-15 16:53:57 -04:00
Matt Gilman
7d8dd27027
NIFI-2554: - Requiring READ permissions on the referenced controller service when creating/updating processors, controller services, and reporting tasks.
...
- Preventing client side selection of unauthorized controller services unless they were the previously configured value.
This closes #860 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-15 16:46:58 -04:00
Scott Aslan
2a92747046
[NIFI-2559] UI - Controller Service update missing icons
...
This closes #864
2016-08-15 16:27:12 -04:00
Matt Gilman
d45114e48d
NIFI-2501: - Ensuring users can access the controller service list regardless of permissions on the corresponding process group or controller. - Better handling the case where the user had write permissions but no read permissions. - Returning to the appropriate controller service listing after going to the usage page.
...
This closes #835
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-15 15:16:58 -04:00
Oleg Zhurakousky
51c566ffc8
NIFI-2546 fixed NPE in FlowSnippetDTO fixed NPE caused by non-configured ControllerService
...
This closes #859 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-15 14:55:20 -04:00
Yolanda M. Davis
fbd3201157
NIFI-2524 - Fixes to improve handling of missing journal files during rollover/merge execution.Includes:
...
This closes #840
Removed partial file check (based on missing first file)
Added condition to merge if at least one journal files available on disk. If all files are missing from disk that is considered an error.
Added retry logic to prevent endless thread execution when encountering errors (such as missing files).
2016-08-15 14:43:38 -04:00