Commit Graph

2453 Commits

Author SHA1 Message Date
Matthew Burgess 4df3eb567d NIFI-4410: Improved error handling/logging in PutElasticsearchHttp processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2175.
2018-02-02 10:35:03 +01:00
Pierre Villard dc67bd2fdd NIFI-4747 - Removed directory existence check in GetHDFS
This closes #2391

Signed-off-by: Jeremy Dyer <jeremydyer@apache.org>
2018-01-31 12:01:17 -05:00
Mike Thomsen 6e7dfb9935 NIFI-4823 Made pretty printing configurable in GetMongo.
This closes #2441

Signed-off-by: Jeremy Dyer <jeremydyer@apache.org>
2018-01-31 11:34:31 -05:00
jlwt90 d8cfb8e6c5 NIFI-4686 MockFlowFile now includes penalized status when copying. This closes #2438.
Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-01-29 11:02:19 -05:00
dorian.bugeja 8bdc2910e1 NIFI-4786 Allow Expression Evaluation to Kinesis/Firehose Stream Name
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #2409.
2018-01-27 16:01:09 -08:00
Kevin Doran c4e2ac7cda
NIFI-4801 Fixes Swagger spec for uploadTemplate. This closes #2428 2018-01-25 10:02:56 -05:00
Marco Gaido 37271e8241 NIFI-4790 - support HTTPS Proxy in InvokeHTTP
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2426.
2018-01-24 17:51:28 +01:00
Matthew Burgess 84848f7cbb NIFI-4773: Moved DB Fetch processors' connection code from setup to onTrigger
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2422.
2018-01-23 15:10:34 +01:00
Mark Payne 6f282c6843
NIFI-4803: Ensure that we set the FileCountAttribute of BinManager to the proper value, regardless of the merge strategy
This closes #2423.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-01-22 15:37:31 -05:00
Peter G. Horvath 3ebfcd5ae5
NIFI-4424 Added functionality to allow NiFi to run in "embedded" mode for eventual integration test access.
This closes #2251.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-01-22 12:00:33 -08:00
Matt Gilman 05e9e6eaa5 NIFI-4799:
- Ensure variable registry update request is marked completed.
This closes #2421.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-01-22 12:53:23 -05:00
Kevin Doran 5d5edfa896
NIFI-4744 Detect incorrect authorizers config
Adds stricter checks in AuthorizerFactoryBean for unique ids within
a given type of provider and requires unique providers in composite
and composite-configurable user group providers. Failed validation
checks cause startup to fail. Adds test cases for these new rules.

This closes #2419.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-01-22 09:45:17 -05:00
sbouchex 94d0974003
NIFI-4795:
Fixed allowed values
This closes #2414
2018-01-19 12:58:36 -05:00
Matt Gilman e3c661daac
NIFI-4761 Fixing test case regression.
This closes #2418.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-01-19 09:47:31 -08:00
Pierre Villard a3ddb3b4fa
NIFI-1604 - PutSolrContentStream - Evaluate stream path against flow file
This closes #2092.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-01-19 11:26:05 -05:00
Andy LoPresto 8cb09c301d
NIFI-4761
Added HostHeaderHandler regression unit tests before adding new functionality.
Added logic for parsing nifi.web.proxy.host property.
Added default property in nifi.properties and pom.xml.
Added logic for IPv6 and custom default hostnames.
Improved error messaging.
Added HostHeaderHandler unit tests.
Disabled HostHeaderSanitizationCustomizer in HTTP mode.
Fixed HTML escaping in error message.
Improved error message.
Added failing unit test for parsing custom hostnames.
Fixed custom hostname parsing.
Fixed unit tests.
Added TODO for IPv6 custom hostname parsing and unit test.
Added IPv6 custom hostname parsing and unit tests.
Fixed checkstyle issues.
Removed empty element in host list when no value defined.
Improved error message formatting.
Added unit tests.
Removed HostHeaderSanitizationCustomizer.
Removed InvalidPropertiesFormatException from NiFiProperties.
Removed InvalidPropertiesFormatException from HostHeaderHandler.
This closes #2415
2018-01-19 10:53:13 -05:00
zenfenaan 94eb11bfa6 NIFI-4770 - ListAzureBlobStorage now properly writes azure.container flowfile attribute
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2402.
2018-01-18 16:16:00 +01:00
Mike Thomsen ca54186b60 NIFI-4759 - Fixed a bug that left a hard-coded reference to _id in as the update key for MongoDB upserts.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2401.
2018-01-17 21:48:31 +01:00
Joey Frazee ea2519e3ea NIFI-4748 - Add endpoint override to Kinesis processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2399.
2018-01-17 21:42:19 +01:00
sbouchex e4dda497bb
NIFI-4784: Fixed runStatus allowedValues. This closes #2407 2018-01-17 10:59:09 -05:00
Senthilannaswamy 790f14b8ef
NIFI-4781: Updated ClientAuthenticationMethod as optional field response from OpenID provider. This closes #2213 2018-01-17 10:55:11 -05:00
Mark Payne 7c1ce17223
NIFI-4756: Updated PublishKafkaRecord processors to include attributes generated from schema write strategy into the message headers when appropriate
This closes #2396.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-01-16 16:31:34 -05:00
Mark Payne 28e1bcc9d0
NIFI-4782: Allow the value of a Required Property to be moved when changing version of a flow or reverting a flow
This closes #2406.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-01-16 14:14:25 -05:00
Matthew Burgess 7e29103995 NIFI-4428: This closes #2310. Updated POM versions to current master branch
Signed-off-by: joewitt <joewitt@apache.org>
2018-01-16 13:27:29 -05:00
Matthew Burgess ecb8067883 NIFI-4428: Replaced JSON input with RecordReader
using per-record flowfiles
NIFI-4428: Added initial L&N, fixed dependency hierarchy

NIFI-4428: Exposed additional ZK properties

NIFI-4428: More work to reduce dependencies in Druid artifacts

NIFI-4428: Removed inaccessible attribute

NIFI-4428: Fixed typo in property description

NIFI-4428: Updates to Druid NAR L&N

NIFI-4428: Updated LICENSE to refer to ICU License for icu4j
2018-01-16 13:08:02 -05:00
vvaks 7fa0a34aba NIFI-4428: - Implement PutDruid Processor and Controller
update

added provenance report

added parameters for batch control

WIP
2018-01-16 13:07:56 -05:00
Mark Payne d93d538177
NIFI-4763: Ignore differences in components' Bundle Version when comparing a local flow to a flow in the registry
This closes #2393.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-01-16 12:48:17 -05:00
Koji Kawamura 83701632fb NIFI-4769: Use FlowFile for EL at Fetch and PutAzureBlobStorage
This commit add back the existing capability for those Processors to use
incoming FlowFile attributes to compute account name and account key,
which had been removed by NIFI-4004.

Also, the same capability is added for SAS token.

This closes #2400.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-01-13 09:57:25 +09:00
Matthew Burgess 83d2930095 NIFI-4768: Add exclusion filters to S2SProvenanceReportingTask
NIFI-4768: Updated exclusion logic per review comments

This closes #2397.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-01-13 09:47:21 +09:00
joewitt 41ce788812 NIFI-4751 changed to next minor release version snapshot 2018-01-12 15:15:32 -05:00
joewitt 42edfa75b7 Merge branch 'NIFI-4751-RC1' 2018-01-12 15:00:32 -05:00
Mark Payne a36afe0bbe NIFI-4767 - Fixed issues with RecordPath using the wrong field name for arrays and maps. Also addressed issue where Avro Reader was returning a Record object when it should return a Map
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2398.
2018-01-11 23:24:12 +01:00
Patrice Freydiere 5f7bd81af9 NIFI-4441: patch avro maps in union types. This closes #2207.
Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-01-11 15:04:42 -05:00
Marco Gaido 39a484b631
NIFI-4764: Add tooltips to status bar icons
add tooltip to process groups
cleanup
This closes #2394
2018-01-11 12:25:33 -05:00
Mike Moser bcac2766bc NIFI-3648 removed message copying when not in debug mode. This closes #1637.
Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-01-11 11:23:04 -05:00
Matt Gilman 674c9e4687 NIFI-4754:
- Only showing the import link in the new Process Group dialog when initiating from the toolbar.
This closes #2395.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-01-11 10:34:46 -05:00
Mark Payne 6153fb6465 NIFI-4752: Addressed issue with some event types having potentially the wrong FlowFile UUID listed (could have child UUID when it's supposed to have parent flowfile UUID). In testing fix, also found an issue with Search threads not being daemon and Re-Index threads not propertly being shutdown so addressed those as well.
This closes #2390.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-01-10 17:42:04 +09:00
joewitt 36405e888c NIFI-4751-RC1 prepare for next development iteration 2018-01-08 23:39:49 -07:00
joewitt 46d30c7e92 NIFI-4751-RC1 prepare release nifi-1.5.0-RC1 2018-01-08 23:39:32 -07:00
Pierre Villard 10e3b14433 NIFI-4515 - This closes #2224. Enabled EL on Kerberos properties for Kafka 0.10 & 0.11 & 1.0 processors
Signed-off-by: joewitt <joewitt@apache.org>
2018-01-08 22:07:14 -07:00
Mike Moser 6e7544bd37 NIFI-4697 This closes #2381. clarified some PostHTTP documentation
Signed-off-by: joewitt <joewitt@apache.org>
2018-01-08 21:47:27 -07:00
joewitt 3157b00a7a NIFI-4751 correcting extranous NOTICE entries for MIT License and fixed the cassandra nar LandN 2018-01-08 21:30:11 -07:00
Mark Payne 953e922d32 NIFI-4749: This closes #2386. Pass the record reader's schema along to the ResultSetRecordSet so that it is able to resolve the schema for Record fields
Signed-off-by: joewitt <joewitt@apache.org>
2018-01-08 19:47:18 -07:00
Andy LoPresto a7f1eb89c2
NIFI-4727 Added CountText processor and unit test.
This closes #2371.

Signed-off-by: Kevin Doran <kdoran.apache@gmail.org>
2018-01-08 14:26:14 -08:00
Bryan Bende 4196140e4c
NIFI-4750 Ensuring preDestruction is called on authorizer and appropriate policy/user-group providers. This closes #2387 2018-01-08 16:40:40 -05:00
Matt Gilman 8f635f1c0d
NIFI-4436:
- Only enforcing the unique name check when the registry has a different identifier.

This closes #2385.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-01-08 15:13:31 -05:00
Matt Gilman 33b40fb87f NIFI-4739:
- Ensuring the logout action is using a relative link.

This closes #2374
2018-01-08 15:02:12 -05:00
Kevin Doran a8817e0238
NIFI-4708 Add Registry support to encrypt-config.
Adds support for NiFI Registry config files to the encrypt-config tool
in NiFi Toolkit.
Also adds decryption capability to encrypt-config tool.

This closes #2376.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-01-08 11:17:21 -08:00
Mark Payne b6117743d4
NIFI-4436: Ensure that on save, we assign a Versioned Component Identifier to inner process groups that are tracking to remote flows, if they don't have one. This would occur, for instance, if a Process Group was imported into an existing group (or copied/moved into it) and then the existing group was saved.
NIFI-4436: Fixed a bug that caused a flow not to successfully change version if a connection is added to an existing component and that component is running at time of version change

NIFI-4436: Fixed bug with ordering of controller services being enabled and disabled

NIFI-4436: Fixed bug that prevented local input and output ports from being stopped and started as needed

NIFI-4436: Fixed bugs around referencing controller services that are at a higher level than the versioned flow

NIFI-4436: Ensure that we clear components from FlowController's cache when removed and that they are added to cache when created.

NIFI-4436: Fixed error message coming back if component is invalid when trying to be restarted/re-enabled

NIFI-4436: Addressed issue with children of a removed process group not being considered 'affected components' and as a result not being stopped/disabled/restarted/re-enabled

This closes #2219.

Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2018-01-08 13:10:13 -05:00
Matt Gilman fa996cd418
NIFI-4436:
- Minor tweak to when the max height for the options list is calculated per PR comments.
- Resolving logic issue in two phase commit when updating variable registry.
- Fixing variable visibility.
2018-01-08 12:44:57 -05:00