Commit Graph

4700 Commits

Author SHA1 Message Date
Andrew Lim 860663ae3e
NIFI-5526 Improve PutS3Object processor documentation
This closes #2975.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-08-29 15:07:22 -07:00
Andy LoPresto e83ea1f9ae
NIFI-5558 Fixed unit test to avoid contamination from System property "nifi.properties.file.path" when creating test NiFiProperties instance.
This closes #2972.

Co-authored-by: thenatog <thenatog@gmail.com>
Signed-off-by: Marc Parisi <phrocker@apache.org>
2018-08-29 14:52:07 -07:00
Matthew Burgess 8a8a8cb072 NIFI-5553: Fixed issue with rollback on result set errors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2967.
2018-08-29 13:22:10 +02:00
Matthew Burgess 53969adcc8 NIFI-5353: Add JoltTransformRecord processor 2018-08-28 14:32:27 -04:00
Matt Gilman f04cd8681d NIFI-5479: Using the SUN provider when the keystore type is JKS.
This closes #2961.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-08-28 15:28:30 +09:00
joewitt a27ccd8a56 NIFI-5479 Upgraded Jetty. Moved where we unpack bundled deps to so we can avoid a new jetty bug with META-INF loading logic.
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-08-28 15:28:11 +09:00
Mark Bean 58cb900b90
NIFI-5543: move bendPointDrag below mousedown.selection in nf-connection.js
This closes #2957
2018-08-27 11:04:07 -04:00
Mark Payne 6ceee25859 NIFI-5551: If session.get() returns null, then return fron onTrigger instead of assuming that the FlowFile is non-null
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2964.
2018-08-27 16:52:07 +02:00
Mike Moser 8c0705cb6b NIFI-5275 PostHTTP SocketConfig setup, fixed connection pool when using HTTPS, setup idle connection checker, setup request retry handler, improved some exception handling and logging, and NIFI-1336 fix as well
This closes #2796.
Signed-off-by: Brandon Devries <devriesb@apache.org>
2018-08-24 10:07:11 -04:00
Matthew Burgess cfc858c901 NIFI-5517 - Add support for remaining Hive types to PutHive3Streaming
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2950.
2018-08-24 11:09:05 +02:00
Mark Payne aac2c6a60e
NIFI-5482: Made WriteAheadProvenanceRepository the default implementation
This closes #2960.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-08-23 16:49:55 -07:00
Andy LoPresto 744b15b4a7
NIFI-5540 Added unit test to demonstrate missing default sensitive properties key in flow election encryptor creation.
NIFI-5540 Added failing unit test and ignored regression test to demonstrate missing default sensitive properties key in flow election encryptor creation.

NIFI-5540 Added equality logic to StringEncryptor and utility equality methods to CryptoUtils.

NIFI-5540 Added default sensitive properties key population logic and log warning to StringEncryptor.

NIFI-5540 Cleaned up formatting.

NIFI-5540 Cleaned up boolean logic.

NIFI-5540 Added Javadoc to StringEncryptor.

NIFI-5540 Added unit test for StringEncryptor#equals().

NIFI-5540 Added performance benchmarking unit tests for constantTimeEquals methods for String, byte[], and char[].

NIFI-5540 Fixed checkstyle issue.

NIFI-5540 Fixed unit tests for default key population.

This closes #2959.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-08-22 13:56:16 -04:00
Mark Payne 5b57935bae NIFI-5527: Refactored unit test to make member variables for 'delay tolerances' so that they are easier to update in the future. Increased delay tolerances so that tests pass on heavily loaded system.
This closes #2955.
2018-08-22 10:51:47 -04:00
zenfenan 82c5126f3c NIFI-5494 - Added ExpressionLanguage support to 'Hive Configuration Resources'
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2946.
2018-08-22 13:04:21 +02:00
Mark Payne 7bbb5a823a NIFI-5466: Keep a running total of stats for each component. Refactored FlowFileEvent and repository in order to provide more efficient storage of objects on Java heap by allowing the same 'EMPTY' object to be reused
- Refactored VolatileComponentStatusRepository to avoid holding on to ProcessorStatus objects, etc, and only keep what they need
 - Updated VolatileComponentStatusRepository to ensure that we are efficiently storing metrics for processors, etc. that are not running

This closes #2939

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-08-21 11:44:25 -04:00
Vadim Arshavsky 410176ed22 NIFI-5525: CSVRecordReader fails with StringIndexOutOfBoundsException when field is a double quote
This closes #2953.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-08-16 14:22:27 -04:00
Mike Thomsen 9d2b698c1c NIFI-5448 Changed from 'stop' to 'penalize' in allowablevalue field to make the popup more consistent. 2018-08-15 21:35:09 -04:00
Jan Hentschel c2657ee043 NIFI-5423 Removed duplicated dependencies in sub-modules
This closes #2887

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-08-15 11:01:51 -04:00
patricker 5106dc0af9
NIFI-4535 Only update Page Title to root flow name when user has permission.
This closes #2899
2018-08-13 12:46:16 -04:00
Scott Aslan 59a79c134f
[NIFI-5499] upgrade AngularJS to v1.7.2
[NIFI-5499] update package-lock.json

This closes #2941
2018-08-13 11:40:59 -04:00
Andrew Lim 86beca0c58 NIFI-5469 Additional italics and code formatting corrections for consistency
This closes #2925

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-08-13 15:03:41 +05:30
patricker 17ea29244e NIFI-5381 SFTP Unit Tests
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2846.
2018-08-10 20:17:28 +02:00
Daniel Jimenez 3731cc8558 NIFI-5489: Add expression language support to AMQP processors HOST, VHOST and USER Fields.
This closes #2936

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-08-09 22:57:23 +05:30
Mike Thomsen 32ee552ada NIFI-5448 Added failure relationship to UpdateAttributes to handle bad expression language logic.
This closes #2914

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-08-09 22:41:50 +05:30
Jeff Storck 451084e11f NIFI-4434 Fixed recursive listing with a custom regex filter.
Filter modes are now supported to perform listings based on directory and file names, file-names only, and full path.

This closes #2937

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-08-08 22:06:50 +05:30
pepov 9a79c94f80
NIFI-5487 Move the packages to a version agnostic path and create symlinks in place, add tests to cover, add missing docs on nifi-toolkit
This closes #2940.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2018-08-08 09:57:22 -04:00
Andy LoPresto 57baae9ae2
NIFI-5476 Added logic to check CA certificate signature against additional certificates.
Moved utility code to TlsHelper.
Added unit tests.
Added command-line parsing for additional CA certificate path.
Added documentation on using the TLS Toolkit to generate and sign certificates using an externally-signed CA.
Updated toolkit external CA documentation to be inline with additional context from NIFI-5473.
Cleaned up toolkit documentation.
Improved error message by changing to absolute path.
Added Javadoc to and removed unthrown exception declarations from TlsHelper#verifyCertificateSignature().
Cleaned up unit tests with utility method.
Fixed checkstyle error.
Support conversion of a PKCS#8 formatted private key automatically to avoid forcing the user to do that. Also add some log messages for debugging when the parser fails to parse the appropriate object
Incorporated Peter's contribution for PKCS #8 to PKCS #1 conversion.
Added documentation and refactored methods.
Refactored unit test.
Added RAT exclusion for test resource.

This closes #2935.

Co-authored-by: pepov <peterwilcsinszky@gmail.com>

Signed-off-by: Matt Gilman <mcgilman@apache.org>
2018-08-07 12:07:35 -07:00
thenatog 8106af699c
NIFI-5400 - Changed the hostname verifier from the custom NiFi verifier to the Apache http-client DefaultHostnameVerifier
Removed NiFiHostnameVerifier. Removed NiFi WebUtils usage of NiFiHostnameVerifier.
Added unit tests for the DefaultHostnameVerifier to WebUtils.java
Added groovy-eclipse-compiler definition to nifi-web-utils/pom.xml to execute Groovy unit tests.

This closes #2919.

Co-authored-by: Andy LoPresto <alopresto@apache.org>
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-08-06 19:57:49 -07:00
Lars Francke a19134f325 NIFI-5350 Add a way to provide arbitrary Java options in shell scripts
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #2823
2018-08-06 21:02:29 +00:00
Matthew Burgess 9ee2316ff6 NIFI-5491: Fixed PutHive3Streaming handling of Byte, Short, and Struct
This closes #2938.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-08-06 14:33:49 -04:00
Mark Payne d1ab17580f NIFI-5465: Set the Idle Timeout on jetty connectors to the same as the Request Timeout. 2018-08-06 10:33:24 -04:00
Matthew Burgess 3d546b8d87
NIFI-5484: Fixed PutHive3Streaming to use the Hive Metastore URI property (to include multiple URIs)
NIFI-5484: Incorporated review comments, added unit test for new validator

This closes #2934
2018-08-03 10:36:56 -04:00
Andy LoPresto 5e6c43f83e
NIFI-5473 Added section on using external signed CA for TLS Toolkit.
Increased TOC level to 3 for ASCIIDOC generated documentation.

This closes #2927.

Signed-off-by: Andrew Lim <andrewlim.apache@gmail.com>
2018-08-02 20:55:39 -07:00
pepov b7fe04257d
NIFI-5468 Add toolkit to NiFi docker image and use zip archive
NIFI-5468 add keypasswd with the default of keystorepasswd for bc compatibility
NIFI-5468 Use ARG instead of ENV for PATH variables as those need to be controlled in the build
NIFI-5468 Use BASE_URL for the default case when MIRROR_BASE_URL is not defined (and replace ARCHIVE_BASE_URL)

This closes #2921

Signed-off-by: Andrew I. Christianson <andy@andyic.org>
2018-08-02 09:44:14 -04:00
Mark Payne 4cca9bef7c NIFI-5480: Use FlowController's maps of components in order to look up component by ID rather than iterating recursively through all Process Groups to find the component
This closes #2932

Signed-off-by: Jeremy Dyer <jeremydyer@apache.org>
2018-08-01 19:33:56 -04:00
Matthew Burgess b4894c5572
NIFI-5475: Upgraded Hive 3 bundle to Apache Hive 3.1.0 2018-08-01 13:42:31 -04:00
Andy LoPresto e62aa0252d
NIFI-5442 Get X-ProxyContextPath value from request attributes rather than directly from headers.
NIFI-5442 Populate request contextPath attribute during AccessResource before displaying on message-page.jsp.
Refactored shared code from CatchAllFilter to WebUtils.
NIFI-5442 Refactored filter and context path code to shared parent filter and subclass.
NIFI-5442 Removed unnecessary initParams from nifi-web-ui web.xml.
NIFI-5442 Added explicit dispatchers to nifi-web-ui web.xml and removed unnecessary code from AccessResource.

This closes #2908
2018-08-01 12:10:14 -04:00
Matthew Burgess 9742dd2fac NIFI-5471: Push table aliasing to DatabaseAdapter impls
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2926.
2018-07-31 10:14:27 +02:00
uday e97ae921f7 NIFI-5342 CaptureChangeMySQL didn't escape database name
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2923
2018-07-30 19:04:19 -04:00
zenfenan 44face10bf NIFI-5450: Added ENDPOINT_OVERRIDE to AWS SQS processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2924.
2018-07-30 23:28:46 +02:00
pepov 56dfcc2cd6
NIFI-5438 create all volume directories for chowning properly, then create proper volumes for persistence. Notes: create conf instead of conf/templates since it will be created automatically. Create database_repository instead of data, since that is the default configuration. Create state volume used to store local state by default.
This closes #2905.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2018-07-27 14:38:18 -04:00
Matthew Burgess 473221368c NIFI-5420: Allow StandardProcessSession to calculate duration for provenance events
This closes #2886.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-07-27 09:13:50 -04:00
Mike Thomsen b1f78d58a6 NIFI-5440 Added db and collection attributes to GetMongo output.
This closes #2906

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-07-26 23:34:12 +05:30
Jan Hentschel 610cbb66b2 NIFI-5418 Removed duplicated jackson-databind dependency from nifi-framework-cluster
This closes #2885

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-07-26 23:20:13 +05:30
Corey Fritz 4baf35db5b NIFI-5083: enabled EL support for processor configuration of Kafka consumer `group.id` property
Signed-off-by: zenfenan <zenfenan@apache.org>
2018-07-26 22:04:49 +05:30
Matthew Burgess 692943f016 NIFI-5454: Added EL support and copy.index attribute to DuplicateFlowFile
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2917.
2018-07-26 14:13:14 +02:00
Andy LoPresto 0ad30e188f NIFI-5451 Added test resources for 128 bit encryption.
Fixed unit test to perform properly without JCE unlimited strength policy installed.

This closes #2916.

Signed-off-by: Mike Moser <mosermw@apache.org>
2018-07-25 15:21:13 +00:00
郑书国10209198 9a23d5bc60
NIFI-5447 Modify the description of 'nifi.security.needClientAuth',add default value describe
Added space and formatting to default value for needClientAuth in Admin Guide.

This closes #2912.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-07-23 18:14:51 -07:00
Mike Thomsen 78d908bc0e NIFI-5412 Added additional documentation for PutMongo.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2895
2018-07-23 09:11:59 -04:00
Mike Thomsen c3cad2b38b NIFI-5410 Added additional documentation for GetMongo.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2880
2018-07-23 08:55:36 -04:00