Commit Graph

4663 Commits

Author SHA1 Message Date
thenatog fc1461298a
NIFI-5366 - Added ContentSecurityPolicyFilter which stops framing of NiFi resources. It applies the Content-Security-Policy header. This protects against clickjacking.
NIFI-5366 - Added unit test. Added single quotes around 'self' for frame-ancestors CSP header.
NIFI-5366 - Fixed dependencies.

This closes #2989.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-09-05 17:38:53 -07:00
zenfenan 4f0e2f5562 NIFI-5456: AWS clients now work with private link endpoints (VPC)
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2968.
2018-09-05 15:04:29 +02:00
Nick Lewis 3efcd45e99 NIFI-5565 Added reference to confluence documentation from the developers guide
This closes #2978

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-09-01 07:32:32 -04:00
Lars Francke 1b73578c48 NIFI-5408 Add documentation for NIFI-4279
This closes #2878

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-08-31 19:09:58 -04:00
zenfenan 05e32cff28 NIFI-5544: GetMongo refactored
NIFI-5544: PR Review changes

This closes #2958

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-08-31 15:32:44 -04:00
thenatog 97e0f6a6a7
NIFI-4558 - Set JKS as the default keystore type and truststore type.
This closes #2982.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-08-31 10:35:21 -07:00
Koji Kawamura 5a58c9a171
NIFI-5282: Add ProxyConfigurationService to GCSProcessors
This closes #2981
2018-08-31 11:07:09 -04:00
jugi92 cdae2b14b3 NIFI-5282: GCPProcessor with HTTP Proxy with Auth
added http proxy support with authentication for GCP processors
added proxy support for Google Credential Service

This closes #2943.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-08-31 20:28:00 +09:00
Andy LoPresto 8f37b5ee10
NIFI-4426 Removed exclude from nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/pom.xml. 2018-08-30 13:05:09 -07:00
thenatog c9267347ed
NIFI-4426 - Replaced Java7 jBCrypt implementation which was made for Java7 backwards compatibility. It now uses a normal maven import to provide jBCrypt.
This closes #2976.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-08-30 12:15:44 -07:00
Pierre Villard cbd942df10
NIFI-5561 - Add component name filtering to S2S Provenance Reporting Task.
Added regression test for ProvenanceEventConsumer#isFilteringEnabled().
Changed isFilteringEnabled implementation to be expandable as other attributes are added using Streams.
EL + indentation.

This closes #2973.

Co-authored-by: Andy LoPresto <alopresto@apache.org>
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-08-30 11:30:10 -07:00
Corey Fritz 89186fb96d NIFI-5388: enabled EL support for dynamic properties of Kafka 1.0 processors
This closes #2915

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-08-30 07:08:00 -04:00
Mike Thomsen c755ed9322 NIFI-5413 Added additional documentation for PutMongoRecord and fixed a typo in RunMongoAggregation's documentation.
This closes #2881

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-08-30 09:43:44 +05:30
Andrew Lim 860663ae3e
NIFI-5526 Improve PutS3Object processor documentation
This closes #2975.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-08-29 15:07:22 -07:00
Andy LoPresto e83ea1f9ae
NIFI-5558 Fixed unit test to avoid contamination from System property "nifi.properties.file.path" when creating test NiFiProperties instance.
This closes #2972.

Co-authored-by: thenatog <thenatog@gmail.com>
Signed-off-by: Marc Parisi <phrocker@apache.org>
2018-08-29 14:52:07 -07:00
Matthew Burgess 8a8a8cb072 NIFI-5553: Fixed issue with rollback on result set errors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2967.
2018-08-29 13:22:10 +02:00
Matthew Burgess 53969adcc8 NIFI-5353: Add JoltTransformRecord processor 2018-08-28 14:32:27 -04:00
Matt Gilman f04cd8681d NIFI-5479: Using the SUN provider when the keystore type is JKS.
This closes #2961.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-08-28 15:28:30 +09:00
joewitt a27ccd8a56 NIFI-5479 Upgraded Jetty. Moved where we unpack bundled deps to so we can avoid a new jetty bug with META-INF loading logic.
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-08-28 15:28:11 +09:00
Mark Bean 58cb900b90
NIFI-5543: move bendPointDrag below mousedown.selection in nf-connection.js
This closes #2957
2018-08-27 11:04:07 -04:00
Mark Payne 6ceee25859 NIFI-5551: If session.get() returns null, then return fron onTrigger instead of assuming that the FlowFile is non-null
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2964.
2018-08-27 16:52:07 +02:00
Mike Moser 8c0705cb6b NIFI-5275 PostHTTP SocketConfig setup, fixed connection pool when using HTTPS, setup idle connection checker, setup request retry handler, improved some exception handling and logging, and NIFI-1336 fix as well
This closes #2796.
Signed-off-by: Brandon Devries <devriesb@apache.org>
2018-08-24 10:07:11 -04:00
Matthew Burgess cfc858c901 NIFI-5517 - Add support for remaining Hive types to PutHive3Streaming
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2950.
2018-08-24 11:09:05 +02:00
Mark Payne aac2c6a60e
NIFI-5482: Made WriteAheadProvenanceRepository the default implementation
This closes #2960.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-08-23 16:49:55 -07:00
Andy LoPresto 744b15b4a7
NIFI-5540 Added unit test to demonstrate missing default sensitive properties key in flow election encryptor creation.
NIFI-5540 Added failing unit test and ignored regression test to demonstrate missing default sensitive properties key in flow election encryptor creation.

NIFI-5540 Added equality logic to StringEncryptor and utility equality methods to CryptoUtils.

NIFI-5540 Added default sensitive properties key population logic and log warning to StringEncryptor.

NIFI-5540 Cleaned up formatting.

NIFI-5540 Cleaned up boolean logic.

NIFI-5540 Added Javadoc to StringEncryptor.

NIFI-5540 Added unit test for StringEncryptor#equals().

NIFI-5540 Added performance benchmarking unit tests for constantTimeEquals methods for String, byte[], and char[].

NIFI-5540 Fixed checkstyle issue.

NIFI-5540 Fixed unit tests for default key population.

This closes #2959.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-08-22 13:56:16 -04:00
Mark Payne 5b57935bae NIFI-5527: Refactored unit test to make member variables for 'delay tolerances' so that they are easier to update in the future. Increased delay tolerances so that tests pass on heavily loaded system.
This closes #2955.
2018-08-22 10:51:47 -04:00
zenfenan 82c5126f3c NIFI-5494 - Added ExpressionLanguage support to 'Hive Configuration Resources'
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2946.
2018-08-22 13:04:21 +02:00
Mark Payne 7bbb5a823a NIFI-5466: Keep a running total of stats for each component. Refactored FlowFileEvent and repository in order to provide more efficient storage of objects on Java heap by allowing the same 'EMPTY' object to be reused
- Refactored VolatileComponentStatusRepository to avoid holding on to ProcessorStatus objects, etc, and only keep what they need
 - Updated VolatileComponentStatusRepository to ensure that we are efficiently storing metrics for processors, etc. that are not running

This closes #2939

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-08-21 11:44:25 -04:00
Vadim Arshavsky 410176ed22 NIFI-5525: CSVRecordReader fails with StringIndexOutOfBoundsException when field is a double quote
This closes #2953.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-08-16 14:22:27 -04:00
Mike Thomsen 9d2b698c1c NIFI-5448 Changed from 'stop' to 'penalize' in allowablevalue field to make the popup more consistent. 2018-08-15 21:35:09 -04:00
Jan Hentschel c2657ee043 NIFI-5423 Removed duplicated dependencies in sub-modules
This closes #2887

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-08-15 11:01:51 -04:00
patricker 5106dc0af9
NIFI-4535 Only update Page Title to root flow name when user has permission.
This closes #2899
2018-08-13 12:46:16 -04:00
Scott Aslan 59a79c134f
[NIFI-5499] upgrade AngularJS to v1.7.2
[NIFI-5499] update package-lock.json

This closes #2941
2018-08-13 11:40:59 -04:00
Andrew Lim 86beca0c58 NIFI-5469 Additional italics and code formatting corrections for consistency
This closes #2925

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-08-13 15:03:41 +05:30
patricker 17ea29244e NIFI-5381 SFTP Unit Tests
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2846.
2018-08-10 20:17:28 +02:00
Daniel Jimenez 3731cc8558 NIFI-5489: Add expression language support to AMQP processors HOST, VHOST and USER Fields.
This closes #2936

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-08-09 22:57:23 +05:30
Mike Thomsen 32ee552ada NIFI-5448 Added failure relationship to UpdateAttributes to handle bad expression language logic.
This closes #2914

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-08-09 22:41:50 +05:30
Jeff Storck 451084e11f NIFI-4434 Fixed recursive listing with a custom regex filter.
Filter modes are now supported to perform listings based on directory and file names, file-names only, and full path.

This closes #2937

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-08-08 22:06:50 +05:30
pepov 9a79c94f80
NIFI-5487 Move the packages to a version agnostic path and create symlinks in place, add tests to cover, add missing docs on nifi-toolkit
This closes #2940.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2018-08-08 09:57:22 -04:00
Andy LoPresto 57baae9ae2
NIFI-5476 Added logic to check CA certificate signature against additional certificates.
Moved utility code to TlsHelper.
Added unit tests.
Added command-line parsing for additional CA certificate path.
Added documentation on using the TLS Toolkit to generate and sign certificates using an externally-signed CA.
Updated toolkit external CA documentation to be inline with additional context from NIFI-5473.
Cleaned up toolkit documentation.
Improved error message by changing to absolute path.
Added Javadoc to and removed unthrown exception declarations from TlsHelper#verifyCertificateSignature().
Cleaned up unit tests with utility method.
Fixed checkstyle error.
Support conversion of a PKCS#8 formatted private key automatically to avoid forcing the user to do that. Also add some log messages for debugging when the parser fails to parse the appropriate object
Incorporated Peter's contribution for PKCS #8 to PKCS #1 conversion.
Added documentation and refactored methods.
Refactored unit test.
Added RAT exclusion for test resource.

This closes #2935.

Co-authored-by: pepov <peterwilcsinszky@gmail.com>

Signed-off-by: Matt Gilman <mcgilman@apache.org>
2018-08-07 12:07:35 -07:00
thenatog 8106af699c
NIFI-5400 - Changed the hostname verifier from the custom NiFi verifier to the Apache http-client DefaultHostnameVerifier
Removed NiFiHostnameVerifier. Removed NiFi WebUtils usage of NiFiHostnameVerifier.
Added unit tests for the DefaultHostnameVerifier to WebUtils.java
Added groovy-eclipse-compiler definition to nifi-web-utils/pom.xml to execute Groovy unit tests.

This closes #2919.

Co-authored-by: Andy LoPresto <alopresto@apache.org>
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-08-06 19:57:49 -07:00
Lars Francke a19134f325 NIFI-5350 Add a way to provide arbitrary Java options in shell scripts
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #2823
2018-08-06 21:02:29 +00:00
Matthew Burgess 9ee2316ff6 NIFI-5491: Fixed PutHive3Streaming handling of Byte, Short, and Struct
This closes #2938.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-08-06 14:33:49 -04:00
Mark Payne d1ab17580f NIFI-5465: Set the Idle Timeout on jetty connectors to the same as the Request Timeout. 2018-08-06 10:33:24 -04:00
Matthew Burgess 3d546b8d87
NIFI-5484: Fixed PutHive3Streaming to use the Hive Metastore URI property (to include multiple URIs)
NIFI-5484: Incorporated review comments, added unit test for new validator

This closes #2934
2018-08-03 10:36:56 -04:00
Andy LoPresto 5e6c43f83e
NIFI-5473 Added section on using external signed CA for TLS Toolkit.
Increased TOC level to 3 for ASCIIDOC generated documentation.

This closes #2927.

Signed-off-by: Andrew Lim <andrewlim.apache@gmail.com>
2018-08-02 20:55:39 -07:00
pepov b7fe04257d
NIFI-5468 Add toolkit to NiFi docker image and use zip archive
NIFI-5468 add keypasswd with the default of keystorepasswd for bc compatibility
NIFI-5468 Use ARG instead of ENV for PATH variables as those need to be controlled in the build
NIFI-5468 Use BASE_URL for the default case when MIRROR_BASE_URL is not defined (and replace ARCHIVE_BASE_URL)

This closes #2921

Signed-off-by: Andrew I. Christianson <andy@andyic.org>
2018-08-02 09:44:14 -04:00
Mark Payne 4cca9bef7c NIFI-5480: Use FlowController's maps of components in order to look up component by ID rather than iterating recursively through all Process Groups to find the component
This closes #2932

Signed-off-by: Jeremy Dyer <jeremydyer@apache.org>
2018-08-01 19:33:56 -04:00
Matthew Burgess b4894c5572
NIFI-5475: Upgraded Hive 3 bundle to Apache Hive 3.1.0 2018-08-01 13:42:31 -04:00
Andy LoPresto e62aa0252d
NIFI-5442 Get X-ProxyContextPath value from request attributes rather than directly from headers.
NIFI-5442 Populate request contextPath attribute during AccessResource before displaying on message-page.jsp.
Refactored shared code from CatchAllFilter to WebUtils.
NIFI-5442 Refactored filter and context path code to shared parent filter and subclass.
NIFI-5442 Removed unnecessary initParams from nifi-web-ui web.xml.
NIFI-5442 Added explicit dispatchers to nifi-web-ui web.xml and removed unnecessary code from AccessResource.

This closes #2908
2018-08-01 12:10:14 -04:00