Apache/nifi
1
0
Fork 0
mirror of https://github.com/apache/nifi.git synced 2025-02-08 02:58:43 +00:00
Code Issues Packages Projects Releases Wiki Activity
4,897 Commits 147 Branches 203 Tags
Commit Graph

3088 Commits

Author SHA1 Message Date
Mark Payne
87cf474e54
NIFI-5581: Disable connection pooling for OkHttpReplicationClient. We should revisit this in the future, but for now, it appears that Jetty is having problems with the connections if they are reused. By disabling the Connection Pooling, we address the concern, but for secure connections this means that every request results in a TLS handshake - and for a mutable request, both the verification and the 'performance' stages require the TLS handshake. But it's better than timing out, which is the currently observed behavior 
This closes #2996
 2018-09-10 09:43:53 -04:00
Mike Thomsen
57820d0d88 NIFI-5495 Made date format configurable. 
This closes #2969

Signed-off-by: zenfenan <zenfenan@apache.org>
 2018-09-09 12:33:34 +05:30
thenatog
fc1461298a
NIFI-5366 - Added ContentSecurityPolicyFilter which stops framing of NiFi resources. It applies the Content-Security-Policy header. This protects against clickjacking. 
NIFI-5366 - Added unit test. Added single quotes around 'self' for frame-ancestors CSP header.
NIFI-5366 - Fixed dependencies.

This closes #2989.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-09-05 17:38:53 -07:00
zenfenan
4f0e2f5562 NIFI-5456: AWS clients now work with private link endpoints (VPC) 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2968.
 2018-09-05 15:04:29 +02:00
Lars Francke
1b73578c48 NIFI-5408 Add documentation for NIFI-4279 
This closes #2878

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-08-31 19:09:58 -04:00
zenfenan
05e32cff28 NIFI-5544: GetMongo refactored 
NIFI-5544: PR Review changes

This closes #2958

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-08-31 15:32:44 -04:00
thenatog
97e0f6a6a7
NIFI-4558 - Set JKS as the default keystore type and truststore type. 
This closes #2982.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-08-31 10:35:21 -07:00
Koji Kawamura
5a58c9a171
NIFI-5282: Add ProxyConfigurationService to GCSProcessors 
This closes #2981
 2018-08-31 11:07:09 -04:00
jugi92
cdae2b14b3 NIFI-5282: GCPProcessor with HTTP Proxy with Auth 
added http proxy support with authentication for GCP processors
added proxy support for Google Credential Service

This closes #2943.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-08-31 20:28:00 +09:00
Andy LoPresto
8f37b5ee10
NIFI-4426 Removed exclude from nifi-nar-bundles/nifi-standard-bundle/nifi-standard-processors/pom.xml. 2018-08-30 13:05:09 -07:00
Pierre Villard
cbd942df10
NIFI-5561 - Add component name filtering to S2S Provenance Reporting Task. 
Added regression test for ProvenanceEventConsumer#isFilteringEnabled().
Changed isFilteringEnabled implementation to be expandable as other attributes are added using Streams.
EL + indentation.

This closes #2973.

Co-authored-by: Andy LoPresto <alopresto@apache.org>
Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-08-30 11:30:10 -07:00
Corey Fritz
89186fb96d NIFI-5388: enabled EL support for dynamic properties of Kafka 1.0 processors 
This closes #2915

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-08-30 07:08:00 -04:00
Mike Thomsen
c755ed9322 NIFI-5413 Added additional documentation for PutMongoRecord and fixed a typo in RunMongoAggregation's documentation. 
This closes #2881

Signed-off-by: zenfenan <zenfenan@apache.org>
 2018-08-30 09:43:44 +05:30
Andrew Lim
860663ae3e
NIFI-5526 Improve PutS3Object processor documentation 
This closes #2975.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-08-29 15:07:22 -07:00
Andy LoPresto
e83ea1f9ae
NIFI-5558 Fixed unit test to avoid contamination from System property "nifi.properties.file.path" when creating test NiFiProperties instance. 
This closes #2972.

Co-authored-by: thenatog <thenatog@gmail.com>
Signed-off-by: Marc Parisi <phrocker@apache.org>
 2018-08-29 14:52:07 -07:00
Matthew Burgess
8a8a8cb072 NIFI-5553: Fixed issue with rollback on result set errors 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2967.
 2018-08-29 13:22:10 +02:00
Matthew Burgess
53969adcc8 NIFI-5353: Add JoltTransformRecord processor 2018-08-28 14:32:27 -04:00
Matt Gilman
f04cd8681d NIFI-5479: Using the SUN provider when the keystore type is JKS. 
This closes #2961.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-08-28 15:28:30 +09:00
joewitt
a27ccd8a56 NIFI-5479 Upgraded Jetty. Moved where we unpack bundled deps to so we can avoid a new jetty bug with META-INF loading logic. 
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-08-28 15:28:11 +09:00
Mark Bean
58cb900b90
NIFI-5543: move bendPointDrag below mousedown.selection in nf-connection.js 
This closes #2957
 2018-08-27 11:04:07 -04:00
Mark Payne
6ceee25859 NIFI-5551: If session.get() returns null, then return fron onTrigger instead of assuming that the FlowFile is non-null 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2964.
 2018-08-27 16:52:07 +02:00
Mike Moser
8c0705cb6b NIFI-5275 PostHTTP SocketConfig setup, fixed connection pool when using HTTPS, setup idle connection checker, setup request retry handler, improved some exception handling and logging, and NIFI-1336 fix as well 
This closes #2796.
Signed-off-by: Brandon Devries <devriesb@apache.org>
 2018-08-24 10:07:11 -04:00
Matthew Burgess
cfc858c901 NIFI-5517 - Add support for remaining Hive types to PutHive3Streaming 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2950.
 2018-08-24 11:09:05 +02:00
Mark Payne
aac2c6a60e
NIFI-5482: Made WriteAheadProvenanceRepository the default implementation 
This closes #2960.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-08-23 16:49:55 -07:00
Andy LoPresto
744b15b4a7
NIFI-5540 Added unit test to demonstrate missing default sensitive properties key in flow election encryptor creation. 
NIFI-5540 Added failing unit test and ignored regression test to demonstrate missing default sensitive properties key in flow election encryptor creation.

NIFI-5540 Added equality logic to StringEncryptor and utility equality methods to CryptoUtils.

NIFI-5540 Added default sensitive properties key population logic and log warning to StringEncryptor.

NIFI-5540 Cleaned up formatting.

NIFI-5540 Cleaned up boolean logic.

NIFI-5540 Added Javadoc to StringEncryptor.

NIFI-5540 Added unit test for StringEncryptor#equals().

NIFI-5540 Added performance benchmarking unit tests for constantTimeEquals methods for String, byte[], and char[].

NIFI-5540 Fixed checkstyle issue.

NIFI-5540 Fixed unit tests for default key population.

This closes #2959.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-08-22 13:56:16 -04:00
Mark Payne
5b57935bae NIFI-5527: Refactored unit test to make member variables for 'delay tolerances' so that they are easier to update in the future. Increased delay tolerances so that tests pass on heavily loaded system. 
This closes #2955.
 2018-08-22 10:51:47 -04:00
zenfenan
82c5126f3c NIFI-5494 - Added ExpressionLanguage support to 'Hive Configuration Resources' 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2946.
 2018-08-22 13:04:21 +02:00
Mark Payne
7bbb5a823a NIFI-5466: Keep a running total of stats for each component. Refactored FlowFileEvent and repository in order to provide more efficient storage of objects on Java heap by allowing the same 'EMPTY' object to be reused 
- Refactored VolatileComponentStatusRepository to avoid holding on to ProcessorStatus objects, etc, and only keep what they need
 - Updated VolatileComponentStatusRepository to ensure that we are efficiently storing metrics for processors, etc. that are not running

This closes #2939

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-08-21 11:44:25 -04:00
Vadim Arshavsky
410176ed22 NIFI-5525: CSVRecordReader fails with StringIndexOutOfBoundsException when field is a double quote 
This closes #2953.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-08-16 14:22:27 -04:00
Mike Thomsen
9d2b698c1c NIFI-5448 Changed from 'stop' to 'penalize' in allowablevalue field to make the popup more consistent. 2018-08-15 21:35:09 -04:00
Jan Hentschel
c2657ee043 NIFI-5423 Removed duplicated dependencies in sub-modules 
This closes #2887

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-08-15 11:01:51 -04:00
Mike Moser
66eeb48802 NIFI-3672 Add support for strongly typed message properties in PublishJMS 2018-08-14 16:37:35 +00:00
patricker
5106dc0af9
NIFI-4535 Only update Page Title to root flow name when user has permission. 
This closes #2899
 2018-08-13 12:46:16 -04:00
Scott Aslan
59a79c134f
[NIFI-5499] upgrade AngularJS to v1.7.2 
[NIFI-5499] update package-lock.json

This closes #2941
 2018-08-13 11:40:59 -04:00
patricker
17ea29244e NIFI-5381 SFTP Unit Tests 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2846.
 2018-08-10 20:17:28 +02:00
Daniel Jimenez
3731cc8558 NIFI-5489: Add expression language support to AMQP processors HOST, VHOST and USER Fields. 
This closes #2936

Signed-off-by: zenfenan <zenfenan@apache.org>
 2018-08-09 22:57:23 +05:30
Mike Thomsen
32ee552ada NIFI-5448 Added failure relationship to UpdateAttributes to handle bad expression language logic. 
This closes #2914

Signed-off-by: zenfenan <zenfenan@apache.org>
 2018-08-09 22:41:50 +05:30
Jeff Storck
451084e11f NIFI-4434 Fixed recursive listing with a custom regex filter. 
Filter modes are now supported to perform listings based on directory and file names, file-names only, and full path.

This closes #2937

Signed-off-by: zenfenan <zenfenan@apache.org>
 2018-08-08 22:06:50 +05:30
Lars Francke
a19134f325 NIFI-5350 Add a way to provide arbitrary Java options in shell scripts 
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #2823
 2018-08-06 21:02:29 +00:00
Matthew Burgess
9ee2316ff6 NIFI-5491: Fixed PutHive3Streaming handling of Byte, Short, and Struct 
This closes #2938.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-08-06 14:33:49 -04:00
Mark Payne
d1ab17580f NIFI-5465: Set the Idle Timeout on jetty connectors to the same as the Request Timeout. 2018-08-06 10:33:24 -04:00
Matthew Burgess
3d546b8d87
NIFI-5484: Fixed PutHive3Streaming to use the Hive Metastore URI property (to include multiple URIs) 
NIFI-5484: Incorporated review comments, added unit test for new validator

This closes #2934
 2018-08-03 10:36:56 -04:00
Mark Payne
4cca9bef7c NIFI-5480: Use FlowController's maps of components in order to look up component by ID rather than iterating recursively through all Process Groups to find the component 
This closes #2932

Signed-off-by: Jeremy Dyer <jeremydyer@apache.org>
 2018-08-01 19:33:56 -04:00
Mike Moser
8309747889 NIFI-3531 Moved session.recover in JMSConsumer to exceptional situations 2018-08-01 20:11:40 +00:00
Matthew Burgess
b4894c5572
NIFI-5475: Upgraded Hive 3 bundle to Apache Hive 3.1.0 2018-08-01 13:42:31 -04:00
Andy LoPresto
e62aa0252d
NIFI-5442 Get X-ProxyContextPath value from request attributes rather than directly from headers. 
NIFI-5442 Populate request contextPath attribute during AccessResource before displaying on message-page.jsp.
Refactored shared code from CatchAllFilter to WebUtils.
NIFI-5442 Refactored filter and context path code to shared parent filter and subclass.
NIFI-5442 Removed unnecessary initParams from nifi-web-ui web.xml.
NIFI-5442 Added explicit dispatchers to nifi-web-ui web.xml and removed unnecessary code from AccessResource.

This closes #2908
 2018-08-01 12:10:14 -04:00
Matthew Burgess
9742dd2fac NIFI-5471: Push table aliasing to DatabaseAdapter impls 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2926.
 2018-07-31 10:14:27 +02:00
uday
e97ae921f7 NIFI-5342 CaptureChangeMySQL didn't escape database name 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2923
 2018-07-30 19:04:19 -04:00
zenfenan
44face10bf NIFI-5450: Added ENDPOINT_OVERRIDE to AWS SQS processors 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2924.
 2018-07-30 23:28:46 +02:00
Matthew Burgess
473221368c NIFI-5420: Allow StandardProcessSession to calculate duration for provenance events 
This closes #2886.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-07-27 09:13:50 -04:00