Commit Graph

4679 Commits

Author SHA1 Message Date
Koji Kawamura e94f0757db
NIFI-4654: Support reporting RAS S2S lineage to Atlas
- Added 's2s.port.id' FlowFile attribute to track target remote Port id
- Use 's2s.port.id' to analyze RAW S2S provenance events
- This closes #2863
2018-07-10 11:44:00 -04:00
Mark Bean b279624398 NIFI-5368 controller services validated prior to enabling; referenced controller services must be enabled for referencing component to be valid (mock framework)
This closes #2873.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-07-10 11:23:40 -04:00
joewitt 23c3bb886c This closes #2838. Forcing this PR closed with empty commit. 2018-07-10 10:56:15 -04:00
Mark Payne 35bfc93901
NIFI-5377: Addressed issue of infinite recursion when enabling/disabling controller services if there is a recursive loop (i.e., Service A references Service B references Service A). This closes #2847
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2018-07-10 09:57:13 -04:00
Mark Bean 0d07bc4951
NIFI-5377 prevent infinite loop if a controller service circular reference exists 2018-07-10 09:57:13 -04:00
Andy LoPresto 3ef8b4ab8d NIFI-5370 removed custom hostname verifier implementation from OkHttpReplicationClient (default handles wildcard certs).
This closes #2869.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-07-10 08:45:33 -04:00
Andy LoPresto 275789f8ca NIFI-5401 Improved logging for node identity loading.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2871.
2018-07-10 09:51:52 +02:00
patricker 19636978f9 NIFI-5355 ResizeImage Fails to read PNG type on some OS's
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2854.
2018-07-10 09:35:30 +02:00
Andy LoPresto f60585a9b6
NIFI-5376 Removed deprecation warnings.
Updated Javadoc for SiteToSiteClient#createTransaction() and HttpClient implementation.
Reverted exception listing in method contract for SiteToSiteClient#createTransaction and HttpClient tion of same.
Reverted import ordering in TestSiteToSiteClient.
Reverted exception listing in TestGetHDFSFileInfo, TestListHDFS, and StandardHttpFlowFileServerProtocol.
Restored @SuppressWarnings annotation and removed unnecessary "public static" keywords from inner classes in SiteToSiteClient.

This closes #2841.

Signed-off-by: Joe Witt <joewitt@apache.org>
2018-07-09 20:45:34 -07:00
patricker 3826536546 NIFI-1251 ExecuteSQL Max Rows and Output Batching
NIFI-1251: Fixed doc and checkstyle issues
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2834
2018-07-09 13:36:45 -04:00
Mike Thomsen 12e384b4be NIFI-5389 Added additional documentation for JsonQueryElasticsearch.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2864
2018-07-09 12:24:02 -04:00
Mark Payne 1e75f8c789 NIFI-5394: Ensure that we wait for service to be fully enabled when enabling a group, before moving on to the next in the list
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2867
2018-07-09 12:15:23 -04:00
Mike Thomsen 0ff8518068 NIFI-5390 Added more documentation for DeleteByQueryElasticsearch.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2865
2018-07-09 11:51:15 -04:00
Mike Thomsen a3a2cbcfc1 NIFI-5391 Removed two unused dependencies from nifi-elasticsearch-restapi-processors.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2862
2018-07-09 11:40:29 -04:00
Jan Hentschel 46014bc962 NIFI-1305 Extended JavaDoc on DistributedMapCacheClient.getAndPutIfAbsent
This closes #2857

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-08 07:23:19 -04:00
patricker d50e3f1747 NIFI-5384 FlowFile's queued in batches should all have the same Queue time
This closes #2849

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-07 07:56:53 -04:00
patricker 0c5e159ebc NIFI-5385 assertAttributeNotExists Is hard to understand
This closes #2850

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-07 07:26:21 -04:00
Mike Thomsen 40c4b2c771 Revert "NIFI-5383 Replaced hard-coded version with Maven property in nifi-redis-bundle"
This reverts commit a8a0b0d075.
2018-07-06 22:05:01 -04:00
Jan Hentschel a8a0b0d075 NIFI-5383 Replaced hard-coded version with Maven property in nifi-redis-bundle
This closes #2848

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-06 21:12:07 -04:00
Jan Hentschel 87f3a99adf NIFI-5387 Removed redundant groupId from nifi-redis-bundle
This closes #2852

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-06 21:08:51 -04:00
Jan Hentschel 8fd8a247d9 NIFI-5386 Removed redundant dependencies from nifi-redis-extensions
This closes #2851

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-06 21:06:40 -04:00
Jan Hentschel d31a919553 NIFI-4811 Updated spring-data-redis to the latest version
This closes #2845

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-06 21:01:54 -04:00
Aldrin Piri 3764b77b7c NIFI-5372 Making adjustments to the docker-compose file to allow utilization of docker-compose up --scale. Providing a README as to how to use the docker-compose.yml
NIFI-5372 Fixed a typo.

This closes #2839

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-04 19:04:24 -04:00
thenatog b77d66889a
NIFI-5374 - Added ExceptionFilter which catches RequestRejectedException thrown in the nifi-api Jersey code. These exceptions were not caught by the Jetty error-page configuration because they're thrown before the endpoint/Jetty routing is hit.
Added integration test for checking the ExceptionFilter catches malicious string exceptions.
Made minor changes to PR 2840 for code style.

This closes #2840.

Co-authored-by: Andy LoPresto <alopresto@apache.org>

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-07-03 18:17:22 -07:00
David Savage f8b1ae6d3f
fix copy paste bug in documentation for ldap auth
This closes #2837.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2018-07-03 15:26:01 -04:00
Mike Thomsen d3222b85ab
NIFI-5195 Added clustering to the docker image and added a docker-compose file that builds a basic 3 node cluster.
This closes #2828.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2018-07-03 11:40:31 -04:00
zenfenan 3164759d7f NIFI-5334: GetMongo keeps original attributes when it has incoming connections
This closes #2815

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-03 07:51:20 -04:00
Mike Thomsen df49312804 NIFI-5359 Exposed variable registry to docker image.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2829.
2018-07-03 11:42:35 +02:00
Matthew Burgess ee86af0c15 NIFI-5356: Added record.count and failure.count attributes to PutElasticsearchHttpRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2835.
2018-07-03 10:23:34 +02:00
Mike Thomsen 22ec069acb NIFI-5059 Updated MongoDBLookupService to be able to detect record schemas or take one provided by the user.
NIFI-5059 Changed it to use a schema registry.

NIFI-5059 Updated MongoDBLookupService to be a SchemaRegistryService.

NIFI-5059 Added two changes from a code review.

NIFI-5059 Fixed two bad references.

NIFI-5059 Refactored schema strategy handling.

NIFI-5059 Moved schema strategy handling to JsonInferenceSchemaRegistryService.

NIFI-5059 Updated to use new LookupService method.

NIFI-5059 fixed schema inference bug.

NIFI-5059 Added test for schema text strategy

NIFI-5059 incremented version number to make the build work.

NIFI-5059 fixed a stray 1.7.0 reference.

NIFI-5059 Added getDatabase to client service.

NIFI-5059 Added changes requested in a code review.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2619
2018-07-02 21:57:50 -04:00
Mark Payne d4d4ddadee
NIFI-5361: When submitting many processors to start, calculate the 'timeout timestamp' immediately before calling @OnScheduled method, after the task has been scheduled to run, instead of before the task has a chance to run.
This closes #2831
2018-07-02 16:36:07 -04:00
Mike Thomsen 790102d8b1 Revert "NIFI-5147 Add CalculateAttributeHash processor"
This reverts commit 7fb931889f.
2018-07-02 16:03:28 -04:00
Mark Payne b549fbb67b NIFI-5362: When a processor is terminated and has no more active threads, ensure that we set this.hasActiveThreads = false
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2832.
2018-07-02 16:20:20 +02:00
Otto Fowler 7fb931889f NIFI-5147 Add CalculateAttributeHash processor
This closes #2802

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-02 06:20:21 -04:00
patricker 4ea6e6a40e NIFI-4535
This closes #2826

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-01 21:25:21 -04:00
Bryan Bende 3fd45ac4c4 NIFI-5354 Changing ranger.version to 1.0.0 and ranger.hadoop.version to 3.0.0
Signed-off-by: Yolanda Davis <ymdavis@apache.org>

This closes #2827
2018-06-29 23:36:54 -04:00
patricker a14dbc7dbe NIFI-5339 - Better Time Tracking for ExecuteSQL Durations
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2824.
2018-06-29 16:47:55 +02:00
patricker c1083dfb62 NIFI-5339 - Better Time Tracking for ExecuteSQL Durations
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2817.
2018-06-29 14:59:27 +02:00
zenfenan 6508c191bf NIFI-5343: Fix GetMongo to properly reads charset from FlowFile attributes
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2818.
2018-06-29 14:56:24 +02:00
Matthew Burgess e741ba1ce4 NIFI-5349: Fixed EL handling in Initial Max Value props for DB Fetch processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2822.
2018-06-29 14:51:59 +02:00
patricker 3be08b7e49 NIFI-5344 Fix Write Ahead Log Unit Test on Windows
This closes #2819

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-06-28 22:39:45 +05:30
Bryan Bende 022b64be08 NIFI-5316 Fixed array handling for Avro that comes from Parquet's Avro reader
Signed-off-by: zenfenan <zenfenan@apache.org>
2018-06-28 22:13:23 +05:30
Matthew Burgess 921403ff55 NIFI-5336: Exclude hbase-server from Hive 3 bundle
This closes #2811

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-06-26 05:33:07 -04:00
thenatog a274918dc5
NIFI-5258 - Changed the way the servlets are created for the documentation webapp.
Removed some unnecessary code.
Fixed imports.

This closes #2812.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-06-25 18:22:55 -07:00
zenfenan 9af61d3a2d NIFI-5332: Fix GetMongoIT test failures
This closes #2808

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-06-25 20:59:48 -04:00
Andrew Lim 0721d9a0ee NIFI-5330 Fixed broken image in Variables in Versioned Flows section of User Guide
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2810
2018-06-25 15:18:17 -04:00
Andy LoPresto ffcff8bfb5
NIFI-5323 Updated Docker info for next release. 2018-06-25 12:06:57 -07:00
Andy LoPresto ea9b0db2f6
Merge branch 'NIFI-5323-RC1' as part of Apache NiFi 1.7.0 release process. 2018-06-25 12:03:00 -07:00
Peter Toth 241bc2aa89 NIFI-5278: fixes JSON escaping of code
Change-Id: I2cb0e6c658d4a0f2aad9c4aab9201a3334ee54df

NIFI-5278: adds Apache Commons Text to NOTICE

Change-Id: I8185239b0a888c16159b18f13d6682ba350cc766

NIFI-5278: adds tests

Change-Id: I9286ac71bc7399e5bdc1e6602609b5e8829db27e

NIFI-5278: fixes review findings

Change-Id: I292c93dae877cf1cd146f3897b7e132b6afac801
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2768
2018-06-21 14:46:41 -04:00
Otto Fowler a64680bfa5
NIFI-5325 A Syslog Parser that fully supports RFC 5424 Structured Data
- address review comments
- per review, add property for including body in attributes
- per review, create processor in OnScheduled

This closes #2805.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-06-21 12:38:41 -04:00