Apache/nifi
1
0
Fork 0
mirror of https://github.com/apache/nifi.git synced 2025-02-11 12:35:20 +00:00
Code Issues Packages Projects Releases Wiki Activity
4,691 Commits 147 Branches 203 Tags
Commit Graph

2910 Commits

Author SHA1 Message Date
patricker
19636978f9 NIFI-5355 ResizeImage Fails to read PNG type on some OS's 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2854.
 2018-07-10 09:35:30 +02:00
Andy LoPresto
f60585a9b6
NIFI-5376 Removed deprecation warnings. 
Updated Javadoc for SiteToSiteClient#createTransaction() and HttpClient implementation.
Reverted exception listing in method contract for SiteToSiteClient#createTransaction and HttpClient tion of same.
Reverted import ordering in TestSiteToSiteClient.
Reverted exception listing in TestGetHDFSFileInfo, TestListHDFS, and StandardHttpFlowFileServerProtocol.
Restored @SuppressWarnings annotation and removed unnecessary "public static" keywords from inner classes in SiteToSiteClient.

This closes #2841.

Signed-off-by: Joe Witt <joewitt@apache.org>
 2018-07-09 20:45:34 -07:00
patricker
3826536546 NIFI-1251 ExecuteSQL Max Rows and Output Batching 
NIFI-1251: Fixed doc and checkstyle issues
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2834
 2018-07-09 13:36:45 -04:00
Mike Thomsen
12e384b4be NIFI-5389 Added additional documentation for JsonQueryElasticsearch. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2864
 2018-07-09 12:24:02 -04:00
Mark Payne
1e75f8c789 NIFI-5394: Ensure that we wait for service to be fully enabled when enabling a group, before moving on to the next in the list 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2867
 2018-07-09 12:15:23 -04:00
Mike Thomsen
0ff8518068 NIFI-5390 Added more documentation for DeleteByQueryElasticsearch. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2865
 2018-07-09 11:51:15 -04:00
Mike Thomsen
a3a2cbcfc1 NIFI-5391 Removed two unused dependencies from nifi-elasticsearch-restapi-processors. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2862
 2018-07-09 11:40:29 -04:00
Jan Hentschel
46014bc962 NIFI-1305 Extended JavaDoc on DistributedMapCacheClient.getAndPutIfAbsent 
This closes #2857

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-08 07:23:19 -04:00
patricker
d50e3f1747 NIFI-5384 FlowFile's queued in batches should all have the same Queue time 
This closes #2849

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-07 07:56:53 -04:00
Mike Thomsen
40c4b2c771 Revert "NIFI-5383 Replaced hard-coded version with Maven property in nifi-redis-bundle" 
This reverts commit a8a0b0d075ccf1d6a71f88a973e6878cec4889e4.
 2018-07-06 22:05:01 -04:00
Jan Hentschel
a8a0b0d075 NIFI-5383 Replaced hard-coded version with Maven property in nifi-redis-bundle 
This closes #2848

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-06 21:12:07 -04:00
Jan Hentschel
87f3a99adf NIFI-5387 Removed redundant groupId from nifi-redis-bundle 
This closes #2852

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-06 21:08:51 -04:00
Jan Hentschel
8fd8a247d9 NIFI-5386 Removed redundant dependencies from nifi-redis-extensions 
This closes #2851

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-06 21:06:40 -04:00
Jan Hentschel
d31a919553 NIFI-4811 Updated spring-data-redis to the latest version 
This closes #2845

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-06 21:01:54 -04:00
thenatog
b77d66889a
NIFI-5374 - Added ExceptionFilter which catches RequestRejectedException thrown in the nifi-api Jersey code. These exceptions were not caught by the Jetty error-page configuration because they're thrown before the endpoint/Jetty routing is hit. 
Added integration test for checking the ExceptionFilter catches malicious string exceptions.
Made minor changes to PR 2840 for code style.

This closes #2840.

Co-authored-by: Andy LoPresto <alopresto@apache.org>

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-07-03 18:17:22 -07:00
zenfenan
3164759d7f NIFI-5334: GetMongo keeps original attributes when it has incoming connections 
This closes #2815

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-03 07:51:20 -04:00
Matthew Burgess
ee86af0c15 NIFI-5356: Added record.count and failure.count attributes to PutElasticsearchHttpRecord 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2835.
 2018-07-03 10:23:34 +02:00
Mike Thomsen
22ec069acb NIFI-5059 Updated MongoDBLookupService to be able to detect record schemas or take one provided by the user. 
NIFI-5059 Changed it to use a schema registry.

NIFI-5059 Updated MongoDBLookupService to be a SchemaRegistryService.

NIFI-5059 Added two changes from a code review.

NIFI-5059 Fixed two bad references.

NIFI-5059 Refactored schema strategy handling.

NIFI-5059 Moved schema strategy handling to JsonInferenceSchemaRegistryService.

NIFI-5059 Updated to use new LookupService method.

NIFI-5059 fixed schema inference bug.

NIFI-5059 Added test for schema text strategy

NIFI-5059 incremented version number to make the build work.

NIFI-5059 fixed a stray 1.7.0 reference.

NIFI-5059 Added getDatabase to client service.

NIFI-5059 Added changes requested in a code review.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2619
 2018-07-02 21:57:50 -04:00
Mark Payne
d4d4ddadee
NIFI-5361: When submitting many processors to start, calculate the 'timeout timestamp' immediately before calling @OnScheduled method, after the task has been scheduled to run, instead of before the task has a chance to run. 
This closes #2831
 2018-07-02 16:36:07 -04:00
Mike Thomsen
790102d8b1 Revert "NIFI-5147 Add CalculateAttributeHash processor" 
This reverts commit 7fb931889f37ecec7d14665e58c3332423916b64.
 2018-07-02 16:03:28 -04:00
Mark Payne
b549fbb67b NIFI-5362: When a processor is terminated and has no more active threads, ensure that we set this.hasActiveThreads = false 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2832.
 2018-07-02 16:20:20 +02:00
Otto Fowler
7fb931889f NIFI-5147 Add CalculateAttributeHash processor 
This closes #2802

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-02 06:20:21 -04:00
patricker
4ea6e6a40e NIFI-4535 
This closes #2826

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-01 21:25:21 -04:00
Bryan Bende
3fd45ac4c4 NIFI-5354 Changing ranger.version to 1.0.0 and ranger.hadoop.version to 3.0.0 
Signed-off-by: Yolanda Davis <ymdavis@apache.org>

This closes #2827
 2018-06-29 23:36:54 -04:00
patricker
a14dbc7dbe NIFI-5339 - Better Time Tracking for ExecuteSQL Durations 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2824.
 2018-06-29 16:47:55 +02:00
patricker
c1083dfb62 NIFI-5339 - Better Time Tracking for ExecuteSQL Durations 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2817.
 2018-06-29 14:59:27 +02:00
zenfenan
6508c191bf NIFI-5343: Fix GetMongo to properly reads charset from FlowFile attributes 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2818.
 2018-06-29 14:56:24 +02:00
Matthew Burgess
e741ba1ce4 NIFI-5349: Fixed EL handling in Initial Max Value props for DB Fetch processors 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2822.
 2018-06-29 14:51:59 +02:00
Bryan Bende
022b64be08 NIFI-5316 Fixed array handling for Avro that comes from Parquet's Avro reader 
Signed-off-by: zenfenan <zenfenan@apache.org>
 2018-06-28 22:13:23 +05:30
Matthew Burgess
921403ff55 NIFI-5336: Exclude hbase-server from Hive 3 bundle 
This closes #2811

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-06-26 05:33:07 -04:00
thenatog
a274918dc5
NIFI-5258 - Changed the way the servlets are created for the documentation webapp. 
Removed some unnecessary code.
Fixed imports.

This closes #2812.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-06-25 18:22:55 -07:00
zenfenan
9af61d3a2d NIFI-5332: Fix GetMongoIT test failures 
This closes #2808

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-06-25 20:59:48 -04:00
Andy LoPresto
ea9b0db2f6
Merge branch 'NIFI-5323-RC1' as part of Apache NiFi 1.7.0 release process. 2018-06-25 12:03:00 -07:00
Peter Toth
241bc2aa89 NIFI-5278: fixes JSON escaping of code 
Change-Id: I2cb0e6c658d4a0f2aad9c4aab9201a3334ee54df

NIFI-5278: adds Apache Commons Text to NOTICE

Change-Id: I8185239b0a888c16159b18f13d6682ba350cc766

NIFI-5278: adds tests

Change-Id: I9286ac71bc7399e5bdc1e6602609b5e8829db27e

NIFI-5278: fixes review findings

Change-Id: I292c93dae877cf1cd146f3897b7e132b6afac801
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2768
 2018-06-21 14:46:41 -04:00
Otto Fowler
a64680bfa5
NIFI-5325 A Syslog Parser that fully supports RFC 5424 Structured Data 
- address review comments
- per review, add property for including body in attributes
- per review, create processor in OnScheduled

This closes #2805.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-06-21 12:38:41 -04:00
Andy LoPresto
d42a1e8bf4
NIFI-5323-RC1 prepare for next development iteration 2018-06-19 20:02:21 -07:00
Andy LoPresto
99bcd1f88d
NIFI-5323-RC1 prepare release nifi-1.7.0-RC1 2018-06-19 20:02:01 -07:00
Bartlomiej Tartanus
235463af7b allow expression language in Schema File property 
Update ValidateXml.java

Update ValidateXml.java

NIFI-5192: Added evaluateAttributeExpressions call, error handling, and unit tests
 2018-06-19 16:12:52 -04:00
Mark Payne
2760b07770 NIFI-5322: Addressed bug that caused QueryRecord to fail (rollback session instead of routing to 'failure') whenever a record in the incoming FlowFile did not adhere to its schema. This happened because the InputStream for the FlowFile was not properly closed. Also updated the text of the Exception to include information from its 'cause' so user is better able to understand the underlying issue. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2803
 2018-06-19 16:01:33 -04:00
Matthew Burgess
aa33989192
NIFI-5266: Sanitize ES parameters in PutElasticsearchHttp processors 
Incorporated review comments
Added integration test with JSON character

This closes #2760.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-06-18 17:59:28 -07:00
Bryan Bende
0b0ba1eae3
NIFI-5319 Utilize NiFi Registry 0.2.0 client 
This closes #2801.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-06-18 15:37:05 -07:00
Mike Moser
d4d9259664 NIFI-5274 avoid rollback on uncaught errors in ReplaceText 
forgot to penalize flowfiles sent to failure

NIFI-5274 avoid rollback on StackOverflowError in ReplaceText

add comment

removed penalize on failure, doesn't really apply here

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2767
 2018-06-18 12:00:30 -04:00
Ed
568959baf5
NIFI-4906 Add GetHDFSFileInfo 
- Updated doc for write attributes
- Removing redundant files
- Updates based on review

Changes:
- changed validators for regex params (3)
- removed TriggerWhenEmpty and TriggerSerially.
- removed unused LISTING_LAG_NANOS
- removed unimplemented customValidate
- removed unsused error handling for building/updating request params
- added MIME_TYPE for content
- suppressed output to original relationship when scheduled
- added full path to original/new FF when not found
- added warning messages for huge attribute values.

This closes #2639.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-06-18 09:33:42 -04:00
Pierre Villard
e5322b5d33 NIFI-4982 - Add a DistributedMapCacheLookupService 
This closes #2558

Signed-off-by: zenfenan <zenfenan@apache.org>
 2018-06-18 18:35:12 +05:30
Dustin Rodrigues
021ee6faf2 NIFI-5317 - support non-ASCII X-Mailer PutEmail header 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2800.
 2018-06-18 10:45:56 +02:00
Matthew Burgess
97f71fd6c7 NIFI-5044: Applied changes in SelectHiveQL to SelectHive3QL 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2799.
 2018-06-15 22:42:59 +02:00
Ed B
187417d077 NIFI-5044 SelectHiveQL accept only one statement 
SelectHiveQL support only single SELECT statement.
This change adds support for pre- and post- select statements.
It will be useful for configuration queries, i.e. "set tez.queue.name=default", and others.

renamed selectQuery to hqlStatement for better readability

style check correction in comment

removed meaningless examples for post-queries

execute query without result set

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2695
 2018-06-15 15:48:16 -04:00
Dongkyu Hwangbo
9b461027a4 NIFI-5188: DruidTranquilityController does not fully support Druid aggregator 
Rollback Druid 0.9.2 to 0.9.1

Fixed checkstyle error

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2696
 2018-06-15 09:52:14 -04:00
Koji Kawamura
52d6b9cfa2
NIFI-5257: Expand Couchbase Server integration 
- Added CouchbaseMapCacheClient.
- Added CouchbaseKeyValueLookupService.
- Added CouchbaseRecordLookupService.
- Added 'Put Value to Attribute' to GetCouchbaseKey.
- Fixed Get/PutCouchbaseKey relationship descriptions.
- Stop sharing Relationship.Builders.

This closes #2750
 2018-06-15 09:14:30 -04:00
Koji Kawamura
f05c5e6ea0
NIFI-5054: Add Couchbase user authentication 2018-06-15 08:48:46 -04:00