Commit Graph

2906 Commits

Author SHA1 Message Date
Jan Hentschel c2657ee043 NIFI-5423 Removed duplicated dependencies in sub-modules
This closes #2887

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-08-15 11:01:51 -04:00
patricker 5106dc0af9
NIFI-4535 Only update Page Title to root flow name when user has permission.
This closes #2899
2018-08-13 12:46:16 -04:00
Scott Aslan 59a79c134f
[NIFI-5499] upgrade AngularJS to v1.7.2
[NIFI-5499] update package-lock.json

This closes #2941
2018-08-13 11:40:59 -04:00
patricker 17ea29244e NIFI-5381 SFTP Unit Tests
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2846.
2018-08-10 20:17:28 +02:00
Daniel Jimenez 3731cc8558 NIFI-5489: Add expression language support to AMQP processors HOST, VHOST and USER Fields.
This closes #2936

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-08-09 22:57:23 +05:30
Mike Thomsen 32ee552ada NIFI-5448 Added failure relationship to UpdateAttributes to handle bad expression language logic.
This closes #2914

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-08-09 22:41:50 +05:30
Jeff Storck 451084e11f NIFI-4434 Fixed recursive listing with a custom regex filter.
Filter modes are now supported to perform listings based on directory and file names, file-names only, and full path.

This closes #2937

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-08-08 22:06:50 +05:30
Lars Francke a19134f325 NIFI-5350 Add a way to provide arbitrary Java options in shell scripts
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #2823
2018-08-06 21:02:29 +00:00
Matthew Burgess 9ee2316ff6 NIFI-5491: Fixed PutHive3Streaming handling of Byte, Short, and Struct
This closes #2938.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-08-06 14:33:49 -04:00
Mark Payne d1ab17580f NIFI-5465: Set the Idle Timeout on jetty connectors to the same as the Request Timeout. 2018-08-06 10:33:24 -04:00
Matthew Burgess 3d546b8d87
NIFI-5484: Fixed PutHive3Streaming to use the Hive Metastore URI property (to include multiple URIs)
NIFI-5484: Incorporated review comments, added unit test for new validator

This closes #2934
2018-08-03 10:36:56 -04:00
Mark Payne 4cca9bef7c NIFI-5480: Use FlowController's maps of components in order to look up component by ID rather than iterating recursively through all Process Groups to find the component
This closes #2932

Signed-off-by: Jeremy Dyer <jeremydyer@apache.org>
2018-08-01 19:33:56 -04:00
Matthew Burgess b4894c5572
NIFI-5475: Upgraded Hive 3 bundle to Apache Hive 3.1.0 2018-08-01 13:42:31 -04:00
Andy LoPresto e62aa0252d
NIFI-5442 Get X-ProxyContextPath value from request attributes rather than directly from headers.
NIFI-5442 Populate request contextPath attribute during AccessResource before displaying on message-page.jsp.
Refactored shared code from CatchAllFilter to WebUtils.
NIFI-5442 Refactored filter and context path code to shared parent filter and subclass.
NIFI-5442 Removed unnecessary initParams from nifi-web-ui web.xml.
NIFI-5442 Added explicit dispatchers to nifi-web-ui web.xml and removed unnecessary code from AccessResource.

This closes #2908
2018-08-01 12:10:14 -04:00
Matthew Burgess 9742dd2fac NIFI-5471: Push table aliasing to DatabaseAdapter impls
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2926.
2018-07-31 10:14:27 +02:00
uday e97ae921f7 NIFI-5342 CaptureChangeMySQL didn't escape database name
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2923
2018-07-30 19:04:19 -04:00
zenfenan 44face10bf NIFI-5450: Added ENDPOINT_OVERRIDE to AWS SQS processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2924.
2018-07-30 23:28:46 +02:00
Matthew Burgess 473221368c NIFI-5420: Allow StandardProcessSession to calculate duration for provenance events
This closes #2886.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-07-27 09:13:50 -04:00
Mike Thomsen b1f78d58a6 NIFI-5440 Added db and collection attributes to GetMongo output.
This closes #2906

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-07-26 23:34:12 +05:30
Jan Hentschel 610cbb66b2 NIFI-5418 Removed duplicated jackson-databind dependency from nifi-framework-cluster
This closes #2885

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-07-26 23:20:13 +05:30
Corey Fritz 4baf35db5b NIFI-5083: enabled EL support for processor configuration of Kafka consumer `group.id` property
Signed-off-by: zenfenan <zenfenan@apache.org>
2018-07-26 22:04:49 +05:30
Matthew Burgess 692943f016 NIFI-5454: Added EL support and copy.index attribute to DuplicateFlowFile
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2917.
2018-07-26 14:13:14 +02:00
Andy LoPresto 0ad30e188f NIFI-5451 Added test resources for 128 bit encryption.
Fixed unit test to perform properly without JCE unlimited strength policy installed.

This closes #2916.

Signed-off-by: Mike Moser <mosermw@apache.org>
2018-07-25 15:21:13 +00:00
Mike Thomsen 78d908bc0e NIFI-5412 Added additional documentation for PutMongo.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2895
2018-07-23 09:11:59 -04:00
Mike Thomsen c3cad2b38b NIFI-5410 Added additional documentation for GetMongo.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2880
2018-07-23 08:55:36 -04:00
Mike Thomsen d139b28564 NIFI-5409 Added additional documentation for DeleteMongo.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2879
2018-07-23 08:52:57 -04:00
Jeff Storck 46ce7aaa32
NIFI-5341 Enabled groovy tests in nifi-runtime
Fixed tests in NiFiGroovyTest in the nifi-runtime module
Updated NiFi.createBootstrapClassLoader to log a warning if lib/bootstrap does not exist rather than throwing a FileNotFoundException, since it already catches MalformedUrlException if there's an issue adding one of the bootstrap JARs to the bootstrap classpath
Explicitly handling InvocationTargetException in NiFi.initializeProperties to unwrap the cause and rewrap as an IllegalArgumentException to propogate the real cause of the underlying exception thrown by NiFiPropertiesLoader

This closes #2821.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-07-18 11:35:55 -07:00
Joe Gresock 66783c18b2 NIFI-5427: Updating ScrollElasticsearchHttp to use POST, supporting ES6
This closes #2890

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-18 13:50:53 -04:00
Mike Moser 4e09a03f86 NIFI-5196 Fixed JMS connection leak when uncaught exceptions happen
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2904.
2018-07-18 11:27:51 +02:00
Mike Thomsen 461eca0d14 NIFI-5305 If EL evaluation creates an empty string for the database or collection names, it raises a ProcessException which triggers failure behavior.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2891.
2018-07-18 11:07:31 +02:00
Pierre Villard d126743d93 NIFI-5437 - Yield in ExecuteScript when catching ScriptException
This closes #2903

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-17 19:58:33 -04:00
Koji Kawamura 8b9d446118 NIFI-54096: Consolidating new model into existing List processors.
Adding followings:

- Use separate DistributedMapCache for tracking entities to avoid
conflict with existing code
- Added more validation
- Delete listed entities from cache if reset is needed
- Support Local scope
- Added Initial Listing Target

This closes #2876.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-07-17 13:59:57 -04:00
Otto Fowler 0a493bf7fd
NIFI-5432 Add Syslog Record Reader legacy Syslog
- Add additional details for schema

This closes #2900.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-07-17 13:40:47 -04:00
Otto Fowler b10220439c
NIFI-5337 Syslog 5424 Record Reader and nifi-syslog-utils
- Create nifi-syslog-utils to move syslog parsing functionalty to a central location shared by the processors and serialization/record system.
- Refactor Processors to use these utils
- Update 5424 syslog classes using simple-syslog-5424 to pick up new changes to support this work, as well as keep dependencies/types from bleeding out to the
processors or readers
- Refactor Syslog5424Event and Parser
- Create Syslog5424RecordReader
- per review, handle blank message differently from eof
- name schema per review

This closes #2816.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-07-16 11:50:55 -04:00
Damian Czaja ec7f131602
NIFI-4889: Logout not working properly with OIDC
- Redirect user agent to end session endpoint on the OIDC provider
- This closes #2830
2018-07-16 10:14:31 -04:00
Marco Gaido 31bb89514c NIFI-5426: Use NIO.2 API for ListFile 2018-07-13 13:54:27 -04:00
Andy LoPresto ffbff42421 NIFI-5415 Renamed ListenSyslogGroovyTest to ITListenSyslogGroovy.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2883
2018-07-13 09:57:50 -04:00
patricker 0dd4a91a67 NIFI-5312 QueryDatabaseTable updates state when an SQLException is thrown
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2868
2018-07-10 19:03:14 -04:00
patricker e13602f752 NIFI-4279 PutDatabaseRecord and ConvertJSONToSQL stream has already been closed error on Oracle
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2874
2018-07-10 15:30:07 -04:00
patricker 624bbab8f0 NIFI-5382 ConvertRecord Add Option To Drop 0 Record Files
NIFI-5382 ConvertRecord Add Option To Drop 0 Record Files

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2853
2018-07-10 12:56:53 -04:00
Koji Kawamura e94f0757db
NIFI-4654: Support reporting RAS S2S lineage to Atlas
- Added 's2s.port.id' FlowFile attribute to track target remote Port id
- Use 's2s.port.id' to analyze RAW S2S provenance events
- This closes #2863
2018-07-10 11:44:00 -04:00
Mark Bean b279624398 NIFI-5368 controller services validated prior to enabling; referenced controller services must be enabled for referencing component to be valid (mock framework)
This closes #2873.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-07-10 11:23:40 -04:00
Mark Payne 35bfc93901
NIFI-5377: Addressed issue of infinite recursion when enabling/disabling controller services if there is a recursive loop (i.e., Service A references Service B references Service A). This closes #2847
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2018-07-10 09:57:13 -04:00
Mark Bean 0d07bc4951
NIFI-5377 prevent infinite loop if a controller service circular reference exists 2018-07-10 09:57:13 -04:00
Andy LoPresto 3ef8b4ab8d NIFI-5370 removed custom hostname verifier implementation from OkHttpReplicationClient (default handles wildcard certs).
This closes #2869.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-07-10 08:45:33 -04:00
Andy LoPresto 275789f8ca NIFI-5401 Improved logging for node identity loading.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2871.
2018-07-10 09:51:52 +02:00
patricker 19636978f9 NIFI-5355 ResizeImage Fails to read PNG type on some OS's
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2854.
2018-07-10 09:35:30 +02:00
Andy LoPresto f60585a9b6
NIFI-5376 Removed deprecation warnings.
Updated Javadoc for SiteToSiteClient#createTransaction() and HttpClient implementation.
Reverted exception listing in method contract for SiteToSiteClient#createTransaction and HttpClient tion of same.
Reverted import ordering in TestSiteToSiteClient.
Reverted exception listing in TestGetHDFSFileInfo, TestListHDFS, and StandardHttpFlowFileServerProtocol.
Restored @SuppressWarnings annotation and removed unnecessary "public static" keywords from inner classes in SiteToSiteClient.

This closes #2841.

Signed-off-by: Joe Witt <joewitt@apache.org>
2018-07-09 20:45:34 -07:00
patricker 3826536546 NIFI-1251 ExecuteSQL Max Rows and Output Batching
NIFI-1251: Fixed doc and checkstyle issues
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2834
2018-07-09 13:36:45 -04:00
Mike Thomsen 12e384b4be NIFI-5389 Added additional documentation for JsonQueryElasticsearch.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2864
2018-07-09 12:24:02 -04:00
Mark Payne 1e75f8c789 NIFI-5394: Ensure that we wait for service to be fully enabled when enabling a group, before moving on to the next in the list
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2867
2018-07-09 12:15:23 -04:00
Mike Thomsen 0ff8518068 NIFI-5390 Added more documentation for DeleteByQueryElasticsearch.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2865
2018-07-09 11:51:15 -04:00
Mike Thomsen a3a2cbcfc1 NIFI-5391 Removed two unused dependencies from nifi-elasticsearch-restapi-processors.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2862
2018-07-09 11:40:29 -04:00
Jan Hentschel 46014bc962 NIFI-1305 Extended JavaDoc on DistributedMapCacheClient.getAndPutIfAbsent
This closes #2857

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-08 07:23:19 -04:00
patricker d50e3f1747 NIFI-5384 FlowFile's queued in batches should all have the same Queue time
This closes #2849

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-07 07:56:53 -04:00
Mike Thomsen 40c4b2c771 Revert "NIFI-5383 Replaced hard-coded version with Maven property in nifi-redis-bundle"
This reverts commit a8a0b0d075.
2018-07-06 22:05:01 -04:00
Jan Hentschel a8a0b0d075 NIFI-5383 Replaced hard-coded version with Maven property in nifi-redis-bundle
This closes #2848

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-06 21:12:07 -04:00
Jan Hentschel 87f3a99adf NIFI-5387 Removed redundant groupId from nifi-redis-bundle
This closes #2852

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-06 21:08:51 -04:00
Jan Hentschel 8fd8a247d9 NIFI-5386 Removed redundant dependencies from nifi-redis-extensions
This closes #2851

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-06 21:06:40 -04:00
Jan Hentschel d31a919553 NIFI-4811 Updated spring-data-redis to the latest version
This closes #2845

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-06 21:01:54 -04:00
thenatog b77d66889a
NIFI-5374 - Added ExceptionFilter which catches RequestRejectedException thrown in the nifi-api Jersey code. These exceptions were not caught by the Jetty error-page configuration because they're thrown before the endpoint/Jetty routing is hit.
Added integration test for checking the ExceptionFilter catches malicious string exceptions.
Made minor changes to PR 2840 for code style.

This closes #2840.

Co-authored-by: Andy LoPresto <alopresto@apache.org>

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-07-03 18:17:22 -07:00
zenfenan 3164759d7f NIFI-5334: GetMongo keeps original attributes when it has incoming connections
This closes #2815

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-03 07:51:20 -04:00
Matthew Burgess ee86af0c15 NIFI-5356: Added record.count and failure.count attributes to PutElasticsearchHttpRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2835.
2018-07-03 10:23:34 +02:00
Mike Thomsen 22ec069acb NIFI-5059 Updated MongoDBLookupService to be able to detect record schemas or take one provided by the user.
NIFI-5059 Changed it to use a schema registry.

NIFI-5059 Updated MongoDBLookupService to be a SchemaRegistryService.

NIFI-5059 Added two changes from a code review.

NIFI-5059 Fixed two bad references.

NIFI-5059 Refactored schema strategy handling.

NIFI-5059 Moved schema strategy handling to JsonInferenceSchemaRegistryService.

NIFI-5059 Updated to use new LookupService method.

NIFI-5059 fixed schema inference bug.

NIFI-5059 Added test for schema text strategy

NIFI-5059 incremented version number to make the build work.

NIFI-5059 fixed a stray 1.7.0 reference.

NIFI-5059 Added getDatabase to client service.

NIFI-5059 Added changes requested in a code review.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2619
2018-07-02 21:57:50 -04:00
Mark Payne d4d4ddadee
NIFI-5361: When submitting many processors to start, calculate the 'timeout timestamp' immediately before calling @OnScheduled method, after the task has been scheduled to run, instead of before the task has a chance to run.
This closes #2831
2018-07-02 16:36:07 -04:00
Mike Thomsen 790102d8b1 Revert "NIFI-5147 Add CalculateAttributeHash processor"
This reverts commit 7fb931889f.
2018-07-02 16:03:28 -04:00
Mark Payne b549fbb67b NIFI-5362: When a processor is terminated and has no more active threads, ensure that we set this.hasActiveThreads = false
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2832.
2018-07-02 16:20:20 +02:00
Otto Fowler 7fb931889f NIFI-5147 Add CalculateAttributeHash processor
This closes #2802

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-02 06:20:21 -04:00
patricker 4ea6e6a40e NIFI-4535
This closes #2826

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-01 21:25:21 -04:00
Bryan Bende 3fd45ac4c4 NIFI-5354 Changing ranger.version to 1.0.0 and ranger.hadoop.version to 3.0.0
Signed-off-by: Yolanda Davis <ymdavis@apache.org>

This closes #2827
2018-06-29 23:36:54 -04:00
patricker a14dbc7dbe NIFI-5339 - Better Time Tracking for ExecuteSQL Durations
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2824.
2018-06-29 16:47:55 +02:00
patricker c1083dfb62 NIFI-5339 - Better Time Tracking for ExecuteSQL Durations
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2817.
2018-06-29 14:59:27 +02:00
zenfenan 6508c191bf NIFI-5343: Fix GetMongo to properly reads charset from FlowFile attributes
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2818.
2018-06-29 14:56:24 +02:00
Matthew Burgess e741ba1ce4 NIFI-5349: Fixed EL handling in Initial Max Value props for DB Fetch processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2822.
2018-06-29 14:51:59 +02:00
Bryan Bende 022b64be08 NIFI-5316 Fixed array handling for Avro that comes from Parquet's Avro reader
Signed-off-by: zenfenan <zenfenan@apache.org>
2018-06-28 22:13:23 +05:30
Matthew Burgess 921403ff55 NIFI-5336: Exclude hbase-server from Hive 3 bundle
This closes #2811

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-06-26 05:33:07 -04:00
thenatog a274918dc5
NIFI-5258 - Changed the way the servlets are created for the documentation webapp.
Removed some unnecessary code.
Fixed imports.

This closes #2812.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-06-25 18:22:55 -07:00
zenfenan 9af61d3a2d NIFI-5332: Fix GetMongoIT test failures
This closes #2808

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-06-25 20:59:48 -04:00
Andy LoPresto ea9b0db2f6
Merge branch 'NIFI-5323-RC1' as part of Apache NiFi 1.7.0 release process. 2018-06-25 12:03:00 -07:00
Peter Toth 241bc2aa89 NIFI-5278: fixes JSON escaping of code
Change-Id: I2cb0e6c658d4a0f2aad9c4aab9201a3334ee54df

NIFI-5278: adds Apache Commons Text to NOTICE

Change-Id: I8185239b0a888c16159b18f13d6682ba350cc766

NIFI-5278: adds tests

Change-Id: I9286ac71bc7399e5bdc1e6602609b5e8829db27e

NIFI-5278: fixes review findings

Change-Id: I292c93dae877cf1cd146f3897b7e132b6afac801
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2768
2018-06-21 14:46:41 -04:00
Otto Fowler a64680bfa5
NIFI-5325 A Syslog Parser that fully supports RFC 5424 Structured Data
- address review comments
- per review, add property for including body in attributes
- per review, create processor in OnScheduled

This closes #2805.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-06-21 12:38:41 -04:00
Andy LoPresto d42a1e8bf4
NIFI-5323-RC1 prepare for next development iteration 2018-06-19 20:02:21 -07:00
Andy LoPresto 99bcd1f88d
NIFI-5323-RC1 prepare release nifi-1.7.0-RC1 2018-06-19 20:02:01 -07:00
Bartlomiej Tartanus 235463af7b allow expression language in Schema File property
Update ValidateXml.java

Update ValidateXml.java

NIFI-5192: Added evaluateAttributeExpressions call, error handling, and unit tests
2018-06-19 16:12:52 -04:00
Mark Payne 2760b07770 NIFI-5322: Addressed bug that caused QueryRecord to fail (rollback session instead of routing to 'failure') whenever a record in the incoming FlowFile did not adhere to its schema. This happened because the InputStream for the FlowFile was not properly closed. Also updated the text of the Exception to include information from its 'cause' so user is better able to understand the underlying issue.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2803
2018-06-19 16:01:33 -04:00
Matthew Burgess aa33989192
NIFI-5266: Sanitize ES parameters in PutElasticsearchHttp processors
Incorporated review comments
Added integration test with JSON character

This closes #2760.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-06-18 17:59:28 -07:00
Bryan Bende 0b0ba1eae3
NIFI-5319 Utilize NiFi Registry 0.2.0 client
This closes #2801.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-06-18 15:37:05 -07:00
Mike Moser d4d9259664 NIFI-5274 avoid rollback on uncaught errors in ReplaceText
forgot to penalize flowfiles sent to failure

NIFI-5274 avoid rollback on StackOverflowError in ReplaceText

add comment

removed penalize on failure, doesn't really apply here

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2767
2018-06-18 12:00:30 -04:00
Ed 568959baf5
NIFI-4906 Add GetHDFSFileInfo
- Updated doc for write attributes
- Removing redundant files
- Updates based on review

Changes:
- changed validators for regex params (3)
- removed TriggerWhenEmpty and TriggerSerially.
- removed unused LISTING_LAG_NANOS
- removed unimplemented customValidate
- removed unsused error handling for building/updating request params
- added MIME_TYPE for content
- suppressed output to original relationship when scheduled
- added full path to original/new FF when not found
- added warning messages for huge attribute values.

This closes #2639.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-06-18 09:33:42 -04:00
Pierre Villard e5322b5d33 NIFI-4982 - Add a DistributedMapCacheLookupService
This closes #2558

Signed-off-by: zenfenan <zenfenan@apache.org>
2018-06-18 18:35:12 +05:30
Dustin Rodrigues 021ee6faf2 NIFI-5317 - support non-ASCII X-Mailer PutEmail header
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2800.
2018-06-18 10:45:56 +02:00
Matthew Burgess 97f71fd6c7 NIFI-5044: Applied changes in SelectHiveQL to SelectHive3QL
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2799.
2018-06-15 22:42:59 +02:00
Ed B 187417d077 NIFI-5044 SelectHiveQL accept only one statement
SelectHiveQL support only single SELECT statement.
This change adds support for pre- and post- select statements.
It will be useful for configuration queries, i.e. "set tez.queue.name=default", and others.

renamed selectQuery to hqlStatement for better readability

style check correction in comment

removed meaningless examples for post-queries

execute query without result set

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2695
2018-06-15 15:48:16 -04:00
Dongkyu Hwangbo 9b461027a4 NIFI-5188: DruidTranquilityController does not fully support Druid aggregator
Rollback Druid 0.9.2 to 0.9.1

Fixed checkstyle error

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2696
2018-06-15 09:52:14 -04:00
Koji Kawamura 52d6b9cfa2
NIFI-5257: Expand Couchbase Server integration
- Added CouchbaseMapCacheClient.
- Added CouchbaseKeyValueLookupService.
- Added CouchbaseRecordLookupService.
- Added 'Put Value to Attribute' to GetCouchbaseKey.
- Fixed Get/PutCouchbaseKey relationship descriptions.
- Stop sharing Relationship.Builders.

This closes #2750
2018-06-15 09:14:30 -04:00
Koji Kawamura f05c5e6ea0
NIFI-5054: Add Couchbase user authentication 2018-06-15 08:48:46 -04:00
Dustin Rodrigues 2277b9411e NIFI-5252 - support arbitrary headers in PutEmail processor
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2787.
2018-06-15 14:29:56 +02:00
Matthew Burgess 0886dcb0b4 NIFI-5303: Fixed QueryDatabaseTable to work with DB2
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2788.
2018-06-15 13:56:52 +02:00
zenfenan 3752398943 NIFI-5221 - Added 'Object Tagging' functionalities to S3 Processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2751.
2018-06-15 13:49:13 +02:00
Mike Thomsen be63378a1e NIFI-5214 Added REST LookupService
NIFI-5214 Added support for the new ProxyConfigurationService

NIFI-5214 Integration tests added.

NIFI-5214 Added missing pom.xml and a change from a code review.

NIFI-5214 Added another tag based on code review.

NIFI-5214 Added user-defined header support.

NIFI-5214 Added Basic Auth support.

NIFI-5214 Moved documentation.

NIFI-5214 Fixed checkstyle issues; added changes requested in a review.

NIFI-5214 Added changes requested in a code review.

NIFI-5214 Added verb test and @DynamicProperties

NIFI-5214 Added templated URL support to RestLookupService.

NIFI-5214 Fixed documentation based on code review changes.

NIFI-5214 Changed RestLookupService to use a property descriptor.

NIFI-5214 Updated documentation.

NIFI-5214 Made changes requested in code review.

NIFI-5214 Renamed nifi-standard-web-utils to reflect that it is for tests.

NIFI-5214: Refactor RestLookupService.

1. Added 'Base URL' property to address environment specific part of URL.
2. Removed 'Record Path Property Name' property, because the name of
a resulted record field of a record path can be obtained by field name.
3. Lower cased HTTP method name should be used throughout.
4. Added mimeType require check when body is specified.
5. Added debug log to print HTTP response code.
6. Prepare for NIFI-5287.
7. Fixed that mime.type being used regardless of whether body is
specified or not, caused NullPointerException when 'mime.type' is not
specified when it is not required.
8. Updated documentation.

NIFI-5214 Fixed AWS processors that broke w/ change to TestServer location.

NIFI-5214 Added changes requested in a code review.

Refactored the way to evaluate EL for URL property

- Use PropertyValue instead of PreparedQuery to utilize Variable
Registry.
- Removed BASE_URL because Variable Registry can be used at URL

NIFI-5214 Rebased to use new LookupService method.

This closes #2723.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-06-15 15:18:03 +09:00