Commit Graph

4700 Commits

Author SHA1 Message Date
Mike Thomsen d139b28564 NIFI-5409 Added additional documentation for DeleteMongo.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2879
2018-07-23 08:52:57 -04:00
Jeff Storck 46ce7aaa32
NIFI-5341 Enabled groovy tests in nifi-runtime
Fixed tests in NiFiGroovyTest in the nifi-runtime module
Updated NiFi.createBootstrapClassLoader to log a warning if lib/bootstrap does not exist rather than throwing a FileNotFoundException, since it already catches MalformedUrlException if there's an issue adding one of the bootstrap JARs to the bootstrap classpath
Explicitly handling InvocationTargetException in NiFi.initializeProperties to unwrap the cause and rewrap as an IllegalArgumentException to propogate the real cause of the underlying exception thrown by NiFiPropertiesLoader

This closes #2821.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-07-18 11:35:55 -07:00
Joe Gresock 66783c18b2 NIFI-5427: Updating ScrollElasticsearchHttp to use POST, supporting ES6
This closes #2890

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-18 13:50:53 -04:00
Mike Moser 4e09a03f86 NIFI-5196 Fixed JMS connection leak when uncaught exceptions happen
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2904.
2018-07-18 11:27:51 +02:00
Mike Thomsen 461eca0d14 NIFI-5305 If EL evaluation creates an empty string for the database or collection names, it raises a ProcessException which triggers failure behavior.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2891.
2018-07-18 11:07:31 +02:00
Mark Payne 72a5e6bfba NIFI-4407: Updated Expression Language Guide to provide details about how escaping $ is accomplished, and when the $ character should and should not be escaped. Fixed bug in the Query compiler that mistakenly would blindly replace 484 with $ even when the 484 did not precede an Expression. Added additional test cases.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2898.
2018-07-18 10:52:13 +02:00
Pierre Villard d126743d93 NIFI-5437 - Yield in ExecuteScript when catching ScriptException
This closes #2903

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-17 19:58:33 -04:00
Otto Fowler 3746ae258d
NIFI-5436 Add ability to set the processor name in the ProcessContext when using the TestRunner.
This closes #2902.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-07-17 14:42:37 -07:00
Koji Kawamura 8b9d446118 NIFI-54096: Consolidating new model into existing List processors.
Adding followings:

- Use separate DistributedMapCache for tracking entities to avoid
conflict with existing code
- Added more validation
- Delete listed entities from cache if reset is needed
- Support Local scope
- Added Initial Listing Target

This closes #2876.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-07-17 13:59:57 -04:00
Otto Fowler 0a493bf7fd
NIFI-5432 Add Syslog Record Reader legacy Syslog
- Add additional details for schema

This closes #2900.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-07-17 13:40:47 -04:00
pepov b191f6a62a
NIFI-5430 CLI tool extension for cluster summary
This closes #2894.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-07-16 15:29:06 -04:00
Otto Fowler b10220439c
NIFI-5337 Syslog 5424 Record Reader and nifi-syslog-utils
- Create nifi-syslog-utils to move syslog parsing functionalty to a central location shared by the processors and serialization/record system.
- Refactor Processors to use these utils
- Update 5424 syslog classes using simple-syslog-5424 to pick up new changes to support this work, as well as keep dependencies/types from bleeding out to the
processors or readers
- Refactor Syslog5424Event and Parser
- Create Syslog5424RecordReader
- per review, handle blank message differently from eof
- name schema per review

This closes #2816.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-07-16 11:50:55 -04:00
Damian Czaja ec7f131602
NIFI-4889: Logout not working properly with OIDC
- Redirect user agent to end session endpoint on the OIDC provider
- This closes #2830
2018-07-16 10:14:31 -04:00
Marco Gaido 31bb89514c NIFI-5426: Use NIO.2 API for ListFile 2018-07-13 13:54:27 -04:00
Andy LoPresto ffbff42421 NIFI-5415 Renamed ListenSyslogGroovyTest to ITListenSyslogGroovy.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2883
2018-07-13 09:57:50 -04:00
Lars Francke 4dd3495c77 NIFI-5352 Change distribution to have the JARs and NARs in lib readable by "other"
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #2825.
2018-07-10 21:26:18 -07:00
Martin Payne eaef91fabb NIFI-5289 - Changed nifi-mock junit Dependency Scope
Resolves NoClassDefFoundError for org.junit.Assert when using nifi-mock.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2780
2018-07-10 20:38:16 -04:00
patricker 0dd4a91a67 NIFI-5312 QueryDatabaseTable updates state when an SQLException is thrown
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2868
2018-07-10 19:03:14 -04:00
patricker e13602f752 NIFI-4279 PutDatabaseRecord and ConvertJSONToSQL stream has already been closed error on Oracle
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2874
2018-07-10 15:30:07 -04:00
Andy LoPresto bef91008bb
NIFI-5399 Added wildcard certificate documentation to Admin Guide.
Clarified CN vs. SAN entries.

This closes #2870.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2018-07-10 11:15:07 -07:00
patricker 624bbab8f0 NIFI-5382 ConvertRecord Add Option To Drop 0 Record Files
NIFI-5382 ConvertRecord Add Option To Drop 0 Record Files

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2853
2018-07-10 12:56:53 -04:00
Koji Kawamura e94f0757db
NIFI-4654: Support reporting RAS S2S lineage to Atlas
- Added 's2s.port.id' FlowFile attribute to track target remote Port id
- Use 's2s.port.id' to analyze RAW S2S provenance events
- This closes #2863
2018-07-10 11:44:00 -04:00
Mark Bean b279624398 NIFI-5368 controller services validated prior to enabling; referenced controller services must be enabled for referencing component to be valid (mock framework)
This closes #2873.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-07-10 11:23:40 -04:00
joewitt 23c3bb886c This closes #2838. Forcing this PR closed with empty commit. 2018-07-10 10:56:15 -04:00
Mark Payne 35bfc93901
NIFI-5377: Addressed issue of infinite recursion when enabling/disabling controller services if there is a recursive loop (i.e., Service A references Service B references Service A). This closes #2847
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2018-07-10 09:57:13 -04:00
Mark Bean 0d07bc4951
NIFI-5377 prevent infinite loop if a controller service circular reference exists 2018-07-10 09:57:13 -04:00
Andy LoPresto 3ef8b4ab8d NIFI-5370 removed custom hostname verifier implementation from OkHttpReplicationClient (default handles wildcard certs).
This closes #2869.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-07-10 08:45:33 -04:00
Andy LoPresto 275789f8ca NIFI-5401 Improved logging for node identity loading.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2871.
2018-07-10 09:51:52 +02:00
patricker 19636978f9 NIFI-5355 ResizeImage Fails to read PNG type on some OS's
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2854.
2018-07-10 09:35:30 +02:00
Andy LoPresto f60585a9b6
NIFI-5376 Removed deprecation warnings.
Updated Javadoc for SiteToSiteClient#createTransaction() and HttpClient implementation.
Reverted exception listing in method contract for SiteToSiteClient#createTransaction and HttpClient tion of same.
Reverted import ordering in TestSiteToSiteClient.
Reverted exception listing in TestGetHDFSFileInfo, TestListHDFS, and StandardHttpFlowFileServerProtocol.
Restored @SuppressWarnings annotation and removed unnecessary "public static" keywords from inner classes in SiteToSiteClient.

This closes #2841.

Signed-off-by: Joe Witt <joewitt@apache.org>
2018-07-09 20:45:34 -07:00
patricker 3826536546 NIFI-1251 ExecuteSQL Max Rows and Output Batching
NIFI-1251: Fixed doc and checkstyle issues
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2834
2018-07-09 13:36:45 -04:00
Mike Thomsen 12e384b4be NIFI-5389 Added additional documentation for JsonQueryElasticsearch.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2864
2018-07-09 12:24:02 -04:00
Mark Payne 1e75f8c789 NIFI-5394: Ensure that we wait for service to be fully enabled when enabling a group, before moving on to the next in the list
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2867
2018-07-09 12:15:23 -04:00
Mike Thomsen 0ff8518068 NIFI-5390 Added more documentation for DeleteByQueryElasticsearch.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2865
2018-07-09 11:51:15 -04:00
Mike Thomsen a3a2cbcfc1 NIFI-5391 Removed two unused dependencies from nifi-elasticsearch-restapi-processors.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2862
2018-07-09 11:40:29 -04:00
Jan Hentschel 46014bc962 NIFI-1305 Extended JavaDoc on DistributedMapCacheClient.getAndPutIfAbsent
This closes #2857

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-08 07:23:19 -04:00
patricker d50e3f1747 NIFI-5384 FlowFile's queued in batches should all have the same Queue time
This closes #2849

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-07 07:56:53 -04:00
patricker 0c5e159ebc NIFI-5385 assertAttributeNotExists Is hard to understand
This closes #2850

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-07 07:26:21 -04:00
Mike Thomsen 40c4b2c771 Revert "NIFI-5383 Replaced hard-coded version with Maven property in nifi-redis-bundle"
This reverts commit a8a0b0d075.
2018-07-06 22:05:01 -04:00
Jan Hentschel a8a0b0d075 NIFI-5383 Replaced hard-coded version with Maven property in nifi-redis-bundle
This closes #2848

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-06 21:12:07 -04:00
Jan Hentschel 87f3a99adf NIFI-5387 Removed redundant groupId from nifi-redis-bundle
This closes #2852

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-06 21:08:51 -04:00
Jan Hentschel 8fd8a247d9 NIFI-5386 Removed redundant dependencies from nifi-redis-extensions
This closes #2851

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-06 21:06:40 -04:00
Jan Hentschel d31a919553 NIFI-4811 Updated spring-data-redis to the latest version
This closes #2845

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-06 21:01:54 -04:00
Aldrin Piri 3764b77b7c NIFI-5372 Making adjustments to the docker-compose file to allow utilization of docker-compose up --scale. Providing a README as to how to use the docker-compose.yml
NIFI-5372 Fixed a typo.

This closes #2839

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-04 19:04:24 -04:00
thenatog b77d66889a
NIFI-5374 - Added ExceptionFilter which catches RequestRejectedException thrown in the nifi-api Jersey code. These exceptions were not caught by the Jetty error-page configuration because they're thrown before the endpoint/Jetty routing is hit.
Added integration test for checking the ExceptionFilter catches malicious string exceptions.
Made minor changes to PR 2840 for code style.

This closes #2840.

Co-authored-by: Andy LoPresto <alopresto@apache.org>

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-07-03 18:17:22 -07:00
David Savage f8b1ae6d3f
fix copy paste bug in documentation for ldap auth
This closes #2837.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2018-07-03 15:26:01 -04:00
Mike Thomsen d3222b85ab
NIFI-5195 Added clustering to the docker image and added a docker-compose file that builds a basic 3 node cluster.
This closes #2828.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2018-07-03 11:40:31 -04:00
zenfenan 3164759d7f NIFI-5334: GetMongo keeps original attributes when it has incoming connections
This closes #2815

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-03 07:51:20 -04:00
Mike Thomsen df49312804 NIFI-5359 Exposed variable registry to docker image.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2829.
2018-07-03 11:42:35 +02:00
Matthew Burgess ee86af0c15 NIFI-5356: Added record.count and failure.count attributes to PutElasticsearchHttpRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2835.
2018-07-03 10:23:34 +02:00