Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,793 Commits 147 Branches 203 Tags 407 MiB
Commit Graph

4793 Commits

Author SHA1 Message Date
Otto Fowler 3746ae258d
NIFI-5436 Add ability to set the processor name in the ProcessContext when using the TestRunner. 
This closes #2902.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-07-17 14:42:37 -07:00
Koji Kawamura 8b9d446118 NIFI-54096: Consolidating new model into existing List processors. 
Adding followings:

- Use separate DistributedMapCache for tracking entities to avoid
conflict with existing code
- Added more validation
- Delete listed entities from cache if reset is needed
- Support Local scope
- Added Initial Listing Target

This closes #2876.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-07-17 13:59:57 -04:00
Otto Fowler 0a493bf7fd
NIFI-5432 Add Syslog Record Reader legacy Syslog 
- Add additional details for schema

This closes #2900.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-07-17 13:40:47 -04:00
pepov b191f6a62a
NIFI-5430 CLI tool extension for cluster summary 
This closes #2894.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-07-16 15:29:06 -04:00
Otto Fowler b10220439c
NIFI-5337 Syslog 5424 Record Reader and nifi-syslog-utils 
- Create nifi-syslog-utils to move syslog parsing functionalty to a central location shared by the processors and serialization/record system.
- Refactor Processors to use these utils
- Update 5424 syslog classes using simple-syslog-5424 to pick up new changes to support this work, as well as keep dependencies/types from bleeding out to the
processors or readers
- Refactor Syslog5424Event and Parser
- Create Syslog5424RecordReader
- per review, handle blank message differently from eof
- name schema per review

This closes #2816.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-07-16 11:50:55 -04:00
Damian Czaja ec7f131602
NIFI-4889: Logout not working properly with OIDC 
- Redirect user agent to end session endpoint on the OIDC provider
- This closes #2830
 2018-07-16 10:14:31 -04:00
Marco Gaido 31bb89514c NIFI-5426: Use NIO.2 API for ListFile 2018-07-13 13:54:27 -04:00
Andy LoPresto ffbff42421 NIFI-5415 Renamed ListenSyslogGroovyTest to ITListenSyslogGroovy. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2883
 2018-07-13 09:57:50 -04:00
Lars Francke 4dd3495c77 NIFI-5352 Change distribution to have the JARs and NARs in lib readable by "other" 
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #2825.
 2018-07-10 21:26:18 -07:00
Martin Payne eaef91fabb NIFI-5289 - Changed nifi-mock junit Dependency Scope 
Resolves NoClassDefFoundError for org.junit.Assert when using nifi-mock.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2780
 2018-07-10 20:38:16 -04:00
patricker 0dd4a91a67 NIFI-5312 QueryDatabaseTable updates state when an SQLException is thrown 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2868
 2018-07-10 19:03:14 -04:00
patricker e13602f752 NIFI-4279 PutDatabaseRecord and ConvertJSONToSQL stream has already been closed error on Oracle 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2874
 2018-07-10 15:30:07 -04:00
Andy LoPresto bef91008bb
NIFI-5399 Added wildcard certificate documentation to Admin Guide. 
Clarified CN vs. SAN entries.

This closes #2870.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
 2018-07-10 11:15:07 -07:00
patricker 624bbab8f0 NIFI-5382 ConvertRecord Add Option To Drop 0 Record Files 
NIFI-5382 ConvertRecord Add Option To Drop 0 Record Files

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2853
 2018-07-10 12:56:53 -04:00
Koji Kawamura e94f0757db
NIFI-4654: Support reporting RAS S2S lineage to Atlas 
- Added 's2s.port.id' FlowFile attribute to track target remote Port id
- Use 's2s.port.id' to analyze RAW S2S provenance events
- This closes #2863
 2018-07-10 11:44:00 -04:00
Mark Bean b279624398 NIFI-5368 controller services validated prior to enabling; referenced controller services must be enabled for referencing component to be valid (mock framework) 
This closes #2873.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-07-10 11:23:40 -04:00
joewitt 23c3bb886c This closes #2838. Forcing this PR closed with empty commit. 2018-07-10 10:56:15 -04:00
Mark Payne 35bfc93901
NIFI-5377: Addressed issue of infinite recursion when enabling/disabling controller services if there is a recursive loop (i.e., Service A references Service B references Service A). This closes #2847 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2018-07-10 09:57:13 -04:00
Mark Bean 0d07bc4951
NIFI-5377 prevent infinite loop if a controller service circular reference exists 2018-07-10 09:57:13 -04:00
Andy LoPresto 3ef8b4ab8d NIFI-5370 removed custom hostname verifier implementation from OkHttpReplicationClient (default handles wildcard certs). 
This closes #2869.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-07-10 08:45:33 -04:00
Andy LoPresto 275789f8ca NIFI-5401 Improved logging for node identity loading. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2871.
 2018-07-10 09:51:52 +02:00
patricker 19636978f9 NIFI-5355 ResizeImage Fails to read PNG type on some OS's 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2854.
 2018-07-10 09:35:30 +02:00
Andy LoPresto f60585a9b6
NIFI-5376 Removed deprecation warnings. 
Updated Javadoc for SiteToSiteClient#createTransaction() and HttpClient implementation.
Reverted exception listing in method contract for SiteToSiteClient#createTransaction and HttpClient tion of same.
Reverted import ordering in TestSiteToSiteClient.
Reverted exception listing in TestGetHDFSFileInfo, TestListHDFS, and StandardHttpFlowFileServerProtocol.
Restored @SuppressWarnings annotation and removed unnecessary "public static" keywords from inner classes in SiteToSiteClient.

This closes #2841.

Signed-off-by: Joe Witt <joewitt@apache.org>
 2018-07-09 20:45:34 -07:00
patricker 3826536546 NIFI-1251 ExecuteSQL Max Rows and Output Batching 
NIFI-1251: Fixed doc and checkstyle issues
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2834
 2018-07-09 13:36:45 -04:00
Mike Thomsen 12e384b4be NIFI-5389 Added additional documentation for JsonQueryElasticsearch. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2864
 2018-07-09 12:24:02 -04:00
Mark Payne 1e75f8c789 NIFI-5394: Ensure that we wait for service to be fully enabled when enabling a group, before moving on to the next in the list 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2867
 2018-07-09 12:15:23 -04:00
Mike Thomsen 0ff8518068 NIFI-5390 Added more documentation for DeleteByQueryElasticsearch. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2865
 2018-07-09 11:51:15 -04:00
Mike Thomsen a3a2cbcfc1 NIFI-5391 Removed two unused dependencies from nifi-elasticsearch-restapi-processors. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2862
 2018-07-09 11:40:29 -04:00
Jan Hentschel 46014bc962 NIFI-1305 Extended JavaDoc on DistributedMapCacheClient.getAndPutIfAbsent 
This closes #2857

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-08 07:23:19 -04:00
patricker d50e3f1747 NIFI-5384 FlowFile's queued in batches should all have the same Queue time 
This closes #2849

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-07 07:56:53 -04:00
patricker 0c5e159ebc NIFI-5385 assertAttributeNotExists Is hard to understand 
This closes #2850

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-07 07:26:21 -04:00
Mike Thomsen 40c4b2c771 Revert "NIFI-5383 Replaced hard-coded version with Maven property in nifi-redis-bundle" 
This reverts commit a8a0b0d075.
 2018-07-06 22:05:01 -04:00
Jan Hentschel a8a0b0d075 NIFI-5383 Replaced hard-coded version with Maven property in nifi-redis-bundle 
This closes #2848

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-06 21:12:07 -04:00
Jan Hentschel 87f3a99adf NIFI-5387 Removed redundant groupId from nifi-redis-bundle 
This closes #2852

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-06 21:08:51 -04:00
Jan Hentschel 8fd8a247d9 NIFI-5386 Removed redundant dependencies from nifi-redis-extensions 
This closes #2851

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-06 21:06:40 -04:00
Jan Hentschel d31a919553 NIFI-4811 Updated spring-data-redis to the latest version 
This closes #2845

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-06 21:01:54 -04:00
Aldrin Piri 3764b77b7c NIFI-5372 Making adjustments to the docker-compose file to allow utilization of docker-compose up --scale. Providing a README as to how to use the docker-compose.yml 
NIFI-5372 Fixed a typo.

This closes #2839

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-04 19:04:24 -04:00
thenatog b77d66889a
NIFI-5374 - Added ExceptionFilter which catches RequestRejectedException thrown in the nifi-api Jersey code. These exceptions were not caught by the Jetty error-page configuration because they're thrown before the endpoint/Jetty routing is hit. 
Added integration test for checking the ExceptionFilter catches malicious string exceptions.
Made minor changes to PR 2840 for code style.

This closes #2840.

Co-authored-by: Andy LoPresto <alopresto@apache.org>

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-07-03 18:17:22 -07:00
David Savage f8b1ae6d3f
fix copy paste bug in documentation for ldap auth 
This closes #2837.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2018-07-03 15:26:01 -04:00
Mike Thomsen d3222b85ab
NIFI-5195 Added clustering to the docker image and added a docker-compose file that builds a basic 3 node cluster. 
This closes #2828.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2018-07-03 11:40:31 -04:00
zenfenan 3164759d7f NIFI-5334: GetMongo keeps original attributes when it has incoming connections 
This closes #2815

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-03 07:51:20 -04:00
Mike Thomsen df49312804 NIFI-5359 Exposed variable registry to docker image. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2829.
 2018-07-03 11:42:35 +02:00
Matthew Burgess ee86af0c15 NIFI-5356: Added record.count and failure.count attributes to PutElasticsearchHttpRecord 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2835.
 2018-07-03 10:23:34 +02:00
Mike Thomsen 22ec069acb NIFI-5059 Updated MongoDBLookupService to be able to detect record schemas or take one provided by the user. 
NIFI-5059 Changed it to use a schema registry.

NIFI-5059 Updated MongoDBLookupService to be a SchemaRegistryService.

NIFI-5059 Added two changes from a code review.

NIFI-5059 Fixed two bad references.

NIFI-5059 Refactored schema strategy handling.

NIFI-5059 Moved schema strategy handling to JsonInferenceSchemaRegistryService.

NIFI-5059 Updated to use new LookupService method.

NIFI-5059 fixed schema inference bug.

NIFI-5059 Added test for schema text strategy

NIFI-5059 incremented version number to make the build work.

NIFI-5059 fixed a stray 1.7.0 reference.

NIFI-5059 Added getDatabase to client service.

NIFI-5059 Added changes requested in a code review.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2619
 2018-07-02 21:57:50 -04:00
Mark Payne d4d4ddadee
NIFI-5361: When submitting many processors to start, calculate the 'timeout timestamp' immediately before calling @OnScheduled method, after the task has been scheduled to run, instead of before the task has a chance to run. 
This closes #2831
 2018-07-02 16:36:07 -04:00
Mike Thomsen 790102d8b1 Revert "NIFI-5147 Add CalculateAttributeHash processor" 
This reverts commit 7fb931889f.
 2018-07-02 16:03:28 -04:00
Mark Payne b549fbb67b NIFI-5362: When a processor is terminated and has no more active threads, ensure that we set this.hasActiveThreads = false 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2832.
 2018-07-02 16:20:20 +02:00
Otto Fowler 7fb931889f NIFI-5147 Add CalculateAttributeHash processor 
This closes #2802

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-02 06:20:21 -04:00
patricker 4ea6e6a40e NIFI-4535 
This closes #2826

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-01 21:25:21 -04:00
Bryan Bende 3fd45ac4c4 NIFI-5354 Changing ranger.version to 1.0.0 and ranger.hadoop.version to 3.0.0 
Signed-off-by: Yolanda Davis <ymdavis@apache.org>

This closes #2827
 2018-06-29 23:36:54 -04:00