Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,590 Commits 147 Branches 203 Tags 407 MiB
Commit Graph

2823 Commits

Author SHA1 Message Date
Otto Fowler b10220439c
NIFI-5337 Syslog 5424 Record Reader and nifi-syslog-utils 
- Create nifi-syslog-utils to move syslog parsing functionalty to a central location shared by the processors and serialization/record system.
- Refactor Processors to use these utils
- Update 5424 syslog classes using simple-syslog-5424 to pick up new changes to support this work, as well as keep dependencies/types from bleeding out to the
processors or readers
- Refactor Syslog5424Event and Parser
- Create Syslog5424RecordReader
- per review, handle blank message differently from eof
- name schema per review

This closes #2816.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-07-16 11:50:55 -04:00
Damian Czaja ec7f131602
NIFI-4889: Logout not working properly with OIDC 
- Redirect user agent to end session endpoint on the OIDC provider
- This closes #2830
 2018-07-16 10:14:31 -04:00
Marco Gaido 31bb89514c NIFI-5426: Use NIO.2 API for ListFile 2018-07-13 13:54:27 -04:00
Andy LoPresto ffbff42421 NIFI-5415 Renamed ListenSyslogGroovyTest to ITListenSyslogGroovy. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2883
 2018-07-13 09:57:50 -04:00
patricker 0dd4a91a67 NIFI-5312 QueryDatabaseTable updates state when an SQLException is thrown 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2868
 2018-07-10 19:03:14 -04:00
patricker e13602f752 NIFI-4279 PutDatabaseRecord and ConvertJSONToSQL stream has already been closed error on Oracle 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2874
 2018-07-10 15:30:07 -04:00
patricker 624bbab8f0 NIFI-5382 ConvertRecord Add Option To Drop 0 Record Files 
NIFI-5382 ConvertRecord Add Option To Drop 0 Record Files

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2853
 2018-07-10 12:56:53 -04:00
Koji Kawamura e94f0757db
NIFI-4654: Support reporting RAS S2S lineage to Atlas 
- Added 's2s.port.id' FlowFile attribute to track target remote Port id
- Use 's2s.port.id' to analyze RAW S2S provenance events
- This closes #2863
 2018-07-10 11:44:00 -04:00
Mark Bean b279624398 NIFI-5368 controller services validated prior to enabling; referenced controller services must be enabled for referencing component to be valid (mock framework) 
This closes #2873.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-07-10 11:23:40 -04:00
Mark Payne 35bfc93901
NIFI-5377: Addressed issue of infinite recursion when enabling/disabling controller services if there is a recursive loop (i.e., Service A references Service B references Service A). This closes #2847 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2018-07-10 09:57:13 -04:00
Mark Bean 0d07bc4951
NIFI-5377 prevent infinite loop if a controller service circular reference exists 2018-07-10 09:57:13 -04:00
Andy LoPresto 3ef8b4ab8d NIFI-5370 removed custom hostname verifier implementation from OkHttpReplicationClient (default handles wildcard certs). 
This closes #2869.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-07-10 08:45:33 -04:00
Andy LoPresto 275789f8ca NIFI-5401 Improved logging for node identity loading. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2871.
 2018-07-10 09:51:52 +02:00
patricker 19636978f9 NIFI-5355 ResizeImage Fails to read PNG type on some OS's 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2854.
 2018-07-10 09:35:30 +02:00
Andy LoPresto f60585a9b6
NIFI-5376 Removed deprecation warnings. 
Updated Javadoc for SiteToSiteClient#createTransaction() and HttpClient implementation.
Reverted exception listing in method contract for SiteToSiteClient#createTransaction and HttpClient tion of same.
Reverted import ordering in TestSiteToSiteClient.
Reverted exception listing in TestGetHDFSFileInfo, TestListHDFS, and StandardHttpFlowFileServerProtocol.
Restored @SuppressWarnings annotation and removed unnecessary "public static" keywords from inner classes in SiteToSiteClient.

This closes #2841.

Signed-off-by: Joe Witt <joewitt@apache.org>
 2018-07-09 20:45:34 -07:00
patricker 3826536546 NIFI-1251 ExecuteSQL Max Rows and Output Batching 
NIFI-1251: Fixed doc and checkstyle issues
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2834
 2018-07-09 13:36:45 -04:00
Mike Thomsen 12e384b4be NIFI-5389 Added additional documentation for JsonQueryElasticsearch. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2864
 2018-07-09 12:24:02 -04:00
Mark Payne 1e75f8c789 NIFI-5394: Ensure that we wait for service to be fully enabled when enabling a group, before moving on to the next in the list 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2867
 2018-07-09 12:15:23 -04:00
Mike Thomsen 0ff8518068 NIFI-5390 Added more documentation for DeleteByQueryElasticsearch. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2865
 2018-07-09 11:51:15 -04:00
Mike Thomsen a3a2cbcfc1 NIFI-5391 Removed two unused dependencies from nifi-elasticsearch-restapi-processors. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2862
 2018-07-09 11:40:29 -04:00
Jan Hentschel 46014bc962 NIFI-1305 Extended JavaDoc on DistributedMapCacheClient.getAndPutIfAbsent 
This closes #2857

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-08 07:23:19 -04:00
patricker d50e3f1747 NIFI-5384 FlowFile's queued in batches should all have the same Queue time 
This closes #2849

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-07 07:56:53 -04:00
Mike Thomsen 40c4b2c771 Revert "NIFI-5383 Replaced hard-coded version with Maven property in nifi-redis-bundle" 
This reverts commit a8a0b0d075.
 2018-07-06 22:05:01 -04:00
Jan Hentschel a8a0b0d075 NIFI-5383 Replaced hard-coded version with Maven property in nifi-redis-bundle 
This closes #2848

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-06 21:12:07 -04:00
Jan Hentschel 87f3a99adf NIFI-5387 Removed redundant groupId from nifi-redis-bundle 
This closes #2852

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-06 21:08:51 -04:00
Jan Hentschel 8fd8a247d9 NIFI-5386 Removed redundant dependencies from nifi-redis-extensions 
This closes #2851

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-06 21:06:40 -04:00
Jan Hentschel d31a919553 NIFI-4811 Updated spring-data-redis to the latest version 
This closes #2845

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-06 21:01:54 -04:00
thenatog b77d66889a
NIFI-5374 - Added ExceptionFilter which catches RequestRejectedException thrown in the nifi-api Jersey code. These exceptions were not caught by the Jetty error-page configuration because they're thrown before the endpoint/Jetty routing is hit. 
Added integration test for checking the ExceptionFilter catches malicious string exceptions.
Made minor changes to PR 2840 for code style.

This closes #2840.

Co-authored-by: Andy LoPresto <alopresto@apache.org>

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-07-03 18:17:22 -07:00
zenfenan 3164759d7f NIFI-5334: GetMongo keeps original attributes when it has incoming connections 
This closes #2815

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-03 07:51:20 -04:00
Matthew Burgess ee86af0c15 NIFI-5356: Added record.count and failure.count attributes to PutElasticsearchHttpRecord 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2835.
 2018-07-03 10:23:34 +02:00
Mike Thomsen 22ec069acb NIFI-5059 Updated MongoDBLookupService to be able to detect record schemas or take one provided by the user. 
NIFI-5059 Changed it to use a schema registry.

NIFI-5059 Updated MongoDBLookupService to be a SchemaRegistryService.

NIFI-5059 Added two changes from a code review.

NIFI-5059 Fixed two bad references.

NIFI-5059 Refactored schema strategy handling.

NIFI-5059 Moved schema strategy handling to JsonInferenceSchemaRegistryService.

NIFI-5059 Updated to use new LookupService method.

NIFI-5059 fixed schema inference bug.

NIFI-5059 Added test for schema text strategy

NIFI-5059 incremented version number to make the build work.

NIFI-5059 fixed a stray 1.7.0 reference.

NIFI-5059 Added getDatabase to client service.

NIFI-5059 Added changes requested in a code review.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2619
 2018-07-02 21:57:50 -04:00
Mark Payne d4d4ddadee
NIFI-5361: When submitting many processors to start, calculate the 'timeout timestamp' immediately before calling @OnScheduled method, after the task has been scheduled to run, instead of before the task has a chance to run. 
This closes #2831
 2018-07-02 16:36:07 -04:00
Mike Thomsen 790102d8b1 Revert "NIFI-5147 Add CalculateAttributeHash processor" 
This reverts commit 7fb931889f.
 2018-07-02 16:03:28 -04:00
Mark Payne b549fbb67b NIFI-5362: When a processor is terminated and has no more active threads, ensure that we set this.hasActiveThreads = false 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2832.
 2018-07-02 16:20:20 +02:00
Otto Fowler 7fb931889f NIFI-5147 Add CalculateAttributeHash processor 
This closes #2802

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-02 06:20:21 -04:00
patricker 4ea6e6a40e NIFI-4535 
This closes #2826

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-01 21:25:21 -04:00
Bryan Bende 3fd45ac4c4 NIFI-5354 Changing ranger.version to 1.0.0 and ranger.hadoop.version to 3.0.0 
Signed-off-by: Yolanda Davis <ymdavis@apache.org>

This closes #2827
 2018-06-29 23:36:54 -04:00
patricker a14dbc7dbe NIFI-5339 - Better Time Tracking for ExecuteSQL Durations 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2824.
 2018-06-29 16:47:55 +02:00
patricker c1083dfb62 NIFI-5339 - Better Time Tracking for ExecuteSQL Durations 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2817.
 2018-06-29 14:59:27 +02:00
zenfenan 6508c191bf NIFI-5343: Fix GetMongo to properly reads charset from FlowFile attributes 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2818.
 2018-06-29 14:56:24 +02:00
Matthew Burgess e741ba1ce4 NIFI-5349: Fixed EL handling in Initial Max Value props for DB Fetch processors 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2822.
 2018-06-29 14:51:59 +02:00
Bryan Bende 022b64be08 NIFI-5316 Fixed array handling for Avro that comes from Parquet's Avro reader 
Signed-off-by: zenfenan <zenfenan@apache.org>
 2018-06-28 22:13:23 +05:30
Matthew Burgess 921403ff55 NIFI-5336: Exclude hbase-server from Hive 3 bundle 
This closes #2811

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-06-26 05:33:07 -04:00
thenatog a274918dc5
NIFI-5258 - Changed the way the servlets are created for the documentation webapp. 
Removed some unnecessary code.
Fixed imports.

This closes #2812.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-06-25 18:22:55 -07:00
zenfenan 9af61d3a2d NIFI-5332: Fix GetMongoIT test failures 
This closes #2808

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-06-25 20:59:48 -04:00
Andy LoPresto ea9b0db2f6
Merge branch 'NIFI-5323-RC1' as part of Apache NiFi 1.7.0 release process. 2018-06-25 12:03:00 -07:00
Peter Toth 241bc2aa89 NIFI-5278: fixes JSON escaping of code 
Change-Id: I2cb0e6c658d4a0f2aad9c4aab9201a3334ee54df

NIFI-5278: adds Apache Commons Text to NOTICE

Change-Id: I8185239b0a888c16159b18f13d6682ba350cc766

NIFI-5278: adds tests

Change-Id: I9286ac71bc7399e5bdc1e6602609b5e8829db27e

NIFI-5278: fixes review findings

Change-Id: I292c93dae877cf1cd146f3897b7e132b6afac801
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2768
 2018-06-21 14:46:41 -04:00
Otto Fowler a64680bfa5
NIFI-5325 A Syslog Parser that fully supports RFC 5424 Structured Data 
- address review comments
- per review, add property for including body in attributes
- per review, create processor in OnScheduled

This closes #2805.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-06-21 12:38:41 -04:00
Andy LoPresto d42a1e8bf4
NIFI-5323-RC1 prepare for next development iteration 2018-06-19 20:02:21 -07:00
Andy LoPresto 99bcd1f88d
NIFI-5323-RC1 prepare release nifi-1.7.0-RC1 2018-06-19 20:02:01 -07:00