Apache/nifi
1
0
Fork 0
mirror of https://github.com/apache/nifi.git synced 2025-02-09 03:25:04 +00:00
Code Issues Packages Projects Releases Wiki Activity
4,692 Commits 147 Branches 203 Tags
Commit Graph

2911 Commits

Author SHA1 Message Date
Mark Payne
5b57935bae NIFI-5527: Refactored unit test to make member variables for 'delay tolerances' so that they are easier to update in the future. Increased delay tolerances so that tests pass on heavily loaded system. 
This closes #2955.
 2018-08-22 10:51:47 -04:00
zenfenan
82c5126f3c NIFI-5494 - Added ExpressionLanguage support to 'Hive Configuration Resources' 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2946.
 2018-08-22 13:04:21 +02:00
Mark Payne
7bbb5a823a NIFI-5466: Keep a running total of stats for each component. Refactored FlowFileEvent and repository in order to provide more efficient storage of objects on Java heap by allowing the same 'EMPTY' object to be reused 
- Refactored VolatileComponentStatusRepository to avoid holding on to ProcessorStatus objects, etc, and only keep what they need
 - Updated VolatileComponentStatusRepository to ensure that we are efficiently storing metrics for processors, etc. that are not running

This closes #2939

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-08-21 11:44:25 -04:00
Vadim Arshavsky
410176ed22 NIFI-5525: CSVRecordReader fails with StringIndexOutOfBoundsException when field is a double quote 
This closes #2953.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-08-16 14:22:27 -04:00
Mike Thomsen
9d2b698c1c NIFI-5448 Changed from 'stop' to 'penalize' in allowablevalue field to make the popup more consistent. 2018-08-15 21:35:09 -04:00
Jan Hentschel
c2657ee043 NIFI-5423 Removed duplicated dependencies in sub-modules 
This closes #2887

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-08-15 11:01:51 -04:00
patricker
5106dc0af9
NIFI-4535 Only update Page Title to root flow name when user has permission. 
This closes #2899
 2018-08-13 12:46:16 -04:00
Scott Aslan
59a79c134f
[NIFI-5499] upgrade AngularJS to v1.7.2 
[NIFI-5499] update package-lock.json

This closes #2941
 2018-08-13 11:40:59 -04:00
patricker
17ea29244e NIFI-5381 SFTP Unit Tests 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2846.
 2018-08-10 20:17:28 +02:00
Daniel Jimenez
3731cc8558 NIFI-5489: Add expression language support to AMQP processors HOST, VHOST and USER Fields. 
This closes #2936

Signed-off-by: zenfenan <zenfenan@apache.org>
 2018-08-09 22:57:23 +05:30
Mike Thomsen
32ee552ada NIFI-5448 Added failure relationship to UpdateAttributes to handle bad expression language logic. 
This closes #2914

Signed-off-by: zenfenan <zenfenan@apache.org>
 2018-08-09 22:41:50 +05:30
Jeff Storck
451084e11f NIFI-4434 Fixed recursive listing with a custom regex filter. 
Filter modes are now supported to perform listings based on directory and file names, file-names only, and full path.

This closes #2937

Signed-off-by: zenfenan <zenfenan@apache.org>
 2018-08-08 22:06:50 +05:30
Lars Francke
a19134f325 NIFI-5350 Add a way to provide arbitrary Java options in shell scripts 
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #2823
 2018-08-06 21:02:29 +00:00
Matthew Burgess
9ee2316ff6 NIFI-5491: Fixed PutHive3Streaming handling of Byte, Short, and Struct 
This closes #2938.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-08-06 14:33:49 -04:00
Mark Payne
d1ab17580f NIFI-5465: Set the Idle Timeout on jetty connectors to the same as the Request Timeout. 2018-08-06 10:33:24 -04:00
Matthew Burgess
3d546b8d87
NIFI-5484: Fixed PutHive3Streaming to use the Hive Metastore URI property (to include multiple URIs) 
NIFI-5484: Incorporated review comments, added unit test for new validator

This closes #2934
 2018-08-03 10:36:56 -04:00
Mark Payne
4cca9bef7c NIFI-5480: Use FlowController's maps of components in order to look up component by ID rather than iterating recursively through all Process Groups to find the component 
This closes #2932

Signed-off-by: Jeremy Dyer <jeremydyer@apache.org>
 2018-08-01 19:33:56 -04:00
Matthew Burgess
b4894c5572
NIFI-5475: Upgraded Hive 3 bundle to Apache Hive 3.1.0 2018-08-01 13:42:31 -04:00
Andy LoPresto
e62aa0252d
NIFI-5442 Get X-ProxyContextPath value from request attributes rather than directly from headers. 
NIFI-5442 Populate request contextPath attribute during AccessResource before displaying on message-page.jsp.
Refactored shared code from CatchAllFilter to WebUtils.
NIFI-5442 Refactored filter and context path code to shared parent filter and subclass.
NIFI-5442 Removed unnecessary initParams from nifi-web-ui web.xml.
NIFI-5442 Added explicit dispatchers to nifi-web-ui web.xml and removed unnecessary code from AccessResource.

This closes #2908
 2018-08-01 12:10:14 -04:00
Matthew Burgess
9742dd2fac NIFI-5471: Push table aliasing to DatabaseAdapter impls 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2926.
 2018-07-31 10:14:27 +02:00
uday
e97ae921f7 NIFI-5342 CaptureChangeMySQL didn't escape database name 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2923
 2018-07-30 19:04:19 -04:00
zenfenan
44face10bf NIFI-5450: Added ENDPOINT_OVERRIDE to AWS SQS processors 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2924.
 2018-07-30 23:28:46 +02:00
Matthew Burgess
473221368c NIFI-5420: Allow StandardProcessSession to calculate duration for provenance events 
This closes #2886.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-07-27 09:13:50 -04:00
Mike Thomsen
b1f78d58a6 NIFI-5440 Added db and collection attributes to GetMongo output. 
This closes #2906

Signed-off-by: zenfenan <zenfenan@apache.org>
 2018-07-26 23:34:12 +05:30
Jan Hentschel
610cbb66b2 NIFI-5418 Removed duplicated jackson-databind dependency from nifi-framework-cluster 
This closes #2885

Signed-off-by: zenfenan <zenfenan@apache.org>
 2018-07-26 23:20:13 +05:30
Corey Fritz
4baf35db5b NIFI-5083: enabled EL support for processor configuration of Kafka consumer group.id property 
Signed-off-by: zenfenan <zenfenan@apache.org>
 2018-07-26 22:04:49 +05:30
Matthew Burgess
692943f016 NIFI-5454: Added EL support and copy.index attribute to DuplicateFlowFile 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2917.
 2018-07-26 14:13:14 +02:00
Andy LoPresto
0ad30e188f NIFI-5451 Added test resources for 128 bit encryption. 
Fixed unit test to perform properly without JCE unlimited strength policy installed.

This closes #2916.

Signed-off-by: Mike Moser <mosermw@apache.org>
 2018-07-25 15:21:13 +00:00
Mike Thomsen
78d908bc0e NIFI-5412 Added additional documentation for PutMongo. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2895
 2018-07-23 09:11:59 -04:00
Mike Thomsen
c3cad2b38b NIFI-5410 Added additional documentation for GetMongo. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2880
 2018-07-23 08:55:36 -04:00
Mike Thomsen
d139b28564 NIFI-5409 Added additional documentation for DeleteMongo. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2879
 2018-07-23 08:52:57 -04:00
Jeff Storck
46ce7aaa32
NIFI-5341 Enabled groovy tests in nifi-runtime 
Fixed tests in NiFiGroovyTest in the nifi-runtime module
Updated NiFi.createBootstrapClassLoader to log a warning if lib/bootstrap does not exist rather than throwing a FileNotFoundException, since it already catches MalformedUrlException if there's an issue adding one of the bootstrap JARs to the bootstrap classpath
Explicitly handling InvocationTargetException in NiFi.initializeProperties to unwrap the cause and rewrap as an IllegalArgumentException to propogate the real cause of the underlying exception thrown by NiFiPropertiesLoader

This closes #2821.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-07-18 11:35:55 -07:00
Joe Gresock
66783c18b2 NIFI-5427: Updating ScrollElasticsearchHttp to use POST, supporting ES6 
This closes #2890

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-18 13:50:53 -04:00
Mike Moser
4e09a03f86 NIFI-5196 Fixed JMS connection leak when uncaught exceptions happen 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2904.
 2018-07-18 11:27:51 +02:00
Mike Thomsen
461eca0d14 NIFI-5305 If EL evaluation creates an empty string for the database or collection names, it raises a ProcessException which triggers failure behavior. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2891.
 2018-07-18 11:07:31 +02:00
Pierre Villard
d126743d93 NIFI-5437 - Yield in ExecuteScript when catching ScriptException 
This closes #2903

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-07-17 19:58:33 -04:00
Koji Kawamura
8b9d446118 NIFI-54096: Consolidating new model into existing List processors. 
Adding followings:

- Use separate DistributedMapCache for tracking entities to avoid
conflict with existing code
- Added more validation
- Delete listed entities from cache if reset is needed
- Support Local scope
- Added Initial Listing Target

This closes #2876.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-07-17 13:59:57 -04:00
Otto Fowler
0a493bf7fd
NIFI-5432 Add Syslog Record Reader legacy Syslog 
- Add additional details for schema

This closes #2900.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-07-17 13:40:47 -04:00
Otto Fowler
b10220439c
NIFI-5337 Syslog 5424 Record Reader and nifi-syslog-utils 
- Create nifi-syslog-utils to move syslog parsing functionalty to a central location shared by the processors and serialization/record system.
- Refactor Processors to use these utils
- Update 5424 syslog classes using simple-syslog-5424 to pick up new changes to support this work, as well as keep dependencies/types from bleeding out to the
processors or readers
- Refactor Syslog5424Event and Parser
- Create Syslog5424RecordReader
- per review, handle blank message differently from eof
- name schema per review

This closes #2816.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-07-16 11:50:55 -04:00
Damian Czaja
ec7f131602
NIFI-4889: Logout not working properly with OIDC 
- Redirect user agent to end session endpoint on the OIDC provider
- This closes #2830
 2018-07-16 10:14:31 -04:00
Marco Gaido
31bb89514c NIFI-5426: Use NIO.2 API for ListFile 2018-07-13 13:54:27 -04:00
Andy LoPresto
ffbff42421 NIFI-5415 Renamed ListenSyslogGroovyTest to ITListenSyslogGroovy. 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2883
 2018-07-13 09:57:50 -04:00
patricker
0dd4a91a67 NIFI-5312 QueryDatabaseTable updates state when an SQLException is thrown 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2868
 2018-07-10 19:03:14 -04:00
patricker
e13602f752 NIFI-4279 PutDatabaseRecord and ConvertJSONToSQL stream has already been closed error on Oracle 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2874
 2018-07-10 15:30:07 -04:00
patricker
624bbab8f0 NIFI-5382 ConvertRecord Add Option To Drop 0 Record Files 
NIFI-5382 ConvertRecord Add Option To Drop 0 Record Files

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2853
 2018-07-10 12:56:53 -04:00
Koji Kawamura
e94f0757db
NIFI-4654: Support reporting RAS S2S lineage to Atlas 
- Added 's2s.port.id' FlowFile attribute to track target remote Port id
- Use 's2s.port.id' to analyze RAW S2S provenance events
- This closes #2863
 2018-07-10 11:44:00 -04:00
Mark Bean
b279624398 NIFI-5368 controller services validated prior to enabling; referenced controller services must be enabled for referencing component to be valid (mock framework) 
This closes #2873.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-07-10 11:23:40 -04:00
Mark Payne
35bfc93901
NIFI-5377: Addressed issue of infinite recursion when enabling/disabling controller services if there is a recursive loop (i.e., Service A references Service B references Service A). This closes #2847 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2018-07-10 09:57:13 -04:00
Mark Bean
0d07bc4951
NIFI-5377 prevent infinite loop if a controller service circular reference exists 2018-07-10 09:57:13 -04:00
Andy LoPresto
3ef8b4ab8d NIFI-5370 removed custom hostname verifier implementation from OkHttpReplicationClient (default handles wildcard certs). 
This closes #2869.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-07-10 08:45:33 -04:00