Apache/nifi
1
0
Fork 0
mirror of https://github.com/apache/nifi.git synced 2025-02-09 11:35:05 +00:00
Code Issues Packages Projects Releases Wiki Activity
5,038 Commits 147 Branches 203 Tags
Commit Graph

855 Commits

Author SHA1 Message Date
Otto Fowler
61fe493786 NIFI-5170 Upgrad Grok to version 0.1.9 
This closes #2691

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-05-13 08:40:20 -04:00
Gardella Juan Pablo
64356e0014 NIFI-5049 Fix handling of Phonenix datetime columns 
This closes #2625

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-05-11 09:51:24 -04:00
Matthew Burgess
099bfcdf3a NIFI-5121: Added DBCPService API method for passing in flow file attributes when available 
This closes #2658

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-05-11 08:19:16 -04:00
patricker
0a44bad76e NIFI-5168 - ReplaceText Processor Should Use Single FlowFile Processing Instead of Batch 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2687.
 2018-05-09 18:46:35 +02:00
Koji Kawamura
2007c207ab NIFI-4393: Handle database specific identifier escape characters 
QueryDatabaseTable and GenerateTableFetch processors were not able to
use max value state as expected, if max value column was wrapped with
escape characters. Due to a mis-match between computed state keys
and actual keys used in the managed state. State keys computed by
getStateKey method included escape characters while actual stored keys
did not. Resulted querying the same dataset again and again.

This commit added unwrapIdentifier method to DatabaseAdapter class to
remove database specific escape characters for identifiers such as table
and column names, so that max value state keys are populated correctly
even if identifiers are wrapped with escape characters.

This commit also added new DatabaseAdapter for MySQL, to handle MySQL
specific identifier escape with back-ticks.

This closes #2424

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-05-03 09:06:05 -04:00
Koji Kawamura
6e8b1c8f74 NIFI-5090: Create move target dir dynamically at FetchFTP and FetchSFTP 
Support creating target parent directories even if directory listing is disabled.

fixed typo in doc

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2642
 2018-04-27 11:48:26 -04:00
joewitt
ac9944ccee
NIFI-5108 Updated all explicit refs and media nar usage of commons-compress to latest version and updated spring redis client 
This closes #2651.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-04-24 15:16:04 -04:00
patricker
0390c0f196 NIFI-4561 ExecuteSQL returns no FlowFile for some queries 
This closes #2243

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-04-24 10:27:44 -04:00
Matthew Burgess
ba32879ec8 NIFI-5082: Added support for custom Oracle timestamp types to Avro conversion 
This closes #2638

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
 2018-04-22 19:59:48 -04:00
Joe Percivall
a0c9bebe24 NIFI-5085 In InvokeHttp, moving the OkHttp Response object to a try with resources 2018-04-18 13:18:30 -04:00
patricker
82ac815536 NIFI-1706: Extend QueryDatabaseTable to support arbitrary queries 
- Only include Maximum Value columns in the type map.
- Squashed commits in the previous PR
- Rebased against the latest master
- Added stop method to GenerateTableFetch so that it refreshes the
column type map when it gets restarted
- Fixed whitespacing around if/for statement
- Updated expressionLanguageSupported value since it is not auto-merged
correctly

This closes #2618.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-04-13 16:30:13 +09:00
joewitt
59f625d3c2 Merge branch 'NIFI-4995-RC3' as part of NiFi 1.6.0 release process 2018-04-06 16:48:08 -07:00
Vi On
b414132324 NIFI-5050 update frontend-maven-plugin 
This closes #2613

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
 2018-04-06 16:07:25 -04:00
Pierre Villard
4c787799ff NIFI-4149 - Indicate if EL is evaluated against FFs or not 
- take into account input requirement for documentation rendering
- Renamed variable registry scope and added comments
- Doc + change in mock framework to check scope + update of components + UI
 2018-04-06 12:40:54 -04:00
Marco Gaido
c119547222 NIFI-5043: TailFile in Multifile mode should not open new readers in onTrigger 
This closes #2606.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-04-05 13:53:01 -04:00
joewitt
d511fe3e4b NIFI-4995-RC3 prepare for next development iteration 2018-04-03 08:28:34 -07:00
joewitt
f8466cb16d NIFI-4995-RC3 prepare release nifi-1.6.0-RC3 2018-04-03 08:28:15 -07:00
Mark Bean
c59b6fdf66 NIFI-4658 set Maximum Number of Entries to required and allow FlowFiles having fragment.count greater than Max Entries property 
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #2559
 2018-04-02 20:42:04 -04:00
Mark Payne
94d444abb0 NIFI-4883: Updated ValidateRecord to allow an optional Record Writer to be configured for invalid records that differs from the Record Writer used for writing valid records 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2600.
 2018-04-02 18:16:40 +02:00
Mark Payne
bbbe428e7b NIFI-5030: If ControlRate encounters a FlowFile that cannot be transferred, it should continue processing other FlowFiles that have different group attribute values 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2593.
 2018-03-29 10:31:15 +02:00
Scott Aslan
c1459825bb
[NIFI-4998] update node and npm version 
This closes #2571
 2018-03-28 16:49:32 -04:00
Mark Payne
f394c874e1
NIFI-4895: Added backend code to give users the ability to forcibly terminate a processor if the processor does not complete after clicking Stop 
NIFI-4895: Addressed review feedback; addressed checkstyle issues
This closes #2555
 2018-03-28 12:02:47 -04:00
joewitt
7b5bf265a6 NIFI-4995 updating copyright year on all notices 2018-03-26 21:54:10 -04:00
Joe Percivall
56ad14ad1e
NIFI-4977 Adding expression language support to the Sender properties of PutSyslog 
This closes #2547.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-03-26 15:49:52 -04:00
Matt Gilman
69a564e4c8
NIFI-5009: 
- Fixing required permission for PutParquet.

NIFI-5008:
- Ensuring all restricted components are tagged as such.

This closes #2583.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-03-26 09:47:54 -04:00
Otto Fowler
98c295dfc7
NIFI-5013 create test jar for standard processors 
remove unnec TestServer instances

This closes #2580.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2018-03-24 10:18:46 -04:00
Marco Gaido
758e44682f NIFI-4631: Use java.nio.file.Files in ListFile to improve performance 
This closes #2565.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-23 11:00:21 -04:00
sbouchex
9c9215982f NIFI-4999: Added request URI into the "restlistener.request.uri" attribute 
This closes #2574.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-21 13:17:17 -04:00
Andy LoPresto
d09145e3e3 NIFI-4557 Added Expression Language support for PGP private keyring passphrase in EncryptContent. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2566.
 2018-03-20 11:23:45 +01:00
Derek Straka
5bdb7cf6e7 NIFI-4912: This closes #2494. Update jackson version to latest stable version (2.9.4) 
Signed-off-by: joewitt <joewitt@apache.org>
 2018-03-19 10:22:50 -04:00
Pierre Villard
4687e0fb35 NIFI-4981 Allow using FF's content as message in PutEmail 
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #2556.
 2018-03-18 11:35:43 -07:00
Mark Bean
8b2c5b7246 NIFI-4950 Defining behavior for MergeContent when more than 1 FlowFile has the same fragment.index value 
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #2557.
 2018-03-16 18:31:43 +00:00
Marco Gaido
86f162b611 NIFI-4959: Remove flowfiles and close connection for Bad Requests causing IOException 
This closes #2544.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-16 12:24:00 -04:00
Bryan Bende
de71a41bd0 NIFI-4935 Refactoring to support specifying schema branch or schema version when using schema by name strategy 
This closes #2523.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-15 16:16:12 -04:00
Deon Huang
37ad48844a NIFI-4962 FlattenJson processor add unexpected backslash after flatten 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2538.
 2018-03-13 22:33:53 +01:00
Pierre Villard
11a7d5c09f NIFI-4955 - Preserve columns ordering with CSV and ValidateRecord 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2528
 2018-03-13 17:09:07 -04:00
m-hogue
6471f66acd NIFI-3402 - Added etag support to InvokeHTTP 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2150.
 2018-03-13 10:00:11 +01:00
Deon Huang
7aabb99bcc NIFI-4800 Expose the flattenMode as property in FlattenJSON processor 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2530.
 2018-03-13 09:28:22 +01:00
Matt Gilman
b1217f529b NIFI-4885: 
- Introducing more granular restricted component access policies.

This closes #2515.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-12 14:19:42 -04:00
joewitt
c71409fb5d
NIFI-4936 trying to quiet down the mvn output a bit so we dont exceed the travis-ci 4MB max 
NIFI-4936 updated dependency handling pushing down delcarations where they belong
This closes #2512
 2018-03-09 16:34:53 -05:00
Andy LoPresto
e9d585a785
NIFI-4870 Upgraded activemq-client and activemq-broker versions to 5.15.3. 
- Updated copyright dates in NOTICE files.
- This closes #2469.
 2018-03-09 13:59:13 -05:00
Jeff Storck
e916594b69 NIFI-4872 Added annotation for specifying scenarios in which components can cause high usage of system resources. 
- Initial set of components marked with the HighResourceUsageScenario annotation.
- Added customized descriptions to SystemResourceConsideration annotations for MergeContent, SplitContent, SplitJson, SplitText, and SplitXml.

This closes #2475.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-03-05 15:32:23 -05:00
Matthew Burgess
dd58a376c9 NIFI-4773 - Fixed column type map initialization in QueryDatabaseTable 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2504.
 2018-03-02 17:32:14 +01:00
Matthew Burgess
62732cbb88 NIFI-4903 - Fixed timestamp bug with fetch processors using Oracle 12+ 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2488.
 2018-02-22 20:56:30 +01:00
Pierre Villard
ff95be2a11 NIFI-4815 - Add EL support to ExecuteProcess 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2432
 2018-02-21 12:47:33 -05:00
Matthew Burgess
2a5e21c11b NIFI-4836 - Allow output of FlowFiles during result set processing in QueryDatabaseTable 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2447.
 2018-02-17 15:56:05 +01:00
Andy LoPresto
28067a29fd
NIFI-4869 Added SAX utility method for SplitXML processor. 
Added unit tests.
Added test resources to RAT exclude list.
This closes #2466
 2018-02-13 15:29:29 -05:00
Matthew Burgess
b5ca7adbb9 NIFI-978: Support parameterized statements in ExecuteSQL 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2433.
 2018-02-12 20:44:31 +01:00
Matthew Burgess
7d6bbce123 NIFI-4830: Fixed logic errors in BLOB/CLOB processing in JdbcCommon 
This closes #2459.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-02-09 11:45:12 +09:00
Mark Payne
4428fe28bf
NIFI-4858: Expose Request Timeout from HTTP Context Map and use that to set as the timeout of the 'AsyncContext' in HandleHttpRequest. Otherwise, the request will never timeout (which is OK because the HttpContextMap will handle this). However, Jetty behind the scenes is adding a task to Scheduled Executor for each request with a delay of whatever the timeout is set to. Since it's currently set to Long.MAX_VALUE, that task will never be run and as a result the ExecutorService's queue will grow indefinitely, eventually exhausting the JVM Heap 
This closes #2460.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-02-08 17:38:13 -05:00