Commit Graph

688 Commits

Author SHA1 Message Date
Mark Bean c59b6fdf66 NIFI-4658 set Maximum Number of Entries to required and allow FlowFiles having fragment.count greater than Max Entries property
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #2559
2018-04-02 20:42:04 -04:00
Mark Payne 94d444abb0 NIFI-4883: Updated ValidateRecord to allow an optional Record Writer to be configured for invalid records that differs from the Record Writer used for writing valid records
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2600.
2018-04-02 18:16:40 +02:00
Mark Payne bbbe428e7b NIFI-5030: If ControlRate encounters a FlowFile that cannot be transferred, it should continue processing other FlowFiles that have different group attribute values
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2593.
2018-03-29 10:31:15 +02:00
Scott Aslan c1459825bb
[NIFI-4998] update node and npm version
This closes #2571
2018-03-28 16:49:32 -04:00
Mark Payne f394c874e1
NIFI-4895: Added backend code to give users the ability to forcibly terminate a processor if the processor does not complete after clicking Stop
NIFI-4895: Addressed review feedback; addressed checkstyle issues
This closes #2555
2018-03-28 12:02:47 -04:00
joewitt 7b5bf265a6 NIFI-4995 updating copyright year on all notices 2018-03-26 21:54:10 -04:00
Joe Percivall 56ad14ad1e
NIFI-4977 Adding expression language support to the Sender properties of PutSyslog
This closes #2547.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-03-26 15:49:52 -04:00
Matt Gilman 69a564e4c8
NIFI-5009:
- Fixing required permission for PutParquet.

NIFI-5008:
- Ensuring all restricted components are tagged as such.

This closes #2583.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-03-26 09:47:54 -04:00
Otto Fowler 98c295dfc7
NIFI-5013 create test jar for standard processors
remove unnec TestServer instances

This closes #2580.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2018-03-24 10:18:46 -04:00
Marco Gaido 758e44682f NIFI-4631: Use java.nio.file.Files in ListFile to improve performance
This closes #2565.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-03-23 11:00:21 -04:00
sbouchex 9c9215982f NIFI-4999: Added request URI into the "restlistener.request.uri" attribute
This closes #2574.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-03-21 13:17:17 -04:00
Andy LoPresto d09145e3e3 NIFI-4557 Added Expression Language support for PGP private keyring passphrase in EncryptContent.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2566.
2018-03-20 11:23:45 +01:00
Derek Straka 5bdb7cf6e7 NIFI-4912: This closes #2494. Update jackson version to latest stable version (2.9.4)
Signed-off-by: joewitt <joewitt@apache.org>
2018-03-19 10:22:50 -04:00
Pierre Villard 4687e0fb35 NIFI-4981 Allow using FF's content as message in PutEmail
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #2556.
2018-03-18 11:35:43 -07:00
Mark Bean 8b2c5b7246 NIFI-4950 Defining behavior for MergeContent when more than 1 FlowFile has the same fragment.index value
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #2557.
2018-03-16 18:31:43 +00:00
Marco Gaido 86f162b611 NIFI-4959: Remove flowfiles and close connection for Bad Requests causing IOException
This closes #2544.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-03-16 12:24:00 -04:00
Bryan Bende de71a41bd0 NIFI-4935 Refactoring to support specifying schema branch or schema version when using schema by name strategy
This closes #2523.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-03-15 16:16:12 -04:00
Deon Huang 37ad48844a NIFI-4962 FlattenJson processor add unexpected backslash after flatten
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2538.
2018-03-13 22:33:53 +01:00
Pierre Villard 11a7d5c09f NIFI-4955 - Preserve columns ordering with CSV and ValidateRecord
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2528
2018-03-13 17:09:07 -04:00
m-hogue 6471f66acd NIFI-3402 - Added etag support to InvokeHTTP
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2150.
2018-03-13 10:00:11 +01:00
Deon Huang 7aabb99bcc NIFI-4800 Expose the flattenMode as property in FlattenJSON processor
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2530.
2018-03-13 09:28:22 +01:00
Matt Gilman b1217f529b NIFI-4885:
- Introducing more granular restricted component access policies.

This closes #2515.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-03-12 14:19:42 -04:00
joewitt c71409fb5d
NIFI-4936 trying to quiet down the mvn output a bit so we dont exceed the travis-ci 4MB max
NIFI-4936 updated dependency handling pushing down delcarations where they belong
This closes #2512
2018-03-09 16:34:53 -05:00
Andy LoPresto e9d585a785
NIFI-4870 Upgraded activemq-client and activemq-broker versions to 5.15.3.
- Updated copyright dates in NOTICE files.
- This closes #2469.
2018-03-09 13:59:13 -05:00
Jeff Storck e916594b69 NIFI-4872 Added annotation for specifying scenarios in which components can cause high usage of system resources.
- Initial set of components marked with the HighResourceUsageScenario annotation.
- Added customized descriptions to SystemResourceConsideration annotations for MergeContent, SplitContent, SplitJson, SplitText, and SplitXml.

This closes #2475.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-03-05 15:32:23 -05:00
Matthew Burgess dd58a376c9 NIFI-4773 - Fixed column type map initialization in QueryDatabaseTable
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2504.
2018-03-02 17:32:14 +01:00
Matthew Burgess 62732cbb88 NIFI-4903 - Fixed timestamp bug with fetch processors using Oracle 12+
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2488.
2018-02-22 20:56:30 +01:00
Pierre Villard ff95be2a11 NIFI-4815 - Add EL support to ExecuteProcess
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2432
2018-02-21 12:47:33 -05:00
Matthew Burgess 2a5e21c11b NIFI-4836 - Allow output of FlowFiles during result set processing in QueryDatabaseTable
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2447.
2018-02-17 15:56:05 +01:00
Andy LoPresto 28067a29fd
NIFI-4869 Added SAX utility method for SplitXML processor.
Added unit tests.
Added test resources to RAT exclude list.
This closes #2466
2018-02-13 15:29:29 -05:00
Matthew Burgess b5ca7adbb9 NIFI-978: Support parameterized statements in ExecuteSQL
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2433.
2018-02-12 20:44:31 +01:00
Matthew Burgess 7d6bbce123 NIFI-4830: Fixed logic errors in BLOB/CLOB processing in JdbcCommon
This closes #2459.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-02-09 11:45:12 +09:00
Mark Payne 4428fe28bf
NIFI-4858: Expose Request Timeout from HTTP Context Map and use that to set as the timeout of the 'AsyncContext' in HandleHttpRequest. Otherwise, the request will never timeout (which is OK because the HttpContextMap will handle this). However, Jetty behind the scenes is adding a task to Scheduled Executor for each request with a delay of whatever the timeout is set to. Since it's currently set to Long.MAX_VALUE, that task will never be run and as a result the ExecutorService's queue will grow indefinitely, eventually exhausting the JVM Heap
This closes #2460.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-02-08 17:38:13 -05:00
Mike Moser a2f2ddd6b8 NIFI-4699 Use a filter in PostHTTP to pull flowfiles from queue whose URL is the same
This closes #2412.
2018-02-08 18:36:11 +00:00
Matthew Burgess 16e56ccfca NIFI-4080: Restored customValidate in ValidateCSV for schema property with no EL
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2226.
2018-02-08 11:56:56 +01:00
Marco Gaido ba192d22da enable EL on FF level 2018-02-08 11:56:49 +01:00
Matthew Burgess 836c324258 NIFI-4080: Added EL support to fields in ValidateCSV 2018-02-08 11:56:42 +01:00
Matt Gilman f3013d0764
NIFI-4837:
- When Jetty initializes fails, performing a shutdown sequence to ensure all allocated resources are released.

This closes #2455.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-02-07 16:40:23 -05:00
Koji Kawamura e9af6c6ad8 NIFI-4828: Fix MergeContent to process all ready bins
Before this fix, MergeContent only processed the first bin even if there
were multiple bins.

There were two unit tests marked with Ignore those had been
failing because of this.

This closes #2444.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-02-07 15:45:39 -05:00
Koji Kawamura dbbf78f22c
NIFI-4848: Update HttpComponents version
- httpclient 4.5.3 -> 4.5.5
- httpcore 4.4.4 -> 4.4.9
  - ThreadSafe annotation is removed since 4.4.5, HTTPCLIENT-1743.
    Removed the annotation from DebugFlow processor.
- httpasyncclient 4.1.2 -> 4.1.3
- This closes #2453
2018-02-07 08:55:43 -05:00
Deon Huang b5938062a8 NIFI-4395 GenerateTableFetch can't fetch column type by state after instance reboot
Add multiple states recover

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2442
2018-02-02 11:15:46 -05:00
Marco Gaido 37271e8241 NIFI-4790 - support HTTPS Proxy in InvokeHTTP
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2426.
2018-01-24 17:51:28 +01:00
Matthew Burgess 84848f7cbb NIFI-4773: Moved DB Fetch processors' connection code from setup to onTrigger
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2422.
2018-01-23 15:10:34 +01:00
Mark Payne 6f282c6843
NIFI-4803: Ensure that we set the FileCountAttribute of BinManager to the proper value, regardless of the merge strategy
This closes #2423.

Signed-off-by: Bryan Bende <bbende@apache.org>
2018-01-22 15:37:31 -05:00
joewitt 41ce788812 NIFI-4751 changed to next minor release version snapshot 2018-01-12 15:15:32 -05:00
joewitt 36405e888c NIFI-4751-RC1 prepare for next development iteration 2018-01-08 23:39:49 -07:00
joewitt 46d30c7e92 NIFI-4751-RC1 prepare release nifi-1.5.0-RC1 2018-01-08 23:39:32 -07:00
Mike Moser 6e7544bd37 NIFI-4697 This closes #2381. clarified some PostHTTP documentation
Signed-off-by: joewitt <joewitt@apache.org>
2018-01-08 21:47:27 -07:00
Mark Payne 953e922d32 NIFI-4749: This closes #2386. Pass the record reader's schema along to the ResultSetRecordSet so that it is able to resolve the schema for Record fields
Signed-off-by: joewitt <joewitt@apache.org>
2018-01-08 19:47:18 -07:00
Andy LoPresto a7f1eb89c2
NIFI-4727 Added CountText processor and unit test.
This closes #2371.

Signed-off-by: Kevin Doran <kdoran.apache@gmail.org>
2018-01-08 14:26:14 -08:00