Commit Graph

403 Commits

Author SHA1 Message Date
Koji Kawamura 095c04eda0 NIFI-3213: ListFile do not skip obviously old files
Before this fix, files with the latest timestamp within a listing
iteration are always be held back one cycle no matter how old it is.

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2017-02-18 00:56:46 +11:00
Koji Kawamura a90fa9c285 NIFI-3431: Support batch update in Notify processor
- Added Signal Counter Delta property
- Added Signal Buffer Count property
- Added processor property name and display name
- Changed IOException handling from routing it to failure to throw
  RuntimeException, so that NiFi framework can yield the processor for a while and try again

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1466.
2017-02-15 15:51:31 +01:00
Pierre Villard 71e2061b5d NIFI-2968 This closes #1377. Improved message when ExecuteSQL hits unsupported SQL types 2017-02-14 23:25:29 -05:00
Pierre Villard 6279fd4184 NIFI-3183 This closes #3183. Added command and arguments as FF attributes in ExecuteProcess processor 2017-02-14 22:08:09 -05:00
Koji Kawamura e46f4131f9 NIFI-3452: Add Wait processor Wait Mode property
Ensure back-pressure is active until downstream processing completes.

This closes #1490.
2017-02-14 19:15:27 +01:00
patricker 9cfc13423d NIFI-3455 Large row count paging
This closes #1499.
2017-02-14 19:09:12 +01:00
Selim Namsi 2ef7c15b5d NIFI-2565: add Grok parser
This closes #1108.

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2017-02-14 21:11:03 +11:00
Yolanda M. Davis 8d082d1aca NIFI-3010 - Incorporate expression language support for jolt-spec for processor and Advance UI. Upgraded jolt library to latest version for support of modify functions. Also refactored to interact with JoltTransform interface and updated styling 2017-02-13 22:16:22 -05:00
Otto Fowler 5cfba6ace3 NIFI-3454: Use FileNameFilter to make test consistent
use the FileNameFilter when not passing down explit jar paths
Filter out ^. files when reading lists of files from directories

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-02-11 08:54:06 +09:00
Pierre Villard 2e1b87fa43 NIFI-3403 - Fix NPE in InvokeHTTP
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #1494
2017-02-10 20:59:18 +00:00
Ryan Persaud ea0f5690cc NIFI-3372 Adding capability for PutSQL to handle BIT fields generated by ConvertJSONToSQL.
This closes #1432.
2017-02-07 17:14:37 +01:00
Nick Carenza 46fa6a167a NIFI-3429 Quoting table identifier behind property
This closes #1464.
2017-02-07 16:48:38 +01:00
Koji Kawamura 9a638cc865 NIFI-1125 InvokeHTTP throws NullPointerException
Added null check in onPropertyModified to avoid NPE.

This closes #1477.
2017-02-07 09:06:43 +01:00
Giovanni Lanzani 3d3faada5c NIFI-3408 Add exception class when InvokeHTTP fails 2017-02-07 09:04:48 +01:00
Giovanni Lanzani 31b943d2c1 NIFI-3408 Add exception class when InvokeHTTP fails
This closes #1467.
2017-02-07 08:51:22 +01:00
Joe Gresock 229b20f395 NIFI-3419: Routing flow files causing ZipException to failure in MergeContent
This closes #1454.
2017-02-06 19:34:49 +01:00
Nick Carenza 6466931c23 NIFI-3430 - added support for specifying sql.arg.N.format for timestamp fields according to java.time.format.DateTimeFormatter
This closes #1468.
2017-02-06 18:32:57 +01:00
Pierre Villard adfaffc773 Updated documentation of ListenHTTP 2017-02-03 22:53:29 +00:00
Matt Burgess 6d4901cd26 NIFI-2881: Added EL support to DB Fetch processors
- Allow incoming flowfiles to GenerateTableFetch
- Incorporated review comments/discussions
- Updated documentation, added error attribute to GenerateTableFetch
- Corrected notes for column properties in fetch processors

This closes #1407.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-02-03 08:51:13 +09:00
Andre F de Miranda ea3c294f94
NIFI-819 - Extend GetHTTP to use dynamically add HTTP headers to a request
This closes #1462.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2017-02-02 09:56:53 -05:00
Oleg Zhurakousky 390754c575 NIFI-3179 Added support for default UTF-8 char encoding
removed deprected usage of BAOS and BAIS

This closes #1452.
2017-01-31 15:33:20 +01:00
Koji Kawamura 7f0171ffa2
NIFI-3216: Add N signals to Wait/Notify
- Support counters at Wait/Notify processors so that NiFi flow can be
  configured to wait for N signals
- Extract Wait/Notify logics into WaitNotifyProtocol
- Added FragmentAttributes to manage commonly used fragment attributes
- Changed existing split processors to set 'fragment.identifier' and
  'fragment.count', so that Wait can use those to wait for all splits
get processed

This closes #1420.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-01-19 15:17:59 -05:00
Jeff Storck def4918af0
NIFI-3330 Replaced two instances of multiple calls to getter methods during request attribute retrieval with a single call saved to a local variable to prevent null pointer exceptions during multiple invocations of a getter method.
This closes #1415.

Signed-off-by: Bryan Rosander <brosander@apache.org>
2017-01-13 18:09:28 -05:00
Joe Skora 4d533a99b3 NIFI-2861 ControlRate should accept more than one flow file per execution
* Support multiple files per onTrigger call.

Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #1412.
2017-01-12 21:43:12 +00:00
Joey Frazee 81aca7b97d NIFI-3302 Remove 'accepts incoming FlowFile' doc from QDT
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1406
2017-01-09 10:40:29 -05:00
Mike Moser 3259b01f8e NIFI-3230 fix ActiveMQ SSL support for simple connect URIs in Get/Put JMS processors
This closes #1344.
2017-01-05 22:19:25 +01:00
Pierre Villard 9b47961d1c
NIFI-3231 Added EL support to hostname and port in PutTCP/UDP
This closes #1361.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-01-03 12:09:19 -05:00
Bryan Rosander 1b4729e448
NIFI-3240 - AttributesToJson performance improvements
This closes #1352.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-01-03 10:20:16 -05:00
Davy De Waele 55f4716f3d NIFI-3266 Added EL support for basePath and port in ListenHTTP
This closes #1373.
2016-12-30 16:35:46 +01:00
Joe Gresock 2ea8b4122b NIFI-3127: Fixing NPE for empty flow files in SplitText
This closes #1358.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-12-28 11:21:44 +09:00
Joe Gresock af8ed8b7de
NIFI-3253: Correcting documentation in Notify processor
This closes #1359.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-12-27 12:19:08 -05:00
Bryan Rosander 44c9ea0a66 NIFI-3236 - SplitJson performance improvements
This closes #1347.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-12-22 15:22:53 +09:00
Bryan Rosander 4285157675
NIFI-3235 - EvaluateJsonPath performance improvements
This closes #1346.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-12-21 16:29:23 -05:00
Joe Gresock 34627f78b7
NIFI-190: Initial commit of Wait and Notify processors
This closes #1329.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-12-16 10:29:16 -05:00
Wesley-Lawrence 9a5986b0f6 NIFI-3175 Fix a bug in the ValidateCSV processor to handle empty CSV columns
This closes #1311.
2016-12-15 22:43:15 +01:00
Byunghwa Yun 0f462a7c49 NIFI-3029: QueryDatabaseTable supports max fragments property
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1213
2016-12-14 10:51:27 -05:00
Byunghwa Yun 2b6d6c25d8 NIFI-2866 The Initial Max Value of QueryDatabaseTable won't be case-sensitive
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1212
2016-12-05 12:50:43 -05:00
Mark Payne 8f8b8cdf46 NIFI-3071: Deprecated InputStreams & OutputStream sin org.apache.nifi.stream.io package in favor of using their Java counterparts 2016-12-05 09:29:19 -05:00
Koji Kawamura 8da38acf31 NIFI-3141: Fixed TailFile ArrayIndexOutOfBounds.
- Added unit test cases to simulate NiFi version update which fails without this fix.
- Added state object migration code, add file.0. prefix to state keys,
  and add length from stored position.

This closes #1289
2016-12-02 07:53:04 -05:00
Matt Burgess ba513447d7
NIFI-3076: Fixed handling of 'medium' unsigned integers in JdbcCommon
This closes #1254.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-11-30 13:05:38 -05:00
joewitt 92f17a995b NIFI-3100-rc2 prepare for next development iteration 2016-11-25 23:49:27 -05:00
joewitt 5536f690a8 NIFI-3100-rc2 prepare release nifi-1.1.0-RC2 2016-11-25 23:49:13 -05:00
Jeff Storck 066accc274 NIFI-3086 Updated TailFile.java to deal with windows paths that were breaking the regex parsing Fixed documentation misspelling in TailFile.java Fixed assertions in several tests in TestTailFile that were dependent on the received order of flowfiles, this was differing between Windows and MacOS/Linux
This closes #1264

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-23 00:01:12 -05:00
Oleg Zhurakousky 913ae91614 Added posix guard to ignore tests on windows
This closes #1259

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-22 17:11:25 -05:00
Kathik Narayanan 9e884f6120 NiFI-3064 Convert to Avro fails when a MySQL query returns two columns with the same name even with different aliases
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1251
2016-11-22 11:49:25 -05:00
joewitt fb9cbccc38 NIFI-2954 This closes #1244. Moved StandardPropertyValidator to nifi-utils, documented scope/purpose of a few util libs, removed deps from nifi-utils. 2016-11-21 16:30:42 -05:00
Matt Gilman 7f5eabd603
NIFI-3050: Implemented access control logic for restricted components.
- Addressing comments from PR.
- Adding restricted tags to relevant components.
- Showing a restricted icon overlay on the processor node on the canvas. (+1 squashed commit)
Squashed commits:
[f487682] NIFI-3050:
- Introducing a Restricted annotation for components that require elevated privileges to use.
- Updating the new Processor, Controller Service, and Reporting Task dialogs to include these details and prevent unauthorized selection.
- Including the Restricted description in the generated component documentation.
- Updating processor access control integration test to verify restricted component creation.
- Updating the developer, user, and admin guide to include the restricted component policy.

This closes #1247.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-11-21 12:07:48 -08:00
Peter Wicks d65f46f7a5 NIFI-2750
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2750

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2750 Tweaking Property Retrieval

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1001
2016-11-21 12:58:17 -05:00
Mark Payne 2ee66de1a6 NIFI-3066: Create unit test to reproduce bug that results in IllegalArgumentException: Cannot migrate FlowFiles from a Process Session to itself
NIFI-3066: Ensure that when a Bin is created, it is always created with its own new session

This closes #1245
2016-11-21 11:34:14 -05:00
James Wing 7206318ecf NIFI-3033 GenerateFlowFile Dynamic Properties
This closes #1222.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-11-18 11:06:20 +09:00