Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,826 Commits 147 Branches 203 Tags 406 MiB
Commit Graph

329 Commits

Author SHA1 Message Date
Byunghwa Yun 28acb07433 NIFI-2811 JdbcCommon doesn't convert bigint(20) column. 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1053
 2016-09-27 10:18:48 -04:00
Byunghwa Yun 8868235993 NIFI-2803 The pagination of GenerateTableFetch has a sort bug. 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2803: Updated unit tests for GenerateTableFetch

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1052
 2016-09-26 12:05:16 -04:00
Andre F de Miranda 446cd44702 NIFI-2816 - Clean typos across the code 
This closes #1057.
 2016-09-26 17:47:31 +02:00
Pierre Villard 44d4b882bf NIFI-2071 - Support repeating capture groups in ExtractText 
This closes #1050.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-09-26 17:22:21 +09:00
Mike Moser 5a3d00c7bb NIFI-2636 resolve thread safety problem in UnpackContent 
Signed-off-by: Joe Skora <jskora@apache.org>
 2016-09-23 13:25:03 -04:00
Bartosz Wozniak f11682202b NIFI-1893 Add processor for validating JSON 
This closes #1037.
 2016-09-22 13:08:34 +02:00
Byunghwa Yun 77f8503e98 NIFI-2802 The implementation classes don't support orderByClause. 
This closes #1044.
 2016-09-22 12:21:43 +02:00
Nicolas Dupont be83c0c5b2 NIFI-1844 - Added ListFTP and FetchFTP processors 
This closes #881.
 2016-09-21 17:40:38 +02:00
Peter Wicks 938c7cccb8 NIFI-2749 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #997
 2016-09-21 11:16:57 -04:00
Pierre Villard 930e95aa00 NIFI-1170 - Improved TailFile processor to support multiple files tailing 
This closes #980
 2016-09-21 10:05:39 -04:00
Matt Burgess 68291636cb
NIFI-1841: Fixed support for CLOB/BLOB types 
This closes #1035.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-20 15:33:06 -04:00
Pierre Villard d838f61291 NIFI-1942 Processor to validate CSV against user-supplied schema 
This closes #476

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-09-16 11:13:07 -04:00
Andy LoPresto 022f5a506d NIFI-2266 Refactored GetHTTP processor to use SSLContext protocol vs. hard-coded TLSv1. 
This closes #999.
 2016-09-16 00:08:08 +02:00
Pierre Villard c1ad913598 NIFI-1342 Added default User-Agent in PostHttp 
This closes #1021
 2016-09-15 09:57:09 -04:00
Joe Skora c72a9aa54b NIFI-2752 Correct ReplaceText default pattern and unit tests 
* Corrected the DEFAULT_REGEX pattern.
 * Added tests to isolate regex capture group problem and verify corrected functionality.
 * Removed short circuit logic that masked configuration errors and created inconsistent processor behavior.

This closes #1007.
 2016-09-13 22:55:55 +02:00
Matt Burgess d325773760 NIFI-2262: Added Avro-normalization of table/column names in SQL processors 
This closes #994.
 2016-09-13 15:46:33 +02:00
Kirk Tarou e25885650a NIFI-2440 - Add 'file.lastModifiedTime' attribute to ListSFTP processor 
Added 'file.lastModifiedTime' attribute to ListFileTransfer, which is
the abstract class extended by ListSFTP.
String literal attribute names were replaced with static references to
attribute name constants in ListFile.
ListFileTransfer stores the 'file.lastModifiedTime' attribute in the
format specified in ListFile.FILE_MODIFY_DATE_ATTR_FORMAT

Updated WritesAttribute description for file last modify time attribute
to mirror the entry in ListFile

Signed-off-by: Joe Skora <jskora@gmail.com>

This closes #931.
 2016-09-09 22:44:23 -04:00
Matt Burgess 2afc739ab7 NIFI-2712: Fixed Fetch processors for multiple max-value columns. This closes #976 2016-09-06 16:52:40 -04:00
Andy LoPresto 8556777bf6
NIFI-2618 Reverted merging PR 955 to master as 1.0.0 requires Java 8. 2016-08-30 09:27:24 -07:00
Andy LoPresto d600b065bb
NIFI-2618 Added logic to unit test to handle default TLS version for Java <= 7. 
This closes #955.
 2016-08-30 08:25:38 -07:00
Joseph Percivall 1fe18a1567 NIFI-2676-rc1 prepare for next development iteration 2016-08-26 11:40:58 -04:00
Joseph Percivall 74d5224783 NIFI-2676-rc1 prepare release nifi-1.0.0-RC1 2016-08-26 11:40:44 -04:00
Bryan Rosander 102a9a2b74 NIFI-2674 - Always adding flow files to result set flowfiles, catching runtime exceptions while converting to avro 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #953
 2016-08-25 21:16:26 -04:00
Matt Burgess ad7808f63d NIFI-2641: This closes #928. Add max values as attributes to QueryDatabaseTable 2016-08-25 14:13:55 -04:00
Peter Wicks e210172d93 PutSQLBinary 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2591

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2591

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2591 - Added Format option for binary data types. Updated unit tests.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #883
 2016-08-25 08:41:23 -04:00
Matt Burgess ee9bd94082 NIFI-2632: Added fragment attributes to SplitJson and SplitXml 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #919
 2016-08-23 16:30:57 -04:00
Jeff Storck dca3764ed1 NIFI-2626 Fixes jetty server thread leak. This closes #910 2016-08-22 15:58:06 -04:00
Joe Gresock 17dec04939 NIFI-2611: Fixing bugs in UnpackContent with flow file unpackers 
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #905
 2016-08-22 14:47:24 -04:00
Joe Skora a2d3d0c289 Update to support offsets larger than 2 gigabyte. 2016-08-22 11:02:48 -04:00
Joe Skora 02071103d0 * Add "Remove All Content" property, related functionality, and tests to ModifyBytes processor to allow deletion of all flow file content. 
* Removed @Ignore annotation on class and unnecessary EOL translation of test data.  Because ModifyBytes treat input as binary data, not text, line endings don't matter as long as they byte offsets are calculated correctly.
* Replace validator with .allowableValues.

This closes #890.
 2016-08-19 20:05:14 +02:00
Mark Payne 567535c3d0 NIFI-2382: Fixed typo in documentation 2016-08-18 09:15:55 -04:00
Mark Payne 91a59a8a5a NIFI-2545: Ensure that when @OnUnscheduled and @OnStopped methods are called that the active thread count takes that thread into account 
This closes #836.
 2016-08-18 08:33:45 -04:00
Peter Wicks 7bc7b7f683
NIFI-2584 Fixing date format in PutSQL 
This closes #878.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-17 16:10:56 -04:00
Peter Wicks a0d1aae603 NIFI-2583 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2582

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2582

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #877
 2016-08-17 13:20:44 -04:00
Peter Wicks 1470a52b1b NIFI-2582 NIFI-2583 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2583 Tweaks

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #877
 2016-08-17 13:19:56 -04:00
Peter Wicks b22500d0a3
NIFI-2576 Allowing PutSQL to use timestamps in epoch or string format 
This closes #869.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-16 10:26:24 -04:00
Mark Payne 6af768d0a1 NIFI-2551: Addressed a threading issue in the StandardResourceClaimManager and performed some refactoring so that we can ensure thread-safety across different components of the application, such as ProcessSession and WriteAheadFlowFile Repository when interacting with the StandardResourceClaimManager. Update DebugFlow to allow it to write to a FlowFile multiple times, which exposes the concurrency bug. Also avoided calling ContentRepository.remove() from ProcessSession whenever the content is no longer needed, as that can cause problems now that the Resource Claim is backing the content claim. 2016-08-15 17:02:15 -04:00
Peter Wicks 44057f097a
NIFI-2356 ConvertJSONToSQL assumes IS_AUTOINCREMENT 
This closes #862.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-15 14:17:16 -04:00
Matt Burgess d544274881
NIFI-2531: Fixed JdbcCommon handling of BigInteger objects for Avro 
This closes #823.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-10 15:19:34 -04:00
Joey Frazee bb24312709 NIFI-2142 Added Guava cache for XSLT stylesheets in TransformXml 
This closes #609

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-10 11:13:30 -04:00
Matt Burgess 557d6365bf NIFI-2518: Added unit test showing issue 
NIFI-2518: Added support for fractional seconds to AbstractDatabaseFetchProcessor

This closes #821
 2016-08-10 11:10:17 -04:00
Kirk Tarou e2f649cfea NIFI-2470 This closes #802. 
Fixed WritesAttributes section to include all attributes with the
correct attribute names and descriptions
 2016-08-07 23:58:09 -04:00
joewitt 6bcc415eb8 NIFI-2457 removed old state file mechanism and fixed state reset logic 
This closes #768.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-02 12:11:43 -04:00
joewitt 05a99a93cb NIFI-2208 This closes #754. refactored as per comments on JIRA. Reduced API expsosure and tightened lifecycle management. 2016-08-01 14:17:26 -04:00
Yolanda M. Davis 8412d2662a NIFI-2208 - initial commit Custom Property Expression Language support with Variable Registry, includes bug fix for NIFI-2057 
This closes #529

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-29 17:10:20 -04:00
Yolanda M. Davis 35c0e1436e NIFI-2310 - upgraded jolt to 0.0.21 to resolve special character issue 
This closes #674

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-07-21 10:35:42 +09:00
Matt Burgess f1ba240326 NIFI-2156: Add ListDatabaseTables processor 
This closes #642

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-19 13:00:43 -04:00
Matt Burgess 01cae23745 NIFI-2157: Add GenerateTableFetch processor 
This closes #645

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-17 17:54:42 -04:00
Koji Kawamura e89ee11199 NIFI-619: Make MonitorActivity more cluster friendly 
With this commit, MonitorActivity can be configured as:

- Monitor activity per node individually
- Monitor cluster wide activity
  - Send notification flow-file from all of nodes
  - or only from a primary node

Changes:
- Added 'Monitoring Scope' property
- Added 'Reporting Node' property
- Falls back from cluster scope to node scope if necessary
- Persist the latest activity as Cluster state
- Examine cluster state on each node if necessary
- Only update the cluster state if current timestamp is later than existing
  timestamp stored in Zookeeper

This closes #575

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 12:47:37 -04:00
Yolanda M. Davis 048ba5366c NIFI-2020 - initial commit for custom transformation support 
NIFI-2020 - updates to use lambdas/stream wherever possible and fix potential nullpointer issue.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #564
 2016-07-14 18:04:14 -04:00