Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,903 Commits 143 Branches 197 Tags 391 MiB
Commit Graph

604 Commits

Author SHA1 Message Date
Mike Moser 3259b01f8e NIFI-3230 fix ActiveMQ SSL support for simple connect URIs in Get/Put JMS processors 
This closes #1344.
 2017-01-05 22:19:25 +01:00
Pierre Villard 9b47961d1c
NIFI-3231 Added EL support to hostname and port in PutTCP/UDP 
This closes #1361.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-01-03 12:09:19 -05:00
Bryan Rosander 1b4729e448
NIFI-3240 - AttributesToJson performance improvements 
This closes #1352.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-01-03 10:20:16 -05:00
Davy De Waele 55f4716f3d NIFI-3266 Added EL support for basePath and port in ListenHTTP 
This closes #1373.
 2016-12-30 16:35:46 +01:00
Joe Gresock 2ea8b4122b NIFI-3127: Fixing NPE for empty flow files in SplitText 
This closes #1358.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-12-28 11:21:44 +09:00
Joe Gresock af8ed8b7de
NIFI-3253: Correcting documentation in Notify processor 
This closes #1359.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-12-27 12:19:08 -05:00
Bryan Rosander 44c9ea0a66 NIFI-3236 - SplitJson performance improvements 
This closes #1347.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-12-22 15:22:53 +09:00
Bryan Rosander 4285157675
NIFI-3235 - EvaluateJsonPath performance improvements 
This closes #1346.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-12-21 16:29:23 -05:00
Joe Gresock 34627f78b7
NIFI-190: Initial commit of Wait and Notify processors 
This closes #1329.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-12-16 10:29:16 -05:00
Wesley-Lawrence 9a5986b0f6 NIFI-3175 Fix a bug in the ValidateCSV processor to handle empty CSV columns 
This closes #1311.
 2016-12-15 22:43:15 +01:00
Byunghwa Yun 0f462a7c49 NIFI-3029: QueryDatabaseTable supports max fragments property 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1213
 2016-12-14 10:51:27 -05:00
Byunghwa Yun 2b6d6c25d8 NIFI-2866 The Initial Max Value of QueryDatabaseTable won't be case-sensitive 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1212
 2016-12-05 12:50:43 -05:00
Mark Payne 8f8b8cdf46 NIFI-3071: Deprecated InputStreams & OutputStream sin org.apache.nifi.stream.io package in favor of using their Java counterparts 2016-12-05 09:29:19 -05:00
Koji Kawamura 8da38acf31 NIFI-3141: Fixed TailFile ArrayIndexOutOfBounds. 
- Added unit test cases to simulate NiFi version update which fails without this fix.
- Added state object migration code, add file.0. prefix to state keys,
  and add length from stored position.

This closes #1289
 2016-12-02 07:53:04 -05:00
Matt Burgess ba513447d7
NIFI-3076: Fixed handling of 'medium' unsigned integers in JdbcCommon 
This closes #1254.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-11-30 13:05:38 -05:00
joewitt 92f17a995b NIFI-3100-rc2 prepare for next development iteration 2016-11-25 23:49:27 -05:00
joewitt 5536f690a8 NIFI-3100-rc2 prepare release nifi-1.1.0-RC2 2016-11-25 23:49:13 -05:00
Jeff Storck 066accc274 NIFI-3086 Updated TailFile.java to deal with windows paths that were breaking the regex parsing Fixed documentation misspelling in TailFile.java Fixed assertions in several tests in TestTailFile that were dependent on the received order of flowfiles, this was differing between Windows and MacOS/Linux 
This closes #1264

Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-23 00:01:12 -05:00
Oleg Zhurakousky 913ae91614 Added posix guard to ignore tests on windows 
This closes #1259

Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-22 17:11:25 -05:00
Kathik Narayanan 9e884f6120 NiFI-3064 Convert to Avro fails when a MySQL query returns two columns with the same name even with different aliases 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1251
 2016-11-22 11:49:25 -05:00
joewitt fb9cbccc38 NIFI-2954 This closes #1244. Moved StandardPropertyValidator to nifi-utils, documented scope/purpose of a few util libs, removed deps from nifi-utils. 2016-11-21 16:30:42 -05:00
Matt Gilman 7f5eabd603
NIFI-3050: Implemented access control logic for restricted components. 
- Addressing comments from PR.
- Adding restricted tags to relevant components.
- Showing a restricted icon overlay on the processor node on the canvas. (+1 squashed commit)
Squashed commits:
[f487682] NIFI-3050:
- Introducing a Restricted annotation for components that require elevated privileges to use.
- Updating the new Processor, Controller Service, and Reporting Task dialogs to include these details and prevent unauthorized selection.
- Including the Restricted description in the generated component documentation.
- Updating processor access control integration test to verify restricted component creation.
- Updating the developer, user, and admin guide to include the restricted component policy.

This closes #1247.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-11-21 12:07:48 -08:00
Peter Wicks d65f46f7a5 NIFI-2750 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2750

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2750 Tweaking Property Retrieval

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1001
 2016-11-21 12:58:17 -05:00
Mark Payne 2ee66de1a6 NIFI-3066: Create unit test to reproduce bug that results in IllegalArgumentException: Cannot migrate FlowFiles from a Process Session to itself 
NIFI-3066: Ensure that when a Bin is created, it is always created with its own new session

This closes #1245
 2016-11-21 11:34:14 -05:00
James Wing 7206318ecf NIFI-3033 GenerateFlowFile Dynamic Properties 
This closes #1222.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-11-18 11:06:20 +09:00
Bryan Rosander e5eda63705
NIFI-2943 - Toolkit uses JKS type over PKCS12 when creating truststore because non-Bouncy Castle providers cannot read certificates from PKCS12 truststore. 
Peer review feedback (+2 squashed commits)
Squashed commits:
[0102c8e] NIFI-2943 - Peer review feedback
[9bcd495] NIFI-2943 - pkcs12 keystore improvements

1. loading pkcs12 keystores with bouncy castle everywhere
2. tls-toolkit client using jks truststore when keystore type is specified differently
3. tests

This closes #1165.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-11-16 17:13:10 -08:00
joewitt 45a5f5295c NIFI-2374 This closes #712. updated to latest tika versions where possible, updated doc, commented why cannot update media nar 2016-11-15 23:18:55 -05:00
Andre F de Miranda 3e571f9f1f NIFI-2374 - Adjust documentation wording to clarify IdentifyMimeType 
is a non exhaustive list of mime type values
 2016-11-15 22:42:21 -05:00
joewitt 6696529c99 Revert "NIFI-1893 Add processor for validating JSON" 
This reverts commit f11682202b.

Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-15 18:09:14 -05:00
joewitt 1c9077334f NIFI-2991 removed usage of json lib and components still using it 
Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-15 18:09:09 -05:00
Oleg Zhurakousky 41f519e84c NIFI-2851 initial commit of perf improvements on SplitText 
- introduced org.apache.nifi.stream.io.util.TextLineDemarcator
- refactored SplitText to use org.apache.nifi.stream.io.util.TextLineDemarcator
- updated SplitText's capability discription to provide more clarity around splits with headers.
 2016-11-11 15:45:40 -05:00
Byunghwa Yun 91f0170416 NIFI-3027: ExecuteProcess supports the expression language 2016-11-11 14:41:35 -05:00
Pierre Villard 06f191ca10
NIFI-2912 Allow custom text in GenerateFlowFile 
This closes #1206.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-11-11 10:18:43 -08:00
Mark Payne c441a8696d NIFI-2850 This closes #1115. Added a migrate() method to ProcessSession and refactored BinFiles and MergeContent to use it 2016-11-09 16:25:03 -05:00
Jeff Storck cc2fbcaac4 NIFI-3008 Enabled expression language on BASE_DIRECTORY and FILENAME properties in TailFile 
This closes #1190
 2016-11-09 12:11:11 -05:00
patricker 4b4e099f2e NIFI-2764 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2764: Updated call to convertToAvroStream in TestJdbcCommon

This closes #1009
 2016-11-08 14:45:49 -05:00
Bryan Bende d1d053725b NIFI-2909 Adding per-instance class loading capability through @RequiresInstanceClassLoading annotation 
NIFI-1712 Applying per-instance class loading to HBaseClientService to allow specifying Phoenix Client JAR

-Refactoring the ClassLoading so that every processor, controller service, and reporting task gets an InstanceClassLoader with a parent of the NAR ClassLoader, and only components with @RequiresInstanceClassLoading will make a copy of the NAR ClassLoader resources, and addressing some review feedback

This closes #1156
 2016-11-08 13:21:27 -05:00
Matt Burgess 0841f14c18
NIFI-2928: Fixed checkstyle violation in FetchFile 
This closes #1180

Signed-off-by: Bryan Rosander <brosander@apache.org>
 2016-11-03 14:46:10 -04:00
Oleg Zhurakousky ed035f85e3 NIFI-2928 added support to validate accessibility of the file system 
NIFI-2928 polishing

This closes #1160
 2016-11-03 12:25:31 -04:00
patricker 2fb3b01ebe NIFI-2918 JDBC getColumnName may return empty string 
This closes #1149
 2016-11-02 13:13:34 -04:00
Matt Burgess 892c74dff2 NIFI-2819: Added support for Expresssion Language in ModifyBytes 
This closes #1130
 2016-11-02 13:02:25 -04:00
Koji Kawamura 9e90aae066 NIFI-2936: Fix TestExecuteProcess error on Travis. 
This closes #1162.
 2016-10-28 10:35:37 +02:00
Andre F de Miranda b864d49f66 NIFI-2341 - Introduce ParseCEF processor 
This closes #785
 2016-10-20 17:16:57 -04:00
Oleg Zhurakousky 611cadd231
NIFI-2919 Improved GetFile processor to fail (and provide bulletins) if target directory is inaccessible. 
This closes #1147.

Signed-off-by: Andy LoPresto <alopresto@apache.org>

Fixed typos in error messages, renamed variables in test, and cleaned up unnecessary imports. (+1 squashed commit)
Squashed commits:
[e755cbd] NIFI-2919 improved GetFile to fail if target directory is inaccessible
 2016-10-19 16:33:33 -04:00
Koji Kawamura 27dba60f27
NIFI-2905: Log error stream of ExecuteProcess cmd 
ExecuteProcess ignores error stream when Redirect Error Stream is
false, this commit let it to be logged instead so that user can see it on
bulletin.

This closes #1143.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-10-18 15:56:27 -07:00
Oleg Zhurakousky 5afbc43364 NIFI-2500 This closes #1131. made container queue configurable 2016-10-18 14:47:49 -04:00
Oleg Zhurakousky c883f98cbf NIFI-2906 removed unused memebr variables 
This closes #1144.
 2016-10-17 22:32:23 +02:00
Matt Burgess 596b98865b NIFI-2894: Fixed typo in PutSQL documentation 
This closes #1129
 2016-10-14 12:45:34 -04:00
Pierre Villard 3c8545a902 NIFI-1912 - PutEmail fixed format when attachment 
Correction as suggested by users in JIRA.
+ adding a unit test to check attachments.

This closes: #1081

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
 2016-10-06 21:34:56 +11:00
Andre F de Miranda 3b408f5601 NIFI-2816 - Clean typos across the code - Part 2. This closes #1085 2016-10-05 13:07:57 -04:00
Byunghwa Yun 28acb07433 NIFI-2811 JdbcCommon doesn't convert bigint(20) column. 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1053
 2016-09-27 10:18:48 -04:00
Yolanda M. Davis 30f008d676 NIFI-2822 - pass the JWT Authorization token i. This closes #1065 2016-09-26 15:16:32 -04:00
Byunghwa Yun 8868235993 NIFI-2803 The pagination of GenerateTableFetch has a sort bug. 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2803: Updated unit tests for GenerateTableFetch

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1052
 2016-09-26 12:05:16 -04:00
Andre F de Miranda 446cd44702 NIFI-2816 - Clean typos across the code 
This closes #1057.
 2016-09-26 17:47:31 +02:00
Pierre Villard 44d4b882bf NIFI-2071 - Support repeating capture groups in ExtractText 
This closes #1050.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-09-26 17:22:21 +09:00
Mike Moser 5a3d00c7bb NIFI-2636 resolve thread safety problem in UnpackContent 
Signed-off-by: Joe Skora <jskora@apache.org>
 2016-09-23 13:25:03 -04:00
Scott Aslan e973874793 [NIFI-2781] removing bower and allowing npm to manage client side resources in nifi-web-ui and nifi-jolt-transform-json-ui. This closes #1030 2016-09-22 14:50:21 -04:00
Bartosz Wozniak f11682202b NIFI-1893 Add processor for validating JSON 
This closes #1037.
 2016-09-22 13:08:34 +02:00
Byunghwa Yun 77f8503e98 NIFI-2802 The implementation classes don't support orderByClause. 
This closes #1044.
 2016-09-22 12:21:43 +02:00
Nicolas Dupont be83c0c5b2 NIFI-1844 - Added ListFTP and FetchFTP processors 
This closes #881.
 2016-09-21 17:40:38 +02:00
Peter Wicks 938c7cccb8 NIFI-2749 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #997
 2016-09-21 11:16:57 -04:00
Pierre Villard 930e95aa00 NIFI-1170 - Improved TailFile processor to support multiple files tailing 
This closes #980
 2016-09-21 10:05:39 -04:00
Matt Burgess 68291636cb
NIFI-1841: Fixed support for CLOB/BLOB types 
This closes #1035.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-20 15:33:06 -04:00
Pierre Villard d838f61291 NIFI-1942 Processor to validate CSV against user-supplied schema 
This closes #476

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-09-16 11:13:07 -04:00
Andy LoPresto 022f5a506d NIFI-2266 Refactored GetHTTP processor to use SSLContext protocol vs. hard-coded TLSv1. 
This closes #999.
 2016-09-16 00:08:08 +02:00
Pierre Villard c1ad913598 NIFI-1342 Added default User-Agent in PostHttp 
This closes #1021
 2016-09-15 09:57:09 -04:00
Joe Skora c72a9aa54b NIFI-2752 Correct ReplaceText default pattern and unit tests 
* Corrected the DEFAULT_REGEX pattern.
 * Added tests to isolate regex capture group problem and verify corrected functionality.
 * Removed short circuit logic that masked configuration errors and created inconsistent processor behavior.

This closes #1007.
 2016-09-13 22:55:55 +02:00
Matt Burgess d325773760 NIFI-2262: Added Avro-normalization of table/column names in SQL processors 
This closes #994.
 2016-09-13 15:46:33 +02:00
Kirk Tarou e25885650a NIFI-2440 - Add 'file.lastModifiedTime' attribute to ListSFTP processor 
Added 'file.lastModifiedTime' attribute to ListFileTransfer, which is
the abstract class extended by ListSFTP.
String literal attribute names were replaced with static references to
attribute name constants in ListFile.
ListFileTransfer stores the 'file.lastModifiedTime' attribute in the
format specified in ListFile.FILE_MODIFY_DATE_ATTR_FORMAT

Updated WritesAttribute description for file last modify time attribute
to mirror the entry in ListFile

Signed-off-by: Joe Skora <jskora@gmail.com>

This closes #931.
 2016-09-09 22:44:23 -04:00
Matt Burgess 2afc739ab7 NIFI-2712: Fixed Fetch processors for multiple max-value columns. This closes #976 2016-09-06 16:52:40 -04:00
Andy LoPresto 8556777bf6
NIFI-2618 Reverted merging PR 955 to master as 1.0.0 requires Java 8. 2016-08-30 09:27:24 -07:00
Andy LoPresto d600b065bb
NIFI-2618 Added logic to unit test to handle default TLS version for Java <= 7. 
This closes #955.
 2016-08-30 08:25:38 -07:00
Joseph Percivall 1fe18a1567 NIFI-2676-rc1 prepare for next development iteration 2016-08-26 11:40:58 -04:00
Joseph Percivall 74d5224783 NIFI-2676-rc1 prepare release nifi-1.0.0-RC1 2016-08-26 11:40:44 -04:00
Bryan Rosander 102a9a2b74 NIFI-2674 - Always adding flow files to result set flowfiles, catching runtime exceptions while converting to avro 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #953
 2016-08-25 21:16:26 -04:00
joewitt 1624dd8e4d NIFI-2666 This closes #947. updated where it says BSD to say MIT for bcrypt 2016-08-25 14:59:46 -04:00
Matt Burgess ad7808f63d NIFI-2641: This closes #928. Add max values as attributes to QueryDatabaseTable 2016-08-25 14:13:55 -04:00
Peter Wicks e210172d93 PutSQLBinary 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2591

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2591

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2591 - Added Format option for binary data types. Updated unit tests.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #883
 2016-08-25 08:41:23 -04:00
Matt Burgess ee9bd94082 NIFI-2632: Added fragment attributes to SplitJson and SplitXml 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #919
 2016-08-23 16:30:57 -04:00
Jeff Storck dca3764ed1 NIFI-2626 Fixes jetty server thread leak. This closes #910 2016-08-22 15:58:06 -04:00
Joe Gresock 17dec04939 NIFI-2611: Fixing bugs in UnpackContent with flow file unpackers 
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #905
 2016-08-22 14:47:24 -04:00
Joe Skora a2d3d0c289 Update to support offsets larger than 2 gigabyte. 2016-08-22 11:02:48 -04:00
Joe Skora 02071103d0 * Add "Remove All Content" property, related functionality, and tests to ModifyBytes processor to allow deletion of all flow file content. 
* Removed @Ignore annotation on class and unnecessary EOL translation of test data.  Because ModifyBytes treat input as binary data, not text, line endings don't matter as long as they byte offsets are calculated correctly.
* Replace validator with .allowableValues.

This closes #890.
 2016-08-19 20:05:14 +02:00
Matt Gilman 87161ab96e
NIFI-2595: - Updating ReportingTasks to use ComponentLogger instead of creating Controller level bulletins. 
- Making the bulletin responses consistent in that all bulletins will be included but in redacted form as appropriate.
- Fixing broken unit test.

This closes #892.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-18 17:06:28 -04:00
Mark Payne 567535c3d0 NIFI-2382: Fixed typo in documentation 2016-08-18 09:15:55 -04:00
Mark Payne 91a59a8a5a NIFI-2545: Ensure that when @OnUnscheduled and @OnStopped methods are called that the active thread count takes that thread into account 
This closes #836.
 2016-08-18 08:33:45 -04:00
Peter Wicks 7bc7b7f683
NIFI-2584 Fixing date format in PutSQL 
This closes #878.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-17 16:10:56 -04:00
Andy LoPresto 0ffdc2eb92
Merge branch 'master' of https://github.com/apache/nifi 
(Apologies for merge commits, but it was not possible to rebase the 2574 commits (PR 872)).

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-08-17 10:58:38 -07:00
Peter Wicks a0d1aae603 NIFI-2583 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2582

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2582

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #877
 2016-08-17 13:20:44 -04:00
Peter Wicks 1470a52b1b NIFI-2582 NIFI-2583 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2583 Tweaks

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #877
 2016-08-17 13:19:56 -04:00
joewitt d9633757a6 NIFI-2574 fix spring context definitions 2016-08-17 03:38:31 -07:00
joewitt 7d7401add4 NIFI-2574 Changed NiFiProperties to avoid static initializer and updated all references to it. 2016-08-17 00:10:07 -07:00
Peter Wicks b22500d0a3
NIFI-2576 Allowing PutSQL to use timestamps in epoch or string format 
This closes #869.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-16 10:26:24 -04:00
Mark Payne 6af768d0a1 NIFI-2551: Addressed a threading issue in the StandardResourceClaimManager and performed some refactoring so that we can ensure thread-safety across different components of the application, such as ProcessSession and WriteAheadFlowFile Repository when interacting with the StandardResourceClaimManager. Update DebugFlow to allow it to write to a FlowFile multiple times, which exposes the concurrency bug. Also avoided calling ContentRepository.remove() from ProcessSession whenever the content is no longer needed, as that can cause problems now that the Resource Claim is backing the content claim. 2016-08-15 17:02:15 -04:00
Peter Wicks 44057f097a
NIFI-2356 ConvertJSONToSQL assumes IS_AUTOINCREMENT 
This closes #862.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-15 14:17:16 -04:00
Matt Burgess d544274881
NIFI-2531: Fixed JdbcCommon handling of BigInteger objects for Avro 
This closes #823.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-10 15:19:34 -04:00
Joey Frazee bb24312709 NIFI-2142 Added Guava cache for XSLT stylesheets in TransformXml 
This closes #609

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-10 11:13:30 -04:00
Matt Burgess 557d6365bf NIFI-2518: Added unit test showing issue 
NIFI-2518: Added support for fractional seconds to AbstractDatabaseFetchProcessor

This closes #821
 2016-08-10 11:10:17 -04:00
Bryan Rosander 2dc094765d NIFI-2516 - Extract version info into parent pom, upgrade to commons-io 2.5 
NIFI-2516 - Removing slf4j-api, version from slf4j-log4j12

This closes #809.
 2016-08-09 22:43:29 +02:00
Kirk Tarou e2f649cfea NIFI-2470 This closes #802. 
Fixed WritesAttributes section to include all attributes with the
correct attribute names and descriptions
 2016-08-07 23:58:09 -04:00
joewitt 6bcc415eb8 NIFI-2457 removed old state file mechanism and fixed state reset logic 
This closes #768.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-02 12:11:43 -04:00
joewitt 05a99a93cb NIFI-2208 This closes #754. refactored as per comments on JIRA. Reduced API expsosure and tightened lifecycle management. 2016-08-01 14:17:26 -04:00
Yolanda M. Davis 8412d2662a NIFI-2208 - initial commit Custom Property Expression Language support with Variable Registry, includes bug fix for NIFI-2057 
This closes #529

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-29 17:10:20 -04:00
Yolanda M. Davis 35c0e1436e NIFI-2310 - upgraded jolt to 0.0.21 to resolve special character issue 
This closes #674

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-07-21 10:35:42 +09:00
Matt Burgess f1ba240326 NIFI-2156: Add ListDatabaseTables processor 
This closes #642

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-19 13:00:43 -04:00
Matt Burgess 01cae23745 NIFI-2157: Add GenerateTableFetch processor 
This closes #645

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-17 17:54:42 -04:00
Koji Kawamura e89ee11199 NIFI-619: Make MonitorActivity more cluster friendly 
With this commit, MonitorActivity can be configured as:

- Monitor activity per node individually
- Monitor cluster wide activity
  - Send notification flow-file from all of nodes
  - or only from a primary node

Changes:
- Added 'Monitoring Scope' property
- Added 'Reporting Node' property
- Falls back from cluster scope to node scope if necessary
- Persist the latest activity as Cluster state
- Examine cluster state on each node if necessary
- Only update the cluster state if current timestamp is later than existing
  timestamp stored in Zookeeper

This closes #575

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 12:47:37 -04:00
Aldrin Piri d1129706e2 NIFI-1896 This closes #650. Refactored nifi-api into nifi-framework-api and other locations. The nifi-api is specific to that which is needed for intended extension points. 2016-07-14 18:24:48 -04:00
Yolanda M. Davis 048ba5366c NIFI-2020 - initial commit for custom transformation support 
NIFI-2020 - updates to use lambdas/stream wherever possible and fix potential nullpointer issue.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #564
 2016-07-14 18:04:14 -04:00
Andy LoPresto 4e3580f58e
NIFI-1688 Resolved issue in PostHTTP -- now uses SSLContextService's protocol setting. Modified construction of SSLSocketFactory to avoid hardcoding supported protocol. Added debug information for supported cipher suites. 
This closes #624.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-07-14 16:43:48 -04:00
joewitt f987b21609 NIFI-1157 searched for and resolved all remaining references to deprecated items that were clearly addressable. 2016-07-14 09:32:35 -04:00
Mark Payne 32b8a9b9f4 NIFI-1877, NIFI-1306: Add fields to FlowFile for FIFO Prioritizer, Oldest/Newest FlowFile first prioritizers to work properly 
This closes #546
 2016-07-05 14:59:08 -04:00
Joe Gresock e3d13ecf50 NIFI-920: Adding InvalidPathException handling to UnpackContent 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-06-27 13:49:49 -04:00
Matt Gilman f0811ca45a NIFI-1554: 
- Addressing access controls for the Controller resource.
- Addressing access controls for RAW site to site clients.
- Addressing access controls for downloading content (from provenance and queue).
- Addressing access controls for accessing queues.
- Addressing access controls for cluster endpoints.
- Addressing access controls for counter endpoints.
- Removing redundant authorization calls.
NIFI-2044:
- Requiring revision when creating components.
- Requiring component creation over POST requests.
NIFI-1901
- Continuing to restore access control tests.
- Converting access control tests to itegration tests.
- Restoring contrib check to travis build.
- This closes #567
 2016-06-23 17:09:54 -04:00
jpercivall f0662a24ef NIFI-2092 Fixing unit tests which try to clean up directories before stopping the FlowController that has locks opened. 
This closes #568
 2016-06-23 16:40:00 -04:00
Bryan Bende 4f2643f668 NIFI-2061 Added methods to AbstractPolicyBasedAuthorizer to generate and inherit a fingerprint 
- Updated StandardFlowSynchronizer to compare authorization fingerprints
- This closes #566
 2016-06-23 14:36:04 -04:00
Oleg Zhurakousky 1eeef0e1c0 NIFI-2067 ignored intermittently failing MemoryTest left comment with the explanation as to why it was not removed 
This closes #555

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-06-21 22:18:13 -04:00
Pierre Villard ef192cc859 NIFI-1751 Added proxy authentication in InvokeHttp processor 
This closes #398.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-06-21 14:09:02 -04:00
Andy LoPresto a6e96953f6 Removed duplicate dependency declaration from nifi-standard-processors/pom.xml. 
This closes #551.
 2016-06-21 19:25:01 +02:00
jpercivall cd846c8d62 NIFI-1834 adding fixes to PutTCP 
This closes #543
 2016-06-21 12:05:39 -04:00
Matt Brown a7c912ac18 PutTCP Processor created. 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-06-21 12:05:13 -04:00
Yolanda M. Davis cb3aa8f5c9 NIFI-1850 - Initial Commit for JSON-to-JSON Schema Converter Editor (merge from 0.7.0 - refactor for masterless cluster). This closes #511 2016-06-20 20:30:25 -04:00
ricky f5060a6d63 NIFI-1568: Add Filter Capability to UnpackContent 
Adds a "File Filter" property to the `UnpackContent` processor
to allow users to specify which files are eligible for extraction.
By default, all files will be extracted.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

Refactor how Unpacker is initialized

Re-uses unpackers to avoid creating them each time a
flowfile is received. Moved the package formats into
an enum for clarity.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

Fix packaging format enum warning

The `AUTO_DETECT_FORMAT` enum for PackagingFormat
is not valid for initilization. When this value
is set, then we use the mime.type to determine
which packaging format to use.

We never pass `AUTO_DETECT_FORMAT` to the
`initUnpacker` method.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #248
 2016-06-20 10:44:38 -04:00
Pierre Villard e6250d18cf NIFI-1620 Allow empty Content-Type in InvokeHTTP processor 
This closes #272.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-06-18 12:47:07 -04:00
Adam Lamar db9a79f79d NIFI-1578: Create PutSlack processor 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #256
 2016-06-17 15:32:17 -04:00
Joshi 541bbc0932 NIFI-1549: Fix JMSConsumer exception 
This closes #539
 2016-06-17 12:16:36 -04:00
Oleg Zhurakousky 8e4a4532df
NIFI-1690 Changed MonitorMemory to use allowable values for pool names 
- removed dead code from MonitorMemory
- added MonitorMemoryTest
- minor refactoring in MonitorMemory
- initial fix for NIFI-1731 (WARN/INFO logging) that was required by MonitorMemoryTest

NIFI-1690 polishing

NIFI-1690 address PR comments, removed default value for MEMORY_POOL_PROPERTY

NIFI-1690 addressed latest PR comments

NIFI-1690 fixed breaking changes

Fixed checkstyle issue in StandardProcessScheduler. (+2 squashed commits)
Squashed commits:
[03829c4] Fixed checkstyle issues.
[cb20fe6]

This closes #328.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-06-16 15:17:13 -07:00
Joe Skora 4723f8e24c NIFI-1829 - Create new DebugFlow processor. 
Signed-off-by: Mike Moser <mosermw@apache.org>
This closes #458
 2016-06-16 17:23:19 -04:00
Andy LoPresto 8b0c5a4911 NIFI-1981 Resolved issue where cluster communication without client certificates would fail even if needClientAuth set to false. 
Fixed IDE setting for import wildcarding on Groovy files. (+4 squashed commits)
Squashed commits:
[4c3b174] NIFI-1981 Lowered logging level of client auth setting on cluster connection receive.
[b50f473] NIFI-1981 Finished logic to suppress exception on missing client certificates when clientAuth is set to WANT.
Added unit tests for CertificateUtil methods.
[ace35a2] NIFI-1981 Added test scope dependency on BouncyCastle and BC PKIX modules for CertificateUtils tests.
[2c463d1] NIFI-1981 Added ClientAuth enum and CertificateUtil methods to extract this setting from an SSLSocket.
Added logic to compare X509Certificate DNs regardless of RDN element order.
Added logic to suppress peer certificate exceptions when client authentication is not required.
Removed duplicate dependency in pom.xml.
 2016-06-14 11:18:31 -04:00
Mike Moser cc95e5d8c5 NIFI-1937 GetHTTP configurable redirect cookie policy 
Reviewed by Tony Kurc (tkurc@apache.org). This closes #479
 2016-06-11 11:22:33 -04:00
Matt Burgess 3b99e12352 NIFI-1973 Allow ExecuteSQL to use flow file content as SQL query 
This closes #498.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-06-07 17:26:58 -04:00
Mark Bean 1ac44a0a4b NIFI-1118 adding SplitText features of size limit and header marker characters 
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #444
 2016-06-07 11:37:23 -04:00
Oleg Zhurakousky cee2426df6 NIFI-1956 added 'keyboard-interactive' option to SFTPTransfer 
This closes #487.
 2016-06-06 19:32:16 +02:00
Thad Guidry c090cdf29a Added details about data size in description. 
added "in bytes" to further explain the Segment Size property.

This closes #494
 2016-06-06 09:50:57 -04:00
jpercivall 54c5c28cbb NIFI-1943 added proper ReadsAttribute to PutFile 
This closes #480
 2016-06-02 13:04:14 -04:00
jpercivall 4f101294eb NIFI-1265 Fixing InvokeHttp tests. 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-06-02 09:49:57 -04:00
Matt Gilman e587c99855 NIFI-1265: 
- Upgrading to Jetty 9.3.
 2016-06-02 09:49:57 -04:00
Andre F de Miranda bcead3500d NIFI-1945 - Corrects minor issue in "<Hash Attribute Name>" description 
This closes #481.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
 2016-06-01 21:13:59 +02:00
Oleg Zhurakousky 93795bc7ba NIFI-1915 Fixed '$' escape logic. 
Fixed '$' escape logic (if not followed by number) to use Matcher.quoteReplacement(java.lang.String) to
suppress its special meaning so it could be treated as literal.

This closes #466.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
 2016-06-01 20:17:59 +02:00
jpercivall e1b654655a NIFI-1913 Properly removing flowfile in HandleHttpRequest when the Context Map fails to register the request 
This closes #462
 2016-05-24 10:54:46 -04:00
Oleg Zhurakousky f40a090073 NIFI-1905 enabled ExecuteProcess to terminate process 
NIFI-1905 polishing

NIFI-1905 changed WARN to INFO during shutdown
This closes #456
 2016-05-22 10:36:03 -04:00
DomenicPuzio afc8c645a1 NIFI-1498: putFile - Flowfiles routed to failure relationship produce INFO level log messages 
This closes #445.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-05-19 16:21:45 -04:00
Aldrin Piri 1bd2cf0d09 NIFI-1811 Renaming MockProcessorLogger to MockComponentLogger for consistency. Removing unused imports from ExecuteScript causing checkstyle failures. 2016-05-19 14:38:41 -04:00
Pierre Villard 372ffb8aa0 NIFI-1811 Removed ProcessorLog and updated dependent interfaces 
This closes #403.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-05-19 13:08:09 -04:00
Koji Kawamura 7bd2c64adb NIFI-1865 Close StreamThrottler when processor stops. 
- Also, replaced copyrighted sample texts for tests

Signed-off-by: Matt Burgess <mattyb149@apache.org>
 2016-05-10 22:02:15 -04:00
Pierre Villard 9064b97631 NIFI-1816 Added provenance event SEND in HandleHttpResponse 
This closes #389
 2016-05-07 11:51:26 -04:00
Pierre Villard 63a0d0c211 NIFI-1732 set jetty timeout to Long.MAX_VALUE 
This closes #337
 2016-05-06 19:38:52 -04:00
Pierre Villard e2bbea1c53 NIFI-1814 Extended caught exceptions 
This closes #382
 2016-05-06 18:00:40 -04:00
Yolanda M. Davis defb6f5b61 NIFI-361 - Create Processors to mutate JSON data 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #354
 2016-05-03 14:38:11 -04:00
Andy LoPresto a4409d366c
Fixed typo in ScryptCipherProviderGroovyTest Javadoc. 
This closes #380.
 2016-04-27 16:05:16 -07:00
Andy LoPresto f94b0f2ed2
NIFI-1789 Temporarily ignored incorrectly failing TestPutUDP#testUnknownHostname. 
This closes #373.
 2016-04-20 19:20:41 -07:00
Pierre Villard b5a8f4f73b NIFI-1787 fixed typo 
This closes #367
 2016-04-20 06:57:43 -04:00
Oleg Zhurakousky 5b2490f1e8 NIFI-1738 hot patch to fix reflection mistake that was made while modifying @jvwing test 2016-04-18 08:59:44 -04:00
Pierre Villard 5e55a543eb NIFI-1724 Added properties to configure log level when file not found and permission denied on FetchFile processor 
NIFI-1724 Added unit test for logging with level
This closes #348
 2016-04-18 08:15:27 -04:00
Hejki 1a57b37dc9 NIFI-1738 - Repair logger names for ControllerStatusReportingTask 
NIFI-1738 amending this commit with tests provided by @jvwing
This closes #334
 2016-04-17 15:53:13 -04:00
Pierre Villard ad56f1f853 NIFI-1776 Allowed application/x-gzip as Gzip mime type 
This closes #358
 2016-04-17 14:36:13 -04:00
Toivo Adams 678d64d1d4 NIFI-1685 Optimize database Junit tests to reduce execution time. Removed commented blocks. 
This closes #304.

Signed-off-by: Joe Skora <jskora@apache.org>
 2016-04-16 20:15:42 -04:00
Andy LoPresto 378ccf53c2
NIFI-1753 Replaced usage of javax.security.cert.X509Certificate with java.security.cert.X509Certificate and resolved user-reported ClassCastException when handling client certificates during TLS mutual authentication. 
Fixed nifi-utils pom.xml comment about additional dependencies. (+5 squashed commits)
Squashed commits:
[965b766] NIFI-1753 Removed temporary work-around of duplicate certificate conversion util method and added nifi-security-utils as dependency of nifi-utils.
[cd35f9b] NIFI-1753 Replaced legacy X.509 certificate declarations with new declarations in SSLSocketChannel and EndpointConnectionPool.
Temporary work-around of duplicate certificate conversion util method because nifi-utils cannot depend on nifi-security-utils.
[6420897] NIFI-1753 Replaced legacy X.509 certificate declarations with new declarations in PostHTTP.
[b9868ef] NIFI-1753 Added convenience method for extracting DN from peer certificate chain in SSL socket (canonical implementation to reduce code duplication and references to legacy certificate implementations).
Refactored logic retrieving legacy X.509 certificates with reference to convenience method in NodeProtocolSenderImpl.
Replaced logic retrieving legacy X.509 certificates with reference to convenience method in SocketProtocolListener.
Cleaned up exception handling in SocketProtocolListener.
Replaced legacy X.509 certificate declarations with new declarations in HandleHttpRequest (needs manual test).
[e2d1c35] NIFI-1753 Added convenience methods for converting legacy X.509 certificates and abstract certificates to correct X.509 format.
Added unit tests for certificate manipulation.
Replaced logic retrieving legacy X.509 certificates with new logic in NodeProtocolSenderImpl.
Added bcpkix (Bouncy Castle PKI implementation) dependency to nifi-standard-processors pom.

This closes #346.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-04-13 18:30:21 -07:00
Zachary Jaffee 41583e6dc0 NIFI-400 remove deprecated processor EvaluateRegularExpression 
This closes #77

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-04-08 09:11:20 -04:00
Bryan Bende 3adb45eafc NIFI-1630 This closes #332. Making TestPutUDP select an open port for testing to avoid conflicts 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-04-06 23:39:30 -04:00
Matt Brown b0cc6ae7e8 NIFI-1630 PutUDP processor created. 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-04-06 11:04:01 -04:00
Aldrin Piri 3effc6cca5 NIFI-1689 Correcting TimeUnit conversion to be milliseconds instead of the incorrect microseconds and using historical modified times to avoid issues with second granularity of HFS+ 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-04-05 09:38:48 -04:00
Mike Moser 1c025dd4be NIFI-1714 use standard HttpClient cookie policy instead of default 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-04-04 13:13:17 -04:00
Matt Gilman 2de7f3f884 Updating versions to 1.0.0-SNAPSHOT. 2016-04-04 11:36:20 -04:00
Matt Burgess 65b26e6f41 NIFI-1691: Add Fetch Size property to QueryDatabaseTable 
This closes #307

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-03-29 10:51:30 -04:00
Aldrin Piri e977729b56 NIFI-1634-rc2 prepare for next development iteration 2016-03-23 18:56:34 -04:00
Aldrin Piri 0b9bd20d31 NIFI-1634-rc2 prepare release nifi-0.6.0-RC2 2016-03-23 18:56:22 -04:00
Aldrin Piri 4babd067c1 NIFI-1664 Preferring System.nanoTime to System.currentTimeMillis and providing explicit handling of timestamps for files in those tests that are testing other attributes of the ListFile process besides timestamp which could lead to erroneous transmissions depending on exactly when files were created. 
Adding unsalted_128_raw.enc and salted_128_raw.enc to the list of exclusions for the RAT plugin which caused issues in the Windows environment for contrib-checks.

This closes #297.
 2016-03-22 14:13:37 -04:00
Mark Payne 736896246c NIFI-1649: Addressed bug in SplitText that resulted in improper handling of input data if Remove Trailing Newlines is true and there is a FlowFile that is only made up of newlines 2016-03-21 13:26:32 -04:00
Joey Frazee 3a4546c08a NIFI-1617 Add source filename metadata to IdentifyMimeType 
Signed-off-by: Matt Burgess <mattyb149@apache.org>
 2016-03-18 00:23:16 -04:00
Michal Klempa e12e7a55b7 NIFI-1562 ExecuteStreamCommand and ExecuteProcess now support empty command line arguments 
This closes #247

Signed-off-by: Matt Burgess <mattyb149@apache.org>
 2016-03-17 23:15:12 -04:00
Pierre Villard e7a254f78e NIFI-1332 Fixed HTTP-204 handling + unit test 
This closes #259.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-03-17 23:03:51 -04:00
Matt Burgess 98395de74f NIFI-1575: Add QueryDatabaseTable processor 2016-03-16 15:55:57 -04:00
Mark Payne 68cfc8c612 NIFI-1632: Fixed NPE that occurs if a capturing group is optional and not matched; updated docs to illustrate how this is handled 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-03-16 15:19:17 -04:00
Mark Payne 56f79e1e85 NIFI-1588: Reworked how ListHDFS store state so that only 2 timestamps are stored and no paths 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-03-14 15:59:24 -04:00
joewitt 730d999d4b NIFI-627 minor formating adjustments and removed exception based handling logic. This closes #268. This closes #274. 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-03-13 13:28:48 -04:00
Mike Moser 0cb4047add NIFI-627 removed flowfile penalization which could skew behavior when processor's Time Duration was less than Penalty Duration, improved over throttle penalization NIFI-990 corrected failure path NIFI-1329 refactored using FlowFileFilter to avoid repeatedly returning flowfiles to the input queue, producing misleading stats and excessive Tasks/Time used 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-03-13 13:28:43 -04:00
Bryan Bende 1373bf6725 NIFI-899 Rewrite of ListenUDP to use new listener framework, includes the following changes: 
- Adding Network Interface property to AbstractListenEventProcessor and ListenSyslog
- Adding sending host and sending port to DatagramChannelDispatcher
- Creation of common base class AbstractListenEventBatchingProcessor
- Refactor of ListenUDP, ListenTCP, and ListenRELP to all extend from AbstractListenEventBatchingProcessor
- Changing DatagramChannelDispatcher, socket handlers, and RELP handler to use offer() when queueing instead of put(), and log an error if the offer failed

This closes #266
 2016-03-11 09:07:05 -05:00
Bryan Bende 6f5fb59479 NIFI-1420 Adding Splunk bundle containing PutSplunk, and GetSplunk, and adding a ListenTCP processor to standard processors. Refactored internal code from PutSyslog to create a generic AbstractPutEventProcessor which PutSplunk extends from. 
This closes #233
 2016-03-07 18:21:17 -05:00
Matt Burgess a7e6820fd9 NIFI-1596: ExecuteSQL Error Creating Schema 2016-03-07 10:42:21 -05:00
Bryan Bende 19e53962ca NIFI-1579 Performance improvements for ListenSyslog which include removing an unnecessary yield and exposing a configurable size for the internal queue used by the processor, changing ListenSyslog to use a 20ms poll and use a long poll when batching, also including same improvements for ListenRELP 2016-03-04 09:17:45 -05:00
Mark Payne 28c2a3e5a6 NIFI-1256: Added a 'Satisfies Expression' option for Matching Strategy of RouteText 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-02-25 15:59:57 -05:00
Tony Kurc c7e24c7569 NIFI-1513: fixed some easy to fix errors 
Addressing checkstyle issue.

This closes #221

Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-02-25 15:21:40 -05:00
Jeremy Dyer 32f476aaa7 NIFI-1357 Add Snappy compression to "CompressContent" Processor 
This closes #164.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-02-25 12:47:01 -05:00
joewitt 86ab4428f0 NIFI-1520 by default skip javadoc and source jar generation in nars and wars 
Reviewed by Tony Kurc (tkurc@apache.org). This closes #234
 2016-02-18 18:45:26 -05:00
puspendu.banerjee@gmail.com 1c73d9090a NIFI-1501 : Test Monitor Activity has spurious failures. 
Added Timeout for the test. So, in case something goes South, threshold will never be more that that Timeout period.

Reviewed with amendments for whitespace by Tony Kurc (tkurc@apache.org). This closes #225
 2016-02-17 21:55:10 -05:00
Michal Klempa c2998a71ec NIFI-1514 Fixed ExecuteStreamCommand when expressions in command arguments are used, contents are not split by command separator 
This closes #223.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-02-17 17:48:23 -05:00
Tony Kurc ad73b5c9d9 NIFI-1379-RC3 prepare for next development iteration 2016-02-12 17:28:10 -05:00
Tony Kurc 8309dba80b NIFI-1379-RC3 prepare release nifi-0.5.0-RC3 2016-02-12 17:27:59 -05:00
Tony Kurc cae5b109c0 NIFI-1507: Update bouncycastle license reference 2016-02-12 16:58:26 -05:00
Aldrin Piri 1a512cd1e6 NIFI-1484 Making use of timestamps at various points of execution to provide listing of all but the latest files which are held until a subsequent execution. 
Correcting nifi-amqp-nar bundle's pom description.

This closes #212.
 2016-02-10 10:25:47 -05:00
ledor473 eb6f9f0fec NIFI-1423 Allow to penalize FlowFiles that are routed to No Retry relationship 
This closes #183

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-02-08 11:20:08 -05:00
Aldrin Piri 2673370cba NIFI-1483 Correcting logic in terms of when local persistence files are removed during the migration process. 
Reviewed by Tony Kurc (tkurc@apache.org). This closes #206
 2016-02-07 17:40:12 -05:00
Tony Kurc 5be83166ee NIFI-1485: Updated 'header' section of NiFi NOTICE files 2016-02-07 13:52:00 -05:00
Tony Kurc 303f8eabf1 NIFI-1379: Move to 0.5.0-SNAPSHOT, add tkurc code signing key to keys 2016-02-06 08:49:48 -05:00
Andy LoPresto b407379670 NIFI-1257 Resolved legacy compatibility issue with NiFi legacy KDF salt length dependent on cipher block size. 
Replaced screenshot for NiFiLegacy salt encoding.
Added description of legacy salt length determination in admin guide.
Added logic for NiFiLegacyCipherProvider to generate and validate salts of the length determined by the cipher block size.
Changed EncryptContent to default to Bcrypt KDF.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-02-05 23:38:58 -05:00
Aldrin Piri 4df6512126 Merge branch 'NIFI-259' 2016-02-05 14:09:29 -05:00
Aldrin Piri 16f1852453 NIFI-259 Updating logger message for AbstractListProcessor to reference State Manager in onTrigger instead of the distributed cache. 2016-02-05 12:55:06 -05:00
Andy LoPresto 498b5023ce NIFI-1257 NIFI-1259 
Added utility method to return the maximum acceptable password length for PBE ciphers on JVM with limited strength crypto because BC implementation is undocumented (based on empirical evidence).
Updated EncryptionMethod definitions to accurately reflect need for unlimited strength crypto according to algorithm key length.
Added processor logic to invoke keyed cipher.
Added EncryptContent processor property for raw hex key (always visible until NIFI-1121).
Added validations for KDF (keyed and PBE) and hex key.
Added utility method to return list of valid key lengths for algorithm.
Added description to allowable values for KDF and encryption method in EncryptContent processor.
Added IV read/write to KeyedCipherProvider and changed from interface to abstract class.
Added salt read/write logic to NifiLegacy and OpenSSL cipher providers.
Changed RandomIVPBECipherProvider from interface to abstract class.
Updated strong KDF implementations.
Renamed CipherFactory to CipherProviderFactory.
Added unit test for registered KDF resolution from factory.
Updated default iteration count for PBKDF2 cipher provider.
Implemented Scrypt cipher provider.
Added salt translator from mcrypt format to Java format.
Added unit tests for salt formatting and validation.
Added surefire block to groovy unit test profile to enforce 3072 MB heap for Scrypt test.
Added local Java implementation of Scrypt KDF (and underlying PBKDF2 KDF) from Will Glozer.
Defined interface for KeyedCipherProvider.
Implemented AES implementation for KeyedCipherProvider.
Added Ruby script to test/resources for external compatibility check.
Added key length check to PBKDF2 cipher provider.
Changed default PRF to SHA-512.
Added salt and key length check to PBKDF2 cipher provider.
Added utility method to check key length validity for cipher families.
Added Bcrypt implementation.
Implemented PBKDF2 cipher provider.
Added default constructor with strong choices for PBKDF2 cipher provider.
Implemented NiFiLegacyCipherProvider and added unit tests.
Added key length parameter to PBKDF2 cipher provider.
Added PRF resolution to PBKDF2 cipher provider.
Added RandomIVPBECipherProvider to allow for non-deterministic IVs.
Added new keyed encryption methods and added boolean field for compatibility with new KDFs.
Added CipherFactory.
Improved Javadoc in NiFi legacy cipher provider and OpenSSL cipher provider.
Added KeyedCipherProvider interface.
Added OpenSSL PKCS#5 v1.5 EVP_BytesToKey cipher provider and unit test.

This closes #201.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-02-04 19:40:55 -05:00
jpercivall 29fb9c9393 NIFI-259 Corrected some logic in AbstractListProcessor regarding being elected primary node and improved readability in GetHBase a smidge 2016-02-04 16:07:18 -05:00
jpercivall 88d4d2ce5f NIFI-259 Corrected GetHttp state managment and added a new unit test 2016-02-03 20:04:39 -05:00
Matt Gilman 55b77fe03b NIFI-1223: - Removing conf directory from unit test. 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-02-03 16:05:38 -05:00
Mark Payne ef80549d63 Merge branch 'NIFI-1093' of https://github.com/olegz/nifi into NIFI-1093 2016-02-01 11:51:27 -05:00
Daniel Cave 171b9c4e94 NIFI-1093 - Added settings for processing JSON documents when validating against database columns to fail, log a warning, or ignore unmatched columns. Added tests for new settings. 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2016-02-01 11:45:15 -05:00
joewitt 1bf7a585b2 NIFI-1456 This closes #198. reduced tests to 10MB instead of 100MB datasets and resolved IO issues which impact test stability 2016-01-31 21:56:53 -05:00
Richard Miskin 8ef337b65e NIFI-1434 Prevent array index exception in PutEmail 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-01-30 10:56:31 -05:00
Oleg Zhurakousky 0126800201 NIFI-1093 added support for handling non-required columns 
Mostly based on contribution from Daniel Cave
 2016-01-29 13:41:27 -05:00
jpercivall be27c07c7f NIFI-1382 Created FetchDistributedMapCache processor 2016-01-29 12:12:23 -05:00
Mark Payne a0224f1b4c NIFI-1431: Added documentation about how ETag and LastModified dates are used by the Processor 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-01-28 16:02:05 -05:00
jpercivall ee30b27cc8 NIFI-1396 Correcting PostHttp chunked encoding functionality 2016-01-28 14:50:22 -05:00
Matt Burgess aa6bc5d505 NIFI-1409: Fix missing transfer on error in ExecuteSql 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-01-27 18:23:32 -05:00
Andy LoPresto 93aac8cff3 NIFI-1365 
Added Groovy support for unit tests to pom with skeleton test.
Added Groovy unit tests for OCSPCertificateValidator.
Implemented positive & negative unit tests with cache injection for valid/revoked OCSP certificate.
Modified pom.xml to support Groovy unit tests with custom variable.

mvn clean test -Dgroovy=test

Added local cache injection into Groovy tests for OCSP certificate validation (see NIFI-1324 and NIFI-1364).
Set Java version to 1.7 for Groovy test src/target.
Moved Groovy unit test profile from nifi-web-security to root pom.
Added null check for algorithm argument in PGPUtil.
Changed buffer length check from ">= 0" to "> -1" because it was confusing other developers.
Resolved contrib-check line length issues.
Fixed contrib-check issues in OpenPGPKeyBasedEncryptorTest.
This closes #163

Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-01-26 17:37:59 -05:00
Mark Payne 0e92607466 Merge branch 'NIFI-1412' of https://github.com/mattyb149/nifi into NIFI-1412 2016-01-26 12:30:19 -05:00
Richard Miskin c16c8db459 NIFI-1421 Make namespace ordering deterministic in SplitXML 2016-01-26 05:35:07 +00:00
Bryan Bende b7f7e6ed80 NIFI-1436 This closes #189. Combining stop() and close() into a single method to simplify, and adding checks on stopped flag in the run method of SocketChannelDispatcher and DatagramChannelDispatcher to ensure the run() method exits as soon as possible upon close() being called 
NIFI-1436 Adding synchronization on keys set in close() method  based on Selector JavaDoc

Signed-off-by: joewitt <joewitt@apache.org>
 2016-01-25 22:50:25 -05:00
joewitt beb92492be NIFI-1421 This closes #184. Added content assertion to test and removed extra space 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2016-01-25 16:04:47 -05:00
Mark Payne 4a5fb37b33 Merge branch 'NIFI-1421' of https://github.com/rpmiskin/nifi into NIFI-1421 2016-01-25 15:38:08 -05:00
Matt Burgess 91e7ba84e0 NIFI-1412: Fix error during Avro conversion where no fields are present 2016-01-25 08:35:14 -05:00
Aldrin Piri 8d37af07b9 NIFI-1381 Removing the hardcoded jms:// prefix and instead deferring to the URI specified by the processor properties of PutJMS 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-01-24 23:10:47 -05:00
jpercivall 0db2dc9fc3 NIFI-1405 Adding option to invokeHttp to control using chunked encoding for http PUT and POST calls 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-01-24 15:52:05 -05:00
Richard Miskin dfed7e727d NIFI-1421 Added missing copyright notice to new test input 2016-01-23 08:52:54 +00:00
Mark Payne 93e2c52195 NIFI-1415: Do not enfoce that a password or Private Key Passphrase is set 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-01-22 20:46:14 -05:00
Mark Payne 92e6961b50 NIFI-1416: If FetchSFTP's Remote File has a directory name in it, do not include that as part of the 'filename' attribute but instead add a 'path' attribute 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-01-22 18:15:19 -05:00
Bryan Bende 1089f0a956 NIFI-1273 Adding ListenRELP processor which includes refactoring code that was previously part of ListenSyslog into a reusable framework for implementing listener processors, as well as back-end code for handling the RELP protocol. Addressing some feedback from review and fixing logging statements Addressing review feedback, added AsyncChannelDispatcher and made ChannelHandlerFactory use generics for the dispatcher This closes #179 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-01-22 16:28:58 -05:00
Oleg Zhurakousky 3db6fffa68 NIFI-1378: fixed JMS URI validation simplified JmsFactory check for SSL and scheme-less URIs ensured URI validation is handled by ActiveMqConnectionFactory ensured informative error messages are shown to the userm removed unneeded test, cleaned up unused imports 
Reviewed by Tony Kurc (tkurc@apache.org). This closes #167
 2016-01-21 22:29:50 -05:00
Richard Miskin 68a9375f3e NIFI-1421 Update SplitXML to support namespace declarations 2016-01-21 22:19:15 +00:00
Mark Payne f6ec437bc7 Merge branch 'master' into NIFI-259 2016-01-21 09:32:02 -05:00
Aldrin Piri bc75dd3c17 NIFI-1406 Collecting the number of bytes sent regardless if one or multiple FlowFiles are sent. 
Reviewed by Tony Kurc (tkurc@apache.org). This closes #176
 2016-01-20 21:08:15 -05:00
Mark Payne 348831b20c Merge branch 'NIFI-1414' 2016-01-20 17:31:34 -05:00
smarthi e1588d4136 [NIFI-1411] - TestJdbcTypesDerby: java.sql.SQLSyntaxErrorException: TYPE 'DATETIME' does not exist 2016-01-20 16:51:58 -05:00
Aldrin Piri 9ebcc9e4fa NIFI-1393 Providing the ability to send using gzip Content-Encoding in PostHTTP if the endpoint server supports it regardless if the processor is configured to send as a FlowFile This closes #175 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-01-20 16:46:57 -05:00
Mark Payne d696391f76 NIFI-259: Update ZooKeeperStateServer so that the thread starting it doesn't block indefinitely, as this was causing NiFi to not shut down properly; applied patch for NIFI-1415 2016-01-20 11:52:41 -05:00
Mark Payne 7ef8af9eea NIFI-259: Applied patch for NIFI-1414 2016-01-20 09:14:04 -05:00
Mark Payne 1845f6df8d NIFI-1414: Ensure that the DirectoryStream is closed after streaming contents of a directory 2016-01-20 09:12:14 -05:00
Jeremy Dyer 8f688d4921 NIFI-1360 Add expression language support for "MergeContent" "Correlation Attribute Field" property 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-01-19 10:46:37 -08:00
Mark Payne d6a21537c1 NIFI-259: Do not require the State File anymore, since state management is being used now 2016-01-19 11:03:31 -05:00
smarthi 9e9182aa63 - Unit test creates resources in HOME directory This closes #174 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-01-19 09:44:03 -05:00
Mark Payne 16dcf4595c Merge branch 'master' into NIFI-259 2016-01-18 08:48:30 -05:00
Mark Payne eba25ecaca NIFI-259, NIFI-1339: Added OnConfigurationRestored annotation, always invoke onPropertyModified even on restart when properties are changed from defaults, as was done previously 2016-01-17 14:40:27 -05:00
Jeremy Dyer ecb81ec113 NIFI-1362 Set mime.type attribute on response FlowFile based on InvokeHTTP response Content-Type 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-01-15 16:40:36 -05:00
Mark Payne 0cd6f80f36 NIFI-259: Bug fixes 2016-01-13 15:11:53 -05:00
Mark Payne 0151b1eed1 NIFI-259: Fixed checkstyle violations 2016-01-13 13:57:47 -05:00
Mark Payne d39067ede6 NIFI-259: Update GetHBase to use new State Management feature; updated docs; bug fixes 2016-01-13 13:30:05 -05:00
Mark Payne bbce596d74 NIFI-259: Updated GetHBase to use new State Management; bug fixes; updated docs 2016-01-13 12:47:08 -05:00
Andy LoPresto c757c4d6ea NIFI-1385: Resolved test for missing file which was failing on Windows due to differing error message. 
Reviewed by Tony Kurc (tkurc@apache.org)
 2016-01-12 19:16:29 -05:00
Mark Payne 774c29a4da NIFI-259: Added Stateful annotation as described on ticket 2016-01-12 15:28:35 -05:00
Mark Payne b4bc105ea9 Merge branch 'nifi-1283' of https://github.com/jvwing/nifi 2016-01-12 10:49:04 -05:00
Mark Payne f6b34cbbc5 NIFI-259: Removed bad unit test 2016-01-12 10:40:00 -05:00
Mark Payne e559c68766 NIFI-259: Began updating processors to use new state management 2016-01-12 10:21:47 -05:00
Matt Gilman 44ffddd8b9 NIFI-1324: 
- Addressing lengthy lines contrib-check issue.
- This closes #162
 2016-01-12 09:42:31 -05:00