Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
3,622 Commits 143 Branches 197 Tags 390 MiB
Commit Graph

516 Commits

Author SHA1 Message Date
Giovanni Lanzani 31b943d2c1 NIFI-3408 Add exception class when InvokeHTTP fails 
This closes #1467.
 2017-02-07 08:51:22 +01:00
Joe Gresock 229b20f395 NIFI-3419: Routing flow files causing ZipException to failure in MergeContent 
This closes #1454.
 2017-02-06 19:34:49 +01:00
Nick Carenza 6466931c23 NIFI-3430 - added support for specifying sql.arg.N.format for timestamp fields according to java.time.format.DateTimeFormatter 
This closes #1468.
 2017-02-06 18:32:57 +01:00
Pierre Villard adfaffc773 Updated documentation of ListenHTTP 2017-02-03 22:53:29 +00:00
Matt Burgess 6d4901cd26 NIFI-2881: Added EL support to DB Fetch processors 
- Allow incoming flowfiles to GenerateTableFetch
- Incorporated review comments/discussions
- Updated documentation, added error attribute to GenerateTableFetch
- Corrected notes for column properties in fetch processors

This closes #1407.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2017-02-03 08:51:13 +09:00
Andre F de Miranda ea3c294f94
NIFI-819 - Extend GetHTTP to use dynamically add HTTP headers to a request 
This closes #1462.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2017-02-02 09:56:53 -05:00
Oleg Zhurakousky 390754c575 NIFI-3179 Added support for default UTF-8 char encoding 
removed deprected usage of BAOS and BAIS

This closes #1452.
 2017-01-31 15:33:20 +01:00
Koji Kawamura 7f0171ffa2
NIFI-3216: Add N signals to Wait/Notify 
- Support counters at Wait/Notify processors so that NiFi flow can be
  configured to wait for N signals
- Extract Wait/Notify logics into WaitNotifyProtocol
- Added FragmentAttributes to manage commonly used fragment attributes
- Changed existing split processors to set 'fragment.identifier' and
  'fragment.count', so that Wait can use those to wait for all splits
get processed

This closes #1420.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-01-19 15:17:59 -05:00
Matt Gilman 6170f6442e NIFI-3291: 
- Upgrading jQuery and it's plugins.
- Packaging at build time using npm.
 2017-01-17 14:54:59 -05:00
Jeff Storck def4918af0
NIFI-3330 Replaced two instances of multiple calls to getter methods during request attribute retrieval with a single call saved to a local variable to prevent null pointer exceptions during multiple invocations of a getter method. 
This closes #1415.

Signed-off-by: Bryan Rosander <brosander@apache.org>
 2017-01-13 18:09:28 -05:00
Joe Skora 4d533a99b3 NIFI-2861 ControlRate should accept more than one flow file per execution 
* Support multiple files per onTrigger call.

Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #1412.
 2017-01-12 21:43:12 +00:00
Joey Frazee 81aca7b97d NIFI-3302 Remove 'accepts incoming FlowFile' doc from QDT 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1406
 2017-01-09 10:40:29 -05:00
Mike Moser 3259b01f8e NIFI-3230 fix ActiveMQ SSL support for simple connect URIs in Get/Put JMS processors 
This closes #1344.
 2017-01-05 22:19:25 +01:00
Pierre Villard 9b47961d1c
NIFI-3231 Added EL support to hostname and port in PutTCP/UDP 
This closes #1361.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-01-03 12:09:19 -05:00
Bryan Rosander 1b4729e448
NIFI-3240 - AttributesToJson performance improvements 
This closes #1352.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2017-01-03 10:20:16 -05:00
Davy De Waele 55f4716f3d NIFI-3266 Added EL support for basePath and port in ListenHTTP 
This closes #1373.
 2016-12-30 16:35:46 +01:00
Joe Gresock 2ea8b4122b NIFI-3127: Fixing NPE for empty flow files in SplitText 
This closes #1358.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-12-28 11:21:44 +09:00
Joe Gresock af8ed8b7de
NIFI-3253: Correcting documentation in Notify processor 
This closes #1359.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-12-27 12:19:08 -05:00
Bryan Rosander 44c9ea0a66 NIFI-3236 - SplitJson performance improvements 
This closes #1347.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-12-22 15:22:53 +09:00
Bryan Rosander 4285157675
NIFI-3235 - EvaluateJsonPath performance improvements 
This closes #1346.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-12-21 16:29:23 -05:00
Joe Gresock 34627f78b7
NIFI-190: Initial commit of Wait and Notify processors 
This closes #1329.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-12-16 10:29:16 -05:00
Wesley-Lawrence 9a5986b0f6 NIFI-3175 Fix a bug in the ValidateCSV processor to handle empty CSV columns 
This closes #1311.
 2016-12-15 22:43:15 +01:00
Byunghwa Yun 0f462a7c49 NIFI-3029: QueryDatabaseTable supports max fragments property 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1213
 2016-12-14 10:51:27 -05:00
Byunghwa Yun 2b6d6c25d8 NIFI-2866 The Initial Max Value of QueryDatabaseTable won't be case-sensitive 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1212
 2016-12-05 12:50:43 -05:00
Mark Payne 8f8b8cdf46 NIFI-3071: Deprecated InputStreams & OutputStream sin org.apache.nifi.stream.io package in favor of using their Java counterparts 2016-12-05 09:29:19 -05:00
Koji Kawamura 8da38acf31 NIFI-3141: Fixed TailFile ArrayIndexOutOfBounds. 
- Added unit test cases to simulate NiFi version update which fails without this fix.
- Added state object migration code, add file.0. prefix to state keys,
  and add length from stored position.

This closes #1289
 2016-12-02 07:53:04 -05:00
Matt Burgess ba513447d7
NIFI-3076: Fixed handling of 'medium' unsigned integers in JdbcCommon 
This closes #1254.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-11-30 13:05:38 -05:00
joewitt 92f17a995b NIFI-3100-rc2 prepare for next development iteration 2016-11-25 23:49:27 -05:00
joewitt 5536f690a8 NIFI-3100-rc2 prepare release nifi-1.1.0-RC2 2016-11-25 23:49:13 -05:00
Jeff Storck 066accc274 NIFI-3086 Updated TailFile.java to deal with windows paths that were breaking the regex parsing Fixed documentation misspelling in TailFile.java Fixed assertions in several tests in TestTailFile that were dependent on the received order of flowfiles, this was differing between Windows and MacOS/Linux 
This closes #1264

Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-23 00:01:12 -05:00
Oleg Zhurakousky 913ae91614 Added posix guard to ignore tests on windows 
This closes #1259

Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-22 17:11:25 -05:00
Kathik Narayanan 9e884f6120 NiFI-3064 Convert to Avro fails when a MySQL query returns two columns with the same name even with different aliases 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1251
 2016-11-22 11:49:25 -05:00
joewitt fb9cbccc38 NIFI-2954 This closes #1244. Moved StandardPropertyValidator to nifi-utils, documented scope/purpose of a few util libs, removed deps from nifi-utils. 2016-11-21 16:30:42 -05:00
Matt Gilman 7f5eabd603
NIFI-3050: Implemented access control logic for restricted components. 
- Addressing comments from PR.
- Adding restricted tags to relevant components.
- Showing a restricted icon overlay on the processor node on the canvas. (+1 squashed commit)
Squashed commits:
[f487682] NIFI-3050:
- Introducing a Restricted annotation for components that require elevated privileges to use.
- Updating the new Processor, Controller Service, and Reporting Task dialogs to include these details and prevent unauthorized selection.
- Including the Restricted description in the generated component documentation.
- Updating processor access control integration test to verify restricted component creation.
- Updating the developer, user, and admin guide to include the restricted component policy.

This closes #1247.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-11-21 12:07:48 -08:00
Peter Wicks d65f46f7a5 NIFI-2750 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2750

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2750 Tweaking Property Retrieval

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1001
 2016-11-21 12:58:17 -05:00
Mark Payne 2ee66de1a6 NIFI-3066: Create unit test to reproduce bug that results in IllegalArgumentException: Cannot migrate FlowFiles from a Process Session to itself 
NIFI-3066: Ensure that when a Bin is created, it is always created with its own new session

This closes #1245
 2016-11-21 11:34:14 -05:00
James Wing 7206318ecf NIFI-3033 GenerateFlowFile Dynamic Properties 
This closes #1222.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-11-18 11:06:20 +09:00
Bryan Rosander e5eda63705
NIFI-2943 - Toolkit uses JKS type over PKCS12 when creating truststore because non-Bouncy Castle providers cannot read certificates from PKCS12 truststore. 
Peer review feedback (+2 squashed commits)
Squashed commits:
[0102c8e] NIFI-2943 - Peer review feedback
[9bcd495] NIFI-2943 - pkcs12 keystore improvements

1. loading pkcs12 keystores with bouncy castle everywhere
2. tls-toolkit client using jks truststore when keystore type is specified differently
3. tests

This closes #1165.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-11-16 17:13:10 -08:00
joewitt 45a5f5295c NIFI-2374 This closes #712. updated to latest tika versions where possible, updated doc, commented why cannot update media nar 2016-11-15 23:18:55 -05:00
Andre F de Miranda 3e571f9f1f NIFI-2374 - Adjust documentation wording to clarify IdentifyMimeType 
is a non exhaustive list of mime type values
 2016-11-15 22:42:21 -05:00
joewitt 6696529c99 Revert "NIFI-1893 Add processor for validating JSON" 
This reverts commit f11682202b.

Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-15 18:09:14 -05:00
joewitt 1c9077334f NIFI-2991 removed usage of json lib and components still using it 
Signed-off-by: jpercivall <JPercivall@apache.org>
 2016-11-15 18:09:09 -05:00
Oleg Zhurakousky 41f519e84c NIFI-2851 initial commit of perf improvements on SplitText 
- introduced org.apache.nifi.stream.io.util.TextLineDemarcator
- refactored SplitText to use org.apache.nifi.stream.io.util.TextLineDemarcator
- updated SplitText's capability discription to provide more clarity around splits with headers.
 2016-11-11 15:45:40 -05:00
Byunghwa Yun 91f0170416 NIFI-3027: ExecuteProcess supports the expression language 2016-11-11 14:41:35 -05:00
Pierre Villard 06f191ca10
NIFI-2912 Allow custom text in GenerateFlowFile 
This closes #1206.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-11-11 10:18:43 -08:00
Mark Payne c441a8696d NIFI-2850 This closes #1115. Added a migrate() method to ProcessSession and refactored BinFiles and MergeContent to use it 2016-11-09 16:25:03 -05:00
Jeff Storck cc2fbcaac4 NIFI-3008 Enabled expression language on BASE_DIRECTORY and FILENAME properties in TailFile 
This closes #1190
 2016-11-09 12:11:11 -05:00
patricker 4b4e099f2e NIFI-2764 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2764: Updated call to convertToAvroStream in TestJdbcCommon

This closes #1009
 2016-11-08 14:45:49 -05:00
Bryan Bende d1d053725b NIFI-2909 Adding per-instance class loading capability through @RequiresInstanceClassLoading annotation 
NIFI-1712 Applying per-instance class loading to HBaseClientService to allow specifying Phoenix Client JAR

-Refactoring the ClassLoading so that every processor, controller service, and reporting task gets an InstanceClassLoader with a parent of the NAR ClassLoader, and only components with @RequiresInstanceClassLoading will make a copy of the NAR ClassLoader resources, and addressing some review feedback

This closes #1156
 2016-11-08 13:21:27 -05:00
Matt Burgess 0841f14c18
NIFI-2928: Fixed checkstyle violation in FetchFile 
This closes #1180

Signed-off-by: Bryan Rosander <brosander@apache.org>
 2016-11-03 14:46:10 -04:00
Oleg Zhurakousky ed035f85e3 NIFI-2928 added support to validate accessibility of the file system 
NIFI-2928 polishing

This closes #1160
 2016-11-03 12:25:31 -04:00
patricker 2fb3b01ebe NIFI-2918 JDBC getColumnName may return empty string 
This closes #1149
 2016-11-02 13:13:34 -04:00
Matt Burgess 892c74dff2 NIFI-2819: Added support for Expresssion Language in ModifyBytes 
This closes #1130
 2016-11-02 13:02:25 -04:00
Koji Kawamura 9e90aae066 NIFI-2936: Fix TestExecuteProcess error on Travis. 
This closes #1162.
 2016-10-28 10:35:37 +02:00
Andre F de Miranda b864d49f66 NIFI-2341 - Introduce ParseCEF processor 
This closes #785
 2016-10-20 17:16:57 -04:00
Oleg Zhurakousky 611cadd231
NIFI-2919 Improved GetFile processor to fail (and provide bulletins) if target directory is inaccessible. 
This closes #1147.

Signed-off-by: Andy LoPresto <alopresto@apache.org>

Fixed typos in error messages, renamed variables in test, and cleaned up unnecessary imports. (+1 squashed commit)
Squashed commits:
[e755cbd] NIFI-2919 improved GetFile to fail if target directory is inaccessible
 2016-10-19 16:33:33 -04:00
Koji Kawamura 27dba60f27
NIFI-2905: Log error stream of ExecuteProcess cmd 
ExecuteProcess ignores error stream when Redirect Error Stream is
false, this commit let it to be logged instead so that user can see it on
bulletin.

This closes #1143.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-10-18 15:56:27 -07:00
Oleg Zhurakousky 5afbc43364 NIFI-2500 This closes #1131. made container queue configurable 2016-10-18 14:47:49 -04:00
Oleg Zhurakousky c883f98cbf NIFI-2906 removed unused memebr variables 
This closes #1144.
 2016-10-17 22:32:23 +02:00
Matt Burgess 596b98865b NIFI-2894: Fixed typo in PutSQL documentation 
This closes #1129
 2016-10-14 12:45:34 -04:00
Pierre Villard 3c8545a902 NIFI-1912 - PutEmail fixed format when attachment 
Correction as suggested by users in JIRA.
+ adding a unit test to check attachments.

This closes: #1081

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
 2016-10-06 21:34:56 +11:00
Andre F de Miranda 3b408f5601 NIFI-2816 - Clean typos across the code - Part 2. This closes #1085 2016-10-05 13:07:57 -04:00
Byunghwa Yun 28acb07433 NIFI-2811 JdbcCommon doesn't convert bigint(20) column. 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1053
 2016-09-27 10:18:48 -04:00
Yolanda M. Davis 30f008d676 NIFI-2822 - pass the JWT Authorization token i. This closes #1065 2016-09-26 15:16:32 -04:00
Byunghwa Yun 8868235993 NIFI-2803 The pagination of GenerateTableFetch has a sort bug. 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2803: Updated unit tests for GenerateTableFetch

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1052
 2016-09-26 12:05:16 -04:00
Andre F de Miranda 446cd44702 NIFI-2816 - Clean typos across the code 
This closes #1057.
 2016-09-26 17:47:31 +02:00
Pierre Villard 44d4b882bf NIFI-2071 - Support repeating capture groups in ExtractText 
This closes #1050.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-09-26 17:22:21 +09:00
Mike Moser 5a3d00c7bb NIFI-2636 resolve thread safety problem in UnpackContent 
Signed-off-by: Joe Skora <jskora@apache.org>
 2016-09-23 13:25:03 -04:00
Scott Aslan e973874793 [NIFI-2781] removing bower and allowing npm to manage client side resources in nifi-web-ui and nifi-jolt-transform-json-ui. This closes #1030 2016-09-22 14:50:21 -04:00
Bartosz Wozniak f11682202b NIFI-1893 Add processor for validating JSON 
This closes #1037.
 2016-09-22 13:08:34 +02:00
Byunghwa Yun 77f8503e98 NIFI-2802 The implementation classes don't support orderByClause. 
This closes #1044.
 2016-09-22 12:21:43 +02:00
Nicolas Dupont be83c0c5b2 NIFI-1844 - Added ListFTP and FetchFTP processors 
This closes #881.
 2016-09-21 17:40:38 +02:00
Peter Wicks 938c7cccb8 NIFI-2749 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #997
 2016-09-21 11:16:57 -04:00
Pierre Villard 930e95aa00 NIFI-1170 - Improved TailFile processor to support multiple files tailing 
This closes #980
 2016-09-21 10:05:39 -04:00
Matt Burgess 68291636cb
NIFI-1841: Fixed support for CLOB/BLOB types 
This closes #1035.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-09-20 15:33:06 -04:00
Pierre Villard d838f61291 NIFI-1942 Processor to validate CSV against user-supplied schema 
This closes #476

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-09-16 11:13:07 -04:00
Andy LoPresto 022f5a506d NIFI-2266 Refactored GetHTTP processor to use SSLContext protocol vs. hard-coded TLSv1. 
This closes #999.
 2016-09-16 00:08:08 +02:00
Pierre Villard c1ad913598 NIFI-1342 Added default User-Agent in PostHttp 
This closes #1021
 2016-09-15 09:57:09 -04:00
Joe Skora c72a9aa54b NIFI-2752 Correct ReplaceText default pattern and unit tests 
* Corrected the DEFAULT_REGEX pattern.
 * Added tests to isolate regex capture group problem and verify corrected functionality.
 * Removed short circuit logic that masked configuration errors and created inconsistent processor behavior.

This closes #1007.
 2016-09-13 22:55:55 +02:00
Matt Burgess d325773760 NIFI-2262: Added Avro-normalization of table/column names in SQL processors 
This closes #994.
 2016-09-13 15:46:33 +02:00
Kirk Tarou e25885650a NIFI-2440 - Add 'file.lastModifiedTime' attribute to ListSFTP processor 
Added 'file.lastModifiedTime' attribute to ListFileTransfer, which is
the abstract class extended by ListSFTP.
String literal attribute names were replaced with static references to
attribute name constants in ListFile.
ListFileTransfer stores the 'file.lastModifiedTime' attribute in the
format specified in ListFile.FILE_MODIFY_DATE_ATTR_FORMAT

Updated WritesAttribute description for file last modify time attribute
to mirror the entry in ListFile

Signed-off-by: Joe Skora <jskora@gmail.com>

This closes #931.
 2016-09-09 22:44:23 -04:00
Matt Burgess 2afc739ab7 NIFI-2712: Fixed Fetch processors for multiple max-value columns. This closes #976 2016-09-06 16:52:40 -04:00
Andy LoPresto 8556777bf6
NIFI-2618 Reverted merging PR 955 to master as 1.0.0 requires Java 8. 2016-08-30 09:27:24 -07:00
Andy LoPresto d600b065bb
NIFI-2618 Added logic to unit test to handle default TLS version for Java <= 7. 
This closes #955.
 2016-08-30 08:25:38 -07:00
Joseph Percivall 1fe18a1567 NIFI-2676-rc1 prepare for next development iteration 2016-08-26 11:40:58 -04:00
Joseph Percivall 74d5224783 NIFI-2676-rc1 prepare release nifi-1.0.0-RC1 2016-08-26 11:40:44 -04:00
Bryan Rosander 102a9a2b74 NIFI-2674 - Always adding flow files to result set flowfiles, catching runtime exceptions while converting to avro 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #953
 2016-08-25 21:16:26 -04:00
joewitt 1624dd8e4d NIFI-2666 This closes #947. updated where it says BSD to say MIT for bcrypt 2016-08-25 14:59:46 -04:00
Matt Burgess ad7808f63d NIFI-2641: This closes #928. Add max values as attributes to QueryDatabaseTable 2016-08-25 14:13:55 -04:00
Peter Wicks e210172d93 PutSQLBinary 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2591

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2591

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2591 - Added Format option for binary data types. Updated unit tests.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #883
 2016-08-25 08:41:23 -04:00
Matt Burgess ee9bd94082 NIFI-2632: Added fragment attributes to SplitJson and SplitXml 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #919
 2016-08-23 16:30:57 -04:00
Jeff Storck dca3764ed1 NIFI-2626 Fixes jetty server thread leak. This closes #910 2016-08-22 15:58:06 -04:00
Joe Gresock 17dec04939 NIFI-2611: Fixing bugs in UnpackContent with flow file unpackers 
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #905
 2016-08-22 14:47:24 -04:00
Joe Skora a2d3d0c289 Update to support offsets larger than 2 gigabyte. 2016-08-22 11:02:48 -04:00
Joe Skora 02071103d0 * Add "Remove All Content" property, related functionality, and tests to ModifyBytes processor to allow deletion of all flow file content. 
* Removed @Ignore annotation on class and unnecessary EOL translation of test data.  Because ModifyBytes treat input as binary data, not text, line endings don't matter as long as they byte offsets are calculated correctly.
* Replace validator with .allowableValues.

This closes #890.
 2016-08-19 20:05:14 +02:00
Matt Gilman 87161ab96e
NIFI-2595: - Updating ReportingTasks to use ComponentLogger instead of creating Controller level bulletins. 
- Making the bulletin responses consistent in that all bulletins will be included but in redacted form as appropriate.
- Fixing broken unit test.

This closes #892.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-18 17:06:28 -04:00
Mark Payne 567535c3d0 NIFI-2382: Fixed typo in documentation 2016-08-18 09:15:55 -04:00
Mark Payne 91a59a8a5a NIFI-2545: Ensure that when @OnUnscheduled and @OnStopped methods are called that the active thread count takes that thread into account 
This closes #836.
 2016-08-18 08:33:45 -04:00
Peter Wicks 7bc7b7f683
NIFI-2584 Fixing date format in PutSQL 
This closes #878.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-17 16:10:56 -04:00
Andy LoPresto 0ffdc2eb92
Merge branch 'master' of https://github.com/apache/nifi 
(Apologies for merge commits, but it was not possible to rebase the 2574 commits (PR 872)).

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-08-17 10:58:38 -07:00
Peter Wicks a0d1aae603 NIFI-2583 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2582

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2582

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #877
 2016-08-17 13:20:44 -04:00
Peter Wicks 1470a52b1b NIFI-2582 NIFI-2583 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2583 Tweaks

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #877
 2016-08-17 13:19:56 -04:00
joewitt d9633757a6 NIFI-2574 fix spring context definitions 2016-08-17 03:38:31 -07:00
joewitt 7d7401add4 NIFI-2574 Changed NiFiProperties to avoid static initializer and updated all references to it. 2016-08-17 00:10:07 -07:00
Peter Wicks b22500d0a3
NIFI-2576 Allowing PutSQL to use timestamps in epoch or string format 
This closes #869.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-16 10:26:24 -04:00
Mark Payne 6af768d0a1 NIFI-2551: Addressed a threading issue in the StandardResourceClaimManager and performed some refactoring so that we can ensure thread-safety across different components of the application, such as ProcessSession and WriteAheadFlowFile Repository when interacting with the StandardResourceClaimManager. Update DebugFlow to allow it to write to a FlowFile multiple times, which exposes the concurrency bug. Also avoided calling ContentRepository.remove() from ProcessSession whenever the content is no longer needed, as that can cause problems now that the Resource Claim is backing the content claim. 2016-08-15 17:02:15 -04:00
Peter Wicks 44057f097a
NIFI-2356 ConvertJSONToSQL assumes IS_AUTOINCREMENT 
This closes #862.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-15 14:17:16 -04:00
Matt Burgess d544274881
NIFI-2531: Fixed JdbcCommon handling of BigInteger objects for Avro 
This closes #823.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-10 15:19:34 -04:00
Joey Frazee bb24312709 NIFI-2142 Added Guava cache for XSLT stylesheets in TransformXml 
This closes #609

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-10 11:13:30 -04:00
Matt Burgess 557d6365bf NIFI-2518: Added unit test showing issue 
NIFI-2518: Added support for fractional seconds to AbstractDatabaseFetchProcessor

This closes #821
 2016-08-10 11:10:17 -04:00
Bryan Rosander 2dc094765d NIFI-2516 - Extract version info into parent pom, upgrade to commons-io 2.5 
NIFI-2516 - Removing slf4j-api, version from slf4j-log4j12

This closes #809.
 2016-08-09 22:43:29 +02:00
Kirk Tarou e2f649cfea NIFI-2470 This closes #802. 
Fixed WritesAttributes section to include all attributes with the
correct attribute names and descriptions
 2016-08-07 23:58:09 -04:00
joewitt 6bcc415eb8 NIFI-2457 removed old state file mechanism and fixed state reset logic 
This closes #768.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-02 12:11:43 -04:00
joewitt 05a99a93cb NIFI-2208 This closes #754. refactored as per comments on JIRA. Reduced API expsosure and tightened lifecycle management. 2016-08-01 14:17:26 -04:00
Yolanda M. Davis 8412d2662a NIFI-2208 - initial commit Custom Property Expression Language support with Variable Registry, includes bug fix for NIFI-2057 
This closes #529

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-29 17:10:20 -04:00
Yolanda M. Davis 35c0e1436e NIFI-2310 - upgraded jolt to 0.0.21 to resolve special character issue 
This closes #674

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2016-07-21 10:35:42 +09:00
Matt Burgess f1ba240326 NIFI-2156: Add ListDatabaseTables processor 
This closes #642

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-19 13:00:43 -04:00
Matt Burgess 01cae23745 NIFI-2157: Add GenerateTableFetch processor 
This closes #645

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-17 17:54:42 -04:00
Koji Kawamura e89ee11199 NIFI-619: Make MonitorActivity more cluster friendly 
With this commit, MonitorActivity can be configured as:

- Monitor activity per node individually
- Monitor cluster wide activity
  - Send notification flow-file from all of nodes
  - or only from a primary node

Changes:
- Added 'Monitoring Scope' property
- Added 'Reporting Node' property
- Falls back from cluster scope to node scope if necessary
- Persist the latest activity as Cluster state
- Examine cluster state on each node if necessary
- Only update the cluster state if current timestamp is later than existing
  timestamp stored in Zookeeper

This closes #575

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-07-15 12:47:37 -04:00
Aldrin Piri d1129706e2 NIFI-1896 This closes #650. Refactored nifi-api into nifi-framework-api and other locations. The nifi-api is specific to that which is needed for intended extension points. 2016-07-14 18:24:48 -04:00
Yolanda M. Davis 048ba5366c NIFI-2020 - initial commit for custom transformation support 
NIFI-2020 - updates to use lambdas/stream wherever possible and fix potential nullpointer issue.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #564
 2016-07-14 18:04:14 -04:00
Andy LoPresto 4e3580f58e
NIFI-1688 Resolved issue in PostHTTP -- now uses SSLContextService's protocol setting. Modified construction of SSLSocketFactory to avoid hardcoding supported protocol. Added debug information for supported cipher suites. 
This closes #624.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-07-14 16:43:48 -04:00
joewitt f987b21609 NIFI-1157 searched for and resolved all remaining references to deprecated items that were clearly addressable. 2016-07-14 09:32:35 -04:00
Mark Payne 32b8a9b9f4 NIFI-1877, NIFI-1306: Add fields to FlowFile for FIFO Prioritizer, Oldest/Newest FlowFile first prioritizers to work properly 
This closes #546
 2016-07-05 14:59:08 -04:00
Joe Gresock e3d13ecf50 NIFI-920: Adding InvalidPathException handling to UnpackContent 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-06-27 13:49:49 -04:00
Matt Gilman f0811ca45a NIFI-1554: 
- Addressing access controls for the Controller resource.
- Addressing access controls for RAW site to site clients.
- Addressing access controls for downloading content (from provenance and queue).
- Addressing access controls for accessing queues.
- Addressing access controls for cluster endpoints.
- Addressing access controls for counter endpoints.
- Removing redundant authorization calls.
NIFI-2044:
- Requiring revision when creating components.
- Requiring component creation over POST requests.
NIFI-1901
- Continuing to restore access control tests.
- Converting access control tests to itegration tests.
- Restoring contrib check to travis build.
- This closes #567
 2016-06-23 17:09:54 -04:00
jpercivall f0662a24ef NIFI-2092 Fixing unit tests which try to clean up directories before stopping the FlowController that has locks opened. 
This closes #568
 2016-06-23 16:40:00 -04:00
Bryan Bende 4f2643f668 NIFI-2061 Added methods to AbstractPolicyBasedAuthorizer to generate and inherit a fingerprint 
- Updated StandardFlowSynchronizer to compare authorization fingerprints
- This closes #566
 2016-06-23 14:36:04 -04:00
Oleg Zhurakousky 1eeef0e1c0 NIFI-2067 ignored intermittently failing MemoryTest left comment with the explanation as to why it was not removed 
This closes #555

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-06-21 22:18:13 -04:00
Pierre Villard ef192cc859 NIFI-1751 Added proxy authentication in InvokeHttp processor 
This closes #398.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-06-21 14:09:02 -04:00
Andy LoPresto a6e96953f6 Removed duplicate dependency declaration from nifi-standard-processors/pom.xml. 
This closes #551.
 2016-06-21 19:25:01 +02:00
jpercivall cd846c8d62 NIFI-1834 adding fixes to PutTCP 
This closes #543
 2016-06-21 12:05:39 -04:00
Matt Brown a7c912ac18 PutTCP Processor created. 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-06-21 12:05:13 -04:00
Yolanda M. Davis cb3aa8f5c9 NIFI-1850 - Initial Commit for JSON-to-JSON Schema Converter Editor (merge from 0.7.0 - refactor for masterless cluster). This closes #511 2016-06-20 20:30:25 -04:00
ricky f5060a6d63 NIFI-1568: Add Filter Capability to UnpackContent 
Adds a "File Filter" property to the `UnpackContent` processor
to allow users to specify which files are eligible for extraction.
By default, all files will be extracted.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

Refactor how Unpacker is initialized

Re-uses unpackers to avoid creating them each time a
flowfile is received. Moved the package formats into
an enum for clarity.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

Fix packaging format enum warning

The `AUTO_DETECT_FORMAT` enum for PackagingFormat
is not valid for initilization. When this value
is set, then we use the mime.type to determine
which packaging format to use.

We never pass `AUTO_DETECT_FORMAT` to the
`initUnpacker` method.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #248
 2016-06-20 10:44:38 -04:00
Pierre Villard e6250d18cf NIFI-1620 Allow empty Content-Type in InvokeHTTP processor 
This closes #272.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-06-18 12:47:07 -04:00
Adam Lamar db9a79f79d NIFI-1578: Create PutSlack processor 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #256
 2016-06-17 15:32:17 -04:00
Joshi 541bbc0932 NIFI-1549: Fix JMSConsumer exception 
This closes #539
 2016-06-17 12:16:36 -04:00
Oleg Zhurakousky 8e4a4532df
NIFI-1690 Changed MonitorMemory to use allowable values for pool names 
- removed dead code from MonitorMemory
- added MonitorMemoryTest
- minor refactoring in MonitorMemory
- initial fix for NIFI-1731 (WARN/INFO logging) that was required by MonitorMemoryTest

NIFI-1690 polishing

NIFI-1690 address PR comments, removed default value for MEMORY_POOL_PROPERTY

NIFI-1690 addressed latest PR comments

NIFI-1690 fixed breaking changes

Fixed checkstyle issue in StandardProcessScheduler. (+2 squashed commits)
Squashed commits:
[03829c4] Fixed checkstyle issues.
[cb20fe6]

This closes #328.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-06-16 15:17:13 -07:00
Joe Skora 4723f8e24c NIFI-1829 - Create new DebugFlow processor. 
Signed-off-by: Mike Moser <mosermw@apache.org>
This closes #458
 2016-06-16 17:23:19 -04:00
Andy LoPresto 8b0c5a4911 NIFI-1981 Resolved issue where cluster communication without client certificates would fail even if needClientAuth set to false. 
Fixed IDE setting for import wildcarding on Groovy files. (+4 squashed commits)
Squashed commits:
[4c3b174] NIFI-1981 Lowered logging level of client auth setting on cluster connection receive.
[b50f473] NIFI-1981 Finished logic to suppress exception on missing client certificates when clientAuth is set to WANT.
Added unit tests for CertificateUtil methods.
[ace35a2] NIFI-1981 Added test scope dependency on BouncyCastle and BC PKIX modules for CertificateUtils tests.
[2c463d1] NIFI-1981 Added ClientAuth enum and CertificateUtil methods to extract this setting from an SSLSocket.
Added logic to compare X509Certificate DNs regardless of RDN element order.
Added logic to suppress peer certificate exceptions when client authentication is not required.
Removed duplicate dependency in pom.xml.
 2016-06-14 11:18:31 -04:00
Mike Moser cc95e5d8c5 NIFI-1937 GetHTTP configurable redirect cookie policy 
Reviewed by Tony Kurc (tkurc@apache.org). This closes #479
 2016-06-11 11:22:33 -04:00
Matt Burgess 3b99e12352 NIFI-1973 Allow ExecuteSQL to use flow file content as SQL query 
This closes #498.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-06-07 17:26:58 -04:00
Mark Bean 1ac44a0a4b NIFI-1118 adding SplitText features of size limit and header marker characters 
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #444
 2016-06-07 11:37:23 -04:00
Oleg Zhurakousky cee2426df6 NIFI-1956 added 'keyboard-interactive' option to SFTPTransfer 
This closes #487.
 2016-06-06 19:32:16 +02:00
Thad Guidry c090cdf29a Added details about data size in description. 
added "in bytes" to further explain the Segment Size property.

This closes #494
 2016-06-06 09:50:57 -04:00
jpercivall 54c5c28cbb NIFI-1943 added proper ReadsAttribute to PutFile 
This closes #480
 2016-06-02 13:04:14 -04:00
jpercivall 4f101294eb NIFI-1265 Fixing InvokeHttp tests. 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-06-02 09:49:57 -04:00
Matt Gilman e587c99855 NIFI-1265: 
- Upgrading to Jetty 9.3.
 2016-06-02 09:49:57 -04:00
Andre F de Miranda bcead3500d NIFI-1945 - Corrects minor issue in "<Hash Attribute Name>" description 
This closes #481.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
 2016-06-01 21:13:59 +02:00