Commit Graph

329 Commits

Author SHA1 Message Date
Mark Payne 8f942fcdcc NIFI-1000: Fixed checkstyle violation in TestGetJSMQueue use activemq-broker with test scope and activemq-client with default scope rather than pulling in activemq-all; this reduces size of standard nar from 30 MB to 18 MB 2015-11-10 14:31:20 -05:00
Mark Payne 53725b5c72 Merge branch 'NIFI-1000' of https://github.com/olegz/nifi into NIFI-1000 2015-11-10 13:34:56 -05:00
Oleg Zhurakousky 8699e35108 NIFI-1000 addressed PR comments 2015-11-10 12:13:16 -05:00
Mark Payne 11768cc388 NIFI-1141: Fixed the order of the arguments to the setCurrentContentClaim method 2015-11-10 11:35:14 -05:00
Bryan Bende e748fd5848 NIFI-817 Processors for interacting with HBase
- Refactoring PutHBaseCell to batch Puts by table
- Adding optional Columns property to GetHBase to return only selected column families or columns
- Making GetHBase cluster friendly by storing state in the distributed cache and a local file
- Adding Initial Time Range property to GetHBase
- Adding Filter Expression property and custom validate to prevent using columns and a filter at the same time
- Creating an HBaseClientService controller service to isolate the HBase client and support multiple versions
- Creating appropriate LICENSE/NOTICE files
- Adding @InputRequirement to processors
- Addressing comments from review, moving hbase client services under standard services
- Making sure result of session.penalize() is assinged to FlowFile variable before transferring
2015-11-10 11:13:51 -05:00
Tony Kurc 2a90bd501b NIFI-797 Corrected URL for PutS3 to include correct protocol and endpoint by region.
- corrected a missed 'final' on org.apache.nifi.processors.aws.AbstractAWSProcessor.relationships
 - added protected method org.apache.nifi.processors.aws.AbstractAWSProcessor.getRegion()
 - added protected method org.apache.nifi.processors.aws.s3.AbstractS3Processor.getUrlForObject(String, String)
 - explicitly set AWS client protocol to HTTPS, and created a static final field with comments if other protocols may be considered
 - added a static final field for the UserAgent

Reviewed by Aldrin Piri <aldrin@apache.org>
2015-11-10 06:37:56 -05:00
Oleg Zhurakousky ef0be5a5d6 NIFI-1000 Fixed JmsFactory to properly obtain destiniation name
Re-enabled JMS Tests that were annotated with @Ignore
2015-11-09 18:35:31 -05:00
Mike Moser b75af5b344 Merge branch 'NIFI-1085' 2015-11-09 16:13:12 -05:00
joewitt 41f3875347 NIFI-1134 2015-11-09 15:37:40 -05:00
Mark Payne 73c1671975 NIFI-1132: Limited number of Lineage Identifiers held to 100 and marked the getLineageIdentifiers() method as deprecated 2015-11-09 12:09:56 -05:00
Mark Payne 5f8fdae909 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2015-11-09 12:07:45 -05:00
joewitt 64b1fc983c NIFI-925 reviewed patch/ builds well/ fixed licensing gaps. 2015-11-08 22:15:11 -05:00
Mark Payne 59a49aea12 Revert "NIFI-1082: Ensure that events returned from the provenance repository are ordered such that newest events are provided first"
This reverts commit cf8ca3dc2c.
2015-11-08 21:46:06 -05:00
Tony Kurc 440e4c4940 NIFI-1106 fixed platform-specific object separator. 2015-11-08 12:27:41 -05:00
Venkatesh Sellappa 77de51df19 NIFI-1025 Updated aws-sdk and joda-time to resolve AWS issues with Java 1.8 update 60.
- Refactored tests - created AbstractS3Test for common utility methods
 - Corrected incorrect unit test in TestDeleteS3Object, and adjusted processor documentation to reflect behavior
 - moved aws dependency management to root pom

This closes #107

Tested, Reviewed and Amended by Tony Kurc (<tkurc@apache.org>)
2015-11-07 21:09:18 -05:00
joewitt 99629646fe NIFI-1122 moved to 0.4.0-SNAPSHOT 2015-11-06 23:41:15 -05:00
Mark Payne 0d6e81b54f Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2015-11-06 09:16:12 -05:00
Bryan Bende ee87f33ce7 Fixing check-style violation in StandardFlowFileQueue 2015-11-06 09:10:10 -05:00
Mark Payne 1a388f957e NIFI-1111: We were subtracting values in the wrong order so that we always would 'yield' for a negative amount of time, which equated to not yielding at all. 2015-11-06 09:03:38 -05:00
Mark Payne 98f5a1ab77 NIFI-1110: Fixed bug that caused queue size to become negative when FlowFiles are expired
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-11-05 12:12:02 -05:00
Bryan Bende 4ac52bfc0a Removing nifi-azure-bundle that was incorrectly added to master 2015-11-05 10:42:10 -05:00
Andrew Grande f1bd3d471d NIFI-1112 Fixed APIOperation Annotation on ReportingTaskResource.
Reviewed by Tony Kurc (tkurc@apache.org)
2015-11-04 18:31:34 -05:00
Bryan Bende 618f22e110 NIFI-274 - Fixing TestListenSyslog, fixing default buffer size to be bytes, adding syslog.protocol to attributes
- Adding syslog.port to ListenSyslog attributes, logging at warn level when rejecting tcp connections
         - Adding @InputRequirement to processors and adding appropriate send and receive provenance events
2015-11-04 18:01:59 -05:00
Tony Kurc 5611dac3f8 NIFI-274 - added use of Selectors for TCP and UDP connections. Added a max connections to the TCP thread
- Added comments and code review changes
         - fixed fixbugs bug
2015-11-04 18:00:18 -05:00
Bryan Bende 9c542432da NIFI-274 Adding ListenSyslog and PutSyslog to standard processors.
- Refactoring connection handling on put side, removing number of buffers from properties and basing it off concurrent tasks for the processor.
- Refactoring some of the TCP handling so it keeps reading from a connection until the client closes it
- Adding an error queue
- Adding a sender field on the syslog event to record the system that sent the message
2015-11-04 17:56:13 -05:00
Mike Moser 6add372bc1 NIFI-1085 WebClusterManager fair locking and HeartbeatMonitoringTimerTask scheduling 2015-11-04 12:19:00 -05:00
Matt Gilman 201eac052b NIFI-1098 - Ensuring we pull the correct attribute from the servlet context. Reviewed by Tony Kurc (tkurc@apache.org) 2015-11-04 12:11:19 -05:00
Mark Payne fedbe40313 NIFI-1103: Added InputRequirement annotation 2015-11-04 11:11:33 -05:00
Mark Payne 2b1d093120 NIFI-1105: Only trigger a processor that requires input to run if data is available for it process 2015-11-04 08:41:10 -05:00
Mark Payne dbf0c7893f NIFI-730: Completed merging of master 2015-11-02 14:31:28 -05:00
Mark Payne e4cebba3c7 Merge branch 'master' into NIFI-730 2015-11-02 14:02:16 -05:00
Joseph Percivall a549621267 NIFI-1077 enabling expression language on ConvertCharacterSet input and output
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-11-02 11:46:17 -05:00
Mark Payne 814e8b212c Merge branch 'NIFI-1082' 2015-11-02 11:29:52 -05:00
Mark Payne abf2c62884 NIFI-1051: Fixed checkstyle violations 2015-11-02 11:01:50 -05:00
Mark Payne 7a73867c46 Merge branch 'NIFI-1051' of https://github.com/olegz/nifi into NIFI-1051 2015-11-02 10:51:43 -05:00
Joseph Percivall 2ae49026e8 NIFI-883 Fixing issue HandleHttpRequest had with PrimaryNodeOnly scheduling
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-11-02 10:32:14 -05:00
Matt Gilman 5a04021dd7 NIFI-730:
- Updating logic now that original is guaranteed to be non null.
- Always reporting 100% once the drop request has completed.
2015-11-02 08:59:11 -05:00
Mark Payne f5727cfb0f NIFI-730: Ensure that we always populate queue counts when initiating a Drop FlowFile request 2015-11-02 08:36:50 -05:00
Mark Payne ad849c77df NIFI-1090: Fixed log message that was at info level but should have been debug level 2015-11-01 14:37:01 -05:00
Mark Payne b729bf4c19 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2015-11-01 14:16:54 -05:00
Mark Payne 6e193dffa3 Merge branch 'NIFI-1088' 2015-11-01 14:16:35 -05:00
Joseph Percivall cef7b6c736 NIFI-1080 fleshed out InvokeHttp unit tests
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-10-31 00:19:36 -04:00
Mark Payne 9c148da1c2 NIFI-869: Fixed checkstyle violations 2015-10-30 16:09:50 -04:00
Mark Payne ba72452f66 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2015-10-30 16:02:15 -04:00
Oleg Zhurakousky a3d43d23dc NIFI-869 Fixed SimpleProcessLogger to log correct messages Ensured that SimpleProcessLogger correctly interprets Throwable as discussed in JIRA Added tests
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-10-30 15:52:33 -04:00
Oleg Zhurakousky 90aea01350 NIFI-869 Fixed formatting issue Fixed formatting issue with printed error message which only apears when NiFi is cnfigured using Logback. Please see NIFI-869 for more details
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-10-30 15:52:33 -04:00
Jeremy Dyer eb389cf84c NIFI-1079 Replacing Name for NULL_VALUE_FOR_EMPTY_STRING as I had accidentally removed it.
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-10-30 14:30:56 -04:00
Jeremy Dyer aef0d8fe9b NIFI-1079 Check style and documentation based updates recommended by user bbende on Github pull request
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-10-30 14:30:42 -04:00
Jeremy Dyer 217b1049cf NIFI-1079 Added Destination Property to control if JSON goes to Attribute or
Content of FlowFile. Added Include Core Attributes Property to control
if FlowFile CoreAttributes are included in the JSON output or not.
Added Null value for Empty String flag to control if empty values in
the JSON are empty string or true NULL values. Added more tests and
minor text refactoring per Github comments

Signed-off-by: Bryan Bende <bbende@apache.org>
2015-10-30 14:30:25 -04:00
Jeremy Dyer 19b7a4cc7d NIFI-1079 Create a new Attribute from the existing FlowFile attributes by taking
either all of the existing attributes or a user defined list. The
existing Attributes are converted to JSON and placed in a new Attribute
on the existing FlowFile as Attribute “JSONAttributes”

Signed-off-by: Bryan Bende <bbende@apache.org>
2015-10-30 14:29:29 -04:00
Mark Payne 9515b74607 NIFI-1088: Ensure that FlowFile is penalized before routing to failure 2015-10-30 14:25:27 -04:00
Mark Payne bfa9e45079 NIFI-994: Ensure that processor is not valid due to the tail file not yet existing 2015-10-30 11:44:51 -04:00
Oleg Zhurakousky 5c4042bd7c NIFI-1051 Allowed FileSystemRepository to skip un-readable entries.
The exception was caused due to basic file permissions. This fix overrides
'visitFileFailed' method of SimpleFileVisitor to log WARN message and allow
FileSystemRepository to continue.
2015-10-29 16:31:17 -04:00
Bryan Bende 5cc2b04b91 NIFI-986 Refactoring of action classes from nifi-user-actions to have interfaces in nifi-api, and adding getFlowChanges to EventAccess
- Fixing empty java docs and adding sort by id asc to the history query
- Changing userDn to userIdentity in Action and FlowChangeAction
- Modifying NiFiAuditor to always save events locally, and implementing getFlowChanges for ClusteredEventAccess
2015-10-29 16:28:36 -04:00
Bryan Bende c4f0cb1c6c Removing nifi-pcap-bundle/.gitignore 2015-10-29 12:06:25 -04:00
Mark Payne cf8ca3dc2c NIFI-1082: Ensure that events returned from the provenance repository are ordered such that newest events are provided first 2015-10-28 17:32:51 -04:00
Mark Payne edf238e004 NIFI-730: Do not require a Read Lock in order to obtain backpressure configuration values for FlowFileQueue's 2015-10-28 10:27:58 -04:00
Mark Payne dc4004de64 Merge branch 'NIFI-977' 2015-10-27 16:53:38 -04:00
Mark Payne af19053a7f Merge branch 'NIFI-447' 2015-10-27 10:42:46 -04:00
Joseph Percivall 07238c7913 NIFI-447 adding replacement strategy to ReplaceText processor
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-10-27 10:37:43 -04:00
Joseph Percivall b885f955f4 NIFI-516 adding option to StandardProcessSession.read to close stream
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-10-26 20:23:13 -04:00
Mark Payne 1c1738670c NIFI-10: Updated FetchHDFS, FetchFileTransfer to use new FETCH provenance event 2015-10-26 17:14:29 -04:00
Mark Payne fc2aa2764c NIFI-10: Added FETCH and DOWNLOAD Provenance Events; updated FlowController to use DOWNLOAD event instead of SEND whenever a user downloads/views content via Provenance Event 2015-10-26 14:58:50 -04:00
Mark Payne 51f564024a NIFI-10: Added FETCH Provenance Event and updated processors to use this new event type 2015-10-26 14:58:50 -04:00
Mark Payne aec32a277c NIFI-1070: Added detailed debug-level logging about how FileSystemRepository is choosing to expire archived data 2015-10-26 14:36:03 -04:00
Matt Gilman f8c3377c84 NIFI-820:
- Creating a context menu item for accessing provenance directly for a selected component.
2015-10-26 10:16:01 -04:00
Luke Williamson 26edab3185 NIFI-908 Added support for SSL in JMS connections.
- Added SSL context to JMS producer and consumer processors
 - Tony Kurc Amended patch to check SSL need by scheme and exception consistency
Reviewed by Tony Kurc (tkurc@apache.org)
2015-10-26 00:29:05 -04:00
Mark Payne 8d2f9bc64b NIFI-1056: Do not treat BigDecimal, BigInteger the same way we treat Number's when serializing to Avro because Avro Java Library doesn't support them
Reviewed and Unit Test Amended by Tony Kurc (tkurc@apache.org)
2015-10-25 11:31:30 -04:00
Mark Payne 385bfbb2c6 NIFI-673: Rebased from master; Added InputRequirement annotation, as it is now merged into master 2015-10-25 11:14:11 -04:00
Mark Payne 4e38288062 NIFI-673: Added sftp.listing.user attribute to FlowFiles created by ListSFTP; ensure that FetchSFTP indicates that the username supports Expression Language 2015-10-25 11:13:02 -04:00
Mark Payne b0322d9ffe NIFI-673: Added Completion Strategy to FetchSFTP 2015-10-25 11:13:02 -04:00
Mark Payne d1d57931bf NIFI-673: Initial implementation of ListSFTP, FetchSFTP 2015-10-25 11:13:02 -04:00
Mark Payne 8a80060851 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2015-10-25 11:11:49 -04:00
Mark Payne 0636f0e731 NIFI-810: Merged master into branch 2015-10-25 11:02:40 -04:00
ricky f2c4f2d2a1 [PATCH] NIFI-997 Periodically attempt a kerberos relogin in AbstractHadoopProcessor
- attempt a relogin based on an interval specified in the processor configuration
 - use hadoop's UserGroupInformation.checkTGTAndReloginFromKeytab to determine if a relogin is necessary based on the ticket and do so if needed
 - improve code readability with HdfsResources object in AbstractHadoopProcessor

Reviewed and Amended by Tony Kurc (tkurc@apache.org). This closes #97
2015-10-25 00:49:58 -04:00
Mark Payne d63cd6bd2f Merge branch 'NIFI-1010' 2015-10-23 14:39:16 -04:00
Mark Payne 88fc8d28a0 NIFI-1010: If database driver does not support getting table name for column from ResultSetMetadata, then just use a default name 2015-10-23 10:25:59 -04:00
Mark Payne 0fc5d30461 NIFI-1055: Fixed checkstyle violations 2015-10-23 10:08:44 -04:00
Mark Payne 5d90c9be07 Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi 2015-10-23 09:52:33 -04:00
Mark Payne bd506b1e10 NIFI-972: Added additional unit test; deleted lines that were commented out 2015-10-23 09:52:09 -04:00
Toivo Adams a9e5325047 NIFI-972 attribute to indicate rows count and cleanup
Signed-off-by: Toivo Adams <toivo.adams@gmail.com>
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-10-23 09:28:03 -04:00
Toivo Adams ba3225fe92 NIFI-972 ExecuteSQL bug in createSchema() create Arvo Schema 1
Signed-off-by: Toivo Adams <toivo.adams@gmail.com>
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-10-23 09:28:03 -04:00
Joe a5a5badb88 NIFI-945 Create a new property (JSON Container) in ConvertAvroToJson, which determines how stream of records is exposed: either as a sequence of single Objects ("none"),
writing every Object to a new line, or as an array of Objects.

Let's assume you have an Avro content as stream of records (record1, record2, ...). If JSON container is "none", the converter will expose the records as sequence of
single JSON objects:

record1
record2
...
recordN

Please bear in mind, that the final output is not a valid JSON content. You can then forward this content e.g. to Kafka, where every record will be a single Kafka message.

If JSON container is "array", the output looks like this:

[record1,record2,...,recordN]

It is useful when you want to convert your Avro content to a valid JSON array.

This closes #88

Reviewed and Amended (amendments reviewed by original patch author on github) by Tony Kurc (tkurc@apache.org)
2015-10-21 20:15:29 -04:00
Mark Payne da28b81eec Merge branch 'NIFI-988' 2015-10-21 10:44:06 -04:00
Mark Payne 97441ea0c2 Merge branch 'NIFI-988' of https://github.com/ImpressTV/nifi into NIFI-988 2015-10-21 10:18:05 -04:00
Joe e68fdca517 NIFI-944 Added support and unit tests for escaped characters in ConvertCSVtoAvro processor properties. This closes #87. Reviewed by Tony Kurc <tkurc@apache.org> 2015-10-21 00:01:38 -04:00
Andre F de Miranda 518670dbf6 NIFI-1042 Adds restlistener.remote.source.ip attribute to ListenHTTPServlet. This closes #105 2015-10-19 23:43:44 -04:00
Alex Moundalexis b809031195 NIFI-1046 shell clean up: +variable braces for consistency. Reviewed by Tony Kurc (tkurc@apache.org). This closes #106 2015-10-19 20:36:58 -04:00
Alex Moundalexis 9aa716b059 NIFI-1046 shell clean up: quoting prevents globbing & word splitting.
Ignoring the unquoted array expansions on L188/190; suspect they ought to be quoted per [SC2068](https://github.com/koalaman/shellcheck/wiki/SC2068), but need to confirm desired arguments.

Reviewed by Tony Kurc (tkurc@apache.org)
2015-10-19 20:36:07 -04:00
Alex Moundalexis 58d9b02517 NIFI-1046 shell clean up: remove backticks from nifi.sh. Reviewed by Tony Kurc (tkurc@apache.org) 2015-10-19 20:33:52 -04:00
Tony Kurc 9200542298 NIFI-1016 Naive fix so org.apache.nifi.prioritizer.PriorityAttributePrioritizerTest builds 2015-10-18 20:34:36 -04:00
Tony Kurc 88b1b844fb NIFI-747 This closes #104. PR from Venkatesh Sellappa <VS186031@outlook.com> was modified, then code reviewed by Joe Witt (comments in ticket) 2015-10-18 20:04:24 -04:00
Joe ad73a23aff NIFI-1016: Use centralized priority attribute name in PriorityAttributePrioritizer. closes #98.
Signed-off-by: joewitt <joewitt@apache.org>
2015-10-18 19:42:46 -04:00
Mark Payne 31f0909bd3 NIFI-994: Initial import of TailFile 2015-10-18 19:00:24 -04:00
Alan Jackoway 943ccfedef NIFI-1035 AbstractKiteProcessor.getSchema leaks file handles. closes #101.
Close file handles when reading schema from resources or paths in AbstractKiteProcessor.getSchema

Signed-off-by: joewitt <joewitt@apache.org>
2015-10-18 18:56:26 -04:00
Joe 22924c656b NIFI-995 TestGetFile.testAttributes() failed in case of a NTFS partition in Linux, because Files.setPosixFilePermissions() did not have any effect on the files and did not throw Exception. closes #95. Signed off by Tony Kurc (tkurc@apache.org) 2015-10-17 10:46:49 -04:00
Venkatesh Sellappa 9a8d763d8d NIFI-612 Remove FlowUnmarshaller. Builds, runs, could not find any latent references using reflection or other ways of loading classes without direct references. This closes #103. Signed off by Tony Kurc <tkurc@apache.org> 2015-10-17 09:43:10 -04:00
Matt Gilman 570202eb30 NIFI-730:
- Fixing capitalization to remain consistent.
2015-10-16 10:47:02 -04:00
Matt Gilman a872403831 NIFI-730:
- Updating the styling of the drop request status dialog.
- Rendering any errors that may have occurred.
2015-10-16 09:37:57 -04:00
Mark Payne 2b4999c018 NIFI-730: do not interrupt swap thread if drop flowfiles is canceled 2015-10-16 09:06:13 -04:00
Mark Payne b8dbd1018c NIFI-730: Updated details of Provenance Event for when a queue is emptied 2015-10-16 08:53:40 -04:00
Matt Gilman 39a050d2fd NIFI-730:
- Adding emptying a queue when clustered.
2015-10-14 17:47:06 -04:00
Mark Payne 09a3f6dadd NIFI-730: reordered states for drop flowfile request 2015-10-14 16:32:39 -04:00
Mark Payne 98a04eec74 NIFI-730: Set current queue size on drop flowfile request immediately when creating request 2015-10-14 13:48:59 -04:00
Mark Payne 84db372538 NIFI-977: Allow SQL Data Types with numerals that are negative 2015-10-14 13:12:10 -04:00
Matt Gilman cad0e7cf0f NIFI-730:
- Adding progress bar for showing current status of drop request.
- Allowing the user to cancel the current drop request.
2015-10-14 12:39:19 -04:00
Mark Payne a2ae99f899 NIFI-730: Make cancel request actually cancel 2015-10-14 11:11:48 -04:00
Mark Payne 5867193bc1 NIFI-730: Added additional testing logic to unit tests 2015-10-14 09:56:52 -04:00
Mark Payne 0af1acaafa NIFI-730: Return DropFlowFileStatus object when calling cancel 2015-10-14 09:46:21 -04:00
Mark Payne 77f7d7524c NIFI-730: bug fixes and code cleanup for swap manager and flowfile queue 2015-10-14 09:14:15 -04:00
Mark Payne afb76afcd0 NIFI-730: Added error messages if we fail to drop FlowFiles from queue 2015-10-13 15:57:18 -04:00
Mark Payne 72ff2a25d5 NIFI-730: Updated queue sizes appropriately during dropping of flowfiles 2015-10-13 15:46:56 -04:00
Matt Gilman 4b41aaab02 NIFI-730:
- Fixing checkstyle violations.
- Wiring endpoints and framework model.
- Lowering the max delay while polling from 8 seconds to 4 seconds.
2015-10-13 13:43:10 -04:00
Mark Payne af78354d84 NIFI-730: Added additional parameters to dropFlowFiles 2015-10-13 12:20:18 -04:00
Matt Gilman 09d6fe5cdb NIFI-730:
- Fixing checkstyle violations.
- Renaming context menu item for emptying a queue.
2015-10-13 10:12:58 -04:00
Mark Payne ad6af95d07 NIFI-730: Fixed checkstyle violations 2015-10-13 10:09:21 -04:00
Mark Payne 9be37914dd Merge branch 'NIFI-730' of https://git-wip-us.apache.org/repos/asf/nifi into NIFI-730 2015-10-13 10:03:31 -04:00
Mark Payne 49a781df2d NIFI-730: Implemented swapping in and out on-demand by the FlowFileQueue rather than in a background thread 2015-10-13 10:03:03 -04:00
danbress 49ee06b0a2 NIFI-774 Ignore integration style test 2015-10-12 19:59:46 -04:00
Matt Gilman e0ac7cde37 NIFI-730:
- Starting to add support for deleting flow files from a queue by creating endpoints and starting to wire everything together.
- Adding context menu item for initiating the request to drop flow files.
2015-10-12 10:00:54 -04:00
danbress fad81d872d Merge remote-tracking branch 'yu/NIFI-774' 2015-10-12 09:55:52 -04:00
Mark Payne b8c51dc35d NIFI-730: Added methods for dropping queued flowfiles; refactored swap manager but have not yet started swapping flowfiles in or out from within the flowfile queue 2015-10-11 10:27:07 -04:00
Mike Moser f798127290 NIFI-1031 resolve reporting task error in flow.xml
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-10-09 10:53:23 -04:00
Joseph Percivall b4bfcc1f21 NIFI-1030 made InvokeHttp basic auth password a sensitive value
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-10-08 15:46:12 -04:00
Matt Gilman 2583d7869a NIFI-442:
NIFI-828:
- Always selecting the first item in the new component table.
- Enabling adding the selected component by typing Enter.
- Removing the 'filter by' in the new component dialogs and instead just searching every field.
2015-10-07 19:11:55 -04:00
Mark Payne 8e2308b78d NIFI-810: Reworded validation errors pertaining ot upstream connections 2015-10-07 17:53:04 -04:00
Mark Payne ccfb57fe9f NIFI-810: Addressed several checkstyle violations 2015-10-07 17:48:51 -04:00
Mark Payne b974445ddd NIFI-810: rebased from master 2015-10-07 17:28:39 -04:00
Mark Payne 5ecdb1858e NIFI-810: Updated the wording on validation errors due to upstream connections 2015-10-07 17:26:14 -04:00
Matt Gilman 13edcfda2e NIFI-810:
- Adding basic support for preventing connection when appropriate.
- Updating validation when [dis]connecting processors.
2015-10-07 17:26:14 -04:00
Mark Payne 4afd8f88f8 NIFI-810: Created RequiresInput annotation and ensure that processors are invalid if connections do not agree 2015-10-07 17:26:14 -04:00
Randy Gelhausen 31fba6b333 Bumped nifi-kafka-processors Kafka version
This closes #99.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-10-05 10:39:22 -04:00
Bryan Bende 6b2f5ad1f5 NIFI-992 Adding NOTICE to nifi-couchbase-nar 2015-10-01 16:56:49 -04:00
ijokarumawak 033a1553ab nifi-992 Improvements based on code review part II.
- Penalize or Yield based on ErrorHandlingStrategy.Penalty
- Add Retry relationship to PutCouchbaseKey
- Remove unnecessary try/catch and let the framework handle it
- Change CouchbaseException relation mapping for Fatal from Failure to Retry

Signed-off-by: Bryan Bende <bbende@apache.org>
2015-10-01 14:13:20 -04:00
ijokarumawak 72eb64e8a4 nifi-992 Improvements based on code review.
- Removed checkstyle and contrib-check profile since it's inherit from
  top-level pom.
- Consolidate DOC_ID and DOC_ID_EXP into a single DOC_ID property.
- Add capability description on GetCouchbaseKey.
- Fixed documentation spell misses.
- Handle Exceptions accordingly.
- Add 'retry' relationship.

Signed-off-by: Bryan Bende <bbende@apache.org>
2015-09-29 13:48:13 -04:00
ijokarumawak 2466a24530 nifi-992 Adding nifi-couchbase-bundle.
- new CouchbaseClusterControllerService
- new Processors
  - GetCouchbaseKey
  - PutCouchbaseKey

Signed-off-by: Bryan Bende <bbende@apache.org>
2015-09-28 11:21:42 -04:00
Matt Gilman 2215bc848b NIFI-810:
- Adding basic support for preventing connection when appropriate.
- Updating validation when [dis]connecting processors.
2015-09-25 17:46:58 -04:00
Mark Payne 034ee6de6b NIFI-810: Created RequiresInput annotation and ensure that processors are invalid if connections do not agree 2015-09-25 11:39:58 -04:00
Mark Payne 96764ed6a1 Merge branch 'master' of http://git-wip-us.apache.org/repos/asf/nifi 2015-09-25 09:15:34 -04:00
Mark Payne eb94dab00c NIFI-604: Fixed checkstyle violation 2015-09-24 11:51:44 -04:00
Joe Skora e53ab391fa NIFI-641 Add delete capability to the UpdateAttributes processor.
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-09-24 10:46:10 -04:00
Joe e12da7c9a3 NIFI-985: Custom log prefix for LogAttribute processor
The LogAttribute processor evaluates the log prefix EL using the current flow file.

Log prefix helps to distinguish the log output of multiple LogAttribute processors and identify the right processor. Log prefix appears in the first and the last log line, followed by the original 50 dashes. If you configure log prefix 'STEP 1: ' the log output looks like this:

STEP 1 :  --------------------------------------------------
Standard FlowFile Attributes
Key: 'entryDate'
        Value: 'Tue Sep 22 15:13:02 CEST 2015'
Key: 'lineageStartDate'
        Value: 'Tue Sep 22 15:13:02 CEST 2015'
Key: 'fileSize'
        Value: '9'
FlowFile Attribute Map Content
Key: 'customAttribute'
        Value: 'custom value'
STEP 1 :  --------------------------------------------------

flow file content...

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-09-24 10:31:04 -04:00
Mark Payne 24c080788f NIFI-604: Removed unused import, as it caused checkstyle violation 2015-09-24 10:06:39 -04:00
Mark Payne 193dbe6533 Merge branch 'NIFI-604' of https://github.com/rickysaltzer/nifi into NIFI-604 2015-09-23 16:03:46 -04:00
Mark Payne 26f80095b7 Merge branch 'master' of http://git-wip-us.apache.org/repos/asf/nifi 2015-09-23 15:31:19 -04:00
Mark Payne f884086fc2 NIFI-713: Fixed checkstyle issue 2015-09-23 15:20:25 -04:00
Mark Payne da56b49b88 Merge branch 'NIFI-713' of https://github.com/rickysaltzer/nifi into NIFI-713 2015-09-23 12:06:50 -04:00
Joe ee7d89cb01 NIFI-988: Test cases for PutDistributedMapCache 2015-09-23 14:32:37 +02:00
Joe 6b1328f3f1 NIFI-988: PutDisributedMapCache processor implementation 2015-09-23 14:31:13 +02:00
Bryan Bende 8615941c89 NIFI-959 Fixing incorrect evaluation for getting the collection and adding a unit test to prevent regression 2015-09-22 15:38:53 -04:00