1a388f957e
NIFI-1111: We were subtracting values in the wrong order so that we always would 'yield' for a negative amount of time, which equated to not yielding at all.
2015-11-06 09:03:38 -05:00
98f5a1ab77
NIFI-1110: Fixed bug that caused queue size to become negative when FlowFiles are expired
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-11-05 12:12:02 -05:00
4ac52bfc0a
Removing nifi-azure-bundle that was incorrectly added to master
2015-11-05 10:42:10 -05:00
f1bd3d471d
NIFI-1112 Fixed APIOperation Annotation on ReportingTaskResource.
...
Reviewed by Tony Kurc (tkurc@apache.org )
2015-11-04 18:31:34 -05:00
618f22e110
NIFI-274 - Fixing TestListenSyslog, fixing default buffer size to be bytes, adding syslog.protocol to attributes
...
- Adding syslog.port to ListenSyslog attributes, logging at warn level when rejecting tcp connections
- Adding @InputRequirement to processors and adding appropriate send and receive provenance events
2015-11-04 18:01:59 -05:00
5611dac3f8
NIFI-274 - added use of Selectors for TCP and UDP connections. Added a max connections to the TCP thread
...
- Added comments and code review changes
- fixed fixbugs bug
2015-11-04 18:00:18 -05:00
9c542432da
NIFI-274 Adding ListenSyslog and PutSyslog to standard processors.
...
- Refactoring connection handling on put side, removing number of buffers from properties and basing it off concurrent tasks for the processor.
- Refactoring some of the TCP handling so it keeps reading from a connection until the client closes it
- Adding an error queue
- Adding a sender field on the syslog event to record the system that sent the message
2015-11-04 17:56:13 -05:00
6add372bc1
NIFI-1085 WebClusterManager fair locking and HeartbeatMonitoringTimerTask scheduling
2015-11-04 12:19:00 -05:00
201eac052b
NIFI-1098 - Ensuring we pull the correct attribute from the servlet context. Reviewed by Tony Kurc (tkurc@apache.org)
2015-11-04 12:11:19 -05:00
fedbe40313
NIFI-1103: Added InputRequirement annotation
2015-11-04 11:11:33 -05:00
2b1d093120
NIFI-1105: Only trigger a processor that requires input to run if data is available for it process
2015-11-04 08:41:10 -05:00
dbf0c7893f
NIFI-730: Completed merging of master
2015-11-02 14:31:28 -05:00
e4cebba3c7
Merge branch 'master' into NIFI-730
2015-11-02 14:02:16 -05:00
a549621267
NIFI-1077 enabling expression language on ConvertCharacterSet input and output
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-11-02 11:46:17 -05:00
814e8b212c
Merge branch 'NIFI-1082'
2015-11-02 11:29:52 -05:00
abf2c62884
NIFI-1051: Fixed checkstyle violations
2015-11-02 11:01:50 -05:00
7a73867c46
Merge branch 'NIFI-1051' of https://github.com/olegz/nifi into NIFI-1051
2015-11-02 10:51:43 -05:00
2ae49026e8
NIFI-883 Fixing issue HandleHttpRequest had with PrimaryNodeOnly scheduling
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-11-02 10:32:14 -05:00
5a04021dd7
NIFI-730:
...
- Updating logic now that original is guaranteed to be non null.
- Always reporting 100% once the drop request has completed.
2015-11-02 08:59:11 -05:00
f5727cfb0f
NIFI-730: Ensure that we always populate queue counts when initiating a Drop FlowFile request
2015-11-02 08:36:50 -05:00
ad849c77df
NIFI-1090: Fixed log message that was at info level but should have been debug level
2015-11-01 14:37:01 -05:00
b729bf4c19
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-11-01 14:16:54 -05:00
6e193dffa3
Merge branch 'NIFI-1088'
2015-11-01 14:16:35 -05:00
cef7b6c736
NIFI-1080 fleshed out InvokeHttp unit tests
...
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
2015-10-31 00:19:36 -04:00
9c148da1c2
NIFI-869: Fixed checkstyle violations
2015-10-30 16:09:50 -04:00
ba72452f66
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-10-30 16:02:15 -04:00
a3d43d23dc
NIFI-869 Fixed SimpleProcessLogger to log correct messages Ensured that SimpleProcessLogger correctly interprets Throwable as discussed in JIRA Added tests
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-10-30 15:52:33 -04:00
90aea01350
NIFI-869 Fixed formatting issue Fixed formatting issue with printed error message which only apears when NiFi is cnfigured using Logback. Please see NIFI-869 for more details
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-10-30 15:52:33 -04:00
eb389cf84c
NIFI-1079 Replacing Name for NULL_VALUE_FOR_EMPTY_STRING as I had accidentally removed it.
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-10-30 14:30:56 -04:00
aef0d8fe9b
NIFI-1079 Check style and documentation based updates recommended by user bbende on Github pull request
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-10-30 14:30:42 -04:00
217b1049cf
NIFI-1079 Added Destination Property to control if JSON goes to Attribute or
...
Content of FlowFile. Added Include Core Attributes Property to control
if FlowFile CoreAttributes are included in the JSON output or not.
Added Null value for Empty String flag to control if empty values in
the JSON are empty string or true NULL values. Added more tests and
minor text refactoring per Github comments
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-10-30 14:30:25 -04:00
19b7a4cc7d
NIFI-1079 Create a new Attribute from the existing FlowFile attributes by taking
...
either all of the existing attributes or a user defined list. The
existing Attributes are converted to JSON and placed in a new Attribute
on the existing FlowFile as Attribute “JSONAttributes”
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-10-30 14:29:29 -04:00
9515b74607
NIFI-1088: Ensure that FlowFile is penalized before routing to failure
2015-10-30 14:25:27 -04:00
bfa9e45079
NIFI-994: Ensure that processor is not valid due to the tail file not yet existing
2015-10-30 11:44:51 -04:00
5c4042bd7c
NIFI-1051 Allowed FileSystemRepository to skip un-readable entries.
...
The exception was caused due to basic file permissions. This fix overrides
'visitFileFailed' method of SimpleFileVisitor to log WARN message and allow
FileSystemRepository to continue.
2015-10-29 16:31:17 -04:00
5cc2b04b91
NIFI-986 Refactoring of action classes from nifi-user-actions to have interfaces in nifi-api, and adding getFlowChanges to EventAccess
...
- Fixing empty java docs and adding sort by id asc to the history query
- Changing userDn to userIdentity in Action and FlowChangeAction
- Modifying NiFiAuditor to always save events locally, and implementing getFlowChanges for ClusteredEventAccess
2015-10-29 16:28:36 -04:00
c4f0cb1c6c
Removing nifi-pcap-bundle/.gitignore
2015-10-29 12:06:25 -04:00
cf8ca3dc2c
NIFI-1082: Ensure that events returned from the provenance repository are ordered such that newest events are provided first
2015-10-28 17:32:51 -04:00
edf238e004
NIFI-730: Do not require a Read Lock in order to obtain backpressure configuration values for FlowFileQueue's
2015-10-28 10:27:58 -04:00
dc4004de64
Merge branch 'NIFI-977'
2015-10-27 16:53:38 -04:00
af19053a7f
Merge branch 'NIFI-447'
2015-10-27 10:42:46 -04:00
07238c7913
NIFI-447 adding replacement strategy to ReplaceText processor
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-10-27 10:37:43 -04:00
b885f955f4
NIFI-516 adding option to StandardProcessSession.read to close stream
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-10-26 20:23:13 -04:00
1c1738670c
NIFI-10: Updated FetchHDFS, FetchFileTransfer to use new FETCH provenance event
2015-10-26 17:14:29 -04:00
fc2aa2764c
NIFI-10: Added FETCH and DOWNLOAD Provenance Events; updated FlowController to use DOWNLOAD event instead of SEND whenever a user downloads/views content via Provenance Event
2015-10-26 14:58:50 -04:00
51f564024a
NIFI-10: Added FETCH Provenance Event and updated processors to use this new event type
2015-10-26 14:58:50 -04:00
aec32a277c
NIFI-1070: Added detailed debug-level logging about how FileSystemRepository is choosing to expire archived data
2015-10-26 14:36:03 -04:00
f8c3377c84
NIFI-820:
...
- Creating a context menu item for accessing provenance directly for a selected component.
2015-10-26 10:16:01 -04:00
26edab3185
NIFI-908 Added support for SSL in JMS connections.
...
- Added SSL context to JMS producer and consumer processors
- Tony Kurc Amended patch to check SSL need by scheme and exception consistency
Reviewed by Tony Kurc (tkurc@apache.org )
2015-10-26 00:29:05 -04:00
8d2f9bc64b
NIFI-1056: Do not treat BigDecimal, BigInteger the same way we treat Number's when serializing to Avro because Avro Java Library doesn't support them
...
Reviewed and Unit Test Amended by Tony Kurc (tkurc@apache.org )
2015-10-25 11:31:30 -04:00
385bfbb2c6
NIFI-673: Rebased from master; Added InputRequirement annotation, as it is now merged into master
2015-10-25 11:14:11 -04:00
4e38288062
NIFI-673: Added sftp.listing.user attribute to FlowFiles created by ListSFTP; ensure that FetchSFTP indicates that the username supports Expression Language
2015-10-25 11:13:02 -04:00
b0322d9ffe
NIFI-673: Added Completion Strategy to FetchSFTP
2015-10-25 11:13:02 -04:00
d1d57931bf
NIFI-673: Initial implementation of ListSFTP, FetchSFTP
2015-10-25 11:13:02 -04:00
8a80060851
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-10-25 11:11:49 -04:00
0636f0e731
NIFI-810: Merged master into branch
2015-10-25 11:02:40 -04:00
f2c4f2d2a1
[PATCH] NIFI-997 Periodically attempt a kerberos relogin in AbstractHadoopProcessor
...
- attempt a relogin based on an interval specified in the processor configuration
- use hadoop's UserGroupInformation.checkTGTAndReloginFromKeytab to determine if a relogin is necessary based on the ticket and do so if needed
- improve code readability with HdfsResources object in AbstractHadoopProcessor
Reviewed and Amended by Tony Kurc (tkurc@apache.org ). This closes #97
2015-10-25 00:49:58 -04:00
d63cd6bd2f
Merge branch 'NIFI-1010'
2015-10-23 14:39:16 -04:00
88fc8d28a0
NIFI-1010: If database driver does not support getting table name for column from ResultSetMetadata, then just use a default name
2015-10-23 10:25:59 -04:00
0fc5d30461
NIFI-1055: Fixed checkstyle violations
2015-10-23 10:08:44 -04:00
5d90c9be07
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-10-23 09:52:33 -04:00
bd506b1e10
NIFI-972: Added additional unit test; deleted lines that were commented out
2015-10-23 09:52:09 -04:00
a9e5325047
NIFI-972 attribute to indicate rows count and cleanup
...
Signed-off-by: Toivo Adams <toivo.adams@gmail.com>
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-10-23 09:28:03 -04:00
ba3225fe92
NIFI-972 ExecuteSQL bug in createSchema() create Arvo Schema 1
...
Signed-off-by: Toivo Adams <toivo.adams@gmail.com>
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-10-23 09:28:03 -04:00
a5a5badb88
NIFI-945 Create a new property (JSON Container) in ConvertAvroToJson, which determines how stream of records is exposed: either as a sequence of single Objects ("none"),
...
writing every Object to a new line, or as an array of Objects.
Let's assume you have an Avro content as stream of records (record1, record2, ...). If JSON container is "none", the converter will expose the records as sequence of
single JSON objects:
record1
record2
...
recordN
Please bear in mind, that the final output is not a valid JSON content. You can then forward this content e.g. to Kafka, where every record will be a single Kafka message.
If JSON container is "array", the output looks like this:
[record1,record2,...,recordN]
It is useful when you want to convert your Avro content to a valid JSON array.
This closes #88
Reviewed and Amended (amendments reviewed by original patch author on github) by Tony Kurc (tkurc@apache.org )
2015-10-21 20:15:29 -04:00
da28b81eec
Merge branch 'NIFI-988'
2015-10-21 10:44:06 -04:00
97441ea0c2
Merge branch 'NIFI-988' of https://github.com/ImpressTV/nifi into NIFI-988
2015-10-21 10:18:05 -04:00
e68fdca517
NIFI-944 Added support and unit tests for escaped characters in ConvertCSVtoAvro processor properties. This closes #87 . Reviewed by Tony Kurc <tkurc@apache.org>
2015-10-21 00:01:38 -04:00
518670dbf6
NIFI-1042 Adds restlistener.remote.source.ip attribute to ListenHTTPServlet. This closes #105
2015-10-19 23:43:44 -04:00
b809031195
NIFI-1046 shell clean up: +variable braces for consistency. Reviewed by Tony Kurc (tkurc@apache.org). This closes #106
2015-10-19 20:36:58 -04:00
9aa716b059
NIFI-1046 shell clean up: quoting prevents globbing & word splitting.
...
Ignoring the unquoted array expansions on L188/190; suspect they ought to be quoted per [SC2068](https://github.com/koalaman/shellcheck/wiki/SC2068 ), but need to confirm desired arguments.
Reviewed by Tony Kurc (tkurc@apache.org )
2015-10-19 20:36:07 -04:00
58d9b02517
NIFI-1046 shell clean up: remove backticks from nifi.sh. Reviewed by Tony Kurc (tkurc@apache.org)
2015-10-19 20:33:52 -04:00
9200542298
NIFI-1016 Naive fix so org.apache.nifi.prioritizer.PriorityAttributePrioritizerTest builds
2015-10-18 20:34:36 -04:00
88b1b844fb
NIFI-747 This closes #104 . PR from Venkatesh Sellappa <VS186031@outlook.com> was modified, then code reviewed by Joe Witt (comments in ticket)
2015-10-18 20:04:24 -04:00
ad73a23aff
NIFI-1016: Use centralized priority attribute name in PriorityAttributePrioritizer. closes #98 .
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-10-18 19:42:46 -04:00
31f0909bd3
NIFI-994: Initial import of TailFile
2015-10-18 19:00:24 -04:00
943ccfedef
NIFI-1035 AbstractKiteProcessor.getSchema leaks file handles. closes #101 .
...
Close file handles when reading schema from resources or paths in AbstractKiteProcessor.getSchema
Signed-off-by: joewitt <joewitt@apache.org>
2015-10-18 18:56:26 -04:00
22924c656b
NIFI-995 TestGetFile.testAttributes() failed in case of a NTFS partition in Linux, because Files.setPosixFilePermissions() did not have any effect on the files and did not throw Exception. closes #95 . Signed off by Tony Kurc (tkurc@apache.org)
2015-10-17 10:46:49 -04:00
9a8d763d8d
NIFI-612 Remove FlowUnmarshaller. Builds, runs, could not find any latent references using reflection or other ways of loading classes without direct references. This closes #103 . Signed off by Tony Kurc <tkurc@apache.org>
2015-10-17 09:43:10 -04:00
570202eb30
NIFI-730:
...
- Fixing capitalization to remain consistent.
2015-10-16 10:47:02 -04:00
a872403831
NIFI-730:
...
- Updating the styling of the drop request status dialog.
- Rendering any errors that may have occurred.
2015-10-16 09:37:57 -04:00
2b4999c018
NIFI-730: do not interrupt swap thread if drop flowfiles is canceled
2015-10-16 09:06:13 -04:00
b8dbd1018c
NIFI-730: Updated details of Provenance Event for when a queue is emptied
2015-10-16 08:53:40 -04:00
39a050d2fd
NIFI-730:
...
- Adding emptying a queue when clustered.
2015-10-14 17:47:06 -04:00
09a3f6dadd
NIFI-730: reordered states for drop flowfile request
2015-10-14 16:32:39 -04:00
98a04eec74
NIFI-730: Set current queue size on drop flowfile request immediately when creating request
2015-10-14 13:48:59 -04:00
84db372538
NIFI-977: Allow SQL Data Types with numerals that are negative
2015-10-14 13:12:10 -04:00
cad0e7cf0f
NIFI-730:
...
- Adding progress bar for showing current status of drop request.
- Allowing the user to cancel the current drop request.
2015-10-14 12:39:19 -04:00
a2ae99f899
NIFI-730: Make cancel request actually cancel
2015-10-14 11:11:48 -04:00
5867193bc1
NIFI-730: Added additional testing logic to unit tests
2015-10-14 09:56:52 -04:00
0af1acaafa
NIFI-730: Return DropFlowFileStatus object when calling cancel
2015-10-14 09:46:21 -04:00
77f7d7524c
NIFI-730: bug fixes and code cleanup for swap manager and flowfile queue
2015-10-14 09:14:15 -04:00
afb76afcd0
NIFI-730: Added error messages if we fail to drop FlowFiles from queue
2015-10-13 15:57:18 -04:00
72ff2a25d5
NIFI-730: Updated queue sizes appropriately during dropping of flowfiles
2015-10-13 15:46:56 -04:00
4b41aaab02
NIFI-730:
...
- Fixing checkstyle violations.
- Wiring endpoints and framework model.
- Lowering the max delay while polling from 8 seconds to 4 seconds.
2015-10-13 13:43:10 -04:00
af78354d84
NIFI-730: Added additional parameters to dropFlowFiles
2015-10-13 12:20:18 -04:00
09d6fe5cdb
NIFI-730:
...
- Fixing checkstyle violations.
- Renaming context menu item for emptying a queue.
2015-10-13 10:12:58 -04:00
ad6af95d07
NIFI-730: Fixed checkstyle violations
2015-10-13 10:09:21 -04:00
9be37914dd
Merge branch 'NIFI-730' of https://git-wip-us.apache.org/repos/asf/nifi into NIFI-730
2015-10-13 10:03:31 -04:00
49a781df2d
NIFI-730: Implemented swapping in and out on-demand by the FlowFileQueue rather than in a background thread
2015-10-13 10:03:03 -04:00
Mark Payne
Bryan Bende
Andrew Grande
Tony Kurc
Mike Moser
Matt Gilman
Joseph Percivall
Oleg Zhurakousky
Jeremy Dyer
Luke Williamson
ricky
Toivo Adams
Joe
Andre F de Miranda
Alex Moundalexis
Alan Jackoway
Venkatesh Sellappa