Aldrin Piri
c541c82c35
NIFI-1191 Adding missing tags for ConvertAvroToJSON
2015-11-18 16:38:15 -05:00
Mark Payne
69bce2c2db
NIFI-1168: Ensure that processors with only looping
...
connections are scheduled to run, even if the connections have no FlowFiles;
expose these details to processor developers; update documentation
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-11-18 14:53:30 -05:00
Aldrin Piri
773576e041
NIFI-1108 Providing additional annotations on processors to ensure utilization of the InputRequirement annotation.
2015-11-18 13:56:21 -05:00
Mark Payne
911e1c5412
NIFI-1108: Updated processors to include the @InputRequirement annotation
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-11-18 13:47:59 -05:00
Mark Payne
d88b6cb6bc
NIFI-1173: Even if FlowFile Queue is empty, it needs to hold onto the Empty Queue request so that subsequent cancel/clear requests can reference it
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-11-18 10:56:38 -05:00
Mark Payne
180ea1ba22
NIFI-1176: Use a smaller internal blocking queue size of only 5000 messages; do not create a new queue every time the processor is scheduled to run
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-11-18 10:51:22 -05:00
Mark Payne
93be753301
NIFI-1181: Ensure that a FlowFile's uuid cannot be modified by processors
...
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2015-11-18 10:35:37 -05:00
Bryan Bende
2b9b5e008f
NIFI-1175 Exposing minimum properties required to create an HBase connection on the HBaseClientService as an optional alternative to the conf files
2015-11-17 12:01:46 -05:00
Mark Payne
453b140d6b
Merge branch 'NIFI-748' of https://github.com/olegz/nifi into NIFI-748
2015-11-17 09:23:10 -05:00
Mark Payne
d16392c618
NIFI-1114: Added documentation for nifi.kerberos.krb5.file property
2015-11-17 08:45:28 -05:00
Jenn Barnabee
f98e335cde
NIFI-1178: Updates to Administration Guide - System Properties section.
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-11-17 08:16:45 -05:00
Naveen Madhire
03a54bf2d5
Changes after review
2015-11-16 13:32:17 -06:00
Naveen Madhire
b954ca620e
NIFI-1146 Allow GetKafka to be configured with auto.offset.reset to largest or smallest
2015-11-16 11:59:52 -06:00
Oleg Zhurakousky
15880f9fcc
NIFI-748 addressed PR comments
...
- made DocReader package private
- polished logic in read(..) method to avoid escaping the loop
- added call to sorting logic in LuceneUtil.groupDocsByStorageFileName(..) to ensure that previous behavior and assumptions in read(..) methodd are preserved
- other minor polishing
2015-11-16 08:39:23 -05:00
Matt Gilman
64369f67f9
NIFI-1160:
...
- Addressing possible NPE when removing a drop request.
- Only updating a connection status once it's been retrieved for the first time.
2015-11-16 08:34:04 -05:00
Mark Payne
da9f40b3f0
NIFI-973: Updated main Help page to provide a link to the Getting Started Guide.
...
Reviewed by Aldrin Piri (aldrin@apache.org )
2015-11-15 08:38:51 -05:00
Tony Kurc
528dab78d6
NIFI-1073: Fixing coverity discovered errors. Resource leaks, and statics
...
Reviewed by Bryan Bende (bbende@apache.org )
2015-11-14 18:56:43 -05:00
Aldrin Piri
01539ed323
NIFI-1163: Providing handling of SSLContext creation in GetHTTP in case of only performing a one-way SSL request and accompanying test to verify the configuration/usage.
...
Reviewed by Tony Kurc (tkurc@apache.org )
2015-11-14 18:47:50 -05:00
Oleg Zhurakousky
a4d93c62c8
NIFI-748 Fixed logic around handling partial query results from provenance repository
...
- Ensured that failures derived form correlating Document to its actual provenance event do fail the entire query and produce partial results with warning messages
- Refactored DocsReader.read() operation.
- Added test to validate two conditions where the such failures could occur
2015-11-13 14:23:31 -05:00
Mark Payne
90f6830003
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-11-13 10:47:05 -05:00
Mark Payne
22de23baa6
NIFI-1097: Rewrite PutKafka to use the new producer api
2015-11-13 10:46:46 -05:00
joewitt
36d00a60f5
NIFI-1155 fixed contrib-check violation
2015-11-13 00:06:12 -05:00
Mark Payne
37d6b7350e
NIFI-1155: Refactored StandardFlowFileQueue to update member variables more intelligently, using CAS operations instead of locks. This reduces code complexities because other optimizations that previously existed are no longer needed
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-11-13 00:06:12 -05:00
Mark Payne
3ed0949c55
NIFI-1155: Ensure that when poll(FlowFileFilter, Set) is called, we properly update the indicator for whether or not queue is full
...
Signed-off-by: joewitt <joewitt@apache.org>
2015-11-13 00:06:12 -05:00
Tony Kurc
e6086420aa
NIFI-1158 Default timestamp based on now
2015-11-12 23:11:43 -05:00
Mark Payne
0900fb80c9
NIFI-1153: If no incoming FlowFile, don't try to transfer null
...
Reviewed by Bryan Bende (bbende@apache.org )
Amended based on review (change to a log message) by Tony Kurc (tkurc@apache.org )
2015-11-12 22:41:57 -05:00
Bryan Bende
33ef59c5ba
NIFI-1127 Adding Kerberos properties to FetchHDFS and ListHDFS.
...
Reviewed by Tony Kurc (tkurc@apache.org )
2015-11-12 22:14:12 -05:00
Tony Kurc
db7b94b804
NIFI-696 Deprecated org.apache.nifi.flowfile.FlowFile.getId()
2015-11-12 21:26:48 -05:00
Mark Payne
65bd8c0b1f
NIFI-1109 Updated documentation and cleaned up code
...
Reviewed by Bryan Bende (bbende@apache.org ).
Committed with amendments (for whitespace, a couple misspellings and to change a test method name based on review) by Tony Kurc (tkurc@apache.org )
2015-11-12 21:07:01 -05:00
joewitt
02102ea1c2
Revert "NIFI-1134". This was removed because they looked like floating classes. But in reality they are used to make jars which we use to test the build. However, we really need the test to work differently but until that is fixed these must stay.
...
This reverts commit 41f3875347
.
2015-11-12 18:00:40 -05:00
Mark Payne
56ad22aea6
NIFI-900: Created Processors for interacting with Microsoft Azure EventHubs
...
Reviewed (with amendments needed for clean merge, whitespace and NOTICEs) by Tony Kurc (tkurc@apache.org )
2015-11-11 23:06:04 -05:00
Mark Payne
7a165b62cc
Merge branch 'NIFI-994'
2015-11-11 16:05:40 -05:00
Mark Payne
854d203982
Merge branch 'NIFI-1143' of https://github.com/olegz/nifi into NIFI-1143
2015-11-11 14:14:54 -05:00
Oleg Zhurakousky
5baafa156a
NIFI-1143 Fixed race condition which caused intermittent failures
...
Fixed the order of service state check in PropertyDescriptor
Encapsulated the check into private method for readability
Modified and documented test to validate correct behavior.
For more details please see comment in https://issues.apache.org/jira/browse/NIFI-1143
2015-11-11 14:06:08 -05:00
Mark Payne
11fcad90d1
Merge branch 'NIFI-1083'
2015-11-11 12:07:15 -05:00
Mark Payne
054774fe7b
Merge branch 'NIFI-1061' of https://github.com/olegz/nifi into NIFI-1061
2015-11-11 11:17:25 -05:00
Mark Payne
e7c6c7cae9
NIFI-1083: Added a Grouping Regular Expression property for grouping lines of text
2015-11-11 10:19:07 -05:00
Bryan Bende
429f6a42bb
Previous commits address NIFI-1124 and NIFI-1062 as described in the tickets. This closes #119
2015-11-11 10:17:45 -05:00
Oleg Zhurakousky
a65a29921a
NIFI-1124, NIFI-1062 addressed more PR comments
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-11-11 10:12:30 -05:00
Oleg Zhurakousky
70cc61bb53
NIFI-1124, NIFI-1062 addressed PR comments
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-11-11 10:12:30 -05:00
Oleg Zhurakousky
62e3cfc629
NIFI-1024 NIFI-1062 Fixed PutHDFS processor to properly route failures. Ensured that during put failures the FlowFile is routed to 'failure' relationship. Added validation test Re-enabled previously ignored test.
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2015-11-11 10:12:30 -05:00
Joseph Percivall
3e538d9007
NIFI-1083 Created a processor that routes lines of text based on different matching and routing strategies
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-11-11 09:12:47 -05:00
Oleg Zhurakousky
76690a8ee9
NIFI-1061 fixed deadlock caused by DBCPConnectionPool.onConfigured()
...
Current implementation of DBCPConnectionPool was attempting to test if connection could be obtained via dataSource.getConnection().
Such call is naturally a blocking call and the duration of the block is dependent on driver implementation. Some drivers (e.g., Phoenix - https://phoenix.apache.org/installation.html )
attempts numerous retries before failing creating a deadlock when attempt was made to disable DBCPConnectionPool which was still being enabled.
This fix removes the connection test from DBCPConnectionPool.onConfigured() operation returning successfully upon creation of DataSource.
For more details see comments in https://issues.apache.org/jira/browse/NIFI-1061
2015-11-11 08:33:51 -05:00
Mark Payne
6c510fae80
Merge branch 'master' of https://git-wip-us.apache.org/repos/asf/nifi
2015-11-11 08:16:38 -05:00
Joseph Percivall
d887d8fdf0
NIFI-993 added expression language support to GetHTTP for the filename and URL properties
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2015-11-11 08:05:23 -05:00
Tony Kurc
ba5b1d837c
NIFI-1117 Changed line endings to unix line endings in java source
2015-11-10 18:50:57 -05:00
Tony Kurc
9756e9f126
NIFI-1117 Added unit tests and default behavior for avro files with no records. Also fixed a findbugs warning in SplitAvro (made inner classes static)
2015-11-10 18:46:17 -05:00
Mark Payne
a031fb3dc6
Merge branch 'NIFI-1142'
2015-11-10 17:17:59 -05:00
Mark Payne
e6644b3747
Merge branch 'NIFI-1141'
2015-11-10 17:17:55 -05:00
Mark Payne
7b9c8df6c5
NIFI-994: Fixed issue that could result in data duplication if more than 1 rollover of tailed file has occurred on restart of Processor
2015-11-10 16:53:29 -05:00