Apache/nifi
1
0
Fork 0
mirror of https://github.com/apache/nifi.git synced 2025-02-06 01:58:32 +00:00
Code Issues Packages Projects Releases Wiki Activity
4,356 Commits 147 Branches 203 Tags
Commit Graph

698 Commits

Author SHA1 Message Date
Oleg Zhurakousky
0126800201 NIFI-1093 added support for handling non-required columns 
Mostly based on contribution from Daniel Cave
 2016-01-29 13:41:27 -05:00
jpercivall
be27c07c7f NIFI-1382 Created FetchDistributedMapCache processor 2016-01-29 12:12:23 -05:00
Mark Payne
a0224f1b4c NIFI-1431: Added documentation about how ETag and LastModified dates are used by the Processor 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-01-28 16:02:05 -05:00
jpercivall
ee30b27cc8 NIFI-1396 Correcting PostHttp chunked encoding functionality 2016-01-28 14:50:22 -05:00
Matt Burgess
aa6bc5d505 NIFI-1409: Fix missing transfer on error in ExecuteSql 
Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-01-27 18:23:32 -05:00
Andy LoPresto
93aac8cff3 NIFI-1365 
Added Groovy support for unit tests to pom with skeleton test.
Added Groovy unit tests for OCSPCertificateValidator.
Implemented positive & negative unit tests with cache injection for valid/revoked OCSP certificate.
Modified pom.xml to support Groovy unit tests with custom variable.

mvn clean test -Dgroovy=test

Added local cache injection into Groovy tests for OCSP certificate validation (see NIFI-1324 and NIFI-1364).
Set Java version to 1.7 for Groovy test src/target.
Moved Groovy unit test profile from nifi-web-security to root pom.
Added null check for algorithm argument in PGPUtil.
Changed buffer length check from ">= 0" to "> -1" because it was confusing other developers.
Resolved contrib-check line length issues.
Fixed contrib-check issues in OpenPGPKeyBasedEncryptorTest.
This closes #163

Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-01-26 17:37:59 -05:00
Mark Payne
0e92607466 Merge branch 'NIFI-1412' of https://github.com/mattyb149/nifi into NIFI-1412 2016-01-26 12:30:19 -05:00
Richard Miskin
c16c8db459 NIFI-1421 Make namespace ordering deterministic in SplitXML 2016-01-26 05:35:07 +00:00
Bryan Bende
b7f7e6ed80 NIFI-1436 This closes #189. Combining stop() and close() into a single method to simplify, and adding checks on stopped flag in the run method of SocketChannelDispatcher and DatagramChannelDispatcher to ensure the run() method exits as soon as possible upon close() being called 
NIFI-1436 Adding synchronization on keys set in close() method  based on Selector JavaDoc

Signed-off-by: joewitt <joewitt@apache.org>
 2016-01-25 22:50:25 -05:00
joewitt
beb92492be NIFI-1421 This closes #184. Added content assertion to test and removed extra space 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2016-01-25 16:04:47 -05:00
Mark Payne
4a5fb37b33 Merge branch 'NIFI-1421' of https://github.com/rpmiskin/nifi into NIFI-1421 2016-01-25 15:38:08 -05:00
Matt Burgess
91e7ba84e0 NIFI-1412: Fix error during Avro conversion where no fields are present 2016-01-25 08:35:14 -05:00
Aldrin Piri
8d37af07b9 NIFI-1381 Removing the hardcoded jms:// prefix and instead deferring to the URI specified by the processor properties of PutJMS 
Signed-off-by: joewitt <joewitt@apache.org>
 2016-01-24 23:10:47 -05:00
jpercivall
0db2dc9fc3 NIFI-1405 Adding option to invokeHttp to control using chunked encoding for http PUT and POST calls 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-01-24 15:52:05 -05:00
Richard Miskin
dfed7e727d NIFI-1421 Added missing copyright notice to new test input 2016-01-23 08:52:54 +00:00
Mark Payne
93e2c52195 NIFI-1415: Do not enfoce that a password or Private Key Passphrase is set 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-01-22 20:46:14 -05:00
Mark Payne
92e6961b50 NIFI-1416: If FetchSFTP's Remote File has a directory name in it, do not include that as part of the 'filename' attribute but instead add a 'path' attribute 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-01-22 18:15:19 -05:00
Bryan Bende
1089f0a956 NIFI-1273 Adding ListenRELP processor which includes refactoring code that was previously part of ListenSyslog into a reusable framework for implementing listener processors, as well as back-end code for handling the RELP protocol. Addressing some feedback from review and fixing logging statements Addressing review feedback, added AsyncChannelDispatcher and made ChannelHandlerFactory use generics for the dispatcher This closes #179 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-01-22 16:28:58 -05:00
Oleg Zhurakousky
3db6fffa68 NIFI-1378: fixed JMS URI validation simplified JmsFactory check for SSL and scheme-less URIs ensured URI validation is handled by ActiveMqConnectionFactory ensured informative error messages are shown to the userm removed unneeded test, cleaned up unused imports 
Reviewed by Tony Kurc (tkurc@apache.org). This closes #167
 2016-01-21 22:29:50 -05:00
Richard Miskin
68a9375f3e NIFI-1421 Update SplitXML to support namespace declarations 2016-01-21 22:19:15 +00:00
Mark Payne
f6ec437bc7 Merge branch 'master' into NIFI-259 2016-01-21 09:32:02 -05:00
Aldrin Piri
bc75dd3c17 NIFI-1406 Collecting the number of bytes sent regardless if one or multiple FlowFiles are sent. 
Reviewed by Tony Kurc (tkurc@apache.org). This closes #176
 2016-01-20 21:08:15 -05:00
Mark Payne
348831b20c Merge branch 'NIFI-1414' 2016-01-20 17:31:34 -05:00
smarthi
e1588d4136 [NIFI-1411] - TestJdbcTypesDerby: java.sql.SQLSyntaxErrorException: TYPE 'DATETIME' does not exist 2016-01-20 16:51:58 -05:00
Aldrin Piri
9ebcc9e4fa NIFI-1393 Providing the ability to send using gzip Content-Encoding in PostHTTP if the endpoint server supports it regardless if the processor is configured to send as a FlowFile This closes #175 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-01-20 16:46:57 -05:00
Mark Payne
d696391f76 NIFI-259: Update ZooKeeperStateServer so that the thread starting it doesn't block indefinitely, as this was causing NiFi to not shut down properly; applied patch for NIFI-1415 2016-01-20 11:52:41 -05:00
Mark Payne
7ef8af9eea NIFI-259: Applied patch for NIFI-1414 2016-01-20 09:14:04 -05:00
Mark Payne
1845f6df8d NIFI-1414: Ensure that the DirectoryStream is closed after streaming contents of a directory 2016-01-20 09:12:14 -05:00
Jeremy Dyer
8f688d4921 NIFI-1360 Add expression language support for "MergeContent" "Correlation Attribute Field" property 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-01-19 10:46:37 -08:00
Mark Payne
d6a21537c1 NIFI-259: Do not require the State File anymore, since state management is being used now 2016-01-19 11:03:31 -05:00
smarthi
9e9182aa63 - Unit test creates resources in HOME directory This closes #174 
Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-01-19 09:44:03 -05:00
Mark Payne
16dcf4595c Merge branch 'master' into NIFI-259 2016-01-18 08:48:30 -05:00
Mark Payne
eba25ecaca NIFI-259, NIFI-1339: Added OnConfigurationRestored annotation, always invoke onPropertyModified even on restart when properties are changed from defaults, as was done previously 2016-01-17 14:40:27 -05:00
Jeremy Dyer
ecb81ec113 NIFI-1362 Set mime.type attribute on response FlowFile based on InvokeHTTP response Content-Type 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-01-15 16:40:36 -05:00
Mark Payne
0cd6f80f36 NIFI-259: Bug fixes 2016-01-13 15:11:53 -05:00
Mark Payne
0151b1eed1 NIFI-259: Fixed checkstyle violations 2016-01-13 13:57:47 -05:00
Mark Payne
d39067ede6 NIFI-259: Update GetHBase to use new State Management feature; updated docs; bug fixes 2016-01-13 13:30:05 -05:00
Mark Payne
bbce596d74 NIFI-259: Updated GetHBase to use new State Management; bug fixes; updated docs 2016-01-13 12:47:08 -05:00
Andy LoPresto
c757c4d6ea NIFI-1385: Resolved test for missing file which was failing on Windows due to differing error message. 
Reviewed by Tony Kurc (tkurc@apache.org)
 2016-01-12 19:16:29 -05:00
Mark Payne
774c29a4da NIFI-259: Added Stateful annotation as described on ticket 2016-01-12 15:28:35 -05:00
Mark Payne
b4bc105ea9 Merge branch 'nifi-1283' of https://github.com/jvwing/nifi 2016-01-12 10:49:04 -05:00
Mark Payne
f6b34cbbc5 NIFI-259: Removed bad unit test 2016-01-12 10:40:00 -05:00
Mark Payne
e559c68766 NIFI-259: Began updating processors to use new state management 2016-01-12 10:21:47 -05:00
Matt Gilman
44ffddd8b9 NIFI-1324: 
- Addressing lengthy lines contrib-check issue.
- This closes #162
 2016-01-12 09:42:31 -05:00
Andy LoPresto
ffbfffce6d NIFI-1324: 
Changed Maven dependencies for BouncyCastle bcprov and bcpg from jdk16:1.46 to jdk15on:1.53 (kept nifi-web-security on jdk16:1.46 because jdk15on:1.53 splits OCSP logic into new module bcpkix).
Added individual unit tests for PGP public keyring validation.
Passes all legacy unit tests.
Added TODOs for customizable brick encryption and refactoring shared code.
Cleaned up magic numbers to constants.
Added unit tests for OpenPGPPasswordBasedEncryptor (internal consistency and legacy file decrypt).
Began refactoring shared encrypt code from OpenPGP* implementations.
Extracted encrypt utility method from OpenPGPPasswordBasedEncryptor to PGPUtil class.
Added test resources (signed and unsigned key-encrypted files).
Added unit tests for OpenPGPKeyBasedEncryptor (internal consistency and external file decrypt).
Changed BC dependency for nifi-web-security to bcprov-jdk15on:1.53 and bcpkix-jdk15on:1.53.
Updated OCSPValidator to use new BC logic for OCSP validation. This code compiles but should be fully audited, as the legacy OCSP validation was not completely implemented.
Added skeleton of OCSP validator unit tests with successful keypair and certificate generation and signing code.
Added further unit tests for issued certificates.
Annotated unimplemented unit tests with note about Groovy integration.
Refactored Jersey call in OCSPCertificateValidator to internal method.
Added toString() to NiFi local OcspRequest.
Implemented positive & negative unit tests with cache injection for valid/revoked OCSP certificate.
Resolved contrib-check issues.
Removed ignored code in unit test.

Signed-off-by: Matt Gilman <matt.c.gilman@gmail.com>
 2016-01-12 09:22:51 -05:00
jpercivall
6b54753dbb NIFI-1316 adding option to DetectDuplicate to not cache the entry identifier 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-01-11 22:59:24 -05:00
James Wing
c526656a22 NIFI-1283 Fixing ControllerStatusReportingTask loggers to use fully-qualified class name 2016-01-11 13:39:15 -08:00
Mark Payne
d2a969e3d6 NIFI-259: Initial implementation of State Management feature 2016-01-11 16:38:52 -05:00
joewitt
0c68e2c3a8 NIFI-1378 added validator to ensure the JMS URI has a scheme set 
Signed-off-by: Aldrin Piri <aldrin@apache.org>
 2016-01-10 16:07:56 -05:00
Aldrin Piri
317b2f4a4a NIFI-1361 Exposing Content-Type as a processor property for both InvokeHTTP and PostHTTP. This makes use of the mime.type attribute via the EL expression ${mime.type}, making more apparent to the user how this header is derived and allowing the explicit setting of a value. 2016-01-08 10:43:14 -05:00