Bryan Bende
5930c0c212
NIFI-4346 Modifying HBase_1_1_2_LookupService to use HBase_1_1_2_ClientService, instead of extend it
...
This closes #2125 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-10-07 15:36:49 -04:00
Mike Thomsen
eb97a68110
NIFI-4346 Created a LookupService that uses HBase as its back end.
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-10-07 15:36:44 -04:00
joewitt
1d5df4a5ec
NIFI-4466 fixed incorrect license header back to ASF and addressed some whitespace formatting in a couple of those poms. This closes #2197 .
2017-10-06 11:15:59 -04:00
Mark Owens
701597775f
NIFI-1547: DistributedMapCacheServer: Ambiguous error on
...
misconfiguration
Updated PersistentMapCache constructor in PersistentMapCache.java to
catch an OverlappingFileLockException and present a more useful error
message before propagating the exception forward. The log message alerts
user to possible duplicated persistencePath in call to
PersistentMapCache.
Created a test method to verify the exception is thrown as expected.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2192
2017-10-05 16:44:43 -04:00
Andy LoPresto
d4168f5ff1
NIFI-4297
...
- Upgraded immediately actionable dependency versions from Meterian report.
- Upgraded jackson-core test dependencies for HBase and Elasticsearch modules.
- Only 3 instances of jackson-core < 2.8.6 (Google Cloud Platform and Spark Receiver modules).
- Upgraded version of poi dependency in nifi-email-processors to 3.16.
- Resolving dependency issues after rebasing against 1.5.0-SNAPSHOT.
- Removed jackson-databind from <dependencyManagement> block in nifi/pom.xml and added explicit reference to ${jackson.version} in all referenced artifacts.
- Removed jackson-mapper-asl from <dependencyManagement> block in nifi/pom.xml and added explicit reference to ${jackson.old.version} in all referenced artifacts.
- Removed Jasypt from <dependencyManagement> and added explicit version in test dependency for legacy compatibility.
- This closes #2084
2017-10-05 15:23:52 -04:00
Jeff Storck
a57911d3db
NIFI-4412-RC2 prepare for next development iteration
2017-09-28 13:45:36 -04:00
Jeff Storck
e6508ba7d3
NIFI-4412-RC2 prepare release nifi-1.4.0-RC2
2017-09-28 13:45:21 -04:00
Arun Manivannan
3b1b326b13
NIFI-4416 CSVRecordReader does not accept escaped character as delimiter
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2172
2017-09-25 22:32:15 -04:00
Matthew Burgess
1ca4fa3a83
NIFI-4345: Removed lookup-services dependency from MongoDB Services NAR, cleaned up deps
...
- Added nifi-lookup-service-api to nifi-nar-bundles POM
This closes #2174 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-09-25 14:52:33 -04:00
Mike Thomsen
9a8e6b2eb1
NIFI-4345 Added a MongoDB controller service and a lookup service.
...
NIFI-4345: Changed Lookup Key to Lookup Value Field
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2123
2017-09-22 13:33:07 -04:00
Mark Payne
b452f8c251
NIFI-4378: Allow suppression of null values in JSON
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2148 .
2017-09-12 21:41:59 +02:00
Wesley-Lawrence
e203358bf3
NIFI-4258 Corrected a bug with the 'Informix Unload Escape Disabled' CSV format. This closes #2090 .
2017-09-08 16:17:38 -04:00
Pierre Villard
6559604456
NIFI-4081 - Added raw message option in GrokReader
...
This closes #1921 .
2017-09-08 12:44:37 -04:00
Koji Kawamura
1f67cbf628
NIFI-4004: Use RecordReaderFactory without FlowFile.
...
- Removed FlowFile from RecordReaderFactory, RecordSetWriterFactory and SchemaAccessStrategy.
- Renamed variable 'allowableValue' to 'strategy' to represent its meaning better.
- Removed creation of temporal FlowFile to resolve Record Schema from ConsumerLease.
- Removed unnecessary 'InputStream content' argument from
RecordSetWriterFactory.getSchema method.
This closes #1877 .
2017-09-08 12:37:40 -04:00
m-hogue
03e51ee8ac
NIFI-4335: Changed SSLContextService implementations to RestrictedSSLContextService for all Listen* processors
...
This closes #2131 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-09-07 17:34:00 -07:00
m-hogue
d28e61c5dd
NIFI-2528 Added RestrictedSSLContextService interface with implementation. Changed ListenHTTP to allow only new StandardRestrictedSSLContextService.
...
This closes #1986 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-08-30 20:17:01 -07:00
Bryan Bende
60d4672195
NIFI-4304 Extracting HWX Schema Registry client version to a property and bumping to latest 0.3.0 release
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2096
2017-08-17 16:07:03 -04:00
Mark Payne
451f9cf124
NIFI-4142: This closes #2015 . Refactored Record Reader/Writer to allow for reading/writing "raw records". Implemented ValidateRecord. Updated Record Reader to take two parameters for nextRecord: (boolean coerceTypes) and (boolean dropUnknownFields)
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-08-11 22:01:46 -07:00
Bryan Bende
f7da7e67f4
NIFI-4275 Adding support for specifying the timestamp on PutHBase processors
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2070 .
2017-08-11 18:04:13 +02:00
Andy LoPresto
5150dff70b
NIFI-4274 Removed EL evaluation logic from custom file validator.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2071 .
2017-08-10 10:05:16 +02:00
Mike Thomsen
496a32e12c
NIFI-4024 Added org.apache.nifi.hbase.PutHBaseRecord
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-08-04 14:54:01 -04:00
Pierre Villard
45f82dc855
NIFI-4111 - NiFi shutdown
...
Fixed threads shutdown so that NiFi can shutdown gracefully
NIFI-4111 - Review - Handling SocketRemoteSiteListener (RAW S2S)
This closes #1963 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-07-07 14:23:18 +09:00
Mark Payne
3906d4e1d2
NIFI-1763: Initial implementation of ConfluentSchemaRegistry.
...
NIFI-1763: Fixed bug where the Confluent Schema Registry Schema Access Writer was not being created
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #1938
2017-07-06 15:52:07 -04:00
Steve Champagne
68b42c9e54
NIFI-4055: Add a compression option to AvroRecordSetWriter
...
This closes #1909 .
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2017-06-26 19:16:31 +02:00
Mark Payne
8878d732dd
NIFI-4103: Return an empty Optional if an IP address cannot be found
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1933
2017-06-23 11:14:57 -04:00
Maurizio Colleluori
59a32948ea
NIFI-2923 Added evaluation of attribute expressions for Kerberos principal and keytab
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-21 17:14:28 -04:00
Mark Payne
73e601bc55
NIFI-4102: If first line read does not match Grok expression, skip line
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1932
2017-06-21 15:10:22 -04:00
Matt Gilman
490e1da5db
NIFI-4019:
...
- Adding support for X-Forwarded-* headers.
- Unrelated code clean up.
- Addressing additional proxying issues.
- Addressing mistyped landing page.
- Handled trailing slashes in proxy headers for context path
2017-06-15 14:17:35 -04:00
Bryan Bende
2b47ade0c4
NIFI-4049 Fixing unit test that doesn't run on OSX and caused Travis failure
2017-06-12 16:36:23 -04:00
Koji Kawamura
de1b84e2aa
NIFI-4049: Refactor AtomicDistributedMapCacheClient
...
To be used with cache engines that does not have revision number.
NIFI-4049: Refactor AtomicDistributedMapCacheClient
Removed old methods completely.
This closes #1904 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-12 10:34:48 -04:00
Mark Payne
e7dcb6f6c5
NIFI-3921: Allow Record Writers to inherit schema from Record
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1902
2017-06-09 16:13:25 -04:00
Matt Gilman
cc741d2be6
NIFI-3997:
...
- Bumping to next minor version.
2017-06-08 15:22:51 -04:00
Matt Gilman
1bf0a1a849
Merge branch 'NIFI-3997-RC1'
2017-06-08 14:30:10 -04:00
Steve Champagne
45e035686f
NIFI-4029: Allow null Avro default values in HortonworksSchemaRegistry
...
This closes #1894 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-07 12:03:53 -04:00
Matt Gilman
6ee12e9b47
NIFI-3997-RC1prepare for next development iteration
2017-06-05 11:07:43 -04:00
Matt Gilman
ddb73612bd
NIFI-3997-RC1prepare release nifi-1.3.0-RC1
2017-06-05 11:07:28 -04:00
Mark Payne
37be0b9820
NIFI-3990: This closes #1870 . Avoided creating garbage when we can avoid it in the JSON and csv readers and json writer
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-06-02 10:01:40 -04:00
Mark Payne
067e9dfeb0
NIFI-4003: Expose configuration option for cache size and duration NIFI-4003: Addressed remaining spots where client does not cache information
...
This closes #1879 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-01 15:31:35 -04:00
Yolanda M. Davis
dd50745a9f
NIFI-3984 - upgraded version of schema-registry client to 0.2.1
...
This closes #1866 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-26 17:59:53 -04:00
Koji Kawamura
4d0667380a
NIFI-3404: Improved UX of LookupAttributes.
...
- Added dependency notice.
- Added EL evaluation at SimpleKeyValueLookupService.
- Updated documentation.
- Updated CommonsConfigurationLookupService to throw LookupFailureException if it fails to get configuration so that error messages can be displayed at each processor bulletin.
- Added calling getConfiguration at OnEnabled of CommonsConfigurationLookupService, so that the service will stay in Enabling state if there is any issue.
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2017-05-25 10:05:32 -05:00
Joey Frazee
46e2420d74
NIFI-3404 Added LookupAttribute processor and lookup controller services
...
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2017-05-25 10:05:32 -05:00
Bryan Bende
ae3db82303
NIFI-3644 Fixing the result handler in HBase_1_1_2_ClientMapCacheService to use the offsets for the value bytes
...
This closes #1645 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-24 14:59:28 -04:00
baolsen
152f002abf
Completed initial development of HBase_1_1_2_ClientMapCacheService.java which is compatible with DetectDuplicate (and other processors)
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-24 14:59:23 -04:00
Bryan Bende
a8de27e69b
NIFI-3732 Adding connect with timeout to StandardCommsSession and SSLCommsSession to avoid blocking
...
This closes #1842 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-05-23 15:43:27 +09:00
Mark Payne
a1b07b1e9c
NIFI-3949: Updated Grok Reader to allow for sub-patterns to be used when determining the schema
...
This closes #1839 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-22 16:30:47 -04:00
Mark Payne
6937a6cf64
NIFI-3953: This closes #1837 . Allow multiple schemas on same kafka topic/partition for ConsumeKafkaRecord_0_10
...
Also, updated record writers to ensure that they write the schema as appropriate if not using a RecordSet. Updated ConsumeKafkaRecord to allow for multiple schemas to be on same topic and partition
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-22 14:37:53 -04:00
Mark Payne
7f8987471d
NIFI-3946: Update LookupService to take a Map instead of a String for the input
...
NIFI-3946: Fixed issues where null values were returned instead of empty optionals
This closes #1833 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-22 11:52:41 -04:00
Bryan Bende
71cd497fef
NIFI-3942 Added retry logic if a lookup fails due to InvalidDatabaseException which occurs if the underlying file was modified before we could refresh the reader
...
This closes #1831 .
2017-05-22 09:12:51 -04:00
Bryan Bende
f35e0ecdd0
NIFI-3942 Making IPLookupService reload the database file on the fly when detecting the file has changed
2017-05-22 09:06:42 -04:00
Mark Payne
c49933f03d
NIFI-3948: This closes #1834 . Added flush() method to RecordWriter and call it when writing a single record to OutputStream for PublishKafkaRecord. Also removed no-longer-used class WriteAvroResult
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-19 23:05:04 -04:00