joewitt
f8466cb16d
NIFI-4995-RC3 prepare release nifi-1.6.0-RC3
2018-04-03 08:28:15 -07:00
Bryan Bende
b7e1f48133
NIFI-5035 Moving MongoDB services out of standard services
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2599
2018-04-02 12:18:27 -04:00
Bryan Bende
134339c4b7
NIFI-5021 Moving nifi-elasticsearch-client-service-api to nifi-elasticsearch-bundle and creating NAR for the API
...
This closes #2586 .
2018-04-02 09:49:05 -04:00
joewitt
7b5bf265a6
NIFI-4995 updating copyright year on all notices
2018-03-26 21:54:10 -04:00
Mike Thomsen
aa947e4d3e
NIFI-4325 Added new processor that uses the JSON DSL.
...
NIFI-4325 Cleaned up how ElasticSearch client service builds SSLContext, added query attribute to flowfiles and other changes requested in a code review.
This closes #2113 .
Signed-off-by: Joe Percivall <JPercivall@apache.org>
2018-03-26 15:01:37 -04:00
Derek Straka
95dd1ebffc
NIFI-4882: Resolve issue with parsing custom date, time, and timestamp formats in CSV files
...
Refactor the two existing CSV classes to inherit from an abstract base class that parses the data
Add unit tests for calls to nextRecord that do not coerce types
This closes #2473 .
Signed-off-by: Derek Straka <derek@asterius.io>
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-03-22 09:18:00 +09:00
Mark Payne
0b0aebe148
NIFI-4917: Externalize Keytab and Principal configuration from Processors to a Controller Service. This gives us the ability to allow users to interact with those Keytabs/Principals to which they've been given access without allowing them access to all Keytabs and Principals
...
- Addressed review feedback; rebased against master
This closes #2552 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-03-21 14:23:41 -04:00
Derek Straka
5bdb7cf6e7
NIFI-4912: This closes #2494 . Update jackson version to latest stable version (2.9.4)
...
Signed-off-by: joewitt <joewitt@apache.org>
2018-03-19 10:22:50 -04:00
Bryan Bende
de71a41bd0
NIFI-4935 Refactoring to support specifying schema branch or schema version when using schema by name strategy
...
This closes #2523 .
Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-03-15 16:16:12 -04:00
Pierre Villard
11a7d5c09f
NIFI-4955 - Preserve columns ordering with CSV and ValidateRecord
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2528
2018-03-13 17:09:07 -04:00
Pierre Villard
95e543d4cc
NIFI-4967 - CSVRecordReader does not read header with specific formats
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2536
2018-03-13 16:54:46 -04:00
Pierre Villard
c75604a564
NIFI-4966 - JacksonCSVRecordReader - NPE with some CSV formats
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2535
2018-03-13 16:49:47 -04:00
Ed
c2616e6fe7
NIFI-4833 Add ScanHBase Processor
...
- New processor for scanning HBase records based on verious params like range of rowkeys, range of timestamps. Supports result limit and reverse scan.
- Adds Atlas Support for ScanHBase processor
- Fixed not recent version of FF
- Formatting and Style changes
- Single line to multiline if-then statements
- Removed HTML formatting that is not used for doc generation
- Fixed issue with limitRows
- Fixed issue with filter expression
- Refactored "processRows"
- Fixed possible NPE for bulkSize var
- Changed provenance to "receive" to indicate new data from external source.
- Updated min/max timestamp custom validation
- JSON array support
- Removed in-memory caching for records. Now records are being written directly to FF
- Removed unfinished flowfile from session, transfered original to "failure". Test cases update as well
This closes #2478 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-03-13 10:07:07 -04:00
joewitt
c71409fb5d
NIFI-4936 trying to quiet down the mvn output a bit so we dont exceed the travis-ci 4MB max
...
NIFI-4936 updated dependency handling pushing down delcarations where they belong
This closes #2512
2018-03-09 16:34:53 -05:00
Mike Thomsen
3cdd3f60f6
NIFI-4949 Converted nifi-mongodb-services' unit tests into integration tests so that the @Ignore annotation doesn't have to be removed to make them run.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2525 .
2018-03-09 09:36:15 +01:00
Pierre Villard
1f8af1bde3
NIFI-4948 - MongoDB Lookup Service throws an exception if there is no match
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2522
2018-03-08 13:28:41 -05:00
Mike Thomsen
143d7e6829
NIFI-3538 Added DeleteHBaseRow
...
This closes #2294 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-02-14 10:04:25 +09:00
Koji Kawamura
b4a9f52a4e
NIFI-4866: Fixed HBase performance issue
...
HBase_1_1_2_ClientService performance dropped due to accessing HBase
admin upon every FlowFile transfer. Fixed that by getting master address
only once when the service is enabled and a connection is established.
This closes #2464
2018-02-11 16:14:52 -05:00
Mark Payne
4428fe28bf
NIFI-4858: Expose Request Timeout from HTTP Context Map and use that to set as the timeout of the 'AsyncContext' in HandleHttpRequest. Otherwise, the request will never timeout (which is OK because the HttpContextMap will handle this). However, Jetty behind the scenes is adding a task to Scheduled Executor for each request with a delay of whatever the timeout is set to. Since it's currently set to Long.MAX_VALUE, that task will never be run and as a result the ExecutorService's queue will grow indefinitely, eventually exhausting the JVM Heap
...
This closes #2460 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-02-08 17:38:13 -05:00
Mark Payne
7c1ce17223
NIFI-4756: Updated PublishKafkaRecord processors to include attributes generated from schema write strategy into the message headers when appropriate
...
This closes #2396 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-01-16 16:31:34 -05:00
joewitt
41ce788812
NIFI-4751 changed to next minor release version snapshot
2018-01-12 15:15:32 -05:00
joewitt
36405e888c
NIFI-4751-RC1 prepare for next development iteration
2018-01-08 23:39:49 -07:00
joewitt
46d30c7e92
NIFI-4751-RC1 prepare release nifi-1.5.0-RC1
2018-01-08 23:39:32 -07:00
joewitt
6ee6b5e57c
NIFI-4734 refactored couchbase bundle, jms bundle, removed jms test-lib usage, fixed broken SeeAlso and service links causing docs warns. Corrected L&N in each bundle. This closes #2369 .
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-01-04 09:16:17 -05:00
Jeff Storck
42a1ee011b
NIFI-4323 This closes #2360 . Wrapped Get/ListHDFS hadoop operations in ugi.doAs calls
...
NIFI-3472 NIFI-4350 Removed explicit relogin code from HDFS/Hive/HBase components and updated SecurityUtils.loginKerberos to use UGI.loginUserFromKeytab. This brings those components in line with daemon-process-style usage, made possible by NiFi's InstanceClassloader isolation. Relogin (on ticket expiry/connection failure) can now be properly handled by hadoop-client code implicitly.
NIFI-3472 Added default value (true) for javax.security.auth.useSubjectCredsOnly to bootstrap.conf
NIFI-3472 Added javadoc explaining the removal of explicit relogin threads and usage of UGI.loginUserFromKeytab
Readded Relogin Period property to AbstractHadoopProcessor, and updated its documentation to indicate that it is now a deprecated property
Additional cleanup of code that referenced relogin periods
Marked KerberosTicketRenewer is deprecated
NIFI-3472 Cleaned up imports in TestPutHiveStreaming
2018-01-03 11:31:47 -05:00
Mark Payne
c91d99884a
NIFI-4717: Several minor bug fixes and performance improvements around record-oriented processors
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2359
2017-12-29 10:43:21 -05:00
Mike Moser
c59a967623
NIFI-4504, NIFI-4505 added removeAndGet, removeByPatternAndGet, and keySet methods to MapCache API
...
cleaned up some warnings on deprecated nifi.stream.io classes
This closes #2284 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-12-29 00:23:09 +09:00
Matthew Burgess
14d2291db8
NIFI-4496: Added JacksonCSVRecordReader to allow choice of CSV parser. This closes #2245 .
2017-12-22 08:56:29 -05:00
Mark Payne
406db4867a
NIFI-4702: When we check the next line for matches in Grok Reader, store the Map that is returned so that we don't have to re-evaluate the regexes the next time that nextRecord() is called
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2349
2017-12-18 09:41:05 -05:00
Mike Thomsen
d7347a2dc3
NIFI-4644 Fixed LookupService API to allow for more than String/String lookup pairs. This closes #2304 .
2017-12-13 16:04:23 -05:00
Mike Thomsen
bfe92b9000
NIFI-3970 added changes from a code review.
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2334
2017-12-11 19:16:34 -05:00
Matthew Burgess
63840377dd
NIFI-3970: Add CSVRecordLookupService
2017-12-11 19:14:27 -05:00
Mark Payne
f772f2f093
NIFI-4671: This closes #2328 . Ensure that Avro Schemas that are created properly denote fields as being nullable iff the schemas says they are, for non-top-level fields
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-11 11:46:15 -05:00
Mark Payne
c138987bb4
NIFI-4656, NIFI-4680: This closes #2330 . Fix error handling in consume/publish kafka processors. Address issue with HortonworksSchemaRegistry throwing RuntimeException when it should be IOException. Fixed bug in ConsumeerLease/ConsumKafkaRecord that caused it to report too many records received
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-08 16:01:14 -05:00
Matthew Burgess
16a23f5a0f
NIFI-4589: Allow multiple keys in FetchDistributedMapCache, add subMap operation to API
...
Signed-off-by: Mike Moser <mosermw@apache.org>
This closes #2260 .
2017-11-21 20:13:35 +00:00
Matt Gilman
6b75921725
NIFI-4617:
...
- Ensuring a charset is specified when convert a string into bytes.
- Ensuring the aggregate snapshot is non null before attempting to promote the runStatus.
This closes #2278 .
2017-11-20 09:39:23 -05:00
Matt Gilman
2da72f1524
NIFI-4593: - Ensuring the necessary jackson dependencies are bundled.
...
This closes #2263 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-11-16 15:44:37 -05:00
Koji Kawamura
116c846342
NIFI-4543: Improve HBase processors provenance transit URL
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2237 .
2017-11-02 18:24:40 +01:00
patricker
e3482cc772
NIFI-4534 Choose Character Set for CSV Record Read/Write streams
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2229 .
2017-10-27 10:34:15 +02:00
Mark Payne
95e86c1f51
NIFI-4495: Expose the option for supressing null values on the JSON Writer
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2218 .
2017-10-19 10:20:40 +02:00
patricker
fd00df3d2f
NIFI-4465 ConvertExcelToCSV Data Formatting and Delimiters
...
This closes #2194 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-10-17 14:56:49 +09:00
Matt Gilman
6baea8ccff
NIFI-4444:
...
- Upgrading to Jersey 2.x.
- Updating NOTICE files where necessary.
- Fixing checkstyle issues.
This closes #2206 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-10-12 10:27:02 -07:00
Bryan Bende
5930c0c212
NIFI-4346 Modifying HBase_1_1_2_LookupService to use HBase_1_1_2_ClientService, instead of extend it
...
This closes #2125 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-10-07 15:36:49 -04:00
Mike Thomsen
eb97a68110
NIFI-4346 Created a LookupService that uses HBase as its back end.
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-10-07 15:36:44 -04:00
joewitt
1d5df4a5ec
NIFI-4466 fixed incorrect license header back to ASF and addressed some whitespace formatting in a couple of those poms. This closes #2197 .
2017-10-06 11:15:59 -04:00
Mark Owens
701597775f
NIFI-1547: DistributedMapCacheServer: Ambiguous error on
...
misconfiguration
Updated PersistentMapCache constructor in PersistentMapCache.java to
catch an OverlappingFileLockException and present a more useful error
message before propagating the exception forward. The log message alerts
user to possible duplicated persistencePath in call to
PersistentMapCache.
Created a test method to verify the exception is thrown as expected.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2192
2017-10-05 16:44:43 -04:00
Andy LoPresto
d4168f5ff1
NIFI-4297
...
- Upgraded immediately actionable dependency versions from Meterian report.
- Upgraded jackson-core test dependencies for HBase and Elasticsearch modules.
- Only 3 instances of jackson-core < 2.8.6 (Google Cloud Platform and Spark Receiver modules).
- Upgraded version of poi dependency in nifi-email-processors to 3.16.
- Resolving dependency issues after rebasing against 1.5.0-SNAPSHOT.
- Removed jackson-databind from <dependencyManagement> block in nifi/pom.xml and added explicit reference to ${jackson.version} in all referenced artifacts.
- Removed jackson-mapper-asl from <dependencyManagement> block in nifi/pom.xml and added explicit reference to ${jackson.old.version} in all referenced artifacts.
- Removed Jasypt from <dependencyManagement> and added explicit version in test dependency for legacy compatibility.
- This closes #2084
2017-10-05 15:23:52 -04:00
Jeff Storck
a57911d3db
NIFI-4412-RC2 prepare for next development iteration
2017-09-28 13:45:36 -04:00
Jeff Storck
e6508ba7d3
NIFI-4412-RC2 prepare release nifi-1.4.0-RC2
2017-09-28 13:45:21 -04:00
Arun Manivannan
3b1b326b13
NIFI-4416 CSVRecordReader does not accept escaped character as delimiter
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2172
2017-09-25 22:32:15 -04:00
Matthew Burgess
1ca4fa3a83
NIFI-4345: Removed lookup-services dependency from MongoDB Services NAR, cleaned up deps
...
- Added nifi-lookup-service-api to nifi-nar-bundles POM
This closes #2174 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-09-25 14:52:33 -04:00
Mike Thomsen
9a8e6b2eb1
NIFI-4345 Added a MongoDB controller service and a lookup service.
...
NIFI-4345: Changed Lookup Key to Lookup Value Field
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2123
2017-09-22 13:33:07 -04:00
Mark Payne
b452f8c251
NIFI-4378: Allow suppression of null values in JSON
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2148 .
2017-09-12 21:41:59 +02:00
Wesley-Lawrence
e203358bf3
NIFI-4258 Corrected a bug with the 'Informix Unload Escape Disabled' CSV format. This closes #2090 .
2017-09-08 16:17:38 -04:00
Pierre Villard
6559604456
NIFI-4081 - Added raw message option in GrokReader
...
This closes #1921 .
2017-09-08 12:44:37 -04:00
Koji Kawamura
1f67cbf628
NIFI-4004: Use RecordReaderFactory without FlowFile.
...
- Removed FlowFile from RecordReaderFactory, RecordSetWriterFactory and SchemaAccessStrategy.
- Renamed variable 'allowableValue' to 'strategy' to represent its meaning better.
- Removed creation of temporal FlowFile to resolve Record Schema from ConsumerLease.
- Removed unnecessary 'InputStream content' argument from
RecordSetWriterFactory.getSchema method.
This closes #1877 .
2017-09-08 12:37:40 -04:00
m-hogue
03e51ee8ac
NIFI-4335: Changed SSLContextService implementations to RestrictedSSLContextService for all Listen* processors
...
This closes #2131 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-09-07 17:34:00 -07:00
m-hogue
d28e61c5dd
NIFI-2528 Added RestrictedSSLContextService interface with implementation. Changed ListenHTTP to allow only new StandardRestrictedSSLContextService.
...
This closes #1986 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-08-30 20:17:01 -07:00
Bryan Bende
60d4672195
NIFI-4304 Extracting HWX Schema Registry client version to a property and bumping to latest 0.3.0 release
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2096
2017-08-17 16:07:03 -04:00
Mark Payne
451f9cf124
NIFI-4142: This closes #2015 . Refactored Record Reader/Writer to allow for reading/writing "raw records". Implemented ValidateRecord. Updated Record Reader to take two parameters for nextRecord: (boolean coerceTypes) and (boolean dropUnknownFields)
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-08-11 22:01:46 -07:00
Bryan Bende
f7da7e67f4
NIFI-4275 Adding support for specifying the timestamp on PutHBase processors
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2070 .
2017-08-11 18:04:13 +02:00
Andy LoPresto
5150dff70b
NIFI-4274 Removed EL evaluation logic from custom file validator.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2071 .
2017-08-10 10:05:16 +02:00
Mike Thomsen
496a32e12c
NIFI-4024 Added org.apache.nifi.hbase.PutHBaseRecord
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-08-04 14:54:01 -04:00
Pierre Villard
45f82dc855
NIFI-4111 - NiFi shutdown
...
Fixed threads shutdown so that NiFi can shutdown gracefully
NIFI-4111 - Review - Handling SocketRemoteSiteListener (RAW S2S)
This closes #1963 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-07-07 14:23:18 +09:00
Mark Payne
3906d4e1d2
NIFI-1763: Initial implementation of ConfluentSchemaRegistry.
...
NIFI-1763: Fixed bug where the Confluent Schema Registry Schema Access Writer was not being created
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #1938
2017-07-06 15:52:07 -04:00
Steve Champagne
68b42c9e54
NIFI-4055: Add a compression option to AvroRecordSetWriter
...
This closes #1909 .
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2017-06-26 19:16:31 +02:00
Mark Payne
8878d732dd
NIFI-4103: Return an empty Optional if an IP address cannot be found
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1933
2017-06-23 11:14:57 -04:00
Maurizio Colleluori
59a32948ea
NIFI-2923 Added evaluation of attribute expressions for Kerberos principal and keytab
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-21 17:14:28 -04:00
Mark Payne
73e601bc55
NIFI-4102: If first line read does not match Grok expression, skip line
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1932
2017-06-21 15:10:22 -04:00
Matt Gilman
490e1da5db
NIFI-4019:
...
- Adding support for X-Forwarded-* headers.
- Unrelated code clean up.
- Addressing additional proxying issues.
- Addressing mistyped landing page.
- Handled trailing slashes in proxy headers for context path
2017-06-15 14:17:35 -04:00
Bryan Bende
2b47ade0c4
NIFI-4049 Fixing unit test that doesn't run on OSX and caused Travis failure
2017-06-12 16:36:23 -04:00
Koji Kawamura
de1b84e2aa
NIFI-4049: Refactor AtomicDistributedMapCacheClient
...
To be used with cache engines that does not have revision number.
NIFI-4049: Refactor AtomicDistributedMapCacheClient
Removed old methods completely.
This closes #1904 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-12 10:34:48 -04:00
Mark Payne
e7dcb6f6c5
NIFI-3921: Allow Record Writers to inherit schema from Record
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1902
2017-06-09 16:13:25 -04:00
Matt Gilman
cc741d2be6
NIFI-3997:
...
- Bumping to next minor version.
2017-06-08 15:22:51 -04:00
Matt Gilman
1bf0a1a849
Merge branch 'NIFI-3997-RC1'
2017-06-08 14:30:10 -04:00
Steve Champagne
45e035686f
NIFI-4029: Allow null Avro default values in HortonworksSchemaRegistry
...
This closes #1894 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-07 12:03:53 -04:00
Matt Gilman
6ee12e9b47
NIFI-3997-RC1prepare for next development iteration
2017-06-05 11:07:43 -04:00
Matt Gilman
ddb73612bd
NIFI-3997-RC1prepare release nifi-1.3.0-RC1
2017-06-05 11:07:28 -04:00
Mark Payne
37be0b9820
NIFI-3990: This closes #1870 . Avoided creating garbage when we can avoid it in the JSON and csv readers and json writer
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-06-02 10:01:40 -04:00
Mark Payne
067e9dfeb0
NIFI-4003: Expose configuration option for cache size and duration NIFI-4003: Addressed remaining spots where client does not cache information
...
This closes #1879 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-01 15:31:35 -04:00
Yolanda M. Davis
dd50745a9f
NIFI-3984 - upgraded version of schema-registry client to 0.2.1
...
This closes #1866 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-26 17:59:53 -04:00
Koji Kawamura
4d0667380a
NIFI-3404: Improved UX of LookupAttributes.
...
- Added dependency notice.
- Added EL evaluation at SimpleKeyValueLookupService.
- Updated documentation.
- Updated CommonsConfigurationLookupService to throw LookupFailureException if it fails to get configuration so that error messages can be displayed at each processor bulletin.
- Added calling getConfiguration at OnEnabled of CommonsConfigurationLookupService, so that the service will stay in Enabling state if there is any issue.
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2017-05-25 10:05:32 -05:00
Joey Frazee
46e2420d74
NIFI-3404 Added LookupAttribute processor and lookup controller services
...
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2017-05-25 10:05:32 -05:00
Bryan Bende
ae3db82303
NIFI-3644 Fixing the result handler in HBase_1_1_2_ClientMapCacheService to use the offsets for the value bytes
...
This closes #1645 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-24 14:59:28 -04:00
baolsen
152f002abf
Completed initial development of HBase_1_1_2_ClientMapCacheService.java which is compatible with DetectDuplicate (and other processors)
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-24 14:59:23 -04:00
Bryan Bende
a8de27e69b
NIFI-3732 Adding connect with timeout to StandardCommsSession and SSLCommsSession to avoid blocking
...
This closes #1842 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-05-23 15:43:27 +09:00
Mark Payne
a1b07b1e9c
NIFI-3949: Updated Grok Reader to allow for sub-patterns to be used when determining the schema
...
This closes #1839 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-22 16:30:47 -04:00
Mark Payne
6937a6cf64
NIFI-3953: This closes #1837 . Allow multiple schemas on same kafka topic/partition for ConsumeKafkaRecord_0_10
...
Also, updated record writers to ensure that they write the schema as appropriate if not using a RecordSet. Updated ConsumeKafkaRecord to allow for multiple schemas to be on same topic and partition
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-22 14:37:53 -04:00
Mark Payne
7f8987471d
NIFI-3946: Update LookupService to take a Map instead of a String for the input
...
NIFI-3946: Fixed issues where null values were returned instead of empty optionals
This closes #1833 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-22 11:52:41 -04:00
Bryan Bende
71cd497fef
NIFI-3942 Added retry logic if a lookup fails due to InvalidDatabaseException which occurs if the underlying file was modified before we could refresh the reader
...
This closes #1831 .
2017-05-22 09:12:51 -04:00
Bryan Bende
f35e0ecdd0
NIFI-3942 Making IPLookupService reload the database file on the fly when detecting the file has changed
2017-05-22 09:06:42 -04:00
Mark Payne
c49933f03d
NIFI-3948: This closes #1834 . Added flush() method to RecordWriter and call it when writing a single record to OutputStream for PublishKafkaRecord. Also removed no-longer-used class WriteAvroResult
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-19 23:05:04 -04:00
Mark Payne
ae9953db64
NIFI-3857: This closes #1825 . Added PartitionRecord processor
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-19 02:08:52 -04:00
Mark Payne
9bd0246a96
NIFI-3863: Initial implementation of Lookup Services. Implemented LookupRecord processors. This required some refactoring of RecordSetWriter interface, so refactored that interface and all implementations and references of it
2017-05-19 01:02:41 -04:00
Mark Payne
5cf4bf61b3
NIFI-3917: Use a default value of 'false' for CSV Reader's Skip Header Line property. This closes #1819
2017-05-17 13:31:53 -04:00
Koji Kawamura
40a9cd4f2e
NIFI-3919: Let AvroTypeUtil try every possible type
...
Before this fix, AvroTypeUtil can throw an Exception before trying every possible data types defined within a union field.
This closes #1816 .
2017-05-17 10:53:27 -04:00
Koji Kawamura
f019d509f3
NIFI-3918: Added Choice mapping to JsonTreeRowRecordReader.
2017-05-17 09:49:11 -04:00
Koji Kawamura
33dc3e36fb
NIFI-3920: Remove unnecessary code from AvroTypeUtil
...
- Removed remaining duplicate lines of code left by NIFI-3861 refactoring.
- Added test case that writes Avro record having union field.
This closes #1813 .
2017-05-17 09:45:21 -04:00
Mark Payne
ce1bc42ac5
NIFI-3912: This closes #1809 . Fixed NPE that would result in validation failure for FreeFormTextRecordSetWriter
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-16 16:17:04 -04:00
Mark Payne
3f4b276b71
NIFI-3910: Fixed issue where CSVRecordReader throws an Exception if a field is missing instead of using a null value
...
This closes #1807 .
2017-05-16 13:16:46 -04:00