c0182294ed
NIFI-5720-RC3 prepare for next development iteration
2018-10-22 22:16:43 -04:00
98aabf2c50
NIFI-5720-RC3 prepare release nifi-1.8.0-RC3
2018-10-22 22:16:23 -04:00
a6b9364ebf
NIFI-5664 Support ArrayList in DataTypeUtils#toArray
...
NIFI-5664 Generalize to handling List
This closes #3049
Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-10-12 06:28:56 -04:00
c6572f042b
NIFI-4517: Added ExecuteSQLRecord and QueryDatabaseTableRecord processors
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2945 .
2018-10-06 10:53:11 +02:00
2e1005e884
NIFI-5640: Improved efficiency of Avro Reader and some methods of AvroTypeUtil. Also switched ServiceStateTransition to using read/write locks instead of synchronized blocks because profiling showed that significant time was spent in determining state of a Controller Service when attempting to use it. Switching to a ReadLock should provide better performance there.
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #3036
2018-09-27 15:38:47 -04:00
d42a1e8bf4
NIFI-5323-RC1 prepare for next development iteration
2018-06-19 20:02:21 -07:00
99bcd1f88d
NIFI-5323-RC1 prepare release nifi-1.7.0-RC1
2018-06-19 20:02:01 -07:00
06d1276f09
NIFI-5141: Updated regex for doubles to allow for numbers that have no decimal
...
NIFI-5141: Loosened regex for floating-point numbers to account for decimal place followed by 0 digits, such as '13.' and also added unit tests
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2679
2018-06-04 12:23:57 -04:00
d79216d6b0
NIFI-5217: Allow non-nullable fields to be added to MockRecordParser
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2720
2018-05-18 15:59:12 -04:00
4700b8653d
NIFI-5138: Bug fix to ensure that when we have a CHOICE between two or more REOCRD types that we choose the appropriate RECORD type when creating the Record in the JSON Reader.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2670 .
2018-05-09 18:38:04 +02:00
ba32879ec8
NIFI-5082: Added support for custom Oracle timestamp types to Avro conversion
...
This closes #2638
Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-04-22 19:59:48 -04:00
b29304df79
NIFI-4857: Support String<->byte[] conversion for records
...
This closes #2570 .
Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-04-09 14:53:21 -04:00
d511fe3e4b
NIFI-4995-RC3 prepare for next development iteration
2018-04-03 08:28:34 -07:00
f8466cb16d
NIFI-4995-RC3 prepare release nifi-1.6.0-RC3
2018-04-03 08:28:15 -07:00
de71a41bd0
NIFI-4935 Refactoring to support specifying schema branch or schema version when using schema by name strategy
...
This closes #2523 .
Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-03-15 16:16:12 -04:00
ecb8067883
NIFI-4428: Replaced JSON input with RecordReader
...
using per-record flowfiles
NIFI-4428: Added initial L&N, fixed dependency hierarchy
NIFI-4428: Exposed additional ZK properties
NIFI-4428: More work to reduce dependencies in Druid artifacts
NIFI-4428: Removed inaccessible attribute
NIFI-4428: Fixed typo in property description
NIFI-4428: Updates to Druid NAR L&N
NIFI-4428: Updated LICENSE to refer to ICU License for icu4j
2018-01-16 13:08:02 -05:00
41ce788812
NIFI-4751 changed to next minor release version snapshot
2018-01-12 15:15:32 -05:00
36405e888c
NIFI-4751-RC1 prepare for next development iteration
2018-01-08 23:39:49 -07:00
46d30c7e92
NIFI-4751-RC1 prepare release nifi-1.5.0-RC1
2018-01-08 23:39:32 -07:00
953e922d32
NIFI-4749: This closes #2386 . Pass the record reader's schema along to the ResultSetRecordSet so that it is able to resolve the schema for Record fields
...
Signed-off-by: joewitt <joewitt@apache.org>
2018-01-08 19:47:18 -07:00
c91d99884a
NIFI-4717: Several minor bug fixes and performance improvements around record-oriented processors
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2359
2017-12-29 10:43:21 -05:00
f772f2f093
NIFI-4671: This closes #2328 . Ensure that Avro Schemas that are created properly denote fields as being nullable iff the schemas says they are, for non-top-level fields
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-11 11:46:15 -05:00
c70a86eac0
NIFI-4575 Added ability to convert from a date to a timestamp within the record API.
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2255
2017-11-13 12:57:39 -05:00
a57911d3db
NIFI-4412-RC2 prepare for next development iteration
2017-09-28 13:45:36 -04:00
e6508ba7d3
NIFI-4412-RC2 prepare release nifi-1.4.0-RC2
2017-09-28 13:45:21 -04:00
451f9cf124
NIFI-4142: This closes #2015 . Refactored Record Reader/Writer to allow for reading/writing "raw records". Implemented ValidateRecord. Updated Record Reader to take two parameters for nextRecord: (boolean coerceTypes) and (boolean dropUnknownFields)
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-08-11 22:01:46 -07:00
40cde0466a
NIFI-4215 NiFi can now parse an Avro schema of a record that references an already defined record, including itself.
...
This closes #2052 .
2017-08-03 15:13:07 -04:00
2502b79bae
NIFI-4215 Revert Complex Avro Schema Changes
...
This reverts commit cf49a58ee7
2017-08-01 21:03:04 -07:00
cf49a58ee7
NIFI-4215 Allow Complex Avro Schema Parsing
...
NiFi can now parse an Avro schema of a record that references an already defined record, including itself.
Signed-off-by: James Wing <jvwing@gmail.com>
This closes #2034 .
2017-07-30 16:31:39 -07:00
cc741d2be6
NIFI-3997:
...
- Bumping to next minor version.
2017-06-08 15:22:51 -04:00
6ee12e9b47
NIFI-3997-RC1prepare for next development iteration
2017-06-05 11:07:43 -04:00
ddb73612bd
NIFI-3997-RC1prepare release nifi-1.3.0-RC1
2017-06-05 11:07:28 -04:00
239bbfbb9d
NIFI-3989: This closes #1869 . Avoid calling Long.parseLong, etc. in order to determine if a String is a valid number because we don't want the Exceptions that occur if it is not
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-06-02 10:09:38 -04:00
6937a6cf64
NIFI-3953: This closes #1837 . Allow multiple schemas on same kafka topic/partition for ConsumeKafkaRecord_0_10
...
Also, updated record writers to ensure that they write the schema as appropriate if not using a RecordSet. Updated ConsumeKafkaRecord to allow for multiple schemas to be on same topic and partition
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-22 14:37:53 -04:00
c49933f03d
NIFI-3948: This closes #1834 . Added flush() method to RecordWriter and call it when writing a single record to OutputStream for PublishKafkaRecord. Also removed no-longer-used class WriteAvroResult
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-19 23:05:04 -04:00
ae9953db64
NIFI-3857: This closes #1825 . Added PartitionRecord processor
...
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-19 02:08:52 -04:00
9bd0246a96
NIFI-3863: Initial implementation of Lookup Services. Implemented LookupRecord processors. This required some refactoring of RecordSetWriter interface, so refactored that interface and all implementations and references of it
2017-05-19 01:02:41 -04:00
b1901d5fe0
NIFI-3838: Initial implementation of RecordPath and UpdateRecord processor
...
NIFI-3838: Updated version from 1.2.0-SNAPSHOT to 1.3.0-SNAPSHOT; removed unneeded value from AttributeExpression.ResultType enum
NIFI-3838: Addressed PR Review feedback
NIFI-3838: Allow for schemas to be merged together for a record; refactored RecordSetWriterFactory so that there is a method to obtain the schema and then the writer is created with that schema. Added additional unit tests
NIFI-3838: Addressed problems with documentation based on PR Review
NIFI-3838: Fixed checkstyle violation
NIFI-3838: Addressed issue of comparing different types of Number objects
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1772
2017-05-12 12:36:52 -04:00
3af53419af
NIFI-3770-RC2 prepare for next development iteration
2017-05-05 20:50:28 -04:00
3a605af8e0
NIFI-3770-RC2 prepare release nifi-1.2.0-RC2
2017-05-05 20:50:14 -04:00
9b177fbcba
NIFI-3787: Addressed NPE and ensure that if validation fails due to RuntimeException, that it gets logged. Also clarified documentation for Json Reader services
...
This closes #1742 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-03 13:13:43 -04:00
07989b8460
NIFI-3739: This closes #1695 . Added ConsumeKafkaRecord_0_10 and PublishKafkaRecord_0_10 processors
2017-05-01 18:47:51 -04:00
60d88b5a64
NIFI-3724 - Initial commit of Parquet bundle with PutParquet and FetchParquet
...
- Creating nifi-records-utils to share utility code from record services
- Refactoring Parquet tests to use MockRecorderParser and MockRecordWriter
- Refactoring AbstractPutHDFSRecord to use schema access strategy
- Adding custom validate to AbstractPutHDFSRecord and adding handling of UNION types when writing Records as Avro
- Refactoring project structure to get CS API references out of nifi-commons, introducing nifi-extension-utils under nifi-nar-bundles
- Updating abstract put/fetch processors to obtain the WriteResult and update flow file attributes
This closes #1712 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-05-01 16:10:35 -04:00
Jeff Storck
Carl Gieringer
Matthew Burgess
Mark Payne
Andy LoPresto
joewitt
Bryan Bende
Mike Thomsen
Wesley-Lawrence
James Wing
Matt Gilman