Commit Graph

172 Commits

Author SHA1 Message Date
dan-s1 2f048ca70a
NIFI-13988 Adjusted Record number conversion to treat empty String as null (#9511)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-12 13:23:08 -06:00
exceptionfactory 6bc0e384f4
NIFI-13978 Improved Performance of Record Date Time Parsing
- Replaced DateTimeFormatter.parseBest() with custom TemporalQuery that checks for a ZoneId

This closes #9497.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-11-06 20:32:59 +01:00
exceptionfactory 4adc2be12b
NIFI-13915 Updated version to 2.1.0-SNAPSHOT 2024-11-01 22:56:08 -05:00
exceptionfactory 2f13b609bd
NIFI-13915 Updated version to 2.0.0 2024-10-29 20:25:32 -05:00
Pierre Villard c68f6910ba
NIFI-13843 Default to Drop Unknown Fields in Record Readers (#9347)
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-29 14:18:47 -05:00
dan-s1 92f571940e
NIFI-13880 Replaced if statements with enhanched switch in Object FieldConverters (#9399)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-16 18:28:52 -05:00
exceptionfactory cb2117f8e6 NIFI-13579 Improved Timestamp Zone Offset Formatting and Parsing
- Improved Timestamp to String formatting to support patterns with zone offsets
- Improved String to Timestamp parsing to support adjusted hours and minutes when zone offset is included
2024-10-16 18:37:30 +00:00
dan-s1 3b3b431732
NIFI-13781 Updated DataTypeUtils with syntax optimizations from recent Java versions (#9302)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-24 16:27:40 -05:00
Mark Payne a039bc2b76 NIFI-13380: When determining if Record Type A is 'wider' than Record Type B, and both have a RECORD with the same name but different schemas, instead of determining that A is not wider than B, perform a recursive comparison to check if the RECORD within A's schema is wider than the RECORD within B's schema.
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8948
2024-06-15 14:40:24 -04:00
dan-s1 7deac6afac
NIFI-13266 Removed String concatenation in logging messages (#8940)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-11 23:26:58 -04:00
Pierre Villard ee179f4acf
NIFI-13238 Added Checkstyle rules for whitespace
This closes #8832

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-15 06:41:19 -05:00
Chris Sampson 2d112871db
NIFI-8134 allow unescapeJson Record Path function to recursively convert Maps to Records (#7745)
* NIFI-8134 recursively convert Java Objects to NiFi Records
2024-05-14 17:11:28 -04:00
Joseph Witt 42a4385c82
NIFI-12998 Restructured framework and extension modules
Simplified dependency management into Bill of Material dependencies as parents that align to classloader structures.

- Moved nifi-framework-bundle to root level
- Moved nifi-nar-bundle modules to root nifi-extension-bundles
- Added nifi-extension-bom for internal and external extensions
- Added nifi-framework-nar-bom and nifi-server-nar-bom for managing framework dependencies
- Renamed nifi-jetty-bundle to nifi-jetty-nar

This closes #8677

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-26 12:12:48 -05:00
knguyen1 b6d044853c
NIFI-12885 Added Record Methods for Local and Offset Dates (#8502)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-24 23:23:54 -05:00
Mark Payne afed8c6f53
NIFI-12934 Clear Serialized Form of Records on Field Changes
Any time a Record's field is removed or renamed, ensure that we clear the Serialized Form so that a stale cached value cannot be written

This closes #8576

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-27 17:13:56 -05:00
Mark Payne 8ad3c731da
NIFI-12797 Refactored Record.incorporateInactiveFields
Refactored Record.incorporateInactiveFields to handle when an updated field and an inactive field have the same name (which can happen if incorporateInactiveFields is called multiple times). Also refactored the setValue(String, Object) method to call setValue(RecordField, Object) because the logic had diverged. Also exposed the text of Expression Language, which led to the discovery of this bug.

This closes #8413

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-08 15:25:49 -06:00
ravisingh 8346bd7d0f NIFI-12828: Added Mapping for BIT type to return INT and handled boolean case for postgres
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8445
2024-02-29 14:06:57 -05:00
Mark Bathori c29a744644
NIFI-12847: Add Enum data type handling to Iceberg record converter
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8453.
2024-02-28 14:33:39 +01:00
Mark Payne 5f534dcc42
NIFI-12710 Support microsecond precision for Timestamp Record fields
- PutDatabaseRecordIT supports operating systems with either nanosecond or microsecond precision

This closes #8332

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-09 08:19:51 -06:00
Mark Payne e16286ef40
NIFI-12707 Allow LookupRecord to operate on multiple child-records
- In order to accommodate this, also needed to improve DataTypeUtils so that it knows that Record A is wider than Record B if Record A contains all fields of Record B and more.

- Removed unit tests and resources that are overly complex and no longer applicable
- Fixed issue in unit test based on different line endings between operating systems

This closes #8331

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-02 16:24:43 -06:00
David Handermann 250fe90b34
NIFI-9458 Replaced SimpleDateFormat with DateTimeFormatter (#8248)
- Added FieldConverterRegistry and Standard implementation
- Moved DateTypeUtils methods to FieldConverter implementations
2024-01-16 16:39:40 -05:00
Mark Payne ba599d29c2
NIFI-12480 Updated MapRecord's toString() method to use the SerializedForm of the record when available and fixed bugs around ensuring that the serialized form is properly set
This closes #8132

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-18 08:25:09 -06:00
Chris Sampson aac71c5aa1 NIFI-8135 allow CHOICE data types in conversion of Records to Java Maps
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7746
2023-10-19 13:13:58 -04:00
Mark Payne 3ae0eedee6
NIFI-12124: This closes #7791. Added a new RenameRecordField processor. In testing, also noticed that the Descendant Wildcard operator (//*) and Descendant Field Path Operator (//name, for instance) did not properly account for array of records or map elements, so addressed those concerns.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-13 14:02:55 -07:00
Matt Burgess e7da2ab5b8
NIFI-11177: Add defensive code for null values for Iceberg
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7777.
2023-09-26 11:30:08 +02:00
Pierre Villard 5405a3b08b
NIFI-12102 Fixed deprecation warnings when instantiating primitive types
This closes #7769

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-21 13:41:30 -05:00
Tamas Neumer 80e71068be NIFI-11860 fixed bug in ResultSetRecordSet affecting decimalScale when resultSetScale was zero.
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7545
2023-08-02 12:22:55 -04:00
Chris Sampson 3f5ed23504
NIFI-9206 Added RemoveRecordField Processor
This closes #6816

Co-authored-by: Peter Gyori <peter.gyori.dev@gmail.com>
Co-authored-by: Chris Sampson <chris.sampson82@gmail.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 09:50:41 -05:00
Matt Burgess f3e8651522 NIFI-11647: Support UUID type in DataTypeUtils.getSQLTypeValue
This closes #7355

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-08 11:13:07 -04:00
krisztina-zsihovszki a36040fded
NIFI-11367 Database DATE value displayed incorrectly in record output if timezone is GMT-X
This closes #7103.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-04-02 22:47:42 +02:00
Joe Witt 43eab4c81d
NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
dan-s1 53371844a4
NIFI-11035 Replaced remaining JUnit 4 assertions in nifi-commons with JUnit 5
- Replaced Groovy asserts with JUnit 5 assertions and Groovy shouldFail method Junit 5 with assertThrow method

This closes #6880

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-01-24 15:30:53 -06:00
Lehel Boér ed6ba53724 NIFI-10832: Create PutSalesforceRecord processor
This closes #6670.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-12-13 18:59:41 +01:00
Matt Burgess b744fac479
NIFI-10956: Fix inference issues with mixed arrays (#6763) 2022-12-08 09:28:19 -05:00
Joe Witt 75e7c9e47c
NIFI-10854-RC1 prepare for next development iteration 2022-11-22 19:22:47 -07:00
Joe Witt ec87bf93ad
NIFI-10854-RC1 prepare release nifi-1.19.0-RC1 2022-11-22 19:22:45 -07:00
Matthew Burgess a76abef270 NIFI-10635: Fix handling of enums in PutDatabaseRecord
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6518.
2022-10-17 11:29:53 -04:00
Mark Bathori e87bced147
NIFI-10442: Create PutIceberg processor
This closes #6368.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-10-11 21:51:18 +02:00
Joe Witt c9ebdd2025
NIFI-10521-RC4 prepare for next development iteration 2022-10-03 10:59:36 -07:00
Joe Witt 109e54cd58
NIFI-10521-RC4 prepare release nifi-1.18.0-RC4 2022-10-03 10:59:34 -07:00
Csaba Bejan 35fb66f50f
NIFI-10403 Add processor supporting the new BigQuery Write API
Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #6344
2022-09-19 14:32:11 +02:00
Mark Payne ec09c56e93
NIFI-10508: When inferring data types for values, allow float and double to encapsulate byte/short/int/long values
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6421
2022-09-16 17:58:19 -04:00
Joe Witt 8c66bf948c
NIFI-10272-RC2 prepare for next development iteration 2022-07-27 13:24:09 -07:00
Joe Witt 8d256784d8
NIFI-10272-RC2 prepare release nifi-1.17.0-RC2 2022-07-27 13:24:06 -07:00
Mike Thomsen a3e8048b2d
NIFI-9981 Added support for Avro UUID types
This closes #6013

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-23 08:35:31 -05:00
exceptionfactory 5febd47c72
NIFI-10109 Changed HashMap to LinkedHashMap in JsonTreeRowRecordReader (#6112)
- Added unit test to confirm preservation of field ordering
2022-06-21 17:00:34 -04:00
Matthew Burgess 639ab328c9
NIFI-10057: Add support for SQL Server's DATETIMEOFFSET type to ExecuteSQL processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6080.
2022-06-03 10:33:41 +02:00
Joe Witt 0419dc2939
NIFI-9780-RC3 prepare for next development iteration 2022-03-21 11:58:27 -07:00
Joe Witt b019a9191f
NIFI-9780-RC3 prepare release nifi-1.16.0-RC3 2022-03-21 11:58:09 -07:00
在红尘中成仙 8d5de6b292
NIFI-9818 fix flaky tests
This closes #5883

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-21 08:23:40 -04:00