Chris Sampson
3f5ed23504
NIFI-9206 Added RemoveRecordField Processor
...
This closes #6816
Co-authored-by: Peter Gyori <peter.gyori.dev@gmail.com>
Co-authored-by: Chris Sampson <chris.sampson82@gmail.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 09:50:41 -05:00
exceptionfactory
bdd7ef3671
NIFI-11744 Added Required Permission to Reference Remote Resources
...
- Applied Required Permission to components supporting URL Resource References
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7426
2023-06-23 18:07:16 -04:00
dan-s1
e4d1dab8f7
NIFI-11167 Added ExcelReader to nifi-poi-nar
...
- Moved shared schema inference components to nifi-record-serialization-services-shared
This closes #7194
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 15:50:08 -05:00
Nandor Soma Abonyi
10a2815527
NIFI-11659 Removed unnecessary Jackson 1 dependencies
...
This closes #7354
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-07 15:04:43 -05:00
Mark Payne
ac810671c5
NIFI-11621: Handle the case of CHOICE fields when inferring the type of ARRAY elements. E.g., support ARRAY<CHOICE<STRING, NULL>>
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #7322
2023-05-31 17:07:39 -04:00
exceptionfactory
7906e3424c
NIFI-11489 Removed Deprecated Record Writer and Schema Registry methods
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #7199 .
2023-04-27 20:18:15 +03:00
Mark Payne
7f7cccfdc2
NIFI-11241 Initial implementation of Python-based Processor API with Py4J
...
- Updated GitHub workflow so that system tests include Python 3.9
- Updated GitHub actions to build necessary modules for system tests
This closes #7003
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-14 15:03:34 -05:00
Pierre Villard
b0997f843d
NIFI-11416 Upgraded Caffeine from 2.8.1 to 3.1.6
...
This closes #7147
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:45:12 -05:00
Pierre Villard
4a0b38f4dd
NIFI-11405 Upgraded multiple drivers and test dependencies
...
This closes #7134
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-07 15:54:51 -05:00
Joe Witt
58517e4dd0
NIFI-11329 Updated NAR Plugin to 1.5.0 and Commons Compress to 1.23.0
...
This closes #7077
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:28:40 -05:00
Joe Witt
43eab4c81d
NIFI-11103 prepping for 2.0.0 line
2023-02-09 15:32:53 -07:00
exceptionfactory
6877e84931
NIFI-11135 Upgraded Commons CSV from 1.9.0 to 1.10.0
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6921 .
2023-02-03 12:26:47 +01:00
dan-s1
e86786433a
NIFI-11108 Further changes to upgrade from JUnit 4 to JUnit 5.
...
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
This closes #6919
2023-02-02 12:27:42 +00:00
Peter Turcsanyi
cb77a96059
NIFI-11088: This closes #6878 . updated copyright year to 2023 in NOTICE files
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 09:42:44 -07:00
Matthew Burgess
a9baa21f87
NIFI-10996: Write out CSV header even if there are no records
...
This closes #6818
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-01-11 10:55:31 -05:00
Mark Payne
78be613a0f
NIFI-10888: When inferring a schema using a Record Reader, buffer up to 1 MB of FlowFile content for the schema inference so that when we read the contents to obtain records we can use the buffered data. This helps in cases of small FlowFiles by not having to seek back to the beginning of the FlowFile every time.
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #6725
2022-12-14 12:09:32 -05:00
Lehel Boér
ed6ba53724
NIFI-10832: Create PutSalesforceRecord processor
...
This closes #6670 .
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-12-13 18:59:41 +01:00
exceptionfactory
b0ab364f61
NIFI-10967 Corrected TestWriteJsonResult mixed arrays
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #6773
2022-12-09 01:01:58 -05:00
Matt Burgess
b744fac479
NIFI-10956: Fix inference issues with mixed arrays ( #6763 )
2022-12-08 09:28:19 -05:00
sopan98
ab8e9aa8df
NIFI-10890 Replaced HashMap with LinkedHashMap in JsonRowRecordReader
...
- Updated unit test based on deterministic behavior of LinkedHashMap
This closes #6726
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-29 14:26:58 -06:00
Joe Witt
75e7c9e47c
NIFI-10854-RC1 prepare for next development iteration
2022-11-22 19:22:47 -07:00
Joe Witt
ec87bf93ad
NIFI-10854-RC1 prepare release nifi-1.19.0-RC1
2022-11-22 19:22:45 -07:00
sopan98
ff14ea2aab
NIFI-10862 This closes #6709 . Fix Flaky tests in TestXMLReader
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-22 15:25:02 -07:00
Mark Payne
381e0f84e1
NIFI-10767: When an empty line is encountered with Syslog Readers, just skip over the empty line instead of throwing an Exception
...
This closes #6623
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-04 16:20:22 -05:00
mr1716
60d7f437a6
NIFI-10720 Update bval-jsr to 2.0.6
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6600 .
2022-10-29 10:29:43 +02:00
mr1716
f23318a361
NIFI-10670 Update commons-csv from 1.8 to 1.9.0
...
This closes #6554
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-21 15:18:00 -05:00
exceptionfactory
0dc02e26d2
NIFI-10648 Upgraded Apache Commons Text to 1.10.0
...
- Added org.apache.commons.text.version property in root Maven configuration
- Removed direct version references in favor of managed dependency version
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6531 .
2022-10-14 14:07:23 -04:00
Joe Witt
c9ebdd2025
NIFI-10521-RC4 prepare for next development iteration
2022-10-03 10:59:36 -07:00
Joe Witt
109e54cd58
NIFI-10521-RC4 prepare release nifi-1.18.0-RC4
2022-10-03 10:59:34 -07:00
Lehel Boér
63aac1a31d
NIFI-10513: Added capture non-record fields to JsonTreeRowRecordReader, added pagination to QuerySalesforceObject
...
This closes #6444 .
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-27 19:53:10 +02:00
Bryan Bende
27e3ee1915
NIFI-10528 Create nifi-json-record-utils and updated Salesforce NAR dependencies to use it
...
This closes #6435 .
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-23 17:11:13 +02:00
Mark Payne
ec09c56e93
NIFI-10508: When inferring data types for values, allow float and double to encapsulate byte/short/int/long values
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #6421
2022-09-16 17:58:19 -04:00
Matthew Hawkins
64acd8b1c5
NIFI-2827 Adding zstd-jni to the necessary pom.xml. It's already in the LICENSE.
...
NIFI-2827 Update CompressContent.java to use zstd compression format
NIFI-2827 Update test cases for CompressContent.java to include zstd format
NIFI-2827 Update JsonRecordSetWriter.java to enable zstd compression format
This closes #6294
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-04 15:02:41 -04:00
mr1716
4a2c0beb7f
NIFI-10388 Upgraded xmlunit-matchers from 2.6.3 to 2.9.0
...
This closes #6326
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-23 15:21:45 -05:00
Timea Barna
26829e5c35
NIFI-10256 CSVRecordReader using RFC 4180 CSV format trimming starting and ending double quotes
...
NIFI-10256 Addresseng review comments, adding extra description, removing unneccessary static import, creating extra constructor
NIFI-10256 Refactoring CSVRecordReader
NIFI-10256 Addresseng review comments, adding validator
Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #6234
2022-08-08 17:13:48 +02:00
exceptionfactory
fdf3925f81
NIFI-3964 Updated Grok Patterns to support TEXT and URL Resources
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6260 .
2022-08-08 14:48:21 +02:00
Joe Witt
8c66bf948c
NIFI-10272-RC2 prepare for next development iteration
2022-07-27 13:24:09 -07:00
Joe Witt
8d256784d8
NIFI-10272-RC2 prepare release nifi-1.17.0-RC2
2022-07-27 13:24:06 -07:00
Mike Thomsen
a3e8048b2d
NIFI-9981 Added support for Avro UUID types
...
This closes #6013
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-23 08:35:31 -05:00
exceptionfactory
5febd47c72
NIFI-10109 Changed HashMap to LinkedHashMap in JsonTreeRowRecordReader ( #6112 )
...
- Added unit test to confirm preservation of field ordering
2022-06-21 17:00:34 -04:00
Matt Burgess
b60b9b8e29
NIFI-10141: Fix WriteJsonResult logging to show writer's schema ( #6142 )
...
* NIFI-10141: Fix WriteJsonResult logging to show writer's schema
2022-06-21 16:53:30 -04:00
Lehel
d925989811
NIFI-9963: Configure JsonTreeReader whether the schema applies to the Root Node or the Nested Node
...
This closes #6018 .
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-06-09 19:42:16 +02:00
exceptionfactory
0c8305950c
NIFI-9987 Standardize Commons IO on version 2.11.0
...
- Removed version declarations from multiple modules
- Adjusted PutDynamoDB to remove catch for IOException not thrown in Commons IO 2.11.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6015 .
2022-05-09 12:06:37 +02:00
Mike Thomsen
7271e8cea7
NIFI-7234 Standardized on Avro 1.11.0
...
NIFI-7234 Replaced Jackson 1.X references with Jackson 2.X references in various classes.
NIFI-7234 Added jackson-annotations to nifi-hdfs-processors.
NIFI-7234 Various updates to bring our test cases into better alignment with the Avro specification as of 1.11.
Fixed a checkstyle issue.
NIFI-7234 Made changes requested in a review.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #5900
2022-04-29 17:48:59 -04:00
Peter Gyori
6ee3d32ca3
NIFI-9918: 'Parse XML Attributes' property added to XMLReader
...
NIFI-9918: Fixed review findings
NIFI-9918: Example added to XMLReader's additionalDetails.html on the new property. Minor documentation fixes.
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #5964 .
2022-04-26 22:07:59 -04:00
exceptionfactory
4f423a59ba
NIFI-9952 Upgraded Jackson BOM to 2.13.2.20220328
...
- Removed unnecessary references to jackson.version property
- Removed unnecessary dependency management references to Jackson libraries
This closes #5992
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-04-23 08:23:39 -04:00
Lehel
7f95de27fb
NIFI-9862 Updated JsonTreeReader to read Records from Nested Field
...
This closes #5937
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-04-14 15:50:02 -05:00
exceptionfactory
15f7590f7a
NIFI-9901 Added nifi-xml-processing to nifi-commons
...
- Refactored XML parsing to use providers from nifi-xml-processing
- Configured spotbugs-maven-plugin with findsecbugs-plugin in nifi-xml-processing
- Disabled Validate DTD in default configuration for EvaluateXPath and EvaluateXQuery
- Replaced configuration of DocumentBuilder and streaming XML Readers with shared components
- Removed XML utilities from nifi-security-utils
- Moved Commons Configuration classes to nifi-lookup-services
This closes #5962
Signed-off-by: Paul Grey <greyp@apache.org>
2022-04-13 19:56:57 -04:00
Peter Gyori
68c6722f76
NIFI-9832: Fix disappearing XML element content when the element has attribute ( #5896 )
...
- NIFI-9832: Additional test cases for XMLReader
2022-04-12 11:41:50 -04:00
Paul Grey
2c83149c6d
NIFI-9884 - JacksonCSVRecordReader ignores specified encoding
...
NIFI-9884 - JacksonCSVRecordReader ignores specified encoding; test case for ISO-8859-1
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #5941
2022-04-08 13:20:12 -04:00