247 Commits

Author SHA1 Message Date
exceptionfactory
7906e3424c
NIFI-11489 Removed Deprecated Record Writer and Schema Registry methods
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7199.
2023-04-27 20:18:15 +03:00
Mark Payne
7f7cccfdc2
NIFI-11241 Initial implementation of Python-based Processor API with Py4J
- Updated GitHub workflow so that system tests include Python 3.9
- Updated GitHub actions to build necessary modules for system tests

This closes #7003

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-14 15:03:34 -05:00
Pierre Villard
b0997f843d
NIFI-11416 Upgraded Caffeine from 2.8.1 to 3.1.6
This closes #7147

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-10 08:45:12 -05:00
Pierre Villard
4a0b38f4dd
NIFI-11405 Upgraded multiple drivers and test dependencies
This closes #7134

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-04-07 15:54:51 -05:00
Joe Witt
58517e4dd0
NIFI-11329 Updated NAR Plugin to 1.5.0 and Commons Compress to 1.23.0
This closes #7077

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-03-23 12:28:40 -05:00
Joe Witt
43eab4c81d
NIFI-11103 prepping for 2.0.0 line 2023-02-09 15:32:53 -07:00
exceptionfactory
6877e84931
NIFI-11135 Upgraded Commons CSV from 1.9.0 to 1.10.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6921.
2023-02-03 12:26:47 +01:00
dan-s1
e86786433a
NIFI-11108 Further changes to upgrade from JUnit 4 to JUnit 5.
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #6919
2023-02-02 12:27:42 +00:00
Peter Turcsanyi
cb77a96059
NIFI-11088: This closes #6878. updated copyright year to 2023 in NOTICE files
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-01-23 09:42:44 -07:00
Matthew Burgess
a9baa21f87 NIFI-10996: Write out CSV header even if there are no records
This closes #6818

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-01-11 10:55:31 -05:00
Mark Payne
78be613a0f
NIFI-10888: When inferring a schema using a Record Reader, buffer up to 1 MB of FlowFile content for the schema inference so that when we read the contents to obtain records we can use the buffered data. This helps in cases of small FlowFiles by not having to seek back to the beginning of the FlowFile every time.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6725
2022-12-14 12:09:32 -05:00
Lehel Boér
ed6ba53724 NIFI-10832: Create PutSalesforceRecord processor
This closes #6670.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-12-13 18:59:41 +01:00
exceptionfactory
b0ab364f61
NIFI-10967 Corrected TestWriteJsonResult mixed arrays
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6773
2022-12-09 01:01:58 -05:00
Matt Burgess
b744fac479
NIFI-10956: Fix inference issues with mixed arrays (#6763) 2022-12-08 09:28:19 -05:00
sopan98
ab8e9aa8df
NIFI-10890 Replaced HashMap with LinkedHashMap in JsonRowRecordReader
- Updated unit test based on deterministic behavior of LinkedHashMap

This closes #6726

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-29 14:26:58 -06:00
Joe Witt
75e7c9e47c
NIFI-10854-RC1 prepare for next development iteration 2022-11-22 19:22:47 -07:00
Joe Witt
ec87bf93ad
NIFI-10854-RC1 prepare release nifi-1.19.0-RC1 2022-11-22 19:22:45 -07:00
sopan98
ff14ea2aab
NIFI-10862 This closes #6709. Fix Flaky tests in TestXMLReader
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-11-22 15:25:02 -07:00
Mark Payne
381e0f84e1
NIFI-10767: When an empty line is encountered with Syslog Readers, just skip over the empty line instead of throwing an Exception
This closes #6623

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-04 16:20:22 -05:00
mr1716
60d7f437a6
NIFI-10720 Update bval-jsr to 2.0.6
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6600.
2022-10-29 10:29:43 +02:00
mr1716
f23318a361
NIFI-10670 Update commons-csv from 1.8 to 1.9.0
This closes #6554

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-10-21 15:18:00 -05:00
exceptionfactory
0dc02e26d2 NIFI-10648 Upgraded Apache Commons Text to 1.10.0
- Added org.apache.commons.text.version property in root Maven configuration
- Removed direct version references in favor of managed dependency version

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #6531.
2022-10-14 14:07:23 -04:00
Joe Witt
c9ebdd2025
NIFI-10521-RC4 prepare for next development iteration 2022-10-03 10:59:36 -07:00
Joe Witt
109e54cd58
NIFI-10521-RC4 prepare release nifi-1.18.0-RC4 2022-10-03 10:59:34 -07:00
Lehel Boér
63aac1a31d NIFI-10513: Added capture non-record fields to JsonTreeRowRecordReader, added pagination to QuerySalesforceObject
This closes #6444.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-27 19:53:10 +02:00
Bryan Bende
27e3ee1915 NIFI-10528 Create nifi-json-record-utils and updated Salesforce NAR dependencies to use it
This closes #6435.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-23 17:11:13 +02:00
Mark Payne
ec09c56e93
NIFI-10508: When inferring data types for values, allow float and double to encapsulate byte/short/int/long values
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6421
2022-09-16 17:58:19 -04:00
Matthew Hawkins
64acd8b1c5
NIFI-2827 Adding zstd-jni to the necessary pom.xml. It's already in the LICENSE.
NIFI-2827 Update CompressContent.java to use zstd compression format
NIFI-2827 Update test cases for CompressContent.java to include zstd format
NIFI-2827 Update JsonRecordSetWriter.java to enable zstd compression format

This closes #6294

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-04 15:02:41 -04:00
mr1716
4a2c0beb7f
NIFI-10388 Upgraded xmlunit-matchers from 2.6.3 to 2.9.0
This closes #6326

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-23 15:21:45 -05:00
Timea Barna
26829e5c35 NIFI-10256 CSVRecordReader using RFC 4180 CSV format trimming starting and ending double quotes
NIFI-10256 Addresseng review comments, adding extra description, removing unneccessary static import, creating extra constructor

NIFI-10256 Refactoring CSVRecordReader

NIFI-10256 Addresseng review comments, adding validator

Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #6234
2022-08-08 17:13:48 +02:00
exceptionfactory
fdf3925f81
NIFI-3964 Updated Grok Patterns to support TEXT and URL Resources
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6260.
2022-08-08 14:48:21 +02:00
Joe Witt
8c66bf948c
NIFI-10272-RC2 prepare for next development iteration 2022-07-27 13:24:09 -07:00
Joe Witt
8d256784d8
NIFI-10272-RC2 prepare release nifi-1.17.0-RC2 2022-07-27 13:24:06 -07:00
Mike Thomsen
a3e8048b2d
NIFI-9981 Added support for Avro UUID types
This closes #6013

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-23 08:35:31 -05:00
exceptionfactory
5febd47c72
NIFI-10109 Changed HashMap to LinkedHashMap in JsonTreeRowRecordReader (#6112)
- Added unit test to confirm preservation of field ordering
2022-06-21 17:00:34 -04:00
Matt Burgess
b60b9b8e29
NIFI-10141: Fix WriteJsonResult logging to show writer's schema (#6142)
* NIFI-10141: Fix WriteJsonResult logging to show writer's schema
2022-06-21 16:53:30 -04:00
Lehel
d925989811 NIFI-9963: Configure JsonTreeReader whether the schema applies to the Root Node or the Nested Node
This closes #6018.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-06-09 19:42:16 +02:00
exceptionfactory
0c8305950c
NIFI-9987 Standardize Commons IO on version 2.11.0
- Removed version declarations from multiple modules
- Adjusted PutDynamoDB to remove catch for IOException not thrown in Commons IO 2.11.0

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6015.
2022-05-09 12:06:37 +02:00
Mike Thomsen
7271e8cea7
NIFI-7234 Standardized on Avro 1.11.0
NIFI-7234 Replaced Jackson 1.X references with Jackson 2.X references in various classes.
NIFI-7234 Added jackson-annotations to nifi-hdfs-processors.
NIFI-7234 Various updates to bring our test cases into better alignment with the Avro specification as of 1.11.
Fixed a checkstyle issue.

NIFI-7234 Made changes requested in a review.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5900
2022-04-29 17:48:59 -04:00
Peter Gyori
6ee3d32ca3 NIFI-9918: 'Parse XML Attributes' property added to XMLReader
NIFI-9918: Fixed review findings
NIFI-9918: Example added to XMLReader's additionalDetails.html on the new property. Minor documentation fixes.

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5964.
2022-04-26 22:07:59 -04:00
exceptionfactory
4f423a59ba
NIFI-9952 Upgraded Jackson BOM to 2.13.2.20220328
- Removed unnecessary references to jackson.version property
- Removed unnecessary dependency management references to Jackson libraries

This closes #5992

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-04-23 08:23:39 -04:00
Lehel
7f95de27fb
NIFI-9862 Updated JsonTreeReader to read Records from Nested Field
This closes #5937

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-04-14 15:50:02 -05:00
exceptionfactory
15f7590f7a
NIFI-9901 Added nifi-xml-processing to nifi-commons
- Refactored XML parsing to use providers from nifi-xml-processing
- Configured spotbugs-maven-plugin with findsecbugs-plugin in nifi-xml-processing
- Disabled Validate DTD in default configuration for EvaluateXPath and EvaluateXQuery
- Replaced configuration of DocumentBuilder and streaming XML Readers with shared components
- Removed XML utilities from nifi-security-utils
- Moved Commons Configuration classes to nifi-lookup-services

This closes #5962
Signed-off-by: Paul Grey <greyp@apache.org>
2022-04-13 19:56:57 -04:00
Peter Gyori
68c6722f76
NIFI-9832: Fix disappearing XML element content when the element has attribute (#5896)
- NIFI-9832: Additional test cases for XMLReader
2022-04-12 11:41:50 -04:00
Paul Grey
2c83149c6d
NIFI-9884 - JacksonCSVRecordReader ignores specified encoding
NIFI-9884 - JacksonCSVRecordReader ignores specified encoding; test case for ISO-8859-1

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5941
2022-04-08 13:20:12 -04:00
Mike Thomsen
fdca3dd6b0
NIFI-9881 Refactored the JSON services to use Jackson 2
This closes #5934

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-04-06 15:03:42 -05:00
Peter Gyori
3ef2ad9943 NIFI-9831: XML schema inference fix for XML elements with attributes
This closes #5895.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-04-05 15:20:58 +02:00
Joe Witt
873d25585c
NIFI-9780 Merge branch 'NIFI-9780-RC3' 2022-04-04 08:35:23 -07:00
exceptionfactory
e6e4109cf9
NIFI-9850 Add support for multiple expressions to GrokReader (#5918)
* NIFI-9850 Added support for multiple expressions to GrokReader

- Updated Grok Expression property to support Resources

* NIFI-9850 Updated documentation for Fields from Grok Expression strategy

This closes #5918
Signed-off-by: Otto Fowler <otto@apache.org>
2022-04-02 13:30:55 -04:00
Joe Witt
0419dc2939
NIFI-9780-RC3 prepare for next development iteration 2022-03-21 11:58:27 -07:00