Commit Graph

8873 Commits

Author SHA1 Message Date
Mark Payne 16c527271b
NIFI-11271: This closes #7795. Removed deprecated Kerberos-related properties and updated to make use of KerberosUserService; some code cleanup to bring up-to-date with Java 21 recommendations such as Stream.toList() instead of Stream.collect(Collectors.toList()) and using enhanced switch statements
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-26 10:51:59 -07:00
Joe Witt ff05a5d158
NIFI-12074 updated images to base on Java 21 and added Python3 (#7785)
* NIFI-12074 updated images to base on Java 21 and added Python3

* NIFI-12074 ensure python env included, enable python extension mount
2023-09-26 10:08:32 -04:00
Bryan Bende 04e54d5ea7
NIFI-12117 Allow configuring Jackson's max string length in JoltTransformJSON
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7788.
2023-09-26 13:01:13 +02:00
Joseph Witt 81dc36a473
NIFI-12128 updated cassandra, jgit, and netty
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7793.
2023-09-26 11:44:15 +02:00
dependabot[bot] b76074a6c9
NIFI-12129 - Bump org.xerial.snappy:snappy-java from 1.1.10.3 to 1.1.10.4
Bumps [org.xerial.snappy:snappy-java](https://github.com/xerial/snappy-java) from 1.1.10.3 to 1.1.10.4.
- [Release notes](https://github.com/xerial/snappy-java/releases)
- [Commits](https://github.com/xerial/snappy-java/compare/v1.1.10.3...v1.1.10.4)

---
updated-dependencies:
- dependency-name: org.xerial.snappy:snappy-java
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7792.
2023-09-26 11:34:04 +02:00
Matt Burgess e7da2ab5b8
NIFI-11177: Add defensive code for null values for Iceberg
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7777.
2023-09-26 11:30:08 +02:00
Matt Burgess 3f5661232e
NIFI-12024: Add CSV Writer property to CSVRecordSetWriter and a FastCSV writer implementation
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7686.
2023-09-26 11:22:52 +02:00
Peter Turcsanyi 5644fdd725
NIFI-12126: Downgrade snowflake-jdbc to 3.13.33
snowflake-ingest-sdk:2.0.3 is not compatible with snowflake-jdbc:3.14.x

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7790.
2023-09-26 11:07:14 +02:00
Pierre Villard 43cc5ad122
NIFI-12079 This closes #7750. Remove Variables / Variable Registry
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 09:39:53 -07:00
Mark Payne 025109a9d8
NIFI-12123: This closes #7786. Added additional @UseCase and @MultiProcessorUseCase annotations as well as some trivial cleanup that was flagged by IntelliJ such as making inner class static, updating some deprecated references, etc.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 07:54:21 -07:00
exceptionfactory bcc54953c4
NIFI-12120 This closes #7784. Removed Obsolete Framework Integration Tests
- Removed integration tests from org.apache.nifi.integration in nifi-framework-core

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-24 15:48:47 -07:00
Pierre Villard 2aca08910c
NIFI-12103 Replaced deprecated usage of new URL(String)
This closes #7771

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-23 10:30:42 -05:00
Mark Payne c28d040bca
NIFI-12118: refactored RemoveRecordPath member variable that was caching values, and improve performance with Pattern.matcher().find() instead of .match().
This closes #7783

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-09-23 14:02:09 +01:00
Pierre Villard 4b9eb8361c
NIFI-12113 Replaced Validate.notNull() with Objects.requireNonNull()
This closes #7779

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-22 15:18:50 -05:00
Mark Payne 140ac52e9d
NIFI-12068: This closes #7737. Added the ability to annotate components with @UseCase and @MultiProcessorUseCase annotations; updated several processors to make use of them.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-22 10:47:47 -07:00
exceptionfactory d354c88f57
NIFI-12112 This closes #7778. Removed Unmaintained Components and Modules
- nifi-cybersecurity-bundle
- nifi-html-bundle
- nifi-hl7-bundle
- nifi-metrics-reporting-bundle
- nifi-riemann-bundle
- nifi-tcp-bundle
- nifi-rules-action-handler-bundle
- nifi-rules-engine-service-api

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-22 09:46:28 -07:00
Mark Payne 713be8b539
NIFI-12101: This closes #7768. Fixed bugs that caused StatelessBasicsIT.testChangeFlowVersion to fail. There were a couple of related issues. Firstly, for Stateless Groups we were not waiting for the group to fully stop before attempting to update the flow but were waiting only for child/descendant groups to stop. This was due to misleading naming in the ProcessGroupUpdateStrategy enum. Renamed enum values to more clearly convey what they mean. Additionally, renamed the enum to more clearly convey what how it is used, since it is used not only for updating groups but also for retrieving groups. Additionally, when waiting for stateless groups to stop, we inadvertently checked the Set of affectedComponents' IDs against Process Group IDs so addressed the logic there and also ensured that we were consistent in setting the AffectedComponentEntity's ProcessGroup (i.e., its ProcessGroupNameDTO) as we were inconsistently setting it across the codebase.
Fixed issue in logic of LocalComponentLifecycle, which was waiting for all PGs to reach desired stateless run schedule, even when the group itself was not stateless

Fixed JavaScript to specify correct value for recursivity when updating process group parameter context
2023-09-22 09:00:52 -07:00
Nandor Soma Abonyi 9ae6921272
NIFI-12095 This closes #7762. Increase default Xmx to 1g
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-21 19:48:34 -07:00
exceptionfactory a832b134b1
NIFI-12109 This closes #7774. Removed SpringContextProcessor
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-21 19:41:52 -07:00
exceptionfactory 4169352a2f
NIFI-12110 This closes #7775. Upgraded Spring Framework from 5.3.29 to 5.3.30
- Upgraded Spring Boot from 2.7.15 to 2.7.16 for Registry

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-21 19:41:18 -07:00
mr1716 b6bcce4fe1
NIFI-12106 Upgraded Spring Boot from 2.7.14 to 2.7.15
This closes #7772

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-21 14:53:34 -05:00
Mike Moser 1f87c16ab8
NIFI-12019 Improved reliability of TestSynchronousFileWatcher
This closes #7770

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-21 14:42:20 -05:00
dan-s1 9b591a2fe3
NIFI-12041 Converted Groovy tests to Java in nifi-scripting-processors
This closes #7752

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-21 13:45:26 -05:00
Pierre Villard 5405a3b08b
NIFI-12102 Fixed deprecation warnings when instantiating primitive types
This closes #7769

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-21 13:41:30 -05:00
Nandor Soma Abonyi badbc1aca6
NIFI-12022 Extract verification logic from JMSConnectionFactoryProvider
This closes #7667.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-09-21 19:24:41 +02:00
exceptionfactory ebe8b9a2e7
NIFI-12033 Added EncryptContentAge and DecryptContentAge Processors
This closes #7676
Signed-off-by: Paul Grey <greyp@apache.org>
2023-09-21 13:00:16 -04:00
Pierre Villard 9c19656f5b
NIFI-12097 Upgraded Snowflake ingest SDK to 2.0.3 and JDBC to 3.14.1
This closes #7764

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-20 16:46:19 -05:00
mr1716 fbb635e4c6
NIFI-12096 Upgraded H2 DB from 2.2.222 to 2.2.224
This closes #7763

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-20 16:44:55 -05:00
Joseph Witt 4527e3fe0f
NIFI-12091 Workaround for TestListenTCPRecord to be corrected in NIFI-12098
This closes #7765

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-20 16:38:22 -05:00
exceptionfactory 11d8519914
NIFI-12086 This closes #7757. Removed unused jgit dependency from framework-core
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-20 14:28:38 -07:00
exceptionfactory 2602e16d0d
NIFI-12094 This closes #7767. Removed EncryptContent and CryptographicHashAttribute
- Removed CipherProvider interface and implementations from nifi-security-utils

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-20 13:54:44 -07:00
Joseph Witt e5894cf943
NIFI-12053 Updated Minimum Build Version to Java 21
- Configured GitHub Workflows with Azul Zulu and Amazon Corretto
- Added bootstrap.conf option for reflective access supporting Hive 3

This closes #7744

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 22:59:59 -05:00
Joe Witt 017b16254b
NIFI-11903 disable if windows (#7566) 2023-09-19 16:22:49 -04:00
Peter Turcsanyi 520840d93b
NIFI-12076 Removed ComponentLog methods with Object[] and Throwable
This closes #7759

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 13:10:19 -05:00
mr1716 e281d13499
NIFI-12085 Upgraded Spring Security from 5.8.6 to 5.8.7
This closes #7756

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 12:43:18 -05:00
Peter Turcsanyi ac80b9d900
NIFI-11595 StateProvider.replace() supports creating the initial state
- Extracted common logic from setState() and replace() into modifyState()
- Removed redundant code from createNode() because exceptions are handled on the caller side
- NodeExistsException and InterruptedException are handled in setState() and replace()
- Also used KeeperException's subclasses instead of KeeperException.code()

This closes #7324

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 10:06:38 -05:00
Peter Turcsanyi ebd0d60e49
NIFI-12075 Deprecated ComponentLog methods with Object[] and Throwable
- Updated component references to remove use of Object[] wrapping for log methods

This closes #7748

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 08:53:00 -05:00
mr1716 66524ab267
NIFI-12043 Upgraded MariaDB Java Client from 3.1.4 to 3.2.0
This closes #7747

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 08:03:19 -05:00
exceptionfactory 80264cdd12
NIFI-12081 Removed HackerOne from Security Reporting Methods
This closes #7751

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-18 16:01:29 -05:00
Pierre Villard dcf42d01a4
NIFI-11852 - CLI - connect two process groups
This closes #7527

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-09-18 11:22:02 +02:00
Joe Witt cbf5bb98f9
NIFI-12072 moved to StackWalker API elimnating usage of SecurityManager (#7742) 2023-09-16 17:05:22 -04:00
Pierre Villard cb03d6de74
NIFI-11857 - CLI - recursively change version of Processors
This closes #7528

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-16 10:03:05 -05:00
Joseph Witt ad753318e7
NIFI-12073 removed toolkit tests which rely on system exit calls and captures not allowed any longer by defunct security manager support in Java 21
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7743.
2023-09-16 14:08:56 +02:00
Joe Witt 019e16c728
NIFI-12069 removed nifi grpc bundle and build related config. Cleaned up brittle test check for command line text which varies. (#7739) 2023-09-15 18:15:02 -04:00
Joseph Witt c042a48c86
NIFI-12070 Removed nifi-easyrules-bundle
This closes #7738

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 16:41:06 -05:00
Joseph Witt bd2276260e
NIFI-12051 Upgraded Groovy from 3.0.19 to 4.0.15
- Adjusted Groovy Maven coordinates to org.apache.groovy
- Adjusted build configuration and tests for Groovy 4

This closes #7692

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 13:38:24 -05:00
Joseph Witt 71bdbc080b
NIFI-12066 Upgraded framework and cloud provider dependencies
- Upgraded SLF4J from 2.0.7 to 2.0.9
- Upgraded Logback from 1.3.8 to 1.3.11
- Upgraded Testcontainers from 1.18.3 to 1.19.0
- Upgraded Fabric8 Kubernetes from 6.5.1 to 6.8.1
- Upgraded AspectJ from 1.9.19 to 1.9.20.1
- Upgraded Caffeine from 3.1.6 to 3.1.8
- Upgraded AWS SDK from 2.20.103 to 2.20.148
- Upgraded Guava from 32.0.1 to 32.1.2
- Upgraded Nimbus JOSE JWT from 9.31 to 9.33
- Upgraded Apache Tika from 2.8.0 to 2.9.0
- Upgraded gRPC from 1.57.2 to 1.58.0
- Upgraded Google Libraries from 26.17.0 to 26.22.0
- Upgraded Azure SDK from 1.2.13 to 1.2.16

This closes #7733

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-15 13:05:31 -05:00
exceptionfactory 00dc79c633
NIFI-12045 Upgraded Jetty from 10.0.15 to 10.0.16
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7730.
2023-09-15 12:04:54 +02:00
Chris Sampson 94bb8aec97
NIFI-12063 Clarified Elasticsearch Query Documentation
Clarify paginated Elasticsearch with SCROLL does not use query parameters from dynamic properties

This closes #7695

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-14 20:01:50 -05:00
Joseph Witt 71dd5576db
NIFI-12065 Removed nifi-spark-receiver module
This closes #7732

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-14 19:42:51 -05:00