6724 Commits

Author SHA1 Message Date
exceptionfactory
6394912cce
NIFI-12115 This closes #7830. Added ListenOTLP to collect OpenTelemetry
- Added ListenOTLP Processor supporting OpenTelemetry OTLP 1.0.0 Specification with gRPC and HTTP
- Updated nifi-event-transport to support configurable SSLParameters for configurable Cipher Suites

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-03 19:21:15 -07:00
Matt Burgess
3f7b1de6b8
NIFI-11739 - Add ability to ignore missing fields in PutIceberg
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7421.
2023-10-03 14:41:12 +03:00
Tamas Palfy
9c425d273c
NIFI-12131 Fixed potential NPE related to FlowAnalyzer
Revamped RuleViolationsManager and FlowAnalyzer handling to make sure no issue occurs when these are not set. Fix ResourceNotFoundException: When determining the subject permissions for a rule violation the type of the subject is now known, so we try to lookup all possible types. Non-matching tpyes throw a ResourceNotFoundException exception though. Going to ignore those.

This closes #7809

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-02 15:35:05 -05:00
exceptionfactory
19b4be40aa
NIFI-12157 This closes #7826. Removed nifi-logging-utils and NiFiLog
- Replaced NiFiLog references with direct references to SLF4J LoggerFactory

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-02 08:17:51 -07:00
Joe Gresock
ff8f1ff686
NIFI-8531: This closes #7529. Upgrading Kinesis processors to AWS SDK 2.x
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-01 16:26:51 -07:00
levilentz
9228036e1d
NIFI-7355: This closes #7677. TinkerpopClientService
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-01 11:17:58 -07:00
annanys23
9b9dd4bae3
NIFI-6721: This closes #7789. jms_expiration attribute problem fix
Originally authored in part by sjyang18 <ilsong02@hotmail.com>

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-01 11:11:56 -07:00
Mark Payne
342fb0d876
NIFI-12143: This closes #7820. Introduced a new nifi-calcite-utils module and refactored the nifi-sql-reporting-tasks to mamke use of it. This uses the newer calcite api instead of deprecated classes/methods
- Refactored QueryRecord / JoinEnrichment to use new nifi-calcite-utils

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-30 13:28:03 -07:00
exceptionfactory
1561eb2506 NIFI-12155 Upgraded Apache Commons IO from 2.13.0 to 2.14.0
- Upgraded Apache POI from 5.2.3 to 5.2.4

This closes #7825

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-09-30 16:25:23 -04:00
Emilio Setiadarma
a8c1bb1d9c
NIFI-10425 Corrected auto-reloading KeyStore files with symlinks
- Changed StoreScanner scanner instantiation to not report real paths

This closes #7821

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-30 12:28:54 -05:00
Peter Turcsanyi
8c5d85a28d
NIFI-12151 Fixed StandardPrivateKeyService fails due to missing BouncyCastleProvider
This closes #7817

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-30 11:01:40 -05:00
Mike Moser
e93586df11
NIFI-12038 This closes #7760. introduce PackageFlowFile processor
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-30 08:51:46 -07:00
exceptionfactory
c76191fa4b
NIFI-12152 This closes #7818. Refactored addProvider() Bouncy Castle references
- Removed Security.addProvider() references from several tests
- Refactored KeyStoreUtils to use instance of BouncyCastleProvider instead of BC provider name string
- Refactored MiNiFi references to pass BouncyCastleProvider for BCFKS

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-30 07:56:53 -07:00
exceptionfactory
75c3b19979
NIFI-12142 This closes #7822. Corrected Cluster Pool Size Method Reference
- Set getClusterNodeProtocolMaxPoolSize method reference in place of deprecated getClusterNodeProtocolThreads

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-30 07:54:13 -07:00
dan-s1
e9b532bd32 NIFI-12100 Removed the ConvertExcelToCSVProcessor
This closes #7802

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-09-29 14:09:00 -04:00
Bryan Bende
a74c411079 NIFI-12104 Separate a non-atomic Redis DMC implementation from the existing one for use in Put/Fetch DMC when Redis is clustered
This closes #7796

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-09-29 10:54:16 -04:00
Joe Witt
476f30813d
NIFI-12132 change default content repo archive percentage and age to 90 percent and 3 hours to better align to default user needs (#7797) 2023-09-28 17:32:21 -04:00
Mark Payne
1046fdf79d
NIFI-11938: This closes #7673. Created ConsumeSlack Processor to consume conversation history message events from Slack
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-28 14:14:35 -07:00
Mark Payne
db727aa419
NIFI-12142: This closes #7806. Deleted many methods, classes, and references that were deprecated.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-28 14:07:48 -07:00
Arpad Boda
dbcc223b40 NIFI-12134 - Disable Directory Listing property is duplicated on PutSFTP processor
Signed-off-by: Bejan Csaba <bejan.csaba@gmail.com>

This closes #7798.
2023-09-27 17:44:24 +02:00
Bryan Bende
1ac833654b NIFI-12127 Allow Jackson's max string length to be configured on SplitJson and EvaluateJsonPath
This closes #7794

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-09-27 08:48:11 -04:00
Mark Payne
16c527271b
NIFI-11271: This closes #7795. Removed deprecated Kerberos-related properties and updated to make use of KerberosUserService; some code cleanup to bring up-to-date with Java 21 recommendations such as Stream.toList() instead of Stream.collect(Collectors.toList()) and using enhanced switch statements
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-26 10:51:59 -07:00
Bryan Bende
04e54d5ea7
NIFI-12117 Allow configuring Jackson's max string length in JoltTransformJSON
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7788.
2023-09-26 13:01:13 +02:00
Joseph Witt
81dc36a473
NIFI-12128 updated cassandra, jgit, and netty
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7793.
2023-09-26 11:44:15 +02:00
Matt Burgess
e7da2ab5b8
NIFI-11177: Add defensive code for null values for Iceberg
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7777.
2023-09-26 11:30:08 +02:00
Matt Burgess
3f5661232e
NIFI-12024: Add CSV Writer property to CSVRecordSetWriter and a FastCSV writer implementation
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7686.
2023-09-26 11:22:52 +02:00
Peter Turcsanyi
5644fdd725
NIFI-12126: Downgrade snowflake-jdbc to 3.13.33
snowflake-ingest-sdk:2.0.3 is not compatible with snowflake-jdbc:3.14.x

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7790.
2023-09-26 11:07:14 +02:00
Pierre Villard
43cc5ad122
NIFI-12079 This closes #7750. Remove Variables / Variable Registry
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 09:39:53 -07:00
Mark Payne
025109a9d8
NIFI-12123: This closes #7786. Added additional @UseCase and @MultiProcessorUseCase annotations as well as some trivial cleanup that was flagged by IntelliJ such as making inner class static, updating some deprecated references, etc.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-25 07:54:21 -07:00
exceptionfactory
bcc54953c4
NIFI-12120 This closes #7784. Removed Obsolete Framework Integration Tests
- Removed integration tests from org.apache.nifi.integration in nifi-framework-core

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-24 15:48:47 -07:00
Pierre Villard
2aca08910c
NIFI-12103 Replaced deprecated usage of new URL(String)
This closes #7771

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-23 10:30:42 -05:00
Mark Payne
c28d040bca
NIFI-12118: refactored RemoveRecordPath member variable that was caching values, and improve performance with Pattern.matcher().find() instead of .match().
This closes #7783

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-09-23 14:02:09 +01:00
Pierre Villard
4b9eb8361c
NIFI-12113 Replaced Validate.notNull() with Objects.requireNonNull()
This closes #7779

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-22 15:18:50 -05:00
Mark Payne
140ac52e9d
NIFI-12068: This closes #7737. Added the ability to annotate components with @UseCase and @MultiProcessorUseCase annotations; updated several processors to make use of them.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-22 10:47:47 -07:00
exceptionfactory
d354c88f57
NIFI-12112 This closes #7778. Removed Unmaintained Components and Modules
- nifi-cybersecurity-bundle
- nifi-html-bundle
- nifi-hl7-bundle
- nifi-metrics-reporting-bundle
- nifi-riemann-bundle
- nifi-tcp-bundle
- nifi-rules-action-handler-bundle
- nifi-rules-engine-service-api

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-22 09:46:28 -07:00
Mark Payne
713be8b539
NIFI-12101: This closes #7768. Fixed bugs that caused StatelessBasicsIT.testChangeFlowVersion to fail. There were a couple of related issues. Firstly, for Stateless Groups we were not waiting for the group to fully stop before attempting to update the flow but were waiting only for child/descendant groups to stop. This was due to misleading naming in the ProcessGroupUpdateStrategy enum. Renamed enum values to more clearly convey what they mean. Additionally, renamed the enum to more clearly convey what how it is used, since it is used not only for updating groups but also for retrieving groups. Additionally, when waiting for stateless groups to stop, we inadvertently checked the Set of affectedComponents' IDs against Process Group IDs so addressed the logic there and also ensured that we were consistent in setting the AffectedComponentEntity's ProcessGroup (i.e., its ProcessGroupNameDTO) as we were inconsistently setting it across the codebase.
Fixed issue in logic of LocalComponentLifecycle, which was waiting for all PGs to reach desired stateless run schedule, even when the group itself was not stateless

Fixed JavaScript to specify correct value for recursivity when updating process group parameter context
2023-09-22 09:00:52 -07:00
Nandor Soma Abonyi
9ae6921272
NIFI-12095 This closes #7762. Increase default Xmx to 1g
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-21 19:48:34 -07:00
exceptionfactory
a832b134b1
NIFI-12109 This closes #7774. Removed SpringContextProcessor
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-21 19:41:52 -07:00
dan-s1
9b591a2fe3
NIFI-12041 Converted Groovy tests to Java in nifi-scripting-processors
This closes #7752

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-21 13:45:26 -05:00
Pierre Villard
5405a3b08b
NIFI-12102 Fixed deprecation warnings when instantiating primitive types
This closes #7769

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-21 13:41:30 -05:00
Nandor Soma Abonyi
badbc1aca6
NIFI-12022 Extract verification logic from JMSConnectionFactoryProvider
This closes #7667.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-09-21 19:24:41 +02:00
exceptionfactory
ebe8b9a2e7
NIFI-12033 Added EncryptContentAge and DecryptContentAge Processors
This closes #7676
Signed-off-by: Paul Grey <greyp@apache.org>
2023-09-21 13:00:16 -04:00
Pierre Villard
9c19656f5b
NIFI-12097 Upgraded Snowflake ingest SDK to 2.0.3 and JDBC to 3.14.1
This closes #7764

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-20 16:46:19 -05:00
Joseph Witt
4527e3fe0f
NIFI-12091 Workaround for TestListenTCPRecord to be corrected in NIFI-12098
This closes #7765

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-20 16:38:22 -05:00
exceptionfactory
11d8519914
NIFI-12086 This closes #7757. Removed unused jgit dependency from framework-core
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-20 14:28:38 -07:00
exceptionfactory
2602e16d0d
NIFI-12094 This closes #7767. Removed EncryptContent and CryptographicHashAttribute
- Removed CipherProvider interface and implementations from nifi-security-utils

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-09-20 13:54:44 -07:00
Joseph Witt
e5894cf943
NIFI-12053 Updated Minimum Build Version to Java 21
- Configured GitHub Workflows with Azul Zulu and Amazon Corretto
- Added bootstrap.conf option for reflective access supporting Hive 3

This closes #7744

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 22:59:59 -05:00
Joe Witt
017b16254b
NIFI-11903 disable if windows (#7566) 2023-09-19 16:22:49 -04:00
Peter Turcsanyi
520840d93b
NIFI-12076 Removed ComponentLog methods with Object[] and Throwable
This closes #7759

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 13:10:19 -05:00
Peter Turcsanyi
ac80b9d900
NIFI-11595 StateProvider.replace() supports creating the initial state
- Extracted common logic from setState() and replace() into modifyState()
- Removed redundant code from createNode() because exceptions are handled on the caller side
- NodeExistsException and InterruptedException are handled in setState() and replace()
- Also used KeeperException's subclasses instead of KeeperException.code()

This closes #7324

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-09-19 10:06:38 -05:00