Commit Graph

9148 Commits

Author SHA1 Message Date
exceptionfactory 22ad7d542d
NIFI-12206 Refactor Flow History using JetBrains Xodus (#7870)
* NIFI-12206 Refactored Flow History using JetBrains Xodus

- Replaced H2 Database Engine with JetBrains Xodus for persistent storage of FlowConfigurationHistory
- Added EntityStoreAuditService implementation using Xodus PersistentEntityStore
- Removed nifi.h2.url.append from properties
2023-10-12 14:50:25 -04:00
Mark Payne abfc49e212
NIFI-12139: Implemented migrateProperties, migrateRelationships for processors, as well as migrateProperties for ReportingTasks and Controller Services. Added system tests to verify behavior.
- Ensure that after restoring nars in the lib/ directory we restart NiFi so that they take effect. This is important if this test is not the last one to run

This closes #7837

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-12 11:40:18 -05:00
exceptionfactory a849ca044c
NIFI-12218 Removed SensitiveValueEncoder and SecureHasher
- SensitiveValueEncoder and SecureHasher are no longer required following the removal of support for flow.xml.gz

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7873.
2023-10-12 17:39:43 +02:00
Joseph Witt 2bcdcab5dd
NIFI-12215 Upgraded ZooKeeper from 3.9.0 to 3.9.1
- Resolves CVE-2023-44981

This closes #7872

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-11 22:18:40 -05:00
levilentz 1a0f509ffc
NIFI-12211: This closes #7868. add Validator.VALID to username/password on TinkerpopClientService
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-11 17:38:02 -07:00
Chris Sampson 584b3fc165
NIFI-12214 This closes #7869. ConsumeElasticsearch Query Builder properties do not dependOn the Query Definition Style
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-11 17:37:40 -07:00
Mike Moser f2927525f3
NIFI-12213 This closes #7871. add nifi-utils dependency to NARs that do not use nifi-standard-services-api-nar as a parent
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-11 17:37:19 -07:00
Joe Gresock 9627c4c0e8
NIFI-12174 Upgraded AWS PutLambda Processor to SDK 2
This closes #7851

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-11 16:41:39 -05:00
Bence Simon 3f13604c36
NIFI-11772 Removed flow.xml.gz support
- Created NIFI-12203 to evaluate issues with flow comparison surfaced in JoinClusterWithDifferentFlow

This closes #7661

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-11 13:53:01 -05:00
exceptionfactory 1b57980067
NIFI-12207 Upgraded Netty from 4.1.99 to 4.1.100
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7865.
2023-10-11 19:52:01 +02:00
exceptionfactory b236200a84
NIFI-12208 Upgraded Jetty from 10.0.16 to 10.0.17
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7866.
2023-10-11 19:50:29 +02:00
Mark Payne 0fd4ec50ad
NIFI-12144: Eliminated deprecation warnings by moving to newer Amazon SDK APIs. Eliminated several abstract classes that provided no value. Code cleanup. Refactored many of the integration tests to make use of Test Containers. Removed some tests that were incorrect
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7854.
2023-10-10 20:32:49 -04:00
Mark Payne ce2a156b9c NIFI-12140: Updated dependency to include nifi-property-utils in nifi-redis-utils module as a result of merging NIFI-12185 2023-10-10 16:08:26 -04:00
timeabarna d2aec89738
NIFI-12166 Add repo usage to the monitoring endpoint (#7836)
* NIFI-12166 Add repo usage to the monitoring endpoint
2023-10-10 14:55:33 -04:00
Bryan Bende 5a42d7245b
NIFI-12140 Add optional properties to RedisConnectionPoolService for Username and Sentinel Username (#7862) 2023-10-10 14:39:41 -04:00
exceptionfactory 98cebc6687
NIFI-12185 Added nifi-bom Bill of Materials (#7852)
- Imported nifi-bom to nifi-commons and nifi-nar-bundles parent modules
- Removed explicit version and scope properties for dependencies declared in nifi-bom
2023-10-10 13:55:22 -04:00
Chris Sampson c091347795
NIFI-11985: Add ConsumeElasticsearch processor
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7671.
2023-10-10 06:00:52 -04:00
dependabot[bot] 2cad5c5ad6
NIFI-12199 Upgraded PostCSS from 8.4.25 to 8.4.31
This closes #7856

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 16:13:24 -05:00
Nandor Soma Abonyi 87b8f230d2
NIFI-11940 Added SSLContextService to GetSplunk
- Included ClassLoader isolation to work around Splunk Service static configuration limitations

This closes #7668

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 15:59:27 -05:00
Paul Grey 130c8e9903
NIFI-12169 - Document alternatives to usage of TLS Toolkit
This closes #7860

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 15:56:17 -05:00
Nandor Soma Abonyi 621e212640
NIFI-12197 Upgrade wrapper Maven from 3.9.4 to 3.9.5
This closes #7861

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 11:52:27 -05:00
mkalavala 2b41b07489
NIFI-6240 Added Proxy Support for WebSocket Transport in Azure EventHubs
This closes #7740

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 11:19:24 -05:00
dan-s1 66b68140e2
NIFI-12116 Documented lack of NDJSON support in ValidateJson
This closes #7782

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 11:12:02 -05:00
Chris Sampson 099ceec7ed
NIFI-12153 Added Allow Comments and Max String Length to JSON Readers
This closes #7823

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-09 10:43:08 -05:00
Bryan Bende ae61ebb5ed
NIFI-12186 Add ability to export a versioned reporting task snapshot (#7853)
* NIFI-12186 Add ability to export a versioned reporting task snapshot
- Add CLI commands and optional query param to specify specific reporting task
2023-10-09 10:50:36 -04:00
exceptionfactory 457973d133
NIFI-12188 Upgraded Commons Net from 3.9.0 to 3.10.0
- Removed ProxyFTPClient extension of standard FTPClient no longer required following changes implemented in NET-650

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7855.
2023-10-09 12:21:23 +02:00
Joe Gresock a584251f0a
NIFI-12189: Upgrading PutCloudwatchMetric to use AWS SDK 2.x
This closes #7857

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2023-10-08 18:24:37 +01:00
mr1716 d2fb81d1d6
NIFI-12182 Upgraded AMQP from 5.18.0 to 5.19.0
This closes #7847

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-06 15:32:29 -05:00
mr1716 226bf273a1
NIFI-12179 Upgraded Accumulo from 2.1.1 to 2.1.2
This closes #7843

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-06 15:32:29 -05:00
mr1716 1e5c491433
NIFI-12184 Upgraded Iceberg from 1.3.1 to 1.4.0
This closes #7848

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-06 15:32:28 -05:00
mr1716 a8b56949d7
NIFI-12183 Upgraded zstd-jni from 1.5.5-5 to 1.5.5-6
This closes #7850

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-06 15:32:28 -05:00
mr1716 db0407cda6
NIFI-12181 Upgraded HiveMQ MQTT Client from 1.3.1 to 1.3.3
This closes #7846

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-06 15:32:27 -05:00
mr1716 cb3b7907e0
NIFI-12180 Upgraded Testcontainers from 1.19.0 to 1.19.1
This closes #7845

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-06 15:32:27 -05:00
Bryan Bende 551625f7bf
NIFI-12149 Create nifi-redis-utils and minor improvements to util methods
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7812.
2023-10-06 15:32:00 -04:00
mr1716 7ddcb91605
NIFI-12171 Upgraded excel-streaming-reader from 4.1.2 to 4.2.0
This closes #7841

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-05 16:09:58 -05:00
mr1716 cebd13132e
NIFI-12170 Upgraded snappy-java from 1.1.10.4 to 1.1.10.5
This closes #7840

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-05 16:09:12 -05:00
Nissim Shiman 5afda79f28
NIFI-11782 Resolved NPE when moving snippet with label to process group
This closes #7838

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-05 16:05:40 -05:00
Lehel Boer 7e4ca9365f NIFI-12092 Add backoff parameters to JettyWebsocketClient reconnect
This closes #7761.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2023-10-04 18:22:15 +02:00
Mark Payne 711f2f1188
NIFI-12137: This closes #7808. Fixed name of Expression Language Scope from LIMITED to ENVIRONMENT, ; fixed issue in which flowfiles routed to failure by FlowFileTransform were also being routed to original; defined 'identifier' and 'logger' as member variables for FlowFileTransform and RecordTransform so that IDEs know about them
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-04 09:16:04 -07:00
Mark Payne 1d9ccb3857
NIFI-12161: This closes #7829. Ensuring framework threads use lightweight threads instead of a capped thread pool. This prevents framework threads from livelocking in the event enough framework threads are holding threads while those needing to run cannot get them.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-04 08:48:12 -07:00
Eric Secules 746dad7f46
[NIFI-12067] mock process session keeps track of flowfiles created during the session and removes them on rollback rather than putting them on the input queue (#7827)
rename method to be more descriptive, fix checkstyle error for trailing whitespace in TestMockProcessSession.java
added session.transfer call to unit tests so that they fail without the fixes.

Co-authored-by: Eric Secules <eric.secules@macrohealth.com>
2023-10-04 10:48:50 -04:00
exceptionfactory da4c6f6e25
NIFI-12163 This closes #7835. Improved Syslog 5424 Line Handling
- Eliminated unused parseEvent method signatures from StrictSyslog5424Parser in favor of a single String line method
- Eliminated intermediate conversion from String to byte array and back to String for Syslog Parser

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-03 19:26:06 -07:00
exceptionfactory 6394912cce
NIFI-12115 This closes #7830. Added ListenOTLP to collect OpenTelemetry
- Added ListenOTLP Processor supporting OpenTelemetry OTLP 1.0.0 Specification with gRPC and HTTP
- Updated nifi-event-transport to support configurable SSLParameters for configurable Cipher Suites

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-03 19:21:15 -07:00
Eric Secules 721628eb95
NIFI-12158 MockProcessSession write methods preserves attributes (#7828)
Co-authored-by: Eric Secules <eric.secules@macrohealth.com>
2023-10-03 14:40:31 -04:00
Matt Burgess 3f7b1de6b8
NIFI-11739 - Add ability to ignore missing fields in PutIceberg
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7421.
2023-10-03 14:41:12 +03:00
exceptionfactory 2c79b5f8e2
NIFI-12162 This closes #7831. Upgraded Netty from 4.1.98 to 4.1.99
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-02 14:59:59 -07:00
Tamas Palfy 9c425d273c
NIFI-12131 Fixed potential NPE related to FlowAnalyzer
Revamped RuleViolationsManager and FlowAnalyzer handling to make sure no issue occurs when these are not set. Fix ResourceNotFoundException: When determining the subject permissions for a rule violation the type of the subject is now known, so we try to lookup all possible types. Non-matching tpyes throw a ResourceNotFoundException exception though. Going to ignore those.

This closes #7809

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-10-02 15:35:05 -05:00
exceptionfactory 19b4be40aa
NIFI-12157 This closes #7826. Removed nifi-logging-utils and NiFiLog
- Replaced NiFiLog references with direct references to SLF4J LoggerFactory

Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-02 08:17:51 -07:00
Joe Gresock ff8f1ff686
NIFI-8531: This closes #7529. Upgrading Kinesis processors to AWS SDK 2.x
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-01 16:26:51 -07:00
levilentz 9228036e1d
NIFI-7355: This closes #7677. TinkerpopClientService
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-10-01 11:17:58 -07:00