Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
8,909 Commits 146 Branches 201 Tags 404 MiB
Commit Graph

8909 Commits

Author SHA1 Message Date
Mark Payne 1d9ccb3857
NIFI-12161: This closes #7829. Ensuring framework threads use lightweight threads instead of a capped thread pool. This prevents framework threads from livelocking in the event enough framework threads are holding threads while those needing to run cannot get them. 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-10-04 08:48:12 -07:00
Eric Secules 746dad7f46
[NIFI-12067] mock process session keeps track of flowfiles created during the session and removes them on rollback rather than putting them on the input queue (#7827) 
rename method to be more descriptive, fix checkstyle error for trailing whitespace in TestMockProcessSession.java
added session.transfer call to unit tests so that they fail without the fixes.

Co-authored-by: Eric Secules <eric.secules@macrohealth.com>
 2023-10-04 10:48:50 -04:00
exceptionfactory da4c6f6e25
NIFI-12163 This closes #7835. Improved Syslog 5424 Line Handling 
- Eliminated unused parseEvent method signatures from StrictSyslog5424Parser in favor of a single String line method
- Eliminated intermediate conversion from String to byte array and back to String for Syslog Parser

Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-10-03 19:26:06 -07:00
exceptionfactory 6394912cce
NIFI-12115 This closes #7830. Added ListenOTLP to collect OpenTelemetry 
- Added ListenOTLP Processor supporting OpenTelemetry OTLP 1.0.0 Specification with gRPC and HTTP
- Updated nifi-event-transport to support configurable SSLParameters for configurable Cipher Suites

Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-10-03 19:21:15 -07:00
Eric Secules 721628eb95
NIFI-12158 MockProcessSession write methods preserves attributes (#7828) 
Co-authored-by: Eric Secules <eric.secules@macrohealth.com>
 2023-10-03 14:40:31 -04:00
Matt Burgess 3f7b1de6b8
NIFI-11739 - Add ability to ignore missing fields in PutIceberg 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7421.
 2023-10-03 14:41:12 +03:00
exceptionfactory 2c79b5f8e2
NIFI-12162 This closes #7831. Upgraded Netty from 4.1.98 to 4.1.99 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-10-02 14:59:59 -07:00
Tamas Palfy 9c425d273c
NIFI-12131 Fixed potential NPE related to FlowAnalyzer 
Revamped RuleViolationsManager and FlowAnalyzer handling to make sure no issue occurs when these are not set. Fix ResourceNotFoundException: When determining the subject permissions for a rule violation the type of the subject is now known, so we try to lookup all possible types. Non-matching tpyes throw a ResourceNotFoundException exception though. Going to ignore those.

This closes #7809

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-10-02 15:35:05 -05:00
exceptionfactory 19b4be40aa
NIFI-12157 This closes #7826. Removed nifi-logging-utils and NiFiLog 
- Replaced NiFiLog references with direct references to SLF4J LoggerFactory

Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-10-02 08:17:51 -07:00
Joe Gresock ff8f1ff686
NIFI-8531: This closes #7529. Upgrading Kinesis processors to AWS SDK 2.x 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-10-01 16:26:51 -07:00
levilentz 9228036e1d
NIFI-7355: This closes #7677. TinkerpopClientService 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-10-01 11:17:58 -07:00
annanys23 9b9dd4bae3
NIFI-6721: This closes #7789. jms_expiration attribute problem fix 
Originally authored in part by sjyang18 <ilsong02@hotmail.com>

Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-10-01 11:11:56 -07:00
Mark Payne 342fb0d876
NIFI-12143: This closes #7820. Introduced a new nifi-calcite-utils module and refactored the nifi-sql-reporting-tasks to mamke use of it. This uses the newer calcite api instead of deprecated classes/methods 
- Refactored QueryRecord / JoinEnrichment to use new nifi-calcite-utils

Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-30 13:28:03 -07:00
exceptionfactory 1561eb2506 NIFI-12155 Upgraded Apache Commons IO from 2.13.0 to 2.14.0 
- Upgraded Apache POI from 5.2.3 to 5.2.4

This closes #7825

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-09-30 16:25:23 -04:00
exceptionfactory a84c103a0b NIFI-12154 Upgraded Apache Avro from 1.11.2 to 1.11.3 
This closes #7824

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-09-30 16:24:47 -04:00
Emilio Setiadarma a8c1bb1d9c
NIFI-10425 Corrected auto-reloading KeyStore files with symlinks 
- Changed StoreScanner scanner instantiation to not report real paths

This closes #7821

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-09-30 12:28:54 -05:00
Peter Turcsanyi 8c5d85a28d
NIFI-12151 Fixed StandardPrivateKeyService fails due to missing BouncyCastleProvider 
This closes #7817

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-09-30 11:01:40 -05:00
Mike Moser e93586df11
NIFI-12038 This closes #7760. introduce PackageFlowFile processor 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-30 08:51:46 -07:00
exceptionfactory c76191fa4b
NIFI-12152 This closes #7818. Refactored addProvider() Bouncy Castle references 
- Removed Security.addProvider() references from several tests
- Refactored KeyStoreUtils to use instance of BouncyCastleProvider instead of BC provider name string
- Refactored MiNiFi references to pass BouncyCastleProvider for BCFKS

Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-30 07:56:53 -07:00
exceptionfactory 75c3b19979
NIFI-12142 This closes #7822. Corrected Cluster Pool Size Method Reference 
- Set getClusterNodeProtocolMaxPoolSize method reference in place of deprecated getClusterNodeProtocolThreads

Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-30 07:54:13 -07:00
Joseph Witt 9ba81c9564 NIFI-12147 Cleaned poms, updated Dockerfile, fixed Jersey version to get appropriate bundled ASM 
This closes #7819

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-09-30 07:40:53 -04:00
Joseph Witt 67ba13796e
NIFI-12150 Restored NiFiRegistrySecurityConfig required for Registry 
- NiFiRegistrySecurityConfig was removed mistakenly in NIFI-12147 and updating extractor to match changes in NIFI-12147 for DN extraction

This closes #7815

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-09-29 14:21:40 -05:00
dan-s1 e9b532bd32 NIFI-12100 Removed the ConvertExcelToCSVProcessor 
This closes #7802

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-09-29 14:09:00 -04:00
Bryan Bende a74c411079 NIFI-12104 Separate a non-atomic Redis DMC implementation from the existing one for use in Put/Fetch DMC when Redis is clustered 
This closes #7796

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-09-29 10:54:16 -04:00
Joe Gresock 71adc196b3
NIFI-12146: Updating nifi cli command list in documentation (#7807) 2023-09-29 09:03:48 -04:00
Joe Witt 476f30813d
NIFI-12132 change default content repo archive percentage and age to 90 percent and 3 hours to better align to default user needs (#7797) 2023-09-28 17:32:21 -04:00
Joe Witt b58f3aee4d
NIFI-12138 added volume for nar extensions (#7804) 2023-09-28 17:30:16 -04:00
Mark Payne 1046fdf79d
NIFI-11938: This closes #7673. Created ConsumeSlack Processor to consume conversation history message events from Slack 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-28 14:14:35 -07:00
Marcelo Vinícius de Sousa Campos b8fd22e065
NIFI-12141 This closes #7805. Update README about HTTPS and OpenID Authentication for Docker Image 
According to this recent issue [NIFI-12135](https://issues.apache.org/jira/browse/NIFI-12135) I've forgotten to add 2 missing environment variables about OIDC configurations for docker image:

- NIFI_SECURITY_USER_OIDC_CLAIM_GROUPS and
- NIFI_SECURITY_USER_OIDC_TOKEN_REFRESH_WINDOW

Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-28 14:10:46 -07:00
Mark Payne db727aa419
NIFI-12142: This closes #7806. Deleted many methods, classes, and references that were deprecated. 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-28 14:07:48 -07:00
Marcelo Vinícius de Sousa Campos acd9b5b10b
NIFI-12135 This closes #7799. Update update_oidc_properties.sh 
Update OIDC properties via update_oidc_properties.sh

Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-27 16:31:47 -07:00
Joe Witt 249829af5f
NIFI-11917 removing support for RPM building as we lack the infrastructure/maintenance to keep it healthy and we dont publish the artifacts (#7801) 
Signed-off-by: Otto Fowler <ottobackwards@gmail.com>
 2023-09-27 15:50:03 -04:00
Marcelo Vinícius de Sousa Campos 01fb3e99dd
NIFI-12136 This closes #7800. Update README.md to add an example how to using Nifi to connect to an OpenID server. 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-27 10:17:19 -07:00
Arpad Boda dbcc223b40 NIFI-12134 - Disable Directory Listing property is duplicated on PutSFTP processor 
Signed-off-by: Bejan Csaba <bejan.csaba@gmail.com>

This closes #7798.
 2023-09-27 17:44:24 +02:00
Bryan Bende 1ac833654b NIFI-12127 Allow Jackson's max string length to be configured on SplitJson and EvaluateJsonPath 
This closes #7794

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
 2023-09-27 08:48:11 -04:00
Nandor Soma Abonyi 4b0c8bf6af
NIFI-12114 Create separate test instance for python extensions 
Signed-off-by: Arpad Boda <aboda@apache.org>

This closes #7780
 2023-09-27 11:40:13 +02:00
Mark Payne 16c527271b
NIFI-11271: This closes #7795. Removed deprecated Kerberos-related properties and updated to make use of KerberosUserService; some code cleanup to bring up-to-date with Java 21 recommendations such as Stream.toList() instead of Stream.collect(Collectors.toList()) and using enhanced switch statements 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-26 10:51:59 -07:00
Joe Witt ff05a5d158
NIFI-12074 updated images to base on Java 21 and added Python3 (#7785) 
* NIFI-12074 updated images to base on Java 21 and added Python3

* NIFI-12074 ensure python env included, enable python extension mount
 2023-09-26 10:08:32 -04:00
Bryan Bende 04e54d5ea7
NIFI-12117 Allow configuring Jackson's max string length in JoltTransformJSON 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7788.
 2023-09-26 13:01:13 +02:00
Joseph Witt 81dc36a473
NIFI-12128 updated cassandra, jgit, and netty 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7793.
 2023-09-26 11:44:15 +02:00
dependabot[bot] b76074a6c9
NIFI-12129 - Bump org.xerial.snappy:snappy-java from 1.1.10.3 to 1.1.10.4 
Bumps [org.xerial.snappy:snappy-java](https://github.com/xerial/snappy-java) from 1.1.10.3 to 1.1.10.4.
- [Release notes](https://github.com/xerial/snappy-java/releases)
- [Commits](https://github.com/xerial/snappy-java/compare/v1.1.10.3...v1.1.10.4)

---
updated-dependencies:
- dependency-name: org.xerial.snappy:snappy-java
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7792.
 2023-09-26 11:34:04 +02:00
Matt Burgess e7da2ab5b8
NIFI-11177: Add defensive code for null values for Iceberg 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7777.
 2023-09-26 11:30:08 +02:00
Matt Burgess 3f5661232e
NIFI-12024: Add CSV Writer property to CSVRecordSetWriter and a FastCSV writer implementation 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7686.
 2023-09-26 11:22:52 +02:00
Peter Turcsanyi 5644fdd725
NIFI-12126: Downgrade snowflake-jdbc to 3.13.33 
snowflake-ingest-sdk:2.0.3 is not compatible with snowflake-jdbc:3.14.x

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7790.
 2023-09-26 11:07:14 +02:00
Pierre Villard 43cc5ad122
NIFI-12079 This closes #7750. Remove Variables / Variable Registry 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-25 09:39:53 -07:00
Mark Payne 025109a9d8
NIFI-12123: This closes #7786. Added additional @UseCase and @MultiProcessorUseCase annotations as well as some trivial cleanup that was flagged by IntelliJ such as making inner class static, updating some deprecated references, etc. 
Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-25 07:54:21 -07:00
exceptionfactory bcc54953c4
NIFI-12120 This closes #7784. Removed Obsolete Framework Integration Tests 
- Removed integration tests from org.apache.nifi.integration in nifi-framework-core

Signed-off-by: Joseph Witt <joewitt@apache.org>
 2023-09-24 15:48:47 -07:00
Pierre Villard 2aca08910c
NIFI-12103 Replaced deprecated usage of new URL(String) 
This closes #7771

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-09-23 10:30:42 -05:00
Mark Payne c28d040bca
NIFI-12118: refactored RemoveRecordPath member variable that was caching values, and improve performance with Pattern.matcher().find() instead of .match(). 
This closes #7783

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
 2023-09-23 14:02:09 +01:00
Pierre Villard 4b9eb8361c
NIFI-12113 Replaced Validate.notNull() with Objects.requireNonNull() 
This closes #7779

Signed-off-by: David Handermann <exceptionfactory@apache.org>
 2023-09-22 15:18:50 -05:00