Commit Graph

6142 Commits

Author SHA1 Message Date
Matt Burgess f6a14bc475
NIFI-11807 Added ExtractRecordSchema Processor
This closes #7482

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-19 12:32:59 -05:00
exceptionfactory 16c4004d58 NIFI-10728 Upgraded Apache Derby from 10.14.2.0 to 10.16.1.1
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7497
2023-07-18 18:29:20 -04:00
Pierre Villard 150bfbe990
NIFI-11813 Removed Event Driven Scheduling Strategy
This closes #7483

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-18 12:22:52 -05:00
mr1716 779eea6453
NIFI-11824 Upgraded JAX-RS API from 2.1 to 2.1.1
This closes #7490

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-18 10:50:30 -05:00
Lehel a3fe9d121d NIFI-11817: Improve ListHDFS extensibility
Fix review items

This closes #7484
Signed-off-by: Bence Simon <bsimon@apache.org>
2023-07-18 15:56:08 +02:00
mr1716 bdd2a2b24b
NIFI-11819 Update derby.version to 10.16.1.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7491.
2023-07-18 10:14:05 +02:00
EndzeitBegins 34a6d8a0a1
NIFI-8128 Added Sentinel Password to Redis Service
- Replaced embedded-redis and with Testcontainers for Redis integration tests

This closes #7481

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-15 19:53:24 -05:00
exceptionfactory 95bb23d403
NIFI-11781 Corrected OIDC Claim Identity Processing
- Added StandardOidcUserService supporting fallback claim names
- Updated StandardClientRegistrationProvider to use standard Subject claim
- Updated OIDC Security Configuration to use customized OidcUserService for claim handling

Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #7468.
2023-07-15 11:03:58 -04:00
Peter Turcsanyi 437995b75a
NIFI-11758: Added FileResourceService and used it in PutAzure*Storage processors for local file upload
- Renamed classes from DataUpload to ResourceTransfer and updated references
- Disabled testNonReadableFile() on Windows due to Posix permissions
- Replaced utility methods with functional handling of FileResource
- Corrected FlowFile InputStream access using Optional.orElseGet()

This closes: #7458

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-07-14 23:48:27 +02:00
mr1716 e5362c5eb7
NIFI-11798 Update smbj to 0.12.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7480.
2023-07-14 20:30:51 +02:00
Pierre Villard 8a61d5bdbf
NIFI-11794 - Fix NPE + configure max attempts for Redis State Provider (#7473)
Signed-off-by: Otto Fowler<ottobackwards@gmail.com>

This closes #7473.
2023-07-14 11:51:18 -04:00
exceptionfactory e812951c57
NIFI-11810 Removed unused JSTL and EL API libraries
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7479.
2023-07-14 10:30:27 +02:00
mr1716 65f9bcf0cf
NIFI-11804 Upgraded excel-streaming-reader from 4.0.5 to 4.1.0
This closes #7477

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-13 16:32:48 -05:00
mr1716 77b194303b
NIFI-11801 Upgraded RabbitMQ AMQP Client from 5.17.0 to 5.18.0
This closes #7475

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-13 16:30:08 -05:00
mr1716 3f72032112
NIFI-11800 Upgraded icu4j from 73.1 to 73.2
This closes #7474

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-13 16:29:24 -05:00
Matt Burgess 21e5ebc840
NIFI-7343: Add support for SchemaRegistryService to scripted components
This closes #7467

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-12 17:21:28 -05:00
Joe Witt d2c70d1d2f
NIFI-11434 added support for optionally allowing zip entries with dat… (#7462)
* NIFI-11434 added support for optionally allowing zip entries with data descriptors
* set default value and ensured all zip tests use various configs
2023-07-12 17:09:03 -04:00
Lehel 5bd4bc5190 NIFI-11178: Improve ListHDFS performance, incremental loading refactor. 2023-07-11 13:22:29 +02:00
Pierre Villard a04cbe7f07 NIFI-11779 - Override endpoint in PutBigQuery
review

use default from code instead of hardcoding

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7460
2023-07-10 12:15:24 -04:00
Emilio Setiadarma a85ef2c1f4
NIFI-11536 Corrected Keystore and Truststore auto-reloading
- Replaced Jetty KeyStoreScanner and custom TrustStoreScanner with shared StoreScanner
- New StoreScanner uses TLS Configuration to reload SSLContext instead of relying on Jetty SslContextFactory properties

This closes #7446

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-10 11:07:04 -05:00
dan-s1 d24318cdb8
NIFI-11767 Refactored Groovy tests in nifi-web-error and nifi-web-security to Java
This closes #7457

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-06 16:30:34 -05:00
Pierre Villard b3372900b3
NIFI-11774 Upgraded gRPC from 1.55.1 to 1.56.1
This closes #7456

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-07-05 17:01:49 -05:00
Matt Burgess f69b457757
NIFI-11770: Replace java-faker with Data Faker for GenerateRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7454.
2023-07-03 11:33:50 +02:00
Mark Bathori b1be71f918
NIFI-11334: Fixed PutIceberg processor instance interference due to same class loader usage
This closes #7449.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-06-30 20:36:33 +02:00
simonbence 5f4cc106f1
NIFI-11769 Adding details on Registry Clients and Registrty Client types on UI (#7453)
Co-authored-by: Shane Ardell <shane.m.ardell@gmail.com>

Merged #7453 into main.
2023-06-30 11:33:41 -07:00
Bence Simon cadf2fb6f2
NIFI-11706 Add option to create dedicated Parameter Contexts for Imported Flows
This closes #7401

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-30 12:56:27 -05:00
exceptionfactory 50b01ffd63
NIFI-11714 Added Error Handler to Jetty Server
- Configured Error Handler with Stack Traces disabled for NiFi and Registry

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #7447.
2023-06-29 16:44:01 -04:00
exceptionfactory 3aba769cc3
NIFI-11762 Upgraded Hadoop dependencies from 3.3.5 to 3.3.6
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7445.
2023-06-28 19:35:38 +02:00
Matt Burgess 7b5853363f NIFI-11759: Remove Distributed Map Cache Client property from ListHDFS
This closes #7443

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-28 11:07:56 -04:00
exceptionfactory 12b7dd0243
NIFI-11760 Upgraded Riemann Client from 0.4.1 to 0.5.3
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7444.
2023-06-28 09:55:45 +02:00
dan-s1 2a7fa6d17b
NIFI-11754 Refactored Groovy test in nifi-jetty to Java (and JUnit 5)
This closes #7442

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-27 14:39:08 -05:00
exceptionfactory 09e36f4d3e NIFI-11757 Upgraded Google Cloud Libraries from 26.15.0 to 26.17.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7439
2023-06-27 12:48:51 -04:00
Matt Burgess c90625a3e8
NIFI-11753: Remove deprecated JRuby and Luaj script engines
This closes #7436

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 15:35:57 -05:00
dan-s1 7748d9d1e5
NIFI-11747 Refactored Groovy tests in nifi-web-api to Java (and JUnit 5)
This closes #7434

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 15:18:48 -05:00
Chris Sampson 3f5ed23504
NIFI-9206 Added RemoveRecordField Processor
This closes #6816

Co-authored-by: Peter Gyori <peter.gyori.dev@gmail.com>
Co-authored-by: Chris Sampson <chris.sampson82@gmail.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 09:50:41 -05:00
Bence Simon c5946b2e6c
NIFI-11745 Upgraded QuestDB from 6.7 to 7.2
This closes #7430

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-26 09:45:36 -05:00
exceptionfactory 1f1c5df5a3
NIFI-11673 Removed Legacy TLS Configuration Versions
This closes #7367

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-26 11:10:39 +02:00
timeabarna ba6797bb94
NIFI-3065 Per Process Group logging (#7315)
* NIFI-3065 Per Process Group logging
2023-06-23 21:14:34 -04:00
exceptionfactory 7d6af0dbb0 NIFI-11748 Upgraded Apache Commons Codec from 1.15 to 1.16.0
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7428
2023-06-23 18:27:36 -04:00
exceptionfactory bdd7ef3671 NIFI-11744 Added Required Permission to Reference Remote Resources
- Applied Required Permission to components supporting URL Resource References

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7426
2023-06-23 18:07:16 -04:00
Timea Barna dceee57dfd
NIFI-11705 Append Operating System section in NiFi diagnostic tool
This closes #7388

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-23 16:36:51 -05:00
Bryan Bende 40014486a4
NIFI-11492 Allow authorization to proceed based on request groups even if user does not exist
This closes #7425

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-22 15:50:23 -05:00
Tanmaya Panda bd33f2c911
NIFI-8294 Added QueryAzureDataExplorer and StandardKustoQueryService
This closes #7122

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-22 15:26:47 -05:00
Mark Payne ce623632cf
NIFI-11243: Implemented Dependent Properties on the Python side
This closes #7323

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-22 13:03:43 -05:00
exceptionfactory 0f736e060a
NIFI-11735 Refactored Identity Provider Groups Handling (#7419)
- Removed H2 database approach in favor of passing groups in Application Bearer Token
2023-06-22 11:07:23 -04:00
exceptionfactory 3ddac48c6d NIFI-11734 Upgraded Apache Accumulo from 2.1.0 to 2.1.1
This closes #7418

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-21 15:42:05 -04:00
mr1716 f62e1eb1e9
NIFI-11732 Upgraded Saxon from 12.1 to 12.2
- Adjusted spacing in test HTML to match Saxon 12.2 serialization

This closes #7414

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-21 11:01:45 -05:00
dan-s1 5db06437a3 NIFI-11638 Refactored Groovy tests in nifi-cdc/nifi-cdc-mysql-bundle/nifi-cdc-mysql-processors to Java (and JUnit 5)
NIFI-11638 Removed groovy-json dependency

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7408
2023-06-21 10:25:17 -04:00
Matt Burgess 84fdb5e32f NIFI-7016: Fix Groovy File functions available for FlowFile in ExecuteGroovyScript
This closes #7016

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-21 06:23:59 -04:00
exceptionfactory 26d02fff49 NIFI-11729 Upgraded OWASP Dependency Check from 8.2.1 to 8.3.1
- Updated OWASP suppressions to exclude several JSON and Kafka false positives
- Excluded JUnit dependency from Hive 3 JDBC

This closes #7411

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-21 06:14:22 -04:00
mr1716 05322fa8ce
NIFI-11730 Upgraded UnboundID LDAP SDK from 6.0.8 to 6.0.9
This closes #7412

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-20 17:12:05 -05:00
exceptionfactory 305277b833 NIFI-11709 Upgraded Guava from 32.0.0 to 32.0.1
- Added version override for Guava 27 to 32.0.1 in Hadoop and Hive modules

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7415
2023-06-20 16:22:00 -04:00
exceptionfactory 7b6a51aa9f NIFI-11728 Removed RethinkDB Processors
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7410
2023-06-20 16:15:13 -04:00
mr1716 3ac1876ecb NIFI-11731 Update json-schema-validator to 1.0.84
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7413
2023-06-20 12:52:50 -04:00
Peter Turcsanyi 4082951506
NIFI-11708: Upgraded snowflake-ingest-sdk to 2.0.1 and snowflake-jdbc to 3.13.33
This closes #7393

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-20 18:12:34 +02:00
mr1716 a5ae155839
NIFI-11725 Upgraded Woodstox from 6.5.0 to 6.5.1
This closes #7407

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:05:01 -05:00
mr1716 b8c5bb661e
NIFI-11724 Upgraded parquet-avro from 1.13.0 to 1.13.1
This closes #7406

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:04:15 -05:00
mr1716 69ef6c6971
NIFI-11723 Upgraded Jedis from 3.9.0 to 3.10.0
This closes #7405

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:03:32 -05:00
mr1716 d252ed5e1b
NIFI-11722 Upgraded Spring Data Redis from 2.7.10 to 2.7.13
This closes #7404

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:02:07 -05:00
mr1716 8be9b01677
NIFI-11720 Upgraded HBase from 2.5.3 to 2.5.5
This closes #7402

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-19 16:01:15 -05:00
exceptionfactory 0ed1efc50a
NIFI-11712 Removed java.net.preferIPv4Stack from bootstrap.conf
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7392.
2023-06-19 10:22:31 +02:00
exceptionfactory b6b621bf9e
NIFI-11717 Updated Required Java Version to 17.0.6
- Added Groovy Plugin Repository for groovy-eclipse-compiler

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7397.
2023-06-19 10:19:55 +02:00
Matt Burgess 8a696c1dfa
NIFI-11715 Removed unused user-defined property support from PutDatabaseRecord and DistributedMapCacheLookupService
This closes #7395

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 16:23:43 -05:00
dan-s1 e4d1dab8f7
NIFI-11167 Added ExcelReader to nifi-poi-nar
- Moved shared schema inference components to nifi-record-serialization-services-shared

This closes #7194

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 15:50:08 -05:00
Matt Burgess bc6ac4b700
NIFI-11682 Correct Quoting for UPSERT and INSERT_IGNORE keys in PutDatabaseRecord
This closes #7385

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 15:05:03 -05:00
exceptionfactory ce019071a4 NIFI-11713 Removed Deprecated ECMAScript Support
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7394
2023-06-16 14:23:51 -04:00
Peter Turcsanyi b36570f2cd
NIFI-11699 Fixed dynamic properties in SnowflakeComputingConnectionPool
Also fixed driver class name handling (caused IT test failure).
Other test fixes to make IT tests work.

This closes #7387

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 09:40:57 -05:00
mr1716 7c7b7c026b
NIFI-11710 Corrected nifi-kafka-2-6-nar Description
This closes #7390

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-16 09:39:46 -05:00
exceptionfactory 6b19ab8eaa NIFI-11696 Upgraded Bouncy Castle from 1.71 to 1.74
- Adjusted nifi-repository-encryption to remove dependency on Bouncy Castle Provider
- Updated Google Cloud Provider dependencies to remove exclusions and dependencies on Bouncy Castle that no longer apply to current versions

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7384
2023-06-15 16:33:20 -04:00
exceptionfactory 4638d2e251
NIFI-11635 Upgraded IoTDB from 1.0.1 to 1.1.1
- Excluded transitive test dependencies to avoid SNAPSHOT versions

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7382.
2023-06-15 13:39:11 +02:00
Matt Burgess 760949922c
NIFI-11691 Support VARBINARY and LONGVARBINARY in PutDatabaseRecord
This closes #7380

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 21:01:02 -05:00
Matthew Burgess 991e5e24de
NIFI-4957 Add Resource File Support for Jolt Specifications
This closes #4044

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 16:01:02 -05:00
mr1716 17efd87bae
NIFI-11687 Upgraded Hazelcast from 5.3.0 to 5.3.1
This closes #7375

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 14:28:45 -05:00
mr1716 8cd1b4b76c
NIFI-11685 Upgraded zstd-jni from 1.5.5-3 to 1.5.5-4
This closes #7376

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 14:28:07 -05:00
mr1716 4b6209ed20
NIFI-11684 Upgraded Brotli4j from 1.11.0 to 1.12.0
This closes #7377

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-14 14:27:26 -05:00
Jeyassri Balchandran 8382b0a7a3
NIFI-11540 Removed legacy segment attributes from MergeContent
This closes #7305

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 18:37:48 -05:00
exceptionfactory ca6c7f7041 NIFI-11532 Removed JUnit 4 and Groovy Test from default dependencies
- Removed hamcrest-all from default dependencies
- Added groovy-test to selected modules with Groovy test classes
- Added junit-vintage-engine to selected modules with JUnit 4 test classes
- Corrected references to JUnit 4 assertions in JUnit 5 test classes
- Removed several unnecessary test classes from nifi-socket-utils
- Removed duplicative Registry toolkit test classes
- Removed Kudu integration tests

NIFI-11532 Corrected scope for junit-vintage-engine for Elasticsearch

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7233
2023-06-13 15:36:23 -04:00
Emilio Setiadarma 31e1c17d44
NIFI-11642 Updated PutSNS using AWS SDK 2
This closes #7362

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 13:50:22 -05:00
Paul Grey 336b857442
NIFI-11553 Add Record handling and more Properties for GCP PubSub
- Added Message Derivation Strategy to PublishGCPubSub with FlowFile and Record options
- Added API Endpoint property to PublishGCPPubSub and ConsumeGCPubSub
- Added Batch configuration properties

This closes #7274

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 11:00:51 -05:00
exceptionfactory 9c2f15cc18
NIFI-11680 Corrected Buffer Size Calculation for Connection Balancing (#7370)
- Resolved BufferOverflowException in PeerChannel with Bouncy Castle Provider
- Changed prepareForWrite() to use Destination Buffer remaining instead of Application Buffer Size
- Changed encrypt() to Packet Buffer Size instead of Application Buffer Size
2023-06-13 11:01:27 -04:00
Mark Payne 787e0d8261
NIFI-11681: Terminate Process Sessions before interrupting processor threads
This closes #7371

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-13 08:24:03 -05:00
Paul Grey 45e8226f89
NIFI-11672 Adjusted ListSFTP to handle incomplete File Types
- Modified file handling to include both REGULAR and UNKNOWN File Types returned from an SFTP server

This closes #7365

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-12 11:25:22 -05:00
Mark Payne 702c635034
NIFI-11670 Refactored Content Repo OutputStream to create new Claim per FlowFile
Rather than creating many FlowFiles with the same Content Claim, refactored content repos' OutputStreams and ClaimWriteCache so that a new ContentClaim is created for each FlowFile. This ensures that we have a content claim offset of 0. The poor performance was due to having to use StreamUtils.skip() in conjunction with the CipherInputStream, which would only skip a max of 511 bytes at a time. By using a separate Content Claim per FlowFile, we no longer need to seek after creating the CipherInputStream

This closes #7363

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-12 09:47:44 -05:00
exceptionfactory 7485687d4b
NIFI-11657 Removed Deprecated PutBigQueryBatch and PutBigQueryStreaming
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7351.
2023-06-11 15:49:42 +02:00
exceptionfactory 9374039312
NIFI-11674 Upgraded Apache Iceberg from 1.2.1 to 1.3.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7364.
2023-06-11 15:43:58 +02:00
mr1716 054df20aed
NIFI-11665 Upgraded oauth2-oidc-sdk from 9.43.1 to 9.43.3
This closes #7358

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-08 16:18:44 -05:00
Matt Burgess 5e6f3abdd2
NIFI-11655 Fixed float and double handling in GenerateRecord
This closes #7356

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-08 16:18:44 -05:00
exceptionfactory 4509f5de80 NIFI-11666 Added Exception to Error Log for ModifyCompression
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7360
2023-06-08 11:19:05 -04:00
Matt Burgess f3e8651522 NIFI-11647: Support UUID type in DataTypeUtils.getSQLTypeValue
This closes #7355

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-06-08 11:13:07 -04:00
Nandor Soma Abonyi 10a2815527
NIFI-11659 Removed unnecessary Jackson 1 dependencies
This closes #7354

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-07 15:04:43 -05:00
exceptionfactory 9195b586e5
NIFI-11656 Removed deprecated Azure Queue Storage Processors
- Removed AzureStorageCredentialsControllerService and related implementations
- Removed com.micrsoft.azure:azure-storage dependencies

This closes #7350

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-07 16:19:38 +02:00
siddr dd2486d3e0 NIFI-11587: Update questdb to 6.7
This closes #7319
Signed-off-by: Bence Simon <bsimon@apache.org>
2023-06-07 09:39:44 +02:00
siddr e72ca689c2
NIFI-11643 Upgraded geoip2 from 2.16.1 to 4.0.1
This closes #7341

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-06 15:31:39 -05:00
exceptionfactory 4faf3ea598
NIFI-11653 This closes #7349. Added Connection URL Validation for Database Services
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-06 09:29:48 -07:00
mr1716 d956ede743
NIFI-11649 Upgraded icu4j from 72.1 to 73.1
This closes #7346

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-06 10:42:17 -05:00
mr1716 e6c2c7c7ee
NIFI-11652 Upgraded Jolt from 0.1.7 to 0.1.8
This closes #7348

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-06 10:30:36 -05:00
exceptionfactory c5c711c91d
NIFI-11645 This closes #7342. Upgraded Guava from 31.1 to 32.0.0
- Added selective overrides to upgrade transitive dependencies

Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-05 14:33:10 -07:00
Emilio Setiadarma b11373af7b
NIFI-11549 Added AzureQueueStorage_v12 Processors
- Deprecated GetAzureQueueStorage and PutAzureQueueStorage

This closes #7269

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-05 16:26:02 -05:00
Shane Ardell 7a7f6f6229
NIFI-11593: Fix hiding logic for properties (#7339)
* NIFI-11593: fix hiding logic for properties with references or without dependent values

* NIFI-11593: remove arrow functions

Merged #7339 into main.
2023-06-05 13:36:49 -07:00
dependabot[bot] 88d7b3905b
NIFI-11644 Upgraded Hazelcast from 4.2.7 to 5.3.0
This closes #7282

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-05 14:49:22 -05:00
Matt Burgess d200186096
NIFI-11567: Auto-reload database file in GeoEnrichIP processors (#7266)
NIFI-11567: Auto-reload database file in GeoEnrichIP processors
2023-06-05 13:54:17 -04:00
Bryan Bende ce50ffbe0e
NIFI-11464 Improvements for importing nested versioned flows (#7218)
* NIFI-11464 Improvements for importing nested versioned flows
- Introduce FlowSnapshotContainer to return root snapshot + children
- Introduce ControllerServiceResolver to extract logic from service facade
- Update resolution logic to correctly consider all services in the hierarchy
- Merge additional parameter contexts and parameter providers from child to parent
- Add unit test for controller service resolver
- Replace use of emptSet/emptyMap with new set/map instance
2023-06-05 10:11:33 -04:00
Peter Turcsanyi 963518d943
NIFI-11586 Added AzureStorageCredentialsControllerServiceLookup_v12
Also added client caching in blob v_12 processors which was needed to support multiple credentials provided by the new lookup service

This closes #7300

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-06-05 13:07:02 +02:00
Peter Turcsanyi 803868935a
NIFI-11628 Fixed Object[] and Throwable argument substitution in SimpleProcessLogger
This closes #7362

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-02 14:59:07 -05:00
Mark Payne df9f8ddcfb NIFI-11636: Do not buffer Parquet content into memory unnecessarily
NIFI-11636: Change default log level from parquet internal reader to WARN as it logs excessively at INFO level

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7334
2023-06-02 15:35:10 -04:00
exceptionfactory ec525b0437
NIFI-11629 This closes #7327. Added Socket Write Timeout to InvokeHTTP
Signed-off-by: Joe Witt <joewitt@apache.org>
2023-06-02 08:04:25 -07:00
Joe Gresock 3ef4439879
NIFI-8287 Upgraded SQS Processors to use AWS SDK 2
This closes #7211

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-01 21:53:33 -05:00
Scott Aslan 7a10ba6165
[NIFI-11560] call forEach on Map (#7297)
* [NIFI-11560] call forEach on Map

* getComponentRestrictions returns Map, use forEach

This closes #7297
2023-06-01 16:13:08 -04:00
Matthew Burgess 3ebe8f2983
NIFI-11538: This closes #7239. Fix primitive type conversion for PutIceberg 2023-06-01 12:29:38 -07:00
Mark Payne 50811660d0
NIFI-11603 Refactored Socket-based tests to use Dynamic Ports
- Removed NetworkUtils methods for getting available ports
- Updated Socket-based components to support using 0 to listen on a random available port for improved test reliability

This closes #7299

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-06-01 13:33:06 -05:00
exceptionfactory b042eb01e8
NIFI-11614 Improved Validation for JndiJmsConnectionFactoryProvider
This closes #7313.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-06-01 19:53:18 +02:00
Pierre Villard d4f301f473
NIFI-11620 Upgraded Google libraries-bom from 26.12.0 to 26.15.0
This closes #7321

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:31:44 -05:00
Pierre Villard 06b49cbc32
NIFI-11619 Upgraded Azure BOM from 1.2.11 to 1.2.13
This closes #7320

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:31:04 -05:00
Mark Payne 4b7e20740e
NIFI-11591: Added additional logging for DynamicallyModifyClasspath system test
This closes #7312

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 16:23:07 -05:00
Mark Payne ac810671c5 NIFI-11621: Handle the case of CHOICE fields when inferring the type of ARRAY elements. E.g., support ARRAY<CHOICE<STRING, NULL>>
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #7322
2023-05-31 17:07:39 -04:00
Steven Matison 645618a609
NIFI-11608 Fixed Expression Language Evaluation in PutBigQuery
This closes #7316

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 14:32:01 -05:00
Bence Simon 007bf3bcec
NIFI-11596 Adjusting Swagger contract to cover RegistryClients as possible reference type for Controller Services
This closes #7295

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-31 11:02:48 -05:00
siddr b6802ffed8
NIFI-11598 Upgrade gremlin.version from 3.6.2 to 3.6.4
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7311.
2023-05-31 15:06:39 +02:00
Peter Turcsanyi 02374798d2
NIFI-11615: Logging fixes in AMQP bundle
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7314.
2023-05-31 13:03:41 +02:00
Michael Moser eca4f5d68f
NIFI-11392 for CRON scheduled components, improved cancellation of … (#7232)
NIFI-11392 for CRON scheduled components, improved cancellation of futures for thread cleanup
2023-05-30 11:09:06 -04:00
Peter Turcsanyi 3bd4b49abe NIFI-11369: Fixed Defragment strategy with optional fragment.count attribute in MergeContent 2023-05-30 16:25:28 +02:00
mr1716 bfa4b178ee NIFI-11606 Update aws-kinesis-client-library-version to 1.14.10
This closes #7307

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2023-05-29 14:07:44 -04:00
Mark Bathori cfd62c9511
NIFI-11590: Missing Enum data type handling in FlowFileTable
This closes #7294.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-26 11:08:37 +02:00
Peter Turcsanyi de62c6261f Revert "NIFI-11590: Missing Enum data type handling in FlowFileTable"
This reverts commit 4e304ac586.
2023-05-26 11:07:45 +02:00
Mark Bathori 4e304ac586
NIFI-11590: Missing Enum data type handling in FlowFileTable
This closes #7294.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-26 10:57:33 +02:00
dan-s1 d6600e67cb
NIFI-2964 Added JSON Handling Strategy property to AttributesToJSON
This closes #7231

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 15:51:02 -05:00
Mike Moser a446af8aaa
NIFI-11580 Use daemon threads in DistributedCacheClient for clean shutdown
- Added thread naming based on Component Type and Component Identifier

This closes #7281

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 14:04:20 -05:00
mr1716 4695925dd5
NIFI-11599 Upgraded json-schema-validator from 1.0.79 to 1.0.82
This closes #7293

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 13:19:37 -05:00
mr1716 8a0007a6b8
NIFI-11597 Upgraded zstd-jni from 1.5.5-1 to 1.5.5-3
This closes #7292

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-25 13:12:11 -05:00
Peter Turcsanyi e2dd9359e4
NIFI-11585: Added ADLSCredentialsControllerServiceLookup
This closes #7287

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-25 15:49:50 +02:00
mr1716 40157ae5a2
NIFI-11588 Upgraded gRPC from 1.54.1 to 1.55.1
This closes #7290

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 13:27:36 -05:00
NissimShiman a59ea4a135
NIFI-11109 Allow registry client's class in flow.xml/json to not change (#7273)
when underlying nar for nifi-flow-registry-client-nar is missing
2023-05-24 13:32:31 -04:00
Mark Payne ca2a829d47
NIFI-11584 Improved MergeContent stream handling
- Allow ProcessSession to manage its own input streams and deprecated method that reads from FlowFile without allowing it

This closes #7286

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-24 11:09:42 -05:00
Matthew Burgess adb8420b48
NIFI-11552: Support FlowFile Attributes in some PutIceberg proeprties
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7268.
2023-05-24 11:40:48 +02:00
Matthew Burgess df04c60e01
NIFI-8326: Send records as individual messages in Kafka RecordSinks
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4901.
2023-05-24 10:43:30 +02:00
exceptionfactory 3833b51764
NIFI-11583 Removed GetIgniteCache and PutIgniteCache Processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #7285.
2023-05-24 09:49:34 +02:00
Mark Payne a12c9ca9c7
NIFI-11557: Avoid using the expensive and unnecessary Files.walkFileTree on startup and initialization of Content Repository. Also performed some code cleanup: IntelliJ flagged many warnings in the class, mostly around methods that are no longer used and potential NullPointerExceptions, so those were cleaned up. Additionally, removed the nifi property for max flowfiles per claim - this property was never implemented. It was referenced, but the way in which is was used curiously had nothing to do with what the property was intended to be used for or for how it was documented. Instead, it was used to limit the max number of claims that could remain writable. As a result, it was removed.
NIFI-11557: Added an additional system test and updated github actions to include surefire-report in order to help diagnose problem that occurred in one of the last system-test runs in Github. Could not replicate problem locally
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7265
2023-05-23 14:29:29 -04:00
Bence Simon ec01bce207
NIFI-11559 Increased poll time in CollisionAwareResourceProviderWorkerTest
- Incremental adjustment avoids breaking test on slower environments

This closes #7260

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-23 10:14:39 -05:00
exceptionfactory c32bfd0557
NIFI-11568 Removed Apache DS Test Dependency
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #7264.
2023-05-21 07:17:52 -04:00
Pierre Villard a54c9915c3
NIFI-11574 Upgraded snowflake-ingest-sdk from 1.1.3 to 1.1.4
This closes #7277

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:26:58 -05:00
Pierre Villard 0e8aa5b744
NIFI-11571 Upgraded Apache SSHD from 2.9.2 to 2.10.0
This closes #7275

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 16:25:58 -05:00
mr1716 141ea044bb
NIFI-11564 Upgraded msal4j from 1.13.7 to 1.13.8
- Upgrade applies to nifi-azure-graph-authorizer

This closes #7262

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-19 10:24:23 -05:00
Mike Thomsen c473e6fa0c
NIFI-11221 Removed client configuration from AbstractMongoProcessor.
NIFI-11221 Style check fixes

NIFI-11221 Removed dead code.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7213
2023-05-19 10:53:28 -04:00
Joe Gresock 28f003d886
NIFI-11563: Allowing source connectables to be restarted on new connections in the StandardVersionedComponentSynchronizer (#7261) 2023-05-19 08:24:13 -04:00
Lehel Boér 6c70471cc6
NIFI-5151: Add UPSERT support for Apache Phoenix
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #7263
2023-05-18 15:54:08 -04:00
Lehel 1a38bf003e
NIFI-11547 Fixed DBCPConnectionPool verification
- Added unit test for AbstractDBCPConnectionPool

This closes #7249

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-17 10:51:29 -05:00
siddr 607b53504b
NIFI-11454 Upgraded commons-jexl3 from 3.2.1 to 3.3
This closes #7252

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-05-16 15:48:57 -05:00
exceptionfactory bfe4110b56
NIFI-11513 Remove deprecated NarProvider and implementations (#7222)
* NIFI-11513 Removed deprecated NarProvider and implementations

- Removed HDFSNarProvider
- Removed NiFiRegistryNarProvider
- Removed nifi-external-resource-utils module from nifi-commons
- Removed unnecessary deprecated annotations from EncryptedSchemaRepositoryRecordSerde
- Removed deprecated method from ContentRequestContext interface
- Restored NiFi Registry Provider example properties
2023-05-16 16:10:25 -04:00
Lehel 335365874a
NIFI-11535: Transfer ConnectWebsocket connection configuration FlowFile to relationships
Also moved dto and util packages under org.apache.nifi.websocket.jetty

This closes #7246.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2023-05-16 15:26:35 +02:00
Matthew Burgess 78fd7fadcd
NIFI-11380: Refactor CaptureChangeMySQL with improvements
This closes #7116

Signed-off-by: Nandor Soma Abonyi <nsabonyi@apache.org>
2023-05-16 12:12:18 +02:00