Commit Graph

10085 Commits

Author SHA1 Message Date
Bryan Bende b5b61d960c
NIFI-13344 Implemented backend for uploading and managing custom NARs
- Add NarPersistenceProvider to framework API with standard implementation
- Add NarManager to orchestrate interactions with the persistence provider and framework
- Add REST API for upload, download, list, and delete of custom NARs
- Add CLI commands for call these REST APIs
- Implement an upload request replicator for replicating a file upload across the cluster
- Update ExtensionManager, NarLoader, and JettyServer to support unloading a NAR
- Add ability to replace a NAR in place by unloading components, loading new NAR, and reloading components
- Add system tests for uploading a NAR and verifying other APIs
- Add NAR digest to NarNode and summary DTO, fix bug in digest utils
- Sync NARs from cluster coordinator when joining the cluster

This closes #9017

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-12 09:02:25 -05:00
Matt Gilman 1437a2dcef
NIFI-13480: (#9077)
- Taking the user to the Parameter Context dialog from the Parameters context menu on the canvas.

This closes #9077
2024-07-12 00:20:37 -05:00
Matt Gilman 8f85b58dc5
NIFI-13477: (#9075)
- Refreshing the controller service listing after creation or deletion to ensure allowable values of other services is accurate.

This closes #9075
2024-07-11 23:51:22 -05:00
Bryan Bende cbdabccd6b
NIFI-13485 Use readBlob when reading content in GitHubRepositoryClient
- The readBlob method avoids issues with 1 MB limits on alternative getContent requests

This closes #9067

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-11 09:32:47 -05:00
EndzeitBegins 3b2120e6c6 NIFI-13537 Do not include exception details in FlowFile attributes in DeleteFile
This closes #9069

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-07-10 21:48:11 -04:00
Scott Aslan cd7559cdc8
[NIFI-13469] add attributes to jolt ui (#9028)
* [NIFI-13469] add attributes to jolt ui

* fix unit tests

* expansion panel styles and adding comments and organizing global styles

* Update nifi-frontend/src/main/frontend/apps/nifi-jolt-transform-ui/src/app/pages/jolt-transform-json-ui/feature/jolt-transform-json-ui.component.ts

Co-authored-by: Matt Gilman <matt.c.gilman@gmail.com>

* Update nifi-frontend/src/main/frontend/apps/nifi-jolt-transform-ui/src/app/pages/jolt-transform-json-ui/feature/jolt-transform-json-ui.component.ts

Co-authored-by: Matt Gilman <matt.c.gilman@gmail.com>

---------

Co-authored-by: Matt Gilman <matt.c.gilman@gmail.com>

This closes #9028
2024-07-10 15:45:06 -04:00
Mark Payne f338215851
NIFI-13529 Set Calcite Connection timeZone to UTC for Records
Calcite adjusts Timestamp objects returned from a Result Set based on the configured Time Zone Offset in an attempt to localize the results. Framework use of Calcite for Record processing expects input Timestamp values to remain unchanged, so setting the timeZone property to UTC with an offset of 0 effectively avoids this Calcite localization.

This closes #9066

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-09 13:47:27 -05:00
Scott Aslan 5193436a53
[NIFI-13492] fa-info-circle icon apply primary color (#9062)
This closes #9062
2024-07-09 08:37:54 -04:00
dan-s1 90c58a88a7
NIFI-13418 Updated ExcelReader to handle spreadsheets with shared formulas
This closes #9063

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 16:18:27 -05:00
Joseph Witt 3f6eb6ff63
NIFI-13527 Corrected various grammar issues in comments and docs
This closes #9060

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 13:45:21 -05:00
Joseph Witt f92d8f72a8
NIFI-13526 Removed unused variables and localized nifi-socket-utils
- Remove nifi-socket-utils and moved remaining classes to referencing framework components

This closes #9059

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 13:44:42 -05:00
Matt Gilman 58b2af9a6e
NIFI-13523: (#9056)
- Refreshing the controller service listing after creation or deletion to ensure allowable values of other services is accurate.

This closes #9056
2024-07-08 12:34:51 -05:00
exceptionfactory 4006cb7849
NIFI-13510 Removed KerberosCredentialsService and implementations
- Removed nifi-kerberos-credentials-service-api and NAR
- Removed individual Kerberos credentials properties
- Removed NIFI_ALLOW_EXPLICIT_KEYTAB from nifi-env.sh
- Removed unused references to NiFi Properties in tests
This closes #9058

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-08 11:52:33 -04:00
tpalfy 057e02e698
NIFI-13484 Fix HBase_2_ClientService.getResults methods, so they properly return a single row when startRow and endRow/stopRow are the same.
This closes #9029.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-07-08 17:20:35 +02:00
Scott Aslan f5476ca3b4
[NIFI-13492] fa-info-circle icon apply primary color (#9036)
This closes #9036
2024-07-08 09:30:30 -04:00
exceptionfactory 62c66a12d1
NIFI-13525 Removed unused classes from nifi-security-crypto-key
This closes #9057

- Removed Derived Key Parameter Reader and implementations
- Removed bcrypt and scrypt Derived Key Providers
- Removed unused dependency from nifi-cipher-processors

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-06 09:33:32 -07:00
dan-s1 b2840bd851
NIFI-13466 Catch IllegalStateException in SplitExcel
This closes #9033

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 10:04:47 -05:00
Joseph Witt 15e5193099
NIFI-13517 Upgraded Jetty from 12.0.10 to 12.0.11 and others
- Upgraded AWS SDK 1 from 1.12.755 to 1.12.756
- Upgraded AWS SDK 2 from 2.26.14 to 2.26.15
- Upgraded Azure SDK BOM from 1.2.24 to 1.2.25
- Upgraded Elasticsearch Client from 8.14.1 to 8.14.2
- Upgraded GitHub Client from 1.322 to 1.323
- Upgraded mysql-connector-j from 8.4.0 to 9.0.0
- Upgraded Azure Kusto from 5.0.5 to 5.1.0
- Upgraded Datafaker from 2.2.2 to 2.3.0
- Upgraded nimbus-jose-jwt from 9.37.3 to 9.40
- Upgraded oauth2-oidc-sdk from 11.10.1 to 11.13

This closes #9051

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 10:00:13 -05:00
Joseph Witt 6783420897
NIFI-13513 Removed ListenSMTP
This closes #9047

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:51:18 -05:00
Joseph Witt f1fb106bf8
NIFI-13509 Removed ListenTCPRecord, ListenRELP and others
- Removed ConvertJSONToSql
- Removed ParseCEF
- Removed nifi-security-socket-ssl
- Removed Socket Dispatcher Reader classes

This closes #9045

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:50:03 -05:00
Joseph Witt 4ff70dd233
NIFI-13507 Removed nifi-prometheus-bundle
- Removed StandardGangliaReporter
- Removed PrometheusReportingTask
- Removed PrometheusRecordSink

This closes #9044

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:48:01 -05:00
Joseph Witt 396c8450d0
NIFI-13505 Removed QueryDNS and QueryWhois
This closes #9043

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:46:21 -05:00
Joseph Witt b2f19aa0a8
NIFI-13501 Removed DecryptContent and DecryptContentCompatibility
This closes #9041

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:45:36 -05:00
exceptionfactory 7cb6684801
NIFI-13494 Removed support for Repository Encryption
This closes #9039

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-05 13:48:40 -07:00
exceptionfactory 449ada0863
NIFI-13489 Removed Kafka 2.6 Processors
This closes #9034

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-05 13:42:35 -07:00
exceptionfactory eb154d0640
NIFI-13518 Removed duplicative Windows start scripts
This closes #9052

- Removed run-nifi.bat in favor of nifi.cmd

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-05 13:41:20 -07:00
exceptionfactory dd71fa35ac
NIFI-13521 Removed nifi-headless-server-nar
This closes #9053

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-05 13:38:53 -07:00
Joseph Witt 89741f6160
NIFI-13516 Removed YandexTranslate and nifi-language-translation-nar
This closes #9049

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-05 14:26:08 -05:00
Joseph Witt 1d2b755edf
NIFI-13511 Removed ShellUserGroupProvider from NiFi and Registry
This closes #9046

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-05 11:24:31 -05:00
Joseph Witt b1da7322e8
NIFI-13515 Removed PutKudu and nifi-kudu-bundle
This closes #9048

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-05 11:22:44 -05:00
Joseph Witt ad7375a3be
NIFI-13503 Removed ExtractTNEFAttachments from nifi-email-processors
This closes #9042

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-05 11:20:12 -05:00
Joseph Witt db6bac21bf
NIFI-13499 Removed ListenBeats and nifi-beats-bundle
This closes #9040

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-05 11:18:28 -05:00
Scott Aslan bd80506e89
[NIFI-13472] update Alignment/spacing issues (#9022)
This closes #9022
2024-07-05 10:09:04 -04:00
Peter Turcsanyi f57a96dbfb
NIFI-13496 Included Hadoop configuration file paths in the classloader isolation key of HDFS processors
Signed-off-by: Mark Bathori <mbathori@apache.org>

This closes #9038
2024-07-05 13:52:17 +02:00
Krisztina Zsihovszki c73d1cf634
NIFI-13487 ConsumeKinesisStream initial stream position handling error after AWS SDK 2.x migration
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #9035.
2024-07-04 06:03:06 -04:00
exceptionfactory e4014b5525
NIFI-13493 Removed dependency-check GitHub workflow
This closes #9037

- Upgraded dependency-check plugin from 9.1.0 to 10.0.1

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-03 16:27:05 -07:00
Joseph Witt 5f2ae3db3d
NIFI-13490 Upgraded AWS SDK to 2.26.14 and other dependencies (#9032)
- Upgraded AWS SDK 1 from 1.12.748 to 1.12.755
- Upgraded AWS SDK 2 from 2.26.8 to 2.26.14
- Upgraded Google Libraries BOM from 26.40.0 to 26.42.0
- Upgraded Fabric8 Kubernetes Client from 6.13.0 to 6.13.1
- Upgraded Groovy from 4.0.21 to 4.0.22
- Upgraded Lucene from 9.11.0 to 9.11.1
- Upgraded org.checkerframework from 3.44.0 to 3.45.0
- Upgraded org.junit.jupiter from 5.10.2 to 5.10.3
- Upgraded org.junit.platform from 1.10.2 to 1.10.3
- Upgraded org.junit.vintage from 5.10.2 to 5.10.3
- Upgraded Mockito from 5.11.0 to 5.12.0
- Upgraded com.slack.api from 1.40.0 to 1.40.2
- Upgraded org.apache.iotdb from 1.3.1 to 1.3.2
- Upgraded org.apache.kafka from 3.7.0 to 3.7.1
- Upgraded org.flywaydb from 10.15.0 to 1.15.2
- Upgraded org.neo4j.driver from 5.21.0 to 5.22.0

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-03 15:35:17 -05:00
exceptionfactory 6d6d4a8904
NIFI-13488 Upgraded Apache POI from 5.2.5 to 5.3.0
This closes #9031

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-03 10:22:13 -07:00
Scott Aslan 66f403bd0f
[NIFI-13483] use primary contrast color for active thread count icon and text on primary surfaces (#9030)
This closes #9030
2024-07-03 13:18:30 -04:00
Matt Burgess 239b9362f4
NIFI-13465: Fix NPE in QueryNiFiReportingTask when analytics tables are queried without analytics enabled
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9016.
2024-07-03 11:53:25 +02:00
Scott Aslan 229364fc31
[NIFI-13483] update active thread count colors for PG and RPG (#9027)
* [NIFI-13483] update active thread count colors for PG and RPG

* address review feedback

This closes #9027
2024-07-02 17:36:23 -04:00
Mark Bathori fd6e62bdd2 NIFI-13478: Protobuf Reader fails to coerce type of repeated fields
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9024
2024-07-02 15:38:39 -04:00
Matt Gilman 715989d48c
NIFI-13479: (#9026)
- Remove unnecessary imports which was impacting the ability to use EL and Parameter autocomplete.

This closes #9026
2024-07-02 13:19:02 -06:00
David Handermann 3bb79f1ba6
NIFI-13476 Optimized Authorization Checking in Process Group Status (#9021)
- Avoided invoking Authorizer when nested component is not included in Process Group Status based on depth of recursion
2024-07-01 14:58:22 -04:00
Ferenc Erdei 903090b649
NIFI-13436 Retain queue for non-modified connections during MiNiFi flow update
This closes #8998.

Signed-off-by: Ferenc Kis <briansolo1985@gmail.com>
2024-06-28 08:40:23 +02:00
Peter Gyori 3efb0763da
NIFI-13427 Added FlowFileSource interface for Python Processors
This closes #9000

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-27 12:35:31 -05:00
Joe Gresock b105b5bbef
NIFI-13454 Renamed FileParameterProvider to KubernetesSecretParameterProvider
This closes #9008

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-27 08:36:44 -05:00
dan-s1 5c9fb448a4
NIFI-13456 Removed unused code from TestSplitExcel
This closes #9009

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-26 17:46:08 -05:00
mr1716 2066d6ebc5
NIFI-13451 Upgraded error_prone_annotations from 2.21.1 to 2.28.0
This closes #9006

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-26 17:45:01 -05:00
Ferenc Erdei 212dd94f90
NIFI-13450 Regenerate MiNiFi Agent Manifest between Heartbeats
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #9005
2024-06-26 17:18:35 -04:00