Commit Graph

10015 Commits

Author SHA1 Message Date
Ferenc Kis dca7aac9b3
NIFI-13541 [MiNiFi] Validate flow during startup
Signed-off-by: Csaba Bejan <bejan.csaba@gmail.com>

This closes #9073.
2024-07-25 07:57:54 -04:00
Bryan Bende 94f8688545
NIFI-13581 Remove Parameter Contexts and Providers in destroyFlow of NiFiSystemIT (#9110)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-24 18:51:49 -05:00
Rob Fellows 2dd7cf7f92
[NIFI-13535] - Fix: Issues selecting GitHub branch on version control screens in new UI (#9087)
* [NIFI-13535] - Fix: Issues selecting GitHub branch on version control screens in new UI

* ensure branch is provided when querying flow versions in import from registry dialog

* add branch to loadFlows call on bucketChange

This closes #9087
2024-07-24 09:28:54 -04:00
David Handermann 11fdc44fb9
NIFI-13577 Corrected null handling in Parameter Value Mapper (#9107) 2024-07-24 08:01:41 -04:00
Ferenc Kis c31fb9d373
NIFI-13568 MiNiFi Fix concurrent SAXParser issue in manifest parsing
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #9098.
2024-07-24 11:45:31 +02:00
David Handermann b0f419be2c
NIFI-13560 Changed Parameter Provider handling to avoid storing values (#9102)
- Added ParameterValueMapper for handling serialization of Parameter Values for Flow Configuration
- Added Parameter Group retrieval method for Flow Synchronizer
2024-07-23 11:31:16 -04:00
dan-s1 7c4c5ae693
NIFI-13569 Converted TestRegexDateTimeMatcher to Parameterized Test (#9099)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-23 08:10:42 -05:00
Bryan Bende 79ac0c2d89
NIFI-13570 Use NiFiProperties isHTTPSConfigured to determine if NAR Manager should use https
This closes #9100

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-22 10:58:08 -07:00
Joseph Witt bacc30b05b NIFI-13567 bump various deps
google libraries-bom 26.42.0 26.43.0
com.amazonaws 1.12.756 1.12.762
com.box 4.10.0 4.11.1
com.exceptionfactory.jagged 0.3.2 0.4.0
com.fasterxml.jackson.core 2.17.1 2.17.2
com.fasterxml.jackson.dataformat 2.17.1 2.17.2
com.fasterxml.jackson.datatype 2.17.1 2.17.2
com.fasterxml.jackson.jakarta.rs 2.17.1 2.17.2
com.fasterxml.jackson.jaxrs 2.17.1 2.17.2
com.fasterxml.jackson.jr 2.17.1 2.17.2
com.fasterxml.jackson.module 2.17.1 2.17.2
com.github.pjfanning 4.3.1 4.4.0
com.h2database 2.2.224 2.3.230
com.networknt 1.4.2 1.5.0
commons-codec 1.17.0 1.17.1
io.netty 4.1.111.Final 4.1.112.Final
io.projectreactor.netty 1.1.20 1.1.21
net.sf.saxon Saxon-HE 12.4 12.5
org.apache.commons commons-lang3 3.14.0 3.15.0
org.elasticsearch.client 8.14.2 8.14.3
org.jetbrains.kotlin 1.9.24 1.9.25
org.jsoup 1.17.2 1.18.1
org.springframework 6.1.10 6.1.11
org.testcontainers 1.19.8 1.20.0
software.amazon.awssdk 2.26.15 2.26.21
com.github.docker-java 3.3.6 3.4.0
google-api-services-drive v3-rev20240521-2.0.0	 v3-rev20240628-2.0.0
com.slack.api bolt-socket-mode 1.40.2 1.40.3
wire-schema-jvm 4.9.9 5.0.0
io.projectreactor reactor-core/test 3.6.7 3.6.8
net.datafaker 2.3.0 2.3.1
org.flywaydb 10.15.2 10.16.0
org.jline 3.26.2 3.26.3
org.mariadb.jdbc 3.4.0 3.4.1
org.springframework.boot 3.3.1 3.3.2
org.springframework.integration 6.3.1 6.3.2
org.springframework.retry 2.0.6 2.0.7

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9097
2024-07-22 13:39:17 -04:00
Bryan Bende 0e422f0ea3 NIFI-13566 Catch Throwable during JettyServer start to ensure any issue during start will exit
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9101
2024-07-22 13:00:50 -04:00
Mark Payne 6dd83b7034 NIFI-13563: Updated Provenance Repository so that instead of returning the single latest event for a component, we return the events from the latest invocation / session. Added system tests to verify the behavior. Also, when replaying latest event, attempt all of those events until one succeeds or all fail
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #9095
2024-07-22 12:44:35 -04:00
dan-s1 f50fce5344
NIFI-13565 Updated Record Date Time Properties to mention DateTimeFormatter
This closes #9096

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-19 17:00:50 -05:00
dan-s1 059a3b7745
NIFI-13557 Corrected Date Time Matcher to support single digit months
This closes #9094

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-19 16:59:14 -05:00
David Handermann 36b9edd862
NIFI-13561 Enabled Jira Automatic Linking in GitHub (#9092) 2024-07-19 10:20:48 -04:00
David Handermann e72b099887
NIFI-13559 Removed Legacy Access Resource REST Methods (#9091)
- Removed GET /access for Access Status
- Removed GET /access/config for Login Configuration
- Removed GET /access/token/expiration for Access Token Expiration
2024-07-19 09:15:19 -04:00
Ferenc Erdei ee7a905c40
NIFI-13551 Fixed framework SSLContext loading for Headless Server
- Changed conditional from evaluating HTTPS port to evaluating store path and password properties

This closes #9083

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-18 12:44:00 -05:00
David Handermann e35cbbba81
NIFI-13558 Configured Web Security to ignore unauthenticated requests (#9090)
This closes #9090
2024-07-18 13:26:26 -04:00
Bryan Bende 16c9ea4f7c
NIFI-13536 Added branch parameter to REST methods for listing buckets and flows
This closes #9071

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-18 08:39:58 -05:00
Scott Aslan e205f27f89
[NIFI-13539] upgrade to angular 18.0.7 (#9072)
* [NIFI-13539] upgrade to angular 18.0.7

* update deps

* update package-lock.json

* rebase and address review feedback

* remove unused dev dep

This closes #9072
2024-07-18 08:38:38 -04:00
Scott Aslan 634d914889
[NIFI-13471] make theme file path configurable during maven build (#9020)
* [NIFI-13471] make theme file path configurable during maven build

* address review feedback

This closes #9020
2024-07-17 17:25:02 -04:00
Matt Gilman ca227c7cd0
NIFI-13552 - Ensure errors from Provenance and Lineage queries are shown. (#9088)
This closes #9088
2024-07-17 16:25:14 -04:00
Bryan Bende 8e5cf99cd7
NIFI-13556 Fixed logic for identifying components from uploaded NAR
- Return copied set of Extensions from ExtensionManager to avoid concurrent modification

This closes #9089

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-17 13:51:22 -05:00
Mark Payne 0e7e511aec
NIFI-13546 Fixed Content Repository recovery when archive directories are missing
Ensure on startup that Content Repo archive directories are created, if configured to do so, rather than creating them on demand. If IOException thrown when archiving file, delete it instead. Cleaned up some code duplication between remove(ResourceClaim) and archive(ResourceClaim) methods

This closes #9079

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-17 12:39:19 -05:00
Mark Bathori 36fb6f109f NIFI-13528: fixed Python processor's customValidate function
This closes #9061.

Signed-off-by: Peter Gyori <pgyori@apache.org>
2024-07-16 18:05:33 +02:00
dan-s1 1ff5ebd6fc
NIFI-13550 Added documentation about the ExcelReader Starting Row Strategy
This closes #9082

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-15 15:33:49 -05:00
Mark Bathori 730b9c693e
NIFI-13542 Added missing Max String Length property for JSON Readers
This closes #9074

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-15 15:05:35 -05:00
Bryan Bende 76a23d921f
NIFI-13545 Improve BootstrapListener getClusterStatus to handle factory being null
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9078.
2024-07-15 21:33:24 +07:00
dan-s1 a424c0eac3
NIFI-12491 Added Starting Row Schema Strategy to ExcelReader
This closes #9064

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-13 15:17:03 -05:00
Scott Aslan 380ce0eb20
[NIFI-13519] allow user to choose to enable, disable, or use device s… (#9076)
* [NIFI-13519] allow user to choose to enable, disable, or use device settings for animations

* address review feedback

This closes #9076
2024-07-12 20:04:06 -04:00
Mike Moser 3c7b262619
NIFI-13159 Moved Remote Delete after Put for PutFTP/PutSFTP REPLACE Strategy
This closes #8914

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-12 15:14:31 -05:00
Bryan Bende b5b61d960c
NIFI-13344 Implemented backend for uploading and managing custom NARs
- Add NarPersistenceProvider to framework API with standard implementation
- Add NarManager to orchestrate interactions with the persistence provider and framework
- Add REST API for upload, download, list, and delete of custom NARs
- Add CLI commands for call these REST APIs
- Implement an upload request replicator for replicating a file upload across the cluster
- Update ExtensionManager, NarLoader, and JettyServer to support unloading a NAR
- Add ability to replace a NAR in place by unloading components, loading new NAR, and reloading components
- Add system tests for uploading a NAR and verifying other APIs
- Add NAR digest to NarNode and summary DTO, fix bug in digest utils
- Sync NARs from cluster coordinator when joining the cluster

This closes #9017

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-12 09:02:25 -05:00
Matt Gilman 1437a2dcef
NIFI-13480: (#9077)
- Taking the user to the Parameter Context dialog from the Parameters context menu on the canvas.

This closes #9077
2024-07-12 00:20:37 -05:00
Matt Gilman 8f85b58dc5
NIFI-13477: (#9075)
- Refreshing the controller service listing after creation or deletion to ensure allowable values of other services is accurate.

This closes #9075
2024-07-11 23:51:22 -05:00
Bryan Bende cbdabccd6b
NIFI-13485 Use readBlob when reading content in GitHubRepositoryClient
- The readBlob method avoids issues with 1 MB limits on alternative getContent requests

This closes #9067

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-11 09:32:47 -05:00
EndzeitBegins 3b2120e6c6 NIFI-13537 Do not include exception details in FlowFile attributes in DeleteFile
This closes #9069

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-07-10 21:48:11 -04:00
Scott Aslan cd7559cdc8
[NIFI-13469] add attributes to jolt ui (#9028)
* [NIFI-13469] add attributes to jolt ui

* fix unit tests

* expansion panel styles and adding comments and organizing global styles

* Update nifi-frontend/src/main/frontend/apps/nifi-jolt-transform-ui/src/app/pages/jolt-transform-json-ui/feature/jolt-transform-json-ui.component.ts

Co-authored-by: Matt Gilman <matt.c.gilman@gmail.com>

* Update nifi-frontend/src/main/frontend/apps/nifi-jolt-transform-ui/src/app/pages/jolt-transform-json-ui/feature/jolt-transform-json-ui.component.ts

Co-authored-by: Matt Gilman <matt.c.gilman@gmail.com>

---------

Co-authored-by: Matt Gilman <matt.c.gilman@gmail.com>

This closes #9028
2024-07-10 15:45:06 -04:00
Mark Payne f338215851
NIFI-13529 Set Calcite Connection timeZone to UTC for Records
Calcite adjusts Timestamp objects returned from a Result Set based on the configured Time Zone Offset in an attempt to localize the results. Framework use of Calcite for Record processing expects input Timestamp values to remain unchanged, so setting the timeZone property to UTC with an offset of 0 effectively avoids this Calcite localization.

This closes #9066

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-09 13:47:27 -05:00
Scott Aslan 5193436a53
[NIFI-13492] fa-info-circle icon apply primary color (#9062)
This closes #9062
2024-07-09 08:37:54 -04:00
dan-s1 90c58a88a7
NIFI-13418 Updated ExcelReader to handle spreadsheets with shared formulas
This closes #9063

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 16:18:27 -05:00
Joseph Witt 3f6eb6ff63
NIFI-13527 Corrected various grammar issues in comments and docs
This closes #9060

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 13:45:21 -05:00
Joseph Witt f92d8f72a8
NIFI-13526 Removed unused variables and localized nifi-socket-utils
- Remove nifi-socket-utils and moved remaining classes to referencing framework components

This closes #9059

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-08 13:44:42 -05:00
Matt Gilman 58b2af9a6e
NIFI-13523: (#9056)
- Refreshing the controller service listing after creation or deletion to ensure allowable values of other services is accurate.

This closes #9056
2024-07-08 12:34:51 -05:00
exceptionfactory 4006cb7849
NIFI-13510 Removed KerberosCredentialsService and implementations
- Removed nifi-kerberos-credentials-service-api and NAR
- Removed individual Kerberos credentials properties
- Removed NIFI_ALLOW_EXPLICIT_KEYTAB from nifi-env.sh
- Removed unused references to NiFi Properties in tests
This closes #9058

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-08 11:52:33 -04:00
tpalfy 057e02e698
NIFI-13484 Fix HBase_2_ClientService.getResults methods, so they properly return a single row when startRow and endRow/stopRow are the same.
This closes #9029.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-07-08 17:20:35 +02:00
Scott Aslan f5476ca3b4
[NIFI-13492] fa-info-circle icon apply primary color (#9036)
This closes #9036
2024-07-08 09:30:30 -04:00
exceptionfactory 62c66a12d1
NIFI-13525 Removed unused classes from nifi-security-crypto-key
This closes #9057

- Removed Derived Key Parameter Reader and implementations
- Removed bcrypt and scrypt Derived Key Providers
- Removed unused dependency from nifi-cipher-processors

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-06 09:33:32 -07:00
dan-s1 b2840bd851
NIFI-13466 Catch IllegalStateException in SplitExcel
This closes #9033

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 10:04:47 -05:00
Joseph Witt 15e5193099
NIFI-13517 Upgraded Jetty from 12.0.10 to 12.0.11 and others
- Upgraded AWS SDK 1 from 1.12.755 to 1.12.756
- Upgraded AWS SDK 2 from 2.26.14 to 2.26.15
- Upgraded Azure SDK BOM from 1.2.24 to 1.2.25
- Upgraded Elasticsearch Client from 8.14.1 to 8.14.2
- Upgraded GitHub Client from 1.322 to 1.323
- Upgraded mysql-connector-j from 8.4.0 to 9.0.0
- Upgraded Azure Kusto from 5.0.5 to 5.1.0
- Upgraded Datafaker from 2.2.2 to 2.3.0
- Upgraded nimbus-jose-jwt from 9.37.3 to 9.40
- Upgraded oauth2-oidc-sdk from 11.10.1 to 11.13

This closes #9051

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 10:00:13 -05:00
Joseph Witt 6783420897
NIFI-13513 Removed ListenSMTP
This closes #9047

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:51:18 -05:00
Joseph Witt f1fb106bf8
NIFI-13509 Removed ListenTCPRecord, ListenRELP and others
- Removed ConvertJSONToSql
- Removed ParseCEF
- Removed nifi-security-socket-ssl
- Removed Socket Dispatcher Reader classes

This closes #9045

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:50:03 -05:00