Commit Graph

10385 Commits

Author SHA1 Message Date
lehelb 81ba02f785 NIFI-14100: Add option to sequential download of dependencies for Python processors 2024-12-20 14:49:17 +01:00
Rob Fellows df793ce14e
[NIFI-13977] - Updated Copy/Paste in UI to align with new backend API (#9536)
* [NIFI-13977] - Updated Copy/Paste in UI to align with new backend API
* center pasted elements on screen. zoom out to fit them if needed
* offset pasted components if the originally copied content is still in view

* copy using ClipboardItem to support Safari. other review concerns addressed. added some minor positioning fixes as well.

* copy using ClipboardItem to support Safari. other review concerns addressed. added some minor positioning fixes as well.

* remove commented out code

* Offset paste to center if it would overlap a prior paste of that content

This closes #9536
2024-12-03 16:57:04 -05:00
NissimShiman 39aa106943
NIFI-14016 Resolved issue for onPropertyModified() where oldValue was always null (#9560)
NIFI-14016 Resolved issue for onPropertyModified() where oldValue was always null (#9560)
2024-12-03 10:34:09 -05:00
dan-s1 82fe051413
NIFI-13996 Improved removal of temporary files after a build (#9551)
Signed-off-by: David Handerman <exceptionfactory@apache.org>
Co-authored-by: David Handermann <exceptionfactory@apache.org>
2024-12-02 17:39:31 -06:00
Joseph Witt 1c9f083682
NIFI-14056 bumped box, aws, com.fasterxml, and many other dependencies
- com.amazonaws 1.12.778 1.12.779
- box-java-sdk 4.12.0 4.13.1
- <changed com.fasterxml.jackson bom>
  com.fasterxml.jackson.core 2.18.1 2.18.2
  com.fasterxml.jackson.dataformat  2.18.1 2.18.2
  com.fasterxml.jackson.datatype	 2.18.1 2.18.2
  com.fasterxml.jackson.jakarta.rs 2.18.1 2.18.2
  com.fasterxml.jackson.jaxrs 2.18.1 2.18.2
  com.fasterxml.jackson.jr 2.18.1 2.18.2
  com.fasterxml.jackson.module 2.18.1 2.18.2
- com.networknt	json-schema-validator 1.5.2 1.5.4
- com.nimbusds	nimbus-jose-jwt 9.42 9.47
- io.dropwizard.metrics	metrics-core 4.2.28 4.2.29
- io.projectreactor.netty	reactor-netty-http 1.1.23 1.1.24	1.2.0
- software.amazon.awssdk 2.29.22 2.29.23
- com.google.apis	google-api-services-drive	v3-rev20240914-2.0.0	v3-rev20241027-2.0.0
- com.icegreen 2.1.1 2.1.2
- com.rabbitmq	amqp-client	5.22.0	5.23.0
- io.projectreactor 3.6.11 3.7.0
- org.apache.activemq 6.1.3 6.1.4
- org.apache.parquet	1.14.3 1.14.4
- org.flywaydb	10.20.1 11.0.0
- org.gitlab4j	6.0.0-rc.6 6.0.0-rc.7
- org.mariadb.jdbc 3.5.0 3.5.1
- org.neo4j.driver 5.26.3 5.27.0
- org.springframework.boot 3.3.5 3.3.6

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9559.
2024-12-02 11:03:54 +01:00
Pierre Villard 452ddbbec5 NIFI-14050 - Dependency housekeeping - Spring Security, AWS, commons-io, Elastic, Mongo, Neo4J, Redis
This closes #9556

- AWS SDK v1 from 1.2.778 to 1.12.779
- AWS SDK v2 from 2.29.15 to 2.29.22
- ZSTD from 1.5.6-7 to 1.5.6-8
- commons-io from 2.17.0 to 2.18.0
- Test containers from 1.20.3 to 1.20.4
- log4j from 2.24.1 to 2.24.2
- Spring Security from 6.4.0 to 6.4.1
- jsoup from 1.18.1 to 1.18.2
- metrics-jvm and metrics-core from 4.2.28 to 4.2.29
- elasticsearch client from 8.15.3 to 8.16.1
- Spring integration from 6.3.5 to 6.4.0
- greenmail from 2.0.1 to 2.1.1
- gremlin from 3.7.2 to 3.7.3
- janusgraph from 1.0.0 to 1.2.0-20241120
- amqp client from 5.22.0 to 5.23.0
- neo4j driver from 5.26.0 to 5.26.3
- mongodb driver from 4.11.4 to 4.11.5
- jackson-datatype-protobuf from 0.9.16 to 0.9.17
- Redis from 3.3.5 to 3.4.0
- Slack bolt from 1.44.1 to 1.44.2
- Spring boot from 3.3.5 to 3.4.0
- datafaker from 2.4.1 to 2.4.2
- Spring retry from 2.0.9 to 2.0.10
- Kotlin from 2.0.21 to 2.1.0

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-12-01 17:09:17 -07:00
David Handermann 3214e9163c
NIFI-14049 Added PEM-Encoded SSLContextProvider (#9555)
Signed-off-by: Lucas Ottersbach <ottersbach@apache.org>
2024-12-01 11:20:26 +01:00
David Handermann de9042bb19
NIFI-14052 Removed non-deterministic build properties (#9558)
- Removed Maven and Java Home properties from Runtime Manifest build
- Removed Built-By and Build-Os-Version properties from Runtime Manifest
- Disabled JAXB episode file generation
- Enabled output sorting for Swagger specification

Signed-off-by: Lucas Ottersbach <ottersbach@apache.org>
2024-11-30 20:47:20 +01:00
Lucas 2199d64298
NIFI-14043 Add support for keySet in HazelcastMapCacheClient (#9553)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-25 08:29:02 -06:00
Pierre Villard cfa495b64d
NIFI-14041 Improved MockPropertyValue and EL evaluation validation (#9549)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-25 08:14:29 -06:00
dan-s1 134240c51c
NIFI-14036 Improved Description of SplitExcel regarding Formulas (#9552)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-22 15:18:57 -06:00
Matt Gilman f744deebf9
NIFI-13976 Added REST Endpoints for Copying and Pasting Flows (#9535)
- Including the revision for the current Process Group in the flow response.
- Introduce a method propose built for adding new versioned components to an existing Process Group.
- Updating the paste response payload to only include the entities for the components that were just added.
- Always generating new IDs when copying components.
- Creating an ID for the copy action.
- Code clean up.
- Mapping IDs on paste to ensure connections are created correctly.
- Authorizing any components whose instance IDs are specified.
- Copying any sensitive properties from copied instances when pasting.
- Fixing mapping of copy response to ensure that nested Controller Services can be referenced.
- Including external Controller Services in copy response to they can be resolved on paste.
- Excluding unreferenced services from copy response.
- Including property descriptors to allow external services to resolve when pasting.
- Including Parameters and Parameter Providers in copy response.
- Fixing issue returning unreferenced services in the current process group.
- Reverting changes building up external service references.
- Only including external services that are references by the copy selection.
- Adding some additional test coverage.
- Adding consideration for the current ids in the paste id mapping.
- Adding an endpoint response merger for the paste endpoint.
- Including version control information in copy response.
- Being more lenient when pasting unknown registry clients.
- Ensuring groups IDs are mapped correctly when and when not versioned.
- Including registry client id in vci of versioned process groups.
- Updating copy/paste logic in existing system tests to leverage new endpoints.
- Restoring originally proposed port name if possible.
- Allow ports to be pasted into the root group.
- Fixing authorization issue when pasting a flow containing Parameter Providers.
- Fixing issue when authorizing exporting a Flow that contains a Process Group bound to a Parameter Context.
- Introducing some Copy/Paste system tests.
- Adding system tests for verify various copy paste functionality.
- Ensuring appropriate access around Parameter Providers following resolution based on locally available Parameter Providers.
- Ensuring user has access to controller services directly referenced.
- Fixing NPE in log message of Parameter Context.
- Adding more copy/paste system tests.
- Moving copy/paste version tests into the CopyPasteIT.
- Fixing unit test mocking.
- Include service authorization based on versioned component id since it may resolve during synchronization.
- Skipping properties with no values when resolving service identifiers.

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-22 15:11:29 -06:00
exceptionfactory d07b363fb0
NIFI-14027 Added SSLContextProvider Controller Service Interface
- Updated SSLContextService to extend SSLContextProvider
- Updated Processors and Controller Services to use SSLContextProvider where supported

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9537.
2024-11-21 14:23:25 +01:00
NissimShiman aa3a7c05ad
NIFI-13491 Added Response Header Request Attributes Prefix to InvokeHTTP (#9507)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-20 21:03:37 -06:00
Matt Gilman b421ccad21
NIFI-14031: Ensuring all Parameter Contexts are added when Editing a … (#9539)
* NIFI-14031: Ensuring all Parameter Contexts are added when Editing a Process Group. For contexts the user lacks access to will be added as disabled options.

* NIFI-14031: Addressing review feedback allowing the currently selected value to be reselected even when the user lacks permissions because the back end skips the check when the value isn't changing.

* NIFI-14031: Fixing PropertyItem instances in unit tests.

This closes #9539
2024-11-20 17:13:31 -05:00
Rob Fellows 685f5712b7
[NIFI-14033] - Disable links to referencing components while saving. (#9543)
This closes #9543
2024-11-20 15:43:59 -05:00
Rob Fellows c12c5fbd53
[NIFI-14038] - Add quick-copy to component-context component when it displays the id (#9546)
* [NIFI-14038] - Add quick-copy to component-context component when it displays the id

* npm audit fix - cross-spawn vulnerability

This closes #9546
2024-11-20 15:27:44 -05:00
Rob Fellows 3ab426072d
[NIFI-14032] - Format Core Load Average in Cluster system table to 2 decimal places. (#9541)
This closes #9541
2024-11-20 15:21:50 -05:00
Rob Fellows a760f0a8ee
[NIFI-14030] - Add an icon for Parameters and Parameter Contexts menu items (#9540)
This closes #9540
2024-11-20 14:17:55 -05:00
Rob Fellows bac6300e95
[NIFI-14024] - Improve Bulletin ToolTip (#9534)
This closes #9534
2024-11-20 13:50:34 -05:00
exceptionfactory a3f4f7b964
NIFI-14025 Corrected LDAP Provider Trust Store Configuration
- Fixed LDAP Provider support for configuring a Trust Store without a Key Store

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9544.
2024-11-20 12:19:32 +01:00
exceptionfactory e327dcdd21
NIFI-14035 Upgraded Spring Security from 6.3.4 to 6.4.0
- Upgraded OpenSAML from 4.3.2 to 5.1.3
- Upgraded Nimbus JOSE JWT from 9.42 to 9.47
- Upgraded Santuario from 2.3.4 to 4.0.3
- Updated OpenSAML 4 references to OpenSAML 5
- Added OIDC RestClient Bean and updated references based on deprecation warnings

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9545.
2024-11-20 11:39:43 +01:00
dependabot[bot] 90f6fd06fb
NIFI-14034 Upgraded Kafka Clients from 3.6.2 to 3.9.0 for AWS Kinesis
Signed-off-by: David Handermann <exceptionfactory@apache.org>
Co-authored-by: David Handermannn <exceptionfactory@apache.org>
2024-11-19 22:15:38 -06:00
David Handermann e33cbe6df5
NIFI-14001 Added Framework Support for PEM Keys and Certificates (#9517) 2024-11-19 11:38:15 -05:00
Pierre Villard 6f941bd622
NIFI-13905 CLI - Support Setting Properties for new Registry Clients (#9472)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-19 10:32:20 -06:00
Pierre Villard 3508560b7a
NIFI-13950 Add commands to list branch, bucket, flows, versions to CLI (#9473)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-19 10:28:02 -06:00
Pierre Villard e082b60ef5
NIFI-13948 Add command pg-list-processors to CLI (#9471)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-19 10:04:07 -06:00
Pierre Villard a2c0fa5cd5
NIFI-13995 Add start, run once and clear state to CLI for Processors (#9509)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-19 10:01:43 -06:00
Pierre Villard 4e869e661d
NIFI-14021 Upgraded Spring to 6.2.0 and other dependencies
- Azure BOM from 1.2.28 to 1.2.29
- MSAL4J from 1.17.1 to 1.17.2
- GCP BOM from 26.49.0 to 26.50.0
- AWS SDK v1 from 1.12.777 to 1.12.778
- AWS SDK v2 from 2.29.1 to 2.29.15
- Groovy from 4.0.23 to 4.0.24
- Spring Framework from 6.1.14 to 6.2.0
- Swagger annotation from 2.2.25 to 2.2.26

- Set HTTPS port values for OAuth2 Request Resolver Test
- Removed invalid Autowired annotations from Web Config
- Set required to false for Autowired cluster components

This closes #9531

Signed-off-by: David Handermann <exceptionfactory@apache.org>
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Co-authored-by: Pierre Villard <pierre.villard.fr@gmail.com>
2024-11-19 09:35:54 -06:00
Pierre Villard ddef74b67f
NIFI-14009 Moved Toolkit Client code in its own nifi-toolkit-client module
This closes #9522

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-18 15:08:07 -06:00
exceptionfactory 20c7913d96
NIFI-14012 Added UID and DC Formatting for Certificate Principals
- Added Object Identifiers for UID and DC which are not included in the standard set for X500Principal.RFC1779

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9532.
2024-11-18 19:13:53 +01:00
Pierre Villard d51b306731
NIFI-14005 Add processor GetFileResource processor
This closes #9519 

Signed-off-by: Lucas Ottersbach <ottersbach@apache.org>
2024-11-18 17:58:42 +01:00
Alex Ethier 2173672666
NIFI-14007 Add ACL entities to GCS Processor FlowFile Attributes (#9520)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-15 16:24:39 -06:00
Pierre Villard 050fcc6b07
NIFI-14014 Use Node ID when available instead of Instance ID for Metrics (#9528)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-15 16:21:03 -06:00
Pierre Villard a856ffc241
NIFI-13731 Fixed null handling for Provenance Lineage Submission (#9525)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-15 16:18:56 -06:00
Pierre Villard 3fd3957b83
NIFI-13682 Fixed Flow Versioning when changing Label styles (#9526)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-15 16:16:09 -06:00
Rob Fellows b623ccc7fe
[NIFI-13918][NIFI-14015] - Flow analysis unauthorized root group does not display group id in the PG details section (#9529) 2024-11-15 15:09:53 -05:00
Pierre Villard 461fdd9f6f
NIFI-13608 - Handle NPE from Empty All Queues when there is no queue (#9527) 2024-11-15 14:36:26 -05:00
Bob Paulin 9708f05b9c
NIFI-14003: Allow stateless ready queue to update order. (#9515)
When more than one processor is ready we should allow the order of the
queue to change to prevent execution from getting stuck on a single
processor.
2024-11-15 14:33:00 -05:00
Alex Ethier 588e84e5c6
NIFI-14008 Add verify implementation to JsonConfigBasedBoxClientService and provide enhanced error message when box connection fails.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9521.
2024-11-14 21:28:12 +01:00
exceptionfactory 31e4c3728a
NIFI-14010 Upgraded Netty to 4.1.115 and Bouncy Castle to 1.79
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9524.
2024-11-14 19:52:38 +01:00
Pierre Villard b7e49bfac1
NIFI-13998 Add OIDC Client Credentials Flow support to NiFi CLI (#9512)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-13 21:23:27 -06:00
Pierre Villard 21e7eef660
NIFI-13990 Fixed CLI pg-enable-services failing if parent PG has disabled CS (#9504)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-13 21:19:32 -06:00
Greg Solovyev 6fb208807e
NIFI-12061 Added Listing Strategy to AWS Secrets Manager Provider
- Enumerate Secret Names allows using AWS Secrets Manager without ListSecrets permission

This closes #9483

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-13 21:05:02 -06:00
Bryan Bende 6b2dd3209f
NIFI-14006 Fixed Manifest Merger to avoid multiple reads for HTTP Responses (#9518)
- Corrects behavior when running in a cluster required after changes to read from response streams instead of buffering the entire response body in memory

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-13 16:08:10 -06:00
Rob Fellows 919b376c16
[NIFI-14002] - Quick copy of IDs (#9514) 2024-11-13 12:58:13 -05:00
Pierre Villard 6c4ddf8631
NIFI-13982 Updated web-client-api to support body as string and response URI (#9500)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-12 13:28:23 -06:00
dan-s1 2f048ca70a
NIFI-13988 Adjusted Record number conversion to treat empty String as null (#9511)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-12 13:23:08 -06:00
Peter Gyori 2f3dd015e0
NIFI-13745 Added StateManager Support to Python Processor API (#9419)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-12 09:03:57 -06:00
dan-s1 f15b7caaa4
NIFI-13989 Reduced constructors in JsonTreeRowRecordReader to one (#9506)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-11-12 08:24:30 -06:00