6642 Commits

Author SHA1 Message Date
Paul Grey
b368c281e8
NIFI-12851 - ConsumeKafka, remove limitation on count of subscribed topics
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8460.
2024-02-29 12:01:07 +01:00
Rob Fellows
1cb0a53711
[NIFI-12848] - fixed ExpressionChanged error in Status History dialog (#8455)
* color the legend text to match the color of the corresponding line in the chart for each node

This closes #8455
2024-02-28 16:17:33 -05:00
Juldrixx
ecea18f796
NIFI-12733 Make Apicurio's groupId optional and configurable and use artifactId instead of name as key
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8351.
2024-02-28 14:42:17 +01:00
Mark Bathori
c29a744644
NIFI-12847: Add Enum data type handling to Iceberg record converter
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8453.
2024-02-28 14:33:39 +01:00
Rajmund Takacs
f119c49c4d NIFI-12843: Fix incorrect read of parquet data, when record.count is inherited
This closes #8452.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2024-02-27 18:01:49 +01:00
Balázs Gerner
40d9750bb3
NIFI-12671 Added S3FileResourceService
This closes #8368.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-02-26 17:23:35 +01:00
Balázs Gerner
03bba7049a
NIFI-12672 Added AzureFileResourceService
This closes #8359.

Signed-off-by: Mark Bathori <mbathori@apache.org>
2024-02-26 17:04:50 +01:00
Mark Payne
ae423fc6ba
NIFI-12832 Removed unnecessary dependencies from nifi-mock
- Moved StandardValidators to nifi-api
- Moved URL creation method from UriUtils to URLValidator
- Separated FormatUtils into FormatUtils and DurationFormat classes
- Added DurationFormat to nifi-api

This closes #8442

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-23 15:13:21 -06:00
bob
3c74aa460e
NIFI-11859: Ensure Hazelcast can not join a network when Cluster is NONE
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8440.
2024-02-23 13:20:00 +01:00
Mark Payne
064e15b7be
NIFI-12834 Fixed ConsumeSlack NPE for latestReply field
This closes #8446

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-22 16:46:37 -06:00
Joseph Witt
9e7e39fc2a
NIFI-12826 Added timing lag in TestFTP method for improved stability
This closes #8443

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-22 10:58:07 -06:00
Matt Gilman
6c76ecadd4
NIFI-12807: Handle clustering in Provenance, Lineage, and Queue Listing (#8431)
* NIFI-12807:
- Handling cluster node id in provenance listing, lineage graph, and queue listing.

* NIFI-12807:
- Addressing review feedback.

This closes #8431
2024-02-21 11:20:49 -05:00
dan-s1
0a2ba317c0
NIFI-12784 Set Path Not Found as a Dependent Property in EvaluateJsonPath
This closes #8420

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 22:14:52 -06:00
Robert
043e2dd3ff
NIFI-12633 Avoid resetting state in GetSolr on restart
This closes #8267

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 21:52:30 -06:00
dependabot[bot]
47290eb39f
NIFI-12827 Upgraded PostgreSQL JDBC test driver from 42.7.1 to 42.7.2
This closes #8437

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 21:28:47 -06:00
Joseph Witt
3f2f5a02e0
NIFI-12768 Removed unstable assertions from TestListFile
Additional assertion removals which assumed ordering that isn't guaranteed or enforced by the tests

This closes #8438

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 21:09:07 -06:00
exceptionfactory
014d539b5e
NIFI-12824 Removed ExecuteStateless Processor and NAR
This closes #8434

Removed nifi-stateless-nar from nifi-assembly

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-20 17:02:05 -07:00
Tom Brisland
89b618cc05
NIFI-12772 Expose REMOTE_POLL_BATCH_SIZE property for ListSFTP
This closes #8390.

revert max results optimisation + unnecessary import

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-20 12:52:35 -07:00
Bryan Bende
d35247b7b1
NIFI-12788 Avoid host URI encoding errors for Jetty Server Connector
This closes #8404

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 12:59:12 -06:00
dependabot[bot]
154fd87b79
Bump undici and @angular-devkit/build-angular (#8418)
Bumps [undici](https://github.com/nodejs/undici) to 6.6.2 and updates ancestor dependency [@angular-devkit/build-angular](https://github.com/angular/angular-cli). These dependencies need to be updated together.


Updates `undici` from 6.2.1 to 6.6.2
- [Release notes](https://github.com/nodejs/undici/releases)
- [Commits](https://github.com/nodejs/undici/compare/v6.2.1...v6.6.2)

Updates `@angular-devkit/build-angular` from 17.1.3 to 17.2.0
- [Release notes](https://github.com/angular/angular-cli/releases)
- [Changelog](https://github.com/angular/angular-cli/blob/main/CHANGELOG.md)
- [Commits](https://github.com/angular/angular-cli/compare/17.1.3...17.2.0)

---
updated-dependencies:
- dependency-name: undici
  dependency-type: indirect
- dependency-name: "@angular-devkit/build-angular"
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-02-20 13:18:41 -05:00
Mark Payne
a821966a87
NIFI-12232 Corrected Group Component ID Handling for Clustered Flows
Ensured that if a Process Group doesn't have a Versioned Component ID we use the ComponentIdLookup to create one based on its Instance ID in the same way that is done when serializing the flow; this ensures matching ID's when we synchronize flows across the cluster. Also included some code cleanup around failure handling on startup

This closes #8406

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 11:25:56 -06:00
Peter Turcsanyi
0f4defa49a
NIFI-12771 Restored Client-side KMS encryption strategy for S3
This closes #8388

Signed-off-by: David Handermann <exceptionfactory@apache.org>v
2024-02-20 10:59:49 -06:00
Mark Payne
7681054cf7
NIFI-12697 Allow disabling scientific notation when writing JSON
Use Jackson's internal implementations for parsing big integers and floating-point numbers more efficiently

Addressed case where JSON Writer configured to not allow scientific notation, but receives a record that already has a SerializedForm using scientific notation.

This closes #8319

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 10:53:39 -06:00
Pierre Villard
abc08eb842
NIFI-12796 - PutDatabaseRecord statement type should support u/c/d for Debezium
This closes #8412.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-20 09:36:55 -07:00
exceptionfactory
1e558802c9
NIFI-12819 Removed ReportLineageToAtlas Task and nifi-atlas-bundle
This closes #8427.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-20 09:21:01 -07:00
exceptionfactory
ff4c187f86
NIFI-12820 Upgraded Email Processors to Jakarta Mail 2
This closes #8428.

- Upgraded from Java Mail 1.4.7 to Jakarta Mail API 2.1.2
- Upgraded Spring Integration from 5.5.20 to 6.2.1
- Upgraded SubEtha SMTP from 3.1.7 to 7.0.1
- Upgraded Greenmail from 1.6.15 to 2.0.1
- Removed usage of Commons Lang3
- Removed usage of Commons IO

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-20 09:16:36 -07:00
exceptionfactory
9a81f660f2
NIFI-12813 Corrected Username handling in HTTP Request Log
- Corrected Jetty AuthenticationState interface reference for authenticated user attribute mapping
- Added unit test verifying expected attribute values

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8423.
2024-02-19 12:12:08 +01:00
Scott Aslan
3c5b997ce7
[NIFI-12761] refresh RPG (#8401)
* [NIFI-12761] refresh RPG

* address feedback

* stop polling on error

* fix linting errors introduced in this PR

* reload the connections

* refresh rpg, if first call does not have updated timestamp start polling

* rename action

* final touches

This closes #8401
2024-02-16 11:15:44 -05:00
Matt Gilman
6f6ddf8960
NIFI-12795: (#8416)
- Including embedded help documentation.
- Support linking to specific help documentation from the canvas and component listings.
2024-02-16 10:01:04 -05:00
Mark Payne
bd11031725
NIFI-12659 Respawn Python Processes on Unexpected Termination
Refactored so that when a Python Process dies, NiFi will detect this, respawn the process, recreate the Processors that exist in the process, re-initialize them, and restart them. In testing, found the PythonControllerInteractionIT had bugs that were causing Python Processors to be re-initialized many times; this resulted in threading issues that caused processors to be invalid, indicating that property descriptors didn't exist, etc. Addressed these concerns in the same commit, since they were necessary to properly run tests

Ensure that ClassLoader is consistently established for python processor proxies; ensure that if we re-initialize python processor the old initialization thread is stopped

This closes #8363

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-15 21:30:55 -06:00
dan-s1
fd4a74dbff
NIFI-12725 Upgraded json-schema-validator from 1.1.0 to 1.3.2
- Adjusted URIs for schemas Draft 4, Draft 6 and Draft 7 to match official values set on json-schema-validator 1.3.0

This closes #8405

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-15 15:11:01 -06:00
Mark Payne
b8d7b9c677
NIFI-12757: Issue GC commands to Python for FlowFileTransformResults and RecordTransformResults when no longer needed on Java side
This closes #8375

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-15 15:07:03 -06:00
Rob Fellows
e90c42d9cd
[NIFI-12790] Migrate to Angular 17 (#8410)
* [NIFI-12790] update version of typescript and zone.js
* remove override of dependency

* upgrade to angular 17

* migration to control-flow - used "ng generate @angular/core:control-flow"

* update the version of node used to build with

* add engine.node requirement to package.json

This closes #8410
2024-02-15 13:47:19 -05:00
Pierre Villard
a1542affc3 NIFI-12789 - fix broken link in couchbase additional details 2024-02-15 10:29:48 -05:00
exceptionfactory
4d5f33804b
NIFI-12765 Removed Apache Ranger modules
This closes #8389

- Removed nifi-ranger-bundle modules
- Removed nifi-registry-ranger modules

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-14 17:11:50 -07:00
exceptionfactory
fcaaa566e8
NIFI-12793 Removed deprecated nifi-spark-bundle
This closes #8409

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-14 17:10:50 -07:00
Rob Fellows
2792aa7038
[NIFI-12754] - Flow Configuration History (#8399)
* [NIFI-12754] - Flow Configuration History
* support selection
* support pagination
* support sorting
* added time controls, also updated provenance to use them too
* allow for clearing of filters
* use date range filter
* more details dialog for flow config history
* support purge history

* review feedback - use snackbar error where intended, add padding between header and page content

* don't use route for flow config history item selection

* Address review feedback

* remove unused style

* Review feedback * initial query is for the last 2 weeks * added timezone to purge confirmation message * reset pagination state on filter, clear filter, and purge * only resubmit query when filter by changes IF there is a filter term specified

This closes #8399
2024-02-14 16:35:58 -05:00
Scott Aslan
22de416ffc
[NIFI-12774] configure RPG (#8398)
* [NIFI-12774] configure RPG

* address review feedback

* conditionally dispatch selectComponents action

This closes #8398
2024-02-14 12:52:01 -05:00
Alex Ethier
e03329e01f
NIFI-12739 - Import ProcessPoolExecutor to fix bug in python 3.9+ (#8357)
* NIFI-12739 Import ProcessPoolExecutor to fix bug in python 3.9+ that causes
Exceptions to be raised incorrectly in multi-threaded applications
(https://bugs.python.org/issue42647)

* Removed extraneous whitespace.
2024-02-14 12:50:01 -05:00
Matt Gilman
da8f86b7e7
NIFI-12767: Error handling in Provenance and Lineage (#8386)
* NIFI-12767:
- Error handling in Provenance and Lineage.

* NIFI-12767:
- Addressing review feedback.

* NIFI-12767:
- Restoring empty initial state for completed request that allows showing a banner error over an empty table instead of an empty page.

* NIFI-12767:
- Restoring error state to ensure that the loading spinner stops on error.

This closes #8386
2024-02-14 11:11:26 -05:00
Peter Turcsanyi
9ba68edb5f
NIFI-12766 Fixed Region handling for AWS Assume Role Credentials
This closes #8382

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-12 18:05:09 -06:00
Pierre Villard
ecd6ed48a9
NIFI-12755 Upgraded Jetty from 12.0.5 to 12.0.6
- Refactored WebSocket Test Listener to avoid method visibility problem

This closes #8374

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-12 17:43:01 -06:00
Scott Aslan
25e24e0377
[NIFI-12759] go to RPG (#8378)
This closes #8378
2024-02-12 18:20:40 -05:00
lehelb
d1af7ef0c5
NIFI-12781 Removed File Location from Provenance UPLOAD event
This closes #8397

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-12 16:31:41 -06:00
Scott Aslan
14fcc42d16
[NIFI-12758] create remote process group (#8376)
* [NIFI-12758] create remote process group

* address review feedback

* update unit test

This closes #8376
2024-02-12 15:27:14 -05:00
lehelb
bf86103abf
NIFI-12775: Renamed provenance/FileResource to ProvenanceFileResource
This closes #8392.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-02-12 08:52:24 +01:00
Peter Turcsanyi
b6b0b241c3
NIFI-12769 Updated copyright year to 2024 in NOTICE file headers
This closes #8384.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-09 14:23:39 -07:00
David Handermann
e93fb17b66
NIFI-12768 Removed unstable filename assertion in TestListFile (#8383) 2024-02-09 16:00:22 -05:00
David Handermann
2ea4838157
NIFI-12764 Removed Commons Codec and Lang3 from security-utils (#8380) 2024-02-09 16:00:06 -05:00
Rob Fellows
7dc696ecdc
[NIFI-12665] fetch parameter provider parameters (#8367)
* [NIFI-12665] - fetch parameter provider parameters
* add permissions checks to parameter provider table actions for edit, delete, and fetch.
* error handling
* routing to fetch parameter provider dialog
* list the parameter groups
* parameter sensitivity selction/deselection
* show banner error if any affected/referencing components are not readable and writeable
* add indicators to parameters for changed, new, removed, ...
* refactored parameter-references component to the common area. leveraged it in the fetch dialog.
* validate the fetch form
* submit the fetch parameter provider parameters

* make the async update step completion icon color theme-aware

* add missing license header

* fixes for the initial round of review comments

* fixing issues found in review

* fix registry clients test

* stop polling when there is an api error

* use sort and join pipes in a couple of more places.

* protect references to parameter provider in the context for read permissions

* when full screen error is triggered, close any open dialog with the 'ROUTED' result to prevent unintended afterClosed actions taking place (like re-selection)

* handle fetch parameter provider error

* remove TODO comments

* call fullScreenError correctly

This closes #8367
2024-02-09 13:19:12 -05:00