Commit Graph

9472 Commits

Author SHA1 Message Date
Jim Steinebrey bda9b6360d NIFI-12630 Fix NPE getLogger in ConsumeSlack and PublishSlack
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8474
2024-03-05 19:33:54 -05:00
David Handermann 26f5fa2be0
NIFI-11443 Route Python Framework Logging to SLF4J (#8407)
* NIFI-11443 Routed Python Framework Logging to SLF4J

- Changed Python logging to use standard output stream
- Adjusted Python logging format for simplified processing
- Updated PythonProcess to pipe standard error and standard output streams to reader
- Added Log Reader command with Virtual Thread for each Python Process
- Removed Python log properties from NiFi Properties configuration
2024-03-05 16:55:04 -05:00
Peter Radden 264ea30bbd
NIFI-12860 Fixed NPE in ExtensionMetadata Constructor
This closes #8468

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-05 09:23:59 -06:00
Ferenc Kis d1b6aab9d3
NIFI-12760 Flow sensitive properties encryption support in toolkit
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #8430.
2024-03-05 14:35:15 +01:00
dan-s1 4083fd3f75
NIFI-12864 Corrected NOTICE Reference to UriComponentsBuilder
This closes #8470

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-04 15:31:46 -06:00
Jim Steinebrey 97516de1e0 NIFI-12645 Fix to correctly invoke onStopped method of scripted processor
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8471
2024-03-04 16:30:14 -05:00
Mark Payne 55738f8522
NIFI-12740 Fixed Python to Java Object Binding
Fixed issue in NiFiPythonGateway that stems from the fact that the thread adding an object to the JavaObjectBindings was not necessarily the thread removing them. The algorithm that was in place assumed that the same thread would be used, in order to ensure that an object could be unbound before being accessed. The new algorithm binds each new object to all active method invocations and only unbinds the objects after all method invocations complete, regardless of thread. Additionally, found that many method calls could create new proxies on the Python side, just for getter methods whose values don't change. This is very expensive, so introduced a new @Idempotent annotation that can be added to interface methods such that we can cache the value and avoid the expensive overhead.

This closes #8456

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-04 15:28:12 -06:00
Scott Aslan f9c1c3f042
[NIFI-12778] manage remote ports (#8433)
* [NIFI-12778] manage remote ports

* update last refreshed timestamp and loadedTimestamp

* address review feedback

* final touches

* address addition review comments

* formatDuration check isDurationBlank

This closes #8433
2024-02-29 16:09:32 -05:00
Rob Fellows 455159f6ac
[NIFI-12537] Open cluster/node dialog from Summary screen. (#8454)
* [NIFI-12537] - Summary screen cluster-related features

* common component status table

* cluster summary dialogs

* address review feedback

* ellisis for node columns in cluster dialogs, cluster node dropdown panel no longer wraps, shorted the dropdown width as well.

* prettier

This closes #8454
2024-02-29 16:08:47 -05:00
Pierre Villard c3c1b834c7 NIFI-12850 - Prevent indexing of overly large filename attribute
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8457
2024-02-29 14:10:19 -05:00
ravisingh 8346bd7d0f NIFI-12828: Added Mapping for BIT type to return INT and handled boolean case for postgres
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #8445
2024-02-29 14:06:57 -05:00
Paul Grey b368c281e8
NIFI-12851 - ConsumeKafka, remove limitation on count of subscribed topics
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8460.
2024-02-29 12:01:07 +01:00
Rob Fellows 1cb0a53711
[NIFI-12848] - fixed ExpressionChanged error in Status History dialog (#8455)
* color the legend text to match the color of the corresponding line in the chart for each node

This closes #8455
2024-02-28 16:17:33 -05:00
Mark Payne 74bd798097
NIFI-12773: Added join and anchored RecordPath function
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #8391
2024-02-28 20:11:50 +00:00
Lucas 01ca19eccc
NIFI-12498 Adjust docs on default behaviour of prioritizers (#8451) 2024-02-28 12:55:45 -05:00
Juldrixx ecea18f796
NIFI-12733 Make Apicurio's groupId optional and configurable and use artifactId instead of name as key
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8351.
2024-02-28 14:42:17 +01:00
Mark Bathori c29a744644
NIFI-12847: Add Enum data type handling to Iceberg record converter
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8453.
2024-02-28 14:33:39 +01:00
Rajmund Takacs f119c49c4d NIFI-12843: Fix incorrect read of parquet data, when record.count is inherited
This closes #8452.

Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2024-02-27 18:01:49 +01:00
Balázs Gerner 40d9750bb3
NIFI-12671 Added S3FileResourceService
This closes #8368.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-02-26 17:23:35 +01:00
Balázs Gerner 03bba7049a
NIFI-12672 Added AzureFileResourceService
This closes #8359.

Signed-off-by: Mark Bathori <mbathori@apache.org>
2024-02-26 17:04:50 +01:00
Matt Burgess 0884b627b2 NIFI-12839: Explicitly set nifiVersion for processor bundle archetype dependencies
This closes #8447

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2024-02-24 13:10:53 -05:00
Mark Payne ae423fc6ba
NIFI-12832 Removed unnecessary dependencies from nifi-mock
- Moved StandardValidators to nifi-api
- Moved URL creation method from UriUtils to URLValidator
- Separated FormatUtils into FormatUtils and DurationFormat classes
- Added DurationFormat to nifi-api

This closes #8442

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-23 15:13:21 -06:00
bob 3c74aa460e
NIFI-11859: Ensure Hazelcast can not join a network when Cluster is NONE
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8440.
2024-02-23 13:20:00 +01:00
Mark Payne 064e15b7be
NIFI-12834 Fixed ConsumeSlack NPE for latestReply field
This closes #8446

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-22 16:46:37 -06:00
dependabot[bot] e9b99ed04f
NIFI-12835 Upgraded node-ip from 1.1.8 to 1.1.9 for Registry
This closes #8444

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-22 16:39:57 -06:00
Joseph Witt 9e7e39fc2a
NIFI-12826 Added timing lag in TestFTP method for improved stability
This closes #8443

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-22 10:58:07 -06:00
Matt Gilman 6c76ecadd4
NIFI-12807: Handle clustering in Provenance, Lineage, and Queue Listing (#8431)
* NIFI-12807:
- Handling cluster node id in provenance listing, lineage graph, and queue listing.

* NIFI-12807:
- Addressing review feedback.

This closes #8431
2024-02-21 11:20:49 -05:00
dan-s1 0a2ba317c0
NIFI-12784 Set Path Not Found as a Dependent Property in EvaluateJsonPath
This closes #8420

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 22:14:52 -06:00
Robert 043e2dd3ff
NIFI-12633 Avoid resetting state in GetSolr on restart
This closes #8267

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 21:52:30 -06:00
dependabot[bot] a95f327b31
NIFI-12827 Upgraded PostgreSQL JDBC test driver from 42.6.0 to 42.7.2
This closes #8436

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 21:28:48 -06:00
dependabot[bot] 47290eb39f
NIFI-12827 Upgraded PostgreSQL JDBC test driver from 42.7.1 to 42.7.2
This closes #8437

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 21:28:47 -06:00
Joseph Witt 3f2f5a02e0
NIFI-12768 Removed unstable assertions from TestListFile
Additional assertion removals which assumed ordering that isn't guaranteed or enforced by the tests

This closes #8438

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 21:09:07 -06:00
exceptionfactory 014d539b5e
NIFI-12824 Removed ExecuteStateless Processor and NAR
This closes #8434

Removed nifi-stateless-nar from nifi-assembly

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-20 17:02:05 -07:00
Tom Brisland 89b618cc05
NIFI-12772 Expose REMOTE_POLL_BATCH_SIZE property for ListSFTP
This closes #8390.

revert max results optimisation + unnecessary import

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-20 12:52:35 -07:00
Bryan Bende d35247b7b1
NIFI-12788 Avoid host URI encoding errors for Jetty Server Connector
This closes #8404

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 12:59:12 -06:00
dependabot[bot] 154fd87b79
Bump undici and @angular-devkit/build-angular (#8418)
Bumps [undici](https://github.com/nodejs/undici) to 6.6.2 and updates ancestor dependency [@angular-devkit/build-angular](https://github.com/angular/angular-cli). These dependencies need to be updated together.


Updates `undici` from 6.2.1 to 6.6.2
- [Release notes](https://github.com/nodejs/undici/releases)
- [Commits](https://github.com/nodejs/undici/compare/v6.2.1...v6.6.2)

Updates `@angular-devkit/build-angular` from 17.1.3 to 17.2.0
- [Release notes](https://github.com/angular/angular-cli/releases)
- [Changelog](https://github.com/angular/angular-cli/blob/main/CHANGELOG.md)
- [Commits](https://github.com/angular/angular-cli/compare/17.1.3...17.2.0)

---
updated-dependencies:
- dependency-name: undici
  dependency-type: indirect
- dependency-name: "@angular-devkit/build-angular"
  dependency-type: direct:development
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
2024-02-20 13:18:41 -05:00
Mark Payne a821966a87
NIFI-12232 Corrected Group Component ID Handling for Clustered Flows
Ensured that if a Process Group doesn't have a Versioned Component ID we use the ComponentIdLookup to create one based on its Instance ID in the same way that is done when serializing the flow; this ensures matching ID's when we synchronize flows across the cluster. Also included some code cleanup around failure handling on startup

This closes #8406

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 11:25:56 -06:00
Peter Turcsanyi 0f4defa49a
NIFI-12771 Restored Client-side KMS encryption strategy for S3
This closes #8388

Signed-off-by: David Handermann <exceptionfactory@apache.org>v
2024-02-20 10:59:49 -06:00
Mark Payne 7681054cf7
NIFI-12697 Allow disabling scientific notation when writing JSON
Use Jackson's internal implementations for parsing big integers and floating-point numbers more efficiently

Addressed case where JSON Writer configured to not allow scientific notation, but receives a record that already has a SerializedForm using scientific notation.

This closes #8319

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-20 10:53:39 -06:00
Pierre Villard abc08eb842
NIFI-12796 - PutDatabaseRecord statement type should support u/c/d for Debezium
This closes #8412.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-20 09:36:55 -07:00
exceptionfactory 1e558802c9
NIFI-12819 Removed ReportLineageToAtlas Task and nifi-atlas-bundle
This closes #8427.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-20 09:21:01 -07:00
exceptionfactory 27f8b98e9a
NIFI-12817 Moved Hadoop DBCP NAR to Hadoop Build Profile
This closes #8425.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-20 09:17:21 -07:00
exceptionfactory 1124728ff7
NIFI-12821 Set docker-maven-plugin version to 0.43.4
This closes #8429.

- Reduced docker-tests timeout from 120 to 60 minutes

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-20 09:16:56 -07:00
exceptionfactory ff4c187f86
NIFI-12820 Upgraded Email Processors to Jakarta Mail 2
This closes #8428.

- Upgraded from Java Mail 1.4.7 to Jakarta Mail API 2.1.2
- Upgraded Spring Integration from 5.5.20 to 6.2.1
- Upgraded SubEtha SMTP from 3.1.7 to 7.0.1
- Upgraded Greenmail from 1.6.15 to 2.0.1
- Removed usage of Commons Lang3
- Removed usage of Commons IO

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-20 09:16:36 -07:00
AjayPremarajan fcbd7c690b
NIFI-12644 Exported json flows does not match minifi json schema resolved by adding new method transform-nifi to convert Nifi Flow json to MiNifi flow json #8393
Signed-off-by: Ferenc Kis <briansolo1985@gmail.com>

This closes #8393.
2024-02-20 12:47:51 +01:00
Paul Grey 44e20873b8
NIFI-12814 Corrected documentation for manual keystore generation
- Corrected certificate order with node then issuer

This closes #8424

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-19 13:48:53 -06:00
exceptionfactory 32a33115eb
NIFI-12811 Upgraded Spring Framework from 6.0.16 to 6.0.17
- Upgraded Spring Security from 6.2.0 to 6.2.2
- Upgraded Registry version of Spring Framework from 6.1.3 to 6.1.4

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8422.
2024-02-19 12:14:03 +01:00
exceptionfactory 9a81f660f2
NIFI-12813 Corrected Username handling in HTTP Request Log
- Corrected Jetty AuthenticationState interface reference for authenticated user attribute mapping
- Added unit test verifying expected attribute values

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8423.
2024-02-19 12:12:08 +01:00
exceptionfactory 2007d79e2c
NIFI-12808 Upgraded Commons Codec from 1.16.0 to 1.16.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8419.
2024-02-19 11:12:09 +01:00
exceptionfactory abc841e49c
NIFI-12810 Upgraded SLF4J from 2.0.11 to 2.0.12
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8421.
2024-02-19 11:10:26 +01:00