Commit Graph

722 Commits

Author SHA1 Message Date
Greg Solovyev 90d3b9da31
NIFI-13868 Added pg-delete command to NiFi Toolkit CLI (#9388)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-28 15:20:49 -05:00
exceptionfactory 63b0456bad
NIFI-13935 Removed HBase 2 Processors and Services
This closes #9453

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-28 07:20:47 -07:00
exceptionfactory b719e8728e
NIFI-13893 Removed Outdated Encryption Configuration from Admin Guide
This closes #9414

- Removed unsupported sensitive properties algorithms
- Removed historical sensitive property provider configuration for bootstrap.conf

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-10-17 14:29:51 -07:00
exceptionfactory 927baa858f
NIFI-13891 Updated Documentation for Bootstrap Network Address
- Removed unused nifi.listener.bootstrap.port property from nifi.properties
- Added documentation for management.server.address property in bootstrap.conf
- Corrected location of nifi.diagnostics.on.shutdown property documentation
- Added localized handling to bootstrap port property in StandardMiNiFiServer

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9413.
2024-10-17 21:32:00 +02:00
Michael Moser fa2a01c823
NIFI-13854 Updated Getting Started Guide for 2.0.0 (#9362)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-10-11 16:06:00 -05:00
Matt Gilman fb2a82c035
NIFI-13721: Migrating documentation into the NiFi UI (#9288)
* NIFI-13721: Migrating additional details to markdown.

* NIFI-13721: Rebuilding documentation to generate mark up on the client.

* NIFI-13721: Removing old documentation approach.

* NIFI-13721: Rebase main and final fixing button colors.

* NIFI-13721: Fixing rat issues.

* NIFI-13721: Removing generated comonent documentation.
- Removing links and images from additional details markdown.

* NIFI-13721: Recreating package lock following rebase.

* NIFI-13721: Updating documentation for M3.

* NIFI-13721: Fixing broken test.

* NIFI-13721: Addressing review feedback.

* NIFI-13721: Addressing review feedback.

* NIFI-13721: Ensuring the selected item is visible after routing.

* NIFI-13721: Fixing reportingTaskTypes in finding extensions for a given type.

* NIFI-13721: Updating the see also component to handle when the referenced extension is not installed.

* NIFI-13721: Fixing expansion panel header styles.
2024-09-27 11:11:55 -04:00
markobean 9b7b246dcc
NIFI-13736 Updated Expression Language Guide join function example (#9256)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-14 15:07:48 -05:00
Eric Secules 80b3cde95c
NIFI-7583 Document that Prioritizers do not fully sort a queue when swapping (#9263)
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-09-14 15:03:25 -05:00
EndzeitBegins 6ac5a96dd0
NIFI-13468 Add standalone RecordPath function recordOf
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9018.
2024-09-06 17:45:13 +02:00
Matt Gilman 39ab3129f0
NIFI-13632: Updating content access. (#9221)
* NIFI-13632: Updating content access.
- Removing existing content viewer application.
- Introduced new front end based content viewer applicaiton.
- Introduced new bundled content viewers for hex and images.
- Deleted previous image content viewer.
- Migrated existing standard content viewer (which handles json, xml, yaml, csv, and text) to utilize new content access interface.
- Moved standard content viewer into its own NAR.
- Moved and renamed custom ui utils and content viewer utils into nifi-common.
- Added mime type to FlowFileSummary response payload to help drive the initially opened content viewer.

* NIFI-13632: Fixing rat issue.

* NIFI-13632: Fixing CI issue.

* NIFI-13632: Removing standard content viewer war from code coverage.

* NIFI-13632: Addressing review feedback.

* NIFI-13632: Fixing import.

* NIFI-13632: Further simplification of content viewer state.

* NIFI-13632: Removing unneeded code.

* NIFI-13632: Adding a min height around codemirror.

* NIFI-13632: Addressing review feedback.
- Rendering mime type in the content viewer.
- Preventing additions to the browser history as the user changes how the content is viewed.
- Appending forward slash to content viewer UIs to prevent unnecessary redirect.
- Removing Standard Content Viewer title based on review feedback.
- Fixing double scroll bar in the Standard Content Viewer on small browser heights.
- Removed unnecessary application.yml.
- Bumping spring boot version.

This closes #9221
2024-09-06 09:12:38 -04:00
Peter Gyori 5f0cbed5a6
NIFI-13660 ProcessContext.yieldResources() can be called from Python code
Closes #9182

Signed-off-by: Marton Szasz <szaszm@apache.org>
2024-09-04 20:26:32 +02:00
Mike Moser ba13c5d48a
NIFI-13664 Support Component Search on NAR Bundle ID
This closes #9197

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-31 10:50:48 -05:00
David Handermann 6b6e8d6f78
NIFI-13665 Refactored Bootstrap and Runtime Process Handling (#9192)
- Added BootstrapProcess main class to nifi-bootstrap
- Added HTTP Management Server to nifi-runtime for status
- Added HTTP client to nifi-bootstrap for status
- Removed TCP socket listeners from nifi-bootstrap and nifi-runtime
- Removed dump and env commands
- Removed java property from bootstrap.conf
- Removed nifi.bootstrap.listen.port from bootstrap.conf
2024-08-26 14:22:04 -04:00
exceptionfactory fa6e55f1de
NIFI-13677 Removed install command from nifi.sh
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #9194.
2024-08-23 18:01:30 +02:00
Mark Payne 60e99184f8
NIFI-12898 Added Asset Management REST API and CLI Capabilities
- Added REST resource methods for managing assets associated with Parameter Contexts
- Added CLI commands for managing assets
- Added and updated system test for assets and Parameter Contexts
- Updated flow synchronization to consider referenced asset changes
- Adjusted authorization for cluster nodes to read Parameter Contexts

This closes #9138

Co-authored-by: Bryan Bende <bbende@apache.org>
Co-authored-by: Mark Payne <markap14@hotmail.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-08-13 11:42:02 -05:00
Peter Gyori 4f262dc7ea
NIFI-13604 Python Source processors can be triggered without creating new FlowFiles
Closes #9159

Signed-off-by: Marton Szasz <szaszm@apache.org>
2024-08-08 22:49:05 +02:00
Bryan Bende b5b61d960c
NIFI-13344 Implemented backend for uploading and managing custom NARs
- Add NarPersistenceProvider to framework API with standard implementation
- Add NarManager to orchestrate interactions with the persistence provider and framework
- Add REST API for upload, download, list, and delete of custom NARs
- Add CLI commands for call these REST APIs
- Implement an upload request replicator for replicating a file upload across the cluster
- Update ExtensionManager, NarLoader, and JettyServer to support unloading a NAR
- Add ability to replace a NAR in place by unloading components, loading new NAR, and reloading components
- Add system tests for uploading a NAR and verifying other APIs
- Add NAR digest to NarNode and summary DTO, fix bug in digest utils
- Sync NARs from cluster coordinator when joining the cluster

This closes #9017

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-12 09:02:25 -05:00
Joseph Witt f1fb106bf8
NIFI-13509 Removed ListenTCPRecord, ListenRELP and others
- Removed ConvertJSONToSql
- Removed ParseCEF
- Removed nifi-security-socket-ssl
- Removed Socket Dispatcher Reader classes

This closes #9045

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:50:03 -05:00
Joseph Witt 4ff70dd233
NIFI-13507 Removed nifi-prometheus-bundle
- Removed StandardGangliaReporter
- Removed PrometheusReportingTask
- Removed PrometheusRecordSink

This closes #9044

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:48:01 -05:00
exceptionfactory 7cb6684801
NIFI-13494 Removed support for Repository Encryption
This closes #9039

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-05 13:48:40 -07:00
exceptionfactory eb154d0640
NIFI-13518 Removed duplicative Windows start scripts
This closes #9052

- Removed run-nifi.bat in favor of nifi.cmd

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-05 13:41:20 -07:00
Joseph Witt 1d2b755edf
NIFI-13511 Removed ShellUserGroupProvider from NiFi and Registry
This closes #9046

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-05 11:24:31 -05:00
Joseph Witt b1da7322e8
NIFI-13515 Removed PutKudu and nifi-kudu-bundle
This closes #9048

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-05 11:22:44 -05:00
Peter Gyori 3efb0763da
NIFI-13427 Added FlowFileSource interface for Python Processors
This closes #9000

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-27 12:35:31 -05:00
David Handermann 14b1776739
NIFI-13424 Switched to EdDSA for Application Bearer Tokens (#8986)
- Replaced PS512 algorithm based on RSASSA-PSS with EdDSA algorithm using Ed25519
- Added Ed25519 Signer and Verifier implementations based on Java Signature processing

This closes #8986
2024-06-21 08:49:45 -04:00
exceptionfactory 49a0401058
NIFI-13414 Removed Property Protection Modules and Encrypt Config
This closes #8978

- Removed nifi-property-protection-api and implementation modules
- Removed nifi-toolkit-encrypt-config and minifi-toolkit-encrypt-config modules
- Removed extra bootstrap.conf configuration files for property protection implementations

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-06-20 13:04:00 -07:00
tpalfy c6fbd86cd8
NIFI-13388 Add NiFi CLI support for Flow Analysis Rules
This closes #8954.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-06-14 21:14:03 +02:00
Matt Gilman b3c7952ef3
NIFI-13373: Adding support for banner text (#8947)
* NIFI-13373:
- Adding support for banner text.

* NIFI-13373:
- Prettier.

* NIFI-13373:
- Removing unused property.

* NIFI-13373:
- Defining reponse payload when loading banner text.
- Removing banner text from login, logout, and error pages.

* NIFI-13373:
- Only loading the banner text when necessary.

This closes #8947
2024-06-11 11:47:56 -04:00
Matt Gilman 5c335cbbec
NIFI-13364 Removed autorefresh and banner UI properties
This closes #8932

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-06 08:34:17 -05:00
exceptionfactory fa8dc4f1a0
NIFI-13295 Removed Apache Knox SSO Authentication
This closes #8876

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-25 13:10:36 -07:00
exceptionfactory 43cc2b4aaa
NIFI-13297 Removed Kerberos SPENGO Authentication
This closes #8879

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-25 12:47:38 -07:00
exceptionfactory 15ac906725
NIFI-13256 Corrected Example WriteHelloWorld Processor Attributes
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8841.
2024-05-16 21:54:29 +02:00
Chris Sampson 2d112871db
NIFI-8134 allow unescapeJson Record Path function to recursively convert Maps to Records (#7745)
* NIFI-8134 recursively convert Java Objects to NiFi Records
2024-05-14 17:11:28 -04:00
Joseph Witt d1a9043167
NIFI-13193 Set Minimum Maven Version to 3.9.6
- Upgraded Maven plugins
- Upgraded SpotBugs from 4.7.3.5 to 4.8.5.0
- Upgraded asciidoctor-maven-plugin from 2.2.4 to 3.0.0
- Upgraded license-maven-plugin from 2.2.0 to 2.4.0
- Upgraded download-maven-plugin from 1.7.1 to 1.9.0
- Upgraded maven-clean-plugin from 3.3.1 to 3.3.2
- Upgraded frontend-maven-plugin from 1.14.2 to 1.15.0
- Upgraded hisrc-higherjaxb40-maven-plugin from 2.1.1 to 2.2.0
- Upgraded jacoco-maven-plugin from 0.8.11 to 0.8.12
- Upgraded swagger-maven-plugin-jakarta from 2.2.20 to 2.2.21
- Upgraded swagger-codegen-maven-plugin from 3.0.52 to 3.0.55

This closes #8797

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-10 08:05:14 -05:00
exceptionfactory 72b45f3114
NIFI-13202 Removed Accumulo Processors and Services
This closes #8794.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-09 16:14:20 -07:00
Pierre Villard ba1109f1f1
NIFI-13008 - CLI command to upgrade all instances of a versioned flow
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #8611.
2024-05-03 08:49:00 -04:00
Joseph Witt 19aab9bbba
NIFI-13007 Removed nifi-solr-bundle
This closes #8705

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-27 22:42:49 -05:00
David Handermann 335f08e5a4
NIFI-5302 Add Support for Client Credentials Flow with OIDC (#8532)
* NIFI-5302 Added Support for Client Credentials Flow with OIDC
- Added JwtDecoder implementation supporting delegation based on Issuer
* NIFI-5302 Added Client Credentials Grant Type section to OIDC docs
* NIFI-5302 Replaced deprecated OkHttp3ClientHttpRequestFactory
2024-04-25 12:33:32 -04:00
Mike Moser 7fdaa5f311
NIFI-13052 allow CRON driven components to be searchable
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8655.
2024-04-16 15:16:52 +02:00
exceptionfactory 2d9943e2d3
NIFI-13042 Support Python 3.12 for Python Processors
This closes #8644.

- Updated Controller.py main function to join non-daemon threads avoiding RuntimeError on Python 3.12
- Replaced deprecated find_module method with find_spec
- Updated documentation to include support for Python 3.12

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-04-14 20:47:51 -07:00
exceptionfactory 858d0bdf25
NIFI-10977 Added documentation on Kubernetes Clustering
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8612.
2024-04-09 16:18:11 +02:00
Mark Bean 506ac835ad
NIFI-13004 Removed include-grpc profile from documentation
This closes #8605

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-05 16:28:03 -05:00
Mark Payne 2ad9db18db
NIFI-12959: Support loading Python processors from NARs
This closes #8573

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-05 15:55:03 -05:00
exceptionfactory 14cb3f00f8
NIFI-12981 Removed Hive 3 Components
- Moved nifi-hive-test-utils to nifi-iceberg-test-utils
- Removed nifi-hive-bundle and include-hive3 profile

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8588.
2024-03-31 20:01:37 +03:00
EndzeitBegins fabf6bf536
NIFI-12617 Set default nifi.web.https.host to localhost
This closes #8486

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-08 15:51:58 -06:00
David Handermann 26f5fa2be0
NIFI-11443 Route Python Framework Logging to SLF4J (#8407)
* NIFI-11443 Routed Python Framework Logging to SLF4J

- Changed Python logging to use standard output stream
- Adjusted Python logging format for simplified processing
- Updated PythonProcess to pipe standard error and standard output streams to reader
- Added Log Reader command with Virtual Thread for each Python Process
- Removed Python log properties from NiFi Properties configuration
2024-03-05 16:55:04 -05:00
Mark Payne 55738f8522
NIFI-12740 Fixed Python to Java Object Binding
Fixed issue in NiFiPythonGateway that stems from the fact that the thread adding an object to the JavaObjectBindings was not necessarily the thread removing them. The algorithm that was in place assumed that the same thread would be used, in order to ensure that an object could be unbound before being accessed. The new algorithm binds each new object to all active method invocations and only unbinds the objects after all method invocations complete, regardless of thread. Additionally, found that many method calls could create new proxies on the Python side, just for getter methods whose values don't change. This is very expensive, so introduced a new @Idempotent annotation that can be added to interface methods such that we can cache the value and avoid the expensive overhead.

This closes #8456

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-04 15:28:12 -06:00
Mark Payne 74bd798097
NIFI-12773: Added join and anchored RecordPath function
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #8391
2024-02-28 20:11:50 +00:00
Lucas 01ca19eccc
NIFI-12498 Adjust docs on default behaviour of prioritizers (#8451) 2024-02-28 12:55:45 -05:00
exceptionfactory 1e558802c9
NIFI-12819 Removed ReportLineageToAtlas Task and nifi-atlas-bundle
This closes #8427.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-20 09:21:01 -07:00