Commit Graph

706 Commits

Author SHA1 Message Date
Bryan Bende b5b61d960c
NIFI-13344 Implemented backend for uploading and managing custom NARs
- Add NarPersistenceProvider to framework API with standard implementation
- Add NarManager to orchestrate interactions with the persistence provider and framework
- Add REST API for upload, download, list, and delete of custom NARs
- Add CLI commands for call these REST APIs
- Implement an upload request replicator for replicating a file upload across the cluster
- Update ExtensionManager, NarLoader, and JettyServer to support unloading a NAR
- Add ability to replace a NAR in place by unloading components, loading new NAR, and reloading components
- Add system tests for uploading a NAR and verifying other APIs
- Add NAR digest to NarNode and summary DTO, fix bug in digest utils
- Sync NARs from cluster coordinator when joining the cluster

This closes #9017

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-12 09:02:25 -05:00
Joseph Witt f1fb106bf8
NIFI-13509 Removed ListenTCPRecord, ListenRELP and others
- Removed ConvertJSONToSql
- Removed ParseCEF
- Removed nifi-security-socket-ssl
- Removed Socket Dispatcher Reader classes

This closes #9045

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:50:03 -05:00
Joseph Witt 4ff70dd233
NIFI-13507 Removed nifi-prometheus-bundle
- Removed StandardGangliaReporter
- Removed PrometheusReportingTask
- Removed PrometheusRecordSink

This closes #9044

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-06 09:48:01 -05:00
exceptionfactory 7cb6684801
NIFI-13494 Removed support for Repository Encryption
This closes #9039

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-05 13:48:40 -07:00
exceptionfactory eb154d0640
NIFI-13518 Removed duplicative Windows start scripts
This closes #9052

- Removed run-nifi.bat in favor of nifi.cmd

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-07-05 13:41:20 -07:00
Joseph Witt 1d2b755edf
NIFI-13511 Removed ShellUserGroupProvider from NiFi and Registry
This closes #9046

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-05 11:24:31 -05:00
Joseph Witt b1da7322e8
NIFI-13515 Removed PutKudu and nifi-kudu-bundle
This closes #9048

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-07-05 11:22:44 -05:00
Peter Gyori 3efb0763da
NIFI-13427 Added FlowFileSource interface for Python Processors
This closes #9000

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-27 12:35:31 -05:00
David Handermann 14b1776739
NIFI-13424 Switched to EdDSA for Application Bearer Tokens (#8986)
- Replaced PS512 algorithm based on RSASSA-PSS with EdDSA algorithm using Ed25519
- Added Ed25519 Signer and Verifier implementations based on Java Signature processing

This closes #8986
2024-06-21 08:49:45 -04:00
exceptionfactory 49a0401058
NIFI-13414 Removed Property Protection Modules and Encrypt Config
This closes #8978

- Removed nifi-property-protection-api and implementation modules
- Removed nifi-toolkit-encrypt-config and minifi-toolkit-encrypt-config modules
- Removed extra bootstrap.conf configuration files for property protection implementations

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-06-20 13:04:00 -07:00
tpalfy c6fbd86cd8
NIFI-13388 Add NiFi CLI support for Flow Analysis Rules
This closes #8954.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2024-06-14 21:14:03 +02:00
Matt Gilman b3c7952ef3
NIFI-13373: Adding support for banner text (#8947)
* NIFI-13373:
- Adding support for banner text.

* NIFI-13373:
- Prettier.

* NIFI-13373:
- Removing unused property.

* NIFI-13373:
- Defining reponse payload when loading banner text.
- Removing banner text from login, logout, and error pages.

* NIFI-13373:
- Only loading the banner text when necessary.

This closes #8947
2024-06-11 11:47:56 -04:00
Matt Gilman 5c335cbbec
NIFI-13364 Removed autorefresh and banner UI properties
This closes #8932

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-06-06 08:34:17 -05:00
exceptionfactory fa8dc4f1a0
NIFI-13295 Removed Apache Knox SSO Authentication
This closes #8876

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-25 13:10:36 -07:00
exceptionfactory 43cc2b4aaa
NIFI-13297 Removed Kerberos SPENGO Authentication
This closes #8879

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-25 12:47:38 -07:00
exceptionfactory 15ac906725
NIFI-13256 Corrected Example WriteHelloWorld Processor Attributes
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8841.
2024-05-16 21:54:29 +02:00
Chris Sampson 2d112871db
NIFI-8134 allow unescapeJson Record Path function to recursively convert Maps to Records (#7745)
* NIFI-8134 recursively convert Java Objects to NiFi Records
2024-05-14 17:11:28 -04:00
Joseph Witt d1a9043167
NIFI-13193 Set Minimum Maven Version to 3.9.6
- Upgraded Maven plugins
- Upgraded SpotBugs from 4.7.3.5 to 4.8.5.0
- Upgraded asciidoctor-maven-plugin from 2.2.4 to 3.0.0
- Upgraded license-maven-plugin from 2.2.0 to 2.4.0
- Upgraded download-maven-plugin from 1.7.1 to 1.9.0
- Upgraded maven-clean-plugin from 3.3.1 to 3.3.2
- Upgraded frontend-maven-plugin from 1.14.2 to 1.15.0
- Upgraded hisrc-higherjaxb40-maven-plugin from 2.1.1 to 2.2.0
- Upgraded jacoco-maven-plugin from 0.8.11 to 0.8.12
- Upgraded swagger-maven-plugin-jakarta from 2.2.20 to 2.2.21
- Upgraded swagger-codegen-maven-plugin from 3.0.52 to 3.0.55

This closes #8797

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-05-10 08:05:14 -05:00
exceptionfactory 72b45f3114
NIFI-13202 Removed Accumulo Processors and Services
This closes #8794.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-05-09 16:14:20 -07:00
Pierre Villard ba1109f1f1
NIFI-13008 - CLI command to upgrade all instances of a versioned flow
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #8611.
2024-05-03 08:49:00 -04:00
Joseph Witt 19aab9bbba
NIFI-13007 Removed nifi-solr-bundle
This closes #8705

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-27 22:42:49 -05:00
David Handermann 335f08e5a4
NIFI-5302 Add Support for Client Credentials Flow with OIDC (#8532)
* NIFI-5302 Added Support for Client Credentials Flow with OIDC
- Added JwtDecoder implementation supporting delegation based on Issuer
* NIFI-5302 Added Client Credentials Grant Type section to OIDC docs
* NIFI-5302 Replaced deprecated OkHttp3ClientHttpRequestFactory
2024-04-25 12:33:32 -04:00
Mike Moser 7fdaa5f311
NIFI-13052 allow CRON driven components to be searchable
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8655.
2024-04-16 15:16:52 +02:00
exceptionfactory 2d9943e2d3
NIFI-13042 Support Python 3.12 for Python Processors
This closes #8644.

- Updated Controller.py main function to join non-daemon threads avoiding RuntimeError on Python 3.12
- Replaced deprecated find_module method with find_spec
- Updated documentation to include support for Python 3.12

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-04-14 20:47:51 -07:00
exceptionfactory 858d0bdf25
NIFI-10977 Added documentation on Kubernetes Clustering
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8612.
2024-04-09 16:18:11 +02:00
Mark Bean 506ac835ad
NIFI-13004 Removed include-grpc profile from documentation
This closes #8605

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-05 16:28:03 -05:00
Mark Payne 2ad9db18db
NIFI-12959: Support loading Python processors from NARs
This closes #8573

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-04-05 15:55:03 -05:00
exceptionfactory 14cb3f00f8
NIFI-12981 Removed Hive 3 Components
- Moved nifi-hive-test-utils to nifi-iceberg-test-utils
- Removed nifi-hive-bundle and include-hive3 profile

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8588.
2024-03-31 20:01:37 +03:00
EndzeitBegins fabf6bf536
NIFI-12617 Set default nifi.web.https.host to localhost
This closes #8486

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-08 15:51:58 -06:00
David Handermann 26f5fa2be0
NIFI-11443 Route Python Framework Logging to SLF4J (#8407)
* NIFI-11443 Routed Python Framework Logging to SLF4J

- Changed Python logging to use standard output stream
- Adjusted Python logging format for simplified processing
- Updated PythonProcess to pipe standard error and standard output streams to reader
- Added Log Reader command with Virtual Thread for each Python Process
- Removed Python log properties from NiFi Properties configuration
2024-03-05 16:55:04 -05:00
Mark Payne 55738f8522
NIFI-12740 Fixed Python to Java Object Binding
Fixed issue in NiFiPythonGateway that stems from the fact that the thread adding an object to the JavaObjectBindings was not necessarily the thread removing them. The algorithm that was in place assumed that the same thread would be used, in order to ensure that an object could be unbound before being accessed. The new algorithm binds each new object to all active method invocations and only unbinds the objects after all method invocations complete, regardless of thread. Additionally, found that many method calls could create new proxies on the Python side, just for getter methods whose values don't change. This is very expensive, so introduced a new @Idempotent annotation that can be added to interface methods such that we can cache the value and avoid the expensive overhead.

This closes #8456

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-03-04 15:28:12 -06:00
Mark Payne 74bd798097
NIFI-12773: Added join and anchored RecordPath function
Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #8391
2024-02-28 20:11:50 +00:00
Lucas 01ca19eccc
NIFI-12498 Adjust docs on default behaviour of prioritizers (#8451) 2024-02-28 12:55:45 -05:00
exceptionfactory 1e558802c9
NIFI-12819 Removed ReportLineageToAtlas Task and nifi-atlas-bundle
This closes #8427.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-20 09:21:01 -07:00
Paul Grey 44e20873b8
NIFI-12814 Corrected documentation for manual keystore generation
- Corrected certificate order with node then issuer

This closes #8424

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-19 13:48:53 -06:00
exceptionfactory 4d5f33804b
NIFI-12765 Removed Apache Ranger modules
This closes #8389

- Removed nifi-ranger-bundle modules
- Removed nifi-registry-ranger modules

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-14 17:11:50 -07:00
Peter Turcsanyi b6b0b241c3
NIFI-12769 Updated copyright year to 2024 in NOTICE file headers
This closes #8384.

Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-02-09 14:23:39 -07:00
Bence Simon a519585b02
NIFI-12236 Improved Fault Tolerance in QuestDB Status Repository
- Moved QuestDB components to nifi-questdb-bundle

This closes #8152

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-08 17:27:05 -06:00
lehelb 6a007f9159
NIFI-12270 Added UPLOAD Provenance Event Type to nifi-api
This closes #8094

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-02-08 08:16:46 -06:00
exceptionfactory 547f338147
NIFI-12695 Enabled PKCE Support for OIDC Integration
- Added Spring Security PKCE OAuth2 Request Customizer to standard Resolver

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #8324.
2024-02-01 10:57:32 +04:00
Mark Payne 2acc1038c9
NIFI-12616 Added Processor Documentation Support for Python
- Added some Use Case docs for Python processors and updated Runtime Manifests to include Python based processors as well as Use Case/MultiProcessorUseCase documentation elements. Refactored/cleaned up some of the Python code and added unit tests.

- Added python-unit-tests profile and enabled on Ubuntu and macOS GitHub workflows

This closes #8253

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-18 19:12:05 -06:00
Pierre Villard c719761a51
NIFI-12625 Listed Supported Python Versions in Docs
This closes #8261

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-17 14:29:30 -06:00
David Handermann 250fe90b34
NIFI-9458 Replaced SimpleDateFormat with DateTimeFormatter (#8248)
- Added FieldConverterRegistry and Standard implementation
- Moved DateTypeUtils methods to FieldConverter implementations
2024-01-16 16:39:40 -05:00
Joe Gresock 1e27cb907a
NIFI-12610: Corrected default_value example in Python Developer guide
This closes #8245

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-15 11:17:21 -06:00
theBestAndrew 2179d16bdc
NIFI-12607 This closes #8243. remove kernel 2.6 TIMED_WAIT documentation
Signed-off-by: Joseph Witt <joewitt@apache.org>
2024-01-12 14:45:54 -07:00
Pierre Villard a7c9eccf4a
NIFI-12538 Added mapOf Record Standalone Function
This closes #8182

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2024-01-02 15:35:42 -06:00
Alex Ethier 77093671e0
NIFI-12535: This closes #8181. Fixed documentation for 'PadRight Examples' table name in the Expression Language Guide as well as the last example in the table.
Signed-off-by: Joseph Witt <joewitt@apache.org>
2023-12-21 19:14:50 -07:00
David Handermann 6b7b7cccf8
NIFI-12493 Update Documentation References to Java 21 (#8144)
* NIFI-12493 Updated Documentation References to Java 21

- Removed Apache Maven download step from Custom Distribution instructions and referenced Apache Maven Wrapper in command
- Updated Java Documentation links to Java 21

* NIFI-12493 Updated additional Java version references
2023-12-19 09:49:00 -05:00
annanys23 93c9efe527
NIFI-11308 Added nifi.framework.version System Property for EL
- Updated Expression Language Guide to note the available system property providing the current framework version according to the Framework NAR version

This closes #8101

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-18 08:46:55 -06:00
Bence Simon 5b664147ee
NIFI-12508 Cleaning up remainders of the Event Driven Strategy
This closes #8153

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2023-12-13 13:15:29 -06:00