Commit Graph

7198 Commits

Author SHA1 Message Date
Matthew Burgess a4a46d50c3
NIFI-9316: Registry Sort by label should be 'Last Updated (newest)' not 'Newest (update)'
NIFI-9316: Incorporated review comments
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5496
2022-03-16 14:25:32 -04:00
Paul Grey a0fc7f5e61
NIFI-9799 Enabled style checking for nifi-system-tests in ci-workflow
This closes #5869

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-16 10:53:35 -05:00
exceptionfactory 77c45cabc5 NIFI-9797 Corrected AccessToken.isExpired() margin calculation
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5867.
2022-03-14 18:31:44 -04:00
exceptionfactory 36b3f18424
NIFI-9796 This closes #5866. Updated Registry Security Configuration to avoid warnings
- Replaced WebSecurity.ignoring().antMatchers() with HttpSecurity.authorizeRequests().antMatchers()

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-03-14 12:52:36 -07:00
markap14 21922af90c
NIFI-9794: If a node is OFFLOADING, do not allow connections to be deleted. Also if we fail to notify the node that it needs to offload its data, change its state back to DISCONNECTED. (#5865) 2022-03-14 15:45:02 -04:00
Nathan Gough a7edabb4ff
NIFI-9590 Added support for sensitive properties in Azure authorizers to encrypt-config
This closes #5833

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-14 12:15:11 -05:00
Paul Grey a7abe6d722 NIFI-9795 - checkstyle, rat issues in nifi-system-test-suite module
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5864.
2022-03-14 13:08:03 -04:00
Nathan Gough 713e2fd03c
NIFI-9645 - Updated PutSplunk to allow idle connection timeouts
This closes #5841

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-14 11:15:16 -05:00
Mark Payne 7ff70706ee
NIFI-9790: This closes #5860. Fixed race condition in which SwappablePriorityQueue could attempt to access the 0th element of an empty collection
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-03-14 08:38:39 -07:00
Mike 237e481c4a
NIFI-9765 Added documentation that covers how to build a custom binar… (#5840)
* NIFI-9765 Added documentation that covers how to build a custom binary distribution of NiFi for internal use by NiFi users.

* Added 'clean' to Maven command example.

* NIFI-9765 Updated content based on review.

* Two updates requested in a review.
2022-03-14 08:51:16 -04:00
Bryan Bende e226d3be52
NIFI-9791 Use maven.build.timestamp during manifest generation instead of buildhelper timestamp
This closes #5861

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-12 12:04:28 -05:00
David Young d424537c53
NIFI-8899 - Add NiFi Registry version information to the Registry under an "about" button. (#5743)
* NIFI-8899 - Add NiFi Registry version information to the Registry under an "about" button.

Add a new endpoint to the registry API that serves up the project version.
Add a new "about" button to the Registry layout that shows a dialog with
version information.

* NIFI-8899 - Change where the version information is retrieved from

Change from pulling the version information from the POM itself, set by having maven filter the properties file at build time, to getting it from the `NiFiRegistryApiApplication` class's `getImplementationVersion` method.

* NIFI-8899 - Remove unused dependency

Left in an extra import

* NIFI-8899 - Rebase and update npm dependencies

Rebased on top of main, merged new dependencies
Updated and locking Sass to 1.49.7

* NIFI-8899 - Update typescript

Updated typescript to something more modern. (latest)

* NIFI-8899 - Change Version to RegistryVersion

Changed plain 'Version' to be more explicit about whose version: Registry
Changed the url endpoint from 'version' to 'about' to make it more clear it's
  not a versioned resource but information about the registry itself

* NIFI-8899 - Reflect new API in UI, look-and-feel, build-and-run script

API changes are now reflected in the UI
Bring the look-and-feel more inline with the Nifi about page.
  It's not perfect, but it looks much better than before.
Update the build-and-run script for the registry to not actually run the
  registry if the build didn't complete

* NIFI-8899 - Fix spacing, documentation

Removed unused import
Fixed param name in javadoc
Fixed spacing in HTML

* NIFI-8899 - Change to dialogService, fix styling

Changed close button to use raised accent styling
Moved dialog showing into nf-registry.api.js
Changed click call to show dialog using the api method
Showing the dialog now makes the api call before rendering.

* NIFI-8899 - Fixed styling, refactored the about dialog codepath

Changed close button to use raised primary style
Changed click call to use nf-regisry.js to call the api method
  Removed the extra call to show the dialog.
Removed some comments and outdated references

Merged #5743 into main.
2022-03-11 17:25:47 -08:00
exceptionfactory 6e974a1fd2
NIFI-9789 Upgraded Logback from 1.2.10 to 1.2.11
This closes #5858

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-11 18:01:45 -05:00
Nathan Gough 885c475f90
NIFI-9699 - Updated oidcCallback method to handle error cases. Added some unit tests.
This closes #5824

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-11 11:40:47 -06:00
Joe Witt 72fadf9e51
NIFI-9780 fixing many inconsistent pom project declarations and updated org apache parent version 2022-03-10 11:15:16 -07:00
exceptionfactory 859d5fe8cf NIFI-9785 Improved Login Credentials Writer File Handling
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5856.
2022-03-10 11:47:32 -05:00
Bryan Bende 546f986603
NIFI-9775 Create RuntimeManifestService
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5849.
2022-03-10 07:52:16 -05:00
Peter Turcsanyi 92202a5b95
NIFI-9764: Atlas reporting task sends 'unknown' hive_table when table is name not available
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5839.
2022-03-10 13:16:24 +01:00
Mike Thomsen df00cc6cb5
NIFI-6047 Cleaned up code to allow tests to run against 1.13.0-snapshot
Removed DMC.
NIFI-6047 Started integrating changes from NIFI-6014.
NIFI-6047 Added DMC tests.
NIFI-6047 Added cache identifier recordpath test.
NIFI-6047 Added additional details.
NIFI-6047 Removed old additional details.
NIFI-6047 made some changes requested in a follow up review.
NIFI-6047 latest.
NIFI-6047 Finished updates
First round of code review cleanup
Latest
Removed EL from the dynamic properties.
Finished code review requested refactoring.
Checkstyle fix.
Removed a Java 11 API
NIFI-6047 Renamed processor to DeduplicateRecord

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4646
2022-03-09 19:06:44 -05:00
Adam 23132fb89f
NIFI-6047
Added NiFi DetectDuplicateRecord standard processor.
Adding some documentation and PR review tweaks.
Exposing processor
Documentation updates, exception handling consolidation, added support for record path field variables.
Added tests.
Build bump.
Migrated cache service to groovy folder.
Moved declarations for properties to @BeforeClass lifecycle method.
Adding some documentation and PR review tweaks.
Documentation updates, exception handling consolidation, added support for record path field variables.
Added tests.
Build bump.
Migrated cache service to groovy folder.
Fixed variable type bug.
Fixed mapping of test params to usage.
Fixed potential illegal state exception bug.
2022-03-09 19:06:08 -05:00
Joe Witt df2f1f3b49
NIFI-9780 updating docker file versions 2022-03-09 13:35:25 -07:00
exceptionfactory 4a46b087b8
NIFI-9782 This closes #5854. Excluded H2 DB from nifi-druid-bundle
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-03-09 13:26:54 -07:00
Mark Payne 73356ea448
NIFI-9783: This closes #5855. When migrating FlowFiles from one ProcessSession to another, if any FlowFile had already been transferred, and the Relationship to which it was transferred was auto-terminated, we were updating the wrong member variable, which threw off our stats for the processor. Fixed that.
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-03-09 13:26:32 -07:00
exceptionfactory c73573b325
NIFI-9761 Correct PeerChannel processing for TLS 1.3 (#5836)
* NIFI-9761 Corrected PeerChannel processing for TLS 1.3
- Added TestPeerChannel with methods for TLS 1.2 and TLS 1.3
- Updated PeerChannel.close() to process SSLEngine close notification
- Improved logging and corrected handling after decryption
2022-03-09 15:15:52 -05:00
Mark Payne 6a1c7c72d5
NIFI-9781: Fix handling when selecting array element via QueryRecord
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5853.
2022-03-09 13:07:15 -05:00
Peter Turcsanyi 3219c105eb
NIFI-9728: Added support for User Assigned Managed Identity authentication for Azure ADLS and Blob_v12 processors
Also bumped Azure dependencies.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5846.
2022-03-09 16:50:38 +01:00
Bence Simon b86466b4a5 NIFI-9669 Adding PutDynamoDBRecord processor
This closes #5761.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-03-09 16:20:33 +01:00
exceptionfactory c8f8747dbc
NIFI-9774 Upgraded Netty from 4.1.73 to 4.1.74
This closes #5851

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-09 08:51:00 -05:00
Bence Simon 3b8afee9d6
NIFI-9778 Fixing additional details for ScriptedPartitionRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5852.
2022-03-09 14:49:28 +01:00
Matt Gilman 227dcf5456
NIFI-9777: (#5850) - Adding support to remove attributes from verification requests.
This closes #5850
2022-03-08 16:25:32 -05:00
Mark Payne e6229ab938
NIFI-9771: When a Kafka record is obtained during config verification, we should produce an invalid response if the Record Reader is not able to produce any records from it
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5847.
2022-03-08 06:42:27 -05:00
Mike Thomsen f35f010deb
NIFI-9085 Refactored the Elasticsearch bundle to use JUnit 5
- NIFI-9086 Refactored nifi-accumulo-bundle to use JUnit 5
- NIFI-9087 Updated nifi-ambari-bundle to use JUnit 5
- NIFI-9088 Refactored nifi-amqp-bundle to use JUnit 5
- NIFI-9089 Updated nifi-asn1-bundle to use JUnit 5
- NIFI-9090 Refactored nifi-atlas-bundle to use JUnit 5
- NIFI-9091 Refactored nifi-avro-bundle to use JUnit 5
- NIFI-9092 Refactored nifi-aws-bundle to use JUnit 5
- NIFI-9095 Refactored nifi-azure-bundle to use JUnit 5
- NIFI-9145 Refactored nifi-rethinkdb-bundle to use JUnit 5
- NIFI-9143 Refactored nifi-redis-bundle to use JUnit 5

This closes #5350

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-07 21:49:23 -06:00
Matthew Burgess 43bf2b5975
NIFI-9763: Additional escaped VALUE column due to H2 changes
This closes #5848

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-07 19:18:02 -06:00
Joe Gresock 743020eeb4
NIFI-9762: Adding DBCPConnectionPool config verification
Relaxing MockPropertyValue validation to allow for variables to be passed to config verification

Fixing underlying framework issue with config verification: wrong variable registry was being used

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5843
2022-03-07 14:43:11 -05:00
Paul Grey fc5c810de7
NIFI-9750 - Logging Improvements to support LoadBalanceProtocol troubleshooting
This closes #5828

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-07 13:41:07 -06:00
Eduardo Fontes d062029258
NIFI-8927 - Add option to start/stop all controllers (#5247)
* Update nf-context-menu.js

Include enable/disable all controllers menu item

* Update nf-actions.js

Create enableAllControllers and disableAllControllers actions

* Rename ...Controllers to ...ControllerServices

* Rename *controllers to *controller services

* Adjusts proposed by reviewer.

* Refactor enable and disable AllControllerServices

This closes #5247
2022-03-07 13:57:35 -05:00
exceptionfactory 7d046fe3de
NIFI-9763 Escaped VALUE column for Configure Details Auditing
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5838
2022-03-07 08:53:08 -05:00
Andrew Lim 9782a51564
NIFI-9756 Add documentation for framework-level retry in Processors and update processor tab images
This closes #5837

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-06 08:27:06 -05:00
Chris Sampson 12685a4af4
NIFI-9766 avoid intermittent SearchElasticsearchTest failures in CI pipeline
This closes #5842

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-05 19:05:02 -05:00
Mark Payne 65dd62716a
NIFI-9748: Added new property for Output Format to LogAttribute. Also made the FlowFile Properties (file size, entry date, lineage start date) optional and renamed from 'Standard FlowFile Attributes' to 'FlowFile Properties' because this has led to confusion many times in the past, around users wanting to reference these things as attributes via EL but they are not actually attributes.
This closes #5825

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-04 08:24:39 -05:00
Mark Payne 8959226b50
NIFI-9754: Introduced VersionedExternalFlow
- Updated stateless and StandardProcessGroup, etc. to make use of VersionedExternalFlow
- Updated StatelessDataflowDefinition to use ExternalVersionedFlow instead of generic type
- Updated Stateless Bootstrap to avoid loading stateless engine libs from root class path but instead use a NarClassLoader to load the statelss nar

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5832.
2022-03-04 07:19:38 -05:00
exceptionfactory 7438bc9244
NIFI-9759 Upgraded Spring Framework from 5.3.15 to 5.3.16
- Upgraded Spring Security from 5.6.1 to 5.6.2
- Upgraded Spring Boot from 2.6.3 to 2.6.4 in NiFi Registry
- Upgraded Spring Data Redis from 2.6.0 to 2.6.2
- Upgraded Spring Integration from 5.5.7 to 5.5.9

This closes #5835

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-04 06:23:51 -05:00
exceptionfactory 923e9f4e4f
NIFI-9757 Upgraded SLF4J from 1.7.35 to 1.7.36
This closes #5834

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-04 06:18:09 -05:00
Shane Ardell 6cd30e3d0a
NIFI-9543: Add bring-to-front functionality to labels (#5765)
* NIFI-9543: add bring-to-front functionality to labels

* NIFI-9543: update zIndex changes to persist after shutdown

* NIFI-9543: remove commented code

* NIFI-9543: update flow comparator and snippet to account for zIndex

* NIFI-9543: changed add function to sort labels when a new label is added

* NIFI-9543: remove unnecessary call to position

* NIFI-9543: only register difference if zIndex is not default value

* NIFI-9543: add null checks to prevent primitive Long

This closes #5765
2022-03-03 18:50:15 -05:00
Adam Kocsis 6f5fda54e5
[NIFI-9746] NiFi Registy Bucket Side Nav no longer fails to open (#5831)
- all ViewCild queries are decorated with {static: true} which is needed because of new angular version
none of these ViewChild under *ng directives so they are available during init with static:true

Merged #5831 into main.
2022-03-03 14:45:35 -08:00
Matthew Burgess c91f543c2b NIFI-9425: Added auto-load NAR capability to MiNiFi
NIFI-9425: Added autoload directory property and defensive code for stop() called twice

This closes #5762.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-03-03 16:30:47 -05:00
Paul Grey d2e90dd160
NIFI-9751 - Poll as needed during system-tests to ensure expected state
This closes #5829

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-03 15:24:52 -06:00
Adam Kocsis 7a16619969
[NIFI-9690] Display icon on Connection Label to show when head of the queue is penalized (#5812)
This closes #5812
2022-03-03 09:13:00 -05:00
Paul Grey 6bc85155f9
NIFI-9749 - Capture additional logging for system-test workflow runs
This closes #5827

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-02 18:52:43 -06:00
Paul Grey 272f412254
NIFI-9747 - Track PID in nifi-bootstrap logging on shutdown
This closes #5826

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-02 18:49:34 -06:00