Commit Graph

7523 Commits

Author SHA1 Message Date
exceptionfactory 0fa4490a98
NIFI-9842 Refactored nifi-commons using JUnit 5
- Refactored nifi-bootstrap using JUnit 5
- Refactored nifi-maven-archetypes using JUnit 5
- Refactored nifi-stateless using JUnit 5

This closes #5912

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-28 16:00:23 -04:00
Peter Gyori 6ade47ac4f
NIFI-9838: Added Client Certificate attributes to ListenTCPRecord FlowFiles
This closes #5908

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-28 13:36:16 -05:00
Emilio Setiadarma 9566d3fa78
NIFI-9841 Improved Encryptor test reliability
- Changed expected exception to ProcessException in KeyedEncryptorGroovyTest and PasswordBasedEncryptorGroovyTest to avoid intermittent failures

This closes #5911

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-28 13:28:28 -05:00
Nathan Gough 2fbe10b4bc
NIFI-9701 - Corrected No Tracking strategy to create one flow file when using a Record Writer
- Corrected No Tracking strategy Record Writer handling for ListSFTP
- Updated temporary test files to have last modified time of epoch to avoid intermittent issue with Minimum Age filtering
- Refactored MockCacheService to separate reusable class

This closes #5885

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-28 12:47:30 -05:00
exceptionfactory 105890ef37
NIFI-9773 Refactored nifi-system-tests using JUnit 5
- Enabled system-tests workflow on push and pull requests

This closes #5901

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-26 07:22:07 -04:00
Mark Payne 16c9bd535b NIFI-9834: When calling ByteArrayContentRepository.read() on a null Content Claim, return an empty ByteArrayInputStream instead of throwing NullPointerException
This closes #5903.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-03-25 21:07:25 +01:00
Mark Payne 63f02c99bf
NIFI-9835: Fixed threading bug in which NioAsyncLoadBalanceClient calls LoadBalanceSession.isComplete() followed by LoadBalanceSession.isCanceled() but it's possible for the complete flag to change before the canceled flag (they are not updated atomically). So changed to use a single LoadBalanceSessionState enum that represents the state. Also made the private StandardProcessSession.commit(boolean) method synchronized. When a processor is terminated (as is the case in Offload), we roll back sessions and both the commit() and rollback() need to be synchronized. Only the public commit() method was synchronized, and now with commitAsync() happening, we had the ability to commit without any synchronization. This addresses that concern. Also fixed a typo in docs for MergeRecord.
This closes #5902

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-25 12:42:03 -05:00
Mike 2ac90a6441
NIFI-7262 Added debug logging for the generated query in PutCassandraRecord. (#5898)
Signed-off-by: Otto Fowler <otto@apache.org>
2022-03-25 06:48:57 -04:00
Joe Gresock a75381abbe NIFI-9827: Upgrading AWS Java SDK to 1.12.182 to pick up new AWS Regions
This closes #5892

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>
2022-03-24 13:24:28 +00:00
Marcus Ely 72435c3c6d
NIFI-8124 Added Cookie Strategy property to InvokeHTTP
This closes #5887

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-23 15:55:40 -05:00
Emilio Setiadarma 772adbc709
NIFI-1468 Added tests to handle invalid cipher streams missing Salt/IV
- Updated PasswordBasedEncryptorGroovyTest and KeyedEncryptorGroovyTest

This closes #5877

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-23 13:30:15 -05:00
exceptionfactory 5928d2048e
NIFI-9793 Added wait for Controller Service run status in tests
- Added check for controller-level service run status in disableControllerLevelServices to avoid HTTP 409 Conflict response when attempting to delete services

This closes #5863

Signed-off-by: Paul Grey <greyp@apache.org>
2022-03-21 16:13:32 -04:00
Joe Witt 0419dc2939
NIFI-9780-RC3 prepare for next development iteration 2022-03-21 11:58:27 -07:00
Joe Witt b019a9191f
NIFI-9780-RC3 prepare release nifi-1.16.0-RC3 2022-03-21 11:58:09 -07:00
Matthew Burgess c84f438782
NIFI-9800: Unwrap SQLException in PutDatabaseRecord when table does not exist
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5871
2022-03-21 14:00:13 -04:00
Mike Thomsen 2dc23e7309
NIFI-8521 Removed nifi-influxdb-nar package from nifi-assembly
This closes #5880

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-21 12:33:38 -05:00
Tamas Horvath a8cd7e5200
NIFI-9786 Added debug to KeyStoreUtils.isStoreValid
This closes #5884

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-21 10:48:00 -05:00
Mike Thomsen 2bb1a06a8c
NIFI-9788 Updated commons-codec to 1.15 across all modules.
This closes #5881

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-21 09:13:05 -05:00
在红尘中成仙 8d5de6b292
NIFI-9818 fix flaky tests
This closes #5883

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-21 08:23:40 -04:00
exceptionfactory 7823156606
NIFI-9815 Corrected log message formatting in multiple classes
This closes #5879

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-18 20:11:05 -04:00
Bryan Bende 193bcbe33a
NIFI-9806 Introduce ConfigurableExtensionDefinition and VersionedConfigurableExtension (#5875) 2022-03-18 08:43:17 -04:00
exceptionfactory ab0d2c2f72
NIFI-9807 Added Refresh Window Property to OAuth2 Token Provider
- Removed hard-coded expiry margin from AccessToken.isExpired() determination

This closes #5876

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-18 08:32:05 -04:00
Tamas Palfy fc30b649cc
NIFI-9801 Fixed error in previous correction of AccessToken.isExpired() margin calculation
NIFI-9801 Stabilized shaky AccessTokenTest.

This closes #5872

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-17 20:01:32 -04:00
exceptionfactory e17a436797
NIFI-9662 Remove unused mail-1.4.7 dependency from nifi-framework-bundle
This closes #5873

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-17 14:38:57 -04:00
exceptionfactory 412e21be97
NIFI-9281 Enabled building on Java 17
- Added Ubuntu Zulu JDK 17 GitHub build
- Adjusted MiNiFi C2 FileSystemConfigurationCache test to avoid using environment variables
- Adjusted MiNiFi StatusLogger and StatusLoggerTest to avoid overriding private logger
- Adjusted failure reason attribute check in TestGetIgniteCache
- Adjusted TestRangerAuthorizer and TestRangerNiFiAuthorizer to avoid checking nested exceptions
- Adjusted encrypt-config TestUtil to avoid unnecessary comparison of different types
- Disabled Javascript tests on Java 15 and higher
- Disabled several Hive 3 tests on Java 17 for StringInternUtils illegal access
- Refactored nifi-enrich-processors tests to use Mockito without Powermock
- Refactored nifi-toolkit-tls tests to avoid illegal reflective access
- Removed deprecated X509Certificate test in CertificateUtilsTest
- Removed kryo serialization from nifi-site-to-site-client test
- Updated TestHashContent to use SHA-1 instead of SHA for hash algorithm
- Upgraded maven-war-plugin from 2.5 to 3.3.2
- Upgraded nifi-graph-bundle dependencies from Groovy 2.5.14 to 3.0.8
- Upgraded QuestDB from 4.2.1 to 6.2.1 in nifi-framework-core

This closes #5870

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-17 14:08:38 -04:00
Matthew Burgess a4a46d50c3
NIFI-9316: Registry Sort by label should be 'Last Updated (newest)' not 'Newest (update)'
NIFI-9316: Incorporated review comments
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5496
2022-03-16 14:25:32 -04:00
Paul Grey a0fc7f5e61
NIFI-9799 Enabled style checking for nifi-system-tests in ci-workflow
This closes #5869

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-16 10:53:35 -05:00
exceptionfactory 77c45cabc5 NIFI-9797 Corrected AccessToken.isExpired() margin calculation
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5867.
2022-03-14 18:31:44 -04:00
exceptionfactory 36b3f18424
NIFI-9796 This closes #5866. Updated Registry Security Configuration to avoid warnings
- Replaced WebSecurity.ignoring().antMatchers() with HttpSecurity.authorizeRequests().antMatchers()

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-03-14 12:52:36 -07:00
markap14 21922af90c
NIFI-9794: If a node is OFFLOADING, do not allow connections to be deleted. Also if we fail to notify the node that it needs to offload its data, change its state back to DISCONNECTED. (#5865) 2022-03-14 15:45:02 -04:00
Nathan Gough a7edabb4ff
NIFI-9590 Added support for sensitive properties in Azure authorizers to encrypt-config
This closes #5833

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-14 12:15:11 -05:00
Paul Grey a7abe6d722 NIFI-9795 - checkstyle, rat issues in nifi-system-test-suite module
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5864.
2022-03-14 13:08:03 -04:00
Nathan Gough 713e2fd03c
NIFI-9645 - Updated PutSplunk to allow idle connection timeouts
This closes #5841

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-14 11:15:16 -05:00
Mark Payne 7ff70706ee
NIFI-9790: This closes #5860. Fixed race condition in which SwappablePriorityQueue could attempt to access the 0th element of an empty collection
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-03-14 08:38:39 -07:00
Mike 237e481c4a
NIFI-9765 Added documentation that covers how to build a custom binar… (#5840)
* NIFI-9765 Added documentation that covers how to build a custom binary distribution of NiFi for internal use by NiFi users.

* Added 'clean' to Maven command example.

* NIFI-9765 Updated content based on review.

* Two updates requested in a review.
2022-03-14 08:51:16 -04:00
Bryan Bende e226d3be52
NIFI-9791 Use maven.build.timestamp during manifest generation instead of buildhelper timestamp
This closes #5861

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-12 12:04:28 -05:00
David Young d424537c53
NIFI-8899 - Add NiFi Registry version information to the Registry under an "about" button. (#5743)
* NIFI-8899 - Add NiFi Registry version information to the Registry under an "about" button.

Add a new endpoint to the registry API that serves up the project version.
Add a new "about" button to the Registry layout that shows a dialog with
version information.

* NIFI-8899 - Change where the version information is retrieved from

Change from pulling the version information from the POM itself, set by having maven filter the properties file at build time, to getting it from the `NiFiRegistryApiApplication` class's `getImplementationVersion` method.

* NIFI-8899 - Remove unused dependency

Left in an extra import

* NIFI-8899 - Rebase and update npm dependencies

Rebased on top of main, merged new dependencies
Updated and locking Sass to 1.49.7

* NIFI-8899 - Update typescript

Updated typescript to something more modern. (latest)

* NIFI-8899 - Change Version to RegistryVersion

Changed plain 'Version' to be more explicit about whose version: Registry
Changed the url endpoint from 'version' to 'about' to make it more clear it's
  not a versioned resource but information about the registry itself

* NIFI-8899 - Reflect new API in UI, look-and-feel, build-and-run script

API changes are now reflected in the UI
Bring the look-and-feel more inline with the Nifi about page.
  It's not perfect, but it looks much better than before.
Update the build-and-run script for the registry to not actually run the
  registry if the build didn't complete

* NIFI-8899 - Fix spacing, documentation

Removed unused import
Fixed param name in javadoc
Fixed spacing in HTML

* NIFI-8899 - Change to dialogService, fix styling

Changed close button to use raised accent styling
Moved dialog showing into nf-registry.api.js
Changed click call to show dialog using the api method
Showing the dialog now makes the api call before rendering.

* NIFI-8899 - Fixed styling, refactored the about dialog codepath

Changed close button to use raised primary style
Changed click call to use nf-regisry.js to call the api method
  Removed the extra call to show the dialog.
Removed some comments and outdated references

Merged #5743 into main.
2022-03-11 17:25:47 -08:00
exceptionfactory 6e974a1fd2
NIFI-9789 Upgraded Logback from 1.2.10 to 1.2.11
This closes #5858

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-11 18:01:45 -05:00
Nathan Gough 885c475f90
NIFI-9699 - Updated oidcCallback method to handle error cases. Added some unit tests.
This closes #5824

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-03-11 11:40:47 -06:00
Joe Witt 72fadf9e51
NIFI-9780 fixing many inconsistent pom project declarations and updated org apache parent version 2022-03-10 11:15:16 -07:00
exceptionfactory 859d5fe8cf NIFI-9785 Improved Login Credentials Writer File Handling
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5856.
2022-03-10 11:47:32 -05:00
Bryan Bende 546f986603
NIFI-9775 Create RuntimeManifestService
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5849.
2022-03-10 07:52:16 -05:00
Peter Turcsanyi 92202a5b95
NIFI-9764: Atlas reporting task sends 'unknown' hive_table when table is name not available
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5839.
2022-03-10 13:16:24 +01:00
Mike Thomsen df00cc6cb5
NIFI-6047 Cleaned up code to allow tests to run against 1.13.0-snapshot
Removed DMC.
NIFI-6047 Started integrating changes from NIFI-6014.
NIFI-6047 Added DMC tests.
NIFI-6047 Added cache identifier recordpath test.
NIFI-6047 Added additional details.
NIFI-6047 Removed old additional details.
NIFI-6047 made some changes requested in a follow up review.
NIFI-6047 latest.
NIFI-6047 Finished updates
First round of code review cleanup
Latest
Removed EL from the dynamic properties.
Finished code review requested refactoring.
Checkstyle fix.
Removed a Java 11 API
NIFI-6047 Renamed processor to DeduplicateRecord

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #4646
2022-03-09 19:06:44 -05:00
Adam 23132fb89f
NIFI-6047
Added NiFi DetectDuplicateRecord standard processor.
Adding some documentation and PR review tweaks.
Exposing processor
Documentation updates, exception handling consolidation, added support for record path field variables.
Added tests.
Build bump.
Migrated cache service to groovy folder.
Moved declarations for properties to @BeforeClass lifecycle method.
Adding some documentation and PR review tweaks.
Documentation updates, exception handling consolidation, added support for record path field variables.
Added tests.
Build bump.
Migrated cache service to groovy folder.
Fixed variable type bug.
Fixed mapping of test params to usage.
Fixed potential illegal state exception bug.
2022-03-09 19:06:08 -05:00
Joe Witt df2f1f3b49
NIFI-9780 updating docker file versions 2022-03-09 13:35:25 -07:00
exceptionfactory 4a46b087b8
NIFI-9782 This closes #5854. Excluded H2 DB from nifi-druid-bundle
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-03-09 13:26:54 -07:00
Mark Payne 73356ea448
NIFI-9783: This closes #5855. When migrating FlowFiles from one ProcessSession to another, if any FlowFile had already been transferred, and the Relationship to which it was transferred was auto-terminated, we were updating the wrong member variable, which threw off our stats for the processor. Fixed that.
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-03-09 13:26:32 -07:00
exceptionfactory c73573b325
NIFI-9761 Correct PeerChannel processing for TLS 1.3 (#5836)
* NIFI-9761 Corrected PeerChannel processing for TLS 1.3
- Added TestPeerChannel with methods for TLS 1.2 and TLS 1.3
- Updated PeerChannel.close() to process SSLEngine close notification
- Improved logging and corrected handling after decryption
2022-03-09 15:15:52 -05:00
Mark Payne 6a1c7c72d5
NIFI-9781: Fix handling when selecting array element via QueryRecord
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5853.
2022-03-09 13:07:15 -05:00