Commit Graph

6969 Commits

Author SHA1 Message Date
Chris Sampson b0b1a57b98
NIFI-9222 allow ControllerStatusReportingTask to log details even when there are no Counters present on Processors (#5573) 2022-01-05 16:28:12 -05:00
exceptionfactory d783e10e68
NIFI-9537 Upgraded Spring Data Redis to 2.6.0
- Upgraded Jedis from 3.6.3 to 3.8.0

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5633.
2022-01-05 18:58:16 +01:00
exceptionfactory 7c407cf580
NIFI-9523 Consolidated Maven Enforcer Plugin executions
- Removed duplicative Enforcer Plugin configuration from nifi-registry

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5623.
2022-01-05 16:02:01 +01:00
exceptionfactory 81e57c9651
NIFI-9535 Upgraded Spring Framework to 5.3.14
- Centralized Spring Framework and Spring Security versions using BOM dependencies
- Upgraded Spring Security from 5.5.2 to 5.6.1
- Upgraded Spring Boot from 2.5.5 to 2.5.8 in Registry
- Upgraded Spring Integration from 5.5.2 to 5.5.7

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5631.
2022-01-05 15:30:03 +01:00
exceptionfactory abd154026e
NIFI-9534 Upgraded Log4j 2 BOM from 2.17.0 to 2.17.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5629.
2022-01-05 15:21:45 +01:00
Andrew Lim f80e2ec70b
NIFI-9532 Correct error in allDelineatedValues table in EL Guide
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5628.
2022-01-05 15:19:26 +01:00
Lehel Boér be138ab656
NIFI-9434: Added bulletin to alert FileSystemRepository backpressure (#5596) 2022-01-04 15:59:32 -05:00
Peter Turcsanyi 4346dd8faf
NIFI-9391: Modified MergeRecord to process FlowFiles within a loop in… (#5550)
* NIFI-9391: Modified MergeRecord to process FlowFiles within a loop in a single onTrigger

MergeRecord processed the FlowFiles in multiple onTrigger-s and it needed an extra onTrigger call
(with no incoming FFs) to realize that no more FFs are available and it is time to send the merged FF downstream.
It was not compatible with Stateless Runtime which does not trigger the flow any more if no FFs available.

Also changed "unschedule" logic in StandardProcessorTestRunner: @OnUnscheduled methods were called immediately after
the 1st FlowFile was processed. Unschedule the processor only at the end of the execution (onTrigger finished)
and only if stopOnFinish has been requested by the test case.
2022-01-04 11:36:56 -05:00
Zoltán Kornél Török e54cbe6451
NIFI-9524 exclude commons-logging and log4j-core banned dependencies for other build profiles as well (#5625) 2022-01-04 09:14:04 -05:00
Vibhath Ileperuma 0ac8f1b32c
NIFI-8605 Adding a new property for ExecuteSQL and ExecuteSQLRecord processors to enable/disable auto committing
change the default value of auto commit function to true
Changed the auto commit property name and add more details in the description
If the auto commit is set to false, commit() is called for consistency
adds unit tests
Fix the check style issue of having more than 200 characters in single line

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5554
2021-12-30 18:35:50 -05:00
Bryan Bende d6efc69585
NIFI-9502 Move extension manifest model and parser out of nifi-registry and into common modules
NIFI-9502 Move ExtensionManifest parser and impl from nifi registry into common module

NIFI-9502 Add jigsaw profile to nifi-extension-manifest-model in order to build on Java 11

Add apache license header to test resources

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5619
2021-12-22 10:46:59 -05:00
Paul Grey 0d49371c53
NIFI-7371 Added FlowFile attributes for exceptions in S3 processors
This closes #5606

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-21 22:35:31 -06:00
Olivier Dupré 4ee5bb65b8
NIFI-9445: Minor formatting improvements in developer guide.
This closes #5575

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-21 22:32:16 -06:00
Bryan Bende 0f02dac3fa
NIFI-9452 Generate a RuntimeManifest for NiFi at build time
- Write additional fields to extnesion-manifest.xml for processors
- Update C2 model classes to support new fields for processors, properties, and scheduling
- Create converter between NiFi model and C2 model
- Create generator and execute during the build

Add profile to nifi-assembly that skips the binary assembly, update github workflow to enable this profile instead of excluding nifi-assembly

Add additional documentation on new fields in processor definition and reporting task definition

Set charset to UTF-8 on the OutputStreamWriter

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5612
2021-12-21 16:35:15 -05:00
exceptionfactory 9747d6a410
NIFI-9509 This closes #5618. Added PatchedSFTPEngine to correct SFTP rename flags handling
- SSHJ 0.32.0 introduced support for rename flags in SFTP commands without checking the protocol version
- PatchedSFTPEngine overrides the rename method to check the SFTP protocol version

Signed-off-by: Joe Witt <joewitt@apache.org>
2021-12-21 12:14:23 -07:00
exceptionfactory 4f28b28ba2
NIFI-9507 This closes #5617. Corrected SSH Client handling on connect failures
- Refactored SSH Client configuration and connection to SSHClientProvider
- Implemented exception handling for configuration and connection failures
- Named SSH keep-alive thread for improved runtime tracking
- Closed SSH Client and interrupted keep-alive thread on configuration failures
- Added missing Compression Property to ListSFTP
- Corrected Hostname and Port property descriptors in ListSFTP

Signed-off-by: Joe Witt <joewitt@apache.org>
2021-12-20 20:23:31 -07:00
Adam Kocsis f85ae68fb5
NIFI-8821 Registry - Sorting the grid-list no longer expands the listed buckets (#5611)
* [NIFI-8821] Registry - Sorting the grid-list no linger expands the listed buckets

- gitignore is added to support dev UI run with npm

* - trackByFn is specified for ngForOf to help td-expansion-panel to track elements after sorting

* - adding trackByFn to all grid list view component codes

Merged #5611 into main.
2021-12-20 09:13:29 -08:00
exceptionfactory 9dd6b5f3e5
NIFI-9483 This closes #5616. Excluded Log4j 2 log4j-core and related libraries
- Added log4j-core to list of banned dependencies
- Added log4j-to-slf4j for Elasticsearch 5 processors to support runtime logging

Signed-off-by: Joe Witt <joewitt@apache.org>
2021-12-20 10:02:08 -07:00
exceptionfactory bda48b3f87 NIFI-9504 Upgraded Logback from 1.2.8 to 1.2.9
NIFI-9505 Upgraded Log4j 2 from 2.16.0 to 2.17.0

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #5615
2021-12-19 18:19:19 +00:00
Mark Payne 20392d5ef4
NIFI-9503: Fixed issue in system-tests
- Fixed system-tests workflow so that troubleshooting info is always uploaded for failures

This closes #5614

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-18 19:59:54 -06:00
Joe Gresock 66f36eaf5a NIFI-9461: Correcting equality comparison in Parameter update test
This closes #5609.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-12-17 18:05:35 +01:00
exceptionfactory be9f254056
NIFI-9497 Upgraded Bouncy Castle from 1.69 to 1.70
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5610.
2021-12-17 17:31:47 +01:00
exceptionfactory 7c6bdcb035
NIFI-9491 Excluded commons-logging and added jcl-over-slf4j references
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5608
2021-12-17 07:21:03 -05:00
Joe Gresock 7d8f99a1f4
NIFI-9461: Allowing Parameter descriptions to be changed (#5603)
Merged #5603 into main.
2021-12-16 17:09:26 -08:00
exceptionfactory 784ee680d5
NIFI-9495 Corrected BulletinMergerTest using static timestamps
- Replaced JUnit 4 and TestNG references with JUnit 5
- Added test method for bulletin sorting

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5607
2021-12-16 18:44:07 -05:00
Shane Ardell 293919f881
NIFI-9460: Update Lodash to 4.17.21 (#5605)
* NIFI-9460: update lodash transitive dep in registry

* NIFI-9460: use lodash instead of lodash-core

Merged #5605 into main.
2021-12-16 14:28:02 -08:00
Pierre Villard 8638b7c0d8
NIFI-9466 - PublishKafka 2.x - change default delivery guarantee from best effort to replicated
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5586
2021-12-16 15:10:32 -05:00
Pierre Villard 03cf976c07
NIFI-9467 - Update description for DefaultPartitioner in PublishKafka 2.6 to mention sticky partitioning
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5587
2021-12-16 15:07:55 -05:00
Nathan Gough 5e9c86885c
NIFI-9478 Moved Netty Log Exception Handler to end of pipeline
- Changed display name of Max Number of TCP Connections to Max Number of Worker Threads for ListenTCP
- Set Netty Socket Receive Buffer using Max Socket Buffer Size in ListenTCP

This closes #5599

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-15 16:59:07 -06:00
Pierre Villard 90930ca197
NIFI-9476 - Fix QueryRecord when no result and with array type column
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5594
2021-12-15 17:37:24 -05:00
Bryan Bende e7449bf0d3
NIFI-9486 This closes #5604. Add compile scope to logging deps in nifi-registry-assembly
NIFI-9486 Add compile scope to logging deps in minifi-assembly

This commit is 2 of 2.

Signed-off-by: Joe Witt <joewitt@apache.org>
2021-12-14 13:17:37 -07:00
Bryan Bende 09f254c611
NIFI-9486 This closes #5604. Upgrade to logback 1.2.8, remove unnecessary dependencyManagement entries in minifi and nifi-registry in favor of root pom
Remove unnecessary use of slf4j-simple
2021-12-14 12:32:32 -07:00
exceptionfactory 1321b25f66
NIFI-9482 This closes #5600. Upgrade Log4j 2 from 2.15.0 to 2.16.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-12-13 14:12:11 -07:00
M Tien 3d5f357de8
[NIFI-9423-NIFI-9429]: Show icon and tooltip for Parameters with leading and/or trailing whitespace (#5569)
* NIFI-9423 - Show icon and tooltip for Parameter values that have leading and/or trailing whitespaces

NIFI-9429 - Parameters should allow blank values that are non-null (only whitespace)

* - Update areas to clean up tooltips in parameter values
- Show whitespaces and ellipsis in parameter and property values and tooltips
- Update serializeValue to accommodate for blank values

* - Address review findings

* - Remove commented out code

* - Add multiline check for ellipsis

* NIFI-9459 - Empty string checked will disable Edit Parameter value field on dialog open

* - Add multi-line style to parameter and property table

* - Safely insert title attribute content

* - Fix Edit Parameter bug that clears textarea for sensitive and empty string values on dialog open

This closes #5569
2021-12-13 16:01:42 -05:00
Bryan Bende b5414ab195
NIFI-9474 Block log4j-core older than 2.15.0
- Add log4j-bom to root Maven configuration
- Remove previous overrides in favor of log4j-bom in root Maven configuration

This closes #5598

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-13 10:54:45 -06:00
Joe Gresock 429087c11d
NIFI-9386: Adding status task schedule to Stateless engine config
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5532.
2021-12-13 12:08:54 +01:00
Joe Gresock f3c7537d9b
NIFI-9343: Adding config verification to GCP processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5494.
2021-12-11 19:58:01 +01:00
Joe Gresock f07c37285e NIFI-9353: Adding Config Verification to AWS Processors
This closes #5504
2021-12-11 14:33:23 +00:00
Pierre Villard 6f22d3ad11
NIFI-9474 - Upgrade additional Log4j references to 2.15.0
This closes #5595

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-10 21:47:12 -06:00
Mikayla Yang 24422c4ec8
NIFI-9259: Adding GeohashRecord Processor (#5476) 2021-12-10 16:57:23 -05:00
Matthew Burgess b578f183cb
NIFI-9430: Create initial C2 structure, add c2-protocol-api module (#5563)
* NIFI-9430: Create initial C2 structure, add c2-protocol-api module

* NIFI-9430: Incorporated review comments

* NIFI-9430: More refactor per review comments

* NIFI-9430: Additional review comments

* NIFI-9430: Restore Objects from primitives for serialization

* NIFI-9430: Restore API names for compatibility

* NIFI-9430: Set remaining serialization versions to 1
2021-12-10 09:12:38 -05:00
Pierre Villard 8fdde86997
NIFI-9474 - Upgrade Log4j references to 2.15.0
This closes #5592

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-10 08:00:23 -06:00
Pierre Villard f7a300d27d
NIFI-9473 - Upgrade Jackson from 2.12.3 to 2.12.5
This closes #5591

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-10 07:43:48 -06:00
Pierre Villard 7dc0f847bd
NIFI-9468 - Bump Kafka client from 2.6.0 to 2.6.3
This closes #5588

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-10 06:59:43 -06:00
Pierre Villard a475e7e4e2
NIFI-9450 Correct Admin Guide documentation about diagnostics
This closes #5585

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-10 06:48:48 -06:00
exceptionfactory b7ad1f924d
NIFI-9457 Support microseconds for String Timestamps in PutKudu
- Implemented override for Timestamp Record Field Type format handling to add support for optional microseconds
- Added FieldConverter and ObjectTimestampFieldConverter implementation for generalized Timestamp parsing using DateTimeFormatter
- Updated PutKudu unit tests for standard Timestamp and Timestamp with microseconds

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5589.
2021-12-10 10:31:52 +01:00
exceptionfactory 3d3f6ac070
NIFI-9471 Corrected PutKudu usage of DataTypeUtils.toString()
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5590.
2021-12-10 10:26:59 +01:00
Lehel f5dccb5522 NIFI-9444: Added reconnect property to JettyWebsocketClient.
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5583.
2021-12-09 16:13:15 -05:00
Mark Payne 97198e35a0
NIFI-9382: This closes #5584. Added system test that replicates issue in which a closed shared classloader causes issues when used again
NIFI-9382: Fixed issue with SharedInstanceClassLoader where the classloader may get closed but then get used again. When the SharedInstanceClassLoader is closed, we will now ensure that we don't use anymore and instead create a new one.

Signed-off-by: Joe Witt <joewitt@apache.org>
2021-12-09 12:41:57 -07:00
Yiming Li c1bb0c0c34
NIFI-9417: Update BulletinMergerTest.java
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5572
2021-12-09 13:27:35 -05:00