6952 Commits

Author SHA1 Message Date
exceptionfactory
9dd6b5f3e5
NIFI-9483 This closes #5616. Excluded Log4j 2 log4j-core and related libraries
- Added log4j-core to list of banned dependencies
- Added log4j-to-slf4j for Elasticsearch 5 processors to support runtime logging

Signed-off-by: Joe Witt <joewitt@apache.org>
2021-12-20 10:02:08 -07:00
exceptionfactory
bda48b3f87 NIFI-9504 Upgraded Logback from 1.2.8 to 1.2.9
NIFI-9505 Upgraded Log4j 2 from 2.16.0 to 2.17.0

Signed-off-by: Chris Sampson <chris.sampson82@gmail.com>

This closes #5615
2021-12-19 18:19:19 +00:00
Mark Payne
20392d5ef4
NIFI-9503: Fixed issue in system-tests
- Fixed system-tests workflow so that troubleshooting info is always uploaded for failures

This closes #5614

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-18 19:59:54 -06:00
Joe Gresock
66f36eaf5a NIFI-9461: Correcting equality comparison in Parameter update test
This closes #5609.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-12-17 18:05:35 +01:00
exceptionfactory
be9f254056
NIFI-9497 Upgraded Bouncy Castle from 1.69 to 1.70
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5610.
2021-12-17 17:31:47 +01:00
exceptionfactory
7c6bdcb035
NIFI-9491 Excluded commons-logging and added jcl-over-slf4j references
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5608
2021-12-17 07:21:03 -05:00
Joe Gresock
7d8f99a1f4
NIFI-9461: Allowing Parameter descriptions to be changed (#5603)
Merged #5603 into main.
2021-12-16 17:09:26 -08:00
exceptionfactory
784ee680d5
NIFI-9495 Corrected BulletinMergerTest using static timestamps
- Replaced JUnit 4 and TestNG references with JUnit 5
- Added test method for bulletin sorting

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5607
2021-12-16 18:44:07 -05:00
Shane Ardell
293919f881
NIFI-9460: Update Lodash to 4.17.21 (#5605)
* NIFI-9460: update lodash transitive dep in registry

* NIFI-9460: use lodash instead of lodash-core

Merged #5605 into main.
2021-12-16 14:28:02 -08:00
Pierre Villard
8638b7c0d8
NIFI-9466 - PublishKafka 2.x - change default delivery guarantee from best effort to replicated
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5586
2021-12-16 15:10:32 -05:00
Pierre Villard
03cf976c07
NIFI-9467 - Update description for DefaultPartitioner in PublishKafka 2.6 to mention sticky partitioning
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5587
2021-12-16 15:07:55 -05:00
Nathan Gough
5e9c86885c
NIFI-9478 Moved Netty Log Exception Handler to end of pipeline
- Changed display name of Max Number of TCP Connections to Max Number of Worker Threads for ListenTCP
- Set Netty Socket Receive Buffer using Max Socket Buffer Size in ListenTCP

This closes #5599

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-15 16:59:07 -06:00
Pierre Villard
90930ca197
NIFI-9476 - Fix QueryRecord when no result and with array type column
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5594
2021-12-15 17:37:24 -05:00
Bryan Bende
e7449bf0d3
NIFI-9486 This closes #5604. Add compile scope to logging deps in nifi-registry-assembly
NIFI-9486 Add compile scope to logging deps in minifi-assembly

This commit is 2 of 2.

Signed-off-by: Joe Witt <joewitt@apache.org>
2021-12-14 13:17:37 -07:00
Bryan Bende
09f254c611
NIFI-9486 This closes #5604. Upgrade to logback 1.2.8, remove unnecessary dependencyManagement entries in minifi and nifi-registry in favor of root pom
Remove unnecessary use of slf4j-simple
2021-12-14 12:32:32 -07:00
exceptionfactory
1321b25f66
NIFI-9482 This closes #5600. Upgrade Log4j 2 from 2.15.0 to 2.16.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-12-13 14:12:11 -07:00
M Tien
3d5f357de8
[NIFI-9423-NIFI-9429]: Show icon and tooltip for Parameters with leading and/or trailing whitespace (#5569)
* NIFI-9423 - Show icon and tooltip for Parameter values that have leading and/or trailing whitespaces

NIFI-9429 - Parameters should allow blank values that are non-null (only whitespace)

* - Update areas to clean up tooltips in parameter values
- Show whitespaces and ellipsis in parameter and property values and tooltips
- Update serializeValue to accommodate for blank values

* - Address review findings

* - Remove commented out code

* - Add multiline check for ellipsis

* NIFI-9459 - Empty string checked will disable Edit Parameter value field on dialog open

* - Add multi-line style to parameter and property table

* - Safely insert title attribute content

* - Fix Edit Parameter bug that clears textarea for sensitive and empty string values on dialog open

This closes #5569
2021-12-13 16:01:42 -05:00
Bryan Bende
b5414ab195
NIFI-9474 Block log4j-core older than 2.15.0
- Add log4j-bom to root Maven configuration
- Remove previous overrides in favor of log4j-bom in root Maven configuration

This closes #5598

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-13 10:54:45 -06:00
Joe Gresock
429087c11d
NIFI-9386: Adding status task schedule to Stateless engine config
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5532.
2021-12-13 12:08:54 +01:00
Joe Gresock
f3c7537d9b
NIFI-9343: Adding config verification to GCP processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5494.
2021-12-11 19:58:01 +01:00
Joe Gresock
f07c37285e NIFI-9353: Adding Config Verification to AWS Processors
This closes #5504
2021-12-11 14:33:23 +00:00
Pierre Villard
6f22d3ad11
NIFI-9474 - Upgrade additional Log4j references to 2.15.0
This closes #5595

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-10 21:47:12 -06:00
Mikayla Yang
24422c4ec8
NIFI-9259: Adding GeohashRecord Processor (#5476) 2021-12-10 16:57:23 -05:00
Matthew Burgess
b578f183cb
NIFI-9430: Create initial C2 structure, add c2-protocol-api module (#5563)
* NIFI-9430: Create initial C2 structure, add c2-protocol-api module

* NIFI-9430: Incorporated review comments

* NIFI-9430: More refactor per review comments

* NIFI-9430: Additional review comments

* NIFI-9430: Restore Objects from primitives for serialization

* NIFI-9430: Restore API names for compatibility

* NIFI-9430: Set remaining serialization versions to 1
2021-12-10 09:12:38 -05:00
Pierre Villard
8fdde86997
NIFI-9474 - Upgrade Log4j references to 2.15.0
This closes #5592

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-10 08:00:23 -06:00
Pierre Villard
f7a300d27d
NIFI-9473 - Upgrade Jackson from 2.12.3 to 2.12.5
This closes #5591

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-10 07:43:48 -06:00
Pierre Villard
7dc0f847bd
NIFI-9468 - Bump Kafka client from 2.6.0 to 2.6.3
This closes #5588

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-10 06:59:43 -06:00
Pierre Villard
a475e7e4e2
NIFI-9450 Correct Admin Guide documentation about diagnostics
This closes #5585

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-10 06:48:48 -06:00
exceptionfactory
b7ad1f924d
NIFI-9457 Support microseconds for String Timestamps in PutKudu
- Implemented override for Timestamp Record Field Type format handling to add support for optional microseconds
- Added FieldConverter and ObjectTimestampFieldConverter implementation for generalized Timestamp parsing using DateTimeFormatter
- Updated PutKudu unit tests for standard Timestamp and Timestamp with microseconds

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5589.
2021-12-10 10:31:52 +01:00
exceptionfactory
3d3f6ac070
NIFI-9471 Corrected PutKudu usage of DataTypeUtils.toString()
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5590.
2021-12-10 10:26:59 +01:00
Lehel
f5dccb5522 NIFI-9444: Added reconnect property to JettyWebsocketClient.
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5583.
2021-12-09 16:13:15 -05:00
Mark Payne
97198e35a0
NIFI-9382: This closes #5584. Added system test that replicates issue in which a closed shared classloader causes issues when used again
NIFI-9382: Fixed issue with SharedInstanceClassLoader where the classloader may get closed but then get used again. When the SharedInstanceClassLoader is closed, we will now ensure that we don't use anymore and instead create a new one.

Signed-off-by: Joe Witt <joewitt@apache.org>
2021-12-09 12:41:57 -07:00
Yiming Li
c1bb0c0c34
NIFI-9417: Update BulletinMergerTest.java
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5572
2021-12-09 13:27:35 -05:00
Peter Turcsanyi
dafa03a21a
NIFI-9421: Running NiFi Stateless with local NARs only
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5557.
2021-12-08 15:59:31 -05:00
Lehel Boér
bf288f3ba1
NIFI-9454: Moved file renaming after closing the OutputStream in StandardFlowConfigurationDAO (#5581) 2021-12-08 13:38:45 -05:00
exceptionfactory
563df24067
NIFI-9448 Improved S2S HTTP Extend Transaction Exception Handling
- Refactor background transaction extension to ExtendTransactionCommand
- Avoid closing S2S HTTP client for IllegalStateExceptions
- Avoid creating additional S2S HTTP client instance for transaction extension commands
- Add check for extend transaction requests received in client test class
- Add null check for Peer Persistence implementation in PeerSelector

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5577.
2021-12-08 09:33:55 -05:00
Bence Simon
12015a17dd
NIFI-9397 Added Custom Authorization property to JettyWebSocketClient
This closes #5574

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-07 10:54:58 -06:00
ahmed shaaban
70822b9c8d
NIFI-9093 This closes #5578. GetSplunk Processor hangs addressed by adding timeouts.
changed the required flag to false on ConnectTimeout and ReadTimeout properties

Signed-off-by: Joe Witt <joewitt@apache.org>
2021-12-07 08:17:31 -07:00
Lehel
1eb4264e34 NIFI-9447: Fix SNMP related tests to find available UDP ports instead of TCP
This closes #5576.

Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
2021-12-06 21:00:40 +01:00
Bryan Bende
0f027743d1
NIFI-9443 Update NAR plugin to 1.3.3 and update data model for extension manifest to capture new fields
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5570.
2021-12-06 08:58:40 -05:00
Chris Sampson
53809dd83f
NIFI-9439:
- Add PutElasticsearchJson processor to Elasticsearch REST bundle
- Deprecate PutElasticsearchHttp/PutElasticsearchHttpReccord in favour of Elasticsearch REST processors

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5566.
2021-12-05 15:39:35 -05:00
Mark Payne
2a3f7dafd6
NIFI-9442: When deleting a connection, ensure that when the source of the connection is a funnel that its upstream components are checked (recursively)
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5568.
2021-12-05 06:39:52 -05:00
Mark Payne
7a83c32a01
NIFI-9441: Ensure that we only update our member variable for the latest timestamp after processing all objects within the GCS Bucket
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5567.
2021-12-04 23:49:27 +01:00
exceptionfactory
41ff6f076b NIFI-9409 Updated links for EVP BytesToKey and PBKDF2 2021-12-03 13:27:34 -05:00
Mark Payne
f95044ff87
NIFI-9433: When a Connection is unregistered from the NioAsyncLoadBalanceClient, make sure that we only cancel its active transaction if the transaction belongs to the appropriate connection. Also ensure that when we do cancel a transaction / call its failure callback, we purge the collection of any FlowFiles that have been sent in that transaction. This ensures that we cannot later attempt to failure the transaction again, decrementing the count of FlowFiles for the connection more than we should.
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5564.
2021-12-03 10:31:31 -05:00
Mark Payne
90b39b593a
NIFI-9069 Changed framework dataflow serialization to support JSON
- Changed framework so that it serializes the dataflow into a VersionedDataflow using JSON as well as XML, and prefers the JSON representation on load, if it's available. This also results in the need for the cluster protocol to exchange its representation of the dataflow to using JSON. Rather than re-implementing all of the complex logic of Flow Fingerprinting, updated to just inherit the cluster's flow.
- Moved logic to synchronize Process Group with Versioned Process Group into a new ProcessGroupSynchronizer class instead of having all of the logic within StandardProcessGroup
- Reworked versioned components to use an instance id.
- Renamed StandardFlowSynchronizer to XmlFlowSynchronizer; introduced new StandardFlowSynchronizer that delegates to the appropriate (Xml or Versioned)FlowSynchronzer
- Updated to allow import of VersionedProcessGroup even if not all bundles are available - will now use ghost components
- Introduced a VersionedDataflow object to hold controller-level services, reporting tasks, parameter contexts, templates, etc.
- Allow mutable requests to be made while nodes are disconnected. Also fixed issue in AbstractPolicyBasedAuthorizer that caused ClassNotFoundException / NoClassDefFoundError if the authorizations were changed and then a node attempts to rejoin the cluster. The Authorizer was attempting to use XmlUtils, which is in nifi-security-utils and so so by madking nifi-security-utils a provided dependency of nifi-framework-api, but this doesn't work, because nifi-framework-api is loaded by a higher-level classloader, so the classloader that loads AbstractPolicyBasedAuthorizer will never have the appropriate classloader to provide nifi-security-utils. Addressed this by copying the code for creating a safe document builder from XmlUtils to AbstractPolicyBasedAuthorizer.
- Fixed bug that occurred when importing a Process Group that has 2 parameter contexts, one inheriting from another, where neither is pre-defined in the existing flow
- Fixed bug that was encountered when Updating a Versioned Process Group where one version had a disabled processor and the other had the processor running.
- Increased system-tests workflow timeout to 120 minutes
- Added additional exception handling to system tests

This closes #5514

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-02 15:10:38 -06:00
Pierre Villard
fede6b9354
NIFI-9432 - fix typo in diagnostic output (#5562) 2021-12-02 15:25:23 -05:00
Tamas Palfy
ff864266f5
NIFI-9436 - In AbstractPutHDFSRecord make sure the record writers use the FileSystem object the processor already has.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5565
2021-12-02 14:24:12 -05:00
M Tien
2b415de912
NIFI-9336 - Show icon for property values with leading or trailing whitespace (#5559)
* NIFI-9336 - Show icon in processor and controller services configurations when property values contain leading or trailing whitespace

* - Address PR feedback

* - Fix a bug to clean up tooltips to prevent a DOM leak

This closes #5559
2021-12-02 13:31:19 -05:00
Chris Sampson
d45b23d89f
NIFI-8153 custom date/time format properties for PutElasticsearchRecord
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5552.
2021-12-01 07:28:41 -05:00