Commit Graph

7097 Commits

Author SHA1 Message Date
exceptionfactory 7c6bdcb035
NIFI-9491 Excluded commons-logging and added jcl-over-slf4j references
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5608
2021-12-17 07:21:03 -05:00
Joe Gresock 7d8f99a1f4
NIFI-9461: Allowing Parameter descriptions to be changed (#5603)
Merged #5603 into main.
2021-12-16 17:09:26 -08:00
exceptionfactory 784ee680d5
NIFI-9495 Corrected BulletinMergerTest using static timestamps
- Replaced JUnit 4 and TestNG references with JUnit 5
- Added test method for bulletin sorting

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5607
2021-12-16 18:44:07 -05:00
Shane Ardell 293919f881
NIFI-9460: Update Lodash to 4.17.21 (#5605)
* NIFI-9460: update lodash transitive dep in registry

* NIFI-9460: use lodash instead of lodash-core

Merged #5605 into main.
2021-12-16 14:28:02 -08:00
Pierre Villard 8638b7c0d8
NIFI-9466 - PublishKafka 2.x - change default delivery guarantee from best effort to replicated
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5586
2021-12-16 15:10:32 -05:00
Pierre Villard 03cf976c07
NIFI-9467 - Update description for DefaultPartitioner in PublishKafka 2.6 to mention sticky partitioning
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5587
2021-12-16 15:07:55 -05:00
Nathan Gough 5e9c86885c
NIFI-9478 Moved Netty Log Exception Handler to end of pipeline
- Changed display name of Max Number of TCP Connections to Max Number of Worker Threads for ListenTCP
- Set Netty Socket Receive Buffer using Max Socket Buffer Size in ListenTCP

This closes #5599

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-15 16:59:07 -06:00
Pierre Villard 90930ca197
NIFI-9476 - Fix QueryRecord when no result and with array type column
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5594
2021-12-15 17:37:24 -05:00
Bryan Bende e7449bf0d3
NIFI-9486 This closes #5604. Add compile scope to logging deps in nifi-registry-assembly
NIFI-9486 Add compile scope to logging deps in minifi-assembly

This commit is 2 of 2.

Signed-off-by: Joe Witt <joewitt@apache.org>
2021-12-14 13:17:37 -07:00
Bryan Bende 09f254c611
NIFI-9486 This closes #5604. Upgrade to logback 1.2.8, remove unnecessary dependencyManagement entries in minifi and nifi-registry in favor of root pom
Remove unnecessary use of slf4j-simple
2021-12-14 12:32:32 -07:00
exceptionfactory 1321b25f66
NIFI-9482 This closes #5600. Upgrade Log4j 2 from 2.15.0 to 2.16.0
Signed-off-by: Joe Witt <joewitt@apache.org>
2021-12-13 14:12:11 -07:00
M Tien 3d5f357de8
[NIFI-9423-NIFI-9429]: Show icon and tooltip for Parameters with leading and/or trailing whitespace (#5569)
* NIFI-9423 - Show icon and tooltip for Parameter values that have leading and/or trailing whitespaces

NIFI-9429 - Parameters should allow blank values that are non-null (only whitespace)

* - Update areas to clean up tooltips in parameter values
- Show whitespaces and ellipsis in parameter and property values and tooltips
- Update serializeValue to accommodate for blank values

* - Address review findings

* - Remove commented out code

* - Add multiline check for ellipsis

* NIFI-9459 - Empty string checked will disable Edit Parameter value field on dialog open

* - Add multi-line style to parameter and property table

* - Safely insert title attribute content

* - Fix Edit Parameter bug that clears textarea for sensitive and empty string values on dialog open

This closes #5569
2021-12-13 16:01:42 -05:00
Bryan Bende b5414ab195
NIFI-9474 Block log4j-core older than 2.15.0
- Add log4j-bom to root Maven configuration
- Remove previous overrides in favor of log4j-bom in root Maven configuration

This closes #5598

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-13 10:54:45 -06:00
Joe Gresock 429087c11d
NIFI-9386: Adding status task schedule to Stateless engine config
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5532.
2021-12-13 12:08:54 +01:00
Joe Gresock f3c7537d9b
NIFI-9343: Adding config verification to GCP processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5494.
2021-12-11 19:58:01 +01:00
Joe Gresock f07c37285e NIFI-9353: Adding Config Verification to AWS Processors
This closes #5504
2021-12-11 14:33:23 +00:00
Pierre Villard 6f22d3ad11
NIFI-9474 - Upgrade additional Log4j references to 2.15.0
This closes #5595

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-10 21:47:12 -06:00
Mikayla Yang 24422c4ec8
NIFI-9259: Adding GeohashRecord Processor (#5476) 2021-12-10 16:57:23 -05:00
Matthew Burgess b578f183cb
NIFI-9430: Create initial C2 structure, add c2-protocol-api module (#5563)
* NIFI-9430: Create initial C2 structure, add c2-protocol-api module

* NIFI-9430: Incorporated review comments

* NIFI-9430: More refactor per review comments

* NIFI-9430: Additional review comments

* NIFI-9430: Restore Objects from primitives for serialization

* NIFI-9430: Restore API names for compatibility

* NIFI-9430: Set remaining serialization versions to 1
2021-12-10 09:12:38 -05:00
Pierre Villard 8fdde86997
NIFI-9474 - Upgrade Log4j references to 2.15.0
This closes #5592

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-10 08:00:23 -06:00
Pierre Villard f7a300d27d
NIFI-9473 - Upgrade Jackson from 2.12.3 to 2.12.5
This closes #5591

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-10 07:43:48 -06:00
Pierre Villard 7dc0f847bd
NIFI-9468 - Bump Kafka client from 2.6.0 to 2.6.3
This closes #5588

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-10 06:59:43 -06:00
Pierre Villard a475e7e4e2
NIFI-9450 Correct Admin Guide documentation about diagnostics
This closes #5585

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-10 06:48:48 -06:00
exceptionfactory b7ad1f924d
NIFI-9457 Support microseconds for String Timestamps in PutKudu
- Implemented override for Timestamp Record Field Type format handling to add support for optional microseconds
- Added FieldConverter and ObjectTimestampFieldConverter implementation for generalized Timestamp parsing using DateTimeFormatter
- Updated PutKudu unit tests for standard Timestamp and Timestamp with microseconds

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5589.
2021-12-10 10:31:52 +01:00
exceptionfactory 3d3f6ac070
NIFI-9471 Corrected PutKudu usage of DataTypeUtils.toString()
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5590.
2021-12-10 10:26:59 +01:00
Lehel f5dccb5522 NIFI-9444: Added reconnect property to JettyWebsocketClient.
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5583.
2021-12-09 16:13:15 -05:00
Mark Payne 97198e35a0
NIFI-9382: This closes #5584. Added system test that replicates issue in which a closed shared classloader causes issues when used again
NIFI-9382: Fixed issue with SharedInstanceClassLoader where the classloader may get closed but then get used again. When the SharedInstanceClassLoader is closed, we will now ensure that we don't use anymore and instead create a new one.

Signed-off-by: Joe Witt <joewitt@apache.org>
2021-12-09 12:41:57 -07:00
Yiming Li c1bb0c0c34
NIFI-9417: Update BulletinMergerTest.java
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5572
2021-12-09 13:27:35 -05:00
Peter Turcsanyi dafa03a21a
NIFI-9421: Running NiFi Stateless with local NARs only
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5557.
2021-12-08 15:59:31 -05:00
Lehel Boér bf288f3ba1
NIFI-9454: Moved file renaming after closing the OutputStream in StandardFlowConfigurationDAO (#5581) 2021-12-08 13:38:45 -05:00
exceptionfactory 563df24067
NIFI-9448 Improved S2S HTTP Extend Transaction Exception Handling
- Refactor background transaction extension to ExtendTransactionCommand
- Avoid closing S2S HTTP client for IllegalStateExceptions
- Avoid creating additional S2S HTTP client instance for transaction extension commands
- Add check for extend transaction requests received in client test class
- Add null check for Peer Persistence implementation in PeerSelector

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5577.
2021-12-08 09:33:55 -05:00
Bence Simon 12015a17dd
NIFI-9397 Added Custom Authorization property to JettyWebSocketClient
This closes #5574

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-07 10:54:58 -06:00
ahmed shaaban 70822b9c8d
NIFI-9093 This closes #5578. GetSplunk Processor hangs addressed by adding timeouts.
changed the required flag to false on ConnectTimeout and ReadTimeout properties

Signed-off-by: Joe Witt <joewitt@apache.org>
2021-12-07 08:17:31 -07:00
Lehel 1eb4264e34 NIFI-9447: Fix SNMP related tests to find available UDP ports instead of TCP
This closes #5576.

Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
2021-12-06 21:00:40 +01:00
Bryan Bende 0f027743d1
NIFI-9443 Update NAR plugin to 1.3.3 and update data model for extension manifest to capture new fields
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5570.
2021-12-06 08:58:40 -05:00
Chris Sampson 53809dd83f
NIFI-9439:
- Add PutElasticsearchJson processor to Elasticsearch REST bundle
- Deprecate PutElasticsearchHttp/PutElasticsearchHttpReccord in favour of Elasticsearch REST processors

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5566.
2021-12-05 15:39:35 -05:00
Mark Payne 2a3f7dafd6
NIFI-9442: When deleting a connection, ensure that when the source of the connection is a funnel that its upstream components are checked (recursively)
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5568.
2021-12-05 06:39:52 -05:00
Mark Payne 7a83c32a01
NIFI-9441: Ensure that we only update our member variable for the latest timestamp after processing all objects within the GCS Bucket
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5567.
2021-12-04 23:49:27 +01:00
exceptionfactory 41ff6f076b NIFI-9409 Updated links for EVP BytesToKey and PBKDF2 2021-12-03 13:27:34 -05:00
Mark Payne f95044ff87
NIFI-9433: When a Connection is unregistered from the NioAsyncLoadBalanceClient, make sure that we only cancel its active transaction if the transaction belongs to the appropriate connection. Also ensure that when we do cancel a transaction / call its failure callback, we purge the collection of any FlowFiles that have been sent in that transaction. This ensures that we cannot later attempt to failure the transaction again, decrementing the count of FlowFiles for the connection more than we should.
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5564.
2021-12-03 10:31:31 -05:00
Mark Payne 90b39b593a
NIFI-9069 Changed framework dataflow serialization to support JSON
- Changed framework so that it serializes the dataflow into a VersionedDataflow using JSON as well as XML, and prefers the JSON representation on load, if it's available. This also results in the need for the cluster protocol to exchange its representation of the dataflow to using JSON. Rather than re-implementing all of the complex logic of Flow Fingerprinting, updated to just inherit the cluster's flow.
- Moved logic to synchronize Process Group with Versioned Process Group into a new ProcessGroupSynchronizer class instead of having all of the logic within StandardProcessGroup
- Reworked versioned components to use an instance id.
- Renamed StandardFlowSynchronizer to XmlFlowSynchronizer; introduced new StandardFlowSynchronizer that delegates to the appropriate (Xml or Versioned)FlowSynchronzer
- Updated to allow import of VersionedProcessGroup even if not all bundles are available - will now use ghost components
- Introduced a VersionedDataflow object to hold controller-level services, reporting tasks, parameter contexts, templates, etc.
- Allow mutable requests to be made while nodes are disconnected. Also fixed issue in AbstractPolicyBasedAuthorizer that caused ClassNotFoundException / NoClassDefFoundError if the authorizations were changed and then a node attempts to rejoin the cluster. The Authorizer was attempting to use XmlUtils, which is in nifi-security-utils and so so by madking nifi-security-utils a provided dependency of nifi-framework-api, but this doesn't work, because nifi-framework-api is loaded by a higher-level classloader, so the classloader that loads AbstractPolicyBasedAuthorizer will never have the appropriate classloader to provide nifi-security-utils. Addressed this by copying the code for creating a safe document builder from XmlUtils to AbstractPolicyBasedAuthorizer.
- Fixed bug that occurred when importing a Process Group that has 2 parameter contexts, one inheriting from another, where neither is pre-defined in the existing flow
- Fixed bug that was encountered when Updating a Versioned Process Group where one version had a disabled processor and the other had the processor running.
- Increased system-tests workflow timeout to 120 minutes
- Added additional exception handling to system tests

This closes #5514

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-12-02 15:10:38 -06:00
Pierre Villard fede6b9354
NIFI-9432 - fix typo in diagnostic output (#5562) 2021-12-02 15:25:23 -05:00
Tamas Palfy ff864266f5
NIFI-9436 - In AbstractPutHDFSRecord make sure the record writers use the FileSystem object the processor already has.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5565
2021-12-02 14:24:12 -05:00
M Tien 2b415de912
NIFI-9336 - Show icon for property values with leading or trailing whitespace (#5559)
* NIFI-9336 - Show icon in processor and controller services configurations when property values contain leading or trailing whitespace

* - Address PR feedback

* - Fix a bug to clean up tooltips to prevent a DOM leak

This closes #5559
2021-12-02 13:31:19 -05:00
Chris Sampson d45b23d89f
NIFI-8153 custom date/time format properties for PutElasticsearchRecord
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5552.
2021-12-01 07:28:41 -05:00
exceptionfactory 2844652f72
NIFI-9426 Removed unused jackson-mapper-asl from MiNiFi
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5561
2021-11-30 20:39:04 -05:00
exceptionfactory 55e91d607c
NIFI-9420 Upgraded MiNiFi Guava from 26.0 to 31.0.1
- Replaced usage of Guava Lists with standard Java classes in TemplatesIteratorTest

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5556
2021-11-30 15:02:08 -05:00
Matthew Burgess 07c4a05cdf
NIFI-9412: Autogenerate sensitive key in MiNiFi if not present
This closes #5558

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-11-30 13:57:07 -06:00
Pierre Villard e6b573e79e
NIFI-9419 ParseCEF - Upgraded parcefone and supported empty extensions
- Upgraded com.fluenda:parcefone from 2.0.0 to 2.1.0
- Added Accept empty extensions property to ParseCEF

This closes #5555

Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-11-30 11:27:50 -06:00
exceptionfactory 6a6b755aaa
NIFI-9394 Removed RequestLogger and TimerFilter
- Removed logger references from logback.xml

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5543.
2021-11-29 12:55:39 -05:00