3f0ef9e977
NIFI-10406: Updated Maven assemblies to ensure that we always use at least two of the GAVC parameters for includes and excludes. Updated Maven assembly plugin to version 3.4.2. Removed some includes and excludes from dependencies that previously were not matching and were generating Maven WARNING messages.
...
This closes #6415
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-15 11:02:08 -05:00
51d01f874e
NIFI-10401: Adding ScheduledStateChangeListener to synchronizer ( #6341 )
...
NIFI-10401: Adding ScheduledStateChangeListener to synchronizer
2022-09-15 09:15:44 -04:00
3987d39cdc
NIFI-9401 Added HashiCorpVaultParameterProvider
...
- Refactored nifi-vault-utils to nifi-hashicorp-vault-api and nifi-hashcorp-vault modules
- Added HashiCorpVaultClientService and Standard implementation
This closes #6304
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-14 19:46:09 -05:00
5303aadda3
NIFI-10500: Improved property ordering in MQTT processors
...
Signed-off-by: Arpad Boda <aboda@apache.org>
2022-09-14 21:13:01 +02:00
4b0568e6fe
NIFI-10242 Create QueryAirtableTable processor
...
This closes #6350 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-14 20:31:34 +02:00
a9013a61ec
NIFI-10494 Upgrade Camel-Salesforce to 3.14.5
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6413 .
2022-09-14 16:48:16 +02:00
04c0df1723
NIFI-10471 Documented and applied standard deprecation logging
...
- Updated Admin Guide with section on Logging Configuration and Deprecation Logging
- Updated Developer Guide with section on Deprecating Components and Features
- Added Deprecation Logging when adding components marked with DeprecationNotice to the Flow Configuration
- Added Deprecation Logging on deprecated methods in standard Controller Service implementations
- Removed integration tests for deprecated PersistentProvenanceRepository
- Updated logging and added documentation on minor upgrade steps
- Updated logging for HDFSNarProvider and RocksDB Repository
This closes #6390
Signed-off-by: Paul Grey <greyp@apache.org>
2022-09-13 19:40:03 -04:00
e26aa233d7
NIFI-10458 Add support for the DESCRIBE/MANIFEST Operation
...
Signed-off-by: Ferenc Erdei <erdei.ferenc90@gmail.com>
This closes #6375
2022-09-13 19:22:35 +02:00
5fbd3ac7a9
NIFI-10490 Upgrade influxdb-java to 2.23
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6410 .
2022-09-13 15:08:21 +02:00
ae14ef2d1f
NIFI-10373 Set managed version for AWS 1 and 2 SDK
...
- Replaced individual AWS SDK versions with root managed dependency version
- Set AWS SDK 1 version to 1.12.299
- Set AWS SDK 2 version to 2.17.270
- Suppressed false positive dependency vulnerability for aws-sdk-swf-libraries
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6405 .
2022-09-13 15:06:42 +02:00
a91928e0e3
NIFI-10489 Upgraded zip4j from 2.10.0 to 2.11.2
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6409 .
2022-09-13 15:03:54 +02:00
d351f92104
NIFI-10486 Upgraded greenmail from 1.5.11 to 1.6.10
...
This closes #6406
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-12 15:21:21 -05:00
158c5417bc
NIFI-9500 Added nifi.cmd for Windows; Switched to NiFi Home directory to run command actions
...
This closes #6370
Signed-off-by: Paul Grey <greyp@apache.org>
2022-09-12 14:13:02 -04:00
eaaff4ede9
NIFI-10364: Simplified connection/session handling in SmbjClientService
...
This closes #6307 .
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-12 16:06:22 +02:00
dfa18b848f
NIFI-10477 Upgraded Apache Calcite from 1.31 to 1.32
...
This closes #6396
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-11 07:55:07 -04:00
ccebf2b271
NIFI-10466 Updated questdb to 6.5.2-jdk8
...
This closes #6384
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-10 07:23:56 -04:00
1370295bd3
NIFI-10470 Upgraded SSHJ from 0.33.0 to 0.34.0
...
This closes #6387
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-10 07:19:22 -04:00
5b3601f50f
NIFI-10472 Upgraded SnakeYAML from 1.29 to 1.31
...
- Replaced module overrides with root managed dependency version
This closes #6389
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-09 20:38:01 -04:00
de7793e69b
NIFI-9003 Added framework support for Parameter Providers
...
- Added Environment Variable and File Parameter Provider implementations
- Added Parameter Provider commands to CLI
- Added component search handling for Parameter Providers
- Added documentation for integrating Parameter Providers
This closes #5369
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 13:04:56 -05:00
e81466d4f3
NIFI-10465: Fixed error message for invalid Controller Service type
...
This closes #6381
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 10:16:06 -05:00
a4a3bdbc98
NIFI-10451 Updated QuestDB Status History Rollover to work with version 6
...
This closes #6374
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 10:08:07 -05:00
aca93ed3ce
NIFI-10464 Upgraded json-flattener from 0.13.0 to 0.14.0
...
This closes #6380
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 10:03:31 -05:00
b1b3a7057c
NIFI-10380 Added ListDropbox and DropboxCredentialService
...
This closes #6331
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-09 09:59:34 -05:00
eb68ffad70
NIFI-10411 Add record processing feature to PublishMQTT processor
...
This closes #6373 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-09-09 09:51:13 +02:00
b12510e54a
NIFI-10443 Upgraded oauth2-oidc-sdk from 9.10 to 9.43
...
- Upgraded nimbus-jose-jwt to 9.11.2 to 9.24.3
This closes #6366
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-08 17:54:39 -05:00
a0c705715b
NIFI-10429: Added the ability to Replay latest provenance event for a given Processor.
...
This closes #6359
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-08 15:55:26 -05:00
97b8f0e205
NIFI-10435 Masked sensitive arguments in ExecuteStreamCommand
...
This closes #6367
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-07 21:33:57 -05:00
5b565679df
NIFI-10230 added FetchSmb
...
This closes #6279 .
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-06 18:58:55 +02:00
822c4d473a
NIFI-10404 TailFile processor persistent state not cleaned up
...
This closes #6349 .
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-09-06 10:52:38 +02:00
64acd8b1c5
NIFI-2827 Adding zstd-jni to the necessary pom.xml. It's already in the LICENSE.
...
NIFI-2827 Update CompressContent.java to use zstd compression format
NIFI-2827 Update test cases for CompressContent.java to include zstd format
NIFI-2827 Update JsonRecordSetWriter.java to enable zstd compression format
This closes #6294
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-04 15:02:41 -04:00
6ac7bfe0fa
NIFI-10433 Updated javassist
...
This closes #6363
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-03 21:03:33 -04:00
60a6578a70
NIFI-10393 Update the lucene version
...
This closes #6333
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-09-03 18:09:14 -04:00
09faec4866
NIFI-10432 Upgraded jsoup from 1.14.2 to 1.15.3
...
This closes #6362
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-03 09:23:23 -05:00
0a98ca3c09
NIFI-10424 Upgraded spring-integration from 5.5.9 to 5.5.14
...
This closes #6354
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-09-02 16:51:29 -05:00
7a90137cef
NIFI-10431: Improved log messages and Exception messages to indicate which components they pertain to. Also added a toString() for StandardLabel to make it more clear which Label is being referenced
...
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6361 .
2022-09-02 15:56:33 -04:00
c19d6a0db1
NIFI-10407 Improved reliability of GetSmbFileTest
...
- Changed TestRunner.run() to avoid clearing internal cache between runs
- Updated Mockito usage with annotations
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6346 .
2022-09-01 14:08:07 -04:00
6350829676
NIFI-10384 Upgraded Avatica to 1.22.0 for Hive 3
...
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6323 .
2022-09-01 12:43:04 -04:00
5280762f58
NIFI-10417 Upgrade neo4j-java-driver to 1.7.6
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6353 .
2022-09-01 12:08:20 +02:00
a22f0b6bb4
NIFI-10399 Upgraded Jolt from 0.1.1 to 0.1.7
...
This closes #6339
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-31 15:40:59 -05:00
10d1fbe888
NIFI-10378 Added OIDC client secret to encrypted properties
...
This closes #6352
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-30 16:14:32 -05:00
e2d6df5afc
NIFI-10356 Created GetHubSpot processor
...
This closes #6301
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-30 15:50:51 -05:00
3a6d724b44
NIFI-10408 Added build user method to LdapUserGroupProvider
...
- Introduced blank user identity checking with improved error reporting for misconfigured mapping
- Simplified LDAP ThreadFactory configuration
- Replaced String.format() with placeholders for debug logging
- Replaced deprecated FormatUtils.getTimeDuration with getPreciseTimeDuration
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6351 .
2022-08-30 16:26:58 -04:00
28fc030ef5
NIFI-10366: Make Default Run Duration configurable ( #6310 )
...
NIFI-10366: Make Default Run Duration configurable
2022-08-30 14:38:56 -04:00
bae659cb9e
NIFI-10409 Improved enrich-processors tests using MockedStatic
...
This closes #6348
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-30 11:35:00 -05:00
4f87cd770b
NIFI-10410 Added InputRequirement annotation to ExtractGrok
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6345 .
2022-08-30 15:46:14 +02:00
4d4a5ca4be
NIFI-10251 Add v5 protocol support for existing MQTT processors
...
This closes #6225 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-08-30 10:27:19 +02:00
63905c5fc1
NIFI-10379 - In FetchGoogleDrive removed record-based input processing.
...
This closes #6327 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-08-29 17:01:34 +02:00
3be503668b
NIFI-10347 Upgraded metrics-graphite from 4.1.2 to 4.1.33
...
This closes #6291
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-26 14:54:54 -05:00
b777978293
NIFI-10313 Removed Expiration Token on Authentication Errors
...
- Updated standard user interface error handler to clear the Access-Token-Expiration item from Session Storage when receiving an error with the WWW-Authenticate Header indicating a problem with the Bearer Token
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6334 .
2022-08-25 13:12:01 -04:00
f5fee4dda3
NIFI-10344 Refactored Groovy tests in standard-processor to Java and JUnit 5
...
This closes #6321
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-25 08:02:15 -05:00
d698e7af1a
NIFI-10306: Add logging to StandardProcessGroup.addConnection() with more details
...
This closes #6264
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-25 07:50:55 -05:00
71ba581fd8
NIFI-10392 - This closes #6330 . ResizeImage - add option to maintain aspect ratio
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-08-25 08:34:19 +02:00
777238eb32
NIFI-10321 Send Session Expired message for Expired JWT errors
...
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6332 .
2022-08-24 12:40:04 -04:00
5303dd13aa
NIFI-10389 Upgrade AWS Kinesis to 1.14.8
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6328 .
2022-08-24 11:46:32 +02:00
4a2c0beb7f
NIFI-10388 Upgraded xmlunit-matchers from 2.6.3 to 2.9.0
...
This closes #6326
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-23 15:21:45 -05:00
6f0ca87304
NIFI-10387: Fixed negative logic bug in scripted components ( #6325 )
2022-08-23 13:53:12 -04:00
90aa778a6c
NIFI-10348 Upgraded Tomcat Embed to 8.5.82 for Flume NAR
...
- Upgraded tomcat-embed-core from 8.5.46 to 8.5.82 for Flume components
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6292 .
2022-08-23 12:39:08 -04:00
fa85a05a2b
NIFI-9374 Added Deprecation Logger
...
- Added nifi-deprecation-log module with interface and implementation using SLF4J
- Updated standard logback.xml with nifi-deprecation.log appender
- Updated NiFiLegacyCipherProvider with deprecation logging
- Set Size, Time Policy, and Total Size Limit for Deprecation Log
This closes #6300
Signed-off-by: Paul Grey <greyp@apache.org>
2022-08-23 11:25:03 -04:00
ca991a6805
NIFI-10382 Upgraded Flume dependencies from 1.10.0 to 1.10.1
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6320 .
2022-08-23 17:15:10 +02:00
9070cd0904
NIFI-10383: When importing/synching to a VersionedFlow, if the Versioned PropertyDescriptor indicates that a property references a Controller Service, treat it the same as if the PropertyDescriptor itself indicates that it references a service. This allows us to ensure that scripted components' property descriptors that reference controller services are properly mapped. Additionally updated StandardProcessorNode so that when we have this condition that we properly account for the Controller Service reference
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #6322
2022-08-23 09:59:07 -04:00
cb275dd956
NIFI-10385: If script body is empty for AbstractScriptedControllerService or InvokeScriptedProcessor, do not attempt to load script
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #6324
2022-08-22 22:34:29 -04:00
0a065538e2
NIFI-10368 Upgraded jQuery UI from 1.12.1 to 1.13.2
...
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6312 .
2022-08-22 14:14:15 -04:00
4b9f92f167
NIFI-10374 Upgraded Caffeine to 2.8.1 in nifi-asn1-services
...
This closes #6316
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-22 08:11:34 -05:00
b012e9aad2
NIFI-10371: When a component is moved between groups, ensure that its versioned component id is unique within the destination group. Also ensure that when adding a connection to a PG with the VersionedComponentSynchronizer that we prefer obtaining source/destination by instance id instead of versioned id.
...
Fixed bug where ProcessGroup would inadvertently set the wrong component's Versioned Component ID to null when there was an ID conflict
This closes #6314
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-22 08:07:27 -05:00
22e8901fce
NIFI-8248 Modified PutAzureDataLakeStorage processor to use temp file instead of inline replacement
...
This closes #6159
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2022-08-19 17:10:32 +00:00
1dd2bbb866
NIFI-10372 Upgrade Spring-Data-Redis to 2.7.2
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6315 .
2022-08-19 12:18:25 +02:00
bcc73a700d
NIFI-10367 Removed unused org.jeasy:easy-rules-mvel from rules-action-handler
...
This closes #6311
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-18 10:04:35 -05:00
2685856c62
NIFI-10052 Avoid obtaining any locks when creating/sending heartbeats ( #6298 )
2022-08-17 14:05:55 -04:00
5df6efa0f2
NIFI-10358 Updated CaptureChangeMySQL to use SSL JDBC properties
...
- Added Connection Properties Provider with implementation to translate SSL Mode and SSL Context Service configuration to MySQL Connector properties
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #6306
2022-08-17 12:15:04 -04:00
21503f6353
NIFI-10362: When asynchronous node disconnect is issued, do not send disconnect to node if the node becomes reconnected in the interim. Also, addressed the issue in which a disconnected node acts on a replicated request during the first phase by detect that it's the first phase if configured for cluster, not when only when connected to a cluster.
...
This closes #6308
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-17 11:09:47 -05:00
99a0c05070
NIFI-10361 Upgraded commons-jexl3 from 3.1 to 3.2.1
...
This closes #6305
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-17 09:20:06 -05:00
a89873f437
NIFI-9518 Upgraded mysql-binlog-connector-java from 0.20.1 to 0.26.1
...
- Changed from com.github.shyiko to com.zendesk dependency group for current library version
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6302 .
2022-08-17 10:51:35 +02:00
1b4d66a726
NIFI-10343 Add error code to exception message
...
The error object may not have a description, but should have a code.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6288 .
2022-08-16 09:49:58 +02:00
eb419b6e40
NIFI-10300 Added AzureEventHubRecordSink
...
This closes #6296
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-15 15:57:08 -05:00
0d0a119737
NIFI-1954: Add additionalDetails page to ExecuteScript ( #6044 )
...
* NIFI-1954: Add additionalDetails page to ExecuteScript
* NIFI-1954: Incorporated review comments
2022-08-15 11:44:30 -04:00
864036674e
NIFI-10244 Added nifi-web-client-api and implementation
...
- Added nifi-web-client implementation based on OkHttp
- Added WebClientServiceProvider Controller Service interface and implementation
- Corrected comments and added unmodifiableMap wrapper
- Added getHeaderNames() and corrected ProxyContext comments
This closes #6268
Signed-off-by: Paul Grey <greyp@apache.org>
2022-08-11 17:25:18 -04:00
a3a7b2fcfd
NIFI-10334 Upgraded amqp-client from 5.8.0 to 5.15.0
...
This closes #6280
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-10 12:06:15 -05:00
e7dc14a4e0
NIFI-10339 - Fix typo in QuerySalesforceObject
...
This closes #6286
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-10 10:37:25 -05:00
8605d0a29f
NIFI-10336 Removed unnecessary lineage check from TestMonitorActivity
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6285 .
2022-08-10 15:34:44 +02:00
24cea2a93b
NIFI-10183 Upgraded swagger-annotations to 1.6.6
...
- Added managed dependency in root Maven configuration
- Removed different versions from other Maven configurations
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6284 .
2022-08-10 15:32:30 +02:00
77033ec11a
NIFI-10322 Corrected Cookie path when removing Bearer Token
...
- Appended root path to Cookie path attribute when removing Bearer Tokens as part of unauthorized response handling
- Updated Saml2AuthenticationSuccessHandler to follow standard Cookie path building strategy
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6278 .
2022-08-09 16:09:41 -04:00
3341e789f0
NIFI-10329 Upgrade jasn1-compiler to 1.11.3
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6277 .
2022-08-09 15:27:38 +02:00
0dc751981c
NIFI-10291 Updated Snowflake Driver from 3.13.14 to 3.13.21
...
This closes #6252
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-08 12:58:31 -05:00
415413fac2
NIFI-10327 Upgraded Apache Ivy from 2.4.0 to 2.5.0
...
This closes #6275
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-08 12:44:12 -05:00
5b9f096143
NIFI-10307 Refactored nifi-standard-processors tests to use JUnit 5
...
This closes #6272
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-08 12:35:19 -05:00
26829e5c35
NIFI-10256 CSVRecordReader using RFC 4180 CSV format trimming starting and ending double quotes
...
NIFI-10256 Addresseng review comments, adding extra description, removing unneccessary static import, creating extra constructor
NIFI-10256 Refactoring CSVRecordReader
NIFI-10256 Addresseng review comments, adding validator
Signed-off-by: Bence Simon <bsimon@apache.org>
This closes #6234
2022-08-08 17:13:48 +02:00
fdf3925f81
NIFI-3964 Updated Grok Patterns to support TEXT and URL Resources
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6260 .
2022-08-08 14:48:21 +02:00
0fd262efca
NIFI-10319 - Update pom.xml
...
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6270 .
2022-08-05 16:42:06 -04:00
387ae7d323
NIFI-10199: PublishKafka InFlightMessageTracker should not log batch level errors on each record
...
Currently, when a batch level error occurs (e.g. delivery timeout), the same error is logged for each record of the batch, needlessly flooding the logs.
InFlightMessageTracker now only logs an exception when a flow file encounters it for the first time.
This closes #6185
Signed-off-by: Paul Grey <greyp@apache.org>
2022-08-05 14:12:43 -04:00
768f58da21
NIFI-10212 added ListSmb processor and SmbConnectionPoolService
...
This closes #6192 .
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-08-05 18:46:04 +02:00
5cc2790891
NIFI-10302 Streamlined TestMonitorActivity to improve reliability
...
- Removed TestRunner.run() loops
- Reduced usage of Thread.sleep()
- Upgraded TestMonitorActivity to JUnit 5
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6261 .
2022-08-05 10:44:26 -04:00
2d73fd5631
NIFI-10318 Corrected HandleHttpRequest TLS client authentication
...
- Corrected setting of wantClientAuth instead of needClientAuth based on Client Authentication configuration
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6271 .
2022-08-04 14:18:10 -04:00
df2c187761
NIFI-10298 Changed nifi-framework-cluster tests to use Java and JUnit 5
...
This closes #6262
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-04 10:31:17 -05:00
b260c10ad4
NIFI-10293 Refactored tests in nifi-jolt-transform-json-ui to use JUnit 5
...
This closes #6258
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-01 10:49:27 -05:00
ded48269fe
Merge branch 'NIFI-10272-RC2'
2022-08-01 06:10:25 -07:00
296f308cdc
NIFI-10048 Corrected StandardFlowDifference.hashCode() to avoid NPE
...
- Added tests to TestFlowController for JSON flow configuration
This closes #6227
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-29 13:44:26 -05:00
67c463627c
NIFI-10292 Refactor nifi-framework-authorization-providers tests with Java and JUnit 5
...
This closes #6257
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-29 10:48:11 -05:00
4e49a55e93
NIFI-10295 Upgraded GRPC from 1.34.0 to 1.48.0
...
- Upgraded Protobuf from 3.14.0 to 3.21.4
- Removed netty-tcnative-boringssl-static as not necessary following NIFI-9897
This closes #6255 .
Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-07-28 18:47:37 -04:00
8c66bf948c
NIFI-10272-RC2 prepare for next development iteration
2022-07-27 13:24:09 -07:00
8d256784d8
NIFI-10272-RC2 prepare release nifi-1.17.0-RC2
2022-07-27 13:24:06 -07:00
c77f85aafb
NIFI-10070 Updated status merging for ControllerService and ReportingTask entities
...
- Corrected node identifier selection in multiple Mergers
This closes #6154
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-27 14:48:02 -05:00
2fae3bb9a8
NIFI-10281 - Added FetchGoogleDrive processor. Consolidated record- and attribute output for ListGoogleDrive. (Record fields and flowfile attributes are now the same.)
...
This closes #6248 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-07-27 18:59:06 +02:00
afa85a03ce
NIFI-10286 This closes #6251 . Removed c2-client-api references from nifi-nar-utils
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-27 08:01:24 -07:00
9bb22fcb11
NIFI-10284 Corrected HTTP Request Authenticated User logging
...
- Moved RequestAuthenticationFilter before HeaderWriterFilter
This closes #6250
Signed-off-by: Paul Grey <greyp@apache.org>
2022-07-27 10:26:43 -04:00
02e37713b3
NIFI-10277 This closes #6245 . Refactored ConnectionLoadBalanceServerTest
...
NIFI-10277 Changed failure test to throw SocketException
NIFI-10277 Increased timeout to 30 seconds and moved verify method
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-25 15:10:27 -07:00
c6999ba9d8
NIFI-10278 - This closes #6247 . repeat onTrigger of ConsumeTwitter until a FlowFile is received or timeout after 60 seconds
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-25 14:45:54 -07:00
8a1249ee39
NIFI-10279: This closes #6246 . Increased timeout in TestExecuteStateless, removed explicit timeouts on stateless system tests that were too aggressive so that the tests use the default 5 minute timeout defined in StatelessSystemIT
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-25 14:33:48 -07:00
92750c2746
NIFI-10261: Ensure that when comparing Sensitive Parameters during flow sync we decrypt values for the comparison
...
This closes #6231
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-25 10:52:46 -05:00
0497907829
NIFI-10262: Ensure that when an Exception is thrown from a Controller Service's @OnEnabled method that we properly handle that Exception and continue enabling the other services in the given collection of services
...
This closes #6236
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-25 10:02:21 -05:00
7767a5b85d
NIFI-10265 Route to Failure on Connect Exceptions in PutDatabaseRecord
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #6235
2022-07-25 09:36:54 -04:00
c61efecbdc
NIFI-10252: Use correct field(s) for PutDatabaseRecord update keys
...
Not always UpdateKey comes in first position
Better readability
Include testUpdatePkNotFirst
Including usefull SQL log debug
Fix semicolon
NIFI-10252: Additional unit test for specified update keys
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #6226
2022-07-25 08:48:06 -04:00
7244b9cfc4
NIFI-10271 This closes #6242 . Upgraded Xerces from 2.12.1 to 2.12.2
...
- Suppressed false positive vulnerability report for CVE-2017-10355
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-23 17:59:33 -07:00
7d920b9bc6
NIFI-10270 This closes #6240 . Upgraded AWS SDK from 1.12.182 to 1.12.267
...
- Upgraded MiNiFi AWS SDK references from 1.11.172 to 1.12.267
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-23 17:59:04 -07:00
0cd438d9e9
NIFI-9817 Added Unit Validator to PutCloudWatchMetric
...
This closes #5905
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-23 10:18:27 -05:00
40d7d88bc0
NIFI-10232 Set write and idle timeouts in DistributedCacheClient
...
- Added OnShutdown annotation to Cache Server and Cache Client Service methods
This closes #6221
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-22 19:49:22 -05:00
a661b035e8
NIFI-10259 Improved HTTP error handling for authentication failures
...
- Added Standard AuthenticationEntryPoint
- Configured AuthenticationEntryPoint for SecurityFilterChain and BearerTokenAuthenticationFilter
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6233 .
2022-07-22 17:33:51 -04:00
d7ed66032e
NIFI-10050: When copying a process group and 1 CS references a higher-level CS, ensure that we don't drop that reference
...
This closes #6077
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-22 16:25:58 -05:00
bc4e3e850b
NIFI-10246: When syncing Controller Services, wait until any DISABLING Controller Service has fully disabled before attempting to synchronize them. Also performed some minor refactoring/cleanup for System Tests in order to make writing a system test for this simpler
...
This closes #6219
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-22 13:31:06 -05:00
74b25c7306
NIFI-10154 ReplaceText AdminYielding on long line ( #6151 )
...
* NIFI-10154 ReplaceText AdminYielding on long line
* NIFI-10154 code review changes
Signed-off-by: Otto Fowler <otto@apache.org>
2022-07-22 11:14:23 -04:00
302bdbfb11
NIFI-10260 Changed display name and description of Validate DTD properties
...
- Set Allow DTD as display name in EvaluateXPath and EvaluateXQuery
This closes #6230
Co-authored-by: David Handermann <exceptionfactory@apache.org>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-21 13:28:36 -05:00
eab687ee50
NIFI-10255 Updated original relationship description on ExecuteStreamCommand
...
- Description of original relationship of ExecuteStreamCommand processor might be misleading
This closes #6229
Signed-off-by: David Handermann <exceptinofactory@apache.org>
2022-07-21 09:41:53 -05:00
ad781170e3
NIFI-10223 Created ListGoogleDrive processor.
...
This closes #6200 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-07-20 13:38:47 +02:00
ccf3866261
NIFI-9812 Disabled Native Lib loading tests on ARM64
...
- Migrate tests in nifi-framework-mark-loading-utils to JUnit5
- Annotate tests that use x86_64 native binaries to be conditional on x86_64 os.arch
This closes #6215
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-19 11:38:26 -05:00
1a1037022f
NIFI-9813 Excluded Ranger modules on ARM64
...
This closes #6216
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-19 08:03:16 -05:00
97e7a3c030
NIFI-9809 Disabled Kudu tests on ARM64
...
This closes #6214
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-19 07:56:26 -05:00
148834e71b
NIFI-10247 Corrected REST API documentation for empty-all-connection-requests
...
This closes #6220
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-19 07:51:32 -05:00
f8844440f5
NIFI-10019: SendTrapSNMP works without flowfile, upgraded to junit5
...
This closes #6046 .
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-07-18 16:15:15 +02:00
4d219689f1
NIFI-10193 Added SupportsSensitiveDynamicProperties to ExecuteStateless
...
This closes #6177
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-18 09:08:27 -05:00
14a31c81dd
NIFI-10239 Upgraded Curator from 4.2.0 to 5.3.0 for Hive3
...
- Corrected NoSuchMethodError for ZooKeeper discovery mode with Hive3 JDBC and mismatch between Hadoop 3.3.3 and Curator 4.2.0
This closes #6210
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-15 12:43:05 -05:00
cb0753b03c
NIFI-9758 Added Dynamic Properties to PutEmail
...
This closes #6204
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-15 10:58:31 -05:00
047b3611bf
NIFI-10233 Corrected Anonymous Authentication for HTTP Access
...
- Enabled Standard Anonymous Authentication Filter when unencrypted HTTP is enabled
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6209 .
2022-07-14 23:27:54 -04:00
d0db4c44bb
NIFI-10231: Change AbstractScriptedControllerService.OnConfigurationRestored to use ConfigurationContext ( #6207 )
2022-07-14 11:49:00 -04:00
a9b5bebb15
NIFI-10216 Refactored NiFi Web API Security Configuration
...
- Removed extension of deprecated WebSecurityConfigurerAdapter
- Moved Filter bean configuration associated configuration classes
- Set default Spring Security log level to INFO
- Adjusted CSRF Token Repository to leverage simplified RequestUriBuilder for retrieving allowed context paths
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6195
2022-07-13 19:11:03 -04:00
0dea0ae364
NIFI-10196 Corrected Jolt UI CSRF Header Handling
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #6198
2022-07-13 15:25:16 -04:00
4c0555a476
NIFI-10203: Ensure that when a FlowFile is transferred and is not retried that we remove the retryCount.<uuid> attribute
...
This closes #6201
Signed-off-by: Paul Grey <greyp@apache.org>
2022-07-12 19:01:41 -04:00
51626d728b
NIFI-10215 This closes #6194 . Upgraded Curator from 5.2.1 to 5.3.0
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-12 09:51:26 -07:00
996d8faaf4
NIFI-10203: Fixed bug in which same FlowFile Builder was used repeatedly for multiple FlowFiles; this caused mingling of their attributes when a FlowFile is routed to a relationship that has more than 1 destination (i.e., many connections with the same Relationship)
...
This closes #6187
Signed-off-by: Paul Grey <greyp@apache.org>
2022-07-12 09:52:49 -04:00
274e4feeaa
NIFI-10143 Adjusted UTF-8 auto-detection in FTP Processors
...
This closes #6172
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-11 20:00:40 -05:00
cf4eed0224
NIFI-10207: ensure allowableValues matches SUPPORTED_STATE in ProcessorRunStatusEntity
...
This closes #6188 .
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-07-11 21:34:27 +02:00
06db7968fa
NIFI-10201 Upgraded Prometheus simpleclient from 0.3.0 to 0.16.0
...
This closes #6180
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-11 12:57:27 -05:00
291bd40013
NIFI-10195 Upgraded Testcontainers to 1.17.3
...
This closes #6179
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-11 10:37:39 -05:00
3a31dff76b
NIFI-10214 Upgraded commons-configuration2 from 2.7 to 2.8.0
...
This closes #6181
This closes #6182
This closes #6183
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-11 10:27:17 -05:00
1685204cc1
NIFI-10206: Restored flushBuffer() call in HandleHttpResponse to avoid HTTP 404
...
This closes #6186
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-08 16:51:20 -05:00
46bb7d153d
NIFI-9558: ConnectWebSocket leaks connections and duplicates FlowFiles in incoming connection mode (new PR)
...
This closes #6176 .
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-07-06 10:30:47 +02:00
328d38facb
NIFI-10194: Simplified SendTrapSNMP error handling
...
This closes #6178 .
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-07-05 16:55:57 +02:00
685088a59c
NIFI-9916: ListenTrapSNMP USM parsing refactor.
...
This closes #6034 .
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-07-04 16:43:20 +02:00
d78c667c19
NIFI-10166 Improved MiNiFi bootstrap test coverage
...
This closes #6160
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-07-01 14:45:31 -05:00
ea0e1b446e
NIFI-10187 Upgraded FtpServer from 1.1.1 to 1.2.0
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6171 .
2022-07-01 14:24:21 +02:00
26a10d772f
NIFI-10186 Corrected PutFTP Remote Path Property EL
...
This closes #6173
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-30 19:12:28 -05:00
1f18345929
NIFI-10163 Corrected StandardProcessSessionTest after NIFI-10167
2022-06-30 19:10:57 -05:00
943197c18b
NIFI-10163
...
- Corrected StandardProcessSession.exportTo() byte counting
- Removed bytesWritten incrementing from exportTo methods
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6153 .
2022-06-30 18:42:44 -04:00
7eec507118
NIFI-10181: Upgrade Groovy to 3.0.9
...
This closes #6170
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-30 14:47:00 -05:00
9cf5c170b1
NIFI-9810 Deprecated RocksDB repository and moved to NAR
...
- Bump version to 6.29.5 for arm64 compatibility
- Extract RocksDBFlowFileRepository and supporting code to its own module
- Mark RocksDBFlowFileRepository as deprecated, both in code and documentation
- Log deprecation warning at startup if RocksDBFlowFileRepository is used
- Move native RocksDB info logs to NiFi debug level logs
This closes #6155
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-30 14:23:10 -05:00
5e83bda9e9
NIFI-10167: Added advanced timing metrics for processors, such as CPU Usage, time reading/writing content repo, process session commit time, etc. Exposed via nifi.sh diagnostics and made configurable via nifi.properties
...
This closes #6156
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-30 10:50:24 -05:00
d5b626f0e4
NIFI-10108 Processor scheduling via parameter ( #6115 )
...
- NIFI-10108 Processor scheduling via parameter
- Refactoring component referencing check in AbstractComponentNode and StandardParameterReferenceManager classes.
2022-06-30 10:11:13 -04:00
0458b6432d
NIFI-10158 Corrected ListFTP expression support for Hostname and Port
...
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6162 .
2022-06-29 22:11:11 -04:00
7a47c8cfbd
NIFI-10162 Reorganized InvokeHTTP Properties
...
- Corrected handling of documentation for allowable values
NIFI-10162 Updated Multipart Form-Data Name description
This closes #6163 .
Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-06-29 16:52:19 -04:00
6997f17bff
NIFI-10180 This closes #6168 . Removed standard Maven repository definitions
...
- Upgraded Apache parent from 25 to 26
- Upgraded Apache Rat Plugin from 0.13 to 0.14
- Upgraded Maven Compiler Plugin from 3.9.0 to 3.10.1
- Removed Confluent repository from Confluent Registry Service module
- Removed MapR repository profile configuration
- Removed Hortonworks repository profile configuration
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-06-29 10:04:47 -07:00
ee3dcc78bf
NIFI-10173 This closes #6164 . Upgraded Flume from 1.6.0 to 1.10.0
...
- Removed unmaintained flume-dataset-sink and flume-ng-elasticsearch-sink dependencies
- Added dependency-check suppression configuration for false positives on Flume libraries
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-06-29 10:04:09 -07:00
39c366eeef
NIFI-10169: When using the Insert Record Fields join strategy of JoinEnrichment, ensure that in order to combine schemas from the original record and the enrichment record we use incorporateSchema() so that even when the first enrichment record is null, we get the schema correct
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6157 .
2022-06-29 17:28:15 +02:00
a098653d07
NIFI-10165 Increased NiFi bootstrap heap size to 48 MB
...
- Increased bootstrap heap size from 24 MB to 48 to avoid heap constraints when using HTTP notifications
This closes #6161
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-28 14:56:55 -05:00
0de83292de
NIFI-9849 Refactored SAML Support with Spring Security 5
...
- Updated SAML Authentication Configuration with Spring Security SAML 2 components
- Updated Administration Guide with REST Resources
- Replaced SAMLAccessResource methods with applicable Spring Security Filters
- Removed IDP Credential Service and supporting components
- Removed message.logging.enabled, metadata.signing.enabled, and signature.digest.algorithm properties
- Added Access Token Expiration resource method
- Removed Saml2AccessResource and replaced with Access Token Expiration to avoid unnecessary conflicts with SAML login consumer
- Corrected Resource URI handling to support proxy server access
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6149 .
2022-06-28 13:57:35 -04:00
1465c2c629
NIFI-9908 C2 refactor and test coverage improvements
...
This closes #6149
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-28 12:02:31 -05:00
db11961026
NIFI-9440 Allow Controller Services to have configurable Bulletins
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #6035
2022-06-28 10:44:45 -04:00
b3b13a4ee0
NIFI-10145 Upgraded Hadoop from 3.3.2 to 3.3.3
...
- Excluded slf4j-reload4j implementation of Log4j 1
- Updated nifi-hive3-processors to leverage shared Hadoop version from 3.1.1
- Updated nifi-accumulo-bundle to leverage shared Hadoop version from 3.1.1
- Updated nifi-atlas-bundle to leverage shared Hadoop version from 3.3.2
- Updated nifi-spark-receiver to leverage shared Hadoop version from 3.3.2
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6139 .
2022-06-28 16:19:38 +02:00
c1c1d0da82
NIFI-10153 Refactored DocGeneratorTest and removed binary test files
...
This closes #6146
Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-06-27 22:05:53 -04:00
9d379121c4
NIFI-5005: Fix MergeRecord to honor writer's schema
...
This closes #6141 .
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-06-27 21:53:20 +02:00
d8ebfb25d0
NIFI-10161 Added Gzip Content-Encoding to InvokeHTTP and ListenHTTP
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6150 .
2022-06-26 22:23:32 +02:00
b6a32a9c5d
NIFI-10025 Removed in-project copy of com.hortonworks.registries.schemaregistry.client.SchemaRegistryClient, relying on original instead. Added basic auth support for HortonworksSchemaRegistry.
...
This closes #6055 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-06-24 22:22:35 +02:00
1442dcef23
NIFI-10111: Added option to unpack NARs into an Uber Jar and updated stateless nifi to always use this.
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #6117
2022-06-24 13:12:14 -04:00
a3e8048b2d
NIFI-9981 Added support for Avro UUID types
...
This closes #6013
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-23 08:35:31 -05:00
3dda694fd6
NIFI-10139: Adding fields to RemoteProcessGroupStatus ( #6137 )
2022-06-22 12:24:23 -04:00
edd862bf55
NIFI-10013 For JASN1RecordReader added unit test for checking multi-record input.
...
This closes #6091 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-06-22 18:19:52 +02:00
bc84532a8b
NIFI-9983 Add output relation name attribute in QueryRecord processor ( #6011 )
...
* NIFI-9983 Add output relation name attribute
2022-06-21 17:55:07 -04:00
f9beb507fd
NIFI-9996 - ListFile does not list root directory when Recurse Subdirectories is active and Path Filter is specified ( #6110 )
2022-06-21 17:23:49 -04:00
c08996515b
NIFI-10106 Avoid NPE in LookupRecord.createLookupCoordinates ( #6111 )
2022-06-21 17:03:44 -04:00
5febd47c72
NIFI-10109 Changed HashMap to LinkedHashMap in JsonTreeRowRecordReader ( #6112 )
...
- Added unit test to confirm preservation of field ordering
2022-06-21 17:00:34 -04:00
47121614a2
NIFI-10146 Upgraded Apache Tika from 2.4.0 to 2.4.1
...
- Removed direct dependency on metadata-extractor to inherit newer transitive version
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6140 .
2022-06-21 22:58:40 +02:00
ac8c1b0326
NIFI-10148: Fixed bug in SwappablePriorityQueue, in which the Active Queue Size could be decremented before the Unacknowledged Queue Size is incremented when FlowFiles are polled. This can result in the SwappablePrioriotyQueue incorrectly returning a value of true from the isEmpty() method. Additionally, updated the NiFiSystemIT so that if waiting for a particular queue size we periodically log size of all queues, which aids in debugging, and added necessary methods to FlowClient to make that happen.
...
This closes #6143
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-21 15:55:47 -05:00
b60b9b8e29
NIFI-10141: Fix WriteJsonResult logging to show writer's schema ( #6142 )
...
* NIFI-10141: Fix WriteJsonResult logging to show writer's schema
2022-06-21 16:53:30 -04:00
1de9c72779
NIFI-10140 Handle deleted parameters in StandardVersionedComponentSynchronizer
...
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6138 .
2022-06-21 10:43:38 -04:00
eef4ea1fc6
NIFI-10138 Updated Atlas tests to use Jackson 2
...
- Replaced Jackson 1 dependencies with Jackson 2
- Removed commons-beanutils override that is no longer necessary with new Hadoop version
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6136 .
2022-06-18 09:46:23 +02:00
4aee4546b9
NIFI-10135 Upgraded maven-surefire-plugin to 3.0.0-M7
...
- Removed duplicate plugin configuration in nifi-registry
- Removed maven-failsafe-plugin override in nifi-elasticsearch-client-service
- Removed failing test ResourceAuthorizationFilterSpec in nifi-registry-web-api
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6132 .
2022-06-18 09:43:46 +02:00
5e01d3de06
NIFI-10117: Allowing remote group ports to be synchronized from Stand… ( #6128 )
...
NIFI-10117: Allowing remote group ports to be synchronized from StandardVersionedComponentSynchronizer
2022-06-17 14:28:14 -04:00
d89f98f5b4
NIFI-9666 Implemented MiNiFi C2 client and refactored bootstrap
...
- Implemented MiNiFi C2 client using OkHttp
- Refactored MiNiFi bootstrap command handling and socket communication
- Added C2 Client Service to nifi-framework-core
This closes #6075
Co-authored-by: Matthew Burgess <mattyb149@apache.org>
Co-authored-by: Csaba Bejan <bejan.csaba@gmail.com>
Co-authored-by: Ferenc Erdei <ferdei@cloudera.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-17 09:23:52 -05:00
bd45eb4995
NIFI-10100 Upgraded Jersey to 2.35
...
- Replaced individual version references with Jersey BOM dependency
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6106 .
2022-06-16 23:09:22 -04:00
2161d0fe9c
NIFI-10104 Refactored usage of PropertyEncryptor
...
This closes #6119
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-16 16:38:34 -05:00
07bbcb771e
NIFI-10087 Implemented UDPEventRecordSink
...
This closes #6099
Signed-off-by: Paul Grey <greyp@apache.org>
2022-06-15 17:58:17 -04:00
0f5d8517b5
NIFI-5378 Prevent duplicate keys with different values in nifi.properties
...
This closes #6061
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-14 11:06:35 -05:00
554f648f00
NIFI-9654 Added Queue Logging to ListenTCP
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6116 .
2022-06-14 15:47:38 +02:00
f91d877043
NIFI-10114 This closes #6122 . Removed Single Refresh from ShellUserGroupProvider
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-06-13 14:38:19 -07:00
00a96d79e0
NIFI-9347: Changed timeout for tests from 5 seconds to 60. It appears that the timeout was previously 50-60 seconds per test and was reduced in NIFI-9141 to 5 seconds, but 5 seconds causes problems in some environments
2022-06-10 10:57:53 -07:00
f99298f98e
NIFI-7535 add detailed error message when .nar file is not readable
...
This closes #6056
Signed-off-by: Bence Simon <bsimon@apache.org>
2022-06-10 09:40:27 +02:00
c51f70b6e6
NIFI-10096 Corrected nested inherited Parameter Context loading
...
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6114 .
2022-06-09 21:10:44 -04:00
d925989811
NIFI-9963: Configure JsonTreeReader whether the schema applies to the Root Node or the Nested Node
...
This closes #6018 .
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-06-09 19:42:16 +02:00
2072e4ed2a
NIFI-10105: FetchS3Object decodes Content-Disposition
...
This closes #6109 .
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-06-09 14:26:32 +02:00
54f1372b78
NIFI-10103 Upgraded Solr from 8.8.2 to 8.11.1
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6107 .
2022-06-08 14:14:02 +01:00
a5bed1391e
NIFI-10098 Upgraded Apache Tika from 2.3.0 to 2.4.0
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6104 .
2022-06-07 17:53:58 +01:00
e19efa6658
NIFI-10095 Use Allowable Value Display Name for Default Value when found
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6103 .
2022-06-07 14:36:47 +01:00
2455ba2c45
NIFI-10094 Removed unused test HttpServer classes
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6102 .
2022-06-07 14:33:57 +01:00
e618e85da7
NIFI-10093 Set timeout to 5 seconds on SocketProtocolListenerTest ( #6101 )
2022-06-06 16:23:17 -04:00
5591bec44b
NIFI-9742: Use dependent property Display Names in documentation
...
This closes #5820
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-06 13:43:02 -05:00
58f93d1f8b
NIFI-10085 Removed CryptoUtility.isUnlimitedStrengthCryptoSupported() and references
...
This closes #6098
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-06 08:49:39 -05:00
4aa0d31d9f
NIFI-10088 Set SSH Transport Timeout using SFTP Data Timeout property
...
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6097 .
2022-06-03 19:10:28 -04:00
1342ea7025
NIFI-10079 Upgraded ZooKeeper from 3.5.9 to 3.8.0
...
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6096 .
2022-06-03 19:05:21 -04:00
4b655ecb68
NIFI-9804 Added HTTP/2 support to Application Server
...
- Added nifi.web.https.application.protocols property
- Set default protocol to HTTP/1.1 and provided documentation for enabling HTTP/2
- Changed StandardALPNProcessor handshakeFailed log to debug
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6093 .
2022-06-03 11:54:21 -04:00
639ab328c9
NIFI-10057: Add support for SQL Server's DATETIMEOFFSET type to ExecuteSQL processors
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6080 .
2022-06-03 10:33:41 +02:00
4c2fc216ab
NIFI-9671 Deprecated GetTwitter in favor of ConsumeTwitter
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6094 .
2022-06-03 10:31:41 +02:00
5a2992c243
NIFI-9960 Add documentation for Sensitive Dynamic Properties ( #6089 )
...
* NIFI-9960 Added documentation for Sensitive Dynamic Properties
- Updated User Guide with Add Property details
- Updated Developer Guide with annotation configuration details
- Updated Document Writer to indicate Supports Sensitive Dynamic Properties status
* NIFI-9960 Adjusted User Guide wording based on feedback
2022-06-02 08:12:22 -04:00
04aa32cd57
NIFI-10054: Improve SendTrapSNMP error handling
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6081 .
2022-06-02 11:43:24 +02:00
7f93cb4c91
NIFI-6943 Set DataDogReportingTask API Key Property as Sensitive
...
- Corrected Logger handling and improved unit tests
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6090 .
2022-06-02 11:40:53 +02:00
1f9672c18b
NIFI-10075 Improved TestListSFTP configuration verification
...
- Changed assertVerificationSuccess() to separate testVerificationSuccessful() method
- Upgraded TestListSFTP to JUnit 5
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6092 .
2022-06-02 11:36:25 +02:00
48de70a568
NIFI-10071: Adding support for HashiCorp Vault K/V version 2 Secrets Engine ( #6087 )
2022-06-01 15:09:01 -04:00
0d45fef702
NIFI-10074 Fix potential UnsupportedOperationException in PutSmbFile.customValidate. ( #6088 )
2022-06-01 14:27:07 -04:00
45cc3cefe5
NIFI-10069 Updated multiple components to support Sensitive Dynamic Properties
...
- ExecuteScript
- ExecuteStreamCommand
- InvokeScriptedProcessor
- HikariCPConnectionPool
This closes #6085 .
Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-06-01 11:26:41 -04:00
314232ca6c
NIFI-10072: Adding LoadBalanceStatus to ConnectionStatus ( #6086 )
2022-05-31 16:27:23 -04:00
9878df9f5a
NIFI-9867 Adding new tests to increase Test Coverage of GetTwitter
...
This closes #5978
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-31 09:53:29 -05:00
d79b390836
NIFI-10056 Wrap table scan in a kerberos action in KuduLookupService so that expired TGTs are renewed automatically.
...
This closes #10056 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-05-27 18:43:46 +02:00
98ec2563e9
NIFI-10059 Remove incorrect removal of controller service from cache ( #6082 )
2022-05-26 17:13:28 -04:00
35d8bb5ca9
NIFI-10051: Clear Controller Services' state in a background thread instead of the web thread.
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #6078
2022-05-26 10:31:55 -04:00
83316736f8
NIFI-9959 Add UI Support for Sensitive Dynamic Properties ( #6073 )
...
* NIFI-9959 Added UI Support for Sensitive Dynamic Properties
- Added SupportsSensitiveDynamicProperties to DBCPConnectionPool and ScriptedReportingTask
* NIFI-9959 Added sensitive parameter argument for Controller Service descriptors
* NIFI-9959 Adjusted sensitive property descriptor handling to support changing status
* NIFI-9959 Added info icon for Sensitive Value field
* NIFI-9959 Corrected handling of descriptor for existing dynamic properties
* NIFI-9959 Cleaning up dialog markup.
Co-authored-by: Matt Gilman <matt.c.gilman@gmail.com>
This closes #6073
2022-05-25 21:36:31 -04:00
f66540eb6d
NIFI-9951 Add proxy support to Azure ADLS and Blob v12 processors
...
This closes #5990 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-05-25 20:33:14 +02:00
e5203db960
NIFI-10046 Upgraded Gson to 2.9.0
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #6072
2022-05-25 14:14:44 -04:00
d664708dd3
NIFI-10049: When unscheduling reporting task, increment its concurrent task count until we've finished all shutdown logic and then decrement it, in much the same way that we do for processors
...
This closes #6076
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-24 17:54:17 -05:00
205c58230b
NIFI-9879 Add min/max age and min/max size properties to ListAzure processors
...
This closes #5933 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-05-24 17:22:52 +02:00
99be62be67
NIFI-9958 Add Framework Support for Sensitive Dynamic Properties ( #6057 )
...
* NIFI-9958 Implemented Sensitive Dynamic Properties
- Added SupportsSensitiveDynamicProperties annotation for components
- Added optional sensitive query parameter to Property Descriptor REST Resource methods
- Added system tests for components supporting sensitive dynamic properties
- Updated REST Resources to support Sensitive Dynamic Property Names
- Updated Documentation Writer to indicate component support for Sensitive Dynamic Properties
- Updated InvokeHTTP to support Sensitive Dynamic Properties
- Updated Auditor components to handle masking Sensitive Dynamic Properties
* Refactored Property Descriptor REST method handling
- Corrected AbstractDocumentationWriter evaluation of support for sensitive dynamic properties
- Refactored Controller Service Dynamic Properties system tests to new class
* Updated AbstractComponentNode.getProperties() to get canonical descriptor
2022-05-23 17:20:54 -04:00
41b3778d67
NIFI-10044: Add content viewer support for YAML
...
This closes #6063
Signed-off-by: David Handermann <exceptionfactory@apache.org?
2022-05-23 11:46:15 -05:00
e74557f990
NIFI-10027: Add support for WEBP images to the image viewer
...
This closes #6064
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-23 09:06:27 -05:00
9c9c708c14
NIFI-10043 fix ElasticsearchClient integration tests following JUnit5 upgrade; update Elasticsearch and json-path dependency versions
...
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6062 .
2022-05-20 12:27:53 -04:00
e0976f42d3
NIFI-3869 Added HTTP/2 support to ListenHTTP and HandleHttpRequest
...
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6048 .
2022-05-19 16:21:53 -04:00
38b51b0dde
NIFI-10037: When system test fails to clean up flow, destroy the entire environment so that the next test starts in a healthy state. Name troubleshooting directories with the name of the test class to avoid ambiguity. Also added a log statement so that we know which test is running when looking at the log output from the tests themselves. Finally, found an issue in AbstractComponentNode in which we iterate over the elements in a Map and call setProperty, which can update the underlying Map - updated to first create a copy of the HashMap. Updated that in this Jira because I suspect it is causing one of the tests failures that I've been investigating.
...
This closes #6059
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-19 13:14:30 -05:00
1cfca0d978
NIFI-10036: Corrected Elasticsearch Client Service to prefix paths for all requests
...
- Prefixing endpoint paths with a forward slash ensures correct HTTP request formatting required for some deployments with a forwarding proxy
This closes #6058
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-19 13:02:40 -05:00
88e53eae8c
NIFI-10001: Fixed bugs that caused some components to not have their scheduled state updated. ( #6049 )
...
* NIFI-10001: Fixed issue in which some components may fail to update the scheduled state when comparing flows
* NIFI-10001: Fixed bugs that caused some components to not have their scheduled state updated. When comparing two flows, now allow specifying how to determine a VersionedComponent's ID for comparison. When comparing local flow against flow from registry, use Versioned Component ID. But when comparing two instantiated flows, such as local flow vs. cluster flow, use the VersionedComponent's Instance ID instead. This ensures that we can properly compare two components even if there are several instances of a given flow
2022-05-18 13:53:36 -04:00
fe424a2d42
NIFI-9805 Refactored Distributed Cache Servers using Netty
...
- Added Map and Set Cache Servers based on nifi-event-transport components
- Removed custom servers and unused socket stream components
- Reduced duplication on protocol classes
- Added checks for readable bytes
- Added mark and reset handling for buffer reads
This closes #6040
Signed-off-by: Paul Grey <greyp@apache.org>
2022-05-18 12:40:16 -04:00
2a8d07641e
NIFI-9895 Allow parameters to reference controller services ( #5958 )
...
* NIFI-9895 Allow parameter to reference controller service. Check read and write authorization for both previous and newly set controller service. Authorization done for both property or parameter change. Import/export handled by switching between instance id and versioned id.
2022-05-16 17:55:03 -04:00
eba1318529
NIFI-10028: Added QuerySalesforceObject additionalDetails and improved age field property descriptions
...
This closes #6047
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-16 16:24:20 -05:00
bd1e033d55
NIFI-9967: Added FlowSerializationStrategy to determine which flow formats (XML,JSON) to save
...
This closes #6001 .
Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-05-16 16:22:19 -04:00
3f16a41ca1
NIFI-10010: ListenTCP adds Certificate Subject and Issuer FlowFile attributes
...
This closes #6032
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-13 15:48:12 -05:00
8031b62351
NIFI-10001: When enabling a collection of Controller Services, change… ( #6042 )
...
* NIFI-10001: When enabling a collection of Controller Services, changed logic. Instead of enabling dependent services and waiting for them to complete enablement before starting a given service, just start the services given. The previous logic was necessary long ago because we couldn't enable a service unless all dependent services were fully enabled. But that changed a while ago. Now, we can enable a service when it's invalid. It'll just keep trying to enable until it becomes valid. At that point, it will complete its transition from ENABLING to ENABLED.
* NIFI-10001: Restored previous implementation for StandardControllerServiceProvider, as the changes were not ultimately what we needed. Changed StandardProcessGroup to use a ConcurrentHashMap for controller services instead of a HashMap with readLock. This was causing a deadlock when we enable a Controller Service that references another service during flow synchronization. Flow Synchronization was happening within a write lock and enabling the service required a read lock on the group. Eventually the thread holding the write lock would timeout and release the write lock. But this caused significant delays on startup. By changing to a ConcurrentHashMap, we alleviate the need for the Read Lock. Also noticed in testing that the StandardNiFiServiceFacade did not save flow changes when enabling dependent services so added call to controllerFacade.save().
2022-05-13 15:09:23 -04:00
30f7c1ba1e
NIFI-9990 This closes #6030 . Improved FTP 550 file unavailable handling
...
- Improved File Not Found reply detection
- Added Permission Denied reply handling
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-05-13 07:44:22 -07:00
313d70520d
NIFI-9470 This closes #6027 . Allow creation of Parameter Context without any Inherited Parameter Contexts
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-05-13 07:39:11 -07:00
4a60d1673e
NIFI-10023: Ensure that any files that are archived upon startup properly increment the archival count in the content repo
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #6037
2022-05-12 15:38:49 -04:00
a528b89169
NIFI-10003 - NiFi build fails in UTC+ time zones
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #6038
2022-05-12 13:55:51 -04:00
dfc8b9c4c8
NIFI-10009 - bump Kudu client from 1.15 to 1.16
...
This closes #6029
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-10 13:21:07 -05:00
8247910a81
NIFI-9865: Add Atlas lineage for GCS processors (PutHDFS)
...
This closes #5926 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-05-10 11:04:30 +00:00
8aaa3d2f10
NIFI-9991 Fix: The asn1 StandardRecordModelIteratorProvider's interator returns only the first object read from the input stream.
...
This closes #6019 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-05-09 20:37:41 +00:00
728744a49b
NIFI-9998: This closes #6023 . Upgrade Hive3 to 3.1.3
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-05-09 10:53:32 -07:00
b25201dd22
NIFI-9993: Fixed bug in initialization in which the Content Repo did not properly increment the counter for how many files exist in the archive directories. This was causing the counter to become negative in some cases, which caused processors to incorrectly pause, waiting for content archive cleanup to occur when, in fact, there were no files archived
...
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6021 .
2022-05-09 12:22:00 -04:00
9c2e255fae
NIFI-9986 Upgraded commons-configuration2 to 2.7 for Accumulo
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6014 .
2022-05-09 16:53:34 +02:00
0c8305950c
NIFI-9987 Standardize Commons IO on version 2.11.0
...
- Removed version declarations from multiple modules
- Adjusted PutDynamoDB to remove catch for IOException not thrown in Commons IO 2.11.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6015 .
2022-05-09 12:06:37 +02:00
5e8b4d3144
NIFI-9997 Upgraded Ranger from 2.1.0 to 2.2.0 ( #6022 )
...
- Upgraded Hadoop from 3.1.1 to 3.3.2 for Ranger Plugins
2022-05-06 16:07:53 -04:00
ea75a0a996
NIFI-9995 Replaced Custom Filters with Spring Security HeaderWriter
...
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6020 .
2022-05-06 12:22:30 -04:00
64f9b66141
NIFI-9984 Allow 200-series responses in OAuth2 Access Token Provider
...
This closes #6016
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-05-04 17:31:07 -04:00
e20aa0ea2a
NIFI-9755 Added ConsumeTwitter Processor
...
This closes #5947
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-03 21:36:48 -05:00
0f6679f2df
NIFI-9980 Corrected conflicting GCP dependencies
...
- Replaced google-cloud-bom 0.172.0 with libraries-bom 25.2.0 in nifi-gcp-bundle
- Removed specific versions from Google dependencies in nifi-gcp-processors and nifi-gcp-services-api
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6010 .
2022-05-03 13:51:34 +02:00
04121c9d6a
NIFI-8533: Replace deprecated jython-shaded with jython-slim
...
This closes #5531
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-02 15:47:23 -05:00
e175b146cd
NIFI-9978:
...
- Updating the condition under which we show the Download Flow menu items.
This closes #6008 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-05-02 19:40:48 +02:00
b04632129f
NIFI-9798 Added Proxy Support for ConsumeGCPubSub and PublishGCPubSub
...
This closes #5868
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-02 11:37:47 -05:00
21b263bd71
NIFI-9979 Removed nifi-druid-bundle and associated components
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6009 .
2022-04-30 16:43:36 +02:00
5aa71570ff
NIFI-9977 In StandardOauth2AccessTokenProvider add new property to be able to set "scope".
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6006 .
2022-04-30 16:41:27 +02:00
7271e8cea7
NIFI-7234 Standardized on Avro 1.11.0
...
NIFI-7234 Replaced Jackson 1.X references with Jackson 2.X references in various classes.
NIFI-7234 Added jackson-annotations to nifi-hdfs-processors.
NIFI-7234 Various updates to bring our test cases into better alignment with the Avro specification as of 1.11.
Fixed a checkstyle issue.
NIFI-7234 Made changes requested in a review.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #5900
2022-04-29 17:48:59 -04:00
fc2f539c7d
NIFI-9976 Upgraded json-smart to 2.4.8
...
- Replaced nifi-framework-bundle managed dependency to root managed dependency
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6005 .
2022-04-29 10:12:41 +02:00
569929269a
NIFI-9956: Fix QuerySalesforceObject schema parsing with nested field strategy
...
This closes #5998 .
Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
2022-04-28 17:17:24 +02:00
ac2d7d1e54
NIFI-9968 Added null check before System.setProperty() in test methods
...
- Resolves build failures on Java 17 where the original user.timezone property returns null from System.getProperty()
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #6000
2022-04-27 14:38:33 -04:00
8b08795e18
NIFI-9944 Configured maven-dependency-plugin for JavaScript test JAR
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #5997
2022-04-27 09:52:47 -04:00
4b66299cf6
NIFI-9944: Fixed issue with using modules in InvokeScriptedProcessor
2022-04-27 09:52:44 -04:00
6ee3d32ca3
NIFI-9918: 'Parse XML Attributes' property added to XMLReader
...
NIFI-9918: Fixed review findings
NIFI-9918: Example added to XMLReader's additionalDetails.html on the new property. Minor documentation fixes.
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #5964 .
2022-04-26 22:07:59 -04:00
56fecbb7d8
NIFI-9955 Upgraded ZooKeeper 3.4.14 to 3.5.9
...
This closes #5995 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-04-24 15:46:55 +02:00
83a9e965d2
NIFI-9888 Fix Azure header datetime format
...
This fixes the occasional "403 Forbidden" bug that we have seen, simply because
the signature ends up being invalid due to an invalid datetime format used.
Issue: NIFI-9888
Reference: https://stackoverflow.com/a/51636763/647151
Use statically defined formatter and explain why
This closes #5943 .
Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-04-23 22:11:40 -04:00
4f423a59ba
NIFI-9952 Upgraded Jackson BOM to 2.13.2.20220328
...
- Removed unnecessary references to jackson.version property
- Removed unnecessary dependency management references to Jackson libraries
This closes #5992
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-04-23 08:23:39 -04:00
4b7f8cbe1f
NIFI-9949 This closes #5988 . Corrected intermittent failures in TestPutSFTP
...
- Changed SSH server to start and stop after each method
- Replaced queued file with string FlowFile contents
- Refactored TestPutSFTP using JUnit 5
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-04-21 12:23:07 -07:00
b288810316
NIFI-9943 Added Transform Provider to nifi-xml-processing
...
- Refactored TransformerFactory references using StandardTransformerProvider
This closes #5986
Signed-off-by: Paul Grey <greyp@apache.org>
2022-04-21 15:14:54 -04:00
4450f4ce50
NIFI-9941 - fix handling of ReportingTask stop request
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #5985
2022-04-21 14:18:09 -04:00
5a3c7d1fbd
NIFI-9940: Renamed StandardProcessGroupSynchronizer to StandardVersionedComponentSynchronizer. Added synching for processors, input/output ports, connections, etc. Added unit tests.
...
This closes #5983
2022-04-21 10:28:21 -04:00
1e345db649
NIFI-9942 Removed load test from TestPutUDP
...
- Refactored TestPutUDP using JUnit 5
- Standardized test method naming
This closes #5984
Signed-off-by: Paul Grey <greyp@apache.org>
2022-04-21 09:45:00 -04:00
28c7583bdb
fixed error message reporting ( #5979 )
2022-04-21 09:12:02 -04:00
aeaec170d5
NIFI-9861: Removed BlockListClassLoader in favor of AllowListClassLoader
...
NIFI-9861: Fixed stateless-processor-tests assembly to ensure that all necessary libraries were included; removed BlockListClassLoader
NIFI-9861: Fixed issue in which we would list .class files as files that we allow through the AllowListClassLoader but didn't allow them.
This closes #5925 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-04-20 22:49:43 +02:00
73ee1a9a1e
NIFI-9720 Added QuerySalesforceObject Processor
...
This closes #5802
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-04-20 13:59:21 -05:00
285a8cbc3c
NIFI-9776 Adding the possibility to export flow definition with referenced services ( #5859 )
...
* NIFI-9776 Adding the possibility to export flow definition with referenced services
* NIFI-9776 Refining naming based on code review
2022-04-20 10:29:38 -04:00
9774bb90ca
NIFI-9917 fix the tooltip of "delivery guarantee/best effort" to a more accurate one
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #5963 .
2022-04-20 16:25:42 +02:00
e98b68cc3a
NIFI-9939 Upgraded SSHJ from 0.32.0 to 0.33.0
...
- Removed PatchedSFTPEngine with resolution of SFTP renaming in SSHJ 0.33.0
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #5982 .
2022-04-20 15:21:22 +02:00
0a94762119
NIFI-9925 Adjust PutUDP and SNMP tests to run without preferring IPv4
...
This closes #5976
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-04-19 14:13:00 -05:00
18a4182cb0
NIFI-9883 Refactor Property Protection using Isolated ClassLoader ( #5972 )
...
* NIFI-9883 Refactored property protection to isolated ClassLoader
- Added nifi-property-protection-loader for abstracting access to implementation classes using ServiceLoader
- Updated Authorizer and Login Identity Provider configuration using isolated ClassLoader
- Updated NiFi Properties Loader using isolated ClassLoader
- Updated nifi-assembly to place property protection dependencies in lib/properties directory
- Updated and refactored unit tests
- Corrected LoginIdentityProviderFactoryBean getObject() Type
2022-04-19 11:08:04 -04:00
876e16f6a8
NIFI-9933 Upgraded Apache Ant to 1.10.12
...
- Upgraded nifi-groovyx-nar
- Upgraded nifi-scripting-nar
- Upgraded nifi-toolkit-admin
- Upgraded nifi-toolkit-encrypt-config
- Upgraded multiple nifi-hive modules
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #5973 .
2022-04-19 09:39:54 +02:00
081154530a
NIFI-9934 Remove unused Groovy dependency management from nifi-graph-test-clients
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #5974 .
2022-04-19 09:38:02 +02:00
ecf0a93124
NIFI-9935 Upgraded Zip4j from 2.9.1 to 2.10.0
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #5975 .
2022-04-19 09:36:29 +02:00
57a4dce28b
NIFI-9928 Removed nifi-security-utils from nifi-prometheus-reporting-task
...
- Adjusted PrometheusServer configuration to use SSLContextService.createContext() instead of individual properties
This closes #5970
Signed-off-by: Paul Grey <greyp@apache.org>
2022-04-18 18:05:53 -04:00
ce95097aee
NIFI-9899 Corrected MongoDBLookupService attribute handling
...
- Corrected collection and database name properties to handle FlowFile attributes
This closes #5966
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-04-18 10:33:27 -05:00
84340962d4
NIFI-9927 Initial Commit to clean up all extraneous version/group declarations.
...
This closes #5969
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-04-16 12:05:07 -04:00
7f95de27fb
NIFI-9862 Updated JsonTreeReader to read Records from Nested Field
...
This closes #5937
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-04-14 15:50:02 -05:00
4310df0544
NIFI-9924 Corrected text encoding in PutEmail filenames and TestFTP
...
This closes #5967
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-04-14 14:58:22 -05:00
efd2421154
NIFI-9897 This closes #5949 . Refactored GRPC SSL Configuration
...
- Added SslContextProvider abstracting Netty SslContext configuration
- Removed runtime dependency on nifi-security-utils from nifi-grpc-processors
- Added TestListenGRPC with methods verifying socket connection and protocol negotiation
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-04-14 09:40:19 -07:00
e76acabe9e
NIFI-9923 Corrected SimpleProcessLogger handling of Throwable causes
...
- Changed log methods that accept a String and Object array to replace the last Throwable argument with a formatted summary of causes when calling LogRepository.addLogMessage()
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #5965 .
2022-04-14 12:30:57 -04:00
15f7590f7a
NIFI-9901 Added nifi-xml-processing to nifi-commons
...
- Refactored XML parsing to use providers from nifi-xml-processing
- Configured spotbugs-maven-plugin with findsecbugs-plugin in nifi-xml-processing
- Disabled Validate DTD in default configuration for EvaluateXPath and EvaluateXQuery
- Replaced configuration of DocumentBuilder and streaming XML Readers with shared components
- Removed XML utilities from nifi-security-utils
- Moved Commons Configuration classes to nifi-lookup-services
This closes #5962
Signed-off-by: Paul Grey <greyp@apache.org>
2022-04-13 19:56:57 -04:00
05f3d7510f
NIFI-9903: This closes #5955 . When using the 'success' relationship only for LookupRecord, lookup all records until a match is found, in order to determine the resultant schema. Refactored code to eliminate AbstractRouteRecord, because LookupRecord is the last processor that extended from it. Refactored code to use an inner interface to clean up code.
...
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-04-13 13:49:26 -07:00
3034f2637a
NIFI-9893 - Ensure orderly cluster node removal on node delete via UI ( #5946 )
2022-04-13 13:44:28 -04:00
5ec02c3464
Bump moment ( #5951 )
...
Bumps [moment](https://github.com/moment/moment ) from 2.29.1 to 2.29.2.
- [Release notes](https://github.com/moment/moment/releases )
- [Changelog](https://github.com/moment/moment/blob/develop/CHANGELOG.md )
- [Commits](https://github.com/moment/moment/compare/2.29.1...2.29.2 )
---
updated-dependencies:
- dependency-name: moment
dependency-type: direct:production
...
Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
This closes #5951
2022-04-12 11:45:13 -04:00
68c6722f76
NIFI-9832: Fix disappearing XML element content when the element has attribute ( #5896 )
...
- NIFI-9832: Additional test cases for XMLReader
2022-04-12 11:41:50 -04:00
27e78c6f0c
NIFI-9871 Correct Component Stack Trace Logging ( #5945 )
...
- Refactored SimpleProcessLogger to avoid sending stack trace causes to SLF4J Logger
- Refactored SimpleProcessLogger to minimize duplication of component message formatting
- Updated ConnectableTask logging to avoid repeating Throwable class in message string
- Refactored TestSimpleProcessLogger to improve coverage and confirm consistent argument handling
- Corrected handling of exception strings in argument arrays
2022-04-12 11:14:36 -04:00
47f75651bb
NIFI-9911: Fixed checking HDFS URI in ListHDFS' Directory property
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #5957
2022-04-12 08:50:49 -04:00
Mark Payne
Joe Gresock
Peter Turcsanyi
Robert Kalmar
UcanInfosec
exceptionfactory
Csaba Bejan
mr1716
Bence Simon
krisztina-zsihovszki
Nandor Soma Abonyi
ravinarayansingh
Gabor Kulik
Matthew Hawkins
Mike Thomsen
Nathan Gough
Lehel
Paul Grey
Tamas Palfy
Emilio Setiadarma
Matthew Burgess
Pierre Villard
Timea Barna
Hsin-Ying Lee
Malthe Borch
royalfork2
Daniel Urban
Joe Witt
Eduardo Fontes
patalwell
NissimShiman
Arpad Boda
Kevin Doran
Otto Fowler
dependabot[bot]
Ferenc Erdei
timeabarna
Nissim Shiman
Tamas Palfy
Juldrixx
greyp9
tpalfy
Bryan Bende
Mark Bean
Paula Yamashita
Chris Sampson
Peter Gyori
Matt Gilman
Juldrixx
simonbence
Peter Gyori