Commit Graph

7008 Commits

Author SHA1 Message Date
Paul Grey 70aa719cbf
NIFI-9586 Removed Surefire ForkNodeFactory configuration
- Falling back to default LegacyForkNodeFactory due to SUREFIRE-1800
- Added upload of Surefire results on automated build failures

This closes #5675

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-19 13:50:05 -06:00
Mark Payne 1d353435a5
NIFI-9594: When converting Record to Avro GenericRecord, ensure that any default values that are defined in the GenericRecord's schema get applied, regardless of whether or not the field exists in the associated RecordSchema.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5677.
2022-01-19 19:20:53 +01:00
Joe Witt 139a269c41
NIFI-9597 fixing all explicit version refs to main latest 2022-01-19 11:17:15 -07:00
Kevin Doran 3f69eeceb2
NIFI-9597 This closes #5681. Fix Dockerfile URLs
Update Docker Hub Dockerfiles for MiNiFi, MiNiFi C2, and Registry
to reflect new default binary download locations.

Also, make mirror base url configurable to streamline the RM process.

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-01-19 10:52:30 -07:00
Joe Witt 48c8193c4c
NIFI-9595 Removed nifi-kafka-0.x modules
This closes #5680

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-19 11:18:36 -06:00
exceptionfactory 8edb5faac9
NIFI-9591 This closes #5674. Removed nifi-kite-bundle
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-01-19 09:24:23 -07:00
Joe Witt 2f95eed8cb
NIFI-9575 This closes #5667. updating copyright year to 2022
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-01-19 09:14:09 -07:00
zhangcheng 3811eea4a2
NIFI-9588 This closes #5672. Update doc for `nifi.content.repository.archive.max.retention.period`
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-01-19 09:08:13 -07:00
Tamas Palfy aa61494fc3
NIFI-9065 Add support for OAuth2AccessTokenProvider in InvokeHTTP
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5319.
2022-01-19 13:29:11 +01:00
sedadgn e603b0179b NIFI-7865 amqp$header is splitted in the wrong way for "," and "}"
This PR introduces 2 new properties for the ConsumeAMQP processor
And one new property for PublishAMQP

This allows to configure the processors to use escaping for commas and to consistently not use curly braces in the amqp$header attribute.

The default values ensure backwards compatibility.

This closes #5458.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-01-18 16:45:45 -05:00
exceptionfactory 405934dcd2
NIFI-9571 Corrected Session commit handling in PutTCP
- Added generic type to AbstractPutEventProcessor for compiler checking of event types
- Refactored createTransitUri to shared method in AbstractPutEventProcessor

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5658.
2022-01-18 15:31:36 -05:00
EC2 Default User 18f2384d0a
NIFI-9568 Updated nifi-jolt-transform-json-ui pom.xml to only include CSS and JS assets in WAR
This closes #5660

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-18 09:57:30 -06:00
Zoltan Kornel Torok 9783f1c5c3
NIFI-9552 Fix NoClassDefFound error in case of nifi-registry-ranger-assembly
Without define the jcl-over-slf4j runtime dependency, the assembly plugin will not copy the jcl jar to the ranger lib directory,
which cause NoClassDefFoundError in some cases

This closes #5663

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-18 08:52:43 -06:00
Pierre Villard 4847926a4b
NIFI-9544 - LookupRecord - fixed behavior when no matching value in the LRS
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5638.
2022-01-13 16:13:24 -05:00
exceptionfactory dd7131b257
NIFI-9435 Added registries and names include parameters to Flow Metrics
- Added optional includedRegistries query parameter to Flow Metrics Resource method supporting one or more registries
- Added optional includedNames query parameter to Flow Metrics Resource method supporting one or more metric family names
- Added sampleName and sampleLabelValue optional pattern parameters
- Added FilteringMetricFamilySamplesEnumeration to support streamed filtering
- Added PrometheusMetricsWriter and TextFormat implementation

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5571.
2022-01-13 15:59:00 -05:00
exceptionfactory 7c50f1429e
NIFI-9563 Enabled ListenTCP Pool Receive Buffers property
- Removed deprecation from ListenTCP Pool Receive Buffers property
- Added BufferAllocator configuration property for NettyEventServerFactory

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5653.
2022-01-13 19:50:44 +01:00
exceptionfactory 2ffd4a5a9a
NIFI-9438 Refactored sensitive-property-provider to multiple modules
- Added nifi-property-protection-api with provider interfaces
- Added nifi-property-protection-factory with implementation references
- Added ProtectionSchemeResolver for abstracting conversion from command arguments
- Refactored PropertyProtectionScheme to package private visibility
- Refactored multiple unit test and removed provider integration tests
- Renamed AESSensitivePropertyProvider to AesGcmSensitivePropertyProvider
- Added getSupportedProtectionSchemes() to StandardProtectionSchemeResolver
- Updated command argument descriptions for protection schemes to include supported values

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5650.
2022-01-13 13:18:04 -05:00
exceptionfactory 7aadb0f0fd
NIFI-9566 This closes #5657. Upgraded Logback from 1.2.9 to 1.2.10
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-01-13 09:27:19 -07:00
Pierre Villard d1599eebcf
NIFI-9545 - Fix in-place replacement for LookupRecord processor
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5637.
2022-01-13 10:59:02 -05:00
Joe Witt bc2ba9537a
NIFI-9525 including same pattern for nifi registry. This is commmit 2/2 for NIFI-9525 2022-01-12 15:52:03 -07:00
Gregory M. Foreman 476c70e220
NIFI-9525 This closes #5626. modify lib packaging to use files from build directory
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-01-12 15:51:41 -07:00
exceptionfactory 5054fc3ac6
NIFI-9564 This closes #5652. Removed unnecessary logback-classic test dependencies
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-01-12 10:39:32 -07:00
Gabriel Barbu 6caffca811
NIFI-9348 NIFI-7863 This closes #5495. Added temporary suffix and fixed [NIFI-7863] creation of the directories
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-01-12 10:25:07 -07:00
exceptionfactory 64495e99e9
NIFI-7835 Added authenticated SOCKS proxy support for SFTP
NIFI-7749 Added authenticated HTTP proxy support for SFTP

- Added StandardSocketFactoryProvider to return SocketFactory based on credentials

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5624.
2022-01-12 10:50:01 -05:00
Mark Payne 72e54f4fab NIFI-9390: Updates to MergeContent / MergeRecord so that they play nicely within Stateless
NIFI-9390: Addressed underlying condition in stateless framework that caused Merge-related processors and similar to not properly be triggered as necessary. Added several system tests to verify different configurations.

NIFI-9390: Simplified the logic for how to iterate over the components in a Stateless flow that are ready to be triggered

This closes #5634.

Co-authored-by: Peter Turcsanyi <turcsanyi@apache.org>
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-01-11 09:45:00 +01:00
Tamas Palfy 990285ba1c NIFI-8676 Added 'Tracking Entities' listing strategy to 'ListS3' and 'ListGCSBucket'
This closes #5413.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-01-10 20:35:04 +01:00
Lehel 16bedc50fa NIFI-9506: Fixed Nifi reconnects with websocket server each second
This closes #5645.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-01-10 13:11:39 +01:00
exceptionfactory 6039095625
NIFI-9267 Replaced nifi-standard-web-test-utils with mockwebserver
- Replaced instances of custom Jetty TestServer with OkHttp MockWebServer
- Removed integration tests referencing nifi-standard-web-test-utils SslContextUtils
- Removed nifi-standard-web-test-utils

Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5620.
2022-01-09 05:25:32 -05:00
exceptionfactory 5832dff25e
NIFI-9556 Upgraded Apache HttpClient to 4.5.13
- Upgraded Apache HttpCore to 4.4.15
- Added dependency management declarations in root Maven configuration for HttpClient and HttpCore
- Removed version numbers from multiple modules

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5647.
2022-01-08 11:06:07 +01:00
exceptionfactory ca8bc17c0a
NIFI-7089 Upgraded Apache SSHD from 1.7.0 to 2.8.0
- Replaced fake-sftp-server-rule with test Apache SSHD Server

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5646.
2022-01-08 11:02:12 +01:00
markobean 42626adab8
NIFI-8962: Add overflow strategy to DistributeLoad (#5267) 2022-01-07 14:45:18 -05:00
exceptionfactory 109e4d1c95
NIFI-9541 Removed Elasticsearch 5 Processors
- Removed nifi-elasticsearch-5-bundle
- Removed include-elasticsearch-5-bundle profile from nifi-assembly

This closes #5636

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-01-07 14:30:29 -05:00
Zoltan Kornel Torok c5d174e280
NIFI-9552: Make sure cl-over-slf4j is included under ext/ranger/install/lib directory
Signed-off-by: Joe Gresock <jgresock@gmail.com>

This closes #5643.
2022-01-07 10:08:45 -05:00
Joe Gresock 287e41d8a6
NIFI-9547: Allowing more datatypes in LookupRecord value substitution
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5640.
2022-01-07 12:30:13 +01:00
Mark Payne d9b863a84b
NIFI-9549: Delegate NonFlushableOutputStream write methods to wrapped OutputStream
Ensure that we delegate calls to write(byte[]) and write(byte[], int, int) to the underlying OutputStream for NonFlushableOutputStream, instead of allowing FilterOutputStream to iterate over every byte

This closes #5642

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-06 22:46:55 -06:00
Mark Payne 56593ad12f
NIFI-9546: Updated PutTCP and PutUDP with SupportsBatching annotations
- Removed incorrect usage of TriggerWhenEmpty
- Allow for 0 seconds of gracefully waiting for incoming threads on shutdown since we won't have any
- Updated unit tests to no longer have arbitrary sleep statements

This closes #5639

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-06 15:52:37 -06:00
Chris Sampson bd1b2b4d69 NIFI-9520 update AWS SDK and Kinesis Client Library versions; Allow PutS3Object to use all available StorageClasses
This closes #5632.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-01-06 13:43:23 +01:00
Pierre Villard dc42012755
NIFI-9407 Upgraded Ozone from 1.0.0 to 1.2.1
This closes #5547

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-01-05 22:59:36 -06:00
exceptionfactory 12ba579b8f NIFI-9539 Upgraded Netty from 4.1.69 to 4.1.72
- Added Netty 4 BOM to root Maven configuration
- Removed individual Netty 4 dependency overrides
- Removed commented dependencies and unnecessary declarations from MiNiFi

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5635.
2022-01-05 18:11:03 -05:00
Chris Sampson b0b1a57b98
NIFI-9222 allow ControllerStatusReportingTask to log details even when there are no Counters present on Processors (#5573) 2022-01-05 16:28:12 -05:00
exceptionfactory d783e10e68
NIFI-9537 Upgraded Spring Data Redis to 2.6.0
- Upgraded Jedis from 3.6.3 to 3.8.0

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5633.
2022-01-05 18:58:16 +01:00
exceptionfactory 7c407cf580
NIFI-9523 Consolidated Maven Enforcer Plugin executions
- Removed duplicative Enforcer Plugin configuration from nifi-registry

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5623.
2022-01-05 16:02:01 +01:00
exceptionfactory 81e57c9651
NIFI-9535 Upgraded Spring Framework to 5.3.14
- Centralized Spring Framework and Spring Security versions using BOM dependencies
- Upgraded Spring Security from 5.5.2 to 5.6.1
- Upgraded Spring Boot from 2.5.5 to 2.5.8 in Registry
- Upgraded Spring Integration from 5.5.2 to 5.5.7

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5631.
2022-01-05 15:30:03 +01:00
exceptionfactory abd154026e
NIFI-9534 Upgraded Log4j 2 BOM from 2.17.0 to 2.17.1
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5629.
2022-01-05 15:21:45 +01:00
Andrew Lim f80e2ec70b
NIFI-9532 Correct error in allDelineatedValues table in EL Guide
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5628.
2022-01-05 15:19:26 +01:00
Lehel Boér be138ab656
NIFI-9434: Added bulletin to alert FileSystemRepository backpressure (#5596) 2022-01-04 15:59:32 -05:00
Peter Turcsanyi 4346dd8faf
NIFI-9391: Modified MergeRecord to process FlowFiles within a loop in… (#5550)
* NIFI-9391: Modified MergeRecord to process FlowFiles within a loop in a single onTrigger

MergeRecord processed the FlowFiles in multiple onTrigger-s and it needed an extra onTrigger call
(with no incoming FFs) to realize that no more FFs are available and it is time to send the merged FF downstream.
It was not compatible with Stateless Runtime which does not trigger the flow any more if no FFs available.

Also changed "unschedule" logic in StandardProcessorTestRunner: @OnUnscheduled methods were called immediately after
the 1st FlowFile was processed. Unschedule the processor only at the end of the execution (onTrigger finished)
and only if stopOnFinish has been requested by the test case.
2022-01-04 11:36:56 -05:00
Zoltán Kornél Török e54cbe6451
NIFI-9524 exclude commons-logging and log4j-core banned dependencies for other build profiles as well (#5625) 2022-01-04 09:14:04 -05:00
Vibhath Ileperuma 0ac8f1b32c
NIFI-8605 Adding a new property for ExecuteSQL and ExecuteSQLRecord processors to enable/disable auto committing
change the default value of auto commit function to true
Changed the auto commit property name and add more details in the description
If the auto commit is set to false, commit() is called for consistency
adds unit tests
Fix the check style issue of having more than 200 characters in single line

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5554
2021-12-30 18:35:50 -05:00
Bryan Bende d6efc69585
NIFI-9502 Move extension manifest model and parser out of nifi-registry and into common modules
NIFI-9502 Move ExtensionManifest parser and impl from nifi registry into common module

NIFI-9502 Add jigsaw profile to nifi-extension-manifest-model in order to build on Java 11

Add apache license header to test resources

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5619
2021-12-22 10:46:59 -05:00