5e83bda9e9
NIFI-10167: Added advanced timing metrics for processors, such as CPU Usage, time reading/writing content repo, process session commit time, etc. Exposed via nifi.sh diagnostics and made configurable via nifi.properties
...
This closes #6156
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-30 10:50:24 -05:00
d5b626f0e4
NIFI-10108 Processor scheduling via parameter ( #6115 )
...
- NIFI-10108 Processor scheduling via parameter
- Refactoring component referencing check in AbstractComponentNode and StandardParameterReferenceManager classes.
2022-06-30 10:11:13 -04:00
f3455372bd
NIFI-10182 Removed optional vendor Maven repository
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6169 .
2022-06-30 12:50:46 +02:00
0458b6432d
NIFI-10158 Corrected ListFTP expression support for Hostname and Port
...
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6162 .
2022-06-29 22:11:11 -04:00
7a47c8cfbd
NIFI-10162 Reorganized InvokeHTTP Properties
...
- Corrected handling of documentation for allowable values
NIFI-10162 Updated Multipart Form-Data Name description
This closes #6163 .
Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-06-29 16:52:19 -04:00
6997f17bff
NIFI-10180 This closes #6168 . Removed standard Maven repository definitions
...
- Upgraded Apache parent from 25 to 26
- Upgraded Apache Rat Plugin from 0.13 to 0.14
- Upgraded Maven Compiler Plugin from 3.9.0 to 3.10.1
- Removed Confluent repository from Confluent Registry Service module
- Removed MapR repository profile configuration
- Removed Hortonworks repository profile configuration
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-06-29 10:04:47 -07:00
ee3dcc78bf
NIFI-10173 This closes #6164 . Upgraded Flume from 1.6.0 to 1.10.0
...
- Removed unmaintained flume-dataset-sink and flume-ng-elasticsearch-sink dependencies
- Added dependency-check suppression configuration for false positives on Flume libraries
Signed-off-by: Joe Witt <joewitt@apache.org>
2022-06-29 10:04:09 -07:00
39c366eeef
NIFI-10169: When using the Insert Record Fields join strategy of JoinEnrichment, ensure that in order to combine schemas from the original record and the enrichment record we use incorporateSchema() so that even when the first enrichment record is null, we get the schema correct
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6157 .
2022-06-29 17:28:15 +02:00
4a9c3435db
NIFI-10174 Upgraded Spring Framework from 5.3.20 to 5.3.21
...
- Upgraded Spring Security from 5.7.1 to 5.7.2
- Upgraded Spring Boot from 2.7.0 to 2.7.1 for NiFi Registry
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6165 .
2022-06-29 17:18:41 +02:00
5bdede1fab
NIFI-10175 Upgraded Jetty from 9.4.46 to 9.4.48
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6166 .
2022-06-29 17:17:06 +02:00
4cb9997ea2
NIFI-10176 Upgraded OkHttp from 4.9.3 to 4.10.0
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6167 .
2022-06-29 17:11:39 +02:00
a098653d07
NIFI-10165 Increased NiFi bootstrap heap size to 48 MB
...
- Increased bootstrap heap size from 24 MB to 48 to avoid heap constraints when using HTTP notifications
This closes #6161
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-28 14:56:55 -05:00
0de83292de
NIFI-9849 Refactored SAML Support with Spring Security 5
...
- Updated SAML Authentication Configuration with Spring Security SAML 2 components
- Updated Administration Guide with REST Resources
- Replaced SAMLAccessResource methods with applicable Spring Security Filters
- Removed IDP Credential Service and supporting components
- Removed message.logging.enabled, metadata.signing.enabled, and signature.digest.algorithm properties
- Added Access Token Expiration resource method
- Removed Saml2AccessResource and replaced with Access Token Expiration to avoid unnecessary conflicts with SAML login consumer
- Corrected Resource URI handling to support proxy server access
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6149 .
2022-06-28 13:57:35 -04:00
1465c2c629
NIFI-9908 C2 refactor and test coverage improvements
...
This closes #6149
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-28 12:02:31 -05:00
db11961026
NIFI-9440 Allow Controller Services to have configurable Bulletins
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #6035
2022-06-28 10:44:45 -04:00
b3b13a4ee0
NIFI-10145 Upgraded Hadoop from 3.3.2 to 3.3.3
...
- Excluded slf4j-reload4j implementation of Log4j 1
- Updated nifi-hive3-processors to leverage shared Hadoop version from 3.1.1
- Updated nifi-accumulo-bundle to leverage shared Hadoop version from 3.1.1
- Updated nifi-atlas-bundle to leverage shared Hadoop version from 3.3.2
- Updated nifi-spark-receiver to leverage shared Hadoop version from 3.3.2
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6139 .
2022-06-28 16:19:38 +02:00
c1c1d0da82
NIFI-10153 Refactored DocGeneratorTest and removed binary test files
...
This closes #6146
Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-06-27 22:05:53 -04:00
9d379121c4
NIFI-5005: Fix MergeRecord to honor writer's schema
...
This closes #6141 .
Signed-off-by: Tamas Palfy <tpalfy@apache.org>
2022-06-27 21:53:20 +02:00
d8ebfb25d0
NIFI-10161 Added Gzip Content-Encoding to InvokeHTTP and ListenHTTP
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6150 .
2022-06-26 22:23:32 +02:00
b6a32a9c5d
NIFI-10025 Removed in-project copy of com.hortonworks.registries.schemaregistry.client.SchemaRegistryClient, relying on original instead. Added basic auth support for HortonworksSchemaRegistry.
...
This closes #6055 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-06-24 22:22:35 +02:00
1442dcef23
NIFI-10111: Added option to unpack NARs into an Uber Jar and updated stateless nifi to always use this.
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #6117
2022-06-24 13:12:14 -04:00
0e52ccf9e9
NIFI-10159 Move internal interfaces from c2-client-api
...
This closes #6152
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-23 15:45:45 -05:00
62eb565daf
NIFI-5402 - Added more assembly options for different modules. Assemblies should build a zip by default, or a tar.gz with the -Ptargz profile
...
This closes #5694
Signed-off-by: Paul Grey <greyp@apache.org>
2022-06-23 13:52:41 -04:00
a3e8048b2d
NIFI-9981 Added support for Avro UUID types
...
This closes #6013
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-23 08:35:31 -05:00
5980625014
NIFI-10156 Remove unnecessary commons-lang3 dependency from c2-protocol-api
...
This closes #6148
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-22 16:17:48 -05:00
b1b20968d6
NIFI-10155 Bump NAR Maven Plugin version to 1.3.4
...
This closes #6147
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-22 15:47:23 -05:00
3dda694fd6
NIFI-10139: Adding fields to RemoteProcessGroupStatus ( #6137 )
2022-06-22 12:24:23 -04:00
edd862bf55
NIFI-10013 For JASN1RecordReader added unit test for checking multi-record input.
...
This closes #6091 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2022-06-22 18:19:52 +02:00
bc84532a8b
NIFI-9983 Add output relation name attribute in QueryRecord processor ( #6011 )
...
* NIFI-9983 Add output relation name attribute
2022-06-21 17:55:07 -04:00
f9beb507fd
NIFI-9996 - ListFile does not list root directory when Recurse Subdirectories is active and Path Filter is specified ( #6110 )
2022-06-21 17:23:49 -04:00
c08996515b
NIFI-10106 Avoid NPE in LookupRecord.createLookupCoordinates ( #6111 )
2022-06-21 17:03:44 -04:00
5febd47c72
NIFI-10109 Changed HashMap to LinkedHashMap in JsonTreeRowRecordReader ( #6112 )
...
- Added unit test to confirm preservation of field ordering
2022-06-21 17:00:34 -04:00
47121614a2
NIFI-10146 Upgraded Apache Tika from 2.4.0 to 2.4.1
...
- Removed direct dependency on metadata-extractor to inherit newer transitive version
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6140 .
2022-06-21 22:58:40 +02:00
ac8c1b0326
NIFI-10148: Fixed bug in SwappablePriorityQueue, in which the Active Queue Size could be decremented before the Unacknowledged Queue Size is incremented when FlowFiles are polled. This can result in the SwappablePrioriotyQueue incorrectly returning a value of true from the isEmpty() method. Additionally, updated the NiFiSystemIT so that if waiting for a particular queue size we periodically log size of all queues, which aids in debugging, and added necessary methods to FlowClient to make that happen.
...
This closes #6143
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-21 15:55:47 -05:00
b60b9b8e29
NIFI-10141: Fix WriteJsonResult logging to show writer's schema ( #6142 )
...
* NIFI-10141: Fix WriteJsonResult logging to show writer's schema
2022-06-21 16:53:30 -04:00
1de9c72779
NIFI-10140 Handle deleted parameters in StandardVersionedComponentSynchronizer
...
Signed-off-by: Joe Gresock <jgresock@gmail.com>
This closes #6138 .
2022-06-21 10:43:38 -04:00
eef4ea1fc6
NIFI-10138 Updated Atlas tests to use Jackson 2
...
- Replaced Jackson 1 dependencies with Jackson 2
- Removed commons-beanutils override that is no longer necessary with new Hadoop version
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6136 .
2022-06-18 09:46:23 +02:00
4aee4546b9
NIFI-10135 Upgraded maven-surefire-plugin to 3.0.0-M7
...
- Removed duplicate plugin configuration in nifi-registry
- Removed maven-failsafe-plugin override in nifi-elasticsearch-client-service
- Removed failing test ResourceAuthorizationFilterSpec in nifi-registry-web-api
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6132 .
2022-06-18 09:43:46 +02:00
4db3c76e90
NIFI-10136 Upgraded Jersey from 2.35 to 2.36
...
- Removed duplicate declaration of jersey-bom
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6133 .
2022-06-18 09:40:01 +02:00
5e01d3de06
NIFI-10117: Allowing remote group ports to be synchronized from Stand… ( #6128 )
...
NIFI-10117: Allowing remote group ports to be synchronized from StandardVersionedComponentSynchronizer
2022-06-17 14:28:14 -04:00
d89f98f5b4
NIFI-9666 Implemented MiNiFi C2 client and refactored bootstrap
...
- Implemented MiNiFi C2 client using OkHttp
- Refactored MiNiFi bootstrap command handling and socket communication
- Added C2 Client Service to nifi-framework-core
This closes #6075
Co-authored-by: Matthew Burgess <mattyb149@apache.org>
Co-authored-by: Csaba Bejan <bejan.csaba@gmail.com>
Co-authored-by: Ferenc Erdei <ferdei@cloudera.com>
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-17 09:23:52 -05:00
bd45eb4995
NIFI-10100 Upgraded Jersey to 2.35
...
- Replaced individual version references with Jersey BOM dependency
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #6106 .
2022-06-16 23:09:22 -04:00
2161d0fe9c
NIFI-10104 Refactored usage of PropertyEncryptor
...
This closes #6119
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-16 16:38:34 -05:00
a30ac23e90
NIFI-10116 Added CLI toolkit command to delete report tasks
...
This closes #6126
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-16 14:53:04 -05:00
6a285c67e5
NIFI-10122 Upgraded Spark Streaming to 3.3.0
...
- Added false positive vulnerability suppression for Spark modules
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #6130 .
2022-06-16 18:12:47 +02:00
07bbcb771e
NIFI-10087 Implemented UDPEventRecordSink
...
This closes #6099
Signed-off-by: Paul Grey <greyp@apache.org>
2022-06-15 17:58:17 -04:00
1f2820a39a
NIFI-10119 Upgraded test hadoop-minikdc from 3.1.0 to 3.3.3
...
- Corrected JUnit 5 Assetions usage in KerberosUserIT
This closes #6129
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-15 13:14:59 -05:00
6c6cb99b38
NIFI-10118 Upgraded OWASP Dependency Check from 7.1.0 to 7.1.1
...
This closes #6127
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-14 16:17:50 -05:00
d298a3ab83
NIFI-10082 Upgraded Google libraries BOM to 25.4.0
...
This closes #6125
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-14 14:26:14 -05:00
0f5d8517b5
NIFI-5378 Prevent duplicate keys with different values in nifi.properties
...
This closes #6061
Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-06-14 11:06:35 -05:00
Mark Payne
timeabarna
exceptionfactory
Emilio Setiadarma
Csaba Bejan
Nissim Shiman
Matthew Burgess
Tamas Palfy
Nathan Gough
Mike Thomsen
Kevin Doran
Joe Gresock
Juldrixx
greyp9
tpalfy
Bryan Bende
Zoltan Kornel Torok
UcanInfosec
Mark Bean