Commit Graph

6995 Commits

Author SHA1 Message Date
markap14 d90ef06752
NIFI-9017: Update Load Balanced Connection logic so that if a node connects to the cluster with a different load balancing hostname/port, it starts sending to the new endpoint instead of failing to send to the old endpoint (#5287)
Self-merging based on +1 feedback from multiple active community members who have reviewed & tested code
2021-08-27 21:37:06 -04:00
Bryan Bende e436381c3a
NIFI-8975 Integrate KerberosUserService into HBase processors/services
This closes #5322

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-27 17:41:58 -05:00
exceptionfactory 4ccb2b6b4a NIFI-9049 Replaced localStorage with sessionStorage for Bearer Token
- Added JavaScript Authorization Storage component for storing and retrieving JSON Web Tokens
- Added access status request to remove Session Cookie when Token not found

NIFI-9049 Updated Jolt JavaScript application to use AuthorizationStorage

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5344.
2021-08-27 16:58:52 -04:00
exceptionfactory ed4d4d5938 NIFI-9016 Added BCFKS KeyStoreKeyProvider examples to User Guide
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5285.
2021-08-27 12:29:16 -04:00
theBestAndrew ee7ca5dcfd
NIFI-9172 fix Currency/Concurrency user guide typo
This closes #5352

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2021-08-27 10:07:58 -04:00
exceptionfactory 0cf09840ea
NIFI-9082 Add nifi.zookeeper.jute.maxbuffer property (#5335)
* NIFI-9082 Added nifi.zookeeper.jute.maxbuffer property

- Updated ZooKeeperStateProvider to check jute.maxbuffer instead of hard-coded number
- Updated internal ZooKeeperClientConfig class to include new juteMaxBuffer property

* NIFI-9082 Updated jute.maxbuffer documentation and added hexadecimal representation

- Renamed DefaultWatcher to NoOpWatcher
- Removed unnecessary validateDataSize() from createNode()
2021-08-26 21:12:34 +02:00
Peter Gyori 73062146c6 NIFI-9076: hdfs operations in MoveHDFS wrapped in UGI.doAs()
This closes #5334.

Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
2021-08-25 19:18:48 +02:00
Paul Grey aa5babbb97
NIFI-9073 - Limit Surefire Output during Build
This closes #5325

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-24 10:37:07 -05:00
Peter Turcsanyi 1d1b805f04
NIFI-9079: Set log level to WARN for Apache Atlas client logs (#5331) 2021-08-24 16:34:58 +02:00
timeabarna 9ebdd4bdf1
NIFI-8761 Enable not setting a value for Escape Character in CSVReade… (#5249)
NIFI-8761 Enable not setting a value for Escape Character in CSVReader controller service

Co-authored-by: Pierre Villard <pierre.villard.fr@gmail.com>
2021-08-24 14:38:16 +02:00
exceptionfactory a652280fbb NIFI-8766 Implemented RS512 Algorithm for JWT Signing
- Replaced per-user symmetric-key HS256 with shared and rotated RSA asymmetric-key RS512 implementation
- Added nifi.security.user.jws.key.rotation.period property for RSA Key Pair rotation
- Added JSON Web Tokens section to Administration Guide
- Implemented persistent storage of RSA Public Keys for verification using Local State Manager
- Implemented JWT revocation on logout with persistence using Local State Manager
- Refactored JWT implementation using Spring Security OAuth2 and Nimbus JWT
- Refactored Spring Security Provider configuration using Java instead of XML
- Removed H2 storage of per-user keys
- Upgraded nimbus-jose-jwt from 7.9 to 9.11.2

NIFI-8766 Corrected AuthenticationException handling in AccessResource.getAccessStatus

- Added nifi.user.security.jws.key.rotation.period to default nifi.properties
- Updated logging statements and clarified configuration and method documentation

NIFI-8766 Changed Algorithm to PS512 and updated documentation

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5262.
2021-08-19 12:26:12 -04:00
Lehel Boér 9bcbf83e5a NIFI-8752: Automatic diagnostic at NiFi restart/stop
This closes #5195.

Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
2021-08-19 18:09:58 +02:00
Róbert Kalmár 388b79d1ee
NIFI-9054 Calling Nifi Registry's createExtensionBundleVersion REST endpoint will cause NullPointerException (#5309)
Co-authored-by: Robert Kalmar <rkalmar@cloudera.com>
2021-08-19 09:57:17 -04:00
exceptionfactory c2c3727dd5
NIFI-9040 Add GitHub Workflow for System Tests (#5310)
- Added GitHub Workflow for System Tests
- Added system-tests badge to README.md
- Added nifi-stateless-system-test-suite to system-tests workflow
2021-08-19 09:52:16 -04:00
Bryan Bende 21c2fb95d3
NIFI-8973 Implement KerberosUserService API and keytab, password, and ticket cache implementations
NIFI-8974 Integrate KerberosUserService with HDFS processors

NIFI-8980 Integrate KerberosUserService with Kafka 2.6 processors
- Introduced SelfContainerKerberosUserService to restrict which impls can be used with Kafka
- Add variations of KerberosUser doAs that allow setting the context ClassLoader
- Add additional unit tests for configurations

This closes #5277

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-18 19:54:56 -05:00
Paul Grey fc1fa3f32c
NIFI-9057 Manage concurrency for GitHub Workflow Runs
This closes #5315

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-18 18:29:06 -05:00
exceptionfactory 1ce897f43a
NIFI-9059 Added Java 11 dependencies to Stateless Assembly (#5314)
- Updated nifi-stateless-system-test-suite with directory for Java 11 dependencies
2021-08-18 15:54:57 -04:00
Bence Simon c3ecf2fea8 NIFI-9032 Refactoring HDFS processors in order to increase flexibility
This closes #5295.

Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
2021-08-17 16:57:27 +02:00
Emilio Setiadarma 714670b8e6
NIFI-6615 Added Azure Key Vault Key Sensitive Property Provider
This closes #5274

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-13 10:54:48 -05:00
Mike Thomsen 4c6bd856c0
NIFI-9041 Replaced JUnit 4 only testing configuration with a combination of JUnit 5 and JUnit Vintage.
- Updated nifi-mock to be exclusively JUnit 5
- Updated a few modules to demonstrate a successful conversion to all JUnit 5

This closes #5304

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-12 17:39:42 -05:00
Mark Payne fb4edfa0d6
NIFI-8950: Added ability to optionally use a file-system backed Content Repository for Stateless NiFi
This closes #5254

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-11 12:01:07 -05:00
timeabarna 5106197b3b
NIFI-9018 When connection points to a moved port version change with … (#5286)
* NIFI-9018 When connection points to a moved port version change with NiFi Registry may throw exception
2021-08-11 14:26:08 +02:00
Matthew Burgess 5ff4974b1f
NIFI-5936: Added DROP provenance event to MockProcessSession.remove() to match real impl
This closes #5302

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2021-08-11 07:16:11 -04:00
Matthew Burgess 9a56d23311
NIFI-9021: Add javax.servlet-api to MiNiFi assembly
This closes #5292

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-10 15:02:53 -05:00
exceptionfactory b34b5b8eef
NIFI-9037 Simplified GitHub Workflow Configuration
- Created environment variables for shared Maven commands and projects
- Combined multiple Maven Cache actions
- Added node_modules to NPM Cache action configuration
- Disabled NiFi Registry integration tests in the default configuration
- Removed JUnit Results artifacts from workflow
- Removed parallel build argument from GitHub workflow Maven command
- Upgraded Surefire Plugin to 3.0.0-M5
- Upgraded Enforcer Plugin to 3.0.0
- Added package-lock.json for nifi-jolt-transform-json-ui

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5298
2021-08-09 19:27:46 -04:00
tpalfy 77cf9a11df
NIFI-8671 Create nifi-versioned-components module. (#5145)
NIFI-8671 Moved versioned components class into nifi-api
- Removed @XmlRootElement from VersionedProcessGroup.
- Fixed nifi-api dependency version in nifi-registry-data-model. Changed logic of handling instances of un-annotated classes during xml serialization in JAXBSerializer.
2021-08-09 16:55:39 -04:00
exceptionfactory f27cd012f3
NIFI-9035 Refactored isKeystoreValid() to avoid NullPointerException
- Removed unnecessary debug logging from StandardTlsConfiguration
- Replaced internal string labels with StoreType enum

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5297
2021-08-09 15:55:20 -04:00
Chris Sampson 2e1f276f06
NIFI-8790 allow Expression Language for Index Operation in PutElasticsearchRecord
Improved validation for PutElasticsearchRecord Index Operation property

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5220
2021-08-09 13:51:15 -04:00
in-park 8d2ced429d
NIFI-9033: Defining Validators and default values for NifiStatelessConnectors' DATA_FLOW name. (#5296) 2021-08-09 12:55:54 -04:00
Mauro Riva 34ab0d8c25
NIFI-8753: Expose flowfile repository implementation configuration
NIFI-8753: Fixed implementation in test to VolatileFlowFileRepository
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5196
2021-08-09 12:19:22 -04:00
Denes Arvay f57685e971 NIFI-8955 Add Max Connection Lifetime property to Hive(_1_1)ConnectionPool CS
This closes #5259.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-08-09 15:15:18 +02:00
Timea Barna 462306369f NIFI-8668 ConsumeAzureEventHub NiFi processors need to support storage SAS token authentication
This closes #5136.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-08-09 12:57:56 +02:00
Paul Grey 0a827d6cd7 NIFI-9025 Fixed reference in TestTailFile unit test
This closes #5294

Signed-off-by: Joey Frazee <jfrazee@apache.org>
2021-08-07 15:40:26 -07:00
Mark Payne bf52973d62
NIFI-8773: Implemented Line Start Pattern in TailFile
Each message encountered in the tailed file will be buffered (up to some configurable max) until the subsequent message arrives. At that point, the previous message will be flushed.

This closes #5251

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-06 15:52:55 -05:00
Joe Gresock 82bd72b83d
NIFI-9002: Renaming Stateless' ParamaterProvider to ParameterValueProvider (#5282) 2021-08-06 13:01:26 -04:00
Joe Gresock cc1e9665cd
NIFI-8696: Added HashiCorp Vault KeyValue SPP
This closes #5255

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-06 07:39:34 -05:00
Mark Payne 787f16da3f
NIFI-9013: Moved nifi-properties-loader and nifi-properties dependencies from data-provenance-utils to the repository where they are needed
This closes #5283

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2021-08-05 20:36:01 -04:00
Matthew Burgess 47d5ae5d75
NIFI-8990: Downgrade Gremlin from 3.5.1 to 3.4.4 to support Graph DBs
This closes #5284

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-05 16:30:38 -05:00
Yoshiaki Takahashi 4fa357ed9e
NIFI-5886: Add RPM profile for NiFi Toolkit
Co-authored-by: Kotaro Terada <kotarot@apache.org>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #4943.
2021-08-05 13:35:16 +02:00
Lehel Boér 9bf3b55034 NIFI-7947: Add directory deletion functionality in DeleteAzureDataLakeStorage
This closes #5190.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-08-05 13:21:44 +02:00
exceptionfactory c273b02ebe
NIFI-9008 Added Jetty modules to managed dependencies
- Updated OWASP dependency check suppressions with jetty-test-helper

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5281.
2021-08-05 12:01:02 +02:00
Denes Arvay f47603ee48
NIFI-8957 NiFi Registry - Possibility to set a description when creating a bucket
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5271.
2021-08-05 11:56:02 +02:00
Mark Bean 713f997f87
NIFI-8991: reduce Node.js requirement across modules to a single version
This closes #5278

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-04 08:54:01 -05:00
Pierre Villard 6139c51063
NIFI-8951 - fixed scale vs precision reference in QueryDatabaseTable processors
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5256
2021-08-04 09:23:35 -04:00
exceptionfactory a4375a046f
NIFI-8990 Upgraded Groovy to 2.5.14
- Added dependency management override for Groovy 2.4.21 in Hive Processors
- Upgraded TinkerPop Gremlin to 3.5.1 in graph bundle to depend on Groovy 2.5.14
- Adjusted TlsHelperGroovyTest variable declaration to avoid compiler warnings

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5276
2021-08-04 09:18:38 -04:00
Peter Turcsanyi a239eea8ff
NIFI-8996: Close JDBC statements in PutHive*QL processors.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5280
2021-08-04 09:13:15 -04:00
exceptionfactory 633cdab121
NIFI-8964 Add Cluster Firewall Configuration to Admin Guide (#5264)
NIFI-8964 Added Cluster Firewall Configuration to Admin Guide
2021-08-03 10:38:59 -04:00
exceptionfactory d93e9f152c
NIFI-8986 Upgraded Commons Compress to 1.21
- Upgraded direct and transitive dependencies from 1.20 and earlier to 1.21

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5273.
2021-08-03 15:52:45 +02:00
Timea Barna 0497129aa6
NIFI-8763 Hide some properties in CSVReader when built-in CSV Format is selected
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5263.
2021-08-03 10:14:47 +02:00
exceptionfactory fb96590586
NIFI-8987 Upgraded Tika to 1.27 and Graphics2d to 0.32
- Tika 1.27 and Graphics2d upgrade Apache PDFBox to 2.0.24

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5272.
2021-08-03 10:06:54 +02:00