Commit Graph

6715 Commits

Author SHA1 Message Date
exceptionfactory 977800b835
NIFI-9210 Upgraded jsoup from 1.8.3 to 1.14.2
This closes #5379

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2021-09-11 12:44:29 -04:00
Lehel Boér d96398feb8 NIFI-9200: Free cache on heap after disabling AbstractCSVLookupService
This closes #5372.

Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2021-09-09 09:45:57 +02:00
exceptionfactory 6e059ef7c6
NIFI-9204 Excluded spotbugs-annotations from accumulo-core (#5374)
This closes #5374
2021-09-08 16:48:42 -04:00
Paul Grey 0a9a8aa190
NIFI-9071 - Update asciidoctor plugin
This closes #5373

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2021-09-08 11:51:33 -04:00
Matthew Burgess 98e3b465c3
NIFI-8376: Gracefully handle SQL exceptions in ResultSetRecordSet
This closes #4951

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2021-09-08 09:11:26 -04:00
Paul Grey cbc25aa180
NIFI-9197 - Improve AWS Surefire Run Time
This closes #5370

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2021-09-08 06:46:48 -04:00
Paul Grey 6ce9919a1f NIFI-9197 - Improve AWS Surefire Run Time 2021-09-08 06:46:26 -04:00
Mohammed Nadeem acb25c1130
NIFI-9170 Upgrade commons-beanutils to 1.9.4 to mitigate CVE-2019-10086
NIFI-9170 Add two more 1.9.4 references to close out the few things identified by the Maven dependency plugin.

This closes #5351

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2021-09-07 16:24:57 -04:00
exceptionfactory 2c5cf8ba0a
NIFI-9141 Refactored nifi-provenance-provenance-bundle using JUnit 5
NIFI-9141 Added class Timeout annotations

This closes #5368

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2021-09-07 13:33:15 -04:00
exceptionfactory f5a421ccb1
NIFI-9067 Upgraded JAXB Runtime from 2.3.0 to 2.3.5
- Replaced old com.sun.xml.bind:jaxb-impl and jaxb-core with current org.glassfish.jaxb:jaxb-runtime
- Replaced old javax.xml.bind:jaxb-api with current jakarta.xml.bind-api
- Removed unnecessary dependency references to javax.activation-api

This closes #5320

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2021-09-07 13:27:53 -04:00
Bence Simon fa79571e30 NIFI-9066 Supporting flow file attributes in PutSplunkHTTP; Fixing endpoint assembly with extra query values
This closes #5330.

Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
2021-09-07 16:50:35 +02:00
Chris Sampson 05adcbcc61
NIFI-9181 Prevent unwanted test artifacts in Windows builds
This closes #5355

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-09-06 17:03:46 -05:00
Mike Thomsen d702506f0d
NIFI-9148 Refactored nifi-scripting-bundle to use JUnit 5.
NIFI-9147 Refactored nifi-rules-action-handler-bundle to use JUnit 5.
NIFI-9146 Refactored nifi-riemann-bundle to use JUnit 5.
NIFI-9144 Refactored nifi-registry-bundle to use JUnit 5.

This closes #5360

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-09-06 09:42:36 -05:00
exceptionfactory 20804ff2b1
NIFI-8749 Removed implicit time zone conversion to GMT
- Updated DataTypeUtils.getDateFormat() to use system default time zone
- Updated Record Path Guide to match Expression Language Guide regarding default time zone
- Updated impacted unit tests to expect localized dates instead of dates converted to GMT

NIFI-8749 Set user.timezone in TestRecordPath to avoid unexpected date conversions

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5361
2021-08-31 16:07:53 -04:00
Matthew Burgess dfa6592a47
NIFI-8749 Revert "Removed implicit time zone conversion to GMT"
This reverts commit 758e1850ed.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>
2021-08-31 13:33:53 -04:00
exceptionfactory 758e1850ed
NIFI-8749 Removed implicit time zone conversion to GMT
- Updated DataTypeUtils.getDateFormat() to use system default time zone
- Updated Record Path Guide to match Expression Language Guide regarding default time zone
- Updated impacted unit tests to expect localized dates instead of dates converted to GMT

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5305
2021-08-31 10:40:57 -04:00
Emilio Setiadarma 2ab23efb74
NIFI-6616 Added GCP Sensitive Property Provider
This closes #5242

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-30 19:15:34 -05:00
Hsin-Ying Lee 59f0b6bac3
NIFI-8739 Penalized flowfiles should be able to be polled from the queue in some cases (#5189) 2021-08-30 11:26:02 -04:00
Joe Gresock 4a3e81531b
NIFI-8490: Adding inherited parameter contexts (#5072)
- Allowing inherited param contexts on creation, updating PC authorization
2021-08-30 10:44:31 -04:00
exceptionfactory 60b08cc569
NIFI-9137 Refactored nifi-parquet-processors using JUnit 5
NIFI-9138 Refactored nifi-pgp-bundle using JUnit 5
NIFI-9139 Refactored nifi-poi-bundle using JUnit 5
NIFI-9140 Refactored nifi-prometheus-bundle using JUnit 5

This closes #5353

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2021-08-28 08:34:29 -04:00
markap14 d90ef06752
NIFI-9017: Update Load Balanced Connection logic so that if a node connects to the cluster with a different load balancing hostname/port, it starts sending to the new endpoint instead of failing to send to the old endpoint (#5287)
Self-merging based on +1 feedback from multiple active community members who have reviewed & tested code
2021-08-27 21:37:06 -04:00
Bryan Bende e436381c3a
NIFI-8975 Integrate KerberosUserService into HBase processors/services
This closes #5322

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-27 17:41:58 -05:00
exceptionfactory 4ccb2b6b4a NIFI-9049 Replaced localStorage with sessionStorage for Bearer Token
- Added JavaScript Authorization Storage component for storing and retrieving JSON Web Tokens
- Added access status request to remove Session Cookie when Token not found

NIFI-9049 Updated Jolt JavaScript application to use AuthorizationStorage

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5344.
2021-08-27 16:58:52 -04:00
exceptionfactory ed4d4d5938 NIFI-9016 Added BCFKS KeyStoreKeyProvider examples to User Guide
Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5285.
2021-08-27 12:29:16 -04:00
theBestAndrew ee7ca5dcfd
NIFI-9172 fix Currency/Concurrency user guide typo
This closes #5352

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2021-08-27 10:07:58 -04:00
exceptionfactory 0cf09840ea
NIFI-9082 Add nifi.zookeeper.jute.maxbuffer property (#5335)
* NIFI-9082 Added nifi.zookeeper.jute.maxbuffer property

- Updated ZooKeeperStateProvider to check jute.maxbuffer instead of hard-coded number
- Updated internal ZooKeeperClientConfig class to include new juteMaxBuffer property

* NIFI-9082 Updated jute.maxbuffer documentation and added hexadecimal representation

- Renamed DefaultWatcher to NoOpWatcher
- Removed unnecessary validateDataSize() from createNode()
2021-08-26 21:12:34 +02:00
Peter Gyori 73062146c6 NIFI-9076: hdfs operations in MoveHDFS wrapped in UGI.doAs()
This closes #5334.

Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
2021-08-25 19:18:48 +02:00
Paul Grey aa5babbb97
NIFI-9073 - Limit Surefire Output during Build
This closes #5325

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-24 10:37:07 -05:00
Peter Turcsanyi 1d1b805f04
NIFI-9079: Set log level to WARN for Apache Atlas client logs (#5331) 2021-08-24 16:34:58 +02:00
timeabarna 9ebdd4bdf1
NIFI-8761 Enable not setting a value for Escape Character in CSVReade… (#5249)
NIFI-8761 Enable not setting a value for Escape Character in CSVReader controller service

Co-authored-by: Pierre Villard <pierre.villard.fr@gmail.com>
2021-08-24 14:38:16 +02:00
exceptionfactory a652280fbb NIFI-8766 Implemented RS512 Algorithm for JWT Signing
- Replaced per-user symmetric-key HS256 with shared and rotated RSA asymmetric-key RS512 implementation
- Added nifi.security.user.jws.key.rotation.period property for RSA Key Pair rotation
- Added JSON Web Tokens section to Administration Guide
- Implemented persistent storage of RSA Public Keys for verification using Local State Manager
- Implemented JWT revocation on logout with persistence using Local State Manager
- Refactored JWT implementation using Spring Security OAuth2 and Nimbus JWT
- Refactored Spring Security Provider configuration using Java instead of XML
- Removed H2 storage of per-user keys
- Upgraded nimbus-jose-jwt from 7.9 to 9.11.2

NIFI-8766 Corrected AuthenticationException handling in AccessResource.getAccessStatus

- Added nifi.user.security.jws.key.rotation.period to default nifi.properties
- Updated logging statements and clarified configuration and method documentation

NIFI-8766 Changed Algorithm to PS512 and updated documentation

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #5262.
2021-08-19 12:26:12 -04:00
Lehel Boér 9bcbf83e5a NIFI-8752: Automatic diagnostic at NiFi restart/stop
This closes #5195.

Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
2021-08-19 18:09:58 +02:00
Róbert Kalmár 388b79d1ee
NIFI-9054 Calling Nifi Registry's createExtensionBundleVersion REST endpoint will cause NullPointerException (#5309)
Co-authored-by: Robert Kalmar <rkalmar@cloudera.com>
2021-08-19 09:57:17 -04:00
exceptionfactory c2c3727dd5
NIFI-9040 Add GitHub Workflow for System Tests (#5310)
- Added GitHub Workflow for System Tests
- Added system-tests badge to README.md
- Added nifi-stateless-system-test-suite to system-tests workflow
2021-08-19 09:52:16 -04:00
Bryan Bende 21c2fb95d3
NIFI-8973 Implement KerberosUserService API and keytab, password, and ticket cache implementations
NIFI-8974 Integrate KerberosUserService with HDFS processors

NIFI-8980 Integrate KerberosUserService with Kafka 2.6 processors
- Introduced SelfContainerKerberosUserService to restrict which impls can be used with Kafka
- Add variations of KerberosUser doAs that allow setting the context ClassLoader
- Add additional unit tests for configurations

This closes #5277

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-18 19:54:56 -05:00
Paul Grey fc1fa3f32c
NIFI-9057 Manage concurrency for GitHub Workflow Runs
This closes #5315

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-18 18:29:06 -05:00
exceptionfactory 1ce897f43a
NIFI-9059 Added Java 11 dependencies to Stateless Assembly (#5314)
- Updated nifi-stateless-system-test-suite with directory for Java 11 dependencies
2021-08-18 15:54:57 -04:00
Bence Simon c3ecf2fea8 NIFI-9032 Refactoring HDFS processors in order to increase flexibility
This closes #5295.

Signed-off-by: Tamas Palfy <tamas.bertalan.palfy@gmail.com>
2021-08-17 16:57:27 +02:00
Emilio Setiadarma 714670b8e6
NIFI-6615 Added Azure Key Vault Key Sensitive Property Provider
This closes #5274

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-13 10:54:48 -05:00
Mike Thomsen 4c6bd856c0
NIFI-9041 Replaced JUnit 4 only testing configuration with a combination of JUnit 5 and JUnit Vintage.
- Updated nifi-mock to be exclusively JUnit 5
- Updated a few modules to demonstrate a successful conversion to all JUnit 5

This closes #5304

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-12 17:39:42 -05:00
Mark Payne fb4edfa0d6
NIFI-8950: Added ability to optionally use a file-system backed Content Repository for Stateless NiFi
This closes #5254

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-11 12:01:07 -05:00
timeabarna 5106197b3b
NIFI-9018 When connection points to a moved port version change with … (#5286)
* NIFI-9018 When connection points to a moved port version change with NiFi Registry may throw exception
2021-08-11 14:26:08 +02:00
Matthew Burgess 5ff4974b1f
NIFI-5936: Added DROP provenance event to MockProcessSession.remove() to match real impl
This closes #5302

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2021-08-11 07:16:11 -04:00
Matthew Burgess 9a56d23311
NIFI-9021: Add javax.servlet-api to MiNiFi assembly
This closes #5292

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-08-10 15:02:53 -05:00
exceptionfactory b34b5b8eef
NIFI-9037 Simplified GitHub Workflow Configuration
- Created environment variables for shared Maven commands and projects
- Combined multiple Maven Cache actions
- Added node_modules to NPM Cache action configuration
- Disabled NiFi Registry integration tests in the default configuration
- Removed JUnit Results artifacts from workflow
- Removed parallel build argument from GitHub workflow Maven command
- Upgraded Surefire Plugin to 3.0.0-M5
- Upgraded Enforcer Plugin to 3.0.0
- Added package-lock.json for nifi-jolt-transform-json-ui

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5298
2021-08-09 19:27:46 -04:00
tpalfy 77cf9a11df
NIFI-8671 Create nifi-versioned-components module. (#5145)
NIFI-8671 Moved versioned components class into nifi-api
- Removed @XmlRootElement from VersionedProcessGroup.
- Fixed nifi-api dependency version in nifi-registry-data-model. Changed logic of handling instances of un-annotated classes during xml serialization in JAXBSerializer.
2021-08-09 16:55:39 -04:00
exceptionfactory f27cd012f3
NIFI-9035 Refactored isKeystoreValid() to avoid NullPointerException
- Removed unnecessary debug logging from StandardTlsConfiguration
- Replaced internal string labels with StoreType enum

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5297
2021-08-09 15:55:20 -04:00
Chris Sampson 2e1f276f06
NIFI-8790 allow Expression Language for Index Operation in PutElasticsearchRecord
Improved validation for PutElasticsearchRecord Index Operation property

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5220
2021-08-09 13:51:15 -04:00
in-park 8d2ced429d
NIFI-9033: Defining Validators and default values for NifiStatelessConnectors' DATA_FLOW name. (#5296) 2021-08-09 12:55:54 -04:00
Mauro Riva 34ab0d8c25
NIFI-8753: Expose flowfile repository implementation configuration
NIFI-8753: Fixed implementation in test to VolatileFlowFileRepository
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5196
2021-08-09 12:19:22 -04:00