Commit Graph

178 Commits

Author SHA1 Message Date
Mike Thomsen 78dbee8b7a
NIFI-10805 Upgraded script bundle Clojure, Groovy and JRuby
- Upgraded Clojure from 1.10.1 to 1.11.1
- Upgraded Groovy from 3.0.8 to 3.0.13
- Upgraded JRuby from 9.3.8.0 to 9.3.9.0

This closes #6657

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-14 07:54:52 -06:00
dependabot[bot] cc35e3e427
NIFI-10782 Upgraded Apache Ivy from 2.5.0 to 2.5.1
This closes #6630 and #6631

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-11-08 15:31:45 -06:00
Nissim Shiman f4069ab77a
NIFI-10287 ExecuteScript - Allow python scripts to use external modules
Co-authored-by: Nissim Shiman <nshiman@yahoo.com>
Co-authored-by: dan-s1 <dstieg1@gmail.com>

NIFI-10287 changes for code review

NIFI-10287 modification based on reviewer comment

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6254
2022-11-02 16:18:41 -04:00
Mike Thomsen b6d95faa95
NIFI-10711 Made the script runner more debuggable.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6590
2022-10-31 13:39:42 -04:00
UcanInfosec 808d3d6664
NIFI-10636 Update Jython-standalone to 2.7.3
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6521
2022-10-18 16:57:32 -04:00
UcanInfosec 14a2249c0e
NIFI-10626 Update jruby-complete to 9.3.8.0
This closes #6510

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-10-12 20:32:17 -04:00
Matt Gilman e638bcee2f
NIFI-10617:
- Adding dynamic property annotation on a number of extensions that were missing it.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6501
2022-10-10 10:32:50 -04:00
Joe Witt c9ebdd2025
NIFI-10521-RC4 prepare for next development iteration 2022-10-03 10:59:36 -07:00
Joe Witt 109e54cd58
NIFI-10521-RC4 prepare release nifi-1.18.0-RC4 2022-10-03 10:59:34 -07:00
Matt Burgess 6f0ca87304
NIFI-10387: Fixed negative logic bug in scripted components (#6325) 2022-08-23 13:53:12 -04:00
Mark Payne cb275dd956
NIFI-10385: If script body is empty for AbstractScriptedControllerService or InvokeScriptedProcessor, do not attempt to load script
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6324
2022-08-22 22:34:29 -04:00
Matt Burgess 0d0a119737
NIFI-1954: Add additionalDetails page to ExecuteScript (#6044)
* NIFI-1954: Add additionalDetails page to ExecuteScript

* NIFI-1954: Incorporated review comments
2022-08-15 11:44:30 -04:00
UcanInfosec 415413fac2
NIFI-10327 Upgraded Apache Ivy from 2.4.0 to 2.5.0
This closes #6275

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-08-08 12:44:12 -05:00
Joe Witt 8c66bf948c
NIFI-10272-RC2 prepare for next development iteration 2022-07-27 13:24:09 -07:00
Joe Witt 8d256784d8
NIFI-10272-RC2 prepare release nifi-1.17.0-RC2 2022-07-27 13:24:06 -07:00
exceptionfactory 7244b9cfc4
NIFI-10271 This closes #6242. Upgraded Xerces from 2.12.1 to 2.12.2
- Suppressed false positive vulnerability report for CVE-2017-10355

Signed-off-by: Joe Witt <joewitt@apache.org>
2022-07-23 17:59:33 -07:00
Matt Burgess d0db4c44bb
NIFI-10231: Change AbstractScriptedControllerService.OnConfigurationRestored to use ConfigurationContext (#6207) 2022-07-14 11:49:00 -04:00
exceptionfactory 45cc3cefe5 NIFI-10069 Updated multiple components to support Sensitive Dynamic Properties
- ExecuteScript
- ExecuteStreamCommand
- InvokeScriptedProcessor
- HikariCPConnectionPool

This closes #6085.

Signed-off-by: Kevin Doran <kdoran@apache.org>
2022-06-01 11:26:41 -04:00
exceptionfactory 83316736f8
NIFI-9959 Add UI Support for Sensitive Dynamic Properties (#6073)
* NIFI-9959 Added UI Support for Sensitive Dynamic Properties

- Added SupportsSensitiveDynamicProperties to DBCPConnectionPool and ScriptedReportingTask

* NIFI-9959 Added sensitive parameter argument for Controller Service descriptors

* NIFI-9959 Adjusted sensitive property descriptor handling to support changing status

* NIFI-9959 Added info icon for Sensitive Value field

* NIFI-9959 Corrected handling of descriptor for existing dynamic properties

* NIFI-9959 Cleaning up dialog markup.

Co-authored-by: Matt Gilman <matt.c.gilman@gmail.com>

This closes #6073
2022-05-25 21:36:31 -04:00
Paul Grey a528b89169
NIFI-10003 - NiFi build fails in UTC+ time zones
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #6038
2022-05-12 13:55:51 -04:00
exceptionfactory 0c8305950c
NIFI-9987 Standardize Commons IO on version 2.11.0
- Removed version declarations from multiple modules
- Adjusted PutDynamoDB to remove catch for IOException not thrown in Commons IO 2.11.0

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #6015.
2022-05-09 12:06:37 +02:00
Matthew Burgess 04121c9d6a
NIFI-8533: Replace deprecated jython-shaded with jython-slim
This closes #5531

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2022-05-02 15:47:23 -05:00
exceptionfactory 8b08795e18
NIFI-9944 Configured maven-dependency-plugin for JavaScript test JAR
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5997
2022-04-27 09:52:47 -04:00
Matthew Burgess 4b66299cf6
NIFI-9944: Fixed issue with using modules in InvokeScriptedProcessor 2022-04-27 09:52:44 -04:00
Matthew Burgess 252a8abadd
NIFI-9896: Fixed bug with overwriting Script Body value in InvokeScriptedProcessor
This closes #5948

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-04-09 06:00:02 -04:00
exceptionfactory 44cdc8e38e
NIFI-9860 Upgraded JRuby from 9.2.6.0 to 9.3.4.0
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5924
2022-04-04 13:48:46 -04:00
Joe Witt 0419dc2939
NIFI-9780-RC3 prepare for next development iteration 2022-03-21 11:58:27 -07:00
Joe Witt b019a9191f
NIFI-9780-RC3 prepare release nifi-1.16.0-RC3 2022-03-21 11:58:09 -07:00
exceptionfactory 412e21be97
NIFI-9281 Enabled building on Java 17
- Added Ubuntu Zulu JDK 17 GitHub build
- Adjusted MiNiFi C2 FileSystemConfigurationCache test to avoid using environment variables
- Adjusted MiNiFi StatusLogger and StatusLoggerTest to avoid overriding private logger
- Adjusted failure reason attribute check in TestGetIgniteCache
- Adjusted TestRangerAuthorizer and TestRangerNiFiAuthorizer to avoid checking nested exceptions
- Adjusted encrypt-config TestUtil to avoid unnecessary comparison of different types
- Disabled Javascript tests on Java 15 and higher
- Disabled several Hive 3 tests on Java 17 for StringInternUtils illegal access
- Refactored nifi-enrich-processors tests to use Mockito without Powermock
- Refactored nifi-toolkit-tls tests to avoid illegal reflective access
- Removed deprecated X509Certificate test in CertificateUtilsTest
- Removed kryo serialization from nifi-site-to-site-client test
- Updated TestHashContent to use SHA-1 instead of SHA for hash algorithm
- Upgraded maven-war-plugin from 2.5 to 3.3.2
- Upgraded nifi-graph-bundle dependencies from Groovy 2.5.14 to 3.0.8
- Upgraded QuestDB from 4.2.1 to 6.2.1 in nifi-framework-core

This closes #5870

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-03-17 14:08:38 -04:00
Bence Simon 3b8afee9d6
NIFI-9778 Fixing additional details for ScriptedPartitionRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5852.
2022-03-09 14:49:28 +01:00
exceptionfactory fe1139b8bb
NIFI-9692 Upgraded Apache Commons Lang3 to 3.12.0
- Moved commons-lang3 version management to root Maven configuration
- Refactored limited usage of StringUtils is nifi-reporting-utils to remove commons-lang3
- Refactored limited usage of StringUtils in nifi-websocket-processors to remove commons-lang3

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5773
2022-02-16 09:28:21 -05:00
Matthew Burgess 9d8b39529e
NIFI-9596: Fix newline bug in JythonScriptRunner
NIFI-9596: Added comment to indicate why the Apache header is missing

This closes #5682

Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2022-02-02 08:46:29 -05:00
exceptionfactory d66219739b
NIFI-5821 Added Engine Name to Script Engine property descriptions
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5529
2021-11-17 12:32:55 -05:00
Joe Witt c055895952
NIFI-9344-RC3 prepare for next development iteration 2021-11-03 08:53:37 -07:00
Joe Witt 7fdc07cccd
NIFI-9344-RC3 prepare release nifi-1.15.0-RC3 2021-11-03 08:53:32 -07:00
Matthew Burgess 104078868e
NIFI-7012: Refactored OnConfigurationRestored to support sensitive property validation (#5415) 2021-10-27 14:40:17 -04:00
Mark Payne 5b7af511fc NIFI-8273: Fix typos in docs/clarify some statements. Addressed handling of arrays as partitions
This closes #4948.
2021-09-23 09:14:00 -04:00
Bence Simon db5b618550 NIFI-8273 Adding Scripted Record processors 2021-09-23 09:13:36 -04:00
Mike Thomsen d702506f0d
NIFI-9148 Refactored nifi-scripting-bundle to use JUnit 5.
NIFI-9147 Refactored nifi-rules-action-handler-bundle to use JUnit 5.
NIFI-9146 Refactored nifi-riemann-bundle to use JUnit 5.
NIFI-9144 Refactored nifi-registry-bundle to use JUnit 5.

This closes #5360

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-09-06 09:42:36 -05:00
Joe Witt 97feacc181
NIFI-8767-RC2 prepare for next development iteration 2021-07-10 12:17:09 -07:00
Joe Witt fcbf1d5f97
NIFI-8767-RC2 prepare release nifi-1.14.0-RC2 2021-07-10 12:17:05 -07:00
Matthew Burgess 632fbcca7d
NIFI-8730: Invalidate (don't evaluate) empty script in scripting components
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #5184.
2021-06-30 13:44:52 +02:00
exceptionfactory 2efc2b6b8b
NIFI-8718 Upgraded Apache Commons IO to 2.10.0
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5169
2021-06-21 11:29:27 -04:00
Matthew Burgess 3e774bc5be
NIFI-8625: Refactor scripted components to use ScriptRunner to fix concurrency issues (#5116)
NIFI-8625: Refactor scripted components to use ScriptRunner to fix concurrency issues
2021-06-11 14:44:55 -04:00
Mark Payne ecacfdaa4c NIFI-8469: Introduced ProcessSession.commitAsync and updated processors to use it. Deprecated ProcessSession.commit()
- Updated Mock Framework to now fail tests that use ProcessSession.commit() unless they first call TestRunner.setAllowSynchronousSessionCommits(true)
- Updated stateless nifi in order to make use of async session commits
- Fixed bug that caused stateless to not properly handle Additional Classpath URLs and bug that caused warnings about validation to get generated when a flow that used controller services was initialized. While this is not really in scope of NIFI-8469, it was found when testing and blocked further progress so addresssed here.
- If Processor fails to progress when run from stateless, trigger from start of flow until that is no longer the case
- Introduced notion of TransactionThresholds that can limit the amount of data that a flow will bring in for a given invocation of stateless dataflow
- Several new system-level tests
2021-05-19 08:51:16 -04:00
exceptionfactory 6776765a92
NIFI-8538 Upgraded Apache Commons IO to 2.8.0
- Upgraded direct dependencies from 2.6 to 2.8.0
- Added dependency management configuration to use 2.8.0 for some modules
- Updated scripted Groovy tests to avoid copying unnecessary files

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #5073
2021-05-14 09:31:48 -04:00
Matthew Burgess a4d435c995 NIFI-8330: Fix compilation of Jython scripts for scripting components
- Add onPropertyModified to ExecuteScript to recompile on change

This closes #4903.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2021-05-11 16:51:23 -04:00
Mark Payne 7d1d536da6
NIFI-8206: Added identifiesExternalResource() method to PropertyDescriptor.Builder and implemented functionality.
- Updated components to make use of new feature

NIFI-8206: Added a ResourceType of TEXT. This requires that the ResourceReferenceFactory know which types are allowed in order to create the ResourceReference. PropertyValue needs to then have the PropertyDescriptor available to it. This resulted in highlighting many bugs in unit tests where components were not exposing property descriptors via getSupportedPropertyDescriptors() or were evaluating Expression Language using the wrong scope, so fixed many unit tests/components to properly declare Expression Language scope when using it

NIFI-8206: Removed problematic unit test that required directory names with special characters that are not allowed on some operating systems

This closes #4890.

Signed-off-by: Bryan Bende <bbende@apache.org>
2021-04-12 11:48:04 -04:00
Nathan Gough 07a4966d10
NIFI-8329 - Updated dependencies with no build failures
NIFI-8329 - Removed unnecessary jackson.version from azure bundle to use the global property instead.

NIFI-8329 - Updated jackson/jackson-databind version and removed the 'jackson-databind.version' pom property in favor of 'jackson.version'

Updated dependencies include the following:

- jackson-core
- jackson-databind
- icu4j
- snakeyaml
- spring-integration-mail
- spring-core and framework modules
- activemq-client
- activemq-broker
- xercesImpl

This closes #4911

Signed-off-by: David Handermann <exceptionfactory@apache.org>
2021-03-19 14:46:33 -05:00
exceptionfactory 418e2cc2cb NIFI-8132 Replaced framework uses of MD5 with SHA-256
NIFI-8132 Added FileDigestUtils in nifi-nar-utils to avoid dependency on nifi-utils

NIFI-8132 Removed unused imports from NarUnpacker

NIFI-8132 Removed MD5 references from FileUtils documentation

NIFI-8132 Replaced StringBuffer with StringBuilder and made new DigestUtils classes final

NIFI-8132 Replaced Collections.sort() with Stream.sorted()

Signed-off-by: Nathan Gough <thenatog@gmail.com>

This closes #4788.
2021-02-22 17:52:24 -05:00