989287adaf
NIFI-8027 In AbstractExecuteSQL make 'SQL Pre-Query' and 'SQL Post-Query' properties support escaping semicolons to allow them be part of statements.
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #4732
2020-12-16 14:57:59 -05:00
02665d7561
NIFI-8092: Fix ITPutS3Object test failure due to Outposts storage class
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4728 .
2020-12-16 12:43:24 +01:00
f29d6a6046
NIFI-7989: Add support to UpdateHiveTable for creating external tables
...
NIFI-7989: Add support for creating partitions, quote identifiers
NIFI-7989: Quote table name when getting description
This closes #4697 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-12-15 22:05:53 +01:00
28ca7478d6
NIFI-8019 Added TlsPlatform to provide runtime TLS protocol configuration
...
NIFI-8019 Renamed getDefaultProtocols() to getSupportedProtocols()
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #4673 .
2020-12-14 19:34:58 -05:00
5bcb5abc86
NIFI-1930 Updated ListenHTTP to set TLS included protocols based on SSLContextService
...
NIFI-1930 Removed unused import in SSLContextServiceTest
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #4673 .
2020-12-14 14:31:08 -05:00
a73cd6a610
NIFI-7856: If a Provenance Event File is ready to be rolled over due to the maximum amount of time having elapsed, avoid rolling over unless there is at least one event written to the event file. Otherwise, we can have multiple RecordWriters / RecordWriterLeases pointing to the same file. This can result in data being overwritten, as well as failing to compress the event file upon rollover. Also added significant DEBUG/TRACE level logging.
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #4580
2020-12-14 11:49:47 -05:00
91f6b42985
NIFI-8085 Use poll(Duration) in ConsumeKafka_2_x processors
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4725 .
2020-12-13 10:23:35 +01:00
ec3d5f89f0
NIFI-8086: Fix file separator char in PutS3Object multipart state directory path
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4726 .
2020-12-13 10:18:32 +01:00
8eb0db6b38
NIFI-8083: SSLSocketChannel Logging Improvement
...
Fixed additional logs messages with same issue
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #4722
2020-12-11 10:06:06 -05:00
7bff64b3cf
NIFI-7913 Added getEnabledProtocols() to TlsConfiguration and updated ListenSMTP to set enabled protocols on SSL Sockets
...
NIFI-7913 Changed order of supported protocols to match existing comments in SSLContextService
This closes #4599
Signed-off-by: Nathan Gough <thenatog@gmail.com>
2020-12-10 11:53:20 -05:00
8e4948322e
NIFI-8074 Switched ReplaceText to use line by line evaluation as its default evaluation mode.
...
This closes #4711
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-10 10:30:11 -05:00
1f8b4e4779
NIFI-8080: Move script compilation to configurator init method
...
This closes #4718
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-09 21:05:44 -05:00
1d31434c48
NIFI-8055 Fix validation message class-name for AzureCosmosDBClientService
...
This closes #4695
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2020-12-09 17:13:25 -06:00
8d2fd39bdb
NIFI-8066: Bump GRPC dependency versions ( #4716 )
2020-12-09 09:37:01 -05:00
0af736dc0b
NIFI-7885 Added Environment Variable to deny LFS access using Hadoop ( #4712 )
...
* NIFI-7885 Added Environment Variable to deny LFS access using Hadoop
* NIFI-7885 Changed Hadoop Processor validation to check LFS access
2020-12-09 09:29:42 -05:00
2c0671cf80
NIFI-8080: Compile Jython scripts before evaluating
...
This closes #4717
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-09 08:57:21 -05:00
cfbcecc4c6
NIFI-7884 Added and applied Distributed File System permissions ( #4713 )
2020-12-08 15:56:46 -05:00
039a09923a
NIFI-8073 Correcting isBackPressureEnabled in PrometheusMetricsUtil
2020-12-07 10:03:16 -05:00
d7ca4c920c
NIFI-8073 corrected condition for label isBackPressureEnabled
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2020-12-07 10:03:04 -05:00
405c393cb5
NIFI-8031: Add UPSERT capability for MySQL in PutDatabaseRecord
...
This closes #4678
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-07 08:51:07 -05:00
2f99d6fce4
NIFI-4540 - Added FIFO options to PutSQS
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4705 .
2020-12-07 13:11:22 +01:00
37c2284d04
NIFI-8068: Ensure that when we determine the best of multiple possible types in a UNION that we handle Arrays of Records properly. Also refactored code to be a bit cleaner by extracting blocks of it into appropriately named methods
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4706 .
2020-12-04 19:31:23 +01:00
71d5162965
NIFI-6878: Added 'Use statement.type Attribute' to ConvertJSONToSQL
...
This closes #3893
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-04 07:39:08 -05:00
29ea872f2c
NIFI-8042: Fixed bug that was escaping Expression Language references for use in a Regular Expression (i.e., Pattern.quote) even though it wasn't being used in a Regular Expression
...
This closes #4685
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-04 07:30:09 -05:00
d84583690f
NIFI-8070: Added coalesce function to RecordPath
2020-12-03 17:23:11 -05:00
04aaf25131
NIFI-1121: Use display name for dependent property documentation
2020-12-03 16:39:46 -05:00
8055c47a84
NIFI-8058 Fixed a UI error to correctly delete dynamic properties while configuring processors.
...
Changed to check the length of all unfiltered properties instead of only filtered properties.
Added additional check if descriptor is a dynamic property.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #4707
2020-12-03 15:44:56 -05:00
312fa8e85e
NIFI-8064 Convert TestSecureClientZooKeeperFactory to integration test
2020-12-03 14:46:13 -05:00
2b1359a808
NIFI-8060 Addressed review feedback
2020-12-03 14:42:50 -05:00
8ac8a2bd1f
NIFI-8060 Added minimal VolatileProvenanceRepository to nifi-stateless-engine and remove dependency on nifi-volatile-provenance-repo module
2020-12-03 14:42:50 -05:00
b90a6e893d
NIFI-7906 This closes #4701 . Updated test case to fix a windows-centric bug.
...
NIFI-7906 Removed unused test code.
Signed-off-by: Joe Witt <joewitt@apache.org>
2020-12-03 07:22:40 -07:00
c29cced269
NIFI-7906: parameterized graph query
...
NIFI-7906: addressing PR concerns
NIFI-7906: code styling fixes
NIFI-7906: adding in license information to new files
+ enables processor in META-INF
NIFI-7906: exclude test files from RAT
NIFI-7906: PR refactor to streamline graph response
NIFI-7906: removing ERRORS output
Unused after refactor
Did a few cleanups for the contributor.
This closes #4638
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-01 11:13:10 -05:00
64e3599f05
NIFI-7260: Fix error handling and re-evaluate Module Directory property on changed for scripted controller services
...
This closes #4147
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-12-01 09:42:14 -05:00
1e13b62e78
NIFI-8047 Added documentation for sensitive DBCP properties
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #4696
2020-11-30 18:33:32 -05:00
aaa1452d04
NIFI-8054: Updated ReflectionUtils to use a WeakHashMap for the mapping of annotations to methods with that annotation. This way, the ReflectionUtils class will not hold a reference to Classes that are no longer referenced elsewhere. ( #4694 )
2020-11-30 16:14:12 -05:00
fe53f8090d
NIFI-8047 Added support for sensitive dynamic properties in DBCP
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #4692
2020-11-30 14:55:20 -05:00
39f8a008d4
NIFI-8039 Adding properties to ListenTCP in order to allow refine behaviour under higher load; Refining thread pool for better scalability
...
NIFI-8039 Review findings; refining thread pool to be able to scale down properly when not under load
NIFI-8039 Answers to PR comments
This closes #4689 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-11-30 10:17:15 +01:00
3625a73d91
NIFI-7821 Added Cassandra-based DMC.
...
NIFI-7821 Updated configuration documentation.
NIFI-7821 Fixed getAndPutIfAbsent and added int test.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #4635
2020-11-29 18:58:57 -05:00
fe950131c3
NIFI-8046: Fix issue with ResultSetRecordSet on DB2
...
This closes #8046 .
Signed-off-by: Peter Turcsanyi <turcsanyi@apache.org>
2020-11-27 19:23:44 +01:00
5ea18f39b5
NIFI-8048 PutElasticsearchRecord should retry with 503 response
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #4690 .
2020-11-26 10:49:52 +01:00
124cdbd3fe
NIFI-6403 and NIFI-6404: Elasticsearch 7 support
...
Addressed PR#4153 comments; removed ES Version property and made Type optional in all ES HTTP/Record processors, applying sensible default values where required; use _source queyr parameter instead of _source_include/s as it's compatible between ES versions
Fix unit test compilation to use JDK8-compatible library/method
Better optional type and id handling for PutElasticsearchRecord; update nifi-elasticsearch-client-service build dependencies to use latest versions of Elasticsearch in each supported major version (5/6/7); addressed several warnings in ElasticSearchClientServiceImpl
This closes #4667 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2020-11-26 15:08:13 +09:00
a3d845a38f
NIFI-6403: Adding Elasticsearch7 support to HTTP processors
...
This closes #4153 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2020-11-26 15:08:05 +09:00
857eeca3c7
NIFI-8032: fix record-path-guide.adoc
...
This closes #4679
Signed-off-by: Mike Thomsen <mthomsen@apache.org>
2020-11-24 18:01:16 -05:00
7ad9520079
NIFI-8041: Refactored API for stateless nifi so that calling StatelessDataflow.trigger() returns an object that allows the caller to wait for the result, cancel the result, etc. and then optionally acknowledge the completion. This allows the caller to block the completion of ProcessSession.commit() until it has handled the output of the dataflow execution.
...
NIFI-8038: Fixed deadlock that can occur when updating Parameter Context
This closes #4684 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2020-11-24 15:12:51 -05:00
3c9d8a7007
NIFI-7897: Refactoring to create a new nifi-framework-components module.
...
- Refactored nifi-stateless to make use of nifi-framework-components
- Removed requirement for nifi-framework-nar to be provided.
- Refactored stateless nifi into api, engine, nar, and bootstrap modules, with a parent 'bundle' module
- Creation of nifi-stateless-system-tests
- Added unit tests and logging
- Changed flow configuration to use properties file instead of json
- Allow for -p parameter to specify parameters on command line
- Moved implementations of Authorizer, NiFiUser, and UserGroupProviders to new module named nifi-framework-authorization-providers so that those that depend on nifi-framework-authorization don't have to bring in the providers. This way, we can have stateless not bring in those providers, as we otherwise get warnings on startup about the provider already being registered. Additionally, it avoids needing dependencies on spring-security-core
- Updated bin/nifi.sh script to run new stateless bootstrap
- Added Reporting Tasks to stateless.
- Download bundles as necessary on stateless nifi startup
NIFI-7897: Addressing review feedback
NIFI-7897: Fixed typos in README and also addressed issue that caused parameters with spaces not to be parsed properly
This closes #4669 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2020-11-24 11:37:45 -05:00
87fd9f968f
NIFI-7958 ConvertAvroToORC - decimal support
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #4628
2020-11-23 13:00:54 -05:00
932496e106
NIFI-7879 Created record path function for UUID v5
...
This closes #4570 .
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2020-11-20 12:10:01 -06:00
2bf5d1a56d
NIFI-8017 NPEx at org.apache.nifi.provenance.index.lucene. IndexDirectoryManager:486
...
Added an extra null-check to avoid NullPointerException
2020-11-19 16:01:42 -05:00
dc6ba2541f
NIFI-8024 Added null claim check to EncryptedFileSystemRepository.read() to avoid EOFException
2020-11-19 09:11:49 -05:00
40fdcd8144
NIFI-7771 - Infinite loop on WebUI when node stopped in cluster (PB1)
...
This commit resolves "Problem 1" described in issue #7771 .
Signed-off-by: Nathan Gough <thenatog@gmail.com>
This closes #4496 .
2020-11-18 14:56:59 -05:00
Tamas Palfy
Peter Turcsanyi
Matthew Burgess
exceptionfactory
Mark Payne
David Mollitor
Mike Thomsen
Sushil Kumar
Peter Turcsanyi
Bryan Bende
DataMoTrain
r65535
mtien
Levi Lentz
Bence Simon
Koji Kawamura
Chris Sampson
Joe Gresock
zhangcheng
Arek Burdach
Denes Arvay
humpfhumpf