Mark Payne
bc0e68ff2a
NIFI-5989: Update to property names to clarify difference between batch sizes
2019-02-08 15:58:43 -05:00
Alex Goos
29d54126e4
NIFI-5989 - PutKudu: Additional FF Queue length setting
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2019-02-08 15:41:02 -05:00
Mark Payne
4e914cea1f
NIFI-6008: When a Processor is Terminated, call its #onPropertyModified method for properties whose value differs from the default value. Previously, it was called if the value differs from the current value (which it never will since we are only restoring the current values for the Processor). This results in ensuring that #onPr #onPropertyModified is correctly called when a component is reloaded
...
This closes #3296 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2019-02-08 10:52:04 -05:00
Jeff Storck
e4be06c7c8
NIFI-5967: Removed unused ALLOW_EXPLICIT_KEYTAB private variable
...
Updated Hive_1_1ConnectionPoolTest.testKerberosAuthException to use a mocked KerberosCredentialsService
This closes #3272
2019-02-08 00:22:56 -05:00
Matthew Burgess
cdf3c69208
NIFI-5967: Add Hive 1.1 processors
...
Removed extra Kerberos properties, added LICENSEs to all Hive NARs, removed unnecessary NOTICE entries
2019-02-08 00:11:38 -05:00
Bryan Bende
8c58d51857
NIFI-5990 This closes #3283 . Moving Developer docs section above Processors
...
Signed-off-by: joewitt <joewitt@apache.org>
2019-02-06 21:04:21 -05:00
thenatog
f81d6bd63b
NIFI-5968 - Added the X-XSS-Protection and Strict-Transport-Security HTTP headers using Jetty Filters. Added some tests.
...
Removed bad test.
Refactored filter creation method.
Ensure HSTS header is only applied if NiFi is secured with HTTPS
Small changes to header array list.
Fixed checkstyle errors.
This closes #3273 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2019-02-07 11:13:28 +11:00
Endre Zoltan Kovacs
24a7d480c8
NIFI-5983: handling parse problems in recordReader implementations
...
Fixed Checkstyle violation
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #3282
2019-02-06 15:54:15 -05:00
Peter Wicks
35147a620f
NIFI-5940 Cluster Node Offload Hangs if any RPG on flow is Disabled
...
This closes #3255
Signed-off-by: Mark Payne <markap14@hotmail.com>
2019-02-06 12:42:43 -05:00
Mark Payne
412c4908e2
NIFI-5997: Recover FlowFile Repository before swap files; then, when recovering swap files, ignore any that are unknown to the flowfile repo. This prevents us from incrementing the size of the flowfile queue for unknown swap files
...
This closes #3292 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2019-02-05 15:23:24 -05:00
Mark Payne
83ac191736
NIFI-5997: If we swap out data, ensure that we do not increment the size of the queue by the size of the data that we failed to swap out. Also, if the FlowFile Repo does not know about a given swap file, do not restore it on restart
...
This closes #3290 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2019-02-04 14:29:17 -05:00
Sujesh Menon
2c2b47ab85
NIFI-5991 Added WebSockets schemes to the broker URI Validator
...
MQTT over websockets uses ws (and wss for secure websocket connections) schemes in the broker URI.
Added support for the same.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3289 .
2019-02-04 15:53:31 +01:00
Peter Wicks
ad1f2fb666
NIFI-5722 Expose Penalty Remaining Duration ( #3091 )
...
Signed-off-by: Koji Kawamura <ijokarumawak@gmail.com>
2019-02-01 13:04:51 -07:00
Mike Thomsen
fef41b3022
NIFI-5995 Updated ScriptedLookupService documentation to warn about Jython and removed Jython from the list of supported script engines for it because it's broken now.
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #3287
2019-02-01 13:33:33 -05:00
Bryan Bende
79a3696e5e
NIFI-5961 Fixing bug where the name of a versioned process group gets incorrectly reset
...
This closes #3271 .
Signed-off-by: Mark Payne <markap14@hotmail.com>
2019-01-30 11:14:53 -05:00
a.durov
8e777203a0
NIFI-5974 fix: Fragment Attributes are populated in case no split has occured.
...
Unit test is implemented: testNoSplitterInString
NIFI-5974: Fixed Checkstyle violations
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #3275
2019-01-30 09:40:36 -05:00
Bryan Bende
2eac0e96c7
NIFI-5962 protecting against null Configuration in AbstractHadoopProcessor onStopped
...
This closes #3270 .
2019-01-28 13:13:48 -05:00
Matt Gilman
531c84ac31
NIFI-5972: Converting some warning log messages to debug as they could possibly be due to a valid scenario like NiFi users belonging to a group that is not relevant to NiFi.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3274 .
2019-01-25 15:00:12 +01:00
Bryan Bende
410c9a4ecd
NIFI-4915 Adding HBase 2.x service bundle
...
Thise closes #3254
Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2019-01-25 07:19:54 -05:00
Mark Payne
fd3d69bc90
NIFI-5949: Addressed problematic error handling logic in PutKudu. Also removed AbstractKudu and moved all logic into PutKudu, as the abstract class was clearly designed to be extended only by PutKudu and no other processors exist for Kudu
...
Added explicit .toString() call on rowError to avoid IllegalStateException during logging of row errors
This closes #3262 .
2019-01-24 19:47:03 -05:00
erichanson5
4ef2251d74
NIFI-3611: Added ability to set Transaction Isolation Level on Database connection for the QueryDatabaseTable processor
...
NIFI-3611: Make TRANS_ISOLATION_LEVEL property optional
This closes #3248 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2019-01-21 17:19:42 +09:00
Koji Kawamura
05de73d6a0
NIFI-5951 Fix error logging with rollback on failure
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #3264
2019-01-17 17:11:39 -05:00
Mark Payne
89adb039d2
NIFI-5944: If processor is no longer scheduled to run after a failed trigger of @OnScheduled, ensure that we set scheduled status to STOPPED
...
This closes #3263
2019-01-11 10:22:22 -05:00
Bryan Bende
2bbfb3217b
NIFI-5945 Add support for password login to kerberos code in nifi-security-utils
...
Fixing solr test
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #3256
2019-01-10 15:05:31 -05:00
SavtechSolutions
cf7ab0ce18
NIFI-5790 removed the last test as it's causing a race condition intermittently ( #3260 )
...
Signed-off-by: Peter Wicks <patricker@gmail.com>
2019-01-10 12:13:35 -07:00
Mark Payne
706cf7dcff
NIFI-5944: When components are started on NiFi startup, if they are invalid, don't fail immediately and give up. Instead, keep attempting to start the component when it becomes valid.
...
This closes #3259
2019-01-10 11:15:17 -05:00
Alex Savitsky
3e52ae952d
NIFI-5909 added optional settings for date, time, and timestamp formats used to write Records to Elasticsearch
...
NIFI-5909 added content checks to the unit tests
NIFI-5937 use explicit long value for test dates/times (to not depend on the timezone of test executor)
NIFI-5937 tabs to spaces
Fixing checkstyle violations introduced by https://github.com/apache/nifi/pull/3249 PR)
NIFI-5937 adjusted property descriptions for consistency; limited EL scope to variable registry; added an appropriate validator along with its Maven dependency; moved format initialization to @OnScheduled
NIFI-5909 tabs to spaces
Signed-off-by: Ed <edward.berezitsky@gmail.com>
This closes #3227
2019-01-09 21:55:09 -05:00
Alex Savitsky
1a443c73ec
NIFI-5937 use processor-configured encoding instead of the system default
...
NIFI-5937 added tests to verify that accented characters are preserved correctly
NIFI-5937 unfolding starred imports
NIFI-5937 unfolding starred imports (now with statics)
Signed-off-by: Ed <edward.berezitsky@gmail.com>
This closes #3250
2019-01-08 23:28:23 -05:00
kei miyauchi
e6e4175d71
NIFI-5841 Fix memory leak of PutHive3Streaming.
...
This closes #3249 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2019-01-09 12:06:27 +09:00
Matt Gilman
93efc2affc
NIFI-5935:
...
- Ensuring exceptions are handled in the ldap user/group sync background thread.
- Adding additional logging around what users/groups were discovered.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3247 .
2019-01-08 11:13:38 +01:00
Stephen Goodman
a8e59e52af
NIFI-5920: Tagging an object in S3
...
Unit tests and functionality for tagging an object in S3.
Set FlowFile attributes directly from tags retrieved from S3.
Add guard clauses to ensure evaluated properties are not blank.
This closes #3239 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2019-01-08 12:12:13 +09:00
Mark Payne
cf41c10546
NIFI-5879: Fixed bug in FileSystemRepository that can occur if an InputStream is obtained, then more data is written to the Content Claim - the InputStream would end before allowing the sequential data to be read. Also fixed bugs in LimitedInputStream related to available(), mark(), and reset() and the corresponding unit tests. Additionally, found that one call to StandardProcessSession.read() was not properly flushing the output of any Content Claim that has been written to before attempting to read it.
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #3207
2019-01-07 11:06:17 -05:00
Pierre Villard
432ba8787f
NIFI-5921 - Timeout property for ConsumeJMS
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3245 .
2019-01-04 12:28:13 +01:00
Ryan Whittington
cd91197a45
NIFI-5921 - Added property to allow a user to define a timeout on the ConsumeJMS processor
...
Co-Authored-By: rwhittington <ryan.whittington@gmail.com>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3240 .
2019-01-04 10:32:12 +01:00
Mike Thomsen
6fa5deafc2
NIFI-5908 Inject locale info into JsonInjector object to make sure we don't lose that information.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3226 .
2019-01-03 18:10:08 +01:00
Mark Payne
fea17d0ca8
NIFI-5919: Addressed a race condition that can exist if adding FlowFiles to a FlowFileQueue before adjusting the size of the queue to account for the FlowFiles
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3238 .
2019-01-03 11:35:23 +01:00
Koji Kawamura
595a2decc6
NIFI-5917 Fix TestSelectHiveQL.testNoTimeLimit
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #3237 .
2019-01-03 11:31:38 +01:00
Otto Fowler
1330b92cfa
NIFI-5892 Wait timestamp lingers, potentially messing up downstream wait-notify pairs
...
Clear the wait timestamp when transferring to failur or success
replace explicit attribute clear with function call, refactor and integrate into existing tests per review
This closes #3233 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-12-28 10:30:02 +09:00
SavtechSolutions
f9f386b0f0
NIFI-5871 ignore UUID attribute when copying flow file attributes ( #3203 )
...
NIFI-5871 ignore UUID attribute when copying flow file attributes
Signed-off-by: Peter Wicks <patricker@gmail.com>
2018-12-20 10:05:25 -07:00
Pierre Villard
f22a6c46ad
Merge pull request #3219 from zenfenan/NIFI-5893
...
NIFI-5893: AWS Endpoint Overriding now functions properly
2018-12-19 10:50:05 +01:00
Pierre Villard
590fa2063c
NIFI-4892 - ValidateCSV: no doublequote escaping in invalid output
...
NIFI-4892 - ValidateCSV: no doublequote escaping in invalid output
NIFI-5907 - unit test
This closes #2481 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-12-19 11:20:55 +09:00
Pierre Villard
e9cb915ca9
Merge pull request #3225 from ijokarumawak/nifi-5905
...
NIFI-5905 Secure S2S fails with NullPointerException
2018-12-18 10:21:29 +01:00
Pierre Villard
c52f880cc1
Merge pull request #3224 from mattyb149/NIFI-5904
...
NIFI-5904: Fix PutHive3Streaming handling of RecordReaderFactoryException
2018-12-18 09:50:25 +01:00
Matthew Burgess
7548d7c859
NIFI-3988: Add fragment attributes to SplitRecord
...
This closes #3217 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-12-18 15:07:43 +09:00
Koji Kawamura
4b70465ea5
NIFI-5905 Secure S2S fails with NullPointerException
...
The constructor arguments should be set to instance variables so that
subsequent code can refer "this.*".
2018-12-18 15:03:31 +09:00
Jeff Storck
cc47a8c0e1
NIFI-5748 Improved Proxy Header Support
...
- Fixed proxy header support to use X-Forwarded-Host instead of X-ForwardedServer
- Added support for the context path header used by Traefik when proxying a service (X-Forwarded-Prefix)
- Added tests to ApplicationResourceTest for X-Forwarded-Context and X-Forwarded-Prefix
- Updated administration doc to include X-Forwarded-Prefix
- Added NIFI_WEB_PROXY_CONTEXT_PATH env var to dockerhub and dockermaven start.sh scripts
- Added documentation for NIFI_WEB_PROXY_CONTEXT_PATH to dockerhub README.md
- Updated ApplicationResource to handle a port specified in X-ProxyPort and X-Forwarded-Port headers
This closes #3129 .
Signed-off-by: Kevin Doran <kdoran@apache.org>
2018-12-17 17:32:06 -05:00
Matthew Burgess
d34789881b
NIFI-5904: Fix PutHive3Streaming handling of RecordReaderFactoryException
2018-12-17 14:12:18 -05:00
zenfenan
10e29ee4d6
NIFI-5898: Updated the display name for ACCESS_KEY & SECRET_KEY
2018-12-16 17:05:52 +05:30
zenfenan
ee24a593e9
NIFI-5893: AWS Endpoint Overriding now functions properly
2018-12-15 19:37:31 +05:30
Koji Kawamura
0efddf47d5
NIFI-4579: Fix ValidateRecord type coercing
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2794
2018-12-13 16:10:41 -05:00