Bryan Bende
b855d0acae
NIFI-4884 Fixing ordering during import from registry so that we set schedule strategy on a processor before setting scheduling duration. This closes #2472
2018-02-16 09:27:36 -05:00
Mike Thomsen
143d7e6829
NIFI-3538 Added DeleteHBaseRow
...
This closes #2294 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-02-14 10:04:25 +09:00
Andy LoPresto
28067a29fd
NIFI-4869 Added SAX utility method for SplitXML processor.
...
Added unit tests.
Added test resources to RAT exclude list.
This closes #2466
2018-02-13 15:29:29 -05:00
Matthew Burgess
b5ca7adbb9
NIFI-978: Support parameterized statements in ExecuteSQL
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2433 .
2018-02-12 20:44:31 +01:00
Koji Kawamura
b4a9f52a4e
NIFI-4866: Fixed HBase performance issue
...
HBase_1_1_2_ClientService performance dropped due to accessing HBase
admin upon every FlowFile transfer. Fixed that by getting master address
only once when the service is enabled and a connection is established.
This closes #2464
2018-02-11 16:14:52 -05:00
Mark Payne
61c6f0305b
NIFI-4863: Bug fixes to the way that we handled Remote Group Ports when changing flow version / reverting local changes
...
- Everywhere that we ignore adding remote ports we should ignore removing remote ports as well in flow diffs
This closes #2462 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-02-09 15:45:54 -05:00
Bryan Bende
34b678d30d
NIFI-4841 Fixing NPE when reverting local changes involving remote group ports. This closes #2454 .
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-02-09 10:26:19 -05:00
Matthew Burgess
25e0bbb68d
NIFI-4853 - Fixed PutMongoRecord handling of nested records
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2457 .
2018-02-09 15:32:38 +01:00
Matthew Burgess
7d6bbce123
NIFI-4830: Fixed logic errors in BLOB/CLOB processing in JdbcCommon
...
This closes #2459 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-02-09 11:45:12 +09:00
Mark Payne
4428fe28bf
NIFI-4858: Expose Request Timeout from HTTP Context Map and use that to set as the timeout of the 'AsyncContext' in HandleHttpRequest. Otherwise, the request will never timeout (which is OK because the HttpContextMap will handle this). However, Jetty behind the scenes is adding a task to Scheduled Executor for each request with a delay of whatever the timeout is set to. Since it's currently set to Long.MAX_VALUE, that task will never be run and as a result the ExecutorService's queue will grow indefinitely, eventually exhausting the JVM Heap
...
This closes #2460 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-02-08 17:38:13 -05:00
Mike Moser
a2f2ddd6b8
NIFI-4699 Use a filter in PostHTTP to pull flowfiles from queue whose URL is the same
...
This closes #2412 .
2018-02-08 18:36:11 +00:00
Matthew Burgess
16e56ccfca
NIFI-4080: Restored customValidate in ValidateCSV for schema property with no EL
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2226 .
2018-02-08 11:56:56 +01:00
Marco Gaido
ba192d22da
enable EL on FF level
2018-02-08 11:56:49 +01:00
Matthew Burgess
836c324258
NIFI-4080: Added EL support to fields in ValidateCSV
2018-02-08 11:56:42 +01:00
Koji Kawamura
270892f926
NIFI-4846: AvroTypeUtil to support more input types for logical decimal conversion
...
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2451
2018-02-07 19:42:26 -05:00
Matt Gilman
f3013d0764
NIFI-4837:
...
- When Jetty initializes fails, performing a shutdown sequence to ensure all allocated resources are released.
This closes #2455 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-02-07 16:40:23 -05:00
Koji Kawamura
e9af6c6ad8
NIFI-4828: Fix MergeContent to process all ready bins
...
Before this fix, MergeContent only processed the first bin even if there
were multiple bins.
There were two unit tests marked with Ignore those had been
failing because of this.
This closes #2444 .
Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-02-07 15:45:39 -05:00
Mark Payne
d7da04209a
Fix for unit tests that are causing build failures in certain environments
2018-02-07 15:08:52 -05:00
Koji Kawamura
2b062e211f
NIFI-4844: Adjust BigDecimal scale to the target Avro schema
...
- Applied the same scale adjustment not only to BigDecimal inputs, but
also to Double values.
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2450
2018-02-07 10:38:45 -05:00
Koji Kawamura
dbbf78f22c
NIFI-4848: Update HttpComponents version
...
- httpclient 4.5.3 -> 4.5.5
- httpcore 4.4.4 -> 4.4.9
- ThreadSafe annotation is removed since 4.4.5, HTTPCLIENT-1743.
Removed the annotation from DebugFlow processor.
- httpasyncclient 4.1.2 -> 4.1.3
- This closes #2453
2018-02-07 08:55:43 -05:00
Koji Kawamura
f16cbd462b
NIFI-4818: Fix transit URL parsing at Hive2JDBC and KafkaTopic for ReportLineageToAtlas
...
- Hive2JDBC: Handle connection parameters and multiple host entries
correctly
- KafkaTopic: Handle multiple host entries correctly
- Avoid potential "IllegalStateException: Duplicate key" exception
when NiFiAtlasHook analyzes existing NiFiFlowPath input/output entries
- This closes #2435
2018-02-07 08:49:35 -05:00
Mark Payne
3ca7c3e7a1
NIFI-4834: Updated AbstractJMSProcessor to use a separate SingleConnectionFactory per concurrent task instead of sharing one across the entire processor.
...
This closes #2445 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-02-02 16:10:07 -05:00
Deon Huang
b5938062a8
NIFI-4395 GenerateTableFetch can't fetch column type by state after instance reboot
...
Add multiple states recover
Signed-off-by: Matthew Burgess <mattyb149@apache.org>
This closes #2442
2018-02-02 11:15:46 -05:00
zenfenan
9bc00b6b64
NIFI-4826 - Fixed azure.blobname in ListAzureBlobStorage
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2440 .
2018-02-02 15:59:54 +01:00
Matthew Burgess
4df3eb567d
NIFI-4410: Improved error handling/logging in PutElasticsearchHttp processors
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2175 .
2018-02-02 10:35:03 +01:00
Pierre Villard
dc67bd2fdd
NIFI-4747 - Removed directory existence check in GetHDFS
...
This closes #2391
Signed-off-by: Jeremy Dyer <jeremydyer@apache.org>
2018-01-31 12:01:17 -05:00
Mike Thomsen
6e7dfb9935
NIFI-4823 Made pretty printing configurable in GetMongo.
...
This closes #2441
Signed-off-by: Jeremy Dyer <jeremydyer@apache.org>
2018-01-31 11:34:31 -05:00
jlwt90
d8cfb8e6c5
NIFI-4686 MockFlowFile now includes penalized status when copying. This closes #2438 .
...
Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-01-29 11:02:19 -05:00
dorian.bugeja
8bdc2910e1
NIFI-4786 Allow Expression Evaluation to Kinesis/Firehose Stream Name
...
Signed-off-by: James Wing <jvwing@gmail.com>
This closes #2409 .
2018-01-27 16:01:09 -08:00
Kevin Doran
c4e2ac7cda
NIFI-4801 Fixes Swagger spec for uploadTemplate. This closes #2428
2018-01-25 10:02:56 -05:00
Marco Gaido
37271e8241
NIFI-4790 - support HTTPS Proxy in InvokeHTTP
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2426 .
2018-01-24 17:51:28 +01:00
Matthew Burgess
84848f7cbb
NIFI-4773: Moved DB Fetch processors' connection code from setup to onTrigger
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2422 .
2018-01-23 15:10:34 +01:00
Mark Payne
6f282c6843
NIFI-4803: Ensure that we set the FileCountAttribute of BinManager to the proper value, regardless of the merge strategy
...
This closes #2423 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-01-22 15:37:31 -05:00
Peter G. Horvath
3ebfcd5ae5
NIFI-4424 Added functionality to allow NiFi to run in "embedded" mode for eventual integration test access.
...
This closes #2251 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-01-22 12:00:33 -08:00
Matt Gilman
05e9e6eaa5
NIFI-4799:
...
- Ensure variable registry update request is marked completed.
This closes #2421 .
Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-01-22 12:53:23 -05:00
Kevin Doran
5d5edfa896
NIFI-4744 Detect incorrect authorizers config
...
Adds stricter checks in AuthorizerFactoryBean for unique ids within
a given type of provider and requires unique providers in composite
and composite-configurable user group providers. Failed validation
checks cause startup to fail. Adds test cases for these new rules.
This closes #2419 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-01-22 09:45:17 -05:00
sbouchex
94d0974003
NIFI-4795:
...
Fixed allowed values
This closes #2414
2018-01-19 12:58:36 -05:00
Matt Gilman
e3c661daac
NIFI-4761 Fixing test case regression.
...
This closes #2418 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-01-19 09:47:31 -08:00
Pierre Villard
a3ddb3b4fa
NIFI-1604 - PutSolrContentStream - Evaluate stream path against flow file
...
This closes #2092 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-01-19 11:26:05 -05:00
Andy LoPresto
8cb09c301d
NIFI-4761
...
Added HostHeaderHandler regression unit tests before adding new functionality.
Added logic for parsing nifi.web.proxy.host property.
Added default property in nifi.properties and pom.xml.
Added logic for IPv6 and custom default hostnames.
Improved error messaging.
Added HostHeaderHandler unit tests.
Disabled HostHeaderSanitizationCustomizer in HTTP mode.
Fixed HTML escaping in error message.
Improved error message.
Added failing unit test for parsing custom hostnames.
Fixed custom hostname parsing.
Fixed unit tests.
Added TODO for IPv6 custom hostname parsing and unit test.
Added IPv6 custom hostname parsing and unit tests.
Fixed checkstyle issues.
Removed empty element in host list when no value defined.
Improved error message formatting.
Added unit tests.
Removed HostHeaderSanitizationCustomizer.
Removed InvalidPropertiesFormatException from NiFiProperties.
Removed InvalidPropertiesFormatException from HostHeaderHandler.
This closes #2415
2018-01-19 10:53:13 -05:00
zenfenaan
94eb11bfa6
NIFI-4770 - ListAzureBlobStorage now properly writes azure.container flowfile attribute
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2402 .
2018-01-18 16:16:00 +01:00
Mike Thomsen
ca54186b60
NIFI-4759 - Fixed a bug that left a hard-coded reference to _id in as the update key for MongoDB upserts.
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2401 .
2018-01-17 21:48:31 +01:00
Joey Frazee
ea2519e3ea
NIFI-4748 - Add endpoint override to Kinesis processors
...
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
This closes #2399 .
2018-01-17 21:42:19 +01:00
sbouchex
e4dda497bb
NIFI-4784: Fixed runStatus allowedValues. This closes #2407
2018-01-17 10:59:09 -05:00
Senthilannaswamy
790f14b8ef
NIFI-4781: Updated ClientAuthenticationMethod as optional field response from OpenID provider. This closes #2213
2018-01-17 10:55:11 -05:00
Mark Payne
7c1ce17223
NIFI-4756: Updated PublishKafkaRecord processors to include attributes generated from schema write strategy into the message headers when appropriate
...
This closes #2396 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-01-16 16:31:34 -05:00
Mark Payne
28e1bcc9d0
NIFI-4782: Allow the value of a Required Property to be moved when changing version of a flow or reverting a flow
...
This closes #2406 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2018-01-16 14:14:25 -05:00
Matthew Burgess
7e29103995
NIFI-4428: This closes #2310 . Updated POM versions to current master branch
...
Signed-off-by: joewitt <joewitt@apache.org>
2018-01-16 13:27:29 -05:00
Matthew Burgess
ecb8067883
NIFI-4428: Replaced JSON input with RecordReader
...
using per-record flowfiles
NIFI-4428: Added initial L&N, fixed dependency hierarchy
NIFI-4428: Exposed additional ZK properties
NIFI-4428: More work to reduce dependencies in Druid artifacts
NIFI-4428: Removed inaccessible attribute
NIFI-4428: Fixed typo in property description
NIFI-4428: Updates to Druid NAR L&N
NIFI-4428: Updated LICENSE to refer to ICU License for icu4j
2018-01-16 13:08:02 -05:00
vvaks
7fa0a34aba
NIFI-4428: - Implement PutDruid Processor and Controller
...
update
added provenance report
added parameters for batch control
WIP
2018-01-16 13:07:56 -05:00