Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
4,166 Commits 143 Branches 197 Tags 390 MiB
Commit Graph

4166 Commits

Author SHA1 Message Date
Matthew Burgess 25e0bbb68d NIFI-4853 - Fixed PutMongoRecord handling of nested records 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2457.
 2018-02-09 15:32:38 +01:00
Matthew Burgess 7d6bbce123 NIFI-4830: Fixed logic errors in BLOB/CLOB processing in JdbcCommon 
This closes #2459.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-02-09 11:45:12 +09:00
Mark Payne 4428fe28bf
NIFI-4858: Expose Request Timeout from HTTP Context Map and use that to set as the timeout of the 'AsyncContext' in HandleHttpRequest. Otherwise, the request will never timeout (which is OK because the HttpContextMap will handle this). However, Jetty behind the scenes is adding a task to Scheduled Executor for each request with a delay of whatever the timeout is set to. Since it's currently set to Long.MAX_VALUE, that task will never be run and as a result the ExecutorService's queue will grow indefinitely, eventually exhausting the JVM Heap 
This closes #2460.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-02-08 17:38:13 -05:00
Mike Moser a2f2ddd6b8 NIFI-4699 Use a filter in PostHTTP to pull flowfiles from queue whose URL is the same 
This closes #2412.
 2018-02-08 18:36:11 +00:00
Matthew Burgess 16e56ccfca NIFI-4080: Restored customValidate in ValidateCSV for schema property with no EL 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2226.
 2018-02-08 11:56:56 +01:00
Marco Gaido ba192d22da enable EL on FF level 2018-02-08 11:56:49 +01:00
Matthew Burgess 836c324258 NIFI-4080: Added EL support to fields in ValidateCSV 2018-02-08 11:56:42 +01:00
Koji Kawamura 270892f926 NIFI-4846: AvroTypeUtil to support more input types for logical decimal conversion 
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2451
 2018-02-07 19:42:26 -05:00
Matt Gilman f3013d0764
NIFI-4837: 
- When Jetty initializes fails, performing a shutdown sequence to ensure all allocated resources are released.

This closes #2455.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-02-07 16:40:23 -05:00
Koji Kawamura e9af6c6ad8 NIFI-4828: Fix MergeContent to process all ready bins 
Before this fix, MergeContent only processed the first bin even if there
were multiple bins.

There were two unit tests marked with Ignore those had been
failing because of this.

This closes #2444.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-02-07 15:45:39 -05:00
Mark Payne d7da04209a Fix for unit tests that are causing build failures in certain environments 2018-02-07 15:08:52 -05:00
Koji Kawamura 2b062e211f NIFI-4844: Adjust BigDecimal scale to the target Avro schema 
- Applied the same scale adjustment not only to BigDecimal inputs, but
also to Double values.

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2450
 2018-02-07 10:38:45 -05:00
Koji Kawamura dbbf78f22c
NIFI-4848: Update HttpComponents version 
- httpclient 4.5.3 -> 4.5.5
- httpcore 4.4.4 -> 4.4.9
  - ThreadSafe annotation is removed since 4.4.5, HTTPCLIENT-1743.
    Removed the annotation from DebugFlow processor.
- httpasyncclient 4.1.2 -> 4.1.3
- This closes #2453
 2018-02-07 08:55:43 -05:00
Koji Kawamura f16cbd462b
NIFI-4818: Fix transit URL parsing at Hive2JDBC and KafkaTopic for ReportLineageToAtlas 
- Hive2JDBC: Handle connection parameters and multiple host entries
correctly
- KafkaTopic: Handle multiple host entries correctly
- Avoid potential "IllegalStateException: Duplicate key" exception
when NiFiAtlasHook analyzes existing NiFiFlowPath input/output entries
- This closes #2435
 2018-02-07 08:49:35 -05:00
Mark Payne 3ca7c3e7a1
NIFI-4834: Updated AbstractJMSProcessor to use a separate SingleConnectionFactory per concurrent task instead of sharing one across the entire processor. 
This closes #2445.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-02-02 16:10:07 -05:00
Deon Huang b5938062a8 NIFI-4395 GenerateTableFetch can't fetch column type by state after instance reboot 
Add multiple states recover

Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2442
 2018-02-02 11:15:46 -05:00
zenfenan 9bc00b6b64 NIFI-4826 - Fixed azure.blobname in ListAzureBlobStorage 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2440.
 2018-02-02 15:59:54 +01:00
Matthew Burgess 4df3eb567d NIFI-4410: Improved error handling/logging in PutElasticsearchHttp processors 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2175.
 2018-02-02 10:35:03 +01:00
dchaffey e74c67f779 Corrected Docker tag back to standard format 
Modified Docker startup scripts to accept Environment variables if available, or use the usual defaults if not.
Updated readme to reflect changes in allowing environment variables.
Updated readme to correctly reflect the default ports that NiFi will run on.

This closes #2439

Signed-off-by: Jeremy Dyer <jeremydyer@apache.org>
 2018-01-31 15:50:42 -05:00
Pierre Villard dc67bd2fdd NIFI-4747 - Removed directory existence check in GetHDFS 
This closes #2391

Signed-off-by: Jeremy Dyer <jeremydyer@apache.org>
 2018-01-31 12:01:17 -05:00
Mike Thomsen 6e7dfb9935 NIFI-4823 Made pretty printing configurable in GetMongo. 
This closes #2441

Signed-off-by: Jeremy Dyer <jeremydyer@apache.org>
 2018-01-31 11:34:31 -05:00
jlwt90 d8cfb8e6c5 NIFI-4686 MockFlowFile now includes penalized status when copying. This closes #2438. 
Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-01-29 11:02:19 -05:00
dorian.bugeja 8bdc2910e1 NIFI-4786 Allow Expression Evaluation to Kinesis/Firehose Stream Name 
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #2409.
 2018-01-27 16:01:09 -08:00
Kevin Doran c4e2ac7cda
NIFI-4801 Fixes Swagger spec for uploadTemplate. This closes #2428 2018-01-25 10:02:56 -05:00
Marco Gaido 37271e8241 NIFI-4790 - support HTTPS Proxy in InvokeHTTP 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2426.
 2018-01-24 17:51:28 +01:00
Matthew Burgess 84848f7cbb NIFI-4773: Moved DB Fetch processors' connection code from setup to onTrigger 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2422.
 2018-01-23 15:10:34 +01:00
Mark Payne 6f282c6843
NIFI-4803: Ensure that we set the FileCountAttribute of BinManager to the proper value, regardless of the merge strategy 
This closes #2423.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-01-22 15:37:31 -05:00
Peter G. Horvath 3ebfcd5ae5
NIFI-4424 Added functionality to allow NiFi to run in "embedded" mode for eventual integration test access. 
This closes #2251.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-01-22 12:00:33 -08:00
Matt Gilman 05e9e6eaa5 NIFI-4799: 
- Ensure variable registry update request is marked completed.
This closes #2421.

Signed-off-by: Mark Payne <markap14@hotmail.com>
 2018-01-22 12:53:23 -05:00
Kevin Doran 5d5edfa896
NIFI-4744 Detect incorrect authorizers config 
Adds stricter checks in AuthorizerFactoryBean for unique ids within
a given type of provider and requires unique providers in composite
and composite-configurable user group providers. Failed validation
checks cause startup to fail. Adds test cases for these new rules.

This closes #2419.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-01-22 09:45:17 -05:00
Andrew Lim 59970344fe NIFI-4791 Made external links open in new windows and fixed some broken links 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2413.
 2018-01-20 15:15:48 +01:00
sbouchex 94d0974003
NIFI-4795: 
Fixed allowed values
This closes #2414
 2018-01-19 12:58:36 -05:00
Matt Gilman e3c661daac
NIFI-4761 Fixing test case regression. 
This closes #2418.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2018-01-19 09:47:31 -08:00
Pierre Villard a3ddb3b4fa
NIFI-1604 - PutSolrContentStream - Evaluate stream path against flow file 
This closes #2092.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-01-19 11:26:05 -05:00
Matt Gilman 4b3b2ebf24
NIFI-4766: 
- Documenting nifi.web.proxy.host property.
- Updating proxy confiugration.
NIFI-4618:
- Documenting nifi.web.proxy.context.path property.
- Addressing PR feedback.
- This closes #2410
 2018-01-19 11:03:55 -05:00
Andy LoPresto 8cb09c301d
NIFI-4761 
Added HostHeaderHandler regression unit tests before adding new functionality.
Added logic for parsing nifi.web.proxy.host property.
Added default property in nifi.properties and pom.xml.
Added logic for IPv6 and custom default hostnames.
Improved error messaging.
Added HostHeaderHandler unit tests.
Disabled HostHeaderSanitizationCustomizer in HTTP mode.
Fixed HTML escaping in error message.
Improved error message.
Added failing unit test for parsing custom hostnames.
Fixed custom hostname parsing.
Fixed unit tests.
Added TODO for IPv6 custom hostname parsing and unit test.
Added IPv6 custom hostname parsing and unit tests.
Fixed checkstyle issues.
Removed empty element in host list when no value defined.
Improved error message formatting.
Added unit tests.
Removed HostHeaderSanitizationCustomizer.
Removed InvalidPropertiesFormatException from NiFiProperties.
Removed InvalidPropertiesFormatException from HostHeaderHandler.
This closes #2415
 2018-01-19 10:53:13 -05:00
zenfenaan 94eb11bfa6 NIFI-4770 - ListAzureBlobStorage now properly writes azure.container flowfile attribute 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2402.
 2018-01-18 16:16:00 +01:00
Mike Thomsen ca54186b60 NIFI-4759 - Fixed a bug that left a hard-coded reference to _id in as the update key for MongoDB upserts. 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2401.
 2018-01-17 21:48:31 +01:00
Joey Frazee ea2519e3ea NIFI-4748 - Add endpoint override to Kinesis processors 
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2399.
 2018-01-17 21:42:19 +01:00
sbouchex e4dda497bb
NIFI-4784: Fixed runStatus allowedValues. This closes #2407 2018-01-17 10:59:09 -05:00
Senthilannaswamy 790f14b8ef
NIFI-4781: Updated ClientAuthenticationMethod as optional field response from OpenID provider. This closes #2213 2018-01-17 10:55:11 -05:00
Mark Payne 7c1ce17223
NIFI-4756: Updated PublishKafkaRecord processors to include attributes generated from schema write strategy into the message headers when appropriate 
This closes #2396.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-01-16 16:31:34 -05:00
Mark Payne 28e1bcc9d0
NIFI-4782: Allow the value of a Required Property to be moved when changing version of a flow or reverting a flow 
This closes #2406.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-01-16 14:14:25 -05:00
Matthew Burgess 7e29103995 NIFI-4428: This closes #2310. Updated POM versions to current master branch 
Signed-off-by: joewitt <joewitt@apache.org>
 2018-01-16 13:27:29 -05:00
Matthew Burgess ecb8067883 NIFI-4428: Replaced JSON input with RecordReader 
using per-record flowfiles
NIFI-4428: Added initial L&N, fixed dependency hierarchy

NIFI-4428: Exposed additional ZK properties

NIFI-4428: More work to reduce dependencies in Druid artifacts

NIFI-4428: Removed inaccessible attribute

NIFI-4428: Fixed typo in property description

NIFI-4428: Updates to Druid NAR L&N

NIFI-4428: Updated LICENSE to refer to ICU License for icu4j
 2018-01-16 13:08:02 -05:00
vvaks 7fa0a34aba NIFI-4428: - Implement PutDruid Processor and Controller 
update

added provenance report

added parameters for batch control

WIP
 2018-01-16 13:07:56 -05:00
Mark Payne d93d538177
NIFI-4763: Ignore differences in components' Bundle Version when comparing a local flow to a flow in the registry 
This closes #2393.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2018-01-16 12:48:17 -05:00
Koji Kawamura 83701632fb NIFI-4769: Use FlowFile for EL at Fetch and PutAzureBlobStorage 
This commit add back the existing capability for those Processors to use
incoming FlowFile attributes to compute account name and account key,
which had been removed by NIFI-4004.

Also, the same capability is added for SAS token.

This closes #2400.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-01-13 09:57:25 +09:00
Matthew Burgess 83d2930095 NIFI-4768: Add exclusion filters to S2SProvenanceReportingTask 
NIFI-4768: Updated exclusion logic per review comments

This closes #2397.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
 2018-01-13 09:47:21 +09:00
joewitt 5e3867011e NIFI-4751 updated docker version 2018-01-12 15:19:15 -05:00