Commit Graph

129 Commits

Author SHA1 Message Date
Wietze d59a07245f NIFI-5500 Adding support for array fields when outputting to attributes when using QueryElasticsearchHttp
NIFI-5500 Optimised array-to-string conversion

This closes #2942

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2019-02-19 12:41:57 -05:00
joewitt 0e204f3576
NIFI-6029-RC2 prepare for next development iteration 2019-02-16 21:50:35 -05:00
joewitt 45bb53d2aa
NIFI-6029-RC2 prepare release nifi-1.9.0-RC2 2019-02-16 21:50:15 -05:00
Alex Savitsky 3e52ae952d NIFI-5909 added optional settings for date, time, and timestamp formats used to write Records to Elasticsearch
NIFI-5909 added content checks to the unit tests

NIFI-5937 use explicit long value for test dates/times (to not depend on the timezone of test executor)

NIFI-5937 tabs to spaces

Fixing checkstyle violations introduced by https://github.com/apache/nifi/pull/3249 PR)

NIFI-5937 adjusted property descriptions for consistency; limited EL scope to variable registry; added an appropriate validator along with its Maven dependency; moved format initialization to @OnScheduled

NIFI-5909 tabs to spaces

Signed-off-by: Ed <edward.berezitsky@gmail.com>

This closes #3227
2019-01-09 21:55:09 -05:00
Alex Savitsky 1a443c73ec NIFI-5937 use processor-configured encoding instead of the system default
NIFI-5937 added tests to verify that accented characters are preserved correctly

NIFI-5937 unfolding starred imports

NIFI-5937 unfolding starred imports (now with statics)

Signed-off-by: Ed <edward.berezitsky@gmail.com>

This closes #3250
2019-01-08 23:28:23 -05:00
Joe Percivall db966cf348 NIFI-5765 Fixing WriteJsonResult to use chosenDataType when writing an Array value
Fixing the same bug in PutElasticsearchHttpRecord.java

This closes #3114.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-10-30 11:51:17 +09:00
Jeff Storck c0182294ed NIFI-5720-RC3 prepare for next development iteration 2018-10-22 22:16:43 -04:00
Jeff Storck 98aabf2c50 NIFI-5720-RC3 prepare release nifi-1.8.0-RC3 2018-10-22 22:16:23 -04:00
joewitt 8e233ca2ef
NIFI-4806 updated tika and a ton of other deps as found by dependency versions plugin
This closes #3028
2018-10-04 09:32:04 -04:00
Joe Gresock 66783c18b2 NIFI-5427: Updating ScrollElasticsearchHttp to use POST, supporting ES6
This closes #2890

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-07-18 13:50:53 -04:00
Matthew Burgess ee86af0c15 NIFI-5356: Added record.count and failure.count attributes to PutElasticsearchHttpRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2835.
2018-07-03 10:23:34 +02:00
Andy LoPresto d42a1e8bf4
NIFI-5323-RC1 prepare for next development iteration 2018-06-19 20:02:21 -07:00
Andy LoPresto 99bcd1f88d
NIFI-5323-RC1 prepare release nifi-1.7.0-RC1 2018-06-19 20:02:01 -07:00
Matthew Burgess aa33989192
NIFI-5266: Sanitize ES parameters in PutElasticsearchHttp processors
Incorporated review comments
Added integration test with JSON character

This closes #2760.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2018-06-18 17:59:28 -07:00
zenfenan cf3c666683 NIFI-5286: Updated FasterXML Jackson libraries to 2.9.5
This closes #2775

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-06-09 14:19:45 -04:00
Koji Kawamura 2834fa4ce4 NIFI-4199: Added ProxyConfigurationService
- Added ProxyConfigurationService to manage centralized proxy
configurations
- Adopt ProxyConfigurationService at FTP and HTTP processors

NIFI-4175 - Add HTTP proxy support to *SFTP processors

This closes #2018.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>

NIFI-4199: Add ProxyConfigurationService to SFTP processors

- Fixed check style issue
- Use the same proxy related PropertyDescriptors from FTPTransfer and
SFTPTransfer
- Dropped FlowFile EL evaluation support to make it align with other
processors spec, Now it supports VARIABLE_REGISTRY
- Added ProxyConfigurationService to SFTP processors
- Added SOCKS proxy support to SFTP processors

NIFI-4199: Added ProxyConfigurationService to ElasticsearchHttp processors

- ElasticsearchHttp processors now support SOCKS proxy, too
- Added proxy support to PutElasticsearchHttpRecord
- Moved more common property descriptors to
AbstractElasticsearchHttpProcessor and just return static unmodifiable
property descriptor list at each implementation processors

NIFI-4196 - Expose AWS proxy authentication settings

NIFI-4196 - Fix jUnit errors

This closes #2016.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>

NIFI-4199: Add ProxyConfigService to AWS processors

- Applied ProxyConfigService to S3 processors
- Added proxy support to following processors:
  - PutKinesisFirehose, PutKinesisStream
  - PutDynamoDB, DeleteDynamoDB, GetDynamoDB
  - PutKinesisStream
- All AWS processors support HTTP proxy now

NIFI-4199: Add ProxyConfigService to Azure processors

NIFI-4199: More explicit validation and docs for Proxy spec

- Each processor has different supporting Proxy specs
- Show supported spec to ProxyConfigurationService property doc
- Validate not only Proxy type, but also with Authentication

NIFI-4199: Incorporated review comments

- Fixed TestListS3 property descriptor check
- Separate name and displayName

This closes #2016
This closes #2018
This closes #2704

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-05-20 17:57:47 -04:00
Koji Kawamura de1ad3eb6f NIFI-4198: ElasticsearchHttp processors Proxy settings
- Added Expression Language support with variable registry at proxy user
and password
2018-05-16 14:02:28 +09:00
Arun Manivannan 01a01a3dfc NIFI-4198 *ElasticsearchHttp processors do not expose Proxy settings
This closes #2094.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2018-05-16 14:01:19 +09:00
Otto Fowler 45bc1f1b4f NIFI-3576 Support for QueryInfo relationship, can be used to track no-hits
Squashed commit includes related commit from GitHub user wietze.

This closes #2601

Signed-off-by: Mike Thomsen <mikerthomsen@gmail.com>
2018-04-23 15:38:27 -04:00
joewitt 59f625d3c2 Merge branch 'NIFI-4995-RC3' as part of NiFi 1.6.0 release process 2018-04-06 16:48:08 -07:00
Pierre Villard 4c787799ff NIFI-4149 - Indicate if EL is evaluated against FFs or not
- take into account input requirement for documentation rendering
- Renamed variable registry scope and added comments
- Doc + change in mock framework to check scope + update of components + UI
2018-04-06 12:40:54 -04:00
joewitt d511fe3e4b NIFI-4995-RC3 prepare for next development iteration 2018-04-03 08:28:34 -07:00
joewitt f8466cb16d NIFI-4995-RC3 prepare release nifi-1.6.0-RC3 2018-04-03 08:28:15 -07:00
Mike Thomsen 6b34d3bea9 NIFI-4743 - Added configurable null suppression to PutElasticsearchHttpRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2501.
2018-03-26 20:41:21 +02:00
Derek Straka 5bdb7cf6e7 NIFI-4912: This closes #2494. Update jackson version to latest stable version (2.9.4)
Signed-off-by: joewitt <joewitt@apache.org>
2018-03-19 10:22:50 -04:00
joewitt c71409fb5d
NIFI-4936 trying to quiet down the mvn output a bit so we dont exceed the travis-ci 4MB max
NIFI-4936 updated dependency handling pushing down delcarations where they belong
This closes #2512
2018-03-09 16:34:53 -05:00
Jeff Storck e916594b69 NIFI-4872 Added annotation for specifying scenarios in which components can cause high usage of system resources.
- Initial set of components marked with the HighResourceUsageScenario annotation.
- Added customized descriptions to SystemResourceConsideration annotations for MergeContent, SplitContent, SplitJson, SplitText, and SplitXml.

This closes #2475.

Signed-off-by: Mark Payne <markap14@hotmail.com>
2018-03-05 15:32:23 -05:00
Matthew Burgess 4df3eb567d NIFI-4410: Improved error handling/logging in PutElasticsearchHttp processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2175.
2018-02-02 10:35:03 +01:00
joewitt 41ce788812 NIFI-4751 changed to next minor release version snapshot 2018-01-12 15:15:32 -05:00
joewitt 36405e888c NIFI-4751-RC1 prepare for next development iteration 2018-01-08 23:39:49 -07:00
joewitt 46d30c7e92 NIFI-4751-RC1 prepare release nifi-1.5.0-RC1 2018-01-08 23:39:32 -07:00
William Griffiths 9736cb9d33 NIFI-4663 This closes #2317. Change log for document not found from warn to debug as we have a NOT_FOUND relationship
Signed-off-by: joewitt <joewitt@apache.org>
2017-12-05 12:44:54 -05:00
joewitt 2c68d0e098
NIFI-4652 updating to latest apache version and updating key maven plugins, fixing versions for grpc to avoid extranous build dir, correcting checkstyle issues, resolving build problem with incorrect usage of activeByDefault in maven. Key change is now for the 'dir-only' profile it is now activated via a system property -Ddir-only instead of profile. No other activeByDefault profiles exist except to minifi the javascript but that usage is acceptible as-is. This closes #2313 2017-12-04 09:59:23 -05:00
Matt Gilman 6baea8ccff
NIFI-4444:
- Upgrading to Jersey 2.x.
- Updating NOTICE files where necessary.
- Fixing checkstyle issues.

This closes #2206.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-10-12 10:27:02 -07:00
Andy LoPresto d4168f5ff1
NIFI-4297
- Upgraded immediately actionable dependency versions from Meterian report.
- Upgraded jackson-core test dependencies for HBase and Elasticsearch modules.
- Only 3 instances of jackson-core < 2.8.6 (Google Cloud Platform and Spark Receiver modules).
- Upgraded version of poi dependency in nifi-email-processors to 3.16.
- Resolving dependency issues after rebasing against 1.5.0-SNAPSHOT.
- Removed jackson-databind from <dependencyManagement> block in nifi/pom.xml and added explicit reference to ${jackson.version} in all referenced artifacts.
- Removed jackson-mapper-asl from <dependencyManagement> block in nifi/pom.xml and added explicit reference to ${jackson.old.version} in all referenced artifacts.
- Removed Jasypt from <dependencyManagement> and added explicit version in test dependency for legacy compatibility.
- This closes #2084
2017-10-05 15:23:52 -04:00
Jeff Storck a57911d3db NIFI-4412-RC2 prepare for next development iteration 2017-09-28 13:45:36 -04:00
Jeff Storck e6508ba7d3 NIFI-4412-RC2 prepare release nifi-1.4.0-RC2 2017-09-28 13:45:21 -04:00
Matt Burgess 6b5015e39b
NIFI-4218: Dynamic properties as query parameters in ESHttp processors
This closes #2049.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-08-17 14:29:05 -04:00
Matt Gilman cc741d2be6
NIFI-3997:
- Bumping to next minor version.
2017-06-08 15:22:51 -04:00
Matt Gilman 6ee12e9b47
NIFI-3997-RC1prepare for next development iteration 2017-06-05 11:07:43 -04:00
Matt Gilman ddb73612bd
NIFI-3997-RC1prepare release nifi-1.3.0-RC1 2017-06-05 11:07:28 -04:00
Matt Burgess 0bddcfe730
NIFI-4002: Add PutElasticsearchHttpRecord processor
This closes #1878

Signed-off-by: Bryan Rosander <brosander@apache.org>
2017-06-02 13:01:13 -04:00
Bryan Bende 3af53419af
NIFI-3770-RC2 prepare for next development iteration 2017-05-05 20:50:28 -04:00
Bryan Bende 3a605af8e0
NIFI-3770-RC2 prepare release nifi-1.2.0-RC2 2017-05-05 20:50:14 -04:00
Pierre Villard 1e43694145 NIFI-3057 Added provenance events to PutElasticsearch and FetchElasticsearch
This closes: #1370.

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2017-02-15 01:37:14 +11:00
Pierre Villard 4e4d14f86f NIFI-3139 Added host:port list and non empty EL validators in StandardValidators 2017-02-10 11:22:43 -05:00
Matt Burgess 3b91635398 NIFI-3194: Fixed error handling in PutElasticsearchHttp
Thise closes #1327

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-12-19 14:51:41 -05:00
Matt Burgess 316cae16d3 NIFI-3140: Restored optional type handling in FetchElasticsearchHttp
This closes #1288

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-12-02 14:10:52 -05:00
Matt Burgess 69b23adf1b NIFI-3095: Add EL support to Elasticsearch 2.x (and HTTP) processors
This closes #1276

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-12-02 11:16:23 -05:00
joewitt 92f17a995b NIFI-3100-rc2 prepare for next development iteration 2016-11-25 23:49:27 -05:00
joewitt 5536f690a8 NIFI-3100-rc2 prepare release nifi-1.1.0-RC2 2016-11-25 23:49:13 -05:00
Matt Burgess 7fc7494b21 NIFI-3087: This closes #1263. Added unit tests to PutElasticsearch(Http) to illustrate issue 2016-11-23 08:22:34 -05:00
Matt Burgess d3dbac50a8 NIFI-3087: Fixed issue with partial failure responses in PutElasticsearch(Http) 2016-11-23 08:11:49 -05:00
Matt Burgess fa5fed9bb5 NIFI-3082: Fixed status code handling in PutElasticsearchHttp
This closes #1258.
2016-11-22 21:32:03 +01:00
joewitt fb9cbccc38 NIFI-2954 This closes #1244. Moved StandardPropertyValidator to nifi-utils, documented scope/purpose of a few util libs, removed deps from nifi-utils. 2016-11-21 16:30:42 -05:00
Matt Burgess dba9d5924a NIFI-3011: Added Elasticsearch5 processors
This closes #1233

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-21 15:58:40 -05:00
Matt Burgess 9e44734042 NIFI-2980: Fixed doc for Elasticsearch URL property in ElasticsearchHttp processors
This closes #1173
2016-11-02 16:18:30 -04:00
Andre F de Miranda 446cd44702 NIFI-2816 - Clean typos across the code
This closes #1057.
2016-09-26 17:47:31 +02:00
Joe Gresock 937dc71aec NIFI-2417: Addressing code review comments
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2016-09-22 15:00:06 -04:00
Joe Gresock 00412f6e97 NIFI-2417: Adding Query and Scroll processors for Elasticsearch
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2016-09-22 15:00:06 -04:00
Joseph Percivall 1fe18a1567 NIFI-2676-rc1 prepare for next development iteration 2016-08-26 11:40:58 -04:00
Joseph Percivall 74d5224783 NIFI-2676-rc1 prepare release nifi-1.0.0-RC1 2016-08-26 11:40:44 -04:00
joewitt 05a99a93cb NIFI-2208 This closes #754. refactored as per comments on JIRA. Reduced API expsosure and tightened lifecycle management. 2016-08-01 14:17:26 -04:00
Yolanda M. Davis 8412d2662a NIFI-2208 - initial commit Custom Property Expression Language support with Variable Registry, includes bug fix for NIFI-2057
This closes #529

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-29 17:10:20 -04:00
Matt Burgess 181386b943 NIFI-2068: Add Elasticsearch HTTP processors
This closes #576

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-07-06 13:12:29 -04:00
João Henrique Ferreira de Freitas e27c2556db NIFI-1594: Add support to expression language to define index operation
The index operation should be one of "index", "update", " upsert ".

This lets the operation could be defined by incoming flowfile.

Signed-off-by: João Henrique Ferreira de Freitas <joaohf@gmail.com>
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #255
2016-06-17 11:22:47 -04:00
Pierre Villard 372ffb8aa0 NIFI-1811 Removed ProcessorLog and updated dependent interfaces
This closes #403.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-05-19 13:08:09 -04:00
Matt Gilman 2de7f3f884 Updating versions to 1.0.0-SNAPSHOT. 2016-04-04 11:36:20 -04:00
Aldrin Piri e977729b56 NIFI-1634-rc2 prepare for next development iteration 2016-03-23 18:56:34 -04:00
Aldrin Piri 0b9bd20d31 NIFI-1634-rc2 prepare release nifi-0.6.0-RC2 2016-03-23 18:56:22 -04:00
Matt Burgess bbbc77707f NIFI-1666: Fixed bug with EL evaluation in PutElasticsearch processor 2016-03-22 15:10:27 -04:00
Matt Burgess e1cf37fb89 NIFI-1619: Fix Elasticsearch processor bug when flow file missing ID attribute
This closes #269

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-03-11 12:01:28 -05:00
Tony Kurc ad73b5c9d9 NIFI-1379-RC3 prepare for next development iteration 2016-02-12 17:28:10 -05:00
Tony Kurc 8309dba80b NIFI-1379-RC3 prepare release nifi-0.5.0-RC3 2016-02-12 17:27:59 -05:00
Tony Kurc 303f8eabf1 NIFI-1379: Move to 0.5.0-SNAPSHOT, add tkurc code signing key to keys 2016-02-06 08:49:48 -05:00
Matt Burgess 75af3a2ebe NIFI-1275: Added FetchElasticsearch processor and support for secure clusters
This closes #180.

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-02-02 18:21:31 -05:00
scarpacci 0c137bc22d Added path home property and unit test to elasticsearch processor in support of the node client 2016-02-02 17:26:40 -05:00
Matt Burgess 943d0a6e53 Adding to PutElasticsearch - validators, unit tests, etc. 2016-02-02 17:26:40 -05:00
scarpacci e6cfcf40d0 Initial commit for the elasticsearch bundle to Nifi 2016-02-02 17:26:39 -05:00