Commit Graph

2284 Commits

Author SHA1 Message Date
Yolanda M. Davis 0eda71a9a6 NIFI-4310 - added changes to support detection of reporting tasks and controller services during isEmpty flow check. Added testing scenarios. This closes #2107. 2017-08-25 10:15:55 -04:00
yuri1969 6c426f7a12 NIFI-2715 - Match style to 'detail-value'
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #2100
2017-08-24 18:39:12 -04:00
yuri1969 a9ee2aa5e4 NIFI-2715 - Keep 'Content Claim' header visible 2017-08-24 18:38:29 -04:00
yuri1969 a7ea178cdc NIFI-2715 - When performing a Queue Listing, if...
...FlowFile has no content, UI does not indicate this fact

For FlowFiles with no content:
* Added a simple title replacing the Content Claim's one.
* Defaulted File Size to 0 bytes using common formatting.
2017-08-24 18:38:29 -04:00
Bryan Bende cf57639396 NIFI-4311 Allowing umask to get set properly before initializing the FileSystem
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2106.
2017-08-22 22:40:26 +02:00
yuri1969 05700a2008 NIFI-3781 - Change tooltip for disabled state
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #2102
2017-08-21 12:56:19 -04:00
yuri1969 a3401c3b95 NIFI-3781 - Controller Service Config Dialog...
..'View Details' button feels confusing and inconsistent with Processors

* Merged 'View Details' and 'Edit' buttons to a single 'Configure'/'View Details' one.
* Fixed confusing 'View Details' modal's title.
2017-08-21 12:56:12 -04:00
mans2singh 8cb501443b NIFI-4250 - Elasticsearch 5 delete processor
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #2045
2017-08-21 08:49:57 -04:00
Pierre Villard 41984bed13 NIFI-1835 - added text/xml to content viewer
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #2098
2017-08-18 12:48:49 -04:00
Bryan Bende 60d4672195 NIFI-4304 Extracting HWX Schema Registry client version to a property and bumping to latest 0.3.0 release
Signed-off-by: Matthew Burgess <mattyb149@apache.org>

This closes #2096
2017-08-17 16:07:03 -04:00
Matt Burgess 6b5015e39b
NIFI-4218: Dynamic properties as query parameters in ESHttp processors
This closes #2049.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-08-17 14:29:05 -04:00
Mark Payne 69a08e78c2
NIFI-4295:
- When determining which controller services to return for a component, ensure that we don't show services that belong to 'child groups'
- Fixed a logic bug that determined which process group to use for obtaining controller services
- This closes #2087
2017-08-17 12:47:46 -04:00
Mark Payne 5cd8e93beb
NIFI-4224:
- Initial implementation of Process Group level Variable Registry
- Updated to incorporate PR Feedback
- Changed log message because slf4j-simple apparently has a memory leak; passing a String instead of passing in the Controller Service object as an argument addresses this.
- This closes #2051
2017-08-17 10:42:29 -04:00
Pierre Villard c1b99d584d NIFI-4028 - fix cache update when Wait releases flow files
NIFI-4028: Refactored Wait processor.

- Consolidated implementation for the cases of releasableFlowCount is 1 or more, in order to reduce complexity and behavior differences
- Added 'consumed' counter when total counter is used to release incoming FlowFiles
- Fixed method name typo, releaseCandidates

This closes #2055.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-08-17 08:30:07 +09:00
Pierre Villard 9f23ec360a NIFI-3931 - Added EL to properties in SFTP transfer
The properties are already evaluated against EL. Also added an
integration test that is failing without the change.

This closes #1968.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-08-17 08:20:30 +09:00
Arun Manivannan 6df112e4b1 NIFI-4062 Provide an option to disable DTD validation for EvaluateXPath and EvaluateXQuery
This closes #2093.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-08-17 08:07:37 +09:00
yuri1969 02c05bc203 NIFI-3780 - Should be able to specify Service...
...name when I create a new Controller Service within a Processor/Service configuration dialog

Changed CS name default's behavior according to PR feedback.

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #2081
2017-08-16 11:56:23 -04:00
yuri1969 79300de7a9 NIFI-3780 - Should be able to specify Service...
...name when I create a new Controller Service within a Processor/Service configuration dialog

I'm not sure how to integrate/style the text box. Suggestions are welcome.
2017-08-16 10:31:10 -04:00
Mark Payne abca9d1464
NIFI-4208: Fixed bug in SchemaRepositoryRecordSerde that would return null from deserializeEdit if there was no data; the interface documents that null cannot be returned from this method, as it is called only when data is expected to exist. As a result, if there is no data, we should throw EOFException instead, and the write-ahead log will handle that appropriately.
This closes #2086.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-08-15 12:10:43 -04:00
Pierre Villard a1706d12f5 NIFI-3281 - fix for (S)FTP processors when using EL against FFs
NIFI-3281 - Review - handle completePendingCommand return and added a unit test for ListFTP

NIFI-3281 - Review - Added flow file for EL evaluation in other methods and added unit test for NIFI-3590

This closes #1974.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-08-15 11:24:48 +09:00
Matt Burgess 50f22162b0
NIFI-4286: Fix NPE in GenerateTableFetch when Partition Size = 0
This closes #2078.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-08-14 15:28:07 -04:00
Pierre Villard 8aa4450084 NIFI-779 - fix for ReportingContext.getProperty(PropertyDescriptor)
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #2033
2017-08-14 13:41:10 -04:00
Mark Payne 451f9cf124 NIFI-4142: This closes #2015. Refactored Record Reader/Writer to allow for reading/writing "raw records". Implemented ValidateRecord. Updated Record Reader to take two parameters for nextRecord: (boolean coerceTypes) and (boolean dropUnknownFields)
Signed-off-by: joewitt <joewitt@apache.org>
2017-08-11 22:01:46 -07:00
Mark Payne 84935d4f78 NIFI-4023, NIFI-4077 This closes #2075. Addressed issue where repository was aging off the wrong index. When it should age off Index 1, it was removing Index 2. As a result, the earliest index is never aged off, and the newest index could potentially be aged off before it is ready to be. Also addressed issue where a query that attempts to read an event that has aged off throws FileNotFoundException (NIFI-4077) instead of skipping over the event. The JavaDocs indicate that the EventIterator should skip records that it cannot find, but SelectiveRecordReaderEventIterator throw FileNotFoundException instead
Signed-off-by: joewitt <joewitt@apache.org>
2017-08-11 22:01:46 -07:00
Andy LoPresto ae940d8624 NIFI-4237 Added working test for StringEncryptor decryption of sensitive flow values in FlowFromDOMFactory.
NIFI-4237 Cleaned up unused alternate approaches.

NIFI-4237 Added failing unit test for better error message.

NIFI-4237 Added logic to capture unhelpful encryption exception and provide context in message. All tests pass.

This closes #2077
2017-08-11 23:57:15 -04:00
Bryan Bende 28d5a70ec0
NIFI-4288 Ignoring tests that intermittently fail in TestPutUDP and TestPutTCP
This closes #2076.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-08-11 17:27:55 -07:00
Mike Moser d6ebc53076 NIFI-3736 modify default nifi.content.claim.max.appendable.size in nifi.properties to 1 MB 2017-08-11 15:53:36 -04:00
Bryan Bende f7da7e67f4 NIFI-4275 Adding support for specifying the timestamp on PutHBase processors
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2070.
2017-08-11 18:04:13 +02:00
Wayne Steel a6e8f0afe3 NIFI-4177 This closes #2002. MergeContent - Tar - Save modification timestamp like Tar does
Signed-off-by: joewitt <joewitt@apache.org>
2017-08-10 19:35:46 -07:00
Pierre Villard 69f263c4d1
NIFI-2167 - include disabled state for processors when copy/paste/templates
This closes #2057.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-08-10 18:41:24 -07:00
Mark Payne 96f5407ed9 NIFI-3329 This closes #2053. Removed check for latest version of flowfile when migrating flowfile from 1 session to another because we now longer are requiring latest version of flowfile be passed to session anywhere else. It was intended to be removed from StandardProcessSession.migrate when it was removed from StandardProcessSession.validateRecordState but it was overlooked. 2017-08-10 18:13:28 -07:00
Matt Gilman 20d6596df0 NIFI-3232:
- Adding support for cascading sub context menus.

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #2072
2017-08-10 17:01:25 -04:00
Pierre Villard 18c82eb6af
NIFI-4277 Fixed exception logging in StandardLogRepository
This closes #2068.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-08-10 11:54:32 -07:00
Matt Gilman 528b82634f
NIFI-4210:
- Introducing support for OpenId Connect.
- Updating REST API and UI to support the authorization code flow.
- Adding/fixing documentation.
- Implementing time constant equality checks where appropriate.
- Corrected error handling during startup and throughout the OIDC login sequence.
- Redacting the token values from the user log.
- Defaulting to RS256 when not preferred algorithm is specified.
- Marking the OIDC endpoints as non-guaranteed in to allow for minor adjustments if/when additional SSO techniques are introduced.

This closes #2047.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-08-10 11:15:35 -07:00
yuri1969 505e93065e NIFI-1027 - Treat label and node of a provenance graph event as one unit
The JIRA issue asks for treating both node and its label as one unit.
Described cursor issues seems to be fixed already.

However, there is an annoying dead space between a node and label
preventing displaying context menu, etc. Due to SVG group's nature
there has been added an opaque joint to remove the dead space.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2059.
2017-08-10 10:54:47 +02:00
Andy LoPresto 5150dff70b NIFI-4274 Removed EL evaluation logic from custom file validator.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2071.
2017-08-10 10:05:16 +02:00
Pierre Villard 6ff8321cf7
NIFI-4278 - add error message to invalid FFs in ValidateXml
This closes #2069.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-08-09 21:20:08 -07:00
Matt Burgess 9c4fdd4ef3 NIFI-4192: Add more Avro/metadata merge options to MergeContent
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2067.
2017-08-09 12:55:12 +02:00
Mike Thomsen 67819e5019
NIFI-4124 Added org.apache.nifi.mongo.PutMongoRecord.
Added changes based on code review. Changed:
* Put record reader instantiation inside of try-with.
* Put a batch size for the insert List.
* Ensured that session.transfer() to the success relationship will always happen.
Removed an unused import to fix the style check.

This closes #1945.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-08-07 22:10:27 -07:00
Bryan Bende 0029f025f8 NIFI-4152 Initial commit of ListenTCPRecord 2017-08-07 22:44:11 +02:00
yuri1969 e44f436bd8 NIFI-4271 - Revert double-click behavior back...
...to delete a bend point

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #2064
2017-08-07 15:58:48 -04:00
zhengsg ee3b58368d NIFI-4267 Change the class name for log in FileRemovalAction
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2061.
2017-08-07 21:42:46 +02:00
Wil Selwood f7f64a572c NIFI-4268: Add fetch tag to FetchFile processor.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2062.
2017-08-07 21:38:55 +02:00
Andy LoPresto 675d989003
NIFI-4139
- Moved key provider interface and implementations from nifi-data-provenance-utils module to nifi-security-utils module.
- Refactored duplicate byte[] concatenation methods from utility classes and removed deprecation warnings from CipherUtility.
- Created KeyProviderFactory to encapsulate key provider instantiation logic.
- Added logic to handle legacy package configuration values for key providers.
- Added unit tests.
- Added resource files for un/limited strength cryptography scenarios.
- Added ASL to test resources.
- Moved legacy FQCN handling logic to CryptUtils.
- Added unit tests to ensure application startup logic handles legacy FQCNs.
- Moved master key extraction/provision out of FBKP.
- Removed nifi-security-utils dependency on nifi-properties-loader module.
- Added unit tests.
2017-08-07 15:21:58 -04:00
Pierre Villard 8b54c2604c NIFI-4082 - Added EL on GetMongo properties
NIFI-4082 - Added EL on DB, URI and Collection

NIFI-4082 - Added UT for EL evaluation (URI, DB, Collection) and fixed ex. message for document validator.

This closes #1969
2017-08-07 13:40:27 -04:00
yuri1969 329b1caf82 NIFI-4266 - Allow double-click to display Event
...details

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #2058
2017-08-07 08:44:13 -04:00
Bryan Bende f8f1cc8d0d
NIFI-4024 Ensuring InputStream gets closed and cleaning up complex field handling
This closes #1961.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-08-04 14:54:05 -04:00
Mike Thomsen 496a32e12c
NIFI-4024 Added org.apache.nifi.hbase.PutHBaseRecord
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-08-04 14:54:01 -04:00
Yolanda M. Davis afd4f9e034
NIFI-4022 - Initial update for SASL support for cluster management in Zookeeper
NIFI-4022 - adding sasl documentation update and update to test

This closes #2046.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-08-04 14:19:35 -04:00
Mark Payne 969bbe654c NIFI-4051: Ensure that we use the appropriate Lexical syntax for SQL query validation as we do when running
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2054.
2017-08-04 16:31:56 +02:00
Wesley-Lawrence 40cde0466a NIFI-4215 NiFi can now parse an Avro schema of a record that references an already defined record, including itself.
This closes #2052.
2017-08-03 15:13:07 -04:00
Matt Burgess 2d33582147 NIFI-4253: Add Oracle 12+ database adapter
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2048.
2017-08-03 09:59:29 +02:00
James Wing 2502b79bae NIFI-4215 Revert Complex Avro Schema Changes
This reverts commit cf49a58ee7.
2017-08-01 21:03:04 -07:00
yuri1969 bcf60aa556 Add double-click shortcut to RPG
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #2009
2017-07-31 10:58:49 -04:00
yuri1969 ef9cb5be23 NIFI-1580 - Allow double-click to display config
* Added double-click shortcut opening config/details dialog to processors,
connections, ports and labels.
* Created a base for further default action selection, disabling, etc.
* Omitted default action configuration UI - that might be a separate JIRA ticket.
2017-07-31 10:36:37 -04:00
Wesley-Lawrence cf49a58ee7 NIFI-4215 Allow Complex Avro Schema Parsing
NiFi can now parse an Avro schema of a record that references an already defined record, including itself.

Signed-off-by: James Wing <jvwing@gmail.com>

This closes #2034.
2017-07-30 16:31:39 -07:00
mans2singh 0bb1411532 NIFI-4212 - RethinkDB Delete Processor
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #2030.
2017-07-29 14:49:22 -07:00
Leah Anderson 70878fe6d6 NIFI-4052 Add DynamicProperty annotation for LookupRecord
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2032.
2017-07-28 17:12:06 +02:00
Mark Payne 1d6b486b63 NIFI-4232: Ensure that we handle conversions to Avro Arrays properly. Also, if unable to convert a value to the expected object, include in the log message the (fully qualified) name of the field that is problematic
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2040.
2017-07-27 08:57:25 +02:00
Matt Burgess dc4006f423 NIFI-3335: Add initial.maxvalue support to GenerateTableFetch
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2039.
2017-07-27 08:43:00 +02:00
Pierre Villard 759f81bc1b
NIFI-4221 - Print app startup in human-readable time
This closes #2038.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-07-25 15:25:55 -07:00
Matt Burgess 9a5d4ff6b3 NIFI-4217 - Retain original DDL in CaptureChangeMySQL
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2036.
2017-07-25 17:54:11 +02:00
Matt Gilman 743c6b9c17 NIFI-4032: - Introducing the ManagedRangerAuthorizer. - Introducing the AuthorizationAuditor. - Updating authorization requests to utilize Authorizable where ever possible so allow for a singular place to audit resource not found as denied when the parent authorizable is null (no more inheritance). - Updating unit tests as appropriate. - Addressing issues with broken web-api integration tests.
NIFI-4032: - Generating the appropriate fingerprint for the ManagedRangerAuthorizer based on whether the UserGroupProvider is configurable. - Adding unit tests.

Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #2019
2017-07-24 15:51:27 -04:00
Pierre Villard 10692256d6 NIFI-917 Improve Rendering of Component Docs
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #2025.
2017-07-23 11:30:04 -07:00
Leah Anderson 3371e915cc NIFI-4087 This closes #2026. Fix to allow exclusion of filename from tika criteria. 2017-07-21 16:56:56 -04:00
Mark Payne 695e8aa98f
NIFI-106:
- Expose processors' counters in Stats History
- Only include counters in Processors' Status History if user has read access to corresponding Processor
- Addressed review feedback. Found and addressed bug where a counter is not present in all of the aggregate snaphot values for status history, resulting in the UI not rendering the chart properly
- This closes #1872
2017-07-21 14:18:11 -04:00
m-hogue c54b2ad81c NIFI-3736: change to honor nifi.content.claim.max.appendable.size and nifi.content.claim.max.flow.files properties. Added 100 MB cap for NiFiProperties.MAX_APPENDABLE_CLAIM_SIZE
This closes #2010.
2017-07-21 09:32:45 -04:00
Davide d334532b16 NIFI-4184: Enabled EL on PutHDFS Remote Group and Owner
I needed to put some attributes on REMOTE_GROUP and REMOTE_OWNER, in order to achieve it i put expressionLanguageSupported(true) on the PropertyDescriptor of REMOTE_GROUP and REMOTE_OWNER

This closes #2007.

Signed-off-by: Davide <davidde85@hotmail.it>
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-07-21 16:31:46 +09:00
Andre F de Miranda b0be99036d NIFI-55 - Ensures ListenHTTP logs the source of an expired hold
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1623.
2017-07-20 23:14:32 +02:00
Koji Kawamura b4e0a6e206 NIFI-4205: Avoid duplicated data from TailFile
Before this fix, it is possible that TailFile to produce duplicated data
if an already tailed file has newer timestamp and fewer or the same
amout of data.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2021.
2017-07-20 12:14:05 +02:00
James Wing 1f330b4fe4 NIFI-11 Fixing checkstyle issue - usused import 2017-07-19 22:46:15 -07:00
mans2singh ea1fe1a9c0 NIFI-4188 New RethinkDB Get processor
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #2012.
2017-07-19 20:56:47 -07:00
Andre F de Miranda 451a88df43
NIFI-11
- Capture Exception to prevent failed evaluations from yielding processor
- Further capture evaluation exceptions as per PR feedback
- Adjust jUnit to new exception behavior
- This closes #1644
2017-07-19 11:50:48 -04:00
Bryan Bende f87d2a2f57 NIFI-4157 Improvements to PutTCP
Signed-off-by: Bryan Bende <bbende@apache.org>
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1989.
2017-07-19 12:25:42 +02:00
joewitt 59754500d5 NIFI-2829 ignoring unit test that appears broken. Commented on JIRA about the problem observed 2017-07-18 22:23:10 -04:00
Andre F de Miranda a307ea3a00 NIFI-4098 This closes #2013. Adjust ParseCEF to re-use bean validator in order to improve performance 2017-07-18 22:02:39 -04:00
Matt Burgess 844dbe4edb NIFI-4156: Fixed fragment.count in SplitText to equal emitted flow files
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #2014.
2017-07-18 11:31:16 +02:00
deonhuang a6e94de0bb NIFI-2829 - Add Date and Time Format Support for PutSQL
Fix unit test for Date and Time type time zone problem
Enhance Time type to record milliseconds

This closes #1983.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-07-18 14:16:10 +09:00
patricker 03bff7c9fc NIFI-2829 Date and Time Format Support for PutSQL
This closes #1524.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-07-18 14:11:37 +09:00
Mark Payne a9529adab1 NIFI-4093: Fixed bug where we used the wrong Enum to determine how to process an update to the FlowFile Repo
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2017-07-13 10:51:02 -04:00
Koji Kawamura 5c48655e69 NIFI-4112: Fix ConvertExcelToCSV to handle empty cells.
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1973
2017-07-13 10:40:01 -04:00
Koji Kawamura 8acee02393 NIFI-1613
- Truncate text data types only.
- Added conversion from a boolean to number.
2017-07-12 17:02:55 -04:00
Koji Kawamura 3844a821f1 NIFI-1613: ConvertJSONToSQL truncates numeric value wrongly.
- Changed boolean value conversion to use Boolean.valueOf.
- Updated comments in source code to reflect current situation more clearly.
- Updated tests those have been added since the original commits were made.
2017-07-12 17:02:55 -04:00
Toivo Adams 3b2e43b75c NIFI-1613 Initial version, try to improve conversion for different SQL types. New test and refactored existing test to reuse DBCP service.
nifi-1613 Adding numeric and Date/time types conversion and test.
2017-07-12 17:02:55 -04:00
Mark Payne b603cb955d NIFI-4060: Initial implementation of MergeRecord
NIFI-4060: Addressed threading issue with RecordBin being updated after it is completed; fixed issue that caused mime.type attribute not to be written properly if all incoming flowfiles already have a different value for that attribute

NIFI-4060: Bug fixes; improved documentation; added a lot of debug information; updated StandardProcessSession to produce more accurate logs in case of a session being committed/rolled back with open input/output streams
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1958
2017-07-12 16:36:48 -04:00
Matt Gilman eefad29167 NIFI-4127:
- Introducing composite ConfigurableUserGroupProvider and UserGroupProvider.
- Adding appropriate unit tests.
- Updating object model to support per resource (user/group/policy) configuration.
- Updating UI to support per resource (user/group/policy) configuration.
- Adding necessary documentation.
- Updating documentation to clarify integrity checks.
- Providing an example of configuring a composite implementation.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1978.
2017-07-11 18:13:04 +02:00
Joe Skora 325fe53fa1 NIFI-3677 - ExtractMediaMetadata should close TikaInputStream
* Added finally block to close TikaInputStream.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1993.
2017-07-11 18:04:50 +02:00
Jeff Storck 58fc5f24b8
NIFI-1586 Removed check for distributed ZK quorum before starting the DatadirCleanupMananger to enable autopurge during standalone ZK server usage. This closes #2001 2017-07-11 10:04:08 -04:00
mans2singh 0fd51b4d12 NIFI-4145 Added writes attributes annotation
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1998.
2017-07-10 21:25:26 -07:00
m-hogue 78fbb8f2ee
NIFI-3939: Reviewed and corrected all incorrect nifi-web-api resource response types. This closes #1999 2017-07-10 14:40:13 -04:00
Mark Payne 87e062ff55
NIFI-4167: StandardResourceClaimManager should not synchronize on a ResourceClaim in order to determine the claim count. This closes #1996 2017-07-10 14:33:07 -04:00
Tony Kurc 2dc45a4dd7 NIFI-4154 Fixing line endings in .java,.html files
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1982.
2017-07-09 12:13:15 -07:00
mans2singh affc88e599 NIFI-4118 RethinkDB bundle with put processor
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1942.
2017-07-09 11:10:23 -07:00
Mark Payne 9e296830ab
NIFI-4151: Ensure that we properly call invalidateValidationContext() when properties change; ensure that in the controller service provider we don't replace a controller service with a new node if the ID's match, as we won't be able to actually add the new one to the flow. This closes #1995 2017-07-07 16:41:32 -04:00
Yolanda M. Davis 6df97bbc88
NIFI-4135 - added hadoop-client and enhanced Authorizers entity to support classpath for resources entry
NIFI-4135 - classpath under class

This closes #1956.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-07-07 10:08:48 -04:00
kwydler e89512e744 NIFI-4161: Adding expression evaluation to AWS PROXY_HOST and PROXY_HOST_PORT property usage
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1990.
2017-07-07 13:28:33 +02:00
Koji Kawamura e84f9a2416 NIFI-4160: SFTPTransfer connection timeout for opening channel.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1991.
2017-07-07 12:31:50 +02:00
Koji Kawamura 50c364a793 NIFI-4162: PutSQL batch update error message should include the cause
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1992.
2017-07-07 12:25:10 +02:00
Pierre Villard 45f82dc855 NIFI-4111 - NiFi shutdown
Fixed threads shutdown so that NiFi can shutdown gracefully

NIFI-4111 - Review - Handling SocketRemoteSiteListener (RAW S2S)

This closes #1963.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-07-07 14:23:18 +09:00
Mark Payne 3906d4e1d2 NIFI-1763: Initial implementation of ConfluentSchemaRegistry.
NIFI-1763: Fixed bug where the Confluent Schema Registry Schema Access Writer was not being created

Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #1938
2017-07-06 15:52:07 -04:00
Pierre Villard a3b72f1bb7
NIFI-4143 - externalize MAX_CONCURRENT_REQUESTS. This closes #1962 2017-07-06 15:38:55 -04:00
Mark Payne ba56774fa1
NIFI-4151: Updated UpdateAttribute to only create JAXB Context once; Minor performance tweaks to standard validators and StatusMerge.prettyPrint; updated AbstractConfiguredComponent to not create a new ValidationContext each time that validate is called but only when needed; updated FlowController, StandardControllerServiceProvider, and StandardProcessGroup so that component lookups can be performed using a ConcurrentMap at FlowController level instead of having to perform a depth-first search through all ProcessGroups when calling findProcessor(), findProcessGroup(), findXYZ()
This closes #1979
2017-07-06 13:43:56 -04:00
Mark Payne cff81c0cd2
NIFI-4153: Use a LinkedBlockingQueue instead of a SynchronousQueue for Request Replicator's thread pool so that requests will queue when all threads are active, instead of throwing an Exception. This closes #1980 2017-07-06 10:11:48 -04:00
m-hogue e6b166a3a2 NIFI-552: added regex properties for include and ignore filters in LogAttribute
This closes #1981

Signed-off-by: Tony Kurc <tkurc@apache.org>
2017-07-05 21:21:50 -04:00
m-hogue 47eece5798 NIFI-3193: added ability to authenticate using cert common names
This closes #1971.

Signed-off-by: Tony Kurc <tkurc@apache.org>
Also reviewed by Pierre Villard <pierre.villard.fr@gmail.com>
2017-07-05 15:28:54 -04:00
Pierre Villard 7843b885ee NIFI-4144 - added min/max age to ListHDFS processor
This closes #1966.

Signed-off-by: Tony Kurc <tkurc@apache.org>
2017-07-04 21:18:43 -04:00
Pierre Villard 8b5342dec0 NIFI-3974 - Added charset in LogAttribute
This closes #1967

Signed-off-by: Tony Kurc <tkurc@apache.org>
2017-07-02 12:03:07 -04:00
Pierre Villard 902b6e205d NIFI-4131 - GFT warning message when badly setting relationships
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1954
2017-06-30 15:12:10 -04:00
Mark Payne 7f4cfd51ea NIFI-3897: If swapping data into queue and an unexpected exception/error is thrown, do not lose track of the swap file
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1960.
2017-06-30 13:53:05 +02:00
Mark Payne cdc154f7c8 NIFI-4046: If we are unable to parse out any records from a Kafka Mesaage with ConsumeKafkaRecord, then we should route all of the bytes received to 'parse.failure'
NIFI-4046: Addressed issue of Record Writer failing with ConsumeKafkaRecord

This closes #1906.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-06-30 17:56:14 +09:00
m-hogue 58a623dfa2 NIFI-4037 added InvokeGRPC processor, with proto service IDL
NIFI-4038 added ListenGRPC processor

This closes #1947

Signed-off-by: Tony Kurc <tkurc@apache.org>
2017-06-29 22:01:22 -04:00
yuri1969 3bf1d12706
NIFI-4125 Added secure transform feature and configuration to TransformXML processor to mitigate XXE file system leaks.
This closes #1946.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-06-29 10:40:33 -07:00
Mike Thomsen 5172797448 NIFI-4122 Added the ability to combine multiple Mongo result documents into a single output JSON array.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1948.
2017-06-29 12:43:52 +02:00
Sreeram Garlapati 82ef671953 NIFI-4007 - Update azure EventHubs client to latest version
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1880.
2017-06-29 09:30:39 +02:00
Michael Andre Pearce bdfd710692 NIFI-3983 - Support ability to make JMS 2.0 durable subscriptions on Topic
Add logic in Consumer adding support for all topic consumer combinations, non-durable, durable, shared, durable-shared.
Add new optional config option to supply subscription name.
Add new optional config option to supply clientId.

This closes #1863.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-06-29 10:23:15 +09:00
Matt Burgess 9bfa7469cb NIFI-4137: Add support for UTF-8 in GetFTP and PutFTP
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #1957
2017-06-28 16:41:14 -04:00
Matt Gilman c99c036c20 NIFI-4045:
- Addressing issues causing the eventId to not be relayed when submitting a lineage request under certain conditions.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1903.
2017-06-27 21:48:55 +02:00
Andre F de Miranda 1e7eceee84 NIFI-4126 - Add SupportBatching, SideEffectFree and EventDriven annotations to ExtractGrok
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1950.
2017-06-27 20:56:56 +02:00
yuri1969 202eb5ccbe
NIFI-4119 - Improve UX of canvas label configuration by providing immediate focus to value field
This closes #1940.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-06-27 10:38:35 -07:00
kwydler c37aed4de2 NIFI-4128 Added "All" MessageAttributeNames to GetSQS processor ReceiveMessageRequest
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1949.
2017-06-26 22:25:16 -07:00
Scott Aslan 24e2981012 [NIFI-4117] update connection config prioritizers to be contained within their parent element
This closes #1944.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2017-06-26 20:25:50 +02:00
Steve Champagne 68b42c9e54 NIFI-4055: Add a compression option to AvroRecordSetWriter
This closes #1909.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>
2017-06-26 19:16:31 +02:00
Koji Kawamura 91ed96f8c4 NIFI-4040: Continue if SFTP failed getting user home directory
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1898.
2017-06-26 19:09:22 +02:00
Koji Kawamura 69613f29c9
NIFI-4050: Fixed NPE at AbstractConfiguredComponent.validate
This closes #1905.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-23 13:58:22 -04:00
Pierre Villard 47165afc0c
NIFI-4073 - fix duplicated stack trace
This closes #1916.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-06-23 11:20:07 -04:00
Mark Payne 8878d732dd NIFI-4103: Return an empty Optional if an IP address cannot be found
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1933
2017-06-23 11:14:57 -04:00
Andy LoPresto ff65b42e88 NIFI-4110 Added Thread.sleep() to ensure provenance event indexing occurs before retrieval and unit test passes.
Signed-off-by: Scott Aslan <scottyaslan@gmail.com>

This closes #1935
2017-06-23 08:48:34 -04:00
patricker 7c27d4c588 NIFI-3992: Added Original Headers to Include/Exclude
Some headers can cause problems with message parsing, specifically the 'Content-Type' header.
If an email contains attachments, ConsumeEWS may generate emails where the attachments cannot be extracted.

This closes #1867.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-06-23 17:38:19 +09:00
Andy LoPresto 253ea2e73b NIFI-4095 Changed minimum capture group count in ExtractText from 1 to 0.
Added unit test and removed obsolete test.
Added custom validation to enforce capture group if "include capture group 0" is false.
2017-06-22 23:31:35 +02:00
Koji Kawamura 5c755c006b
NIFI-4017: Emit provenance event from Notify.
This closes #1890.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-06-22 16:49:31 -04:00
Pierre Villard f54e146561
NIFI-4085 Add exception in log message when (S)FTP listing fails
This closes #1929.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-06-22 16:06:18 -04:00
Niels Zeilemaker 5b82b735ab
NIFI-4106 Increase log level of user authentication rejection to warn.
This closes #1934.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-06-22 14:03:25 -04:00
Jeff Storck 668a64cd56 NIFI-1586 Implements autopurging of transaction log and snapshot files
When NiFi is clustered, and autopurge.purgeInterval is greater than 1, the DatadirCleanupManager will be started in order to automatically purge transaction log and snapshot files based on the autopurge settings in zookeeper.properties

This closes #1928.
2017-06-22 09:30:38 -04:00
Jeff Storck c99100c934
NIFI-4010 Enables EL on Fetch/List/PutSFTP and List/Fetch/Put/DeleteHDFS processor properties
FetchSFTP/ListSFTP/PutSFTP: Private Key Path
ListHDFS/FetchHDFS/PutHDFS/DeleteHDFS: Hadoop Configuration Resources, Kerberos Principal, Kerberos Keytab, Kerberos Relogin Period

This closes #1148
This closes #1930.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-21 17:14:49 -04:00
Maurizio Colleluori 59a32948ea
NIFI-2923 Added evaluation of attribute expressions for Kerberos principal and keytab
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-21 17:14:28 -04:00
Maurizio Colleluori 86fa1bba4f
NIFI-2923 Add expression language support to Kerberos parameters used by processors
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-21 17:14:27 -04:00
Mark Payne 73e601bc55 NIFI-4102: If first line read does not match Grok expression, skip line
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1932
2017-06-21 15:10:22 -04:00
Joe Percivall 77e49b749e NIFI-4075 Updating 'addRemoteProcessGroup' in StandardFlowSerializer to properly use ScheduledStateLookup. This closes #1922. 2017-06-21 14:20:22 -04:00
Bryan Bende aabd4a25d2 NIFI-4043 Initial commit of nifi-redis-bundle
NIFI-4061 Initial version of RedisStateProvider
- Adding PropertyContext and updating existing contexts to extend it
- Added embedded Redis for unit testing
- Added wrapped StateProvider with NAR ClassLoader in StandardStateManagerProvider
- Updating state-management.xml with config for RedisStateProvider
- Renaming tests that use RedisServer to be IT tests so they don't run all the time

This closes #1918.
2017-06-21 12:47:19 -04:00
Matt Gilman 6bc6f955c0 NIFI-4059:
- Introducing the LdapUserGroupProvider.
- Updating documentation accordingly.
- Moving the IdentityMapping utilities so they were accessible.

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1923.
2017-06-19 19:25:33 +02:00
Scott Aslan ad6af1d941 NIFI-3994 Add Create Template to the context menu
Signed-off-by: James Wing <jvwing@gmail.com>

This closes #1883.
2017-06-17 16:46:31 -07:00
Wesley-Lawrence 5a7e6c6ac1 NIFI-4064 Make sure that Funnels with queued incoming FlowFiles, but no outgoing connections yield rather than continually check to run.
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1914.
2017-06-17 15:50:40 +02:00
Chris Herrera 2800df30d3 NIFI-2692
- Removing problematic timeout for SMTP Listen
- Converting anonymous method to lambda
- Adding debug and error logging

Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1924.
2017-06-17 15:22:33 +02:00
Matt Gilman 490e1da5db NIFI-4019:
- Adding support for X-Forwarded-* headers.
- Unrelated code clean up.
- Addressing additional proxying issues.
- Addressing mistyped landing page.
- Handled trailing slashes in proxy headers for context path
2017-06-15 14:17:35 -04:00
Mark Payne c0ad5bcc7b NIFI-1921: Fixed bug in how average lineage duration was calculated for cluster stat
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1912
2017-06-13 12:29:03 -04:00
Bryan Bende 2b47ade0c4
NIFI-4049 Fixing unit test that doesn't run on OSX and caused Travis failure 2017-06-12 16:36:23 -04:00
Koji Kawamura de1b84e2aa
NIFI-4049: Refactor AtomicDistributedMapCacheClient
To be used with cache engines that does not have revision number.

NIFI-4049: Refactor AtomicDistributedMapCacheClient

Removed old methods completely.

This closes #1904.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-12 10:34:48 -04:00
Koji Kawamura 7761903352 NIFI-4041: Add file.size attribute to ListFTP and ListSFTP
This closes #1899.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-06-12 10:53:09 +09:00
Mark Payne e7dcb6f6c5 NIFI-3921: Allow Record Writers to inherit schema from Record
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1902
2017-06-09 16:13:25 -04:00
Matt Gilman 4ed7511bee
NIFI-3653: - Introducing UserGroup and Policy provider interfaces.
- Introducing FileUserGroupProvider and FileAccessPolicyProvider.
- Refactoring FileAuthorizer to utilize the file based implementations.
- Introducing the StandardManagedAuthorizer.
- Decorating the configured ManagedAuthorizer to ensure integrity checks are still performed.
- Loading user groups if possible to use during access decisions.
- Merging responses for requests for AccessPolicies, Users, and UserGroups.
- Adding unit tests as appropriate.
- Adding methods to the User, Group, and AccessPolicy builder that more easily supports generating UUIDs.
- Fixing typo when seeding policies during startup.
- Fixing type in documentation and error messages.

This closes #1897.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-09 13:54:10 -04:00
Mark Payne d8dc2bb00b NIFI-4047: Addressed issue with inconsistent Lexical policy between used cached schemas and non-cached schemas
This closes #1907

Signed-off-by: Joe Percivall <JPercivall@apache.org>
2017-06-09 12:05:11 -04:00
Matt Gilman cc741d2be6
NIFI-3997:
- Bumping to next minor version.
2017-06-08 15:22:51 -04:00
Matt Gilman 1bf0a1a849
Merge branch 'NIFI-3997-RC1' 2017-06-08 14:30:10 -04:00
Bryan Bende b0c9428776 NIFI-4030 Populating default values on GenericRecord from Avro schema if not present in RecordSchema
This closes #1896.
2017-06-07 13:59:40 -04:00
Steve Champagne 45e035686f
NIFI-4029: Allow null Avro default values in HortonworksSchemaRegistry
This closes #1894.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-07 12:03:53 -04:00
Matt Gilman c86190c513 NIFI-4027: - Fixing the positioning of the tooltips in the component toolbar.
This closes #1893

Signed-off-by: Scott Aslan <scottyaslan@gmail.com>
2017-06-06 17:35:43 -04:00
Joe Gresock 3ef0fa48da NIFI-4014: Correcting Event Type text in S2S provenance reporting task
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1887.
2017-06-06 12:06:04 +02:00
Koji Kawamura e1880785d0
NIFI-4021: Fix StandardFlowSynchronizerSpec to pass independently.
This closes #1892.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-06-05 19:25:07 -07:00
Matt Gilman 6ee12e9b47
NIFI-3997-RC1prepare for next development iteration 2017-06-05 11:07:43 -04:00
Matt Gilman ddb73612bd
NIFI-3997-RC1prepare release nifi-1.3.0-RC1 2017-06-05 11:07:28 -04:00
Andre F de Miranda 082b99640e NIFI-4001 - Bump ParCEFone version
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1875.
2017-06-03 12:11:38 +02:00
Andre F de Miranda 4d78052dd4 NIFI-1709 - Introduce logic to probe Linux version using /etc/os-release to nifi.sh
Add explicit paths to support SLES 11 SP4 / OpenSUSE init.d layout

This closes #1794
2017-06-03 08:12:52 +10:00
Mark Payne 32314d70fd NIFI-4009: Added support for several key functions in RecordPath
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1881
2017-06-02 14:06:05 -04:00
Matt Burgess 0bddcfe730
NIFI-4002: Add PutElasticsearchHttpRecord processor
This closes #1878

Signed-off-by: Bryan Rosander <brosander@apache.org>
2017-06-02 13:01:13 -04:00
Mark Payne 37be0b9820 NIFI-3990: This closes #1870. Avoided creating garbage when we can avoid it in the JSON and csv readers and json writer
Signed-off-by: joewitt <joewitt@apache.org>
2017-06-02 10:01:40 -04:00
Mark Payne 067e9dfeb0
NIFI-4003: Expose configuration option for cache size and duration NIFI-4003: Addressed remaining spots where client does not cache information
This closes #1879.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-01 15:31:35 -04:00
Mark Payne 2595d816c4 NIFI-3986: This closes #1868. When we encounted EOFException from sequential record reader event iterator, just treat it as not having any more events
Signed-off-by: joewitt <joewitt@apache.org>
2017-06-01 15:08:12 -04:00
Mark Payne 7035694e37
NIFI-3995: Updated Hwx Encoded Schema Ref Writer to write 13 bytes for header instead of 14; added unit test to verify
This closes #1876.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-06-01 10:29:58 -04:00
Mark Payne a0b2311ff6 NIFI-3995: This closes #1873. No longer use the 14th byte in the header for hwx content-encoded schema reference
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-31 13:41:25 -04:00
Mark Payne 2b435cdfc6 NIFI-3985: This closes #1864. Added 'Starting Position' property to SiteToSiteReportingTask; also added additionalDetails.html that explains the schema and updated the reporting task to stop publishing when the user clicks 'stops' instead of running indefinitely until the reporting task has caught up
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-26 21:05:45 -05:00
Yolanda M. Davis dd50745a9f
NIFI-3984 - upgraded version of schema-registry client to 0.2.1
This closes #1866.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-26 17:59:53 -04:00
Pierre Villard 80dfe0257f ExtractGrok - Include exception message when compile fails
This closes: #1845

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2017-05-27 00:56:25 +10:00
Bryan Bende e85081ed20 NIFI-3979 Documenting how ListHDFS maintains state and performs listings
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1860.
2017-05-26 10:40:22 +02:00
Mark Payne 5cb928131c
NIFI-3981: When serializing flow to cluster, use the Scheduled State of ports as they are configured to be, not the current state, since the current state may change as soon as the FlowController has finished initializing
This closes #1861.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-25 16:45:20 -04:00
Koji Kawamura 13b59b5621 NIFI-3958: Decimal logical type with undefined precision and scale.
- Oracle NUMBER can return 0 precision and -127 or 0 scale with variable scale NUMBER such as ROWNUM or function result
- Added 'Default Decimal Precision' and 'Default Decimal Scale' property to ExecuteSQL and QueryDatabaseTable to apply default precision and scale if those are unknown
- Coerce BigDecimal scale to field schema logical type, so that BigDecimals having different scale can be written

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1851
2017-05-25 14:37:17 -04:00
Mark Payne 36911957dc NIFI-3972: This closes #1855. When enabling Controller Services on startup, wait until service is enabled (or until 30 seconds elapses, whichever comes first) before returning. This avoids having Service A depend on Service B and then attempting to start Service A before Service B is fully enabled
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-25 13:32:02 -04:00
Mark Payne eb25c8547a NIFI-3972: Ensure that we wait until service state becomes enabled before triggering completable future that says that it's enabled 2017-05-25 13:31:53 -04:00
Joseph Niemiec 44fdc0e4ef NIFI-3640 uri eventhub changes
This closes #1617
2017-05-25 13:14:51 -04:00
Koji Kawamura 4d0667380a NIFI-3404: Improved UX of LookupAttributes.
- Added dependency notice.
- Added EL evaluation at SimpleKeyValueLookupService.
- Updated documentation.
- Updated CommonsConfigurationLookupService to throw LookupFailureException if it fails to get configuration so that error messages can be displayed at each processor bulletin.
- Added calling getConfiguration at OnEnabled of CommonsConfigurationLookupService, so that the service will stay in Enabling state if there is any issue.

Signed-off-by: Joey Frazee <jfrazee@apache.org>
2017-05-25 10:05:32 -05:00
Joey Frazee 46e2420d74 NIFI-3404 Added LookupAttribute processor and lookup controller services
Signed-off-by: Joey Frazee <jfrazee@apache.org>
2017-05-25 10:05:32 -05:00
Koji Kawamura 23cbc3b346 NIFI-3976: This closes #1857. Fix ConsumePOP3 and ConsumeIMAP to delete messages.
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-25 10:59:53 -04:00
Pierre Villard dc5e032368 NIFI-3791 - added back pressure data into S2SStatusReportingTask
This closes #1745.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-05-25 18:20:11 +09:00
Andre F de Miranda c07850aec3 NIFI-2702 - Deprecates nifi-standard-bundle/*JMS and document the recommended alternative
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1643.
2017-05-25 08:44:39 +02:00
Pierre Villard e05005584d NIFI-3809 - Added HTTP mode and HTTP proxy for S2S Reporting Tasks
This closes #1754.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-05-25 15:31:49 +09:00
Pierre Villard b6eb0ac0fb NIFI-3859 - Provide filtering options in S2SProvenanceReportingTask
This closes #1777.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-05-25 14:10:50 +09:00
Mark Payne eaefec6d81 NIFI-3971: This closes #1854. Fixed bug in calculating content size that was transferred when cloning a relationship
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-24 22:14:56 -04:00
Mark Payne 5aa3baca79 NIFI-3568: This closes #1577. Use a cached thread pool in order to allow ThreadPoolRequestReplicator to scale up the number of threads to some configurable max
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-24 21:21:45 -04:00
Scott Aslan 86728bac7e
[NIFI-3925] for the jquery.combo plugin: update the calculation of the width of the combo box options overlay and also updated the plugins styles to now leverage the css calc() to determine the exact width of .combotext and .combo-option-text elements. This closes #1848 2017-05-24 16:15:42 -04:00
Matt Gilman f97b3fe455
NIFI-3963: - Ensuring the RemoteGroupPort yields when the details cannot be refreshed from any of the configured remote instances.
This closes #1853.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-24 15:58:22 -04:00
Bryan Bende ae3db82303
NIFI-3644 Fixing the result handler in HBase_1_1_2_ClientMapCacheService to use the offsets for the value bytes
This closes #1645.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-24 14:59:28 -04:00
baolsen 152f002abf
Completed initial development of HBase_1_1_2_ClientMapCacheService.java which is compatible with DetectDuplicate (and other processors)
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-24 14:59:23 -04:00
Mike Moser 232380dbfd NIFI-1452 on timer-driven yield, use the greater of yield duration or run schedule
This closes #1832.
2017-05-24 14:24:29 -04:00
Mark Payne b12cf8a6d2 NIFI-3671: This closes #1852. Ensure that we use the existing ResourceClaim (if it exists) when swapping data in, instead of creating a new one. Otherwise, if the ResourceClaim is still writable, then we may archive the data and then write to it, which can cause a NullPointerException in FileSystemRepository
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-24 14:21:18 -04:00
Pierre Villard fb7d6d1150 NIFI-3799 Add Input Requirement Info to Docs
Added input requirement info for processor documentation

This closes #1756.

Signed-off-by: James Wing <jvwing@gmail.com>
2017-05-24 10:45:45 -07:00
Mark Payne 08b66b5b6a NIFI-3969: Prevent merging flowfiles prematurely when all bins fill but some are already full and can be processed
Signed-off-by: Pierre Villard <pierre.villard.fr@gmail.com>

This closes #1850.
2017-05-24 19:36:18 +02:00
Pierre Villard bb96b0f464 NIFI-3816 - Added correct mime.type to S2S bulletin and provenance reporting tasks
This closes #1758.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2017-05-25 00:33:50 +09:00
Scott Aslan 7a46238baf
[NIFI-3943] align combo option item toolips to hover closer to the icon. This closes #1849 2017-05-24 11:14:48 -04:00
Pierre Villard ba49b8427c
NIFI-3191 - HDFS Processors Should Allow Choosing LZO Compression
This closes #1802.

Signed-off-by: Bryan Bende <bbende@apache.org>
2017-05-24 11:04:00 -04:00
Pierre Villard d63fa8a822 NIFI-3878 This closes #1790. AmbariReportingTask - Default run schedule set to 1 minute
Signed-off-by: joewitt <joewitt@apache.org>
2017-05-24 00:09:17 -04:00
Andy LoPresto 6d07ebf50c NIFI-3954 This closes #1841. Upgraded version of httpclient library to handle TLS issues.
Added explicit dependency on httpcore for @ThreadSafe annotation.

Signed-off-by: joewitt <joewitt@apache.org>
2017-05-23 23:42:28 -04:00