Commit Graph

1584 Commits

Author SHA1 Message Date
Matt Gilman bc223fa197
NIFI-3117: - Checking referenced services when performing an action with a snippet that requires it.
- Updating the SnippetManager to automatically expire unused snippets.
- Making the checking of referenced services consistent across component removal.
- Adding checking of referenced services for all nested components in a snippet.
- Updating the REST API docs to clarify when a referenced service is authorized.
- Conditionally authorizing transitive service references.

This closes #1277.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-11-30 12:50:25 -05:00
jpercivall e3c7611347
NIFI-3112 Revert "NIFI-2199 - allows nifi.sh restart through ssh"
This reverts commit 88d125137e.

This closes #1282.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-11-29 17:32:47 -08:00
Mark Payne 9d6ca6e1e6
NIFI-2975: Only start expiring FlowFiles after FlowFile Repository has been restored
This closes #1274.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-11-29 09:54:15 -05:00
joewitt 92f17a995b NIFI-3100-rc2 prepare for next development iteration 2016-11-25 23:49:27 -05:00
joewitt 5536f690a8 NIFI-3100-rc2 prepare release nifi-1.1.0-RC2 2016-11-25 23:49:13 -05:00
Joey Frazee 617b62ac7a NIFI-3104 This closes #1273. Removed tests derived from HAPI test data 2016-11-25 19:39:36 -05:00
Koji Kawamura f4f60c3610 NIFI-3103: This closes #1272. Exclude localhost.cert from RAT check. 2016-11-25 19:33:48 -05:00
Andy LoPresto 2c3714536f
NIFI-3024 Added key migration for sensitive processor properties contained in flow.xml.gz. (nifi.sensitive.props.key)
This closes #1261.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-11-23 13:26:18 -08:00
Mark Payne 7ff14f7191 NIFI-3091: Ensure that we set the appropriate size on FlowFiles when modifying them
This closes #1267

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-23 12:07:44 -05:00
Mark Payne 91ff810dba NIFI-3088: Ensure that on recovery of FlowFile Repository, if we find a FlowFile that maps to an unknown queue that we log a warning that the queue is missing and drop the FlowFile, rather than throwing an NPE
This closes #1266

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-23 11:27:14 -05:00
joewitt 22143e386d NIFI-2991 This closes #1265. was allowed to restore twitter4j json.org usage until April. Resolution for that will be in NIFI-3089 2016-11-23 10:21:41 -05:00
Matt Burgess 7fc7494b21 NIFI-3087: This closes #1263. Added unit tests to PutElasticsearch(Http) to illustrate issue 2016-11-23 08:22:34 -05:00
Matt Burgess d3dbac50a8 NIFI-3087: Fixed issue with partial failure responses in PutElasticsearch(Http) 2016-11-23 08:11:49 -05:00
Jeff Storck 066accc274 NIFI-3086 Updated TailFile.java to deal with windows paths that were breaking the regex parsing Fixed documentation misspelling in TailFile.java Fixed assertions in several tests in TestTailFile that were dependent on the received order of flowfiles, this was differing between Windows and MacOS/Linux
This closes #1264

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-23 00:01:12 -05:00
Joseph Percivall 50667ed222 NIFI-3084 Fixing TestPersistentProvenanceRepository and closing a stream leak in RecordReaders.
This closes #1260.
2016-11-22 17:31:47 -05:00
Oleg Zhurakousky 913ae91614 Added posix guard to ignore tests on windows
This closes #1259

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-22 17:11:25 -05:00
Bryan Bende 78fed3ed56
NIFI-3068 Adding @RequiresInstanceClassLoading to PutHDFS to ensure the security configuration of the Hadoop client is fully isolated between instances of PutHDFS 2016-11-22 16:41:44 -05:00
Koji Kawamura 36796b5440 NIFI-3078: Test InvokeScriptedProcessor with JS.
This closes #1255.
2016-11-22 21:42:36 +01:00
Matt Burgess fa5fed9bb5 NIFI-3082: Fixed status code handling in PutElasticsearchHttp
This closes #1258.
2016-11-22 21:32:03 +01:00
Kathik Narayanan 9e884f6120 NiFI-3064 Convert to Avro fails when a MySQL query returns two columns with the same name even with different aliases
Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1251
2016-11-22 11:49:25 -05:00
Mark Payne aa99cc6822
NIFI-3079: Ensure that in all cases we increment session's bytesRead count when finished reading from Content Repo
This closes #3079.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-11-22 11:26:22 -05:00
Scott Aslan ead9205458 [NIFI-3075] remove fixed width from combo options and add max-width css style to display ellipsis when options text is too long. This closes #1253 2016-11-21 17:27:03 -05:00
Mike Moser 15af764dd8 NIFI-2996
- validate processors only when they are in STOPPED state
- report validation errors via REST API on processors/services/tasks/ports only when they are in the STOPPED state
- This closes #1192
2016-11-21 17:02:25 -05:00
joewitt fb9cbccc38 NIFI-2954 This closes #1244. Moved StandardPropertyValidator to nifi-utils, documented scope/purpose of a few util libs, removed deps from nifi-utils. 2016-11-21 16:30:42 -05:00
Matt Burgess dba9d5924a NIFI-3011: Added Elasticsearch5 processors
This closes #1233

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-21 15:58:40 -05:00
Matt Gilman 7f5eabd603
NIFI-3050: Implemented access control logic for restricted components.
- Addressing comments from PR.
- Adding restricted tags to relevant components.
- Showing a restricted icon overlay on the processor node on the canvas. (+1 squashed commit)
Squashed commits:
[f487682] NIFI-3050:
- Introducing a Restricted annotation for components that require elevated privileges to use.
- Updating the new Processor, Controller Service, and Reporting Task dialogs to include these details and prevent unauthorized selection.
- Including the Restricted description in the generated component documentation.
- Updating processor access control integration test to verify restricted component creation.
- Updating the developer, user, and admin guide to include the restricted component policy.

This closes #1247.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-11-21 12:07:48 -08:00
Matt Burgess eb5abf809d
NIFI-2927: Added Validation Query to HiveConnectionPool
This closes #1252.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-11-21 14:21:22 -05:00
Peter Wicks d65f46f7a5 NIFI-2750
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2750

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2750 Tweaking Property Retrieval

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1001
2016-11-21 12:58:17 -05:00
Mark Payne 2ee66de1a6 NIFI-3066: Create unit test to reproduce bug that results in IllegalArgumentException: Cannot migrate FlowFiles from a Process Session to itself
NIFI-3066: Ensure that when a Bin is created, it is always created with its own new session

This closes #1245
2016-11-21 11:34:14 -05:00
Joey Frazee e731f09573 NIFI-3061: Bumped azure-eventhubs version to 0.9.0
This closes #1250.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-11-21 10:30:28 +09:00
Matt Gilman c8830742ee NIFI-3020:
- Introducing a strategy for identifying users.
- Fixing issue with the referral strategy error message.
- Adding code to shutdown the application when the authorizer or login identity provider are not initialized successfully.

NIFI-3020:
- Updating the admin guide to document the identity strategy.

NIFI-3020:
- Ensuring the request replicator attempts to shutdown regardless of whether the flow service properly terminates.

This closes #1236
2016-11-19 08:38:41 -05:00
Mark Payne 1be0871473 NIFI-2854: Refactor repositories and swap files to use schema-based serialization so that nifi can be rolled back to a previous version after an upgrade.
NIFI-2854: Incorporated PR review feedback

NIFI-2854: Implemented feedback from PR Review

NIFI-2854: Ensure that all resources are closed on CompressableRecordReader.close() even if an IOException is thrown when closing one of them

This closes #1202
2016-11-18 14:53:13 -05:00
James Wing 7206318ecf NIFI-3033 GenerateFlowFile Dynamic Properties
This closes #1222.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-11-18 11:06:20 +09:00
Bryan Rosander e5eda63705
NIFI-2943 - Toolkit uses JKS type over PKCS12 when creating truststore because non-Bouncy Castle providers cannot read certificates from PKCS12 truststore.
Peer review feedback (+2 squashed commits)
Squashed commits:
[0102c8e] NIFI-2943 - Peer review feedback
[9bcd495] NIFI-2943 - pkcs12 keystore improvements

1. loading pkcs12 keystores with bouncy castle everywhere
2. tls-toolkit client using jks truststore when keystore type is specified differently
3. tests

This closes #1165.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-11-16 17:13:10 -08:00
Scott Aslan 878db82375 [NIFI-2949] update remote process group port styles. This closes #1226 2016-11-16 17:08:06 -05:00
Oleg Zhurakousky f1eca0a09a NIFI-1002 added L&N entries for Bouncy Castle
This closes #1235
2016-11-16 15:30:47 -05:00
Koji Kawamura 31ea50bce9 NIFI-1002: Added WebSocket support.
- Added LICENSE and NOTICE files.
- Fixed UnitTest errors.

This closes #1231
2016-11-16 12:17:37 -05:00
Bryan Bende 2f9ec03242 NIFI-2909 Fix logic in AbstractConfiguredComponent setProperties() for setting classpath resources in the InstanceClassLoader
This closes #1232
2016-11-16 11:34:52 -05:00
Matt Gilman 49afacc3ab NIFI-3022:
- Returning the appropriate authorizable when accessing provenance events for a manual DROP event by emptying a queue.
- Populating the component details of a provenance event when the source is a connection.
2016-11-16 10:13:18 -05:00
joewitt 45a5f5295c NIFI-2374 This closes #712. updated to latest tika versions where possible, updated doc, commented why cannot update media nar 2016-11-15 23:18:55 -05:00
Andre F de Miranda 3e571f9f1f NIFI-2374 - Adjust documentation wording to clarify IdentifyMimeType
is a non exhaustive list of mime type values
2016-11-15 22:42:21 -05:00
Koji Kawamura 26a5881d21 NIFI-1002: Added WebSocket support.
NIFI-1002: Added WebSocket support.

- Reflecting review comments
- Added displayName to peroperty descriptors

NIFI-1002: Added WebSocket support.

This closes #1184

- Reflecting review comments:
  - Removed unnecessary use of NarCloseable.withComponentNarLoader.
  - Removed intermediate on memory queue to make it simpler and more
    robust. Received messages in WebSocket layer now will be transferred
to downstream relationships directly.
2016-11-15 19:34:59 -05:00
joewitt b026f0bebe NIFI-2991 removed json.org references as appropriate for build. Twitter proc no longer deployed but reference kept in notice just in case someone uses it
This closes #1230

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-15 18:09:27 -05:00
joewitt 6696529c99 Revert "NIFI-1893 Add processor for validating JSON"
This reverts commit f11682202b.

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-15 18:09:14 -05:00
joewitt 1c9077334f NIFI-2991 removed usage of json lib and components still using it
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-15 18:09:09 -05:00
Mark Payne 721964b7d8 NIFI-3036: When we replay a FlowFile, ensure that we are using the 'golden copy' of the associated Resource Claim, if the claim is still writable. Ensure that StandardResourceClaimManager retains the 'golden copy' of a Resource Claim until it is no longer writable and has a claim count of 0
This closes #1223

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-15 16:51:34 -05:00
Scott Aslan 81357d4456 [NIFI-3042] Update class name for disabled combo option. This closes #1228 2016-11-15 16:43:27 -05:00
Mark Payne 9f3bf121f9 NIFI-3040: Fixed bug where we were generating a RepositoryRecord with an 'UPDATE' type instead of a 'CREATE' time for Replay of FlowFiles. This caused FlowFile to have no attributes when restored from the FlowFile Repository.
This closes #1224
2016-11-15 16:37:51 -05:00
jpercivall 2614b83543 NIFI-3043 Fixing Kafka unit test failures 2016-11-15 16:31:10 -05:00
Bryan Bende fe59b3415c NIFI-3003 Upgrading hadoop.version to 2.7.3 and fixing TDE issue with PutHDFS, ensuring clean up of instance class loaders, and adding classpath resource property to all HDFS processors
NIFI-3003 Addressing review feedback

NIFI-3003 added minor notice updates

This closes #1219
2016-11-15 16:23:27 -05:00
Pierre Villard 45bc3e054d NIFI-2751 - Pull batch in round-robin manner - fix for / by 0 2016-11-15 16:19:00 -05:00
Scott Aslan 45bf8430fc [NIFI-2844] Update CSS styles for Cluster Summary Dialog icons and refresh button. This closes #1104 2016-11-15 11:55:42 -05:00
Scott Aslan 8f928e5d6e NIFI-2926: add policy action item to the user table and add user centric policy dialog with user policy listing table compolete with GoTo action.
This closes #1188.
2016-11-15 09:58:58 -05:00
Andy LoPresto 59fea1cb4e NIFI-2654 Enabled encryption coverage for login-identity-providers.xml.
Squashed commits:
[5dd22a9] NIFI-2654 Updated administration guide with login-identity-providers.xml flags.

Exposed master key retrieval code in NiFiPropertiesLoader.
Added logic to decrypt login identity providers XML configuration.
Updated login-identity-providers.xsd to include encryption scheme attribute.
Added unit tests. (+18 squashed commits)
Squashed commits:
[57c815f] NIFI-2654 Resolved issue where empty LIP property elements could not be encrypted.
Added unit test and resource.
[27d7309] NIFI-2654 Wired in serialization logic to write logic for LIP.
Added comprehensive unit test for LIP & NFP in same test.
[b450eb2] NIFI-2654 Finalized logic for preserving comments in LIP parsing.
[5aa6c9c] NIFI-2654 Added logic for maintaining XML formatting (comments and whitespace) for LIP.
Added unit tests (w/o encryption works; w/ does not).
[b53461f] NIFI-2654 Added unit test for full tool invocation migrating a login-identity-providers.xml file and updating file and bootstrap.conf with key.
[2d9686c] NIFI-2654 Updated tool description and various logging statements.
Added unit test for full tool invocation encrypting a login-identity-providers.xml file and updating file and bootstrap.conf with key.
[8c67cb2] NIFI-2654 Added logic to encrypt LIP XML content.
Added unit tests.
[8682d19] NIFI-2654 Added logic to handle "empty" (commented) LIP files.
Added unit tests.
[077230e] NIFI-2654 Fixed logic to decrypt multiline and multiple-per-line XML elements.
Added unit tests and resources.
[d5bb8da] NIFI-2654 Ignored unit test for unreadable conf directory because directory was causing Maven build issues.
Removed test resources.
[7e50506] NIFI-2654 Fixed AESSensitivePropertyProvider bug handling cipher text with whitespace.
Added unit test.
[b69a661] NIFI-2654 Fixed AESSensitivePropertyProviderFactoryTest to reflect absence of key causes errors.
[6f821b9] NIFI-2654 Added standard password to arbitrary encryption test for use in test resources.
[d289ffa] NIFI-2654 Added LIP XML decryption.
Added unit tests.
[a482245] NIFI-2654 Added LIP test resources.
[7204df4] NIFI-2654 Changed logic to only perform properties encryption when file path is provided.
[729e1df] NIFI-2654 Removed population of default file locations for bootstrap.conf, nifi.properties, and login-identity-providers.xml as not all files may be desired.
Added/updated unit tests.
[7dba5ef] NIFI-2654 Started LIP work (arguments & parsing).
Added unit tests.

Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #1216
2016-11-14 22:39:06 -05:00
joewitt 8ad3125168 NIFI-2380 This closes #817. corrected licensing and notice and remove conflicting mail deps 2016-11-14 21:04:33 -05:00
Andre F de Miranda a347ebf87b NIFI-2380 - Introduce ExtractTNEFAttachment - A processor to extract
attachments embedded within a Transport Neutral Encapsulation Format (TNEF) attachment (i.e. winmail.dat)
2016-11-14 21:04:12 -05:00
Andy LoPresto 4d1bcc808f
NIFI-3032 Resolved issue where multiple invocations of NiFiPropertiesLoader.withKey() used cached key.
Added unit tests and resources.

NIFI-3032 Fixed bug in AESSensitivePropertyProvider#getIdentifierKey where the result was always the max available key size, not the size of the current key.
Added unit test.

This closes #1220

Signed-off-by: Bryan Rosander <brosander@apache.org>
2016-11-14 17:50:32 -05:00
Matt Gilman ae4f27a627 NIFI-3023:
- Ensuring there are no authorization issues prior to considering the remote process group's transmitting flag.
This closes #1205
2016-11-14 16:23:36 -05:00
Matt Gilman 2c91a1a33d NIFI-3023:
- Verifying permissions prior to checking Remote Process Group transmission status.
2016-11-14 16:03:47 -05:00
Mathias Tiberghien 65b7b377e3 NIFI-1526: DefaultSchedule annotation should be use on Custom Processor to set the default scheduling strategy, scheduling period or max number of concurrent task for each instance of the processor
DefaultSettings annotation should be use on Custom Processor to set the default penalty period, the yield duration or the bulletin log level for each instance of the processor
2016-11-14 12:04:21 -05:00
Oleg Zhurakousky 41f519e84c NIFI-2851 initial commit of perf improvements on SplitText
- introduced org.apache.nifi.stream.io.util.TextLineDemarcator
- refactored SplitText to use org.apache.nifi.stream.io.util.TextLineDemarcator
- updated SplitText's capability discription to provide more clarity around splits with headers.
2016-11-11 15:45:40 -05:00
Mark Payne b73ba7f8d4 NIFI-2999: When Cluster Coordinator changes, purge any old heartbeats so that we don't disconnect a node due to very old heartbeats
This closes #1210
2016-11-11 15:13:49 -05:00
joewitt b9ef0fb847 NIFI-2818 This closes #1059. aligned read method with read/write method 2016-11-11 14:52:13 -05:00
Andre F de Miranda f32bdf7be9 NIFI-2818 - Minimise fs permission required by NiFi
1 - Replace a r/w test over $NIFI_HOME/lib that is performed
            but never utilised by a RO test
            2 - Rename ensureDirectoryExistAndCanAccess to
            ensureDirectoryExistAndCanReadAndWrite and deprecate the
            former
2016-11-11 14:49:33 -05:00
Scott Aslan 52cde9ad13 [NIFI-2898] restore ellipsis for processor type, controller servies type, and reporting task type descriptions. This closes #1191 2016-11-11 14:46:20 -05:00
Byunghwa Yun 91f0170416 NIFI-3027: ExecuteProcess supports the expression language 2016-11-11 14:41:35 -05:00
Pierre Villard 06f191ca10
NIFI-2912 Allow custom text in GenerateFlowFile
This closes #1206.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-11-11 10:18:43 -08:00
Matt Gilman 9f417a84b9 NIFI-3002:
- Removing legacy code when retrieving site to site details when the target instance is this local NiFi.
- Ensures the UI accurately reflects available remote ports.
NIFI-2603:
- Fixing color of remote output port status in connection label.

This closes #1189.
2016-11-11 10:06:41 -05:00
Scott Aslan 4957b628fb [NIFI-3021] remove white-space:no-wrap on view configuration properties tables textareas
This closes #1204.
2016-11-10 22:12:08 +01:00
Matt Gilman f83863ebae NIFI-3009:
- Fixing NaN error when backpressure is not configured.
This closes #1200
2016-11-10 11:39:08 -05:00
Scott Aslan b426de1793 [NIFI-3012] update regex for the summary tables input, output, transferred, received, and sent column parse function. This closes #1197 2016-11-10 09:25:08 -05:00
Matt Burgess 435d9cf353 NIFI-2991 This closes #1194. Exclude org.json dependency from Hive bundle 2016-11-10 08:33:43 -05:00
João Henrique Ferreira de Freitas 1b5a28d130 NIFI-3013 GetSNMP fix stop and start null pointer exception
This closes #1195.
2016-11-10 13:30:16 +01:00
Mark Payne c441a8696d NIFI-2850 This closes #1115. Added a migrate() method to ProcessSession and refactored BinFiles and MergeContent to use it 2016-11-09 16:25:03 -05:00
Jeff Storck cc2fbcaac4 NIFI-3008 Enabled expression language on BASE_DIRECTORY and FILENAME properties in TailFile
This closes #1190
2016-11-09 12:11:11 -05:00
joewitt 3e892c55ec NIFI-2971 This closes #1172. addressed RPM bundled deps and handling exception for bootstrap cl construction 2016-11-09 11:08:43 -05:00
Matt Gilman bff89f17b3 NIFI-401: - Minor tweaks to PR #1117. - Ensuring existing configuraiton is retained and shown until the user explicits changes it. - Retaining, but disabling, deprecated options.
This closes #1185
This closes #1117
This closes #512

Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-08 17:06:43 -05:00
Brian Eugley 7eca2037bd NIFI-401
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-08 17:06:36 -05:00
patricker 4b4e099f2e NIFI-2764
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2764: Updated call to convertToAvroStream in TestJdbcCommon

This closes #1009
2016-11-08 14:45:49 -05:00
Matt Burgess 63bda32a8b NIFI-2998: Add validator to Avro Record Name in InferAvroSchema
This closes #1187
2016-11-08 14:14:40 -05:00
Bryan Bende 78020825e9 NIFI-2841 Refactoring logic in SplitAvro RecordSplitter to avoid making two calls in a row to reader.hasNext()
This closes #1088
2016-11-08 13:50:42 -05:00
Bryan Bende d1d053725b NIFI-2909 Adding per-instance class loading capability through @RequiresInstanceClassLoading annotation
NIFI-1712 Applying per-instance class loading to HBaseClientService to allow specifying Phoenix Client JAR

-Refactoring the ClassLoading so that every processor, controller service, and reporting task gets an InstanceClassLoader with a parent of the NAR ClassLoader, and only components with @RequiresInstanceClassLoading will make a copy of the NAR ClassLoader resources, and addressing some review feedback

This closes #1156
2016-11-08 13:21:27 -05:00
Matt Gilman 2f0d9a34f1 NIFI-2982:
- Updating the labels in the Add Users/Groups to the Policy dialog..

This closes #1178.
2016-11-08 16:55:27 +01:00
Matt Gilman 9d3fe3f03e NIFI-2989:
- Updating the content of the delete policy dialog to make it a little more clear that the permissions for the component will revert back to the inherit policy.

This closes #1183.
2016-11-08 14:58:11 +01:00
Matt Gilman aa8ba0bd1c NIFI-2965:
- Ensuring the selection is cleared when going to the Process Group where the selected component policy is defined.
- Ensure that the selection context is updated when going to a component or group.

This closes #1174.
2016-11-08 14:49:12 +01:00
Oleg Zhurakousky 5fd4a55791 NIFI-2778 added abilty to interrupt Lucene search
polishing

This closes #1138
2016-11-07 16:28:16 -05:00
Pierre Villard 6aefc0b910 NIFI-2751 NIFI-2848 Get batch of flow files in a round-robin manner
This closes #1111
2016-11-07 14:01:18 -05:00
Oleg Zhurakousky c13cfa6ea6 NIFI-1322 fixed breaking changes introduced in previous commit
This closes #1181
2016-11-04 08:23:10 -04:00
Pierre Villard a7d06412f8 NIFI-1322 - PutHDFS - allow file append resolution 2016-11-04 08:23:10 -04:00
James Wing 50010fb340 NIFI-2948 Fix DynamoDB Cached Credentials
This closes #1182
2016-11-04 07:04:25 -04:00
Matt Burgess 0841f14c18
NIFI-2928: Fixed checkstyle violation in FetchFile
This closes #1180

Signed-off-by: Bryan Rosander <brosander@apache.org>
2016-11-03 14:46:10 -04:00
Oleg Zhurakousky ed035f85e3 NIFI-2928 added support to validate accessibility of the file system
NIFI-2928 polishing

This closes #1160
2016-11-03 12:25:31 -04:00
James Wing a486fefb1e NIFI-2115 Detailed Version Info in About Box
* Java version and vendor
* OS name and version
* Release Tag
* Build revision (commit SHA), branch, and timestamp
* Handles formal releases, ad-hoc builds, and non-release source builds
* Standalone UI presence in About dialog, Summary -> System Diagnostics
* Cluster UI as Versions tab in Cluster dialog
* Reduce About Dialog Content
* Fix Missing Property Display Bugs
* Marking the build time as type string.
* This closes #583
2016-11-03 11:16:20 -04:00
Matt Gilman edb0ebe52b
NIFI-2931: - Using the delete button state (which correctly checks if a policy is inherited) to drive the presence of the remove user button.
This closes #1153.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-11-03 09:47:26 -04:00
Matt Burgess 9e44734042 NIFI-2980: Fixed doc for Elasticsearch URL property in ElasticsearchHttp processors
This closes #1173
2016-11-02 16:18:30 -04:00
Pierre Villard 1abd017c35 NIFI-2963 FetchHDFS should support Compression Codec property
This closes #1166
2016-11-02 16:15:09 -04:00
Joe N b5550ffcf5 NIFI-2834 Better Configs for Fetch and Timeout
NIFI-2834 Better Configs for Fetch and Timeout

NIFI-2834 Better Configs for Fetch and Timeout

NIFI-2834 ofSec to of Mils

This closes #1167
2016-11-02 16:10:37 -04:00
Scott Aslan 769530beae [NIFI-2603] applying color to highlight status changes
- Updating the colors of the target port status and ensuring that when one no longer exists it reports that it is not running.
- This closes #1171
2016-11-02 15:15:29 -04:00
Peter Wicks 60423f05b5 NIFI-2603
- Gui Icons
- Gui Icons - Fixing Orange Color
- Gui Icons - Fixing misc. colors
- Gui Icons - Summary page + spinner
- Gui Icons - Summary page again
2016-11-02 14:11:56 -04:00
patricker 2fb3b01ebe NIFI-2918 JDBC getColumnName may return empty string
This closes #1149
2016-11-02 13:13:34 -04:00
Matt Burgess 892c74dff2 NIFI-2819: Added support for Expresssion Language in ModifyBytes
This closes #1130
2016-11-02 13:02:25 -04:00
Scott Aslan 05ea76dd6f [NIFI-2888] Display processor fill color when zoomed in/out. This closes #1151. 2016-11-02 12:54:58 -04:00
Andrew Lim 5f9cae97b7 NIFI-2883 Renamed directories holding ConsumeKafka_0_10 and PublishKafka_0_10 additional details
This closes #1170
2016-11-02 12:29:09 -04:00
Pierre Villard 7fbc23639a NIFI-2956 - GetHDFS - fixed directly path evaluation 2016-11-02 12:15:26 -04:00
simplesteph 56da2b51e1 [NIFI-2900] transformed all datetime fields to string as they don't comply with ISO norms. This closes #1136. 2016-11-02 09:39:48 -04:00
Mark Payne e1f0ba5a43
NIFI-2925: When swapping in FlowFiles, do not assume that its Resource Claim is 'in use' but instead look up the canonical representation of the resource claim
This closes #1150.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-10-31 09:59:06 -04:00
Oleg Zhurakousky 7fd2c42b19 NIFI-2879,NIFI-2880 This closes #1120. fixed NarThreadContextClassLoader instantiation error handling 2016-10-28 12:15:12 -04:00
Koji Kawamura 9e90aae066 NIFI-2936: Fix TestExecuteProcess error on Travis.
This closes #1162.
2016-10-28 10:35:37 +02:00
Matt Gilman 8dc60c72d4
NIFI-2884: - Adding support to selecting multiple users before updating a policy.
NIFI-2533: - Only including a user/group in the search results if they are not currently selected.
NIFI-2286: - Providing a tooltip for the add user and remove policy button.

This closes #1155.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-10-27 11:50:46 -04:00
jpercivall 1d74b5d3ce NIFI-2791 Adding 'math' expression language function
This closes #1157.
2016-10-25 19:45:38 +02:00
Michal Klempa 368ea7a2d2 NIFI-1069 Removing the exit directive
This closes #1159

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-10-25 12:44:19 -04:00
jpercivall e4a3e09643 NIFI-1662 Adding proper UI regex support for decimals in EL
This closes #1018
2016-10-24 10:31:16 -04:00
Andre F de Miranda 9b08f23b24
NIFI-1531 - Remove bogus .gitignore files from sub directories
This closes #1154.

Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-10-23 10:29:09 -04:00
Scott Aslan 6676e94a7c [NIFI-2929] remove canvas element names when zoomed out and view permissions are removed. This closes #1152 2016-10-21 16:11:27 -04:00
Andre F de Miranda b864d49f66 NIFI-2341 - Introduce ParseCEF processor
This closes #785
2016-10-20 17:16:57 -04:00
Matt Burgess f5f132b1ab NIFI-2828: Fixed issue with transitive Hadoop dependencies in Hive NAR
This closes #1146
2016-10-20 14:56:01 -04:00
Matt Gilman af27e4070b NIFI-2843: - Removing the View Configuration menu item from the context menu on Process Groups.
This closes #1087

Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-10-20 12:45:37 -04:00
Michal Klempa 99d3c39748 NIFI-1069 - improve init script exit codes so that results are LSB compliant
This closes: #1093

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2016-10-20 23:12:23 +11:00
Oleg Zhurakousky 611cadd231
NIFI-2919 Improved GetFile processor to fail (and provide bulletins) if target directory is inaccessible.
This closes #1147.

Signed-off-by: Andy LoPresto <alopresto@apache.org>

Fixed typos in error messages, renamed variables in test, and cleaned up unnecessary imports. (+1 squashed commit)
Squashed commits:
[e755cbd] NIFI-2919 improved GetFile to fail if target directory is inaccessible
2016-10-19 16:33:33 -04:00
Scott Aslan a8e1c775fd [NIFI-1459] add css translate3d to properties table editors in order to move the element along the z-axis of the 3D space and allow the scrollbars to properly be poistioned. This closes #1070 2016-10-19 15:39:58 -04:00
Andre F de Miranda 3914141c45
NIFI-1710 - Resolve path name to nifi.sh script
This closes #1137.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-10-18 16:43:03 -07:00
Koji Kawamura 27dba60f27
NIFI-2905: Log error stream of ExecuteProcess cmd
ExecuteProcess ignores error stream when Redirect Error Stream is
false, this commit let it to be logged instead so that user can see it on
bulletin.

This closes #1143.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-10-18 15:56:27 -07:00
Scott Aslan f287bc9119
[NIFI-2913] update z-index of codemirror resize handle to match the z-index of the codemirror vert. and horz. scrollbars
This closes #1145.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-10-18 15:24:18 -07:00
Oleg Zhurakousky 5afbc43364 NIFI-2500 This closes #1131. made container queue configurable 2016-10-18 14:47:49 -04:00
Scott Aslan 9fb3039416 [NIFI-2898] Add Processor dialog processor descriptions now scrollable
This closes #1134.
2016-10-17 23:07:39 +02:00
James Wing b9a940bbd1 NIFI-2902 Fix for S3 Signer v4 Override
This closes #1140.
2016-10-17 22:51:45 +02:00
Oleg Zhurakousky c883f98cbf NIFI-2906 removed unused memebr variables
This closes #1144.
2016-10-17 22:32:23 +02:00
Matt Burgess 596b98865b NIFI-2894: Fixed typo in PutSQL documentation
This closes #1129
2016-10-14 12:45:34 -04:00
Matt Burgess b52b839895 NIFI-2897: Fixed SelectHiveQL for CSV output of complex types
This closes #1132
2016-10-14 12:35:38 -04:00
Michal Klempa 88d125137e NIFI-2199 - allows nifi.sh restart through ssh
Closes: #1092

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2016-10-15 00:48:04 +11:00
d810146 e969a5ffe3 NIFI-2873: Nifi throws UnknownHostException with HA NameNode
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2873: Changed test hive-site.xml to use local FS, fixed Checkstyle violations

This closes #1113
2016-10-14 09:23:19 -04:00
Edgardo 7107616420 NIFI-2872 Create PutCloudWatchMetric Processor
This closes #1125.

Signed-off-by: James Wing <jvwing@gmail.com>
2016-10-13 19:53:53 -07:00
Stephane Maarek 33ba1a822e
NIFI-2899 Updated swagger-maven-plugin to 3.0.1
Incorporates the fix from https://github.com/kongchen/swagger-maven-plugin/issues/141
Ensures the new swagger.json is spec 2.0 compliant, see https://github.com/swagger-api/swagger-codegen/issues/3976

This closes #1135.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-10-13 17:21:11 -07:00
Pierre Villard 26f46538b3 NIFI-766:
- Improved connection UI display when backpressure is enabled
- Updating the connection label to include backpressure indicators for object count and data size thresholds.
- Coloring the connection path and drop shadow once backpressure is engaged.
- Fixing bug with expiration icon tooltip.
- Including columns in the summary table for backpressure.
- Updating empty queue action to reload the connection status upon completion to ensure an updated count.

This closes #1080.
2016-10-13 12:14:16 -04:00
Koji Kawamura c470fae065 NIFI-2863: S2S to allow cluster URL more leniently. This closes #1122
- Consolidated the target cluster URL resolving logic into
  SiteToSiteRestApiClient's as a common method
- Changed to more descriptive error message
- Added more unit test cases
2016-10-13 09:50:50 -04:00
Keren Tseytlin 6dc2f14198 NIFI-2799 AWS Assume Role Credentials With Proxy
This closes #1112.

Signed-off-by: James Wing <jvwing@gmail.com>
2016-10-12 17:19:13 -07:00
Andrew Lim 979b4d8ab9
NIFI-2801 Edited Kafka processor documentation to explicitly state which Kafka versions supported by each processor
This closes #1119.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-10-12 10:35:45 -07:00
Peter Mitchell 893fed794c Add Stateful annotation to scripting processors
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2682: Added text to Stateful description for AbstractScriptProcessor
2016-10-12 13:20:37 -04:00
Matt Gilman a25b651da9
NIFI-2837: - Immediately hiding the template dialog after clicking the Upload button to prevent an accidental re-submission.
This closes #1086.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-10-12 09:18:58 -04:00
mans2singh af27179322 Nifi-1540 - AWS Kinesis Streams put processor
This closes #239.

Signed-off-by: James Wing <jvwing@gmail.com>
2016-10-11 20:21:29 -07:00
Joey Frazee 6d5f4777c5 Fixed HL7 segment index bug for order control codes, more testing
Signed-off-by: Matt Burgess <mattyb149@apache.org>

Added NOTICE entries for test data and fixed checkstyle violations

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #1123
2016-10-11 14:57:40 -04:00
Oleg Zhurakousky ee14ae8af0 NIFI-2774 added configurable QoS options to ConsumeJMS
Signed-off-by: Mike Moser <mosermw@apache.org>

This closes #1036.
2016-10-11 10:32:00 -04:00
Matt Gilman 4a4c87fa15
NIFI-2849:
- Showing process group name when possible.
- Providing a link to jump to the process group defined in the effective policy.
- Preventing editing an inherited policy.
- When overriding a policy, allowing the user to indicate if the policy should be empty or should copy the user/groups of the inherited policy.

This closes #1090.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-10-11 00:06:09 -07:00
Koji Kawamura 540ef63efa NIFI-2855: Site-to-Site with port forwarding.
- Added following properties:
  - nifi.web.http.port.forwarding
  - nifi.web.https.port.forwarding

This closes #1100.

Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-10-07 15:00:37 +09:00
Mark Payne 09568d092b NIFI-2836:
- Ensure that we wait until a request is completed before unlocking the lock for request replication
- Ensure that failures do not trigger request completion logic unless the failure is the last node to report its status
- This closes #1109
2016-10-06 16:41:05 -04:00
Matt Gilman bb6c5d9d4e NIFI-2777:
NIFI-2856:
- Only performing response merging when the node is the cluster cooridinator even if there is a single response.
- Fixing PropertyDescriptor merging to ensure the 'choosen' descriptor is included in map of all responses.

This closes #1095.
2016-10-06 16:19:19 -04:00
Mark Payne b9cb6b1b47
NIFI-2865: Refactored PublishKafka and PublishKafka_0_10 to allow batching of FlowFiles within a single publish and to let messages timeout if not acknowledged
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-10-06 15:51:16 -04:00
Bryan Bende a4ed622152
Revert "NIFI-2865: Refactored PublishKafka and PublishKafka_0_10 to allow batching of FlowFiles within a single publish and to let messages timeout if not acknowledged"
This reverts commit 92cca96d49.
2016-10-06 15:19:00 -04:00
Andrew Lim 53f7a21663 NIFI-2691 Replaced references to kerberos/spegno principle with principal in nifi.properties and admin guide
This closes: #1105

Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2016-10-07 01:22:49 +11:00
Mark Payne 92cca96d49
NIFI-2865: Refactored PublishKafka and PublishKafka_0_10 to allow batching of FlowFiles within a single publish and to let messages timeout if not acknowledged
This closes #1097.

Signed-off-by: Bryan Bende <bbende@apache.org>
2016-10-06 10:05:51 -04:00