675f4f544c
NIFI-1458: Added ScriptedReportingTask
...
This closes #1045 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-01-06 11:56:19 -08:00
31ec01b5f9
NIFI-3004 Added failing unit test to SSLContextServiceTest to demonstrate that customValidate caches result from previous validation.
...
NIFI-3004 Added logic to expire StandardSSLContextService customValidate cache after 5 invocations.
Updated unit test to demonstrate this logic.
This closes #1375 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-01-05 17:32:11 -08:00
970c46ccfe
NIFI-3004 Improved StandardSSLContextService customValidate
...
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-01-05 17:32:01 -08:00
3259b01f8e
NIFI-3230 fix ActiveMQ SSL support for simple connect URIs in Get/Put JMS processors
...
This closes #1344 .
2017-01-05 22:19:25 +01:00
474df053d6
NIFI-3276 - FileSystemRepository.getPath() only check exists if necessary
...
This closes #1388 .
2017-01-05 21:44:59 +01:00
273e69f2cb
NIFI-3274 Adding WriteAheadLog configuration options to WriteAheadLogLocalStateProvider
...
This closes #1386 .
2017-01-05 19:59:58 +01:00
ac42178e9b
NIFI-3283 Fixing typo in UpdateAttribute error message
...
This closes #1396 .
2017-01-05 18:51:40 +01:00
64bb55ef3c
NIFI-2839 Add a confirmation dialog when deleting a Controller Service or Reporting Task. This closes #1384
2017-01-05 09:07:35 -05:00
083d4043e0
NIFI-2840:
...
- Sorting the templates to ensure that the newest templates are listed first.
This closes #1391 .
2017-01-04 19:24:37 +01:00
b1c9f0e764
NIFI-2695: - Providing more granular and meaningful authorization error messages.
...
This closes #1309 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-01-04 13:06:19 -05:00
2c0f1c348e
NIFI-3259 - Process group level option in Ambari reporting task
...
This closes #1360 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-01-03 16:18:53 -05:00
9b47961d1c
NIFI-3231 Added EL support to hostname and port in PutTCP/UDP
...
This closes #1361 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-01-03 12:09:19 -05:00
1b4729e448
NIFI-3240 - AttributesToJson performance improvements
...
This closes #1352 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2017-01-03 10:20:16 -05:00
be6bcf20ad
NIFI-2944 Check remote input hostname at startup.
...
Added unit test cases.
This closes #1379 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-01-02 20:25:03 -08:00
67cbef5df3
NIFI-2917: disable canvas refresh after ajax error and allow page refresh
...
This closes #1351 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2017-01-02 16:32:05 -08:00
55f4716f3d
NIFI-3266 Added EL support for basePath and port in ListenHTTP
...
This closes #1373 .
2016-12-30 16:35:46 +01:00
0d14db72f5
NIFI-3247:
...
- Removing unnecessary authorization check during second phase of connection creation.
- Ensuring that the remote group port returns the correct resource type though not super critical since it is not possible to create policies for remote ports.
This closes #1353 .
2016-12-30 16:05:06 +01:00
8acbe9aa3f
NIFI-1582 Fixing how failures with state are handled and improving flowfile handling
...
This closes #1371
Signed-off-by: Bryan Rosander <brosander@apache.org>
2016-12-29 15:49:52 -05:00
4986b83b83
NIFI-3164 Added NAR loading duration
...
This closes #1366 .
Signed-off-by: James Wing <jvwing@gmail.com>
2016-12-29 10:29:03 -08:00
5c095f3a18
NIFI-3164 Added message at startup to log NAR loading
...
This closes #1365 .
Signed-off-by: James Wing <jvwing@gmail.com>
2016-12-28 14:10:30 -08:00
35e8bedcc8
NIFI-3249 - UpdateAttribute performance improvements
...
This closes #1356
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-12-28 14:54:05 -05:00
16898668c2
NIFI-3228 added s3.contenttype in PutS3Object
...
Signed-off-by: James Wing <jvwing@gmail.com>
This closes #1362 .
2016-12-28 10:54:21 -08:00
2ea8b4122b
NIFI-3127: Fixing NPE for empty flow files in SplitText
...
This closes #1358 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-12-28 11:21:44 +09:00
2f3017638f
NIFI-3239:
...
- Indicating components are not restricted when appropriate.
- Updating unit tests.
This closes #1350 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-12-27 13:06:07 -05:00
978f483ba8
NIFI-3250 Fixing logic in StandardFlowFileQueue when migrating flow files to the active queue
...
This closes #3250 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-12-27 12:52:01 -05:00
af8ed8b7de
NIFI-3253: Correcting documentation in Notify processor
...
This closes #1359 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-12-27 12:19:08 -05:00
6c5d4084d5
NIFI-3207: Fixed Template upload import URI
...
- Fixing the importUri when replicating a Template upload request. Previously was leveraging getResourceUri which considers proxy headers meant for client responses.
This closes #1334 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-12-27 15:44:25 +09:00
6ca25e10ef
NIFI-3220 Add support for basic auth to Solr processors
...
This closes #1338 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-12-26 15:41:24 +09:00
5ea17d30c5
[NIFI-96] add align horizontal and align vertical capability to components on the canvas. This closes #1354
2016-12-22 16:47:34 -05:00
e65aad8fe6
NIFI-2994: - Setting the default position for remote process groups.
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #1303
2016-12-22 14:39:56 -05:00
acc9e0b45c
NIFI-2967:
...
- Disabling the Add button in the new Processor, Controller Service, and Reporting Task dialog when no components match the filter.
This closes #1340
2016-12-22 11:52:20 -05:00
908e7d3131
NIFI-2585: Add attributes to track s2s host and port
...
- Removed host and port field from Peer since the same information is
available in PeerDescription
- Refactored variable names in SocketRemoteSiteListener to improve readability
- Changed how SocketRemoteSiteListener constructs PeerDescription
instance. It used to use hard-coded 'localhost' as hostname, and
getPort() which returns server's port. Since the peer is a remote peer,
i.e the client, it should be client hostname and port.
- Added hostname resolution at DataTransferResource to make s2s.host
value consistent with RAW transport. Without this, RAW uses hostname
while HTTP uses IP address. It will be hard to be used from downstream flows.
- Replaced heavy use of mockito which was difficult to maintain, with
nifi-mock
- Added SiteToSiteAttributes and more assertions in unit tests
This closes #1342 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-12-22 11:00:00 -05:00
f7d761a28a
NIFI-2585 Moving attributes into loop in AbstractFlowFileServerProtocol, and also updating StandardRemoteGroupPort to apply the same attributes when doing a pull-based site-to-site.
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-12-22 10:59:56 -05:00
28e5d85493
NIFI-2585: Add attributes to track where a flow file came from when receiving over site-to-site
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-12-22 10:59:55 -05:00
44c9ea0a66
NIFI-3236 - SplitJson performance improvements
...
This closes #1347 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-12-22 15:22:53 +09:00
4285157675
NIFI-3235 - EvaluateJsonPath performance improvements
...
This closes #1346 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-12-21 16:29:23 -05:00
721c9ee7f0
NIFI-3167: - Ensuring the DELETE button is visible for cluster nodes. - Removing unecessary wrapper element and non breaking spaces.
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #1319
2016-12-21 12:02:44 -05:00
3b91635398
NIFI-3194: Fixed error handling in PutElasticsearchHttp
...
Thise closes #1327
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-12-19 14:51:41 -05:00
aef17f9a8b
[NIFI-3170] remove action details if user does not have read perms, also update action details styles to match other dialogs. This closes #1322
2016-12-19 10:07:15 -05:00
34627f78b7
NIFI-190: Initial commit of Wait and Notify processors
...
This closes #1329 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-12-16 10:29:16 -05:00
9a5986b0f6
NIFI-3175 Fix a bug in the ValidateCSV processor to handle empty CSV columns
...
This closes #1311 .
2016-12-15 22:43:15 +01:00
ab2d07aa5a
NIFI-3186: Fixed NPE that was overlooked
...
This closes #1317 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-12-15 12:56:23 -05:00
5776c4b1f9
NIFI-3173: When a template is created with multiple components in different groups all referencing the same controller service, ensure that controller service is added to the template at a high enough level that all components needing hte service can access it.
...
- Ensure that controller services are added to child process groups when creating snippet
- Addressed issue related to modifying higher-level process groups' controller services in snippet after having already visited the process group
This closes #1318
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-12-14 14:10:59 -05:00
0f462a7c49
NIFI-3029: QueryDatabaseTable supports max fragments property
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1213
2016-12-14 10:51:27 -05:00
266bd80bde
NIFI-3192 Adding a check if the FlowFile is null to UpdateAttribute
...
This closes #1325
2016-12-13 11:30:24 -05:00
868795cdaa
[NIFI-3159] Add ellipsis to long PG name in access policies shell. This closes #1310
2016-12-13 09:41:31 -05:00
45e4514a40
[NIFI-3160] reload canvas when updating PG name of current PG. This closes #1315
2016-12-12 11:45:10 -05:00
2c84b44f54
[NIFI-3154] display ellipsis when text is sufficiently long in connection details and connection configuration dialogs. This closes #1305
2016-12-08 12:52:01 -05:00
d15bd0c00c
NIFI-3165: Update RPG revision when RPGPort is updated. This closes #1308
2016-12-08 08:34:07 -05:00
9ce0af22af
NIFI-3138 - Adding urls, transport, proxy settings to rpg portion of flow config xsd
...
This closes #1304 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-12-08 14:37:07 +09:00
6b82e25c74
[NIFI-3106] updating hover text for remove counter icon. This closes #1299
2016-12-07 16:42:19 -05:00
e36b37692c
NIFI-1582 added state to UpdateAttribute as well as updated a few parts that hadn't be touched in years (referenced the 'FlowFileMetadataEnhancer' processor'. Also added a 'NUMBER_VALIDATOR' to StandardValidators
...
NIFI-1582 removing the option to use cluster state
NIFI-1582 addressing Oleg's comments
NIFI-1582 No longer forcing numbers as the init value and adding getStateValue() to EL instead of using 'ATTRIBUTE_state'
NIFI-1582 Removing init state value
NIFI-1582 Adding documentation for the changes to Init State value
This closes #319
2016-12-06 16:52:02 -05:00
97d2d30423
NIFI-3131 - Qualifying nifi-env in nifi bat scripts, removing popd from toolkit bat scripts
...
This closes #1293
Signed-off-by: Bryan Rosander <brosander@apache.org>
2016-12-05 23:03:41 -05:00
d1f2492dec
NIFI-3132 - Using cygpath and quoting paths correctly in sh scripts when run in cygwin
...
This closes #1292
Signed-off-by: Bryan Rosander <brosander@apache.org>
2016-12-05 22:16:24 -05:00
2d6bba080f
NIFI-3133: - Ensuring that Remote Group Ports are always authorized according to their Remote Process Group.
...
NIFI-3133:
- Using getSourceAuthorizable() when accessing flow files and content.
NIFI-3133:
- Decouple local and remote connectable's to avoid ambiguity with self referencing RPGs.
NIFI-3133:
- Addressing comments from the PR.
NIFI-3133:
- Fixed check verifying source/destination when creating a connection.
NIFI-3133:
- Only showing the go to link when the source component is not a remote port.
NIFI-3133:
- Removing unnecessary checking of remote group port authorization since it's handled by the parent RPG.
NIFI-3133:
- Fixing issue showing the connection details dialog when the source component is a RPG.
NIFI-3133:
- Ensuring the local connectable was found.
This closes #1297
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-12-05 19:45:45 -05:00
fc0d336f36
NIFI-3152: Ensure that we always close the IndexWriter when appropriate in SimpleIndexManager, even if an IOException is thrown when trying to commit the IndexWriter
...
This closes #1300 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-12-05 16:07:54 -05:00
7633fe35c1
NIFI-3149 Adding proper literal support for number operators ('-' and '+') to ANTLR parser and UI highlighting
...
This closes #1298
2016-12-05 13:34:54 -05:00
2b6d6c25d8
NIFI-2866 The Initial Max Value of QueryDatabaseTable won't be case-sensitive
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1212
2016-12-05 12:50:43 -05:00
8f8b8cdf46
NIFI-3071: Deprecated InputStreams & OutputStream sin org.apache.nifi.stream.io package in favor of using their Java counterparts
2016-12-05 09:29:19 -05:00
c5ef076786
NIFI-2325:
...
- Adding support for LDAPS.
This closes #1275 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-12-02 12:41:03 -08:00
316cae16d3
NIFI-3140: Restored optional type handling in FetchElasticsearchHttp
...
This closes #1288
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-12-02 14:10:52 -05:00
7c5bd876bd
NIFI-3026: Support multiple remote target URLs
...
- Added urls in addition to the existing url, to support multiple target
URLs
- Backward compatibility is provided by returning the first url if
multipe urls are specified, but component accessing the url doesn't
support multiple urls
- UI is not fully updated yet. Following UI components are planned to be updated
by different commits
- Search component: only the first URL is searchable and shown
- Component status: RPG status shows only the first URL
- Component action history: only the first URL is searchable and shown
- Updated Search component to use URLs.
This closes #1208 .
2016-12-02 14:01:39 -05:00
d8d29811f5
NIFI-3135: - Authorizing restricted components on snippet usage.
...
- Updating REST API docs accordingly.
- Adding some integration tests to exercise the additional restricted component checks.
This closes #1287 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-12-02 12:55:23 -05:00
69b23adf1b
NIFI-3095: Add EL support to Elasticsearch 2.x (and HTTP) processors
...
This closes #1276
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-12-02 11:16:23 -05:00
8da38acf31
NIFI-3141: Fixed TailFile ArrayIndexOutOfBounds.
...
- Added unit test cases to simulate NiFi version update which fails without this fix.
- Added state object migration code, add file.0. prefix to state keys,
and add length from stored position.
This closes #1289
2016-12-02 07:53:04 -05:00
0297352350
NIFI-2017 Fixing failing test PermissionBasedStatusMergerSpec.groovy introduced in previous commit
2016-12-01 14:02:05 -05:00
02f02b245a
NIFI-2017: Fixed typo in nf-port.js that was referencing the wrong variable name to determine whether or not a port is transmitting
...
Fixed merging logic for root group status. Only consider a port transmitting when there is an active request, not when there is a 'queued' request
This closes #1279
2016-11-30 14:51:28 -05:00
1f40f298c0
NIFI-3130: - Loading the temporary instance from the correct type of component.
...
This closes #1285 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-11-30 14:13:43 -05:00
fff0148a0e
NIFI-3129: When adding controller services to a snippet, ensure that we don't add the service multiple times, even when it's referenced by child process groups. This closes #1284
2016-11-30 13:07:51 -05:00
ba513447d7
NIFI-3076: Fixed handling of 'medium' unsigned integers in JdbcCommon
...
This closes #1254 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-11-30 13:05:38 -05:00
bc223fa197
NIFI-3117: - Checking referenced services when performing an action with a snippet that requires it.
...
- Updating the SnippetManager to automatically expire unused snippets.
- Making the checking of referenced services consistent across component removal.
- Adding checking of referenced services for all nested components in a snippet.
- Updating the REST API docs to clarify when a referenced service is authorized.
- Conditionally authorizing transitive service references.
This closes #1277 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-11-30 12:50:25 -05:00
e3c7611347
NIFI-3112 Revert "NIFI-2199 - allows nifi.sh restart through ssh"
...
This reverts commit 88d125137ecloses #1282 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-11-29 17:32:47 -08:00
9d6ca6e1e6
NIFI-2975: Only start expiring FlowFiles after FlowFile Repository has been restored
...
This closes #1274 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-11-29 09:54:15 -05:00
92f17a995b
NIFI-3100-rc2 prepare for next development iteration
2016-11-25 23:49:27 -05:00
5536f690a8
NIFI-3100-rc2 prepare release nifi-1.1.0-RC2
2016-11-25 23:49:13 -05:00
617b62ac7a
NIFI-3104 This closes #1273 . Removed tests derived from HAPI test data
2016-11-25 19:39:36 -05:00
f4f60c3610
NIFI-3103: This closes #1272 . Exclude localhost.cert from RAT check.
2016-11-25 19:33:48 -05:00
2c3714536f
NIFI-3024 Added key migration for sensitive processor properties contained in flow.xml.gz. (nifi.sensitive.props.key)
...
This closes #1261 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-11-23 13:26:18 -08:00
7ff14f7191
NIFI-3091: Ensure that we set the appropriate size on FlowFiles when modifying them
...
This closes #1267
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-23 12:07:44 -05:00
91ff810dba
NIFI-3088: Ensure that on recovery of FlowFile Repository, if we find a FlowFile that maps to an unknown queue that we log a warning that the queue is missing and drop the FlowFile, rather than throwing an NPE
...
This closes #1266
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-23 11:27:14 -05:00
22143e386d
NIFI-2991 This closes #1265 . was allowed to restore twitter4j json.org usage until April. Resolution for that will be in NIFI-3089
2016-11-23 10:21:41 -05:00
7fc7494b21
NIFI-3087: This closes #1263 . Added unit tests to PutElasticsearch(Http) to illustrate issue
2016-11-23 08:22:34 -05:00
d3dbac50a8
NIFI-3087: Fixed issue with partial failure responses in PutElasticsearch(Http)
2016-11-23 08:11:49 -05:00
066accc274
NIFI-3086 Updated TailFile.java to deal with windows paths that were breaking the regex parsing Fixed documentation misspelling in TailFile.java Fixed assertions in several tests in TestTailFile that were dependent on the received order of flowfiles, this was differing between Windows and MacOS/Linux
...
This closes #1264
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-23 00:01:12 -05:00
50667ed222
NIFI-3084 Fixing TestPersistentProvenanceRepository and closing a stream leak in RecordReaders.
...
This closes #1260 .
2016-11-22 17:31:47 -05:00
913ae91614
Added posix guard to ignore tests on windows
...
This closes #1259
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-22 17:11:25 -05:00
78fed3ed56
NIFI-3068 Adding @RequiresInstanceClassLoading to PutHDFS to ensure the security configuration of the Hadoop client is fully isolated between instances of PutHDFS
2016-11-22 16:41:44 -05:00
36796b5440
NIFI-3078: Test InvokeScriptedProcessor with JS.
...
This closes #1255 .
2016-11-22 21:42:36 +01:00
fa5fed9bb5
NIFI-3082: Fixed status code handling in PutElasticsearchHttp
...
This closes #1258 .
2016-11-22 21:32:03 +01:00
9e884f6120
NiFI-3064 Convert to Avro fails when a MySQL query returns two columns with the same name even with different aliases
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1251
2016-11-22 11:49:25 -05:00
aa99cc6822
NIFI-3079: Ensure that in all cases we increment session's bytesRead count when finished reading from Content Repo
...
This closes #3079 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-11-22 11:26:22 -05:00
ead9205458
[NIFI-3075] remove fixed width from combo options and add max-width css style to display ellipsis when options text is too long. This closes #1253
2016-11-21 17:27:03 -05:00
15af764dd8
NIFI-2996
...
- validate processors only when they are in STOPPED state
- report validation errors via REST API on processors/services/tasks/ports only when they are in the STOPPED state
- This closes #1192
2016-11-21 17:02:25 -05:00
fb9cbccc38
NIFI-2954 This closes #1244 . Moved StandardPropertyValidator to nifi-utils, documented scope/purpose of a few util libs, removed deps from nifi-utils.
2016-11-21 16:30:42 -05:00
dba9d5924a
NIFI-3011: Added Elasticsearch5 processors
...
This closes #1233
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-21 15:58:40 -05:00
7f5eabd603
NIFI-3050: Implemented access control logic for restricted components.
...
- Addressing comments from PR.
- Adding restricted tags to relevant components.
- Showing a restricted icon overlay on the processor node on the canvas. (+1 squashed commit)
Squashed commits:
[f487682closes #1247 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-11-21 12:07:48 -08:00
eb5abf809d
NIFI-2927: Added Validation Query to HiveConnectionPool
...
This closes #1252 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-11-21 14:21:22 -05:00
d65f46f7a5
NIFI-2750
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2750
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2750 Tweaking Property Retrieval
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1001
2016-11-21 12:58:17 -05:00
2ee66de1a6
NIFI-3066: Create unit test to reproduce bug that results in IllegalArgumentException: Cannot migrate FlowFiles from a Process Session to itself
...
NIFI-3066: Ensure that when a Bin is created, it is always created with its own new session
This closes #1245
2016-11-21 11:34:14 -05:00
e731f09573
NIFI-3061: Bumped azure-eventhubs version to 0.9.0
...
This closes #1250 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-11-21 10:30:28 +09:00
c8830742ee
NIFI-3020:
...
- Introducing a strategy for identifying users.
- Fixing issue with the referral strategy error message.
- Adding code to shutdown the application when the authorizer or login identity provider are not initialized successfully.
NIFI-3020:
- Updating the admin guide to document the identity strategy.
NIFI-3020:
- Ensuring the request replicator attempts to shutdown regardless of whether the flow service properly terminates.
This closes #1236
2016-11-19 08:38:41 -05:00
1be0871473
NIFI-2854: Refactor repositories and swap files to use schema-based serialization so that nifi can be rolled back to a previous version after an upgrade.
...
NIFI-2854: Incorporated PR review feedback
NIFI-2854: Implemented feedback from PR Review
NIFI-2854: Ensure that all resources are closed on CompressableRecordReader.close() even if an IOException is thrown when closing one of them
This closes #1202
2016-11-18 14:53:13 -05:00
7206318ecf
NIFI-3033 GenerateFlowFile Dynamic Properties
...
This closes #1222 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-11-18 11:06:20 +09:00
e5eda63705
NIFI-2943 - Toolkit uses JKS type over PKCS12 when creating truststore because non-Bouncy Castle providers cannot read certificates from PKCS12 truststore.
...
Peer review feedback (+2 squashed commits)
Squashed commits:
[0102c8e] NIFI-2943 - Peer review feedback
[9bcd495] NIFI-2943 - pkcs12 keystore improvements
1. loading pkcs12 keystores with bouncy castle everywhere
2. tls-toolkit client using jks truststore when keystore type is specified differently
3. tests
This closes #1165 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-11-16 17:13:10 -08:00
878db82375
[NIFI-2949] update remote process group port styles. This closes #1226
2016-11-16 17:08:06 -05:00
f1eca0a09a
NIFI-1002 added L&N entries for Bouncy Castle
...
This closes #1235
2016-11-16 15:30:47 -05:00
31ea50bce9
NIFI-1002: Added WebSocket support.
...
- Added LICENSE and NOTICE files.
- Fixed UnitTest errors.
This closes #1231
2016-11-16 12:17:37 -05:00
2f9ec03242
NIFI-2909 Fix logic in AbstractConfiguredComponent setProperties() for setting classpath resources in the InstanceClassLoader
...
This closes #1232
2016-11-16 11:34:52 -05:00
49afacc3ab
NIFI-3022:
...
- Returning the appropriate authorizable when accessing provenance events for a manual DROP event by emptying a queue.
- Populating the component details of a provenance event when the source is a connection.
2016-11-16 10:13:18 -05:00
45a5f5295c
NIFI-2374 This closes #712 . updated to latest tika versions where possible, updated doc, commented why cannot update media nar
2016-11-15 23:18:55 -05:00
3e571f9f1f
NIFI-2374 - Adjust documentation wording to clarify IdentifyMimeType
...
is a non exhaustive list of mime type values
2016-11-15 22:42:21 -05:00
26a5881d21
NIFI-1002: Added WebSocket support.
...
NIFI-1002: Added WebSocket support.
- Reflecting review comments
- Added displayName to peroperty descriptors
NIFI-1002: Added WebSocket support.
This closes #1184
- Reflecting review comments:
- Removed unnecessary use of NarCloseable.withComponentNarLoader.
- Removed intermediate on memory queue to make it simpler and more
robust. Received messages in WebSocket layer now will be transferred
to downstream relationships directly.
2016-11-15 19:34:59 -05:00
b026f0bebe
NIFI-2991 removed json.org references as appropriate for build. Twitter proc no longer deployed but reference kept in notice just in case someone uses it
...
This closes #1230
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-15 18:09:27 -05:00
6696529c99
Revert "NIFI-1893 Add processor for validating JSON"
...
This reverts commit f11682202b
2016-11-15 18:09:14 -05:00
1c9077334f
NIFI-2991 removed usage of json lib and components still using it
...
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-15 18:09:09 -05:00
721964b7d8
NIFI-3036: When we replay a FlowFile, ensure that we are using the 'golden copy' of the associated Resource Claim, if the claim is still writable. Ensure that StandardResourceClaimManager retains the 'golden copy' of a Resource Claim until it is no longer writable and has a claim count of 0
...
This closes #1223
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-15 16:51:34 -05:00
81357d4456
[NIFI-3042] Update class name for disabled combo option. This closes #1228
2016-11-15 16:43:27 -05:00
9f3bf121f9
NIFI-3040: Fixed bug where we were generating a RepositoryRecord with an 'UPDATE' type instead of a 'CREATE' time for Replay of FlowFiles. This caused FlowFile to have no attributes when restored from the FlowFile Repository.
...
This closes #1224
2016-11-15 16:37:51 -05:00
2614b83543
NIFI-3043 Fixing Kafka unit test failures
2016-11-15 16:31:10 -05:00
fe59b3415c
NIFI-3003 Upgrading hadoop.version to 2.7.3 and fixing TDE issue with PutHDFS, ensuring clean up of instance class loaders, and adding classpath resource property to all HDFS processors
...
NIFI-3003 Addressing review feedback
NIFI-3003 added minor notice updates
This closes #1219
2016-11-15 16:23:27 -05:00
45bc3e054d
NIFI-2751 - Pull batch in round-robin manner - fix for / by 0
2016-11-15 16:19:00 -05:00
45bf8430fc
[NIFI-2844] Update CSS styles for Cluster Summary Dialog icons and refresh button. This closes #1104
2016-11-15 11:55:42 -05:00
8f928e5d6e
NIFI-2926: add policy action item to the user table and add user centric policy dialog with user policy listing table compolete with GoTo action.
...
This closes #1188 .
2016-11-15 09:58:58 -05:00
59fea1cb4e
NIFI-2654 Enabled encryption coverage for login-identity-providers.xml.
...
Squashed commits:
[5dd22a9] NIFI-2654 Updated administration guide with login-identity-providers.xml flags.
Exposed master key retrieval code in NiFiPropertiesLoader.
Added logic to decrypt login identity providers XML configuration.
Updated login-identity-providers.xsd to include encryption scheme attribute.
Added unit tests. (+18 squashed commits)
Squashed commits:
[57c815f] NIFI-2654 Resolved issue where empty LIP property elements could not be encrypted.
Added unit test and resource.
[27d7309] NIFI-2654 Wired in serialization logic to write logic for LIP.
Added comprehensive unit test for LIP & NFP in same test.
[b450eb2] NIFI-2654 Finalized logic for preserving comments in LIP parsing.
[5aa6c9c] NIFI-2654 Added logic for maintaining XML formatting (comments and whitespace) for LIP.
Added unit tests (w/o encryption works; w/ does not).
[b53461f] NIFI-2654 Added unit test for full tool invocation migrating a login-identity-providers.xml file and updating file and bootstrap.conf with key.
[2d9686c] NIFI-2654 Updated tool description and various logging statements.
Added unit test for full tool invocation encrypting a login-identity-providers.xml file and updating file and bootstrap.conf with key.
[8c67cb2] NIFI-2654 Added logic to encrypt LIP XML content.
Added unit tests.
[8682d19] NIFI-2654 Added logic to handle "empty" (commented) LIP files.
Added unit tests.
[077230e] NIFI-2654 Fixed logic to decrypt multiline and multiple-per-line XML elements.
Added unit tests and resources.
[d5bb8da] NIFI-2654 Ignored unit test for unreadable conf directory because directory was causing Maven build issues.
Removed test resources.
[7e50506] NIFI-2654 Fixed AESSensitivePropertyProvider bug handling cipher text with whitespace.
Added unit test.
[b69a661] NIFI-2654 Fixed AESSensitivePropertyProviderFactoryTest to reflect absence of key causes errors.
[6f821b9] NIFI-2654 Added standard password to arbitrary encryption test for use in test resources.
[d289ffa] NIFI-2654 Added LIP XML decryption.
Added unit tests.
[a482245] NIFI-2654 Added LIP test resources.
[7204df4] NIFI-2654 Changed logic to only perform properties encryption when file path is provided.
[729e1df] NIFI-2654 Removed population of default file locations for bootstrap.conf, nifi.properties, and login-identity-providers.xml as not all files may be desired.
Added/updated unit tests.
[7dba5ef] NIFI-2654 Started LIP work (arguments & parsing).
Added unit tests.
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #1216
2016-11-14 22:39:06 -05:00
8ad3125168
NIFI-2380 This closes #817 . corrected licensing and notice and remove conflicting mail deps
2016-11-14 21:04:33 -05:00
a347ebf87b
NIFI-2380 - Introduce ExtractTNEFAttachment - A processor to extract
...
attachments embedded within a Transport Neutral Encapsulation Format (TNEF) attachment (i.e. winmail.dat)
2016-11-14 21:04:12 -05:00
4d1bcc808f
NIFI-3032 Resolved issue where multiple invocations of NiFiPropertiesLoader.withKey() used cached key.
...
Added unit tests and resources.
NIFI-3032 Fixed bug in AESSensitivePropertyProvider#getIdentifierKey where the result was always the max available key size, not the size of the current key.
Added unit test.
This closes #1220
Signed-off-by: Bryan Rosander <brosander@apache.org>
2016-11-14 17:50:32 -05:00
ae4f27a627
NIFI-3023:
...
- Ensuring there are no authorization issues prior to considering the remote process group's transmitting flag.
This closes #1205
2016-11-14 16:23:36 -05:00
2c91a1a33d
NIFI-3023:
...
- Verifying permissions prior to checking Remote Process Group transmission status.
2016-11-14 16:03:47 -05:00
65b7b377e3
NIFI-1526: DefaultSchedule annotation should be use on Custom Processor to set the default scheduling strategy, scheduling period or max number of concurrent task for each instance of the processor
...
DefaultSettings annotation should be use on Custom Processor to set the default penalty period, the yield duration or the bulletin log level for each instance of the processor
2016-11-14 12:04:21 -05:00
41f519e84c
NIFI-2851 initial commit of perf improvements on SplitText
...
- introduced org.apache.nifi.stream.io.util.TextLineDemarcator
- refactored SplitText to use org.apache.nifi.stream.io.util.TextLineDemarcator
- updated SplitText's capability discription to provide more clarity around splits with headers.
2016-11-11 15:45:40 -05:00
b73ba7f8d4
NIFI-2999: When Cluster Coordinator changes, purge any old heartbeats so that we don't disconnect a node due to very old heartbeats
...
This closes #1210
2016-11-11 15:13:49 -05:00
b9ef0fb847
NIFI-2818 This closes #1059 . aligned read method with read/write method
2016-11-11 14:52:13 -05:00
f32bdf7be9
NIFI-2818 - Minimise fs permission required by NiFi
...
1 - Replace a r/w test over $NIFI_HOME/lib that is performed
but never utilised by a RO test
2 - Rename ensureDirectoryExistAndCanAccess to
ensureDirectoryExistAndCanReadAndWrite and deprecate the
former
2016-11-11 14:49:33 -05:00
52cde9ad13
[NIFI-2898] restore ellipsis for processor type, controller servies type, and reporting task type descriptions. This closes #1191
2016-11-11 14:46:20 -05:00
91f0170416
NIFI-3027: ExecuteProcess supports the expression language
2016-11-11 14:41:35 -05:00
06f191ca10
NIFI-2912 Allow custom text in GenerateFlowFile
...
This closes #1206 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-11-11 10:18:43 -08:00
9f417a84b9
NIFI-3002:
...
- Removing legacy code when retrieving site to site details when the target instance is this local NiFi.
- Ensures the UI accurately reflects available remote ports.
NIFI-2603:
- Fixing color of remote output port status in connection label.
This closes #1189 .
2016-11-11 10:06:41 -05:00
4957b628fb
[NIFI-3021] remove white-space:no-wrap on view configuration properties tables textareas
...
This closes #1204 .
2016-11-10 22:12:08 +01:00
f83863ebae
NIFI-3009:
...
- Fixing NaN error when backpressure is not configured.
This closes #1200
2016-11-10 11:39:08 -05:00
b426de1793
[NIFI-3012] update regex for the summary tables input, output, transferred, received, and sent column parse function. This closes #1197
2016-11-10 09:25:08 -05:00
435d9cf353
NIFI-2991 This closes #1194 . Exclude org.json dependency from Hive bundle
2016-11-10 08:33:43 -05:00
1b5a28d130
NIFI-3013 GetSNMP fix stop and start null pointer exception
...
This closes #1195 .
2016-11-10 13:30:16 +01:00
c441a8696d
NIFI-2850 This closes #1115 . Added a migrate() method to ProcessSession and refactored BinFiles and MergeContent to use it
2016-11-09 16:25:03 -05:00
cc2fbcaac4
NIFI-3008 Enabled expression language on BASE_DIRECTORY and FILENAME properties in TailFile
...
This closes #1190
2016-11-09 12:11:11 -05:00
3e892c55ec
NIFI-2971 This closes #1172 . addressed RPM bundled deps and handling exception for bootstrap cl construction
2016-11-09 11:08:43 -05:00
bff89f17b3
NIFI-401: - Minor tweaks to PR #1117 . - Ensuring existing configuraiton is retained and shown until the user explicits changes it. - Retaining, but disabling, deprecated options.
...
This closes #1185
This closes #1117
This closes #512
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-08 17:06:43 -05:00
7eca2037bd
NIFI-401
...
Signed-off-by: jpercivall <JPercivall@apache.org>
2016-11-08 17:06:36 -05:00
4b4e099f2e
NIFI-2764
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2764: Updated call to convertToAvroStream in TestJdbcCommon
This closes #1009
2016-11-08 14:45:49 -05:00
63bda32a8b
NIFI-2998: Add validator to Avro Record Name in InferAvroSchema
...
This closes #1187
2016-11-08 14:14:40 -05:00
78020825e9
NIFI-2841 Refactoring logic in SplitAvro RecordSplitter to avoid making two calls in a row to reader.hasNext()
...
This closes #1088
2016-11-08 13:50:42 -05:00
d1d053725b
NIFI-2909 Adding per-instance class loading capability through @RequiresInstanceClassLoading annotation
...
NIFI-1712 Applying per-instance class loading to HBaseClientService to allow specifying Phoenix Client JAR
-Refactoring the ClassLoading so that every processor, controller service, and reporting task gets an InstanceClassLoader with a parent of the NAR ClassLoader, and only components with @RequiresInstanceClassLoading will make a copy of the NAR ClassLoader resources, and addressing some review feedback
This closes #1156
2016-11-08 13:21:27 -05:00
2f0d9a34f1
NIFI-2982:
...
- Updating the labels in the Add Users/Groups to the Policy dialog..
This closes #1178 .
2016-11-08 16:55:27 +01:00
9d3fe3f03e
NIFI-2989:
...
- Updating the content of the delete policy dialog to make it a little more clear that the permissions for the component will revert back to the inherit policy.
This closes #1183 .
2016-11-08 14:58:11 +01:00
aa8ba0bd1c
NIFI-2965:
...
- Ensuring the selection is cleared when going to the Process Group where the selected component policy is defined.
- Ensure that the selection context is updated when going to a component or group.
This closes #1174 .
2016-11-08 14:49:12 +01:00
5fd4a55791
NIFI-2778 added abilty to interrupt Lucene search
...
polishing
This closes #1138
2016-11-07 16:28:16 -05:00
6aefc0b910
NIFI-2751 NIFI-2848 Get batch of flow files in a round-robin manner
...
This closes #1111
2016-11-07 14:01:18 -05:00
c13cfa6ea6
NIFI-1322 fixed breaking changes introduced in previous commit
...
This closes #1181
2016-11-04 08:23:10 -04:00
a7d06412f8
NIFI-1322 - PutHDFS - allow file append resolution
2016-11-04 08:23:10 -04:00
50010fb340
NIFI-2948 Fix DynamoDB Cached Credentials
...
This closes #1182
2016-11-04 07:04:25 -04:00
0841f14c18
NIFI-2928: Fixed checkstyle violation in FetchFile
...
This closes #1180
Signed-off-by: Bryan Rosander <brosander@apache.org>
2016-11-03 14:46:10 -04:00
ed035f85e3
NIFI-2928 added support to validate accessibility of the file system
...
NIFI-2928 polishing
This closes #1160
2016-11-03 12:25:31 -04:00
a486fefb1e
NIFI-2115 Detailed Version Info in About Box
...
* Java version and vendor
* OS name and version
* Release Tag
* Build revision (commit SHA), branch, and timestamp
* Handles formal releases, ad-hoc builds, and non-release source builds
* Standalone UI presence in About dialog, Summary -> System Diagnostics
* Cluster UI as Versions tab in Cluster dialog
* Reduce About Dialog Content
* Fix Missing Property Display Bugs
* Marking the build time as type string.
* This closes #583
2016-11-03 11:16:20 -04:00
edb0ebe52b
NIFI-2931: - Using the delete button state (which correctly checks if a policy is inherited) to drive the presence of the remove user button.
...
This closes #1153 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-11-03 09:47:26 -04:00
9e44734042
NIFI-2980: Fixed doc for Elasticsearch URL property in ElasticsearchHttp processors
...
This closes #1173
2016-11-02 16:18:30 -04:00
1abd017c35
NIFI-2963 FetchHDFS should support Compression Codec property
...
This closes #1166
2016-11-02 16:15:09 -04:00
b5550ffcf5
NIFI-2834 Better Configs for Fetch and Timeout
...
NIFI-2834 Better Configs for Fetch and Timeout
NIFI-2834 Better Configs for Fetch and Timeout
NIFI-2834 ofSec to of Mils
This closes #1167
2016-11-02 16:10:37 -04:00
769530beae
[NIFI-2603] applying color to highlight status changes
...
- Updating the colors of the target port status and ensuring that when one no longer exists it reports that it is not running.
- This closes #1171
2016-11-02 15:15:29 -04:00
60423f05b5
NIFI-2603
...
- Gui Icons
- Gui Icons - Fixing Orange Color
- Gui Icons - Fixing misc. colors
- Gui Icons - Summary page + spinner
- Gui Icons - Summary page again
2016-11-02 14:11:56 -04:00
2fb3b01ebe
NIFI-2918 JDBC getColumnName may return empty string
...
This closes #1149
2016-11-02 13:13:34 -04:00
892c74dff2
NIFI-2819: Added support for Expresssion Language in ModifyBytes
...
This closes #1130
2016-11-02 13:02:25 -04:00
05ea76dd6f
[NIFI-2888] Display processor fill color when zoomed in/out. This closes #1151 .
2016-11-02 12:54:58 -04:00
5f9cae97b7
NIFI-2883 Renamed directories holding ConsumeKafka_0_10 and PublishKafka_0_10 additional details
...
This closes #1170
2016-11-02 12:29:09 -04:00
7fbc23639a
NIFI-2956 - GetHDFS - fixed directly path evaluation
2016-11-02 12:15:26 -04:00
56da2b51e1
[NIFI-2900] transformed all datetime fields to string as they don't comply with ISO norms. This closes #1136 .
2016-11-02 09:39:48 -04:00
e1f0ba5a43
NIFI-2925: When swapping in FlowFiles, do not assume that its Resource Claim is 'in use' but instead look up the canonical representation of the resource claim
...
This closes #1150 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-10-31 09:59:06 -04:00
7fd2c42b19
NIFI-2879,NIFI-2880 This closes #1120 . fixed NarThreadContextClassLoader instantiation error handling
2016-10-28 12:15:12 -04:00
9e90aae066
NIFI-2936: Fix TestExecuteProcess error on Travis.
...
This closes #1162 .
2016-10-28 10:35:37 +02:00
8dc60c72d4
NIFI-2884: - Adding support to selecting multiple users before updating a policy.
...
NIFI-2533: - Only including a user/group in the search results if they are not currently selected.
NIFI-2286: - Providing a tooltip for the add user and remove policy button.
This closes #1155 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-10-27 11:50:46 -04:00
1d74b5d3ce
NIFI-2791 Adding 'math' expression language function
...
This closes #1157 .
2016-10-25 19:45:38 +02:00
368ea7a2d2
NIFI-1069 Removing the exit directive
...
This closes #1159
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-10-25 12:44:19 -04:00
e4a3e09643
NIFI-1662 Adding proper UI regex support for decimals in EL
...
This closes #1018
2016-10-24 10:31:16 -04:00
9b08f23b24
NIFI-1531 - Remove bogus .gitignore files from sub directories
...
This closes #1154 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-10-23 10:29:09 -04:00
6676e94a7c
[NIFI-2929] remove canvas element names when zoomed out and view permissions are removed. This closes #1152
2016-10-21 16:11:27 -04:00
b864d49f66
NIFI-2341 - Introduce ParseCEF processor
...
This closes #785
2016-10-20 17:16:57 -04:00
f5f132b1ab
NIFI-2828: Fixed issue with transitive Hadoop dependencies in Hive NAR
...
This closes #1146
2016-10-20 14:56:01 -04:00
af27e4070b
NIFI-2843: - Removing the View Configuration menu item from the context menu on Process Groups.
...
This closes #1087
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-10-20 12:45:37 -04:00
99d3c39748
NIFI-1069 - improve init script exit codes so that results are LSB compliant
...
This closes : #1093
Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2016-10-20 23:12:23 +11:00
611cadd231
NIFI-2919 Improved GetFile processor to fail (and provide bulletins) if target directory is inaccessible.
...
This closes #1147 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
Fixed typos in error messages, renamed variables in test, and cleaned up unnecessary imports. (+1 squashed commit)
Squashed commits:
[e755cbd
2016-10-19 16:33:33 -04:00
a8e1c775fd
[NIFI-1459] add css translate3d to properties table editors in order to move the element along the z-axis of the 3D space and allow the scrollbars to properly be poistioned. This closes #1070
2016-10-19 15:39:58 -04:00
3914141c45
NIFI-1710 - Resolve path name to nifi.sh script
...
This closes #1137 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-10-18 16:43:03 -07:00
27dba60f27
NIFI-2905: Log error stream of ExecuteProcess cmd
...
ExecuteProcess ignores error stream when Redirect Error Stream is
false, this commit let it to be logged instead so that user can see it on
bulletin.
This closes #1143 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-10-18 15:56:27 -07:00
f287bc9119
[NIFI-2913] update z-index of codemirror resize handle to match the z-index of the codemirror vert. and horz. scrollbars
...
This closes #1145 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-10-18 15:24:18 -07:00
5afbc43364
NIFI-2500 This closes #1131 . made container queue configurable
2016-10-18 14:47:49 -04:00
9fb3039416
[NIFI-2898] Add Processor dialog processor descriptions now scrollable
...
This closes #1134 .
2016-10-17 23:07:39 +02:00
b9a940bbd1
NIFI-2902 Fix for S3 Signer v4 Override
...
This closes #1140 .
2016-10-17 22:51:45 +02:00
c883f98cbf
NIFI-2906 removed unused memebr variables
...
This closes #1144 .
2016-10-17 22:32:23 +02:00
596b98865b
NIFI-2894: Fixed typo in PutSQL documentation
...
This closes #1129
2016-10-14 12:45:34 -04:00
b52b839895
NIFI-2897: Fixed SelectHiveQL for CSV output of complex types
...
This closes #1132
2016-10-14 12:35:38 -04:00
88d125137e
NIFI-2199 - allows nifi.sh restart through ssh
...
Closes : #1092
Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2016-10-15 00:48:04 +11:00
e969a5ffe3
NIFI-2873: Nifi throws UnknownHostException with HA NameNode
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2873: Changed test hive-site.xml to use local FS, fixed Checkstyle violations
This closes #1113
2016-10-14 09:23:19 -04:00
7107616420
NIFI-2872 Create PutCloudWatchMetric Processor
...
This closes #1125 .
Signed-off-by: James Wing <jvwing@gmail.com>
2016-10-13 19:53:53 -07:00
33ba1a822e
NIFI-2899 Updated swagger-maven-plugin to 3.0.1
...
Incorporates the fix from https://github.com/kongchen/swagger-maven-plugin/issues/141
Ensures the new swagger.json is spec 2.0 compliant, see https://github.com/swagger-api/swagger-codegen/issues/3976
This closes #1135 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-10-13 17:21:11 -07:00
26f46538b3
NIFI-766:
...
- Improved connection UI display when backpressure is enabled
- Updating the connection label to include backpressure indicators for object count and data size thresholds.
- Coloring the connection path and drop shadow once backpressure is engaged.
- Fixing bug with expiration icon tooltip.
- Including columns in the summary table for backpressure.
- Updating empty queue action to reload the connection status upon completion to ensure an updated count.
This closes #1080 .
2016-10-13 12:14:16 -04:00
c470fae065
NIFI-2863: S2S to allow cluster URL more leniently. This closes #1122
...
- Consolidated the target cluster URL resolving logic into
SiteToSiteRestApiClient's as a common method
- Changed to more descriptive error message
- Added more unit test cases
2016-10-13 09:50:50 -04:00
6dc2f14198
NIFI-2799 AWS Assume Role Credentials With Proxy
...
This closes #1112 .
Signed-off-by: James Wing <jvwing@gmail.com>
2016-10-12 17:19:13 -07:00
979b4d8ab9
NIFI-2801 Edited Kafka processor documentation to explicitly state which Kafka versions supported by each processor
...
This closes #1119 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-10-12 10:35:45 -07:00
893fed794c
Add Stateful annotation to scripting processors
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2682: Added text to Stateful description for AbstractScriptProcessor
2016-10-12 13:20:37 -04:00
a25b651da9
NIFI-2837: - Immediately hiding the template dialog after clicking the Upload button to prevent an accidental re-submission.
...
This closes #1086 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-10-12 09:18:58 -04:00
af27179322
Nifi-1540 - AWS Kinesis Streams put processor
...
This closes #239 .
Signed-off-by: James Wing <jvwing@gmail.com>
2016-10-11 20:21:29 -07:00
6d5f4777c5
Fixed HL7 segment index bug for order control codes, more testing
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
Added NOTICE entries for test data and fixed checkstyle violations
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1123
2016-10-11 14:57:40 -04:00
ee14ae8af0
NIFI-2774 added configurable QoS options to ConsumeJMS
...
Signed-off-by: Mike Moser <mosermw@apache.org>
This closes #1036 .
2016-10-11 10:32:00 -04:00
4a4c87fa15
NIFI-2849:
...
- Showing process group name when possible.
- Providing a link to jump to the process group defined in the effective policy.
- Preventing editing an inherited policy.
- When overriding a policy, allowing the user to indicate if the policy should be empty or should copy the user/groups of the inherited policy.
This closes #1090 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-10-11 00:06:09 -07:00
540ef63efa
NIFI-2855: Site-to-Site with port forwarding.
...
- Added following properties:
- nifi.web.http.port.forwarding
- nifi.web.https.port.forwarding
This closes #1100 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-10-07 15:00:37 +09:00
09568d092b
NIFI-2836:
...
- Ensure that we wait until a request is completed before unlocking the lock for request replication
- Ensure that failures do not trigger request completion logic unless the failure is the last node to report its status
- This closes #1109
2016-10-06 16:41:05 -04:00
bb6c5d9d4e
NIFI-2777:
...
NIFI-2856:
- Only performing response merging when the node is the cluster cooridinator even if there is a single response.
- Fixing PropertyDescriptor merging to ensure the 'choosen' descriptor is included in map of all responses.
This closes #1095 .
2016-10-06 16:19:19 -04:00
b9cb6b1b47
NIFI-2865: Refactored PublishKafka and PublishKafka_0_10 to allow batching of FlowFiles within a single publish and to let messages timeout if not acknowledged
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-10-06 15:51:16 -04:00
a4ed622152
Revert "NIFI-2865: Refactored PublishKafka and PublishKafka_0_10 to allow batching of FlowFiles within a single publish and to let messages timeout if not acknowledged"
...
This reverts commit 92cca96d49
2016-10-06 15:19:00 -04:00
53f7a21663
NIFI-2691 Replaced references to kerberos/spegno principle with principal in nifi.properties and admin guide
...
This closes : #1105
Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2016-10-07 01:22:49 +11:00
92cca96d49
NIFI-2865: Refactored PublishKafka and PublishKafka_0_10 to allow batching of FlowFiles within a single publish and to let messages timeout if not acknowledged
...
This closes #1097 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-10-06 10:05:51 -04:00
8bd85e2085
[NIFI-1792] Clear the selected rule id when deleting the last rule in the list. Add scrollable styles when appropriate. Close popups when appropriate. This PR also adjusts the position of the table cell nfel and long text editors. This closes #1099 .
2016-10-06 09:51:05 -04:00
3c673972e0
NIFI-2816:
...
- Fixing compilation error resulting from the initial NIFI-2816 commit.
2016-10-06 09:29:59 -04:00
3c8545a902
NIFI-1912 - PutEmail fixed format when attachment
...
Correction as suggested by users in JIRA.
+ adding a unit test to check attachments.
This closes : #1081
Signed-off-by: Andre F de Miranda <trixpan@users.noreply.github.com>
2016-10-06 21:34:56 +11:00
6ad633d174
[NIFI-2838] update width of rule name and save message. This closes #1089
2016-10-05 16:40:06 -04:00
da33e2859c
NIFI-2398 - GetIgnite processor
...
This closes #721 .
2016-10-05 22:31:01 +02:00
e46fea920a
[NIFI-1794] Update .dialog-content to wrap text. This closes #1094
2016-10-05 16:15:11 -04:00
c764f83506
[NIFI-1904] If open, close hamburger menu on window resize. This closes #1106
2016-10-05 14:23:13 -04:00
3b408f5601
NIFI-2816 - Clean typos across the code - Part 2. This closes #1085
2016-10-05 13:07:57 -04:00
f157076378
NIFI-2828: Fix Hive NAR dependencies
...
NIFI-2828: Added dependency on hadoop-client to Hive NAR
This closes #1075 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-10-05 11:37:05 -04:00
75d0c74d27
NIFI-1840 Added compression type property in Kite processors
...
This closes #409
2016-10-06 00:20:52 +11:00
2c907c63af
NIFI-2858:
...
- getSystemLoadAverage of OperatingSystemMXBean sometimes returns a negative value.
- ProcessorLoadAverage sets -1.0. It added a defensive logic.
- When load average is zero(load average: 0.00, 0.02, 0.04), systemLoad is zero.
- This closes #1091
2016-10-05 08:59:26 -04:00
44cc7e0072
[NIFI-2864] Update when shell empties content. This closes #1096
2016-10-05 08:14:15 -04:00
17a36c6fd5
NIFI-2825: Fix S2S getPeers flow file count
...
- Added ClusterWorkload message to retrieve workload information from a
cluster coordinator
- Use cluster workload to return queued flow file count to site-to-site
client so that it can calculate distribution of data transfer
This closes #1084 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-10-03 13:28:01 -04:00
34e5a5321a
NIFI-2826 Adding enqueue time to GetAzureEventHub processor
...
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-10-03 10:41:33 -04:00
bec7dbbad6
NIFI-2709 - Refactor ConsumeIMAP and ConsumePOP3 to generate RFC2822
...
compliant flowfiles
NIFI-2709 - refactor ConsumePOP/ConsumeIMAP jUnit
tests now use the greenmail mock email server
This closes : #1083
2016-10-04 01:35:34 +11:00
25b7dfa9b1
NIFI-1971 - Introduce QueryWhois processor with batching (i.e. netcat protocol) support
...
This closes #858 .
2016-10-01 18:38:58 +02:00
d6867283b5
NIFI-2832 State management should be part of the documentation/usage. This closes #1074
2016-09-30 09:59:35 -04:00
e230e50f9d
[NIFI-1851] correctly display number of total process groups upon refresh. This closes #1079
2016-09-29 13:25:19 -04:00
1a24f5f34c
[NIFI-2831] update auto terminate messages. This closes #1077
2016-09-29 13:09:29 -04:00
12e3315ae9
[NIFI-2833] Increase font size and line height for small dialogs. This closes #1078
2016-09-29 11:57:04 -04:00
833ec4409c
NIFI-2758: - Updating move verification to account for Controller Service moving out of scope.
...
This closes #1064
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-09-28 15:01:38 -04:00
cfc738ec19
NIFI-2763: S3 processors do not work with older S3-compatible object stores
...
This closes #1076 .
Signed-off-by: James Wing <jvwing@gmail.com>
2016-09-28 10:32:11 -07:00
d4948a3778
NIFI-1768 Adding TLS/SSL support to Solr processors NIFI-1980 Added a default value for PutSolrContentStream commitWithIn NIFI-2568 Added Kerberos support to Solr processors
...
Upgrading SolrJ to 6.2.
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #1005
2016-09-28 13:14:57 -04:00
c4826cac54
[NIFI-1757] remove iframe from shell dialog to prevent reoccurring requests, update fill color and label config dialog content margins to fit into their respective dialogs. This closes #1069
2016-09-27 15:38:10 -04:00
d674cdfc79
[NIFI-2775] update Provenance table GoTo button visibility in FF. This closes #1040
2016-09-27 15:08:11 -04:00
dd9ecc2907
NIFI-2824: - Updating replication logic to account for the potential replication target and then invoking the corresponding action.
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #1068
2016-09-27 11:44:21 -04:00
508b218b59
NIFI-2795 Sys Diagnostics in Cluster UI
...
- Cleaning up tab resize loop
- Pre-authorizing sys diagnostics api calls
- Addressing issues filtering the tables in the cluster table.
- Addressing issues sorting the tables in the cluster page.
2016-09-27 10:58:01 -04:00
28acb07433
NIFI-2811 JdbcCommon doesn't convert bigint(20) column.
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1053
2016-09-27 10:18:48 -04:00
30f008d676
NIFI-2822 - pass the JWT Authorization token i. This closes #1065
2016-09-26 15:16:32 -04:00
8868235993
NIFI-2803 The pagination of GenerateTableFetch has a sort bug.
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2803: Updated unit tests for GenerateTableFetch
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #1052
2016-09-26 12:05:16 -04:00
446cd44702
NIFI-2816 - Clean typos across the code
...
This closes #1057 .
2016-09-26 17:47:31 +02:00
1b88552b46
NIFI-2796:
...
- Fixing incorrect documentation for the cluster summary endpoint.
This closes #1063 .
Signed-off-by: Aldrin Piri <aldrin@apache.org>
2016-09-26 11:43:33 -04:00
44d4b882bf
NIFI-2071 - Support repeating capture groups in ExtractText
...
This closes #1050 .
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-09-26 17:22:21 +09:00
85a1f753a7
NIFI-2787 truncate flowfile attributes that get indexed to fit within Lucene limits
...
Signed-off-by: Joe Skora <jskora@apache.org>
This closes #1043
2016-09-23 16:01:23 -04:00
25150d4016
[NIFI-2788] update global hamburger menu to have fixed width icons and align text. This closes #1041
2016-09-23 14:35:38 -04:00
66fe004058
NIFI-2815: Fixed InvokeScriptedProcessor to allow changes to script engine type
...
This closes #1055 .
2016-09-23 19:30:51 +02:00
5a3d00c7bb
NIFI-2636 resolve thread safety problem in UnpackContent
...
Signed-off-by: Joe Skora <jskora@apache.org>
2016-09-23 13:25:03 -04:00
b34de74db2
NIFI-2810 Allow Content Type to be set in PutS3Object processor
...
This closes #1034 .
2016-09-23 17:12:30 +02:00
f06aeaee2a
[NIFI-2720] update view configuration properties tables dialogs to match editable configuration properties dialogs
...
This closes #1051 .
2016-09-23 15:46:53 +02:00
49297b725d
NIFI-2805: Add fragment attributes to SplitAvro
...
This closes #1046 .
2016-09-22 21:46:23 +02:00
937dc71aec
NIFI-2417: Addressing code review comments
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2016-09-22 15:00:06 -04:00
00412f6e97
NIFI-2417: Adding Query and Scroll processors for Elasticsearch
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
2016-09-22 15:00:06 -04:00
e973874793
[NIFI-2781] removing bower and allowing npm to manage client side resources in nifi-web-ui and nifi-jolt-transform-json-ui. This closes #1030
2016-09-22 14:50:21 -04:00
0218bc61ef
NIFI-1870: - Restoring the upstream/downstream connections dialog. - Correcting input port label when showing downstream components.
...
This closes #1028 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-22 11:32:19 -04:00
f11682202b
NIFI-1893 Add processor for validating JSON
...
This closes #1037 .
2016-09-22 13:08:34 +02:00
77f8503e98
NIFI-2802 The implementation classes don't support orderByClause.
...
This closes #1044 .
2016-09-22 12:21:43 +02:00
5198e70d14
NIFI-2707: - Ensuring that connections are always sorted accordingly to their zIndex. This preserves the 'bring to front' settings.
...
This closes #1023 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-21 17:20:44 -04:00
b304f70f3e
NIFI-2785: - Ensure the URL is updated when uploading a template to ensure it's going to the appropriate Process Group.
...
This closes #1029 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-21 14:40:10 -04:00
be83c0c5b2
NIFI-1844 - Added ListFTP and FetchFTP processors
...
This closes #881 .
2016-09-21 17:40:38 +02:00
938c7cccb8
NIFI-2749
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #997
2016-09-21 11:16:57 -04:00
fda15d916d
Removing reference to removed lineage identifier header for ExecuteFlumeSink additional details.
...
THis closes #1039
2016-09-21 10:36:24 -04:00
e10b4beb90
NIFI-2797: - Correcting download URIs for OTPs.
...
This closes #1038 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-21 10:33:39 -04:00
684f417406
NIFI-2792 - Ensuring the flow is saved when a template is deleted.
...
This closes #1031 .
2016-09-21 16:31:40 +02:00
930e95aa00
NIFI-1170 - Improved TailFile processor to support multiple files tailing
...
This closes #980
2016-09-21 10:05:39 -04:00
68291636cb
NIFI-1841: Fixed support for CLOB/BLOB types
...
This closes #1035 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-20 15:33:06 -04:00
4fc0e9c407
nifi-2381 Connection Pooling Service -Drop invalid connections and create new ones.
...
This closes #986 .
2016-09-20 18:21:42 +02:00
b693a4a561
NIFI-2789, NIFI-2790 - polishing
...
This closes #1027
2016-09-20 09:32:43 -04:00
c238676058
NIFI-2789, NIFI-2790 - Read JMS properties and add to FlowFile attributes in ConsumeJMS
...
Remove unused assertEquals import
Move destination from default to send/receive to support EL better
2016-09-20 09:30:14 -04:00
feaa4c9db8
NIFI-2757: Site-to-Site with DN mapping
...
Added DN identity mapping pattern support to Site-to-Site client
authorization.
This closes #1010 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-19 12:56:54 -04:00
d838f61291
NIFI-1942 Processor to validate CSV against user-supplied schema
...
This closes #476
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-09-16 11:13:07 -04:00
022f5a506d
NIFI-2266 Refactored GetHTTP processor to use SSLContext protocol vs. hard-coded TLSv1.
...
This closes #999 .
2016-09-16 00:08:08 +02:00
abcfbeb062
NIFI-2771:
...
- Using GzipHandler instead of GzipFilter.
This closes #1020
2016-09-15 10:27:39 -04:00
c1ad913598
NIFI-1342 Added default User-Agent in PostHttp
...
This closes #1021
2016-09-15 09:57:09 -04:00
8a28395e9f
NIFI-2754
...
- Migrating swap to active prior to swapping if necessary.
- This closes #1000 .
2016-09-14 14:27:50 -04:00
67a47dbead
NIFI-2251
...
- Initial commit for client side provenance lineage svg download.
- css styling adjustments, changes for svg replace
- Addressing some style/spacing.
- This closes #982 .
2016-09-14 14:23:46 -04:00
bc005e3398
NIFI-2772: Unsecure RAW Site-to-Site fails with User DN is not known
...
This closes #1019 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-14 10:39:11 -04:00
36846e0fe7
NIFI-2719: - Caching components recently added/removed in case ajax requests are received out of order. This is not an issue for modifications of existing components as we're able to leverage the revision.
...
This closes #1011 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-14 10:33:10 -04:00
c72a9aa54b
NIFI-2752 Correct ReplaceText default pattern and unit tests
...
* Corrected the DEFAULT_REGEX pattern.
* Added tests to isolate regex capture group problem and verify corrected functionality.
* Removed short circuit logic that masked configuration errors and created inconsistent processor behavior.
This closes #1007 .
2016-09-13 22:55:55 +02:00
02ca2a0d78
[NIFI-2770] fix action details dialog
...
This closes #1017 .
2016-09-13 22:17:37 +02:00
5dd743947c
NIFI-2768: - Ensuring we correctly enforce authorization when the destination of a connection changes. This includes source, destination, and parent process group. - Ensuring the UI reseting accordingly when a request fails.
...
This closes #1014 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-13 11:41:51 -04:00
6c9291ad53
NIFI-2765: Fixed Kerberos support for PutHiveStreaming
...
This closes #1012 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-13 11:13:06 -04:00
b48355e75a
NIFI-2766: - Ensuring the root group is included in /resources.
...
This closes #1013 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-13 10:59:26 -04:00
d325773760
NIFI-2262: Added Avro-normalization of table/column names in SQL processors
...
This closes #994 .
2016-09-13 15:46:33 +02:00
9ff5c0b25f
NIFI-2760 Specifying jersey-bundle 1.19 for Ranger plugin
...
This closes #1006 .
2016-09-12 14:18:11 -04:00
e25885650a
NIFI-2440 - Add 'file.lastModifiedTime' attribute to ListSFTP processor
...
Added 'file.lastModifiedTime' attribute to ListFileTransfer, which is
the abstract class extended by ListSFTP.
String literal attribute names were replaced with static references to
attribute name constants in ListFile.
ListFileTransfer stores the 'file.lastModifiedTime' attribute in the
format specified in ListFile.FILE_MODIFY_DATE_ATTR_FORMAT
Updated WritesAttribute description for file last modify time attribute
to mirror the entry in ListFile
Signed-off-by: Joe Skora <jskora@gmail.com>
This closes #931 .
2016-09-09 22:44:23 -04:00
abaacfa5e5
[NIFI-2721] update CS GoTo. This closes #998
2016-09-09 12:31:46 -04:00
ae251c1a6f
NIFI-2718: Show HTTP S2S Auth error on bulletin
...
This commit fixes following two issues, that happens when a Root Group Port
policy for S2S data transfer is removed at a remote NiFi, after a client NiFi has
connected to that port:
1. At client side, Remote Process Group should show that authorization
is failing on its bulletin, but the Exception is caught and
ignored. Nothing is shown on the UI with HTTP transport protocol.
RAW S2S shows error on RPG bulletin. This commit fixes HTTP S2S to
behave the same.
2. At server side, corresponding input-port or output-port should show
that it is accessed by an unauthorized client on its bulletin, but it's
not shown with HTTP transport protocol.
RAW S2S shows warning messages for this. This commit fixes HTTP S2S to
behave the same.
In order to fix the 2nd issue above, request authorization at
DataTransferResource is changed from using DataTransferAuthorizable
directly, to call RootGroupPort.checkUserAuthorization().
Because the blettin is tied to the Port instance and it's
difficult to produce blettin message from this resource.
Since RootGroupPort.checkUserAuthorization uses
DataTransferAuthorizable inside, the check logic stays the same as
before.
Adding a RootGroupPortAuthorizable to provide access to necessary components for performing the authorization.
This closes #996
2016-09-08 13:43:38 -04:00
bc7c42efa5
NIFI-1966: Recreated issue that is outlined in JIRA (the reason for re-opening the ticket) that results in 'java.util.NoSuchElementException: No value present' in unit test - Resolved issue where two flows that are both empty but have different fingerprints (due to root group id being different) causes vote election to fail
...
This closes #995 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-08 10:48:24 -04:00
d36b76cc60
NIFI-2745 added _source destination name_ attribute to ConsumeJMS
...
This closes #992
2016-09-07 15:28:34 -04:00
938e32ed97
NIFI-2746: Ensure that the FlowController is injected into all ResourceApplications. This closes #993
2016-09-07 14:11:46 -04:00
80224e3e5e
NIFI-2741 Move HBase, Storm, Hive, and Kafka versions into properties.
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-07 12:06:01 -04:00
8d6e12fdc4
NIFI-2739: Call KafkaConsumer.wakeup() if consumer is blocking for at least 30 seconds when OnUnscheduled is called
2016-09-07 08:56:23 -04:00
2afc739ab7
NIFI-2712: Fixed Fetch processors for multiple max-value columns. This closes #976
2016-09-06 16:52:40 -04:00
a7e76cc00a
NIFI-1966: When cluster is started up, do not assume that Cluster Coordinator has the golden copy of the flow but instead wait for some period of time or until the required number of nodes have connected, and then choose which flow is correct. This closes #977
2016-09-06 16:31:37 -04:00
7a451935a5
NIFI-2732 ensure session and consumer aligned and has registered rebalance listener. Make consumption far more memory and process efficient, fixed extraneous getbundled call
...
This closes #987 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-06 15:48:40 -04:00
088125451b
NIFI-2681: Refactored IndexManager into an interface and renamed the existing implementation to CachingIndexManager. Implemented a new SimpleIndexManager that performs no caching of IndexSearchers.
...
This closes #958 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-09-06 12:25:28 -04:00
a9d029d74e
NIFI-2717: Ensure that when performing site-to-site communications that we always commit the transaction on the remote side before committing it on the local side
...
This closes #978
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-09-06 10:57:53 +09:00
0e64c3ed30
NIFI-2631: Adding page commits and 'Use Versions' to ListS3
...
This closes #916 and closes #917 .
Signed-off-by: James Wing <jvwing@gmail.com>
2016-09-03 16:04:42 -07:00
97e2f406da
NIFI-2708 Added merging of SiteToSite details
...
NIFI-2708 Updated to include ports from clientDto for port merging.
This closes #981
2016-09-02 14:55:08 -04:00
d37480eaff
NIFI-2722:
...
- Updating the component entity as long as the proposed entity is not older than the current one since stats are bundled in the entity too.
This closes #983
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-09-02 22:25:25 +09:00
867c84f32c
[NIFI-2649] Update CS table upon creation of a CS from the RT or CS properties table
...
- Ensuring the controller services table to correctly reloaded regardless if its the processor group or controller level controller services. This closes #968
2016-09-01 09:53:12 -04:00
96a766464c
NIFI-2678: - Ensuring the most recent version of each component is save for rendering on the canvas.
...
This closes #979 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-31 15:59:52 -04:00
9e10371c8a
NIFI-2704:
...
- Re-using the DataTransferAuthorizable in the DataTransferResource.
- Removing use of the DataTransferResource when obtaining site to site details as it performs additional unnecessary checks.
- Code clean up.
- This closes #971 .
2016-08-31 15:09:17 -04:00
1bb909ebca
NIFI-2703 - Added bootstrap.conf file for running integration tests. This closes #975
2016-08-31 09:28:08 -04:00
648ddb6158
[NIFI-2679] User is now able to disable/enable processors that are invalid or stopped through Operate palette. This closes #973
2016-08-31 09:11:46 -04:00
1213b46632
NIFI-2628: Whenever a flow is inherited from cluster coordinator, save flow immediately to disk
...
This closes #967
2016-08-30 16:13:45 -04:00
ba19238757
NIFI-2694: - Addressing instances where phase one objects were being referenced instead of phase two objects. - Code clean up.
...
This closes #970 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-30 15:50:48 -04:00
8556777bf6
NIFI-2618 Reverted merging PR 955 to master as 1.0.0 requires Java 8.
2016-08-30 09:27:24 -07:00
d600b065bb
NIFI-2618 Added logic to unit test to handle default TLS version for Java <= 7.
...
This closes #955 .
2016-08-30 08:25:38 -07:00
1752a57197
Merge branch 'NIFI-2676-rc1' of https://git-wip-us.apache.org/repos/asf/nifi
2016-08-31 14:01:57 +10:00
daf4855570
NIFI-2687: RPG Port ID was used instead of RPG ID
...
It caused "Error: Unable to find remote process group with id 'XXXX'" error with modifying the transmitting toggle switch of an Input or Output port.
This closes #962
2016-08-29 10:14:55 -04:00
1fe18a1567
NIFI-2676-rc1 prepare for next development iteration
2016-08-26 11:40:58 -04:00
74d5224783
NIFI-2676-rc1 prepare release nifi-1.0.0-RC1
2016-08-26 11:40:44 -04:00
c8ae7fcbe1
[NIFI-2480] remove explicit angular $sanitize to fix multibyte chars in breadcrumbs and flow status bar. All values are escapoed through the angular ng-bind. This closes #957
2016-08-26 11:03:10 -04:00
2ed58912b2
NIFI-2480: Fix for multibyte chars in breadcrumbs. This closes #956
...
Removed $sanitize from breadcrumbs controller, as it escapes multibyte
chars with numerical reference. Even without $sanitize, html tags can be
escaped when Angular binds the value to text content.
2016-08-26 10:27:27 -04:00
0745990c2d
NIFI-2604: Added validators and logic for multiple URLs/files/folders for DB driver location
...
This closes #912
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-25 23:35:41 -04:00
6ef1cca18f
NIFI-2269 Fixing Datadog licensing
2016-08-25 22:43:00 -04:00
e1da9fc11f
NIFI-2667 Adding License and Notice information to Media Bundle Nar and Assembly
...
This closes #950
2016-08-25 22:42:37 -04:00
405252244e
NIFI-2670 minor doc edit to remove kafka.key.hex reference
2016-08-25 22:17:07 -04:00
58e0ce7f92
NIFI-2670: This closes #954 . Expose option for how to interpret Kafka Key - hexadeimal encoding or UTF-8 String
2016-08-25 21:39:40 -04:00
102a9a2b74
NIFI-2674 - Always adding flow files to result set flowfiles, catching runtime exceptions while converting to avro
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #953
2016-08-25 21:16:26 -04:00
7879a99206
NIFI-2675 fixed NPE in template generation
...
This closes #951 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-25 16:44:02 -07:00
957c120343
NIFI-2664 Moving System.setProperty for krb5.conf to NiFi startup, and removing conflicting property from KerberosProvider config
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #946
2016-08-25 17:26:37 -04:00
f908ae3c3b
NIFI-2669: This closes #949 . Ensure that if Exception is thrown during Transaction initialization that the underlying client is closed/cleaned up. Also ensure that we generate bulletins when logging error/warn level log messages
2016-08-25 16:39:00 -04:00
a84d3c9873
NIFI-2665: This closes #942 . Fixed intermittent validation errors in InvokeScriptedProcessor
2016-08-25 15:34:50 -04:00
1624dd8e4d
NIFI-2666 This closes #947 . updated where it says BSD to say MIT for bcrypt
2016-08-25 14:59:46 -04:00
218408953a
NIFI-2668 Added missing license/notice entries for ignite deps in nar
2016-08-25 14:50:38 -04:00
3224b1a5dd
NIFI-2668: This closes #945 . Replaced JSR-107 JCache API JAR w Geronimo version, updated notices
2016-08-25 14:41:08 -04:00
ad7808f63d
NIFI-2641: This closes #928 . Add max values as attributes to QueryDatabaseTable
2016-08-25 14:13:55 -04:00
04db806ace
NIFI-2614 This closes #944 . added support for max.request.size
2016-08-25 13:51:08 -04:00
a6133d4ce3
NIFI-2635:
...
- Fixing contrib check issues.
- Clean up pom.
- Addressing issue where reporting task property descriptor using wrong scope.
NIFI-2635:
- Fixing issue with revisions when creating users and user groups.
- Forwarding requests to the coordinator instead of replicating.
- Tweaking verbage in dialog for removing users and groups.
This closes #943
2016-08-25 13:08:35 -04:00
1745c1274b
NIFI-2608 This closes #930 . restructured the ConsumeKafka processor to follow new consumer API. Made nar classloading more precise to support spawned threads NIFI-2660.
2016-08-25 10:09:50 -04:00
626e23e0ab
Adding ConsumerResource and ConsumerPool for ConsumeKafka
...
Signed-off-by: joewitt <joewitt@apache.org>
2016-08-25 09:47:26 -04:00
56e515f7ae
[NIFI-2658] Use bulletinEntity id instead of bulleting id since the ids match but bulletinEntities do not get bulletin objects if user is not authorized. This closes #938
2016-08-25 09:27:41 -04:00
6fd1c17ca4
NIFI-2662 - Fix checkstyle violations introduced by NIFI-2635
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #940
2016-08-25 08:55:34 -04:00
e210172d93
PutSQLBinary
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2591
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2591
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2591 - Added Format option for binary data types. Updated unit tests.
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #883
2016-08-25 08:41:23 -04:00
afb9a0016f
NIFI-2659: Fixed RPG Received stats. This closes #939
...
It was showing the 'Sent' stats as 'Received' stats.
2016-08-25 08:34:17 -04:00
c2bfc4ef24
NIFI-2635: - Re-using the original request during the second phase of the two phase commit. - Forwarding requests to the coordinator when received by a node.
...
This closes #933
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-24 22:42:10 -04:00
2ceb5c8097
NIFI-2647:
...
- Referencing correct components when checking if save is required.
This closes #935 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-24 15:52:20 -07:00
6331dda8d3
NIFI-2643 Changed null check to !isBlank() for key in RunNiFi.
...
NIFI-2643 Updated comment in bootstrap.conf template.
This closes #932
2016-08-24 16:20:10 -04:00
6475924f53
NIFI-2642 Catches (and ignores) ResourceNotFoundException during the updating of a property value for a controller service when the current value points to a controller service that has been deleted, allowing the assigning of a new controller service to continue.
...
This closes #931
2016-08-24 15:55:04 -04:00
c2ae7a6d7c
NIFI-2605: - Fixing a regression bug where nodes would potentially be elected leader for Cluster Coordinator role when they do not have the correct flow
...
- Ensure that we log which node is the cluster coordinator on startup instead of just indicating that there is one. If we later determine that there is none, ensure that we register for the role
This closes #900
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-24 12:30:48 -04:00
c638191a47
NIFI-1831 Added internal logic and command-line tool to allow AES-encrypted sensitive configuration values in nifi.properties.
...
This closes #834 .
2016-08-23 20:34:31 -07:00
ee9bd94082
NIFI-2632: Added fragment attributes to SplitJson and SplitXml
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #919
2016-08-23 16:30:57 -04:00
5d1a4f343f
NIFI-2622: Added support for complex types in SelectHiveQL
...
This closes #922 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-23 15:52:16 -04:00
0303805c01
NIFI-2620 Adding support for Binary Row Keys for both PutHBaseCell and PutHBaseJSON. This also involved making changes to PutFlowFile and PutColumn to carry around byte[] and not all strings. This closes #914 .
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-23 13:25:55 -04:00
4a49587533
NIFI-2610 annotated unstable tests with @Ignore
...
This closes #918
2016-08-23 13:13:05 -04:00
fbec3b9c13
NIFI-2623: Fixed support for binary types in SelectHiveQL
...
This closes #920 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-23 11:43:46 -04:00
8cc670c8a6
NIFI-2634: Ensure that we check whether or not the Site-to-Site protocol is set when importing template, instead of assuming that it will be
...
This closes #921
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-23 11:19:44 -04:00
3f60eac544
[NIFI-2599] Enhance Status History Dialog. This closes #894
2016-08-23 10:53:10 -04:00
6e82ec738c
NIFI-2269 Fixing minor issues with style check, licensing, etc.
2016-08-22 21:34:51 -04:00
376d3c4ef4
NIFI-2269 Added datadog support
...
This closes #655
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-22 21:34:51 -04:00
dca3764ed1
NIFI-2626 Fixes jetty server thread leak. This closes #910
2016-08-22 15:58:06 -04:00
17dec04939
NIFI-2611: Fixing bugs in UnpackContent with flow file unpackers
...
Signed-off-by: Mike Moser <mosermw@apache.org>
This closes #905
2016-08-22 14:47:24 -04:00
087622eadc
NIFI-2606:
...
- Addressing issue when fingerprinting ReportingTasks and ControllerServices properties with default values.
- Ensuring the flow is saved when templates are created and imported.
- Ensuring default values are included in templates.
- Fixing unit tests.
This closes #908 .
2016-08-22 13:35:15 -04:00
1fcec3747b
NIFI-2617: Instead of retrying an infinite number of times to communicate with ZooKeeper, should try only for a short period in CuratorLeaderElectionManager. This is because web requests may be blocked waiting on a determination of which node is cluster coordinator
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #906
2016-08-22 13:24:22 -04:00
5fab783b50
NIFI-2609: Ensure that we handle URIs for Remote Process Groups that do not have a path of /nifi or /nifi/
...
This closes #902 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-22 13:21:42 -04:00
95b5877f5d
NIFI-2600: Ensure that we do not close Index Searchers prematurely, even if they are poisoned
...
This closes #896
2016-08-22 12:03:47 -04:00
a2d3d0c289
Update to support offsets larger than 2 gigabyte.
2016-08-22 11:02:48 -04:00
b7dc21bd95
NIFI-2547: Fixed checkstyle errors and updated to reflect KerberosProperties changes
2016-08-21 10:26:40 -04:00
26d362b144
NIFI-2547: Add DeleteHDFS Processor
...
This processor adds the capability to delete files or
directories inside of HDFS.
Paths supports both static and expression language values,
as well as glob support (e.g. /data/for/2016/07/*).
This processor may be used standalone, as well as part of a
downstream connection.
Signed-off-by: Matt Burgess <mattyb149@apache.org>
Add Glob Matcher with Tests
Also set displayName on properties.
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #850
2016-08-21 10:10:21 -04:00
02071103d0
* Add "Remove All Content" property, related functionality, and tests to ModifyBytes processor to allow deletion of all flow file content.
...
* Removed @Ignore annotation on class and unnecessary EOL translation of test data. Because ModifyBytes treat input as binary data, not text, line endings don't matter as long as they byte offsets are calculated correctly.
* Replace validator with .allowableValues.
This closes #890 .
2016-08-19 20:05:14 +02:00
3378426f35
NIFI-2581: Keeping context menu and tooltips open when refreshing the canvas.
...
This closes #899 .
2016-08-19 19:36:26 +02:00
a181c7b9d7
[NIFI-2601] Update bower.json to use specific versions. This closes #897
2016-08-19 10:34:48 -04:00
31ca8d02f7
NIFI-2488 Fixed BulletinDTOs not getting their node addresses set properly during bulletin merging. This closes #888
2016-08-19 08:32:00 -04:00
46b81058c7
NIFI-2602: Fixed NPE in SelectHiveQL when CSV output and null column value
...
This closes #898 .
2016-08-19 09:56:26 +02:00
6b5950647a
NIFI-2596:
...
- Adding tooltip for property descriptor on mouse enter of table cell.
This closes #893 .
2016-08-18 17:23:30 -04:00
57648308db
NIFI-2597:
...
- Updating the correct object when attempting to create a self loop.
2016-08-18 17:15:16 -04:00
87161ab96e
NIFI-2595: - Updating ReportingTasks to use ComponentLogger instead of creating Controller level bulletins.
...
- Making the bulletin responses consistent in that all bulletins will be included but in redacted form as appropriate.
- Fixing broken unit test.
This closes #892 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-18 17:06:28 -04:00
f3387426a0
NIFI-2587:
...
- Adding additional authorization for accessing component property history.
2016-08-18 17:05:32 -04:00
6874a5d82d
NIFI-2593: This closes #891 . Fixed handling of nested records/structs in ConvertAvroToORC
2016-08-18 15:15:51 -04:00
a74bc2c7c7
NIFI-2598: This closes #889 . Fixed issue with static init of properties in HiveConnectionPool
2016-08-18 13:38:22 -04:00
e0e4b3407a
NIFI-2574 This clsoes #887 . Fixing NPE when using kerberos keytab location from contexts, and cleaning up hadoop/hbase/hive kerberos variables
2016-08-18 12:19:46 -04:00
0e90a0f76a
[NIFI-2488] update UI to relect changes to ActionDTO and BulletinDTO. This closes #882
2016-08-18 09:38:16 -04:00
08735a4f57
NIFI-2488 Wrapping ActionDTO and BulletinDTO in entities to be able to provide readability permission to the client
2016-08-18 09:37:11 -04:00
567535c3d0
NIFI-2382: Fixed typo in documentation
2016-08-18 09:15:55 -04:00
91a59a8a5a
NIFI-2545: Ensure that when @OnUnscheduled and @OnStopped methods are called that the active thread count takes that thread into account
...
This closes #836 .
2016-08-18 08:33:45 -04:00
7bc7b7f683
NIFI-2584 Fixing date format in PutSQL
...
This closes #878 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-17 16:10:56 -04:00
3d1a24ab7d
NIFI-2578:
...
- Ensuring NiFi still attempts to issue a registration request to support 1.x -> 0.x site to site.
2016-08-17 15:35:16 -04:00
a0fab15eb7
NIFI-2519 polishing remote address formatting to avoid NPE and other potential exceptions.
...
This closes #871
2016-08-17 15:13:05 -04:00
e7288af859
NIFI-2519 - ListenSMTP addresses mismatch between smtp.src attribute documentation and attribute.put
2016-08-17 14:58:02 -04:00
0ffdc2eb92
Merge branch 'master' of https://github.com/apache/nifi
...
(Apologies for merge commits, but it was not possible to rebase the 2574 commits (PR 872)).
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-17 10:58:38 -07:00
b2e468ecf8
NIFI-2574 updated to reflect new accessor methods for nifi properties with kerberos service
...
This closes #872 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-17 10:51:55 -07:00
a0d1aae603
NIFI-2583
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2582
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2582
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #877
2016-08-17 13:20:44 -04:00
1470a52b1b
NIFI-2582 NIFI-2583
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-2583 Tweaks
Signed-off-by: Matt Burgess <mattyb149@apache.org>
This closes #877
2016-08-17 13:19:56 -04:00
a5261914fb
NIFI-2574 merging latest kerb changes to adjust for NiFiProperties
2016-08-17 09:06:18 -07:00
7c99b5e638
NIFI-2574 fixed queue swap threshold setting
2016-08-17 09:05:36 -07:00
3f7216ab84
NIFI-2561: - Decoupling kerberos service and spnego principles and keytabs.
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #873
2016-08-17 08:14:05 -04:00
d9633757a6
NIFI-2574 fix spring context definitions
2016-08-17 03:38:31 -07:00
6bf7e7f325
NIFI-2574 merging master with cluster changes to updated NiFiProperties approach
2016-08-17 01:23:54 -07:00
7d7401add4
NIFI-2574 Changed NiFiProperties to avoid static initializer and updated all references to it.
2016-08-17 00:10:07 -07:00
e42ea9ad45
NIFI-2566: Refactored to allow just the Leader Election Manager to be responsible for determining who is the Cluster Coordinator
...
NIFI-2566: Removed storage of cluster roles from heartbeats and NodeConnectionStatus; use LeaderElectionManager to determine roles instead
NIFI-2566: Updated Heartbeats so that if a node is out-of-sync with cluster topology, cluster coordinator will provide updated information back to the nodes
NIFI-2566: Fixed issue that prevented standalone instance from starting by creating a standalone-instance version of the Leader Election Manager. Also added Controller Service enabled/disabled state to fingerprint rather than attempting to update the state when joining the cluster, as the implementation was incorrect and the correct implementation will be a rather significant effort that doesn't have to happen for 1.0.0 release
This closes #866
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-16 20:39:04 -04:00
b3f36489ad
NIFI-2534: - Refreshing using component IDs. - Code clean up.
...
This closes #874 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-16 16:05:20 -04:00
b0122c6a73
NIFI-2465 - InferAvroSchema EL support based on incoming FlowFiles
...
This closes #863 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-16 12:50:53 -04:00
26f5c496d1
NIFI-2534 Fix JS error when stopping a process group
...
This closes #867 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-16 11:09:41 -04:00
b22500d0a3
NIFI-2576 Allowing PutSQL to use timestamps in epoch or string format
...
This closes #869 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-16 10:26:24 -04:00
03d3b3961d
NIFI-2577: Increased default stripe size in ConvertAvroToORC to 64MB
...
This closes #870 .
2016-08-16 11:53:05 +02:00
6af768d0a1
NIFI-2551: Addressed a threading issue in the StandardResourceClaimManager and performed some refactoring so that we can ensure thread-safety across different components of the application, such as ProcessSession and WriteAheadFlowFile Repository when interacting with the StandardResourceClaimManager. Update DebugFlow to allow it to write to a FlowFile multiple times, which exposes the concurrency bug. Also avoided calling ContentRepository.remove() from ProcessSession whenever the content is no longer needed, as that can cause problems now that the Resource Claim is backing the content claim.
2016-08-15 17:02:15 -04:00
ed42f2e3e3
NIFI-2552: Updated Curator for HiveQL processors using Zookeeper quorum in URL
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #865
2016-08-15 16:53:57 -04:00
7d8dd27027
NIFI-2554: - Requiring READ permissions on the referenced controller service when creating/updating processors, controller services, and reporting tasks.
...
- Preventing client side selection of unauthorized controller services unless they were the previously configured value.
This closes #860 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-15 16:46:58 -04:00
2a92747046
[NIFI-2559] UI - Controller Service update missing icons
...
This closes #864
2016-08-15 16:27:12 -04:00
d45114e48d
NIFI-2501: - Ensuring users can access the controller service list regardless of permissions on the corresponding process group or controller. - Better handling the case where the user had write permissions but no read permissions. - Returning to the appropriate controller service listing after going to the usage page.
...
This closes #835
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-15 15:16:58 -04:00
51c566ffc8
NIFI-2546 fixed NPE in FlowSnippetDTO fixed NPE caused by non-configured ControllerService
...
This closes #859 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-15 14:55:20 -04:00
fbd3201157
NIFI-2524 - Fixes to improve handling of missing journal files during rollover/merge execution.Includes:
...
This closes #840
Removed partial file check (based on missing first file)
Added condition to merge if at least one journal files available on disk. If all files are missing from disk that is considered an error.
Added retry logic to prevent endless thread execution when encountering errors (such as missing files).
2016-08-15 14:43:38 -04:00
44057f097a
NIFI-2356 ConvertJSONToSQL assumes IS_AUTOINCREMENT
...
This closes #862 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-15 14:17:16 -04:00
fd0dd51ff5
NIFI-2553 Fixing handling of Paths in HDFS processors
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #843
2016-08-15 08:59:42 -04:00
9c7668948c
NIFI-2560 This closes #851 . fixed property handling and added tests using it
2016-08-14 14:35:25 -04:00
b7b56b1cad
NIFI-2560 added connection timeout to IMAP/POP3
2016-08-14 14:06:07 -04:00
d3b96dcac1
NIFI-2519 This closes #856 . aligned threading model with subethastmp
2016-08-14 13:32:00 -04:00
48fa76ecff
NIFI-2519 Fixed and refactored ListenSMTP processor
...
- Removed message queueing which could result in data loss
- Fixed life-cycle issues that coudl put processor in an unstable state
- Fixed PropertyDescriptor translation for Time units and Byte sizes
- Fixed broken tests
- Added additional tests
NIFI-2519 added default for SMTP_MAXIMUM_CONNECTIONS
NIFI-2519 addressed PR comments, polishing
- fixed intermittent deadlock on processor stop and added test for it
- the attributes that can not be extracted from the message but available via MessageContext are written into the outgoing FlowFile
- other minor fixes
NIFI-2519 addressed lates PR comments
NIFI-2519 added better messaging when server closes the connection
NIFI-2519 some polishing and additional tests to validate deadlocks
NIFI-2519 address latest PR comments
fixed deadlock condition for when the consumer is stopped while server is distributing messages
fixed MAX message size issue ensuring it is validated
set max connections to SMTPServer
polished pom
added L&N
NIFI-2519 PR comments
- fixed LICENSE
- Added usage of LimitingInputStream
- simplified SmtpConsumer by removing hasMessage operation
2016-08-14 13:31:46 -04:00
0855cb9bd4
NIFI-2555:
...
- Addressing potential NullPointerException when an AccessDeniedException is thrown from an endpoint that isn't subject to the security filter chain.
This closes #846 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-12 15:08:00 -07:00
6799bd4919
NIFI-1876 fixing counter URI pattern
2016-08-12 17:23:12 -04:00
bbdd087d77
NIFI-1876 Implemented PropertyDescriptorDTO merging
...
NIFI-1876 Updated PermissionsDTO to use boolean primitives instead of Boolean objects for read and write permission
Removed ISE throwing from EntityFactory, it will rely on null checks instead
This closes #694
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-12 17:22:37 -04:00
e81147c92a
NIFI-1876: - Introducing entities for allowable values and process group status.
...
Signed-off-by: Jeff Storck <jtswork@gmail.com>
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-12 17:22:26 -04:00
572dfed78a
NIFI-1876 Implements merging of responses to successful requests based on authorization, returning the most restrictive response - Added StandardHttpResponseMergerSpec for testing response merging - Added Permissible interface - Added nifi-api/controller/archive to ProcessGroupEndpointMerger - Removed AbstractMultiEntityEndpoint.java, not used anymore - Implemented reponse merging for GET requests where there are some successful and problematic responses, returning most restrictive one. - Updated nf-settings.js with ControllerConfigurationEntity property rename from controllerConfiguration to component - Implemented merging of status DTOs based on read permission NIFI-2264 Implemented merging of status history results based on readability permissions - Added StatusHistoryEndpointMergerSpec to test merging of status history based on read permission
...
NIFI-1876 Added merging for labels, funnels, and controller service references.
NIFI-1876 Added Label and Funnel merging to FlowMerger.java
NIFI-1876 Added replication of request for process group controller services
- Updated merging code for Status and Status History based on read permissions
NIFI-1876 Fixed issue with node status snapshots all looking like they came from one node
Updated ProcessGroupStatusSnapshotDTO to contain status snapshot entities to retain readability permission
Added entity classes for ConnectionStatusSnapshotDTO, PortStatusSnapshotDTO, ProcessGroupStatusSnapshotDTO, ProcessorStatusSnapshotDTO, and RemoteProcessGroupStatusSnapshotDTO
Updated PropertyDescriptorDTO to contain AllowableValueEntity to retain readability permission
Added entity class for AllowableValueDTO
Moved AllowableValueDTO to its own top-level class
Updated DtoFactory to get permissions for status snapshot entities
Updated StatusMerger to merge status snapshot entities
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-12 17:22:17 -04:00
a9675552d9
[NIFI-2557] Enhance Modal Plugin. This closes #842
2016-08-12 11:40:45 -04:00
e5e86cf07c
NIFI-2548:
...
- Allowing selection of User/Cluster node when searching and encountering an exact match.
This closes #839
Signed-off-by: Koji Kawamura <ijokarumawak@apache.org>
2016-08-12 20:41:49 +09:00
fa639e2596
NIFI-2542: - Ensuring transitive referencing components are able to be returned. - Ensuring we can enable/disable services with transitive referencing components. - Ensuring we cannot enable/disable services with unauthorized referencing components.
...
NIFI-2543: - Ensuring we have permissions before attempting to reload a controller service.
This closes #837
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-11 20:42:35 -04:00
25a2fac453
NIFI-2535: Do not include properties that are unset in flow fingerprint. This allows a new property to be added to a processor without affecting the fingerprint, if the value is never set
...
This closes #829 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-11 10:44:28 -04:00
76a4a2c48b
NIFI-2544: Created integration tests for clustering and addressed a few minor bugs that were found in doing so
...
This closes #832 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-11 10:43:38 -04:00
d544274881
NIFI-2531: Fixed JdbcCommon handling of BigInteger objects for Avro
...
This closes #823 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-10 15:19:34 -04:00
2938a5353a
NIFI-1663: Adding attribution for derived work for OrcFlowFileWriter
2016-08-10 14:51:05 -04:00
85877a73dc
NIFI-2540: Exclude from templates the parts of property descriptors that are not necessary. Also ensure that Property Descriptors are not completely removed from Controller Services.
...
This closes #828
2016-08-10 13:27:20 -04:00
d9720239f5
NIFI-1663: Add ConvertAvroToORC processor
...
This closes #727
2016-08-10 12:37:15 -04:00
bb24312709
NIFI-2142 Added Guava cache for XSLT stylesheets in TransformXml
...
This closes #609
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-10 11:13:30 -04:00
557d6365bf
NIFI-2518: Added unit test showing issue
...
NIFI-2518: Added support for fractional seconds to AbstractDatabaseFetchProcessor
This closes #821
2016-08-10 11:10:17 -04:00
219234d001
NIFI-2530: - When no explicit policy is defined, defer to the parent Process Group instead of attempting to match component's within the flow.
...
This closes #826 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-10 11:06:16 -04:00
84cac0daca
NIFI-2299 Add standard services api access for scripting processors
2016-08-09 17:15:44 -04:00
2dc094765d
NIFI-2516 - Extract version info into parent pom, upgrade to commons-io 2.5
...
NIFI-2516 - Removing slf4j-api, version from slf4j-log4j12
This closes #809 .
2016-08-09 22:43:29 +02:00
fbb705e461
NIFI-2511: - Ensuring Process Group bulletins are bubbling up as expected.
...
This closes #822 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-09 16:28:57 -04:00
45c31c8305
NIFI-2507 Added Canned ACL support to PutS3Object
...
This closes #801
Signed-off-by: James Wing <jvwing@gmail.com>
2016-08-09 13:20:52 -07:00
b2401522ea
NIFI-2521 This closes #815 . removed test classes with questionable origin and licensing.
2016-08-09 15:46:58 -04:00
7a1f749f69
NIFI-2475: - Updating UI to better suggest that component specific administrators do not override higher level administrators.
...
This closes #813
2016-08-09 15:40:28 -04:00
7575e87cb1
NIFI-2520 This closes #818 . Added attribution for storm-hive and other Hive dependencies to NOTICEs
2016-08-09 15:27:24 -04:00
42df02f014
NIFI-2406 This closes #820 . Addressed regression introduced in NIFI-2406 where the cluster does not recognize a new Cluster Coordinator when the coordinator is shutdown
2016-08-09 15:19:49 -04:00
18f4150015
NIFI-2515 This closes #814 . fixed Kafka serialization/deserialization settings
2016-08-09 14:28:51 -04:00
f6ba922292
NIFI-1965 This closes #819 . COnvert DNS_TIMEOUT property to TIME_PERIOD
2016-08-09 14:25:07 -04:00
ae8045d99b
NIFI-2505: - Updating the user identity field in the ActionDTO.
...
This closes #800 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-09 13:07:50 -04:00
aae6325603
NIFI-2237: - Reorganizing the refactored REST endpoints. - Tweaking message text.
...
This closes #788 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-09 12:04:31 -04:00
5e5c3f7c3b
NIFI-2504 This closes #810 . fixed template export for RPG
...
- ensured that RPG and connections to it are treated as special case where instance ID is preserved
2016-08-08 16:54:27 -04:00
ed14bf22e7
NIFI-2493 This closes #798 . Do not fingerprint Remote Ports' running state. When synchronizing remote flow with local flow, start/stop remote group ports as appropriate based on the inherited flow
2016-08-08 16:54:27 -04:00
8752d11f18
NIFI-2495 This closes #808 . Ensure that we always close Index Searchers when we're finished with them
2016-08-08 16:54:27 -04:00
d6a2409d71
NIFI-1965 - Implement QueryDNS processor
...
This closes #496 .
2016-08-08 22:27:40 +02:00
493919922e
NIFI-1965 - Rename nifi-geo-bundle to nifi-enrich-bundle
2016-08-08 22:27:22 +02:00
9b647cd538
NIFI-1148 added IMAP/POP3 support added initial set of processors to support consumption of Email via IMAP/IMAPS and POP3 protocols
...
Signed-off-by: Matt Burgess <mattyb149@apache.org>
NIFI-1148 addressed PR comments from @trixpan
NIFI-1148 addressing PR comments
NIFI-1148 addressed PR comments
This closes #710
2016-08-08 11:57:28 -04:00
c1c052af71
NIFI-2406: Ensure that hearbeat monitor continues to run while instance is running. This way if a node sends heartbeat to this node as elected coordinator changes, we notify the node accordingly. Handle Exceptions more gracefully in leader election code. Tweaked some handling of how nodes reconnect to the cluster to ensure more stability with cluster
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #729
2016-08-08 09:15:10 -04:00
d094130a26
NIFI-2237:
...
Extend template handling to read only properties.
* Add read only property handling to type.hbs template.
* Add flag to ProcessorDTO.getRelationships to reflect read only nature of the property.
* Remove explicit "read only" message from ConnectionDTO.getAvailableRelationships to avoid duplicate text.
* This closes #806
2016-08-08 09:06:47 -04:00
e2f649cfea
NIFI-2470 This closes #802 .
...
Fixed WritesAttributes section to include all attributes with the
correct attribute names and descriptions
2016-08-07 23:58:09 -04:00
29f53c07f5
NIFI-2509 This closes #805 . fixed NPE condition in KafkaConsumer
2016-08-07 23:48:57 -04:00
903b1fe465
NIFI-2494 Remove extraneous text that shows on banner line. This closes #793
2016-08-05 16:03:26 -04:00
f2f070c5be
NIFI-2468: Improved UI consistency.
...
- Addressing comments from PR. Moving new service button below the tab pane. (+2 squashed commits)
Squashed commits:
[f746d097d1fb09closes #794 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-05 12:32:06 -07:00
7ffa30d21b
NIFI-2423: Make use of the SSLContextService to provide SSL information
...
Signed-off-by: Oleg Zhurakousky <oleg@suitcase.io>
2016-08-05 14:14:38 -04:00
c39a127ec8
NIFI-2322, NIFI-2423, NIFI-2412 Kafka improvements
...
- Fixed KafkaConsumer's connection block when broker is not available
- Fixed Serializer/Deserializer configs in both Consume/Publish Kafka
- Added sensitive properties for SSL ket/trust stores
NIFI-2322 fixed tests
2016-08-05 14:14:38 -04:00
8d34223265
NIFI-2472: Normalize coordinates for all components in a snippet, not just processors
...
This closes #786
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-04 19:46:39 -04:00
c0a253568e
NIFI-2486: - Authorizing individual bulletins being returned through the bulletin board.
...
This closes #792
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-04 18:41:18 -04:00
04147ac22a
NIFI-2458: - Fixing issue with timezone when the initial provenance result was cancelled.
...
This closes #773 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-04 17:09:21 -04:00
0e0166cec5
NIFI-2483: Removed 'passthrough' relationship
...
This closes #789 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-04 16:12:21 -04:00
7ba10a6dea
NIFI-2484: Ensure that if a Processor throws an Exception from an @OnScheduled method that @OnStopped methods get called
...
This closes #791 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-04 15:34:10 -04:00
aca2a92d6b
Fixing contrib-check in GetHDFSSequenceFileTest
2016-08-04 15:08:08 -04:00
b7b1dc2fe6
NIFI-2471 fix Hadoop configuration resources when talking to multiple Hadoop clusters
...
This closes #779 .
2016-08-04 14:51:03 -04:00
bc6b22389b
NIFI-2407: Fixed NPE
2016-08-04 14:50:30 -04:00
1ea49ad8cf
NIFI-2407 Implements EL support on some properties of processors/services
...
- Added EL support to "Directory" property of ListHDFS and GetHDFS processors
- Added EL support to "Destination" property for ConsumeJMS and PublishJMS processors
- Added EL support to "MQ ConnectionFactory Implementation", "MQ client library path", "Broker URI" properties for the JMS Connection Factory Provider
- Added EL support to "Database Connection URL", "Database Driver Class Name", "DB Driver jar url", "DB username", and "DB password" properties for the DBCP Connection Pool
- Removed NotificationServiceManagerSpec.groovy, previous PR from Joe Witt covers the needed testing for Variable Registry/Value Lookup at this time
This closes #778 .
2016-08-04 14:23:29 -04:00
0d730c5cc1
NIFI-2435 - Wrapping reader call in doAs if necessary
...
This closes #780 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-04 14:01:05 -04:00
321a2398ba
NIFI-2467: - Resetting cached search term when closing the dialog to ensure the same search time works upon re-opening.
...
NIFI-2467: - Fixing issue preventing the selection of an autocomplete result.
This closes #784 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-04 11:22:01 -04:00
3943d72e95
NIFI-1868: Incorporate PutHiveStreaming review comments
...
This closes #706 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-04 10:05:56 -04:00
59659232c7
NIFI-1868: Downgrade to Hive 1.2.1 and remove ConvertAvroToORC
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-04 10:05:45 -04:00
c2019b9339
NIFI-1868: Add PutHiveStreaming processor
...
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-04 10:05:44 -04:00
cda4310ad8
NIFI-2035: Verify existence of source and destination when creating a connection
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #690
2016-08-04 09:11:25 -04:00
7a7165152e
NIFI-2478 Fixed Zk leaders path to include root.
2016-08-04 08:19:04 -04:00
ed5c44ba53
[NIFI-2053] update open/close palettes. This closes #775
2016-08-04 07:59:13 -04:00
fa4c6ab03c
NIFI-2193 - Added functionality to automate certificate generation, keystore and truststore generation, and nifi.properties keystore and truststore password population. Follow-on changes will be made under NIFI-2476.
...
This closes #695 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
Defaulting to same keyStore, key password (+18 squashed commits)
Squashed commits:
[9d01ba0] NIFI-2193 - Fixing typo
[55440bc] NIFI-2193 - Standalone can run as long as there are no conflicting files/folders
[0ca34ed] NIFI-2193 - Fixing some filename, absolute path issues
[9d4f65b] NIFI-2193 - Incorporating feedback
[f7550b4] NIFI-2193 - Cleaning up imports
[59a7637] NIFI-2193 - Updating umask to allow owner to execute
[cf824e7] NIFI-2193 - Moving DN arg to CA service specific parent class
[921ee13] NIFI-2193 - Making keystore getInstance more consistent
[a283c4b] NIFI-2193 - Updating sample config files in assembly to reflect new structure
[8d3a21d] NIFI-2193 - Making TlsHelper static, adding option to use same password for Key, KeyStore
[b13d247] NIFI-2193 - Addressing PR feedback
[46ef8ed] NIFI-2193 - Removing commons-logging, log4j from notice
[d4cf41a] NIFI-2193 - Adding option to specify output file for CA certificate when using cli client
[b74bf25] NIFI-2193 - Removing Bouncy Castle from notice
[6e34f9a] NIFI-2193 - Adding CLI client for easier generation of client certificates
[2924fca] NIFI-2193 - nifi-toolkit-ssl -> nifi-toolkit-tls, removing unused constants
[886167e] NIFI-2193 - Adding slf4j to avoid runtime issue
[082de46] NIFI-2193 - Command line SSL config utility as well as certificate authority client/server
2016-08-03 21:34:11 -07:00
f0401e4774
NIFI-2419: Ensure that if a node is disconnected that we unregister for 'cluster coordinator' and 'primary node' roles by updating FlowController to know that it is disconnected. Also removed dead code that was needed in the master-worker clustering paradigm but not for zero-master-clustering
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #739
2016-08-03 23:38:50 -04:00
c26398eaba
NIFI-2402: - Removing client side check component move eligibility and instead relaying on verification server side. Cannot check client side as the current user may not have permissions to inspect required fields.
...
This closes #750
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-03 19:08:25 -04:00
83a23f90d4
NIFI-2466: Added option to provide separate key password to StandardSSLContextService.
...
Fixed NPE (+2 squashed commits)
Squashed commits:
[c5d521aaa4d418closes #776 .
Signed-off-by: Andy LoPresto <alopresto@apache.org>
2016-08-03 15:56:12 -07:00
1511887a68
NIFI-2301: - Ensure all component specific policies are removed when the component is removed. - Allowing snippets to be created if the user has read or write access as we don't know what the intended snippet usage. When used the snippet is still authorized accordingly. - Ensuring actions involving Process Groups correctly authorize encapsulated components. - Not requiring read permissions when showing the delete button for Controller Services and Reporting Tasks.
...
This closes #757
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-03 18:06:30 -04:00
9338f102cb
NIFI-2237:
...
- Updating Rest Endpoint documentation specifically regarding access policies.
- Ensuring the resource listing is accurate.
- Removing unnecessary code.
2016-08-03 16:18:30 -04:00
fca59ff9d0
NIFI-2438:
...
- If a node reports forbidden, using an appropriate response failure exception.
This closes #760 .
2016-08-03 15:01:04 -04:00
698cde69ba
NIFI-2453 Making FileAuthorizer perform initial seeding when users and groups are already present
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #772
2016-08-03 11:59:03 -04:00
16348b071d
NIFI-2452: This closes #771 . Ensure that we keep track of how many references we have to each lucene searcher and only close the underlying index reader if there are no references to the searcher. Also updated to prefer newer provenance events over older provenance events, and calculate FlowFile lineage based on an event id instead of a FlowFile UUID, as it's much more efficient
2016-08-03 08:05:26 -07:00
e9b87dd734
NIFI-2452: Ensure that we do not close Index Readers that are still in use
2016-08-03 07:54:10 -07:00
bc5237593e
NIFI-2291: Correct the Content URI for 1.0.0 REST API; added cluster node identifier & whether or not clustered to ReportingContext so that the Reporting Task could make use of it
...
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>
This closes #752
2016-08-03 10:35:11 -04:00
54549891e3
NIFI-2444 NIFI-2445 fixed PublishKafka
...
- fixed the logging issue NIFI-2444 by ensuring the ProcessLog is added to KafkaPublisher
- fixed KafkaPublisher's isAllAcked operation to ensure that it properly reports that the flow file has failed.
- added additional test
This closes #758 .
2016-08-02 20:30:34 -04:00
52d97f966d
NIFI-2443: - Addressing issue where reload group deferred was being resolved prematurely.
...
This closes #756
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-02 17:06:25 -04:00
2a6580992b
NIFI-2455 Removing 'Queue Buffering Max Time' as a required property of PutKafka. This closes #765
2016-08-02 17:01:58 -04:00
ecca76099a
NIFI-2427: - Only showing read/write data policies for applicable components. Disabling for labels, controller services, reporting tasks, and templates.
...
This closes #748
Signed-off-by: jpercivall <joepercivall@yahoo.com>
2016-08-02 16:25:02 -04:00
a1bb94c08a
NIFI-1869 Cloning controller services when referenced by reporting tasks and upgrading from 0.x to 1.0.0. This closes #767
2016-08-02 16:09:54 -04:00
df11e1d2c0
NIFI-2425 fixed ControllerService referebcing in DTOs/Templates. This closes #770
2016-08-02 13:58:19 -04:00
c10d11d378
NIFI-2339 made exception statements more vague and generally limited to identifiers only to avoid any authorization issues. This closes #764
2016-08-02 12:21:43 -04:00
6bcc415eb8
NIFI-2457 removed old state file mechanism and fixed state reset logic
...
This closes #768 .
Signed-off-by: Bryan Bende <bbende@apache.org>
2016-08-02 12:11:43 -04:00
e23b235617
NIFI-2028 This closes #714 . This closes #751 . fixed typo in classname
2016-08-02 09:13:41 -04:00
Matt Burgess
Andy LoPresto
Pierre Villard
Mike Moser
Bryan Rosander
jpercivall
Matt Gilman
Scott Aslan
Davy De Waele
Joe Gresock
Bryan Bende
Koji Kawamura
Randy Gelhausen
Wesley-Lawrence
Mark Payne
Byunghwa Yun
jpercivall
joewitt
Joey Frazee
Jeff Storck
Oleg Zhurakousky
Kathik Narayanan
Peter Wicks
James Wing
Andre F de Miranda
Mathias Tiberghien
João Henrique Ferreira de Freitas
Brian Eugley
patricker
Joe N
Andrew Lim
simplesteph
Michal Klempa
d810146
Edgardo
Stephane Maarek
Keren Tseytlin
Peter Mitchell
mans2singh
Yolanda M. Davis
Bartosz Wozniak
Nicolas Dupont
Aldrin Piri
Toivo Adams
Joe Skora
Kirk Tarou
vijayk
Bryan Rosander
Andrew Psaltis
Ramiz
ricky
Simon Elliston Ball
Tim Reardon
Joe Skora
Scott Aslan