Apache
/
nifi
mirror of https://github.com/apache/nifi.git
1
0
Fork 0
Code Issues Packages Projects Releases Wiki Activity
2,881 Commits 143 Branches 197 Tags 391 MiB
Commit Graph

2881 Commits

Author SHA1 Message Date
Mark Payne 95b5877f5d NIFI-2600: Ensure that we do not close Index Searchers prematurely, even if they are poisoned 
This closes #896
 2016-08-22 12:03:47 -04:00
Joe Skora a2d3d0c289 Update to support offsets larger than 2 gigabyte. 2016-08-22 11:02:48 -04:00
Matt Burgess b7dc21bd95 NIFI-2547: Fixed checkstyle errors and updated to reflect KerberosProperties changes 2016-08-21 10:26:40 -04:00
ricky 26d362b144 NIFI-2547: Add DeleteHDFS Processor 
This processor adds the capability to delete files or
directories inside of HDFS.

Paths supports both static and expression language values,
as well as glob support (e.g. /data/for/2016/07/*).

This processor may be used standalone, as well as part of a
downstream connection.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

Add Glob Matcher with Tests

Also set displayName on properties.

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #850
 2016-08-21 10:10:21 -04:00
Koji Kawamura a919844461 NIFI-2567: Site-to-Site to send large data via HTTPS 
- It couldn't send data larger than about 7KB due to the mis-use of
  httpasyncclient library
- Updated httpasyncclient from 4.1.1 to 4.1.2
- Let httpasyncclient framework to call produceContent multiple times as
  it gets ready to send more data via SSL session
- Added HTTPS test cases to TestHttpClient, which failed without this
  fix
 2016-08-19 14:24:53 -04:00
Joe Skora 02071103d0 * Add "Remove All Content" property, related functionality, and tests to ModifyBytes processor to allow deletion of all flow file content. 
* Removed @Ignore annotation on class and unnecessary EOL translation of test data.  Because ModifyBytes treat input as binary data, not text, line endings don't matter as long as they byte offsets are calculated correctly.
* Replace validator with .allowableValues.

This closes #890.
 2016-08-19 20:05:14 +02:00
Matt Gilman 3378426f35 NIFI-2581: Keeping context menu and tooltips open when refreshing the canvas. 
This closes #899.
 2016-08-19 19:36:26 +02:00
Scott Aslan a181c7b9d7 [NIFI-2601] Update bower.json to use specific versions. This closes #897 2016-08-19 10:34:48 -04:00
Jeff Storck 31ca8d02f7 NIFI-2488 Fixed BulletinDTOs not getting their node addresses set properly during bulletin merging. This closes #888 2016-08-19 08:32:00 -04:00
Matt Burgess 46b81058c7 NIFI-2602: Fixed NPE in SelectHiveQL when CSV output and null column value 
This closes #898.
 2016-08-19 09:56:26 +02:00
Matt Gilman 6b5950647a NIFI-2596: 
- Adding tooltip for property descriptor on mouse enter of table cell.

This closes #893.
 2016-08-18 17:23:30 -04:00
Matt Gilman 57648308db NIFI-2597: 
- Updating the correct object when attempting to create a self loop.
 2016-08-18 17:15:16 -04:00
Matt Gilman 87161ab96e
NIFI-2595: - Updating ReportingTasks to use ComponentLogger instead of creating Controller level bulletins. 
- Making the bulletin responses consistent in that all bulletins will be included but in redacted form as appropriate.
- Fixing broken unit test.

This closes #892.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-18 17:06:28 -04:00
Matt Gilman f3387426a0 NIFI-2587: 
- Adding additional authorization for accessing component property history.
 2016-08-18 17:05:32 -04:00
Matt Burgess 6874a5d82d NIFI-2593: This closes #891. Fixed handling of nested records/structs in ConvertAvroToORC 2016-08-18 15:15:51 -04:00
Sarah Olson 4847ed28a1 NIFI-2410: This closes #885. updates to the Controller Services information in the User Guide. 2016-08-18 13:48:00 -04:00
Matt Burgess a74bc2c7c7 NIFI-2598: This closes #889. Fixed issue with static init of properties in HiveConnectionPool 2016-08-18 13:38:22 -04:00
Bryan Bende e0e4b3407a NIFI-2574 This clsoes #887. Fixing NPE when using kerberos keytab location from contexts, and cleaning up hadoop/hbase/hive kerberos variables 2016-08-18 12:19:46 -04:00
Scott Aslan 0e90a0f76a [NIFI-2488] update UI to relect changes to ActionDTO and BulletinDTO. This closes #882 2016-08-18 09:38:16 -04:00
Jeff Storck 08735a4f57 NIFI-2488 Wrapping ActionDTO and BulletinDTO in entities to be able to provide readability permission to the client 2016-08-18 09:37:11 -04:00
Bryan Rosander d4bbd647c5
NIFI-2586 - Javadocs, ExitCode cleanup, password generation improvement, setting cluster secure to true, making properties writer more flexible 
This closes #879.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-18 09:26:32 -04:00
Mark Payne 567535c3d0 NIFI-2382: Fixed typo in documentation 2016-08-18 09:15:55 -04:00
Mark Payne 91a59a8a5a NIFI-2545: Ensure that when @OnUnscheduled and @OnStopped methods are called that the active thread count takes that thread into account 
This closes #836.
 2016-08-18 08:33:45 -04:00
Bryan Rosander 5b58e5a251
NIFI-2477 - Updating admin guide to account for NIFI-2476 NIFI-2477 - Adding client dn to doc, examples 
This closes #875.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-17 16:36:40 -04:00
Andrew Lim 9a16ca72d7
NIFI-2477 Document TLS generation tool in Admin and Developer Guides 
Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-17 16:36:25 -04:00
Sarah Olson 74661e6623 NIFI-2556 This closes #868. Updated User Guide with informaiton about custom properties 2016-08-17 13:24:49 -07:00
Peter Wicks 7bc7b7f683
NIFI-2584 Fixing date format in PutSQL 
This closes #878.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-17 16:10:56 -04:00
Matt Gilman 3d1a24ab7d NIFI-2578: 
- Ensuring NiFi still attempts to issue a registration request to support 1.x -> 0.x site to site.
 2016-08-17 15:35:16 -04:00
Oleg Zhurakousky a0fab15eb7 NIFI-2519 polishing remote address formatting to avoid NPE and other potential exceptions. 
This closes #871
 2016-08-17 15:13:05 -04:00
Andre F de Miranda e7288af859 NIFI-2519 - ListenSMTP addresses mismatch between smtp.src attribute documentation and attribute.put 2016-08-17 14:58:02 -04:00
Andy LoPresto 0ffdc2eb92
Merge branch 'master' of https://github.com/apache/nifi 
(Apologies for merge commits, but it was not possible to rebase the 2574 commits (PR 872)).

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-08-17 10:58:38 -07:00
joewitt b2e468ecf8
NIFI-2574 updated to reflect new accessor methods for nifi properties with kerberos service 
This closes #872.

Signed-off-by: Andy LoPresto <alopresto@apache.org>
 2016-08-17 10:51:55 -07:00
Peter Wicks a0d1aae603 NIFI-2583 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2582

Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2582

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #877
 2016-08-17 13:20:44 -04:00
Peter Wicks 1470a52b1b NIFI-2582 NIFI-2583 
Signed-off-by: Matt Burgess <mattyb149@apache.org>

NIFI-2583 Tweaks

Signed-off-by: Matt Burgess <mattyb149@apache.org>

This closes #877
 2016-08-17 13:19:56 -04:00
joewitt a5261914fb NIFI-2574 merging latest kerb changes to adjust for NiFiProperties 2016-08-17 09:06:18 -07:00
joewitt 7c99b5e638 NIFI-2574 fixed queue swap threshold setting 2016-08-17 09:05:36 -07:00
Matt Gilman 3f7216ab84 NIFI-2561: - Decoupling kerberos service and spnego principles and keytabs. 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #873
 2016-08-17 08:14:05 -04:00
joewitt d9633757a6 NIFI-2574 fix spring context definitions 2016-08-17 03:38:31 -07:00
joewitt 6bf7e7f325 NIFI-2574 merging master with cluster changes to updated NiFiProperties approach 2016-08-17 01:23:54 -07:00
joewitt 7d7401add4 NIFI-2574 Changed NiFiProperties to avoid static initializer and updated all references to it. 2016-08-17 00:10:07 -07:00
Mark Payne e42ea9ad45 NIFI-2566: Refactored to allow just the Leader Election Manager to be responsible for determining who is the Cluster Coordinator 
NIFI-2566: Removed storage of cluster roles from heartbeats and NodeConnectionStatus; use LeaderElectionManager to determine roles instead

NIFI-2566: Updated Heartbeats so that if a node is out-of-sync with cluster topology, cluster coordinator will provide updated information back to the nodes

NIFI-2566: Fixed issue that prevented standalone instance from starting by creating a standalone-instance version of the Leader Election Manager. Also added Controller Service enabled/disabled state to fingerprint rather than attempting to update the state when joining the cluster, as the implementation was incorrect and the correct implementation will be a rather significant effort that doesn't have to happen for 1.0.0 release

This closes #866

Signed-off-by: jpercivall <joepercivall@yahoo.com>
 2016-08-16 20:39:04 -04:00
Matt Gilman b3f36489ad
NIFI-2534: - Refreshing using component IDs. - Code clean up. 
This closes #874.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-16 16:05:20 -04:00
Bryan Rosander 2fd39676a8
NIFI-2569 - Multiple instances on same host, range enhancements, nifi.properties incrementing ports NIFI-2569 - Updating main class in windows bat file 
This closes #861.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-16 15:20:46 -04:00
Simon Elliston Ball b0122c6a73
NIFI-2465 - InferAvroSchema EL support based on incoming FlowFiles 
This closes #863.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-16 12:50:53 -04:00
Scott Aslan 26f5c496d1
NIFI-2534 Fix JS error when stopping a process group 
This closes #867.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-16 11:09:41 -04:00
Peter Wicks b22500d0a3
NIFI-2576 Allowing PutSQL to use timestamps in epoch or string format 
This closes #869.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-16 10:26:24 -04:00
Matt Burgess 03d3b3961d NIFI-2577: Increased default stripe size in ConvertAvroToORC to 64MB 
This closes #870.
 2016-08-16 11:53:05 +02:00
Mark Payne 6af768d0a1 NIFI-2551: Addressed a threading issue in the StandardResourceClaimManager and performed some refactoring so that we can ensure thread-safety across different components of the application, such as ProcessSession and WriteAheadFlowFile Repository when interacting with the StandardResourceClaimManager. Update DebugFlow to allow it to write to a FlowFile multiple times, which exposes the concurrency bug. Also avoided calling ContentRepository.remove() from ProcessSession whenever the content is no longer needed, as that can cause problems now that the Resource Claim is backing the content claim. 2016-08-15 17:02:15 -04:00
Matt Burgess ed42f2e3e3 NIFI-2552: Updated Curator for HiveQL processors using Zookeeper quorum in URL 
Signed-off-by: Yolanda M. Davis <ymdavis@apache.org>

This closes #865
 2016-08-15 16:53:57 -04:00
Matt Gilman 7d8dd27027
NIFI-2554: - Requiring READ permissions on the referenced controller service when creating/updating processors, controller services, and reporting tasks. 
- Preventing client side selection of unauthorized controller services unless they were the previously configured value.

This closes #860.

Signed-off-by: Bryan Bende <bbende@apache.org>
 2016-08-15 16:46:58 -04:00