Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,903 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

2363 Commits

Author SHA1 Message Date
zouxiangwen 6855143ba9 HBASE-22292 PreemptiveFastFailInterceptor clean repeatedFailuresMap issue 
Signed-off-by: stack <stack@apache.org>
 2019-04-23 07:56:59 -07:00
Jan Hentschel 3dfa98ffc1 HBASE-22258 Removed deprecated methods in VisibilityClient 2019-04-23 16:45:02 +02:00
Michael Stack da286b9087
Merge pull request #158 from hextriclosan/HBASE-22047 
HBASE-22047 LeaseException in Scan should be retried
 2019-04-23 06:18:43 -07:00
Jan Hentschel 1f0e43a27a HBASE-22232 Removed deprecated methods in CompareFilter 2019-04-23 13:25:17 +02:00
zhangduo c3c48f30f7 HBASE-22279 Add a getRegionLocator method in Table/AsyncTable interface 2019-04-22 18:37:23 +08:00
zhangduo 38ff46f88f HBASE-22282 Should deal with error in the callback of RawAsyncHBaseAdmin.splitRegion methods 2019-04-22 16:44:38 +08:00
zhangduo b0075a160a HBASE-22278 RawAsyncHBaseAdmin should not use cached region location 2019-04-21 22:04:01 +08:00
zhangduo eb912bb1da HBASE-22261 Make use of ClusterStatusListener for async client 2019-04-21 22:03:43 +08:00
Jan Hentschel 226c90c058 HBASE-22276 Removed deprecated UnmodifyableHRegionInfo 2019-04-21 10:46:58 +02:00
zhangduo 0645d5a033 HBASE-22267 Implement client push back for async client 2019-04-21 16:31:49 +08:00
Jan Hentschel f30d6c958a HBASE-22231 Removed unused and '*' imports 2019-04-20 22:03:32 +02:00
zhangduo 353f9226c3 HBASE-22236 AsyncNonMetaRegionLocator should not cache HRegionLocation with null location 2019-04-20 08:56:11 +08:00
zhangduo a3d2a2df3a HBASE-22244 Make use of MetricsConnection in async client 2019-04-18 22:13:27 +08:00
Jan Hentschel f4aaf735e4 HBASE-22259 Removed deprecated method in ReplicationLoadSource 2019-04-18 11:32:55 +02:00
Sayed Anisul Hoque 09f484b1a0 HBASE-22260 Removed deprecated methods in ReplicationLoadSink 2019-04-18 08:44:22 +02:00
Igor Rudenko 375ac55d77 HBASE-22047 LeaseException in Scan should be retried 2019-04-16 20:03:29 +03:00
Sayed Anisul Hoque 88de644736 HBASE-22243 Removed deprecated method in Result 2019-04-15 16:46:10 +02:00
Jan Hentschel 7d1399caa7 HBASE-22242 Removed deprecated method in RegionLoadStats 2019-04-15 08:45:18 +02:00
Jan Hentschel 9c13dde84b HBASE-22228 Removed deprecated ThrottlingException 2019-04-13 10:50:10 +02:00
Jan Hentschel 37e93c311a HBASE-22227 Removed deprecated fields in ServerSideScanMetrics 2019-04-13 10:48:39 +02:00
Jan Hentschel bc58adac5b HBASE-22187 Removed remaining usages of ClusterConnection.clearRegionCache 2019-04-12 09:58:20 +02:00
Josh Elser 2bae04fb2b HBASE-22144 Correct MultiRowRangeFilter to work with reverse scans 
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
 2019-04-11 17:49:39 -04:00
stack 387a5da462 HBASE-22155 Move 2.2.0 on to hbase-thirdparty-2.2.0 2019-04-09 09:40:19 -07:00
Jingyun Tian bd2f04dd54 HBASE-21965 Fix failed split and merge transactions that have failed to roll back 2019-04-09 19:56:18 +08:00
meiyi d32f924ef4 HBASE-22117 Move hasPermission/checkPermissions from region server to master 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-04-09 17:01:01 +08:00
zhangduo 11547b79f3 HBASE-22178 Introduce a createTableAsync with TableDescriptor method in Admin 2019-04-07 21:06:00 +08:00
zhangduo 0247466210 HBASE-22179 Fix RawAsyncHBaseAdmin.getCompactionState 2019-04-07 08:31:44 +08:00
zhangduo 0ca97d482a HBASE-22177 Do not recreate IOException in RawAsyncHBaseAdmin.adminCall 2019-04-07 08:30:31 +08:00
Duo Zhang 04937baf7b HBASE-22158 RawAsyncHBaseAdmin.getTableSplits should filter out none default replicas 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-04-05 22:14:36 +08:00
Duo Zhang 3e8152837e HBASE-22157 Include the cause when constructing RestoreSnapshotException in restoreSnapshot 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-04-04 10:45:14 +08:00
zhangduo cd2374a7f0 HBASE-22108 Avoid passing null in Admin methods 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-04-02 21:13:17 +08:00
zhangduo 1c4e705592 HBASE-22135 AsyncAdmin will not refresh master address 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-04-01 09:23:43 +08:00
pingsutw 51dda380a6 HBASE-22101 AsyncAdmin.isTableAvailable should not throw TableNotFoundException 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-30 20:41:19 +08:00
zhangduo 7fe31b060f HBASE-22121 AsyncAdmin can not deal with non default meta replica 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-30 20:18:44 +08:00
Sakthi caa9650a70 HBASE-22094: Throw TableNotFoundException if table not exists in AsyncAdmin.compact 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-27 20:14:12 +08:00
pingsutw 56dd309b21 HBASE-22102 Remove AsyncAdmin.isTableAvailable(TableName, byte[][]) 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-27 17:45:01 +08:00
meiyi 7b3ff56202 HBASE-21911 Move getUserPermissions from regionserver to master 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-27 11:22:21 +08:00
zhangduo 5f6143ebde HBASE-22074 Should use procedure store to persist the state in reportRegionStateTransition 2019-03-26 18:13:59 +08:00
yaojingyi f8524b8f8e HBASE-21964 unset Quota by Throttle Type 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-26 09:42:50 +08:00
zhangduo 386703811d Revert "HBASE-21965 Fix failed split and merge transactions that have failed to roll back" 
This reverts commit 7e3ca7063c.
 2019-03-24 13:51:34 +08:00
pingsutw 21cb00eef6 HBASE-22064 Remove Admin.deleteSnapshot(byte[]) 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-23 21:27:12 +08:00
Jingyun Tian 7e3ca7063c HBASE-21965 Fix failed split and merge transactions that have failed to roll back 2019-03-22 17:11:50 +08:00
niuyulin cbd9c9b2e1 HBASE-22065 Add listTableDescriptors(List<TableName>) method in AsyncAdmin 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-21 22:35:45 +08:00
xujunhong 556b98101c HBASE-22063 Deprecated Admin.deleteSnapshot(byte[]) 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-21 22:28:10 +08:00
Rishabh Jain b4b4854371 HBASE-22042 Missing @Override annotation for RawAsyncTableImpl.scan 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-19 17:01:20 +08:00
meiyi 86dd92cccb HBASE-22015 UserPermission should be annotated as InterfaceAudience.Public 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-19 14:41:22 +08:00
pingsutw f65bf79d1d HBASE-22056 Unexpected blank line in ClusterConnection 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-03-18 15:54:29 -04:00
zhangduo cc55835d03 HBASE-22040 Add mergeRegionsAsync with a List of region names method in AsyncAdmin 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-03-18 20:45:21 +08:00
Duo Zhang f1ebbb928b HBASE-22039 Should add the synchronous parameter for the XXXSwitch method in AsyncAdmin 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-03-16 10:05:54 +08:00
Nihal Jain 01e5af5a34 HBASE-20662 Increasing space quota on a violated table does not remove SpaceViolationPolicy.DISABLE enforcement 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-03-15 12:16:58 -04:00
Duo Zhang 3c5761e365 HBASE-22002 Remove the deprecated methods in Admin interface 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-03-14 21:42:23 +08:00
zhangduo 10ca598004 HBASE-22001 Polish the Admin interface 
Signed-off-by: stack <stack@apache.org>
 2019-03-11 14:38:31 +08:00
Norbert Kalmar 8d3e7517e6 HBASE-21416 - fix TestRegionInfoDisplay flaky test 2019-03-08 09:18:17 -08:00
zhangduo 6e3987cf02 HBASE-22007 Add restoreSnapshot and cloneSnapshot with acl methods in AsyncAdmin 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-03-08 18:03:00 +08:00
johnhomsea 63d0e6ed4a HBASE-22000 Deprecated isTableAvailable with splitKeys 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-03-07 09:18:01 +08:00
zhangduo c9804758d1 HBASE-21983 Should track the scan metrics in AsyncScanSingleRegionRpcRetryingCaller if scan metrics is enabled 2019-03-03 19:08:23 +08:00
zhangduo 1e12e88492 HBASE-21978 Should close AsyncRegistry if we fail to get cluster id when creating AsyncConnection 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-03 08:19:07 +08:00
meiyi 841a45afb7 HBASE-21974 Change Admin#grant/revoke parameter from UserPermission to user and Permission 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-02 23:41:48 +08:00
Syeda 030b4d12fb HBASE-21487 Concurrent modify table ops can lead to unexpected results 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-02 13:00:19 +08:00
Duo Zhang cbdbe6572b HBASE-21976 Deal with RetryImmediatelyException for batching request 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-02 12:14:16 +08:00
meiyi 9370347efe HBASE-21820 Implement CLUSTER quota scope 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-27 18:23:45 +08:00
Duo Zhang b1c42f1009 HBASE-21961 Infinite loop in AsyncNonMetaRegionLocator if there is only one region and we tried to locate before a non empty row 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-27 17:54:50 +08:00
Guanghao Zhang 6e06a0d790 HBASE-20724 Sometimes some compacted storefiles are still opened after region failover 2019-02-27 15:45:42 +08:00
Duo Zhang c33ceb23d3 HBASE-21943 The usage of RegionLocations.mergeRegionLocations is wrong for async client 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-26 11:21:55 +08:00
zhangduo aa7d3ce39f HBASE-21944 Validate put for batch operation 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-24 20:19:51 +08:00
zhangduo b73f03e0cb Revert "HBASE-21943 The usage of RegionLocations.mergeRegionLocations is wrong for async client" 
This reverts commit 449ed0834b.
 2019-02-24 20:14:17 +08:00
zhangduo a47c1ddcd2 HBASE-21945 Maintain the original order when sending batch request 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-24 17:55:49 +08:00
Duo Zhang 449ed0834b HBASE-21943 The usage of RegionLocations.mergeRegionLocations is wrong for async client 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-24 17:34:12 +08:00
Guanghao Zhang 0fc5173eef HBASE-21922 BloomContext#sanityCheck may failed when use ROWPREFIX_DELIMITED bloom filter 2019-02-23 23:25:01 +08:00
Duo Zhang f0032c9255 HBASE-20587 Replace Jackson with shaded thirdparty gson 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-02-22 16:24:51 +08:00
Wellington Chevreuil 482b505796 HBASE-21505 - proposal for a more consistent report on status 
Signed-off-by: Jingyun Tian <tianjy@apache.org>
 2019-02-22 12:08:38 +08:00
meiyi dfb95cfd83 HBASE-21938 Add a new ClusterMetrics.Option SERVERS_NAME to only return the live region servers's name without metrics 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-22 10:41:51 +08:00
meiyi 9a55cbb2c1 HBASE-21783 Support exceed user/table/ns throttle quota if region server has available quota 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-21 15:36:37 +08:00
zhangduo a551149ca7 HBASE-21927 Always fail the locate request when error occur 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-02-20 19:47:28 +08:00
Jingyun Tian eedc33dfd2 Revert "HBASE-21505 - proposal for a more consistent report on status" 
This reverts commit c578020588.
 2019-02-20 18:06:42 +08:00
zhangduo e984515b74 HBASE-21928 Deprecated HConstants.META_QOS 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-02-20 14:16:40 +08:00
zhangduo e257f4698c HBASE-21930 Deal with ScannerResetException when opening region scanner 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-02-20 11:03:56 +08:00
Wellington Chevreuil c578020588 HBASE-21505 - proposal for a more consistent report on status 
Signed-off-by: Jingyun Tian <tianjy@apache.org>
 2019-02-19 10:51:05 +08:00
Nihal Jain 593745e8ac HBASE-17942 Disable region splits and merges per table 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-19 07:15:27 +08:00
Duo Zhang 6176471957 HBASE-21907 Should set priority for rpc request 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-18 19:46:17 +08:00
zhangduo dedab71381 HBASE-21909 Validate the put instance before executing in AsyncTable.put method 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-02-16 17:47:38 +08:00
zhangduo 0b2b474b4c HBASE-21908 Remove Scan.getScanMetrics 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-02-16 17:39:31 +08:00
Duo Zhang 81e1e2f943 HBASE-21910 The nonce implementation is wrong for AsyncTable 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-15 20:24:34 +08:00
Duo Zhang 8bed65fa01 HBASE-21900 Infinite loop in AsyncMetaRegionLocator if we can not get the location for meta 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-14 19:50:02 +08:00
Duo Zhang e06beb0d72 HBASE-21888 Add a isClosed method to AsyncConnection 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-14 11:41:16 +08:00
zhangduo f1e5999ad2 HBASE-21859 Add clearRegionLocationCache method for AsyncConnection 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-13 10:07:29 +08:00
zhangduo 28bc9a51e1 HBASE-21862 IPCUtil.wrapException should keep the original exception types for all the connection exceptions 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-02-10 09:37:14 +08:00
zhangduo 6f16836c20 HBASE-21857 Do not need to check clusterKey if replicationEndpoint is provided when adding a peer 
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-02-08 19:47:37 +08:00
zhangduo 2b1b79f08b HBASE-21829 Use FutureUtils.addListener instead of calling whenComplete directly 2019-02-03 15:24:54 +08:00
zhangduo 89c02dc0cc HBASE-21828 Make sure we do not return CompletionException when locating region 2019-02-02 21:13:45 +08:00
Tommy Li 513ba9ac59 HBASE-21775 ADDENDUM - fix TestAsyncProcess 2019-01-30 15:40:55 -08:00
wanghuan 16c7f5dac9 HBASE-21699 Fixed create table failed when using SPLITS_FILE => 'splits.txt' 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-30 15:56:25 +08:00
meiyi f997252344 HBASE-21739 Move grant/revoke from regionserver to master 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-30 11:16:57 +08:00
Duo Zhang 7dc69b6128 HBASE-21792 Mark HTableMultiplexer as deprecated and remove it in 3.0.0 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-29 09:08:02 +08:00
zhangduo 274e4ccea8 HBASE-21789 Rewrite MetaTableAccessor.multiMutate with Table.coprocessorService 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-27 11:36:58 +08:00
Tommy Li e92b62be54 HBASE-21775 The BufferedMutator doesn't ever refresh region location cache 
Fix server location metadata refresh in multi-actions

Signed-off-by: stack <stack@apache.org>
 2019-01-26 13:10:22 -08:00
Duo Zhang 4f3b95b318 HBASE-21762 Move some methods in ClusterConnection to Connection 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-01-25 21:13:44 +08:00
meiyi 281558a3ab HBASE-21713 Support set region server throttle quota 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-25 13:50:42 +08:00
Wellington Chevreuil 54093b0d1f HBASE-20215 - Rename CollectionUtils to ConcurrentMapUtils 2019-01-24 20:55:15 -08:00
zhangduo e43c833145 HBASE-21770 Should deal with meta table in HRegionLocator.getAllRegionLocations 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-25 11:00:51 +08:00
zhangduo 416b70f461 HBASE-21761 Align the methods in RegionLocator and AsyncTableRegionLocator 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-24 15:21:11 +08:00
xujunhong d4085d11bc HBASE-21715 set timeout instead of throwing Exception when calling ProcedureFuture.get in client side. 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-01-24 14:55:12 +08:00
Kevin 250431144f HBASE-21716 Add toStringCustomizedValues to TableDescriptor 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-01-24 11:32:16 +08:00
Tommy Li d187af00ca HBASE-21720 : metric to measure how actions are distributed to servers within a MultiAction 
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
 2019-01-23 17:52:58 -08:00
Duo Zhang dfad304ddb HBASE-21753 Support getting the locations for all the replicas of a region 2019-01-23 18:09:39 +08:00
huzheng 35ed5d6c39 HBASE-21750 Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized 2019-01-22 19:58:03 +08:00
huzheng b0131e19f4 HBASE-21734 Some optimization in FilterListWithOR 2019-01-22 11:40:37 +08:00
Duo Zhang 882bd564f4 HBASE-21726 Add getAllRegionLocations method to AsyncTableRegionLocator 2019-01-19 11:14:35 +08:00
zhangduo 44dc872b7b HBASE-19695 Handle disabled table for async client 
Signed-off-by: tianjingyun <tianjy1990@gmail.com>
 2019-01-17 18:34:12 +08:00
Duo Zhang 594341d6fe HBASE-21710 Add quota related methods to the Admin interface 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-16 21:08:47 +08:00
Duo Zhang 348cbf63ec HBASE-21732 Should call toUpperCase before using Enum.valueOf in some methods for ColumnFamilyDescriptor 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-01-16 20:46:14 +08:00
Peter Somogyi 51c58e083c HBASE-21727 Simplify documentation around client timeout 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-16 11:32:46 +01:00
huzheng 15031c5bd5 HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case 2019-01-16 09:41:02 +08:00
Sakthi 93d4b95b3f HBASE-21225: Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE' 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-01-14 17:55:42 -07:00
zhangduo c5691a9f60 HBASE-21705 Should treat meta table specially for some methods in AsyncAdmin 2019-01-13 13:40:52 +08:00
Duo Zhang fbf79373e6 HBASE-21663 Add replica scan support 2019-01-11 14:19:05 +08:00
Duo Zhang 7bebdff6a2 HBASE-21580 Support getting Hbck instance from AsyncConnection 2019-01-11 11:26:44 +08:00
meiyi 620d70d618 HBASE-21694 Add append_peer_exclude_tableCFs and remove_peer_exclude_tableCFs shell commands 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-09 22:02:21 +08:00
Sergey Shelukhin 37bc1686d6 HBASE-21614 RIT recovery with ServerCrashProcedure doesn't account for all regions 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-01-09 20:03:37 +08:00
zhangduo d957f0fa19 HBASE-21684 Throw DNRIOE when connection or rpc client is closed 2019-01-08 16:40:40 +08:00
zhangduo 4f0514e39a HBASE-21682 Support getting from specific replica 2019-01-08 09:49:12 +08:00
meiyi 77db1fae09 HBASE-21159 Add shell command to switch throttle on or off 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-07 14:21:41 +08:00
zhangduo db66e6cc9e HBASE-17356 Add replica get support 2019-01-03 08:38:20 +08:00
Sakthi b2bf22e209 HBASE-21631: list_quotas should print human readable values for LIMIT 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-12-22 22:00:58 +08:00
openinx e160b5ac8d HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
 2018-12-21 15:21:53 -08:00
Guanghao Zhang ad819380c7 HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result 2018-12-21 09:49:24 +08:00
meiyi 1b08ba7385 HBASE-21578 Fix wrong throttling exception for capacity unit 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-12-14 18:17:47 +08:00
Sakthi f88224ee34 HBASE-21453 Convert ReadOnlyZKClient to DEBUG instead of INFO 2018-12-11 08:18:02 +01:00
zhangduo b09b87d143 HBASE-21570 Add write buffer periodic flush support for AsyncBufferedMutator 2018-12-11 14:51:26 +08:00
Josh Elser 8a68f0d656 HBASE-21524 Fix logging in ConnectionImplementation.isTableAvailable() 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-11-29 11:40:06 -05:00
zhangduo 1acbd36c90 HBASE-21154 Remove hbase:namespace table; fold it into hbase:meta 2018-11-26 14:51:56 +08:00
meiyi 5ded294419 HBASE-21034 Add new throttle type: read/write capacity unit 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-11-21 09:46:49 +08:00
Reid Chan 130057f137 HBASE-21255 [acl] Refactor TablePermission into three classes (Global, Namespace, Table) 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-11-15 11:34:16 +08:00
Ben Lau d9f32137b6 HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-11-08 11:59:34 -08:00
tianjingyun 116eee6747
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-10-29 20:55:37 -07:00
Guanghao Zhang 23b7510ae2 HBASE-21365 Throw exception when user put data with skip wal to a table which may be replicated 2018-10-26 17:43:38 +08:00
Guanghao Zhang cd943419b6 HBASE-21385 HTable.delete request use rpc call directly instead of AsyncProcess 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-10-25 16:22:36 -07:00
jingyuntian 5fbb227deb
HBASE-21269　Forward-port HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign 2018-10-18 06:22:52 -07:00
Sahil Aggarwal e520399201
HBASE-20716: Changes the bytes[] conversion done in Bytes and ByteBufferUtils. Instead of doing check unsafe_aligned available everytime, choose the best converter at startup. 2018-10-17 21:04:27 -07:00
Michael Stack e736168567 HBASE-21303 [shell] clear_deadservers with no args fails 2018-10-12 11:19:56 -07:00
Nihal Jain 56ac4705e9
HBASE-21196 HTableMultiplexer clears the meta cache after every put operation 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-09-28 16:35:46 -07:00
Michael Stack 27369136be
HBASE-21223 [amv2] Remove abort_procedure from shell 
Signed-off-by: Balazs Meszaros <balazs.meszaros@cloudera.com>
 2018-09-25 11:29:15 -07:00
Guangxu Cheng 3de02d57f6
HBASE-20636 Introduce two bloom filter type : ROWPREFIX and ROWPREFIX_DELIMITED 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
 2018-09-21 16:06:39 -07:00
Umesh Agashe dc767c06d2
HBASE-21023 Added bypassProcedure() API to HbckService 2018-09-19 15:18:16 -07:00
Michael Stack 3a0fcd56cf
HBASE-21156 [hbck2] Queue an assign of hbase:meta and bulk assign/unassign 
Adds 'raw' assigns and unassigns methods to Hbck Service.

Fixes HbckService so it works when cluster is Kerberized.
 2018-09-19 10:06:16 -07:00
Guangxu Cheng 3810ba2c6e HBASE-21179 Fix the number of actions in responseTooSlow log 2018-09-12 10:48:52 +08:00
Guangxu Cheng 2aae247e3f HBASE-21158 Empty qualifier cell is always returned when using QualifierFilter 2018-09-10 21:32:46 +08:00
Toshihiro Suzuki a51c333856 HBASE-21052 After restoring a snapshot, table.jsp page for the table gets stuck 2018-09-09 10:23:50 +09:00
Reid Chan 245bb44703 HBASE-21129 Clean up duplicate codes in #equals and #hashCode methods of Filter 
Signed-off-by Ted Yu <yuzhihong@gmail.com>
 2018-09-04 11:09:21 +08:00
Toshihiro Suzuki bd0435892a HBASE-21084 When cloning a snapshot including a split parent region, the split parent region of the cloned table will be online - addendum 2018-08-28 15:34:01 +09:00
Umesh Agashe 3813f0ac3d HBASE-20941 Created and implemented HbckService in master 
Added API setTableStateInMeta() to update table state only in Meta. This will be used by hbck2 tool.
 2018-08-27 12:11:52 -07:00
subrat.mishra 8e1002913d HBASE-21030: Changed javadoc for append operation. 
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
 2018-08-26 23:38:45 +09:00
liubangchen 72b36e1d9a HBASE-19008 Add missing equals or hashCode method(s) to stock Filter implementations 
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
 2018-08-24 00:22:22 +08:00
zhangduo bb3494134e HBASE-20881 Introduce a region transition procedure to handle all the state transition for a region 2018-08-21 06:12:09 +08:00
subrat.mishra 49ae8549cf HBASE-21040 Replace call to printStackTrace() with proper logger call 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-08-15 08:29:54 -07:00
jingyuntian 21e02813fe HBASE-20985 add two attributes when we do normalization 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-08-13 16:43:54 +08:00
Sakthi bd30ca62ef HBASE-20885 Removed entry for RPC quota from hbase:quota when RPC quota is removed 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-08-03 11:06:50 -04:00
Michael Stack c365c4084e HBASE-20989 Minor, miscellaneous logging fixes 
Signed-off-by: Zach York <zyork@amazon.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
 2018-08-01 11:20:59 -07:00
Reid Chan a8e184dc77 HBASE-20886 [Auth] Support keytab login in hbase client 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-07-31 11:04:40 +08:00
Allan Yang 44f6ef1c90 HBASE-20867 RS may get killed while master restarts 2018-07-25 18:16:28 +08:00
huzheng a888af3dc9 HBASE-20565 ColumnRangeFilter combined with ColumnPaginationFilter can produce incorrect result 2018-07-24 10:29:24 +08:00
Ankit Singhal b4eacdabd6 HBASE-20901 Reducing region replica has no effect 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-07-19 13:38:32 -07:00
Mohit Goel 950d6e6fb0 HBASE-6028 Start/Stop compactions at region server level 
Add switching on/off of compactions.

Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.

Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-07-19 06:20:44 -07:00
Balazs Meszaros 724e323494 HBASE-20853 Polish "Add defaults to Table Interface so Implementors don't have to" 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-07-19 19:38:43 +08:00
Mike Drob dbcc80c9e7
HBASE-20884 Replace Base64 with j.u.Base64 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-07-13 12:59:36 -05:00
zhaoyuan 1e0650955a HBASE-20697 Can't cache All region locations of the specify table by calling table.getRegionLocator().getAllRegionLocations() 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-07-11 10:52:06 +08:00
zhangduo d7561cee50 HBASE-20784 Will lose the SNAPSHOT suffix if we get the version of RS from ServerManager 2018-07-10 09:59:41 +08:00
Allan Yang 97c3984aa3 HBASE-20854 Wrong retries number in RpcRetryingCaller's log message 2018-07-09 15:29:53 +08:00
zhangduo b5222f88b2 HBASE-20822 TestAsyncNonMetaRegionLocator is flakey 2018-07-09 14:56:37 +08:00
Michael Stack 632aaef88b HBASE-20812 Add defaults to Table Interface so implementors don't have to 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-06-29 11:05:26 -07:00
Pankaj bb8826ca5f HBASE-20357 AccessControlClient API Enhancement 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-06-28 22:48:58 -07:00
zhangduo 63477d6251 HBASE-20810 Include the procedure id in the exception message in HBaseAdmin for better debugging 2018-06-29 11:40:44 +08:00
zhangduo 0789e15b5e HBASE-20790 Fix the style issues on branch HBASE-19064 before merging back to master 2018-06-28 18:08:43 +08:00
zhangduo a84cdbd579 HBASE-20783 Addendum fix broken TestSyncReplicationStandBy 2018-06-28 18:08:43 +08:00
huzheng f1806a11e6 HBASE-20783 NEP encountered when rolling update from master with an async peer to branch HBASE-19064 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-06-28 18:08:43 +08:00
zhangduo 39dd81a7c6 HBASE-19957 General framework to transit sync replication state 2018-06-28 18:07:44 +08:00
Guanghao Zhang 00e54aae24 HBASE-19935 Only allow table replication for sync replication for now 2018-06-28 18:07:44 +08:00
Guanghao Zhang 1481bd9481 HBASE-19864 Use protobuf instead of enum.ordinal to store SyncReplicationState 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-06-28 18:07:44 +08:00
Guanghao Zhang 2acebac00e HBASE-19781 Add a new cluster state flag for synchronous replication 2018-06-28 18:07:44 +08:00
Guanghao Zhang b4a1dbf768 HBASE-19078 Add a remote peer cluster wal directory config for synchronous replication 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-06-28 18:07:44 +08:00
Michael Stack 0db2b628d6
HBASE-20770 WAL cleaner logs way too much; gets clogged when lots of work to do 
General log cleanup; setting stuff that can flood the log to TRACE.
 2018-06-25 12:13:04 -07:00
Michael Stack 959d9c16f3 HBASE-20710 extra cloneFamily() in Mutation.add(Cell); ADDENDUM checkstyle 2018-06-23 20:42:23 -07:00
Huaxiang Sun 79800e607c HBASE-20710 extra cloneFamily() in Mutation.add(Cell) 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-06-23 20:37:14 -07:00
zhangduo 14087cc919 HBASE-20775 TestMultiParallel is flakey 2018-06-22 21:32:07 +08:00
zhangduo 177458d9d0 HBASE-18569 Add prefetch support for async region locator 2018-06-22 18:25:31 +08:00
tedyu 98245ca6e4 HBASE-20740 StochasticLoadBalancer should consider CoprocessorService request factor when computing cost (chenxu) 2018-06-22 00:26:14 -07:00
zhangduo 7b716c964b HBASE-20752 Make sure the regions are truly reopened after ReopenTableRegionsProcedure 2018-06-22 14:04:33 +08:00
Ankit Singhal 72784c2d83 HBASE-20642 Clients should re-use the same nonce across DDL operations 
Also changes modify table operations to help the case where a MTP spans
two master, avoiding the sanity-checks propagating back to the client
unnecessarily.

Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-06-20 14:56:10 -07:00
taiynlee d23a517b61 HBASE-20737 (addendum) put collection into ArrayList instead of addAll function -- RetriesExhaustedWithDetailsException.java 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-06-20 14:41:36 +08:00
zhangduo 6dbbd78aa0 HBASE-20708 Remove the usage of RecoverMetaProcedure in master startup 2018-06-19 15:02:10 +08:00
Sean Busbey f1b536bad4 HBASE-20332 shaded mapreduce module shouldn't include hadoop 
* modify the jar checking script to take args; make hadoop stuff optional
* separate out checking the artifacts that have hadoop vs those that don't.
* * Unfortunately means we need two modules for checking things
* * put in a safety check that the support script for checking jar contents is maintained in both modules
* * have to carve out an exception for o.a.hadoop.metrics2. :(
* fix duplicated class warning
* clean up dependencies in hbase-server and some modules that depend on it.
* allow Hadoop to have its own htrace where it needs it
* add a precommit check to make sure we're not using old htrace imports
 2018-06-18 11:31:04 -07:00
Rajeshbabu Chintaguntla 40f0a43462 HBASE-20635 Add missing shaded-pb conversion method for UserPermission 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
 2018-06-11 14:58:18 -04:00
Guanghao Zhang 5fd16f3853 HBASE-20698 Master don't record right server version until new started region server call regionServerReport method 2018-06-09 14:40:43 +08:00
EugeneNik 7d3750bd9f HBASE-20684 org.apache.hadoop.hbase.client.Scan#setStopRow javadoc uses incorrect method 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-06-05 21:57:51 +08:00
Josh Elser c17be2e622 HBASE-20640 Add missing test category and class rule 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-05-30 10:34:19 -04:00
Apekshit Sharma 92460c58aa HBASE-20594 Provide utility to get table desc delta 
Ammending Author: Mike Drob <mdrob@apache.org>

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Apekshit Sharma <appy@apache.org>
 2018-05-29 14:28:57 -05:00
Mike Drob a110e1eff5 HBASE-20478 Update checkstyle to v8.2 
Cannot go to latest (8.9) yet due to
  https://github.com/checkstyle/checkstyle/issues/5279

* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors

Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-05-29 10:12:31 -05:00
huzheng 5721150c6d HBASE-20612 TestReplicationKillSlaveRSWithSeparateOldWALs sometimes fail because it uses an expired cluster conn 2018-05-23 12:07:01 +08:00
zhangduo 26babcf013 HBASE-20457 Return immediately for a scan rpc call when we want to switch from pread to stream 2018-05-15 20:56:20 +08:00
Sean Busbey 8ba2a7eeb9 HBASE-20544 Make HBTU default to random ports. 
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-05-09 23:35:20 -07:00
Nihal Jain f8281aa208 HBASE-20485 Copy constructor of Scan doesn't copy the readType and replicaId 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-05-09 16:39:57 +08:00
Mingdao Yang acd0d1e446 HBASE-20527 Remove unused code in MetaTableAccessor 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-05-05 22:15:54 +08:00
Guangxu Cheng f39ecac488 HBASE-20484 Remove the unnecessary autoboxing in FilterListBase 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-04-26 16:32:03 +08:00
Sean Busbey 914de11416 HBASE-20442 clean up incorrect use of commons-collections 3 
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>
 2018-04-20 07:30:34 -05:00
Huaxiang Sun 1fe3d6a0e9 HBASE-19994 Create a new class for RPC throttling exception, make it retryable 2018-04-16 17:27:14 -07:00
zhangduo 5a633adffe HBASE-20377 Deal with table in enabling and disabling state when modifying serial replication peer 2018-04-13 20:33:29 +08:00
Guangxu Cheng 5a69465ea0 HBASE-20243 [Shell] Add shell command to create a new table by cloning the existent table 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-04-11 19:33:56 -07:00
Balazs Meszaros 35b4adf3ed HBASE-20382 If RSGroups not enabled, rsgroup.jsp prints stack trace 2018-04-11 09:50:07 -07:00
zhangduo 37e5b0b1b7 HBASE-20367 Write a replication barrier for regions when disabling a table 2018-04-11 20:36:51 +08:00
zhangduo a2b9172771 HBASE-20182 Addendum throw IOException instead of NoServerForRegionException because it is a DoNotRetryRegionException 2018-04-11 14:47:06 +08:00
zhangduo 852025dd00 HBASE-20362 TestMasterShutdown.testMasterShutdownBeforeStartingAnyRegionServer is flaky 2018-04-08 16:09:50 +08:00
zhangduo adc0e85e85 HBASE-20182 Can not locate region after split and merge 2018-04-07 13:37:53 +08:00
BELUGA BEHR d866e7c658 HBASE-19488 Move to using Apache commons CollectionUtils 
Signed-off-by: Apekshit Sharma <appy@apache.org>
 2018-04-04 14:12:19 -07:00
Michael Stack c88ca54c16 HBASE-20259 Doc configs for in-memory-compaction and add detail to 
in-memory-compaction logging

Adds logging of CompactingMemStore configuration on construction.

Add logging of detail about Store on creation including memstore type.

Add chapter to refguide on new in-memory compaction feature.
 2018-04-02 09:53:12 -07:00
zhangduo 1e56938757 HBASE-20296 Remove last pushed sequence ids when removing tables from a peer 2018-04-01 21:14:31 +08:00
Yu Li 061a31fad1 HBASE-20159 Support using separate ZK quorums for client 2018-03-29 02:37:26 +08:00
Toshihiro Suzuki ff5250ca2b HBASE-20229 ConnectionImplementation.locateRegions() returns duplicated entries when region replication is on 2018-03-26 15:09:20 -07:00
Jan Hentschel 64ccd2b295 HBASE-13300 Fixed casing in set/getTimeStamp for Mutations 2018-03-23 17:23:22 -07:00
Chia-Ping Tsai ad47c2daf4 HBASE-19504 Add TimeRange support into checkAndMutate 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-24 00:12:38 +08:00
zhangduo 64061f896f HBASE-20147 Serial replication will be stuck if we create a table with serial replication but add it to a peer after there are region moves 2018-03-23 14:31:20 +08:00
Umesh Agashe c614b9f3e8 HBASE-20224 Web UI is broken in standalone mode 
Changes for HBASE-20027 seem to cause UI not showing up on default port in standalone mode. For concurrent
unit test execution, individual tests can set hbase.localcluster.assign.random.ports to true or modify
test/resources/hbase-site.xml.
 2018-03-22 20:27:39 -07:00
Michael Stack 5d1b2110d1
Revert "HBASE-20224 Web UI is broken in standalone mode" 
Broke shell tests.

This reverts commit dd9fe813ec.
 2018-03-22 10:57:42 -07:00
Umesh Agashe 4cb40e6d84 HBASE-20224 Web UI is broken in standalone mode 
Changes for HBASE-20027 seem to cause UI not showing up on default port in standalone mode. For concurrent
unit test execution, individual tests can set hbase.localcluster.assign.random.ports to true or modify
test/resources/hbase-site.xml.
 2018-03-22 06:52:20 -07:00
Chia-Ping Tsai a6eeb26cc0 HBASE-20212 Make all Public classes have InterfaceAudience category 
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-22 18:10:23 +08:00
Andrew Purtell 17ac2fe9c1 HBASE-19024 Provide a configurable option to hsync WAL edits to the disk for better durability (Harshal Jain) 2018-03-20 21:07:59 -07:00
Chia-Ping Tsai 3f906badbe HBASE-20119 (addendum) CP_HTD_ATTR_KEY_PATTERN should be declared Private 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-19 09:15:22 +08:00
Michael Stack bedf849d83 HBASE-20213 [LOGGING] Aligning formatting and logging less (compactions, 
in-memory compactions)

Log less. Log using same format as used elsewhere in log.

Align logs in HFileArchiver with how we format elsewhere. Removed
redundant 'region' qualifiers, tried to tighten up the emissions so
easier to read the long lines.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ChunkCreator.java
 Add a label for each of the chunkcreators we make (I was confused by
two chunk creater stats emissions in log file -- didn't know that one
was for data and the other index).

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CompactSplit.java
 Formatting. Log less.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreCompactionStrategy.java
 Make the emissions in here trace-level. When more than a few regions,
log is filled with this stuff.
 2018-03-16 13:16:49 -07:00
Michael Stack 13f3ba3cee HBASE-20202 [AMv2] Don't move region if its a split parent or offlined 
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/DoNotRetryRegionException.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/exceptions/MergeRegionException.java
 Allow passing cause to Constructor.

M hbase-protocol-shaded/src/main/protobuf/MasterProcedure.proto
 Add prepare step to move procedure.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/MergeTableRegionsProcedure.java
 Add check that regions to merge are actually online to the Constructor
so we can fail fast if they are offline

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/MoveRegionProcedure.java
 Add prepare step. Check regions and context and skip move if not right.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/SplitTableRegionProcedure.java
 Add check parent region is online to constructor.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/AbstractStateMachineTableProcedure.java
 Add generic check region is online utility function for use by subclasses.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMove.java
 Add test that we fail if we try to move an offlined region.
 2018-03-16 09:35:33 -07:00
Chia-Ping Tsai 4f2133ee32 HBASE-20119 Introduce a pojo class to carry coprocessor information in order to make TableDescriptorBuilder accept multiple cp at once 
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-16 01:21:38 +08:00
Michael Stack d0e55429b3 HBASE-20178 [AMv2] Throw exception if hostile environment 
Add Fail-Fast to Procedures by throwing exception out of Procedure
constructor so if move but table is disabled or if master is going
down, etc., we can give notice before the procedure is scheduled.
Will help guard against scheduling Procedures that will have a hard
time succeeding; e.g. a move when table is offline.

Also fixed bug around table state where we presumed ENABLED though no
entry in hbase:meta (we were using this mechanism for whether a table
existed or not).

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMove.java
 Test stolen from HBASE-20131

M hbase-client/src/main/java/org/apache/hadoop/hbase/client/TableState.java
 Add convenience isEnabled/isDisabled

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Promote assert state to throw exception.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterServices.java
 Add isClusterUp

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
 Move constructor now throws exception
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/MoveRegionProcedure.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/MergeTableRegionsProcedure.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/SplitTableRegionProcedure.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/DisableTableProcedure.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/ModifyTableProcedure.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/RestoreSnapshotProcedure.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/TruncateTableProcedure.java
 Do environment check at construction and fail-fast if hostile.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/AbstractStateMachineTableProcedure.java
 Add preflightCheck utility method.

M hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
 Removed setting time setting table state; broke when using other than
 default environment edge masked by presumption that no state meant
 active.
 2018-03-14 14:56:22 -07:00
zhangduo b7308ee01c HBASE-20117 Cleanup the unused replication barriers in meta table 2018-03-14 12:08:15 +08:00
maoling 62fc7fd3ea HBASE-20047 AuthenticationTokenIdentifier should provide a toString 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-03-12 22:06:08 +08:00
zhangduo dd6f4525e7 HBASE-20148 Make serial replication as a option for a peer instead of a table 2018-03-10 09:04:44 +08:00
Mike Drob 641e870e11 HBASE-19987 error-prone 2.2.0 2018-03-07 13:30:51 -06:00
zhangduo 1384da7137 HBASE-20129 Add UT for serial replication checker 2018-03-06 16:43:01 +08:00
Josh Elser 4a4c012049 HBASE-18135 Implement mechanism for RegionServers to report file archival for space quotas 
This de-couples the snapshot size calculation from the
SpaceQuotaObserverChore into another API which both the periodically
invoked Master chore and the Master service endpoint can invoke. This
allows for multiple sources of snapshot size to reported (from the
multiple sources we have in HBase).

When a file is archived, snapshot sizes can be more quickly realized and
the Master can still perform periodical computations of the total
snapshot size to account for any delayed/missing/lost file archival RPCs.

Signed-off-by: Ted Yu <yuzhihong@gmail.com>
 2018-03-05 17:32:42 -05:00
zhangduo b7b8683925 HBASE-20115 Reimplement serial replication based on the new replication storage layer 2018-03-05 20:25:25 +08:00
Sean Busbey 2a65066b35 HBASE-20070 refactor website generation 
* rely on git plumbing commands when checking if we've built the site for a particular commit already
* switch to forcing '-e' for bash
* add command line switches for: path to hbase, working directory, and publishing
* only export JAVA/MAVEN HOME if they aren't already set.
* add some docs about assumptions
* Update javadoc plugin to consistently be version 3.0.0
* avoid duplicative site invocations on reactor modules
* update use of cp command so it works both on linux and mac
* manually skip enforcer plugin during build
* still doing install of all jars due to MJAVADOC-490, but then skip rebuilding during aggregate reports.
* avoid the pager on git-diff by teeing to a log file, which also helps later reviewing in the case of big changesets.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
 2018-03-02 09:25:10 -06:00
zhangduo a8471bd987 HBASE-20065 Addendum remove wrong comment 2018-02-26 09:48:41 +08:00
zhangduo ba5fb53d14 HBASE-20065 Revisit the timestamp usage in MetaTableAccessor 2018-02-25 09:13:56 +08:00
Sean Busbey 216d2d4648 Revert "HBASE-19835 Use explicit casting to avoid side effects" 
This reverts commit f1a81618fd.

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Segment.java

patch reverted changes that happened in parallel without explanation. see jira.
 2018-02-23 16:50:15 -06:00
zhangduo ad5cd50dfc HBASE-20048 Revert serial replication feature 2018-02-23 13:58:31 +08:00
Chia-Ping Tsai 79d9403a79 HBASE-20017 BufferedMutatorImpl submit the same mutation repeatedly 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-02-20 16:59:48 -08:00
zhangduo b7685307e4 HBASE-20020 Make sure we throw DoNotRetryIOException when ConnectionImplementation is closed 2018-02-20 06:12:13 -08:00
Reid Chan a9a6eed372 HBASE-19950 Introduce a ColumnValueFilter 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-02-20 04:56:13 +08:00
eshcar f3bb9b9613 HBASE-18294 Reduce global heap pressure: flush based on heap occupancy 2018-02-18 09:55:44 +02:00
Chia-Ping Tsai dad90f6cce HBASE-19680 BufferedMutatorImpl#mutate should wait the result from AP in order to throw the failed mutations 2018-02-17 07:33:58 +08:00
Mike Drob 8cf7a9d51e HBASE-19920 Lazy init for ProtobufUtil classloader 2018-02-16 09:12:15 -06:00
Chia-Ping Tsai 2f48fdbb26 HBASE-19876 The exception happening in converting pb mutation to hbase.mutation messes up the CellScanner 2018-02-13 21:08:59 +08:00
Michael Stack 67b69fb2c7 HBASE-16060 1.x clients cannot access table state talking to 2.0 cluster 
This patch adds mirroring of table state out to zookeeper. HBase-1.x
clients look for table state in zookeeper, not in hbase:meta where
hbase-2.x maintains table state.

The patch also moves and refactors the 'migration' code that was put in
place by HBASE-13032.

D hbase-client/src/main/java/org/apache/hadoop/hbase/CoordinatedStateException.java
 Unused.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Move table state migration code from Master startup out to
TableStateManager where it belongs. Also start
MirroringTableStateManager dependent on config.

A hbase-server/src/main/java/org/apache/hadoop/hbase/master/MirroringTableStateManager.java

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/TableStateManager.java
 Move migration from zookeeper of table state in here. Also plumb in
mechanism so subclass can get a chance to look at table state as we do
the startup fixup full-table scan of meta.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
 Bug-fix. Now we create regions in CLOSED state but we fail to check
table state; were presuming table always enabled. Meant on startup
there'd be an unassigned region that never got assigned.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMirroringTableStateManager.java
 Test migration and mirroring.
 2018-02-12 08:47:02 -08:00
Michael Stack 0593dda663 HBASE-19951 Cleanup the explicit timeout value for test method 2018-02-10 09:24:31 -08:00
Aman Poonia f1a81618fd HBASE-19835 Use explicit casting to avoid side effects 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-02-08 12:32:36 -08:00
Chia-Ping Tsai d8b999e695 HBASE-19900 Region-level exception destroy the result of batch 2018-02-07 08:41:56 +08:00
Umesh Agashe 6d04aa1794 HBASE-19915 (addendum): Fixed a typo because of which only daughterA was getting stored with a CLOSED state and not daughterB 2018-02-05 15:41:03 -08:00
Mike Drob 8de820786c HBASE-19922 remove ProtobufUtil::PRIMITIVES 2018-02-05 15:33:46 -06:00
Michael Stack b0e998f2a5 HBASE-19726 Failed to start HMaster due to infinite retrying on meta assign; ADDENDUM Fix failing TestMetaWithReplicas#testShutdownHandling; it was reading meta TableState 2018-02-03 21:51:50 -08:00
zhangduo 2e1ec3d3d8 HBASE-19914 Refactor TestVisibilityLabelsOnNewVersionBehaviorTable 2018-02-04 13:27:28 +08:00
Michael Stack 06dec20582
HBASE-19919 Tidying up logging 2018-02-03 08:42:02 -08:00
Umesh Agashe 811afad103
HBASE-19915 Create merged/ daughter region/s with initial state CLOSED from MetaTableAccessor#splitRegion()/ mergeRegions() 
If the initial state is not set to CLOSED while creating merged/ children region/s, merged/
children region/s get stored in meta with state OFFLINE(0). If the master gets restarted after
Merge/ Split procedure stores merged/ children region/s, master startup sequence tries to assign
offline region/s. This is followed by re-assignment of merged/ children region from resumed Merge/
Split procedure.

This bug is related to HBASE-19530.

Signed-off-by: Michael Stack <stack@apache.org>
 2018-02-02 18:25:20 -08:00
Chia-Ping Tsai adccbb7edf HBASE-19897 RowMutations should follow the fluent pattern 2018-02-02 05:33:08 +08:00
zhangduo 7c318cead9 HBASE-19887 Do not overwrite the surefire junit listener property in the pom of sub modules 2018-01-31 20:49:18 +08:00
zhangduo 221eb95768 HBASE-19870 Fix the NPE in ReadOnlyZKClient#run 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-01-29 16:28:59 +08:00
zhangduo 918599ef12 HBASE-19873 Add a CategoryBasedTimeout ClassRule for all UTs 2018-01-29 08:43:56 +08:00
Chia-Ping Tsai 541f8ad8a8 HBASE-4224 Need a flush by regionserver rather than by table option 2018-01-23 09:51:05 +08:00
Sergey Soldatov be496ba8ea HBASE-19774 incorrect behavior of locateRegionInMeta 2018-01-22 11:48:55 -08:00
Michael Stack f3c563fc00 HBASE-19837 Flakey TestRegionLoad 
Add debug, change name of the rows so readable.
 2018-01-21 23:24:23 -08:00
Guangxu Cheng cde1f821eb HBASE-19799 Add web UI to rsgroup 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-01-18 12:49:43 -08:00
zhangduo e546034f09 HBASE-19795 Move the tests which only need zookeeper in TestZooKeeper to hbase-zookeeper module 2018-01-15 10:57:51 +08:00
zhangduo d24fddf3ed HBASE-19772 Do not close connection to zk when there are still pending request in ReadOnlyZKClient 2018-01-14 17:08:23 +08:00
Michael Stack a4a4ce8eac
Revert "HBASE-19772 ReadOnlyZKClient improvements" 
Pushed by mistake. Reverting from master.

This reverts commit 70515f5311.
 2018-01-11 14:27:23 -08:00
Duo Zhang 70515f5311 HBASE-19772 ReadOnlyZKClient improvements 2018-01-11 11:37:27 -08:00
Michael Stack a7f9668c33 HBASE-19753 Miscellany of fixes for hbase-zookeeper tests to make them more robust 
First, we add test resources to CLASSPATH when tests run. W/o it, there
was no logging of hbase-zookeeper test output (not sure why I have to
add this here and not over in hbase-server; research turns up nothing
so far).

M hbase-zookeeper/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKMainServer.java
 Improve fail log message.

M hbase-zookeeper/src/test/java/org/apache/hadoop/hbase/zookeeper/TestReadOnlyZKClient.java
M hbase-zookeeper/src/test/java/org/apache/hadoop/hbase/zookeeper/TestZKNodeTracker.java
 Wait until ZK is connected before progressing. On my slow zk, it could
 be a while post construction before zk connected. Using an unconnected
 zk caused test to fail.

M hbase-zookeeper/src/test/java/org/apache/hadoop/hbase/zookeeper/TestZKMainServer.java
 Change session timeout to default 30s from 1s which was way too short.

M hbase-zookeeper/src/test/resources/log4j.properties
 Set zk logs to DEBUG level in this module at least.

Adds a ZooKeeperHelper class that has utility to help interacting w/ ZK.
 2018-01-11 11:23:37 -08:00
tedyu b568cf4ebd HBASE-19740 Repeated error message for NamespaceExistException 2018-01-10 18:25:45 -08:00
Josh Elser 8118d5de4e HBASE-19734 Fix IntegrationTestReplication and related impl changes 
Adds (client-side) validation to ReplicationPeerConfigBuilder and javadoc
to builder methods in addition to the test fix.

Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-01-10 13:52:31 -05:00
Guanghao Zhang f458b89c05 HBASE-19139 Create Async Admin methods for Clear Block Cache 2018-01-09 14:43:01 +08:00
Guanghao Zhang 01f1fc8284 HBASE-19636 All rs should already start work with the new peer change when replication peer procedure is finished 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-01-09 13:11:01 +08:00
zhangduo 19707a85dd HBASE-19633 Clean up the replication queues in the postPeerModification stage when removing a peer 2018-01-09 13:11:01 +08:00
huzheng f89920a60f HBASE-19622 Reimplement ReplicationPeers with the new replication storage interface 2018-01-09 13:11:01 +08:00
huzheng 8f5e54a456 HBASE-19525 RS side changes for moving peer modification from zk watcher to procedure 2018-01-09 13:11:01 +08:00
Guanghao Zhang 76a044c5d9 HBASE-19536 Client side changes for moving peer modification from zk watcher to procedure 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-01-09 13:11:01 +08:00
Mike Drob 022a348d61
HBASE-19721 Unnecessary stubbings in TestReversedScannerCallable 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-01-06 08:58:17 -06:00
Beluga Behr a30d9fe8d9
HBASE-19651 Remove LimitInputStream 2018-01-05 16:59:29 -06:00
Michael Stack 2bf2b5b2c1
Revert "Revert "Revert "HBASE-19651 Remove LimitInputStream""" 
This reverts commit 032701c96c.
 2018-01-05 16:58:26 -06:00
Michael Stack 032701c96c
Revert "Revert "HBASE-19651 Remove LimitInputStream"" 
This reverts commit e5f7030ded.
 2018-01-05 16:55:59 -06:00
Beluga Behr e5f7030ded
Revert "HBASE-19651 Remove LimitInputStream" 
Revert to put Beluga in place as author.

This reverts commit 032fdc53de.
 2018-01-05 16:55:01 -06:00
Michael Stack 032fdc53de
HBASE-19651 Remove LimitInputStream 
Signed-off-by: Beluga Behr <dam6923@gmail.com>
 2018-01-05 08:31:11 -06:00
Chia-Ping Tsai 8119acfca7 HBASE-19596 RegionMetrics/ServerMetrics/ClusterMetrics should apply to all public classes 2018-01-04 13:13:34 +08:00
BELUGA BEHR 2bd259b445 HBASE-19473 Miscellaneous changes to ClientScanner 
- Remove superfluous logging code guard
- Simplify some of the code
- Use ArrayDeque instead of LinkedList for queue implementation
 2018-01-03 20:25:21 -08:00
zhangduo 1fa3637b4d HBASE-19641 AsyncHBaseAdmin should use exponential backoff when polling the procedure result 2018-01-03 18:32:54 +08:00
BELUGA BEHR 4e9f4abb14 HBASE-19683 Remove Superfluous Methods From String Class (BELUGA BEHR). 
* Remove isEmpty method
* Remove repeat
Use the Apache Commons implementations instead.
 2018-01-02 11:12:38 -08:00
Niels Basjes a6081d30f9 HBASE-19486: Ensure threadsafe WriteBufferPeriodicFlush operations 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-01-02 17:26:22 +08:00
Niels Basjes 5a1c36f70a HBASE-19486 Periodically ensure records are not buffered too long by BufferedMutator 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-29 22:23:18 +08:00
Chia-Ping Tsai e23f7afe57 HBASE-19428 Deprecate the compareTo(Row) 2017-12-29 20:03:39 +08:00
Michael Stack 2dae9d16e2
Revert "HBASE-19651 Remove LimitInputStream" 
This reverts commit 28eaf715e8.
 2017-12-28 14:31:44 -08:00
Michael Stack 28eaf715e8 HBASE-19651 Remove LimitInputStream 
Signed-off-by: Beluga Behr <dam6923@gmail.com>
 2017-12-28 13:04:41 -08:00
Mike Drob c3b4f788b1 HBASE-19552 find-and-replace thirdparty offset 2017-12-28 11:52:32 -06:00
Guanghao Zhang 78013a0c1e HBASE-19653 Reduce the default hbase.client.start.log.errors.counter 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-12-28 07:55:57 -08:00
Guanghao Zhang 8580ba7b6f HBASE-19643 Need to update cache location when get error in AsyncBatchRpcRetryingCaller 2017-12-28 14:33:24 +08:00
Chia-Ping Tsai 53233be5a9 HBASE-19626 Rename Cell.DataType to Cell.Type 2017-12-28 13:04:29 +08:00
Michael Stack 1050936ce7 HBASE-19652 Turn down CleanerChore logging; too chatty 2017-12-27 20:49:26 -08:00