2bae04fb2b
HBASE-22144 Correct MultiRowRangeFilter to work with reverse scans
...
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-04-11 17:49:39 -04:00
387a5da462
HBASE-22155 Move 2.2.0 on to hbase-thirdparty-2.2.0
2019-04-09 09:40:19 -07:00
bd2f04dd54
HBASE-21965 Fix failed split and merge transactions that have failed to roll back
2019-04-09 19:56:18 +08:00
d32f924ef4
HBASE-22117 Move hasPermission/checkPermissions from region server to master
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-04-09 17:01:01 +08:00
11547b79f3
HBASE-22178 Introduce a createTableAsync with TableDescriptor method in Admin
2019-04-07 21:06:00 +08:00
0247466210
HBASE-22179 Fix RawAsyncHBaseAdmin.getCompactionState
2019-04-07 08:31:44 +08:00
0ca97d482a
HBASE-22177 Do not recreate IOException in RawAsyncHBaseAdmin.adminCall
2019-04-07 08:30:31 +08:00
04937baf7b
HBASE-22158 RawAsyncHBaseAdmin.getTableSplits should filter out none default replicas
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-04-05 22:14:36 +08:00
3e8152837e
HBASE-22157 Include the cause when constructing RestoreSnapshotException in restoreSnapshot
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-04-04 10:45:14 +08:00
cd2374a7f0
HBASE-22108 Avoid passing null in Admin methods
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-04-02 21:13:17 +08:00
1c4e705592
HBASE-22135 AsyncAdmin will not refresh master address
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-04-01 09:23:43 +08:00
51dda380a6
HBASE-22101 AsyncAdmin.isTableAvailable should not throw TableNotFoundException
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-30 20:41:19 +08:00
7fe31b060f
HBASE-22121 AsyncAdmin can not deal with non default meta replica
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-30 20:18:44 +08:00
caa9650a70
HBASE-22094: Throw TableNotFoundException if table not exists in AsyncAdmin.compact
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-27 20:14:12 +08:00
56dd309b21
HBASE-22102 Remove AsyncAdmin.isTableAvailable(TableName, byte[][])
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-27 17:45:01 +08:00
7b3ff56202
HBASE-21911 Move getUserPermissions from regionserver to master
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-27 11:22:21 +08:00
5f6143ebde
HBASE-22074 Should use procedure store to persist the state in reportRegionStateTransition
2019-03-26 18:13:59 +08:00
f8524b8f8e
HBASE-21964 unset Quota by Throttle Type
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-26 09:42:50 +08:00
386703811d
Revert "HBASE-21965 Fix failed split and merge transactions that have failed to roll back"
...
This reverts commit 7e3ca7063c
2019-03-24 13:51:34 +08:00
21cb00eef6
HBASE-22064 Remove Admin.deleteSnapshot(byte[])
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-23 21:27:12 +08:00
7e3ca7063c
HBASE-21965 Fix failed split and merge transactions that have failed to roll back
2019-03-22 17:11:50 +08:00
cbd9c9b2e1
HBASE-22065 Add listTableDescriptors(List<TableName>) method in AsyncAdmin
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-21 22:35:45 +08:00
556b98101c
HBASE-22063 Deprecated Admin.deleteSnapshot(byte[])
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-21 22:28:10 +08:00
b4b4854371
HBASE-22042 Missing @Override annotation for RawAsyncTableImpl.scan
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-19 17:01:20 +08:00
86dd92cccb
HBASE-22015 UserPermission should be annotated as InterfaceAudience.Public
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-19 14:41:22 +08:00
f65bf79d1d
HBASE-22056 Unexpected blank line in ClusterConnection
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-03-18 15:54:29 -04:00
cc55835d03
HBASE-22040 Add mergeRegionsAsync with a List of region names method in AsyncAdmin
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-18 20:45:21 +08:00
f1ebbb928b
HBASE-22039 Should add the synchronous parameter for the XXXSwitch method in AsyncAdmin
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-16 10:05:54 +08:00
01e5af5a34
HBASE-20662 Increasing space quota on a violated table does not remove SpaceViolationPolicy.DISABLE enforcement
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-03-15 12:16:58 -04:00
3c5761e365
HBASE-22002 Remove the deprecated methods in Admin interface
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-14 21:42:23 +08:00
10ca598004
HBASE-22001 Polish the Admin interface
...
Signed-off-by: stack <stack@apache.org>
2019-03-11 14:38:31 +08:00
8d3e7517e6
HBASE-21416 - fix TestRegionInfoDisplay flaky test
2019-03-08 09:18:17 -08:00
6e3987cf02
HBASE-22007 Add restoreSnapshot and cloneSnapshot with acl methods in AsyncAdmin
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-08 18:03:00 +08:00
63d0e6ed4a
HBASE-22000 Deprecated isTableAvailable with splitKeys
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-03-07 09:18:01 +08:00
c9804758d1
HBASE-21983 Should track the scan metrics in AsyncScanSingleRegionRpcRetryingCaller if scan metrics is enabled
2019-03-03 19:08:23 +08:00
1e12e88492
HBASE-21978 Should close AsyncRegistry if we fail to get cluster id when creating AsyncConnection
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-03 08:19:07 +08:00
841a45afb7
HBASE-21974 Change Admin#grant/revoke parameter from UserPermission to user and Permission
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-02 23:41:48 +08:00
030b4d12fb
HBASE-21487 Concurrent modify table ops can lead to unexpected results
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-02 13:00:19 +08:00
cbdbe6572b
HBASE-21976 Deal with RetryImmediatelyException for batching request
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-02 12:14:16 +08:00
9370347efe
HBASE-21820 Implement CLUSTER quota scope
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-27 18:23:45 +08:00
b1c42f1009
HBASE-21961 Infinite loop in AsyncNonMetaRegionLocator if there is only one region and we tried to locate before a non empty row
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-27 17:54:50 +08:00
6e06a0d790
HBASE-20724 Sometimes some compacted storefiles are still opened after region failover
2019-02-27 15:45:42 +08:00
c33ceb23d3
HBASE-21943 The usage of RegionLocations.mergeRegionLocations is wrong for async client
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-26 11:21:55 +08:00
aa7d3ce39f
HBASE-21944 Validate put for batch operation
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-24 20:19:51 +08:00
b73f03e0cb
Revert "HBASE-21943 The usage of RegionLocations.mergeRegionLocations is wrong for async client"
...
This reverts commit 449ed0834b
2019-02-24 20:14:17 +08:00
a47c1ddcd2
HBASE-21945 Maintain the original order when sending batch request
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-24 17:55:49 +08:00
449ed0834b
HBASE-21943 The usage of RegionLocations.mergeRegionLocations is wrong for async client
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-24 17:34:12 +08:00
0fc5173eef
HBASE-21922 BloomContext#sanityCheck may failed when use ROWPREFIX_DELIMITED bloom filter
2019-02-23 23:25:01 +08:00
f0032c9255
HBASE-20587 Replace Jackson with shaded thirdparty gson
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-22 16:24:51 +08:00
482b505796
HBASE-21505 - proposal for a more consistent report on status
...
Signed-off-by: Jingyun Tian <tianjy@apache.org>
2019-02-22 12:08:38 +08:00
dfb95cfd83
HBASE-21938 Add a new ClusterMetrics.Option SERVERS_NAME to only return the live region servers's name without metrics
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-22 10:41:51 +08:00
9a55cbb2c1
HBASE-21783 Support exceed user/table/ns throttle quota if region server has available quota
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-21 15:36:37 +08:00
a551149ca7
HBASE-21927 Always fail the locate request when error occur
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 19:47:28 +08:00
eedc33dfd2
Revert "HBASE-21505 - proposal for a more consistent report on status"
...
This reverts commit c578020588
2019-02-20 18:06:42 +08:00
e984515b74
HBASE-21928 Deprecated HConstants.META_QOS
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 14:16:40 +08:00
e257f4698c
HBASE-21930 Deal with ScannerResetException when opening region scanner
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 11:03:56 +08:00
c578020588
HBASE-21505 - proposal for a more consistent report on status
...
Signed-off-by: Jingyun Tian <tianjy@apache.org>
2019-02-19 10:51:05 +08:00
593745e8ac
HBASE-17942 Disable region splits and merges per table
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-19 07:15:27 +08:00
6176471957
HBASE-21907 Should set priority for rpc request
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-18 19:46:17 +08:00
dedab71381
HBASE-21909 Validate the put instance before executing in AsyncTable.put method
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-16 17:47:38 +08:00
0b2b474b4c
HBASE-21908 Remove Scan.getScanMetrics
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-16 17:39:31 +08:00
81e1e2f943
HBASE-21910 The nonce implementation is wrong for AsyncTable
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-15 20:24:34 +08:00
8bed65fa01
HBASE-21900 Infinite loop in AsyncMetaRegionLocator if we can not get the location for meta
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-14 19:50:02 +08:00
e06beb0d72
HBASE-21888 Add a isClosed method to AsyncConnection
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-14 11:41:16 +08:00
f1e5999ad2
HBASE-21859 Add clearRegionLocationCache method for AsyncConnection
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-13 10:07:29 +08:00
28bc9a51e1
HBASE-21862 IPCUtil.wrapException should keep the original exception types for all the connection exceptions
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-10 09:37:14 +08:00
6f16836c20
HBASE-21857 Do not need to check clusterKey if replicationEndpoint is provided when adding a peer
...
Signed-off-by: Xu Cang <xucang@apache.org>
2019-02-08 19:47:37 +08:00
2b1b79f08b
HBASE-21829 Use FutureUtils.addListener instead of calling whenComplete directly
2019-02-03 15:24:54 +08:00
89c02dc0cc
HBASE-21828 Make sure we do not return CompletionException when locating region
2019-02-02 21:13:45 +08:00
513ba9ac59
HBASE-21775 ADDENDUM - fix TestAsyncProcess
2019-01-30 15:40:55 -08:00
16c7f5dac9
HBASE-21699 Fixed create table failed when using SPLITS_FILE => 'splits.txt'
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 15:56:25 +08:00
f997252344
HBASE-21739 Move grant/revoke from regionserver to master
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 11:16:57 +08:00
7dc69b6128
HBASE-21792 Mark HTableMultiplexer as deprecated and remove it in 3.0.0
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-29 09:08:02 +08:00
274e4ccea8
HBASE-21789 Rewrite MetaTableAccessor.multiMutate with Table.coprocessorService
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-27 11:36:58 +08:00
e92b62be54
HBASE-21775 The BufferedMutator doesn't ever refresh region location cache
...
Fix server location metadata refresh in multi-actions
Signed-off-by: stack <stack@apache.org>
2019-01-26 13:10:22 -08:00
4f3b95b318
HBASE-21762 Move some methods in ClusterConnection to Connection
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-01-25 21:13:44 +08:00
281558a3ab
HBASE-21713 Support set region server throttle quota
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-25 13:50:42 +08:00
54093b0d1f
HBASE-20215 - Rename CollectionUtils to ConcurrentMapUtils
2019-01-24 20:55:15 -08:00
e43c833145
HBASE-21770 Should deal with meta table in HRegionLocator.getAllRegionLocations
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-25 11:00:51 +08:00
416b70f461
HBASE-21761 Align the methods in RegionLocator and AsyncTableRegionLocator
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-24 15:21:11 +08:00
d4085d11bc
HBASE-21715 set timeout instead of throwing Exception when calling ProcedureFuture.get in client side.
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-01-24 14:55:12 +08:00
250431144f
HBASE-21716 Add toStringCustomizedValues to TableDescriptor
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-01-24 11:32:16 +08:00
d187af00ca
HBASE-21720 : metric to measure how actions are distributed to servers within a MultiAction
...
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
2019-01-23 17:52:58 -08:00
dfad304ddb
HBASE-21753 Support getting the locations for all the replicas of a region
2019-01-23 18:09:39 +08:00
35ed5d6c39
HBASE-21750 Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized
2019-01-22 19:58:03 +08:00
b0131e19f4
HBASE-21734 Some optimization in FilterListWithOR
2019-01-22 11:40:37 +08:00
882bd564f4
HBASE-21726 Add getAllRegionLocations method to AsyncTableRegionLocator
2019-01-19 11:14:35 +08:00
44dc872b7b
HBASE-19695 Handle disabled table for async client
...
Signed-off-by: tianjingyun <tianjy1990@gmail.com>
2019-01-17 18:34:12 +08:00
594341d6fe
HBASE-21710 Add quota related methods to the Admin interface
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-16 21:08:47 +08:00
348cbf63ec
HBASE-21732 Should call toUpperCase before using Enum.valueOf in some methods for ColumnFamilyDescriptor
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-01-16 20:46:14 +08:00
51c58e083c
HBASE-21727 Simplify documentation around client timeout
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-16 11:32:46 +01:00
15031c5bd5
HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case
2019-01-16 09:41:02 +08:00
93d4b95b3f
HBASE-21225: Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE'
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-01-14 17:55:42 -07:00
c5691a9f60
HBASE-21705 Should treat meta table specially for some methods in AsyncAdmin
2019-01-13 13:40:52 +08:00
fbf79373e6
HBASE-21663 Add replica scan support
2019-01-11 14:19:05 +08:00
7bebdff6a2
HBASE-21580 Support getting Hbck instance from AsyncConnection
2019-01-11 11:26:44 +08:00
620d70d618
HBASE-21694 Add append_peer_exclude_tableCFs and remove_peer_exclude_tableCFs shell commands
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-09 22:02:21 +08:00
37bc1686d6
HBASE-21614 RIT recovery with ServerCrashProcedure doesn't account for all regions
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-01-09 20:03:37 +08:00
d957f0fa19
HBASE-21684 Throw DNRIOE when connection or rpc client is closed
2019-01-08 16:40:40 +08:00
4f0514e39a
HBASE-21682 Support getting from specific replica
2019-01-08 09:49:12 +08:00
77db1fae09
HBASE-21159 Add shell command to switch throttle on or off
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-07 14:21:41 +08:00
db66e6cc9e
HBASE-17356 Add replica get support
2019-01-03 08:38:20 +08:00
b2bf22e209
HBASE-21631: list_quotas should print human readable values for LIMIT
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-22 22:00:58 +08:00
e160b5ac8d
HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-12-21 15:21:53 -08:00
ad819380c7
HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result
2018-12-21 09:49:24 +08:00
1b08ba7385
HBASE-21578 Fix wrong throttling exception for capacity unit
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-14 18:17:47 +08:00
f88224ee34
HBASE-21453 Convert ReadOnlyZKClient to DEBUG instead of INFO
2018-12-11 08:18:02 +01:00
b09b87d143
HBASE-21570 Add write buffer periodic flush support for AsyncBufferedMutator
2018-12-11 14:51:26 +08:00
8a68f0d656
HBASE-21524 Fix logging in ConnectionImplementation.isTableAvailable()
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-29 11:40:06 -05:00
1acbd36c90
HBASE-21154 Remove hbase:namespace table; fold it into hbase:meta
2018-11-26 14:51:56 +08:00
5ded294419
HBASE-21034 Add new throttle type: read/write capacity unit
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-21 09:46:49 +08:00
130057f137
HBASE-21255 [acl] Refactor TablePermission into three classes (Global, Namespace, Table)
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-15 11:34:16 +08:00
d9f32137b6
HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-11-08 11:59:34 -08:00
116eee6747
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-29 20:55:37 -07:00
23b7510ae2
HBASE-21365 Throw exception when user put data with skip wal to a table which may be replicated
2018-10-26 17:43:38 +08:00
cd943419b6
HBASE-21385 HTable.delete request use rpc call directly instead of AsyncProcess
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-25 16:22:36 -07:00
5fbb227deb
HBASE-21269 Forward-port HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign
2018-10-18 06:22:52 -07:00
e520399201
HBASE-20716: Changes the bytes[] conversion done in Bytes and ByteBufferUtils. Instead of doing check unsafe_aligned available everytime, choose the best converter at startup.
2018-10-17 21:04:27 -07:00
e736168567
HBASE-21303 [shell] clear_deadservers with no args fails
2018-10-12 11:19:56 -07:00
56ac4705e9
HBASE-21196 HTableMultiplexer clears the meta cache after every put operation
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 16:35:46 -07:00
27369136be
HBASE-21223 [amv2] Remove abort_procedure from shell
...
Signed-off-by: Balazs Meszaros <balazs.meszaros@cloudera.com>
2018-09-25 11:29:15 -07:00
3de02d57f6
HBASE-20636 Introduce two bloom filter type : ROWPREFIX and ROWPREFIX_DELIMITED
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-09-21 16:06:39 -07:00
dc767c06d2
HBASE-21023 Added bypassProcedure() API to HbckService
2018-09-19 15:18:16 -07:00
3a0fcd56cf
HBASE-21156 [hbck2] Queue an assign of hbase:meta and bulk assign/unassign
...
Adds 'raw' assigns and unassigns methods to Hbck Service.
Fixes HbckService so it works when cluster is Kerberized.
2018-09-19 10:06:16 -07:00
3810ba2c6e
HBASE-21179 Fix the number of actions in responseTooSlow log
2018-09-12 10:48:52 +08:00
2aae247e3f
HBASE-21158 Empty qualifier cell is always returned when using QualifierFilter
2018-09-10 21:32:46 +08:00
a51c333856
HBASE-21052 After restoring a snapshot, table.jsp page for the table gets stuck
2018-09-09 10:23:50 +09:00
245bb44703
HBASE-21129 Clean up duplicate codes in #equals and #hashCode methods of Filter
...
Signed-off-by Ted Yu <yuzhihong@gmail.com>
2018-09-04 11:09:21 +08:00
bd0435892a
HBASE-21084 When cloning a snapshot including a split parent region, the split parent region of the cloned table will be online - addendum
2018-08-28 15:34:01 +09:00
3813f0ac3d
HBASE-20941 Created and implemented HbckService in master
...
Added API setTableStateInMeta() to update table state only in Meta. This will be used by hbck2 tool.
2018-08-27 12:11:52 -07:00
8e1002913d
HBASE-21030: Changed javadoc for append operation.
...
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2018-08-26 23:38:45 +09:00
72b36e1d9a
HBASE-19008 Add missing equals or hashCode method(s) to stock Filter implementations
...
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-08-24 00:22:22 +08:00
bb3494134e
HBASE-20881 Introduce a region transition procedure to handle all the state transition for a region
2018-08-21 06:12:09 +08:00
49ae8549cf
HBASE-21040 Replace call to printStackTrace() with proper logger call
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-08-15 08:29:54 -07:00
21e02813fe
HBASE-20985 add two attributes when we do normalization
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-08-13 16:43:54 +08:00
bd30ca62ef
HBASE-20885 Removed entry for RPC quota from hbase:quota when RPC quota is removed
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-08-03 11:06:50 -04:00
c365c4084e
HBASE-20989 Minor, miscellaneous logging fixes
...
Signed-off-by: Zach York <zyork@amazon.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-08-01 11:20:59 -07:00
a8e184dc77
HBASE-20886 [Auth] Support keytab login in hbase client
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-07-31 11:04:40 +08:00
44f6ef1c90
HBASE-20867 RS may get killed while master restarts
2018-07-25 18:16:28 +08:00
a888af3dc9
HBASE-20565 ColumnRangeFilter combined with ColumnPaginationFilter can produce incorrect result
2018-07-24 10:29:24 +08:00
b4eacdabd6
HBASE-20901 Reducing region replica has no effect
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-19 13:38:32 -07:00
950d6e6fb0
HBASE-6028 Start/Stop compactions at region server level
...
Add switching on/off of compactions.
Switching off compactions will also interrupt any currently ongoing compactions.
Adds a "compaction_switch" to hbase shell. Switching off compactions will
interrupt any currently ongoing compactions. State set from shell will be
lost on restart. To persist the changes across region servers modify
hbase.regionserver.compaction.enabled in hbase-site.xml and restart.
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-07-19 06:20:44 -07:00
724e323494
HBASE-20853 Polish "Add defaults to Table Interface so Implementors don't have to"
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-07-19 19:38:43 +08:00
dbcc80c9e7
HBASE-20884 Replace Base64 with j.u.Base64
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-13 12:59:36 -05:00
1e0650955a
HBASE-20697 Can't cache All region locations of the specify table by calling table.getRegionLocator().getAllRegionLocations()
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-07-11 10:52:06 +08:00
d7561cee50
HBASE-20784 Will lose the SNAPSHOT suffix if we get the version of RS from ServerManager
2018-07-10 09:59:41 +08:00
97c3984aa3
HBASE-20854 Wrong retries number in RpcRetryingCaller's log message
2018-07-09 15:29:53 +08:00
b5222f88b2
HBASE-20822 TestAsyncNonMetaRegionLocator is flakey
2018-07-09 14:56:37 +08:00
632aaef88b
HBASE-20812 Add defaults to Table Interface so implementors don't have to
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-29 11:05:26 -07:00
bb8826ca5f
HBASE-20357 AccessControlClient API Enhancement
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-06-28 22:48:58 -07:00
63477d6251
HBASE-20810 Include the procedure id in the exception message in HBaseAdmin for better debugging
2018-06-29 11:40:44 +08:00
0789e15b5e
HBASE-20790 Fix the style issues on branch HBASE-19064 before merging back to master
2018-06-28 18:08:43 +08:00
a84cdbd579
HBASE-20783 Addendum fix broken TestSyncReplicationStandBy
2018-06-28 18:08:43 +08:00
f1806a11e6
HBASE-20783 NEP encountered when rolling update from master with an async peer to branch HBASE-19064
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-06-28 18:08:43 +08:00
39dd81a7c6
HBASE-19957 General framework to transit sync replication state
2018-06-28 18:07:44 +08:00
00e54aae24
HBASE-19935 Only allow table replication for sync replication for now
2018-06-28 18:07:44 +08:00
1481bd9481
HBASE-19864 Use protobuf instead of enum.ordinal to store SyncReplicationState
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-06-28 18:07:44 +08:00
2acebac00e
HBASE-19781 Add a new cluster state flag for synchronous replication
2018-06-28 18:07:44 +08:00
b4a1dbf768
HBASE-19078 Add a remote peer cluster wal directory config for synchronous replication
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-06-28 18:07:44 +08:00
0db2b628d6
HBASE-20770 WAL cleaner logs way too much; gets clogged when lots of work to do
...
General log cleanup; setting stuff that can flood the log to TRACE.
2018-06-25 12:13:04 -07:00
959d9c16f3
HBASE-20710 extra cloneFamily() in Mutation.add(Cell); ADDENDUM checkstyle
2018-06-23 20:42:23 -07:00
79800e607c
HBASE-20710 extra cloneFamily() in Mutation.add(Cell)
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-06-23 20:37:14 -07:00
14087cc919
HBASE-20775 TestMultiParallel is flakey
2018-06-22 21:32:07 +08:00
177458d9d0
HBASE-18569 Add prefetch support for async region locator
2018-06-22 18:25:31 +08:00
98245ca6e4
HBASE-20740 StochasticLoadBalancer should consider CoprocessorService request factor when computing cost (chenxu)
2018-06-22 00:26:14 -07:00
7b716c964b
HBASE-20752 Make sure the regions are truly reopened after ReopenTableRegionsProcedure
2018-06-22 14:04:33 +08:00
72784c2d83
HBASE-20642 Clients should re-use the same nonce across DDL operations
...
Also changes modify table operations to help the case where a MTP spans
two master, avoiding the sanity-checks propagating back to the client
unnecessarily.
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-06-20 14:56:10 -07:00
d23a517b61
HBASE-20737 (addendum) put collection into ArrayList instead of addAll function -- RetriesExhaustedWithDetailsException.java
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-06-20 14:41:36 +08:00
6dbbd78aa0
HBASE-20708 Remove the usage of RecoverMetaProcedure in master startup
2018-06-19 15:02:10 +08:00
f1b536bad4
HBASE-20332 shaded mapreduce module shouldn't include hadoop
...
* modify the jar checking script to take args; make hadoop stuff optional
* separate out checking the artifacts that have hadoop vs those that don't.
* * Unfortunately means we need two modules for checking things
* * put in a safety check that the support script for checking jar contents is maintained in both modules
* * have to carve out an exception for o.a.hadoop.metrics2. :(
* fix duplicated class warning
* clean up dependencies in hbase-server and some modules that depend on it.
* allow Hadoop to have its own htrace where it needs it
* add a precommit check to make sure we're not using old htrace imports
2018-06-18 11:31:04 -07:00
40f0a43462
HBASE-20635 Add missing shaded-pb conversion method for UserPermission
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-06-11 14:58:18 -04:00
5fd16f3853
HBASE-20698 Master don't record right server version until new started region server call regionServerReport method
2018-06-09 14:40:43 +08:00
7d3750bd9f
HBASE-20684 org.apache.hadoop.hbase.client.Scan#setStopRow javadoc uses incorrect method
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-06-05 21:57:51 +08:00
c17be2e622
HBASE-20640 Add missing test category and class rule
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-30 10:34:19 -04:00
92460c58aa
HBASE-20594 Provide utility to get table desc delta
...
Ammending Author: Mike Drob <mdrob@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-05-29 14:28:57 -05:00
a110e1eff5
HBASE-20478 Update checkstyle to v8.2
...
Cannot go to latest (8.9) yet due to
https://github.com/checkstyle/checkstyle/issues/5279
* move hbaseanti import checks to checkstyle
* implment a few missing equals checks, and ignore one
* fix lots of javadoc errors
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-05-29 10:12:31 -05:00
5721150c6d
HBASE-20612 TestReplicationKillSlaveRSWithSeparateOldWALs sometimes fail because it uses an expired cluster conn
2018-05-23 12:07:01 +08:00
26babcf013
HBASE-20457 Return immediately for a scan rpc call when we want to switch from pread to stream
2018-05-15 20:56:20 +08:00
8ba2a7eeb9
HBASE-20544 Make HBTU default to random ports.
...
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Josh Elser <elserj@apache.org>
2018-05-09 23:35:20 -07:00
f8281aa208
HBASE-20485 Copy constructor of Scan doesn't copy the readType and replicaId
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-05-09 16:39:57 +08:00
acd0d1e446
HBASE-20527 Remove unused code in MetaTableAccessor
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-05-05 22:15:54 +08:00
f39ecac488
HBASE-20484 Remove the unnecessary autoboxing in FilterListBase
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-04-26 16:32:03 +08:00
914de11416
HBASE-20442 clean up incorrect use of commons-collections 3
...
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>
2018-04-20 07:30:34 -05:00
1fe3d6a0e9
HBASE-19994 Create a new class for RPC throttling exception, make it retryable
2018-04-16 17:27:14 -07:00
5a633adffe
HBASE-20377 Deal with table in enabling and disabling state when modifying serial replication peer
2018-04-13 20:33:29 +08:00
5a69465ea0
HBASE-20243 [Shell] Add shell command to create a new table by cloning the existent table
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-11 19:33:56 -07:00
35b4adf3ed
HBASE-20382 If RSGroups not enabled, rsgroup.jsp prints stack trace
2018-04-11 09:50:07 -07:00
37e5b0b1b7
HBASE-20367 Write a replication barrier for regions when disabling a table
2018-04-11 20:36:51 +08:00
a2b9172771
HBASE-20182 Addendum throw IOException instead of NoServerForRegionException because it is a DoNotRetryRegionException
2018-04-11 14:47:06 +08:00
852025dd00
HBASE-20362 TestMasterShutdown.testMasterShutdownBeforeStartingAnyRegionServer is flaky
2018-04-08 16:09:50 +08:00
adc0e85e85
HBASE-20182 Can not locate region after split and merge
2018-04-07 13:37:53 +08:00
d866e7c658
HBASE-19488 Move to using Apache commons CollectionUtils
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-04-04 14:12:19 -07:00
c88ca54c16
HBASE-20259 Doc configs for in-memory-compaction and add detail to
...
in-memory-compaction logging
Adds logging of CompactingMemStore configuration on construction.
Add logging of detail about Store on creation including memstore type.
Add chapter to refguide on new in-memory compaction feature.
2018-04-02 09:53:12 -07:00
1e56938757
HBASE-20296 Remove last pushed sequence ids when removing tables from a peer
2018-04-01 21:14:31 +08:00
061a31fad1
HBASE-20159 Support using separate ZK quorums for client
2018-03-29 02:37:26 +08:00
ff5250ca2b
HBASE-20229 ConnectionImplementation.locateRegions() returns duplicated entries when region replication is on
2018-03-26 15:09:20 -07:00
64ccd2b295
HBASE-13300 Fixed casing in set/getTimeStamp for Mutations
2018-03-23 17:23:22 -07:00
ad47c2daf4
HBASE-19504 Add TimeRange support into checkAndMutate
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-24 00:12:38 +08:00
64061f896f
HBASE-20147 Serial replication will be stuck if we create a table with serial replication but add it to a peer after there are region moves
2018-03-23 14:31:20 +08:00
c614b9f3e8
HBASE-20224 Web UI is broken in standalone mode
...
Changes for HBASE-20027 seem to cause UI not showing up on default port in standalone mode. For concurrent
unit test execution, individual tests can set hbase.localcluster.assign.random.ports to true or modify
test/resources/hbase-site.xml.
2018-03-22 20:27:39 -07:00
5d1b2110d1
Revert "HBASE-20224 Web UI is broken in standalone mode"
...
Broke shell tests.
This reverts commit dd9fe813ec
2018-03-22 10:57:42 -07:00
4cb40e6d84
HBASE-20224 Web UI is broken in standalone mode
...
Changes for HBASE-20027 seem to cause UI not showing up on default port in standalone mode. For concurrent
unit test execution, individual tests can set hbase.localcluster.assign.random.ports to true or modify
test/resources/hbase-site.xml.
2018-03-22 06:52:20 -07:00
a6eeb26cc0
HBASE-20212 Make all Public classes have InterfaceAudience category
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-22 18:10:23 +08:00
17ac2fe9c1
HBASE-19024 Provide a configurable option to hsync WAL edits to the disk for better durability (Harshal Jain)
2018-03-20 21:07:59 -07:00
3f906badbe
HBASE-20119 (addendum) CP_HTD_ATTR_KEY_PATTERN should be declared Private
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-19 09:15:22 +08:00
bedf849d83
HBASE-20213 [LOGGING] Aligning formatting and logging less (compactions,
...
in-memory compactions)
Log less. Log using same format as used elsewhere in log.
Align logs in HFileArchiver with how we format elsewhere. Removed
redundant 'region' qualifiers, tried to tighten up the emissions so
easier to read the long lines.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ChunkCreator.java
Add a label for each of the chunkcreators we make (I was confused by
two chunk creater stats emissions in log file -- didn't know that one
was for data and the other index).
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CompactSplit.java
Formatting. Log less.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreCompactionStrategy.java
Make the emissions in here trace-level. When more than a few regions,
log is filled with this stuff.
2018-03-16 13:16:49 -07:00
13f3ba3cee
HBASE-20202 [AMv2] Don't move region if its a split parent or offlined
...
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/DoNotRetryRegionException.java
M hbase-client/src/main/java/org/apache/hadoop/hbase/exceptions/MergeRegionException.java
Allow passing cause to Constructor.
M hbase-protocol-shaded/src/main/protobuf/MasterProcedure.proto
Add prepare step to move procedure.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/MergeTableRegionsProcedure.java
Add check that regions to merge are actually online to the Constructor
so we can fail fast if they are offline
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/MoveRegionProcedure.java
Add prepare step. Check regions and context and skip move if not right.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/SplitTableRegionProcedure.java
Add check parent region is online to constructor.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/AbstractStateMachineTableProcedure.java
Add generic check region is online utility function for use by subclasses.
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMove.java
Add test that we fail if we try to move an offlined region.
2018-03-16 09:35:33 -07:00
4f2133ee32
HBASE-20119 Introduce a pojo class to carry coprocessor information in order to make TableDescriptorBuilder accept multiple cp at once
...
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
2018-03-16 01:21:38 +08:00
d0e55429b3
HBASE-20178 [AMv2] Throw exception if hostile environment
...
Add Fail-Fast to Procedures by throwing exception out of Procedure
constructor so if move but table is disabled or if master is going
down, etc., we can give notice before the procedure is scheduled.
Will help guard against scheduling Procedures that will have a hard
time succeeding; e.g. a move when table is offline.
Also fixed bug around table state where we presumed ENABLED though no
entry in hbase:meta (we were using this mechanism for whether a table
existed or not).
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMove.java
Test stolen from HBASE-20131
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/TableState.java
Add convenience isEnabled/isDisabled
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
Promote assert state to throw exception.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterServices.java
Add isClusterUp
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
Move constructor now throws exception
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/MoveRegionProcedure.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/MergeTableRegionsProcedure.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/SplitTableRegionProcedure.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/DisableTableProcedure.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/ModifyTableProcedure.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/RestoreSnapshotProcedure.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/TruncateTableProcedure.java
Do environment check at construction and fail-fast if hostile.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/AbstractStateMachineTableProcedure.java
Add preflightCheck utility method.
M hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
Removed setting time setting table state; broke when using other than
default environment edge masked by presumption that no state meant
active.
2018-03-14 14:56:22 -07:00
b7308ee01c
HBASE-20117 Cleanup the unused replication barriers in meta table
2018-03-14 12:08:15 +08:00
62fc7fd3ea
HBASE-20047 AuthenticationTokenIdentifier should provide a toString
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-03-12 22:06:08 +08:00
dd6f4525e7
HBASE-20148 Make serial replication as a option for a peer instead of a table
2018-03-10 09:04:44 +08:00
641e870e11
HBASE-19987 error-prone 2.2.0
2018-03-07 13:30:51 -06:00
1384da7137
HBASE-20129 Add UT for serial replication checker
2018-03-06 16:43:01 +08:00
4a4c012049
HBASE-18135 Implement mechanism for RegionServers to report file archival for space quotas
...
This de-couples the snapshot size calculation from the
SpaceQuotaObserverChore into another API which both the periodically
invoked Master chore and the Master service endpoint can invoke. This
allows for multiple sources of snapshot size to reported (from the
multiple sources we have in HBase).
When a file is archived, snapshot sizes can be more quickly realized and
the Master can still perform periodical computations of the total
snapshot size to account for any delayed/missing/lost file archival RPCs.
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-03-05 17:32:42 -05:00
b7b8683925
HBASE-20115 Reimplement serial replication based on the new replication storage layer
2018-03-05 20:25:25 +08:00
2a65066b35
HBASE-20070 refactor website generation
...
* rely on git plumbing commands when checking if we've built the site for a particular commit already
* switch to forcing '-e' for bash
* add command line switches for: path to hbase, working directory, and publishing
* only export JAVA/MAVEN HOME if they aren't already set.
* add some docs about assumptions
* Update javadoc plugin to consistently be version 3.0.0
* avoid duplicative site invocations on reactor modules
* update use of cp command so it works both on linux and mac
* manually skip enforcer plugin during build
* still doing install of all jars due to MJAVADOC-490, but then skip rebuilding during aggregate reports.
* avoid the pager on git-diff by teeing to a log file, which also helps later reviewing in the case of big changesets.
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Misty Stanley-Jones <misty@apache.org>
2018-03-02 09:25:10 -06:00
a8471bd987
HBASE-20065 Addendum remove wrong comment
2018-02-26 09:48:41 +08:00
ba5fb53d14
HBASE-20065 Revisit the timestamp usage in MetaTableAccessor
2018-02-25 09:13:56 +08:00
216d2d4648
Revert "HBASE-19835 Use explicit casting to avoid side effects"
...
This reverts commit f1a81618fd
2018-02-23 16:50:15 -06:00
ad5cd50dfc
HBASE-20048 Revert serial replication feature
2018-02-23 13:58:31 +08:00
79d9403a79
HBASE-20017 BufferedMutatorImpl submit the same mutation repeatedly
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-20 16:59:48 -08:00
b7685307e4
HBASE-20020 Make sure we throw DoNotRetryIOException when ConnectionImplementation is closed
2018-02-20 06:12:13 -08:00
a9a6eed372
HBASE-19950 Introduce a ColumnValueFilter
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-02-20 04:56:13 +08:00
f3bb9b9613
HBASE-18294 Reduce global heap pressure: flush based on heap occupancy
2018-02-18 09:55:44 +02:00
dad90f6cce
HBASE-19680 BufferedMutatorImpl#mutate should wait the result from AP in order to throw the failed mutations
2018-02-17 07:33:58 +08:00
8cf7a9d51e
HBASE-19920 Lazy init for ProtobufUtil classloader
2018-02-16 09:12:15 -06:00
2f48fdbb26
HBASE-19876 The exception happening in converting pb mutation to hbase.mutation messes up the CellScanner
2018-02-13 21:08:59 +08:00
67b69fb2c7
HBASE-16060 1.x clients cannot access table state talking to 2.0 cluster
...
This patch adds mirroring of table state out to zookeeper. HBase-1.x
clients look for table state in zookeeper, not in hbase:meta where
hbase-2.x maintains table state.
The patch also moves and refactors the 'migration' code that was put in
place by HBASE-13032.
D hbase-client/src/main/java/org/apache/hadoop/hbase/CoordinatedStateException.java
Unused.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
Move table state migration code from Master startup out to
TableStateManager where it belongs. Also start
MirroringTableStateManager dependent on config.
A hbase-server/src/main/java/org/apache/hadoop/hbase/master/MirroringTableStateManager.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/TableStateManager.java
Move migration from zookeeper of table state in here. Also plumb in
mechanism so subclass can get a chance to look at table state as we do
the startup fixup full-table scan of meta.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
Bug-fix. Now we create regions in CLOSED state but we fail to check
table state; were presuming table always enabled. Meant on startup
there'd be an unassigned region that never got assigned.
A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMirroringTableStateManager.java
Test migration and mirroring.
2018-02-12 08:47:02 -08:00
0593dda663
HBASE-19951 Cleanup the explicit timeout value for test method
2018-02-10 09:24:31 -08:00
f1a81618fd
HBASE-19835 Use explicit casting to avoid side effects
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-08 12:32:36 -08:00
d8b999e695
HBASE-19900 Region-level exception destroy the result of batch
2018-02-07 08:41:56 +08:00
6d04aa1794
HBASE-19915 (addendum): Fixed a typo because of which only daughterA was getting stored with a CLOSED state and not daughterB
2018-02-05 15:41:03 -08:00
8de820786c
HBASE-19922 remove ProtobufUtil::PRIMITIVES
2018-02-05 15:33:46 -06:00
b0e998f2a5
HBASE-19726 Failed to start HMaster due to infinite retrying on meta assign; ADDENDUM Fix failing TestMetaWithReplicas#testShutdownHandling; it was reading meta TableState
2018-02-03 21:51:50 -08:00
2e1ec3d3d8
HBASE-19914 Refactor TestVisibilityLabelsOnNewVersionBehaviorTable
2018-02-04 13:27:28 +08:00
06dec20582
HBASE-19919 Tidying up logging
2018-02-03 08:42:02 -08:00
811afad103
HBASE-19915 Create merged/ daughter region/s with initial state CLOSED from MetaTableAccessor#splitRegion()/ mergeRegions()
...
If the initial state is not set to CLOSED while creating merged/ children region/s, merged/
children region/s get stored in meta with state OFFLINE(0). If the master gets restarted after
Merge/ Split procedure stores merged/ children region/s, master startup sequence tries to assign
offline region/s. This is followed by re-assignment of merged/ children region from resumed Merge/
Split procedure.
This bug is related to HBASE-19530.
Signed-off-by: Michael Stack <stack@apache.org>
2018-02-02 18:25:20 -08:00
adccbb7edf
HBASE-19897 RowMutations should follow the fluent pattern
2018-02-02 05:33:08 +08:00
7c318cead9
HBASE-19887 Do not overwrite the surefire junit listener property in the pom of sub modules
2018-01-31 20:49:18 +08:00
221eb95768
HBASE-19870 Fix the NPE in ReadOnlyZKClient#run
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-01-29 16:28:59 +08:00
918599ef12
HBASE-19873 Add a CategoryBasedTimeout ClassRule for all UTs
2018-01-29 08:43:56 +08:00
541f8ad8a8
HBASE-4224 Need a flush by regionserver rather than by table option
2018-01-23 09:51:05 +08:00
be496ba8ea
HBASE-19774 incorrect behavior of locateRegionInMeta
2018-01-22 11:48:55 -08:00
f3c563fc00
HBASE-19837 Flakey TestRegionLoad
...
Add debug, change name of the rows so readable.
2018-01-21 23:24:23 -08:00
cde1f821eb
HBASE-19799 Add web UI to rsgroup
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-18 12:49:43 -08:00
e546034f09
HBASE-19795 Move the tests which only need zookeeper in TestZooKeeper to hbase-zookeeper module
2018-01-15 10:57:51 +08:00
d24fddf3ed
HBASE-19772 Do not close connection to zk when there are still pending request in ReadOnlyZKClient
2018-01-14 17:08:23 +08:00
a4a4ce8eac
Revert "HBASE-19772 ReadOnlyZKClient improvements"
...
Pushed by mistake. Reverting from master.
This reverts commit 70515f5311
2018-01-11 14:27:23 -08:00
70515f5311
HBASE-19772 ReadOnlyZKClient improvements
2018-01-11 11:37:27 -08:00
a7f9668c33
HBASE-19753 Miscellany of fixes for hbase-zookeeper tests to make them more robust
...
First, we add test resources to CLASSPATH when tests run. W/o it, there
was no logging of hbase-zookeeper test output (not sure why I have to
add this here and not over in hbase-server; research turns up nothing
so far).
M hbase-zookeeper/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKMainServer.java
Improve fail log message.
M hbase-zookeeper/src/test/java/org/apache/hadoop/hbase/zookeeper/TestReadOnlyZKClient.java
M hbase-zookeeper/src/test/java/org/apache/hadoop/hbase/zookeeper/TestZKNodeTracker.java
Wait until ZK is connected before progressing. On my slow zk, it could
be a while post construction before zk connected. Using an unconnected
zk caused test to fail.
M hbase-zookeeper/src/test/java/org/apache/hadoop/hbase/zookeeper/TestZKMainServer.java
Change session timeout to default 30s from 1s which was way too short.
M hbase-zookeeper/src/test/resources/log4j.properties
Set zk logs to DEBUG level in this module at least.
Adds a ZooKeeperHelper class that has utility to help interacting w/ ZK.
2018-01-11 11:23:37 -08:00
b568cf4ebd
HBASE-19740 Repeated error message for NamespaceExistException
2018-01-10 18:25:45 -08:00
8118d5de4e
HBASE-19734 Fix IntegrationTestReplication and related impl changes
...
Adds (client-side) validation to ReplicationPeerConfigBuilder and javadoc
to builder methods in addition to the test fix.
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-01-10 13:52:31 -05:00
f458b89c05
HBASE-19139 Create Async Admin methods for Clear Block Cache
2018-01-09 14:43:01 +08:00
01f1fc8284
HBASE-19636 All rs should already start work with the new peer change when replication peer procedure is finished
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-09 13:11:01 +08:00
19707a85dd
HBASE-19633 Clean up the replication queues in the postPeerModification stage when removing a peer
2018-01-09 13:11:01 +08:00
f89920a60f
HBASE-19622 Reimplement ReplicationPeers with the new replication storage interface
2018-01-09 13:11:01 +08:00
8f5e54a456
HBASE-19525 RS side changes for moving peer modification from zk watcher to procedure
2018-01-09 13:11:01 +08:00
76a044c5d9
HBASE-19536 Client side changes for moving peer modification from zk watcher to procedure
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-09 13:11:01 +08:00
022a348d61
HBASE-19721 Unnecessary stubbings in TestReversedScannerCallable
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-01-06 08:58:17 -06:00
a30d9fe8d9
HBASE-19651 Remove LimitInputStream
2018-01-05 16:59:29 -06:00
2bf2b5b2c1
Revert "Revert "Revert "HBASE-19651 Remove LimitInputStream"""
...
This reverts commit 032701c96c
2018-01-05 16:58:26 -06:00
032701c96c
Revert "Revert "HBASE-19651 Remove LimitInputStream""
...
This reverts commit e5f7030ded
2018-01-05 16:55:59 -06:00
e5f7030ded
Revert "HBASE-19651 Remove LimitInputStream"
...
Revert to put Beluga in place as author.
This reverts commit 032fdc53de
2018-01-05 16:55:01 -06:00
032fdc53de
HBASE-19651 Remove LimitInputStream
...
Signed-off-by: Beluga Behr <dam6923@gmail.com>
2018-01-05 08:31:11 -06:00
8119acfca7
HBASE-19596 RegionMetrics/ServerMetrics/ClusterMetrics should apply to all public classes
2018-01-04 13:13:34 +08:00
2bd259b445
HBASE-19473 Miscellaneous changes to ClientScanner
...
- Remove superfluous logging code guard
- Simplify some of the code
- Use ArrayDeque instead of LinkedList for queue implementation
2018-01-03 20:25:21 -08:00
1fa3637b4d
HBASE-19641 AsyncHBaseAdmin should use exponential backoff when polling the procedure result
2018-01-03 18:32:54 +08:00
4e9f4abb14
HBASE-19683 Remove Superfluous Methods From String Class (BELUGA BEHR).
...
* Remove isEmpty method
* Remove repeat
Use the Apache Commons implementations instead.
2018-01-02 11:12:38 -08:00
a6081d30f9
HBASE-19486: Ensure threadsafe WriteBufferPeriodicFlush operations
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-01-02 17:26:22 +08:00
5a1c36f70a
HBASE-19486 Periodically ensure records are not buffered too long by BufferedMutator
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-29 22:23:18 +08:00
e23f7afe57
HBASE-19428 Deprecate the compareTo(Row)
2017-12-29 20:03:39 +08:00
2dae9d16e2
Revert "HBASE-19651 Remove LimitInputStream"
...
This reverts commit 28eaf715e8
2017-12-28 14:31:44 -08:00
28eaf715e8
HBASE-19651 Remove LimitInputStream
...
Signed-off-by: Beluga Behr <dam6923@gmail.com>
2017-12-28 13:04:41 -08:00
c3b4f788b1
HBASE-19552 find-and-replace thirdparty offset
2017-12-28 11:52:32 -06:00
78013a0c1e
HBASE-19653 Reduce the default hbase.client.start.log.errors.counter
...
Signed-off-by: Michael Stack <stack@apache.org>
2017-12-28 07:55:57 -08:00
8580ba7b6f
HBASE-19643 Need to update cache location when get error in AsyncBatchRpcRetryingCaller
2017-12-28 14:33:24 +08:00
53233be5a9
HBASE-19626 Rename Cell.DataType to Cell.Type
2017-12-28 13:04:29 +08:00
1050936ce7
HBASE-19652 Turn down CleanerChore logging; too chatty
2017-12-27 20:49:26 -08:00
2c65f039ed
HBASE-19647 Logging cleanups; emit regionname when RegionTooBusyException inside RetriesExhausted... make netty connect/disconnect TRACE-level; ADDENDUM
2017-12-27 14:14:58 -08:00
01b1f48ccd
HBASE-19644 add the checkstyle rule to reject the illegal imports
2017-12-28 04:10:42 +08:00
16cd916976
HBASE-19647 Logging cleanups; emit regionname when RegionTooBusyException inside RetriesExhausted... make netty connect/disconnect TRACE-level
2017-12-27 11:55:42 -08:00
6b39062e86
HBASE-19628 ByteBufferCell should extend ExtendedCell
2017-12-27 22:26:40 +08:00
467a4667d8
HBASE-19629 RawCell#getTags should return the Iterator<Tag> in order to avoid iterating through whole tag array at once
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-27 21:33:42 +08:00
7145d98182
HBASE-19545 Replace getBytes(StandardCharsets.UTF_8) with Bytes.toBytes
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-27 20:07:25 +08:00
5a561e0882
HBASE-19496 (addendum) don't store the duplicate cp names in ServerMetrics
2017-12-27 07:05:16 +08:00
7ce1943ef3
HBASE-19550 Wrap the cell passed via Mutation#add(Cell) to be of ExtendedCell
2017-12-26 16:39:51 +08:00
1556939236
HBASE-19621 Revisit the methods in ReplicationPeerConfigBuilder
2017-12-26 14:40:31 +08:00
0dadb45ad7
HBASE-19576 Introduce builder for ReplicationPeerConfig and make it immutable
2017-12-23 18:55:29 +08:00
448ba3a78f
HBASE-19496 Reusing the ByteBuffer in rpc layer corrupt the ServerLoad and RegionLoad
2017-12-22 18:54:25 +08:00
001bce54e7
HBASE-19590 Remove the duplicate code in deprecated ReplicationAdmin
2017-12-22 18:32:15 +08:00
8ec0aa0d70
HBASE-19589 New regions should always be added with state CLOSED (followup of HBASE-19530)
2017-12-21 22:57:53 -08:00
59baf12c03
HBASE-19575 add copy constructor to Mutation
2017-12-22 03:24:43 +08:00
f572c4b80e
HBASE-10092 Move up on to log4j2
...
Changes:
- replaced commons-logging to slf4j everywhere
- log.XXX(Throwable) calls were replaced with log.XXX(t.toString(), t)
- log.XXX(Object) calls were replaced with log.XXX(Objects.toString(obj))
- log.fatal() calls were replaced with log.error(HBaseMarkers.FATAL, ...)
- programmatic log4j configuration was removed from the unit test
This commit does not affect the current logging configurations, because log4j
is still on the classpath. slf4j-log4j12 binds log4j to slf4j.
Signed-off-by: Michael Stack <stack@apache.org>
2017-12-20 22:21:33 -08:00
dd00081c26
HBASE-19538 Removed unnecessary semicolons in hbase-client
2017-12-19 20:50:18 +01:00
03e79b7994
HBASE-19492 Add EXCLUDE_NAMESPACE and EXCLUDE_TABLECFS support to replication peer config
2017-12-19 16:53:43 +08:00
6a9b1480c1
HBASE-19122 Suspect methods on Cell to be deprecated; ADDENDUM to fix
...
compile error
2017-12-18 16:02:54 -08:00
b4056d267a
HBASE-19122 Suspect methods on Cell to be deprecated
2017-12-18 15:20:44 -08:00
9d0c7c6dfb
HBASE-19531 Remove needless volatile declaration
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-19 00:34:28 +08:00
979767824d
HBASE-19522 The complete order may be wrong in AsyncBufferedMutatorImpl
2017-12-16 14:00:59 +08:00
Josh Elser
stack
Jingyun Tian
meiyi
zhangduo
pingsutw
Sakthi
yaojingyi
niuyulin
xujunhong
Rishabh Jain
Nihal Jain
Norbert Kalmar
johnhomsea
Syeda
Guanghao Zhang
Wellington Chevreuil
Jingyun Tian
Tommy Li
wanghuan
huzheng
Peter Somogyi
Sergey Shelukhin
Sakthi
Reid Chan
Ben Lau
Sahil Aggarwal
Guangxu Cheng
Umesh Agashe
Toshihiro Suzuki
subrat.mishra
liubangchen
subrat.mishra
Allan Yang
Ankit Singhal
Mohit Goel
Balazs Meszaros
Mike Drob
zhaoyuan
Pankaj
Huaxiang Sun
tedyu
taiynlee
Sean Busbey
Rajeshbabu Chintaguntla
EugeneNik
Apekshit Sharma
Mingdao Yang
BELUGA BEHR
Yu Li
Jan Hentschel
Chia-Ping Tsai
Andrew Purtell
maoling
Reid Chan
eshcar
Aman Poonia
Sergey Soldatov
Duo Zhang
Niels Basjes
Vasudevan
Peter Somogyi
Yun Chi-Shih