Commit Graph

7317 Commits

Author SHA1 Message Date
Duo Zhang 33b66a3981 HBASE-22202 Fix new findbugs issues after we upgrade hbase-thirdparty dependencies 2019-04-12 14:39:25 +08:00
meiyi 61bc0b4741 HBASE-22084 Rename AccessControlLists to PermissionStorage
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-04-12 14:22:57 +08:00
Josh Elser 0f155b9ec9 HBASE-22144 Correct MultiRowRangeFilter to work with reverse scans
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-04-11 17:41:24 -04:00
Bahram Chechrazy 86483bf961 HBASE-22194 Snapshot unittests fail on Windows due to invalid file path uri
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
2019-04-11 11:34:27 -07:00
Jan Hentschel 45ea084e8b
HBASE-22189 Removed remaining usage of StoreFile.getModificationTimeStamp 2019-04-11 12:13:28 +02:00
Duo Zhang cbea2879c4 HBASE-22198 Fix flakey TestAsyncTableGetMultiThreaded 2019-04-11 16:33:39 +08:00
Duo Zhang ae79db959e HBASE-22196 Split TestRestartCluster 2019-04-11 10:58:09 +08:00
huzheng 2e798f87b7 HBASE-22185 RAMQueueEntry#writeToCache should freeBlock if any exception encountered instead of the IOException catch block 2019-04-10 14:06:10 +08:00
Jingyun Tian 8a6b8e81aa HBASE-21965 Fix failed split and merge transactions that have failed to roll back 2019-04-09 20:11:56 +08:00
Duo Zhang b0de9d8391 HBASE-22153 Fix the flaky TestRestartCluster 2019-04-09 18:34:20 +08:00
Duo Zhang 9a1a7eb8c4 HBASE-22188 Make TestSplitMerge more stable 2019-04-09 18:30:25 +08:00
meiyi 0e85571b39 HBASE-22117 Move hasPermission/checkPermissions from region server to master
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-04-09 17:06:09 +08:00
Guanghao 66fffaa6d0 HBASE-22163 Should not archive the compacted store files when region warmup 2019-04-08 22:20:05 +08:00
Duo Zhang a10ac6f4a1 HBASE-22178 Addendum remove createTableAsync references where we pass null as splitKeys 2019-04-08 09:41:29 +08:00
zhangduo b04b1ecc74 HBASE-22108 Avoid passing null in Admin methods
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-04-07 21:08:55 +08:00
zhangduo 507af5fe6c HBASE-22180 Make TestBlockEvictionFromClient.testBlockRefCountAfterSplits more stable 2019-04-07 20:57:18 +08:00
chaiwentao 5e03efc558 HBASE-22070 Checking restoreDir in RestoreSnapshotHelper
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-04-06 16:11:04 +02:00
Duo Zhang e35ff3acb7 HBASE-22158 RawAsyncHBaseAdmin.getTableSplits should filter out none default replicas
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-04-05 20:33:54 +08:00
zhangduo 6837a76ba9 HBASE-22133 Forward port HBASE-22073 "/rits.jsp throws an exception if no procedure" to branch-2.2+
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-04-04 10:33:24 +08:00
Vladimir Rodionov ae4bfabeaa HBASE-21688 Address WAL filesystem issues
Amending-Author: Josh Elser <elserj@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2019-04-03 13:55:48 -04:00
Duo Zhang 1a12b244ec HBASE-22141 Fix TestAsyncDecommissionAdminApi 2019-04-02 18:54:11 +08:00
zhangduo 6fad60232b HBASE-22135 AsyncAdmin will not refresh master address
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-04-01 09:24:00 +08:00
pingsutw b78c7a4f00 HBASE-22101 AsyncAdmin.isTableAvailable should not throw TableNotFoundException
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-30 20:43:12 +08:00
zhangduo 4cf8e3b04c HBASE-22121 AsyncAdmin can not deal with non default meta replica
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-30 20:19:02 +08:00
zhangduo 359cd73e25 HBASE-22099 Backport HBASE-21895 "Error prone upgrade" to branch-2
Signed-off-by: Michael Stack <stack@apache.org>
2019-03-30 14:28:15 +08:00
zhangduo b1edddcf89 Revert "HBASE-22073 /rits.jsp throws an exception if no procedure"
This reverts commit 85c17e711c.
2019-03-30 09:34:47 +08:00
Sergey Shelukhin 8bceaf7f0b HBASE-22115 HBase RPC aspires to grow an infinite tree of trace scopes; some other places are also unsafe
Signed-off-by: Andrew Purtell <apurtell@apache.org>, stack <stack@apache.org>
2019-03-29 13:42:20 -07:00
Balazs Meszaros 85c17e711c HBASE-22073 /rits.jsp throws an exception if no procedure 2019-03-29 07:43:40 -07:00
Sakthi 37b2cab98a HBASE-22094: Throw TableNotFoundException if table not exists in AsyncAdmin.compact
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-27 20:14:29 +08:00
meiyi 89dbab7c9f HBASE-21911 Move getUserPermissions from regionserver to master
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-27 11:22:57 +08:00
xcang f5b20451db
HBASE-22067 Fix log in StochasticLoadBalancer when balancer is ill-fit for cluster size 2019-03-26 11:42:58 -07:00
zhangduo bb52a6766a HBASE-22074 Should use procedure store to persist the state in reportRegionStateTransition 2019-03-26 18:14:17 +08:00
yaojingyi 1926b86a8c HBASE-21964 unset Quota by Throttle Type
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-26 09:46:01 +08:00
Wei-Chiu Chuang d8d8dcf5fe HBASE-21619. Fix warning message caused by incorrect ternary operator evaluation
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-03-25 20:03:29 +01:00
stack 939a29b41e HBASE-22052 pom cleaning; filter out jersey-core in hadoop2 to match hadoop3 and remove redunant version specifications
This is a reapply of a reverted commit. This commit includes
HBASE-22059 amendment and subsequent ammendments to HBASE-22052.
See HBASE-22052 for full story.

jersey-core is problematic. It was transitively included from hadoop
and polluting our CLASSPATH with an implementation of a 1.x version
of the javax.ws.rs.core.Response Interface from jsr311-api when we
want the javax.ws.rs-api 2.x version.

    M hbase-endpoint/pom.xml
    M hbase-http/pom.xml
    M hbase-mapreduce/pom.xml
    M hbase-rest/pom.xml
    M hbase-server/pom.xml
    M hbase-zookeeper/pom.xml
     Remove redundant version specification (and the odd property define
     done already up in parent pom).
    M hbase-it/pom.xml
    M hbase-rest/pom.xml
     Exclude jersey-core explicitly.

    M hbase-procedure/pom.xml
     Remove redundant version and classifier.

    M pom.xml
     Add jersey-core exclusions to all dependencies that pull it in
     except hadoop-minicluster. mr tests fail w/o the jersey-core
     so let it in for minicluster and then in modules, exclude it
     where it causes damage as in hbase-it.
2019-03-25 09:28:39 -04:00
Toshihiro Suzuki b11ab1c4cf HBASE-22093 Combine TestRestoreSnapshotFromClientWithRegionReplicas to CloneSnapshotFromClientAfterSplittingRegionTestBase#testCloneSnapshotAfterSplittingRegion
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-03-24 15:08:40 +09:00
zhangduo 8fb8886e5c Revert "HBASE-21965 Fix failed split and merge transactions that have failed to roll back"
This reverts commit b2a4265992.
2019-03-24 13:50:39 +08:00
Toshihiro Suzuki 71ea921d85 HBASE-22095 Taking a snapshot fails in local mode
Signed-off-by: Zach York <zyork@apache.org>
2019-03-24 13:50:09 +09:00
Jingyun Tian b2a4265992 HBASE-21965 Fix failed split and merge transactions that have failed to roll back 2019-03-22 17:12:34 +08:00
Sakthi d6f23388f5
HBASE-21991: Fix MetaMetrics issues - [Race condition, Faulty remove logic], few improvements
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-21 13:55:33 -07:00
niuyulin ffcc003f85 HBASE-22065 Add listTableDescriptors(List<TableName>) method in AsyncAdmin
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-21 22:36:10 +08:00
Jingyun Tian b5fdce7c6b HBASE-22061 SplitTableRegionProcedure should hold the lock of its daughter regions 2019-03-20 14:13:15 +08:00
meiyi 3317f03d41 HBASE-22015 UserPermission should be annotated as InterfaceAudience.Public
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-19 14:55:15 +08:00
zhangduo 2277ca422e HBASE-22040 Add mergeRegionsAsync with a List of region names method in AsyncAdmin
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-18 21:05:27 +08:00
Andrew Purtell ea653777e7
HBASE-21926 Profiler servlet 2019-03-17 18:48:16 -07:00
Nihal Jain 04b78bb416 HBASE-20662 Increasing space quota on a violated table does not remove SpaceViolationPolicy.DISABLE enforcement
Signed-off-by: Josh Elser <elserj@apache.org>
2019-03-15 14:00:52 -04:00
zhangduo 839dad2c9e HBASE-21736 Remove the server from online servers before scheduling SCP for it in hbck
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-03-13 11:07:22 +08:00
meiyi 8fd1b0afe9 HBASE-21977 Skip replay WAL and update seqid when open regions restored from snapshot
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-12 21:25:06 +08:00
zhangduo 31b3716e84 HBASE-22001 Polish the Admin interface
Signed-off-by: stack <stack@apache.org>
2019-03-11 14:43:12 +08:00
Jack Bearden cce40e14bc HBASE-20918 Re-enable TestRpcHandlerException
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 65149bd8fc)
2019-03-08 11:25:32 -06:00
zhangduo d084423b52 HBASE-22007 Add restoreSnapshot and cloneSnapshot with acl methods in AsyncAdmin
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-08 18:19:11 +08:00
ramkrishna 82618c439d HBASE-21874 Bucket cache on Persistent memory
Signed-off-by: Anoop John <anoop.hbase@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit f67f207965)
2019-03-07 08:53:31 -06:00
stack 89c8056993 HBASE-22006 Fix branch-2.1 findbugs warning; causes nightly show as failed.
(cherry picked from commit 764adaad34)
2019-03-07 08:52:55 -06:00
Sean Busbey ee30872dcf Revert "SE-22006 Fix branch-2.1 findbugs warning; causes nightly show as failed."
This reverts commit 764adaad34.

bad commit message
2019-03-07 08:52:29 -06:00
Sean Busbey a5c26653f9 Revert "HBASE-21874 Bucket cache on Persistent memory"
This reverts commit f67f207965.

bad signed off by line
2019-03-07 08:52:13 -06:00
ramkrishna f67f207965 HBASE-21874 Bucket cache on Persistent memory
Signed-off-by: Anoop John <anoop.hbase@gmail.com>, Sean Busbey
<busbey@apache.org>
2019-03-07 10:52:18 +05:30
stack 764adaad34 SE-22006 Fix branch-2.1 findbugs warning; causes nightly show as failed. 2019-03-06 16:01:18 -08:00
subrat.mishra 2f9ab7d95a HBASE-21871 Added support to specify a peer table name in VerifyReplication tool
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-03-06 23:29:08 +09:00
maoling 80ae8c9f97 HBASE-21949 Fix flaky test TestHBaseTestingUtility.testMiniZooKeeperWithMultipleClientPorts
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-06 18:05:33 +08:00
Duo Zhang 506e01a064 HBASE-21094 Remove the explicit timeout config for TestTruncateTableProcedure
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-04 15:34:57 +08:00
Guanghao Zhang f7aca3fa06 Revert "HBASE-20194 Remove the explicit timeout config for TestTruncateTableProcedure"
This reverts commit cc6fc1f04f.
2019-03-04 15:32:13 +08:00
zhangduo ab8d9e736f HBASE-21093 Move TestCreateTableProcedure.testMRegions to a separated file
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-04 15:20:06 +08:00
Guanghao Zhang 6f8f0fa533 Revert "HBASE-20193 Move TestCreateTableProcedure.testMRegions to a separated file"
This reverts commit b318311dfd.
2019-03-04 15:19:22 +08:00
zhangduo cc924513ac HBASE-21980 Fix typo in AbstractTestAsyncTableRegionReplicasRead 2019-03-03 08:29:47 +08:00
meiyi 0d882bbc2b HBASE-21974 Change Admin#grant/revoke parameter from UserPermission to user and Permission
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-02 23:47:56 +08:00
Syeda 5c03df5e50 HBASE-21487 Concurrent modify table ops can lead to unexpected results
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-02 13:07:35 +08:00
Duo Zhang 8677031707 HBASE-21976 Deal with RetryImmediatelyException for batching request
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-02 12:14:32 +08:00
Reid Chan 6de61d6bee HBASE-21481 [acl] Superuser's permissions should not be granted or revoked by any non-su global admin
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-01 23:42:11 +08:00
Duo Zhang 1138f72c18 HBASE-21082 Reimplement assign/unassign related procedure metrics
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-01 21:08:44 +08:00
Jingyun Tian ebab2fc913 HBASE-21934 RemoteProcedureDispatcher should track the ongoing dispatched calls 2019-03-01 17:55:29 +08:00
Xu cang 3c6ac6d3f8
HBASE-21952 Fix unit test: TestClientOperationInterrupt#testInterrupt50Percent 2019-02-28 22:19:44 -08:00
Guanghao Zhang c2e5f7b505 HBASE-21967 Split TestServerCrashProcedure and TestServerCrashProcedureWithReplicas 2019-02-28 17:46:47 +08:00
Guanghao Zhang e412e036e1 HBASE-20724 Sometimes some compacted storefiles are still opened after region failover 2019-02-28 09:51:29 +08:00
meiyi ea0675eb96 HBASE-21820 Implement CLUSTER quota scope
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-27 18:24:03 +08:00
Duo Zhang 11624c63e3 HBASE-21961 Infinite loop in AsyncNonMetaRegionLocator if there is only one region and we tried to locate before a non empty row
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-27 17:55:09 +08:00
Duo Zhang 80830ee555 HBASE-21943 The usage of RegionLocations.mergeRegionLocations is wrong for async client
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-26 11:22:11 +08:00
xuqinya 3062618ac9 HBASE-21942 [UI] requests per second is incorrect in rsgroup page(rsgroup.jsp)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-02-25 16:24:49 +01:00
Wellington Chevreuil a8af0e5894 HBASE-21505 - proposal for a more consistent report on status
Signed-off-by: Jingyun Tian <tianjy@apache.org>
2019-02-25 10:07:51 +08:00
zhangduo d7c5d73de0 HBASE-21944 Validate put for batch operation
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-24 20:20:16 +08:00
zhangduo 1568aad302 HBASE-21945 Maintain the original order when sending batch request
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-24 17:56:16 +08:00
Guanghao Zhang 607ac735c4 HBASE-21922 BloomContext#sanityCheck may failed when use ROWPREFIX_DELIMITED bloom filter 2019-02-23 23:29:53 +08:00
Duo Zhang 714e5225e8 HBASE-21929 The checks at the end of TestRpcClientLeaks are not executed
Signed-off-by: Xu Cang <xucang@apache.org>
2019-02-23 20:57:10 +08:00
meiyi 9e45752d6e HBASE-21783 Support exceed user/table/ns throttle quota if region server has available quota
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-22 17:43:40 +08:00
Duo Zhang 761aef6d9d HBASE-20587 Replace Jackson with shaded thirdparty gson
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-22 16:40:45 +08:00
meiyi 61621a33ce HBASE-21938 Add a new ClusterMetrics.Option SERVERS_NAME to only return the live region servers's name without metrics
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-22 10:45:35 +08:00
Toshihiro Suzuki 04caf89e80 HBASE-21867 Support multi-threads in HFileArchiver 2019-02-21 19:05:45 +09:00
zhangduo 164c250691 HBASE-21927 Always fail the locate request when error occur
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 19:48:32 +08:00
Guanghao Zhang bcbbfaebc4 HBASE-21932 Use Runtime.getRuntime().halt to terminate regionserver when abort timeout 2019-02-20 15:55:45 +08:00
zhangduo f198311556 HBASE-21928 Deprecated HConstants.META_QOS
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 14:16:54 +08:00
zhangduo 4b36de3161 HBASE-21930 Deal with ScannerResetException when opening region scanner
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 11:04:15 +08:00
Josh Elser c3312b9c53 HBASE-21915 Make FileLinkInputStream implement CanUnbuffer
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2019-02-19 16:17:28 -05:00
Xiang Li 17736e0a87
HBASE-21866 Do not move the table to null rsgroup when creating an existing table 2019-02-19 11:04:42 -08:00
Nihal Jain f671703c7f HBASE-17942 Disable region splits and merges per table
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-19 07:20:34 +08:00
lujie f5ef0442b0
HBASE-21740 Fix NPE while shutting down RS 2019-02-18 02:55:17 -08:00
Daisuke Kobayashi 98c6ab68c1 HBASE-21899 Fix missing variables for slf4j Logger
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-02-17 20:15:44 +09:00
zhangduo d88a87fd04 HBASE-21909 Validate the put instance before executing in AsyncTable.put method
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-16 18:06:39 +08:00
Duo Zhang 48f2ef432b HBASE-21910 The nonce implementation is wrong for AsyncTable
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-15 20:24:48 +08:00
Guanghao Zhang 1650381e96 HBASE-21814 Remove the TODO in AccessControlLists#addUserPermission 2019-02-15 19:36:30 +08:00
Duo Zhang a24ef97073 HBASE-21875 Change the retry logic in RSProcedureDispatcher to 'retry by default, only if xxx'
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-15 11:05:35 +08:00
Duo Zhang ecbcf6ca2f HBASE-21890 Use execute instead of submit to submit a task in RemoteProcedureDispatcher
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-14 14:19:11 +08:00