Commit Graph

7459 Commits

Author SHA1 Message Date
Guanghao Zhang e4e561b37f Revert "Merge pull request #133 from infraio/retry-backoff
HBASE-22193 Add backoff when region failed open too many times"

This reverts commit 249ac58d4f, reversing
changes made to f7867c4ffb.
2019-04-13 11:08:12 +08:00
Guanghao 249ac58d4f
Merge pull request #133 from infraio/retry-backoff
HBASE-22193 Add backoff when region failed open too many times
2019-04-13 10:41:02 +08:00
Duo Zhang f7867c4ffb HBASE-22207 Fix flakey TestAssignmentManager.testAssignSocketTimeout 2019-04-12 23:07:19 +08:00
Jan Hentschel bc58adac5b HBASE-22187 Removed remaining usages of ClusterConnection.clearRegionCache 2019-04-12 09:58:20 +02:00
Guanghao Zhang 942f8c45cd HBASE-22193 Add backoff when region failed open too many times 2019-04-12 15:49:05 +08:00
Duo Zhang f77bde3722 HBASE-22202 Fix new findbugs issues after we upgrade hbase-thirdparty dependencies 2019-04-12 14:29:25 +08:00
meiyi 94d9dc1e84 HBASE-22084 Rename AccessControlLists to PermissionStorage
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-04-12 14:18:09 +08:00
Josh Elser 2bae04fb2b HBASE-22144 Correct MultiRowRangeFilter to work with reverse scans
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-04-11 17:49:39 -04:00
Bahram Chechrazy 2c8b813810 HBASE-22194 Snapshot unittests fail on Windows due to invalid file path uri
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
2019-04-11 11:33:52 -07:00
Jan Hentschel 3994529dc9 HBASE-22189 Removed remaining usage of StoreFile.getModificationTimeStamp 2019-04-11 12:12:07 +02:00
zhangduo a74e1ecad9 HBASE-22196 Split TestRestartCluster 2019-04-11 09:31:14 +08:00
Duo Zhang bf5af14945 HBASE-22198 Fix flakey TestAsyncTableGetMultiThreaded 2019-04-10 21:21:44 +08:00
huzheng 494a8efe5f HBASE-22185 RAMQueueEntry#writeToCache should freeBlock if any exception encountered instead of the IOException catch block 2019-04-10 10:45:00 +08:00
Jingyun Tian bd2f04dd54 HBASE-21965 Fix failed split and merge transactions that have failed to roll back 2019-04-09 19:56:18 +08:00
Duo Zhang 74112e53c9 HBASE-22188 Make TestSplitMerge more stable 2019-04-09 18:18:23 +08:00
meiyi d32f924ef4 HBASE-22117 Move hasPermission/checkPermissions from region server to master
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-04-09 17:01:01 +08:00
Guanghao 89ce5d17e4
HBASE-22163 Should not archive the compacted store files when region warmup (#122)
* HBASE-22163 Should not archive the compacted store files when region warmup
2019-04-08 22:11:07 +08:00
Duo Zhang a871d3139a HBASE-22153 Fix the flaky TestRestartCluster 2019-04-08 15:47:12 +08:00
Duo Zhang b2587c874b HBASE-22178 Addendum remove createTableAsync references where we pass null as splitKeys 2019-04-08 09:41:11 +08:00
zhangduo b3f62a7f59 HBASE-22180 Make TestBlockEvictionFromClient.testBlockRefCountAfterSplits more stable 2019-04-07 20:56:30 +08:00
chaiwentao b1525ed85e HBASE-22070 Checking restoreDir in RestoreSnapshotHelper
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-04-06 16:09:58 +02:00
Duo Zhang 04937baf7b HBASE-22158 RawAsyncHBaseAdmin.getTableSplits should filter out none default replicas
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-04-05 22:14:36 +08:00
zhangduo 129d806732 HBASE-22133 Forward port HBASE-22073 "/rits.jsp throws an exception if no procedure" to branch-2.2+
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-04-04 10:33:11 +08:00
Vladimir Rodionov a3110afcda HBASE-21688 Address WAL filesystem issues
Signed-off-by: Josh Elser <elserj@apache.org>
2019-04-03 16:49:28 -04:00
zhangduo cd2374a7f0 HBASE-22108 Avoid passing null in Admin methods
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-04-02 21:13:17 +08:00
Duo Zhang a3faad76e1 HBASE-22141 Fix TestAsyncDecommissionAdminApi 2019-04-01 21:51:18 +08:00
zhangduo 1c4e705592 HBASE-22135 AsyncAdmin will not refresh master address
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-04-01 09:23:43 +08:00
pingsutw 51dda380a6 HBASE-22101 AsyncAdmin.isTableAvailable should not throw TableNotFoundException
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-30 20:41:19 +08:00
zhangduo 7fe31b060f HBASE-22121 AsyncAdmin can not deal with non default meta replica
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-30 20:18:44 +08:00
zhangduo 833736f28a Revert "HBASE-22073 /rits.jsp throws an exception if no procedure"
This reverts commit 8bac547559.
2019-03-30 09:34:14 +08:00
Sergey Shelukhin 7084144512 HBASE-22115 HBase RPC aspires to grow an infinite tree of trace scopes; some other places are also unsafe
Signed-off-by: Andrew Purtell <apurtell@apache.org>, stack <stack@apache.org>
2019-03-29 13:39:35 -07:00
Balazs Meszaros 8bac547559 HBASE-22073 /rits.jsp throws an exception if no procedure 2019-03-29 07:43:02 -07:00
李小保 bb75773ba2 HBASE-22082 Should not use an instance to access static members, which will increases compilation costs.
Signed-off-by: stack <stack@apache.org>
2019-03-27 08:34:11 -07:00
Sakthi caa9650a70 HBASE-22094: Throw TableNotFoundException if table not exists in AsyncAdmin.compact
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-27 20:14:12 +08:00
pingsutw 56dd309b21 HBASE-22102 Remove AsyncAdmin.isTableAvailable(TableName, byte[][])
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-27 17:45:01 +08:00
meiyi 7b3ff56202 HBASE-21911 Move getUserPermissions from regionserver to master
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-27 11:22:21 +08:00
xcang baf3ae80f5
HBASE-22067 Fix log in StochasticLoadBalancer when balancer is ill-fit for cluster size 2019-03-26 11:42:21 -07:00
zhangduo 5f6143ebde HBASE-22074 Should use procedure store to persist the state in reportRegionStateTransition 2019-03-26 18:13:59 +08:00
yaojingyi f8524b8f8e HBASE-21964 unset Quota by Throttle Type
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-26 09:42:50 +08:00
Wei-Chiu Chuang 5e1e0ca810 HBASE-21619. Fix warning message caused by incorrect ternary operator evaluation
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-03-25 19:58:12 +01:00
stack 089a639724 HBASE-22052 pom cleaning; filter out jersey-core in hadoop2 to match hadoop3 and remove redunant version specifications
This is a reapply of a reverted commit. This commit includes
HBASE-22059 amendment and subsequent ammendments to HBASE-22052.
See HBASE-22052 for full story.

jersey-core is problematic. It was transitively included from hadoop
and polluting our CLASSPATH with an implementation of a 1.x version
of the javax.ws.rs.core.Response Interface from jsr311-api when we
want the javax.ws.rs-api 2.x version.

    M hbase-endpoint/pom.xml
    M hbase-http/pom.xml
    M hbase-mapreduce/pom.xml
    M hbase-rest/pom.xml
    M hbase-server/pom.xml
    M hbase-zookeeper/pom.xml
     Remove redundant version specification (and the odd property define
     done already up in parent pom).
    M hbase-it/pom.xml
    M hbase-rest/pom.xml
     Exclude jersey-core explicitly.

    M hbase-procedure/pom.xml
     Remove redundant version and classifier.

    M pom.xml
     Add jersey-core exclusions to all dependencies that pull it in
     except hadoop-minicluster. mr tests fail w/o the jersey-core
     so let it in for minicluster and then in modules, exclude it
     where it causes damage as in hbase-it.
2019-03-25 09:30:09 -04:00
Toshihiro Suzuki 44f8abd5c6 HBASE-22093 Combine TestRestoreSnapshotFromClientWithRegionReplicas to CloneSnapshotFromClientAfterSplittingRegionTestBase#testCloneSnapshotAfterSplittingRegion
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-03-24 15:07:54 +09:00
zhangduo 386703811d Revert "HBASE-21965 Fix failed split and merge transactions that have failed to roll back"
This reverts commit 7e3ca7063c.
2019-03-24 13:51:34 +08:00
Kevin Risden c144c814b0 HBASE-21895 - Error prone upgrade
* Upgrades to error prone 2.3.3
* Moves to error prone plugin to support 9+ JDKs
* Removes custom error prone plugin due to no usage

Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-24 13:13:07 +08:00
Toshihiro Suzuki 94c18f0653 HBASE-22095 Taking a snapshot fails in local mode
Signed-off-by: Zach York <zyork@apache.org>
2019-03-24 13:47:50 +09:00
pingsutw 21cb00eef6 HBASE-22064 Remove Admin.deleteSnapshot(byte[])
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-23 21:27:12 +08:00
Jingyun Tian 7e3ca7063c HBASE-21965 Fix failed split and merge transactions that have failed to roll back 2019-03-22 17:11:50 +08:00
Sakthi 36f0929efc
HBASE-21991: Fix MetaMetrics issues - [Race condition, Faulty remove logic], few improvements
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-21 13:55:08 -07:00
niuyulin cbd9c9b2e1 HBASE-22065 Add listTableDescriptors(List<TableName>) method in AsyncAdmin
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-21 22:35:45 +08:00
Jingyun Tian c52dd9efa0 HBASE-22061 SplitTableRegionProcedure should hold the lock of its daughter regions 2019-03-20 14:12:09 +08:00
meiyi 86dd92cccb HBASE-22015 UserPermission should be annotated as InterfaceAudience.Public
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-19 14:41:22 +08:00
zhangduo cc55835d03 HBASE-22040 Add mergeRegionsAsync with a List of region names method in AsyncAdmin
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-18 20:45:21 +08:00
Andrew Purtell 6cd78e899f
HBASE-21926 Profiler servlet 2019-03-17 18:48:12 -07:00
Nihal Jain 01e5af5a34 HBASE-20662 Increasing space quota on a violated table does not remove SpaceViolationPolicy.DISABLE enforcement
Signed-off-by: Josh Elser <elserj@apache.org>
2019-03-15 12:16:58 -04:00
Duo Zhang 3c5761e365 HBASE-22002 Remove the deprecated methods in Admin interface
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-14 21:42:23 +08:00
meiyi 908dea8e41 HBASE-21977 Skip replay WAL and update seqid when open regions restored from snapshot
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-12 21:24:43 +08:00
zhangduo 10ca598004 HBASE-22001 Polish the Admin interface
Signed-off-by: stack <stack@apache.org>
2019-03-11 14:38:31 +08:00
zhangduo 3ff2847457 HBASE-21736 Remove the server from online servers before scheduling SCP for it in hbck
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-03-09 08:55:17 +08:00
zhangduo 6e3987cf02 HBASE-22007 Add restoreSnapshot and cloneSnapshot with acl methods in AsyncAdmin
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-08 18:03:00 +08:00
Jack Bearden 65149bd8fc HBASE-20918 Re-enable TestRpcHandlerException
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-03-07 10:04:25 -06:00
stack c9e358908f HBASE-22006 Fix branch-2.1 findbugs warning; causes nightly show as failed.
(cherry picked from commit 18d02ffd5d)
2019-03-07 08:50:53 -06:00
ramkrishna fd6bc5d900 HBASE-21874 Bucket cache on Persistent memory
Signed-off-by: Anoop John <anoop.hbase@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 763202d48e)
2019-03-07 08:50:08 -06:00
Sean Busbey d9793c311c Revert "HBASE-21874 Bucket cache on Persistent memory"
This reverts commit 763202d48e.

bad signed-off-by line
2019-03-07 08:49:41 -06:00
Sean Busbey 415ff2a19d Revert "SE-22006 Fix branch-2.1 findbugs warning; causes nightly show as failed."
This reverts commit 18d02ffd5d.

bad commit message
2019-03-07 08:49:07 -06:00
stack 18d02ffd5d SE-22006 Fix branch-2.1 findbugs warning; causes nightly show as failed. 2019-03-06 16:01:58 -08:00
ramkrishna 763202d48e HBASE-21874 Bucket cache on Persistent memory
Signed-off-by: Anoop John <anoop.hbase@gmail.com>, Sean Busbey
<busbey@apache.org>
2019-03-06 22:37:54 +05:30
subrat.mishra 177d43d8db HBASE-21871 Added support to specify a peer table name in VerifyReplication tool
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-03-06 23:27:44 +09:00
maoling 70558174f0 HBASE-21949 Fix flaky test TestHBaseTestingUtility.testMiniZooKeeperWithMultipleClientPorts
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-06 18:00:57 +08:00
zhangduo 7142cea121 HBASE-21980 Fix typo in AbstractTestAsyncTableRegionReplicasRead 2019-03-03 08:29:37 +08:00
meiyi 841a45afb7 HBASE-21974 Change Admin#grant/revoke parameter from UserPermission to user and Permission
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-02 23:41:48 +08:00
Syeda 030b4d12fb HBASE-21487 Concurrent modify table ops can lead to unexpected results
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-02 13:00:19 +08:00
Duo Zhang cbdbe6572b HBASE-21976 Deal with RetryImmediatelyException for batching request
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-02 12:14:16 +08:00
Reid Chan f748e489c5 HBASE-21481 [acl] Superuser's permissions should not be granted or revoked by any non-su global admin
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-01 23:37:28 +08:00
Duo Zhang 929a8aa5e8 HBASE-21082 Reimplement assign/unassign related procedure metrics
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-01 21:08:13 +08:00
Xu cang fd152c265e
HBASE-21952 Fix unit test: TestClientOperationInterrupt#testInterrupt50Percent 2019-02-28 22:20:18 -08:00
Jingyun Tian c19bc5911b HBASE-21934 RemoteProcedureDispatcher should track the ongoing dispatched calls 2019-03-01 11:00:07 +08:00
Guanghao Zhang c4f5d3c508 HBASE-21967 Split TestServerCrashProcedure and TestServerCrashProcedureWithReplicas 2019-02-28 17:46:02 +08:00
meiyi 9370347efe HBASE-21820 Implement CLUSTER quota scope
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-27 18:23:45 +08:00
Duo Zhang b1c42f1009 HBASE-21961 Infinite loop in AsyncNonMetaRegionLocator if there is only one region and we tried to locate before a non empty row
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-27 17:54:50 +08:00
Guanghao Zhang 6e06a0d790 HBASE-20724 Sometimes some compacted storefiles are still opened after region failover 2019-02-27 15:45:42 +08:00
Duo Zhang c33ceb23d3 HBASE-21943 The usage of RegionLocations.mergeRegionLocations is wrong for async client
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-26 11:21:55 +08:00
xuqinya 99362e894c HBASE-21942 [UI] requests per second is incorrect in rsgroup page(rsgroup.jsp)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-02-25 16:23:14 +01:00
zhangduo aa7d3ce39f HBASE-21944 Validate put for batch operation
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-24 20:19:51 +08:00
zhangduo a47c1ddcd2 HBASE-21945 Maintain the original order when sending batch request
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-24 17:55:49 +08:00
Guanghao Zhang 0fc5173eef HBASE-21922 BloomContext#sanityCheck may failed when use ROWPREFIX_DELIMITED bloom filter 2019-02-23 23:25:01 +08:00
Duo Zhang 07d84eb809 HBASE-21929 The checks at the end of TestRpcClientLeaks are not executed
Signed-off-by: Xu Cang <xucang@apache.org>
2019-02-23 20:56:54 +08:00
Duo Zhang f0032c9255 HBASE-20587 Replace Jackson with shaded thirdparty gson
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-22 16:24:51 +08:00
Wellington Chevreuil 482b505796 HBASE-21505 - proposal for a more consistent report on status
Signed-off-by: Jingyun Tian <tianjy@apache.org>
2019-02-22 12:08:38 +08:00
meiyi dfb95cfd83 HBASE-21938 Add a new ClusterMetrics.Option SERVERS_NAME to only return the live region servers's name without metrics
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-22 10:41:51 +08:00
meiyi 9a55cbb2c1 HBASE-21783 Support exceed user/table/ns throttle quota if region server has available quota
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-21 15:36:37 +08:00
Toshihiro Suzuki 72df52283b HBASE-21867 Support multi-threads in HFileArchiver 2019-02-21 10:26:34 +09:00
zhangduo a551149ca7 HBASE-21927 Always fail the locate request when error occur
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 19:47:28 +08:00
Jingyun Tian eedc33dfd2 Revert "HBASE-21505 - proposal for a more consistent report on status"
This reverts commit c578020588.
2019-02-20 18:06:42 +08:00
Guanghao Zhang e218874e9b HBASE-21932 Use Runtime.getRuntime().halt to terminate regionserver when abort timeout 2019-02-20 15:50:14 +08:00
zhangduo e984515b74 HBASE-21928 Deprecated HConstants.META_QOS
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 14:16:40 +08:00
zhangduo e257f4698c HBASE-21930 Deal with ScannerResetException when opening region scanner
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 11:03:56 +08:00
Josh Elser b76b0191b1 HBASE-21915 Make FileLinkInputStream implement CanUnbuffer
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2019-02-19 16:16:56 -05:00
Wellington Chevreuil c578020588 HBASE-21505 - proposal for a more consistent report on status
Signed-off-by: Jingyun Tian <tianjy@apache.org>
2019-02-19 10:51:05 +08:00
Xiang Li 7ecb45a4b0
HBASE-21866 Do not move the table to null rsgroup when creating an existing table 2019-02-18 10:54:22 -08:00
Nihal Jain 593745e8ac HBASE-17942 Disable region splits and merges per table
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-19 07:15:27 +08:00