Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,886 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

7733 Commits

Author SHA1 Message Date
Duo Zhang 0db0491a9e Revert "HBASE-22086: Space Quota issue: Deleting snapshot doesn't update the usage of table" 
This breaks TestQuotaTableUtil.testDeleteSnapshots.

This reverts commit fe7cf10272.
 2019-04-26 10:00:02 +08:00
Zach York 8af2dd3da2
HBASE-22291 Fix recovery of recovered.edits files under root dir 
When trying to recover a recovered.edits file under the root directory,
it is possible to get a WrongFS exception.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-04-25 18:11:18 -07:00
Sean Busbey bf140acd20 HBASE-22083 move eclipse settings into a profile. 
Signed-off-by: stack <stack@apache.org>
 2019-04-25 14:17:18 -05:00
Sayed Anisul Hoque 5bc7eda1c1 HBASE-22294 Removed deprecated method from WALKeyImpl 2019-04-24 21:43:14 +02:00
李小保 7617b71f00 HBASE-22250 The same constants used in many places should be placed in constant classes 
Signed-off-by: stack <stack@apache.org>
 2019-04-23 21:24:14 -07:00
zhangduo d77e90c006 HBASE-22296 Remove TestFromClientSide.testGetStartEndKeysWithRegionReplicas 2019-04-24 09:59:37 +08:00
Sakthi fe7cf10272 HBASE-22086: Space Quota issue: Deleting snapshot doesn't update the usage of table 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-04-23 19:20:38 -04:00
stack 512bc844bb HBASE-22298 branch-2.2 nightly fails "[ForOverride] Method annotated @ForOverride must have protected or package-private visibility" 2019-04-23 14:02:55 -07:00
Jan Hentschel 1f0e43a27a HBASE-22232 Removed deprecated methods in CompareFilter 2019-04-23 13:25:17 +02:00
Wellington Chevreuil 1644d74be7 HBASE-22200 - WALSplitter.hasRecoveredEdits should use same FS instance from WAL region dir 
Signed-off-by: Zach York <zyork@apache.org>
 2019-04-22 14:37:08 -07:00
zhangduo c3c48f30f7 HBASE-22279 Add a getRegionLocator method in Table/AsyncTable interface 2019-04-22 18:37:23 +08:00
zhangduo eb912bb1da HBASE-22261 Make use of ClusterStatusListener for async client 2019-04-21 22:03:43 +08:00
zhangduo 0645d5a033 HBASE-22267 Implement client push back for async client 2019-04-21 16:31:49 +08:00
Jan Hentschel f30d6c958a HBASE-22231 Removed unused and '*' imports 2019-04-20 22:03:32 +02:00
meiyi 268bcce76f HBASE-22208 Create access checker and expose it in RS 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-04-19 12:39:09 +08:00
Bahram Chehrazy 428afa9c5e HBASE-22150 rssStub in HRegionServer is not thread safe and should not directly be used 
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
 2019-04-17 11:28:00 -07:00
Ben Manes 8ec93ea193
HBASE-15560 W-TinyLFU based BlockCache 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-04-17 11:10:36 -07:00
Jan Hentschel 12bcb879da HBASE-22199 Replaced UTF-8 String with StandardCharsets.UTF_8 2019-04-17 10:13:25 +02:00
Andrew Purtell cc9d401015
HBASE-22235 OperationStatus.{SUCCESS|FAILURE|NOT_RUN} are not visible to 3rd party coprocessors 2019-04-16 13:19:59 -07:00
Jan Hentschel 20f72f5e25 HBASE-22186 Removed remaining usages of SnapshotDescriptionUtils.SNAPSHOT_TIMEOUT_MILLIS_KEY and SnapshotDescriptionUtils.SNAPSHOT_TIMEOUT_MILLIS_DEFAULT 2019-04-16 09:01:54 +02:00
tianjingyun cb84b2788a HBASE-22234 Fix flaky TestHbck#testRecoverSplitAfterMetaUpdated 2019-04-14 22:48:10 +08:00
zhanggangxue 01c26c5311 HBASE-21257 misspelled words.[occured -> occurred] 2019-04-14 21:35:05 +08:00
zhangduo 4bc2edadeb HBASE-22236 add more logs for TestAsyncTableGetMultiThreaded for better debugging 2019-04-14 16:50:22 +08:00
Guanghao Zhang cfd74a68ad HBASE-22193 Add backoff when region failed open too many times 2019-04-13 11:09:00 +08:00
Guanghao Zhang e4e561b37f Revert "Merge pull request #133 from infraio/retry-backoff 
HBASE-22193 Add backoff when region failed open too many times"

This reverts commit 249ac58d4f, reversing
changes made to f7867c4ffb.
 2019-04-13 11:08:12 +08:00
Guanghao 249ac58d4f
Merge pull request #133 from infraio/retry-backoff 
HBASE-22193 Add backoff when region failed open too many times
 2019-04-13 10:41:02 +08:00
Duo Zhang f7867c4ffb HBASE-22207 Fix flakey TestAssignmentManager.testAssignSocketTimeout 2019-04-12 23:07:19 +08:00
Jan Hentschel bc58adac5b HBASE-22187 Removed remaining usages of ClusterConnection.clearRegionCache 2019-04-12 09:58:20 +02:00
Guanghao Zhang 942f8c45cd HBASE-22193 Add backoff when region failed open too many times 2019-04-12 15:49:05 +08:00
Duo Zhang f77bde3722 HBASE-22202 Fix new findbugs issues after we upgrade hbase-thirdparty dependencies 2019-04-12 14:29:25 +08:00
meiyi 94d9dc1e84 HBASE-22084 Rename AccessControlLists to PermissionStorage 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-04-12 14:18:09 +08:00
Josh Elser 2bae04fb2b HBASE-22144 Correct MultiRowRangeFilter to work with reverse scans 
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
 2019-04-11 17:49:39 -04:00
Bahram Chechrazy 2c8b813810 HBASE-22194 Snapshot unittests fail on Windows due to invalid file path uri 
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
 2019-04-11 11:33:52 -07:00
Jan Hentschel 3994529dc9 HBASE-22189 Removed remaining usage of StoreFile.getModificationTimeStamp 2019-04-11 12:12:07 +02:00
zhangduo a74e1ecad9 HBASE-22196 Split TestRestartCluster 2019-04-11 09:31:14 +08:00
Duo Zhang bf5af14945 HBASE-22198 Fix flakey TestAsyncTableGetMultiThreaded 2019-04-10 21:21:44 +08:00
huzheng 494a8efe5f HBASE-22185 RAMQueueEntry#writeToCache should freeBlock if any exception encountered instead of the IOException catch block 2019-04-10 10:45:00 +08:00
Jingyun Tian bd2f04dd54 HBASE-21965 Fix failed split and merge transactions that have failed to roll back 2019-04-09 19:56:18 +08:00
Duo Zhang 74112e53c9 HBASE-22188 Make TestSplitMerge more stable 2019-04-09 18:18:23 +08:00
meiyi d32f924ef4 HBASE-22117 Move hasPermission/checkPermissions from region server to master 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-04-09 17:01:01 +08:00
Guanghao 89ce5d17e4
HBASE-22163 Should not archive the compacted store files when region warmup (#122) 
* HBASE-22163 Should not archive the compacted store files when region warmup
 2019-04-08 22:11:07 +08:00
Duo Zhang a871d3139a HBASE-22153 Fix the flaky TestRestartCluster 2019-04-08 15:47:12 +08:00
Duo Zhang b2587c874b HBASE-22178 Addendum remove createTableAsync references where we pass null as splitKeys 2019-04-08 09:41:11 +08:00
zhangduo b3f62a7f59 HBASE-22180 Make TestBlockEvictionFromClient.testBlockRefCountAfterSplits more stable 2019-04-07 20:56:30 +08:00
chaiwentao b1525ed85e HBASE-22070 Checking restoreDir in RestoreSnapshotHelper 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-04-06 16:09:58 +02:00
Duo Zhang 04937baf7b HBASE-22158 RawAsyncHBaseAdmin.getTableSplits should filter out none default replicas 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-04-05 22:14:36 +08:00
zhangduo 129d806732 HBASE-22133 Forward port HBASE-22073 "/rits.jsp throws an exception if no procedure" to branch-2.2+ 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-04-04 10:33:11 +08:00
Vladimir Rodionov a3110afcda HBASE-21688 Address WAL filesystem issues 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-04-03 16:49:28 -04:00
zhangduo cd2374a7f0 HBASE-22108 Avoid passing null in Admin methods 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-04-02 21:13:17 +08:00
Duo Zhang a3faad76e1 HBASE-22141 Fix TestAsyncDecommissionAdminApi 2019-04-01 21:51:18 +08:00
zhangduo 1c4e705592 HBASE-22135 AsyncAdmin will not refresh master address 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-04-01 09:23:43 +08:00
pingsutw 51dda380a6 HBASE-22101 AsyncAdmin.isTableAvailable should not throw TableNotFoundException 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-30 20:41:19 +08:00
zhangduo 7fe31b060f HBASE-22121 AsyncAdmin can not deal with non default meta replica 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-30 20:18:44 +08:00
zhangduo 833736f28a Revert "HBASE-22073 /rits.jsp throws an exception if no procedure" 
This reverts commit 8bac547559.
 2019-03-30 09:34:14 +08:00
Sergey Shelukhin 7084144512 HBASE-22115 HBase RPC aspires to grow an infinite tree of trace scopes; some other places are also unsafe 
Signed-off-by: Andrew Purtell <apurtell@apache.org>, stack <stack@apache.org>
 2019-03-29 13:39:35 -07:00
Balazs Meszaros 8bac547559 HBASE-22073 /rits.jsp throws an exception if no procedure 2019-03-29 07:43:02 -07:00
李小保 bb75773ba2 HBASE-22082 Should not use an instance to access static members, which will increases compilation costs. 
Signed-off-by: stack <stack@apache.org>
 2019-03-27 08:34:11 -07:00
Sakthi caa9650a70 HBASE-22094: Throw TableNotFoundException if table not exists in AsyncAdmin.compact 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-27 20:14:12 +08:00
pingsutw 56dd309b21 HBASE-22102 Remove AsyncAdmin.isTableAvailable(TableName, byte[][]) 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-27 17:45:01 +08:00
meiyi 7b3ff56202 HBASE-21911 Move getUserPermissions from regionserver to master 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-27 11:22:21 +08:00
xcang baf3ae80f5
HBASE-22067 Fix log in StochasticLoadBalancer when balancer is ill-fit for cluster size 2019-03-26 11:42:21 -07:00
zhangduo 5f6143ebde HBASE-22074 Should use procedure store to persist the state in reportRegionStateTransition 2019-03-26 18:13:59 +08:00
yaojingyi f8524b8f8e HBASE-21964 unset Quota by Throttle Type 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-26 09:42:50 +08:00
Wei-Chiu Chuang 5e1e0ca810 HBASE-21619. Fix warning message caused by incorrect ternary operator evaluation 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-03-25 19:58:12 +01:00
stack 089a639724 HBASE-22052 pom cleaning; filter out jersey-core in hadoop2 to match hadoop3 and remove redunant version specifications 
This is a reapply of a reverted commit. This commit includes
HBASE-22059 amendment and subsequent ammendments to HBASE-22052.
See HBASE-22052 for full story.

jersey-core is problematic. It was transitively included from hadoop
and polluting our CLASSPATH with an implementation of a 1.x version
of the javax.ws.rs.core.Response Interface from jsr311-api when we
want the javax.ws.rs-api 2.x version.

    M hbase-endpoint/pom.xml
    M hbase-http/pom.xml
    M hbase-mapreduce/pom.xml
    M hbase-rest/pom.xml
    M hbase-server/pom.xml
    M hbase-zookeeper/pom.xml
     Remove redundant version specification (and the odd property define
     done already up in parent pom).
    M hbase-it/pom.xml
    M hbase-rest/pom.xml
     Exclude jersey-core explicitly.

    M hbase-procedure/pom.xml
     Remove redundant version and classifier.

    M pom.xml
     Add jersey-core exclusions to all dependencies that pull it in
     except hadoop-minicluster. mr tests fail w/o the jersey-core
     so let it in for minicluster and then in modules, exclude it
     where it causes damage as in hbase-it.
 2019-03-25 09:30:09 -04:00
Toshihiro Suzuki 44f8abd5c6 HBASE-22093 Combine TestRestoreSnapshotFromClientWithRegionReplicas to CloneSnapshotFromClientAfterSplittingRegionTestBase#testCloneSnapshotAfterSplittingRegion 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-03-24 15:07:54 +09:00
zhangduo 386703811d Revert "HBASE-21965 Fix failed split and merge transactions that have failed to roll back" 
This reverts commit 7e3ca7063c.
 2019-03-24 13:51:34 +08:00
Kevin Risden c144c814b0 HBASE-21895 - Error prone upgrade 
* Upgrades to error prone 2.3.3
* Moves to error prone plugin to support 9+ JDKs
* Removes custom error prone plugin due to no usage

Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-24 13:13:07 +08:00
Toshihiro Suzuki 94c18f0653 HBASE-22095 Taking a snapshot fails in local mode 
Signed-off-by: Zach York <zyork@apache.org>
 2019-03-24 13:47:50 +09:00
pingsutw 21cb00eef6 HBASE-22064 Remove Admin.deleteSnapshot(byte[]) 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-23 21:27:12 +08:00
Jingyun Tian 7e3ca7063c HBASE-21965 Fix failed split and merge transactions that have failed to roll back 2019-03-22 17:11:50 +08:00
Sakthi 36f0929efc
HBASE-21991: Fix MetaMetrics issues - [Race condition, Faulty remove logic], few improvements 
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-03-21 13:55:08 -07:00
niuyulin cbd9c9b2e1 HBASE-22065 Add listTableDescriptors(List<TableName>) method in AsyncAdmin 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-21 22:35:45 +08:00
Jingyun Tian c52dd9efa0 HBASE-22061 SplitTableRegionProcedure should hold the lock of its daughter regions 2019-03-20 14:12:09 +08:00
meiyi 86dd92cccb HBASE-22015 UserPermission should be annotated as InterfaceAudience.Public 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-19 14:41:22 +08:00
zhangduo cc55835d03 HBASE-22040 Add mergeRegionsAsync with a List of region names method in AsyncAdmin 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-03-18 20:45:21 +08:00
Andrew Purtell 6cd78e899f
HBASE-21926 Profiler servlet 2019-03-17 18:48:12 -07:00
Nihal Jain 01e5af5a34 HBASE-20662 Increasing space quota on a violated table does not remove SpaceViolationPolicy.DISABLE enforcement 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-03-15 12:16:58 -04:00
Duo Zhang 3c5761e365 HBASE-22002 Remove the deprecated methods in Admin interface 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-03-14 21:42:23 +08:00
meiyi 908dea8e41 HBASE-21977 Skip replay WAL and update seqid when open regions restored from snapshot 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-03-12 21:24:43 +08:00
zhangduo 10ca598004 HBASE-22001 Polish the Admin interface 
Signed-off-by: stack <stack@apache.org>
 2019-03-11 14:38:31 +08:00
zhangduo 3ff2847457 HBASE-21736 Remove the server from online servers before scheduling SCP for it in hbck 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-03-09 08:55:17 +08:00
zhangduo 6e3987cf02 HBASE-22007 Add restoreSnapshot and cloneSnapshot with acl methods in AsyncAdmin 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-03-08 18:03:00 +08:00
Jack Bearden 65149bd8fc HBASE-20918 Re-enable TestRpcHandlerException 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-03-07 10:04:25 -06:00
stack c9e358908f HBASE-22006 Fix branch-2.1 findbugs warning; causes nightly show as failed. 
(cherry picked from commit 18d02ffd5d)
 2019-03-07 08:50:53 -06:00
ramkrishna fd6bc5d900 HBASE-21874 Bucket cache on Persistent memory 
Signed-off-by: Anoop John <anoop.hbase@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 763202d48e)
 2019-03-07 08:50:08 -06:00
Sean Busbey d9793c311c Revert "HBASE-21874 Bucket cache on Persistent memory" 
This reverts commit 763202d48e.

bad signed-off-by line
 2019-03-07 08:49:41 -06:00
Sean Busbey 415ff2a19d Revert "SE-22006 Fix branch-2.1 findbugs warning; causes nightly show as failed." 
This reverts commit 18d02ffd5d.

bad commit message
 2019-03-07 08:49:07 -06:00
stack 18d02ffd5d SE-22006 Fix branch-2.1 findbugs warning; causes nightly show as failed. 2019-03-06 16:01:58 -08:00
ramkrishna 763202d48e HBASE-21874 Bucket cache on Persistent memory 
Signed-off-by: Anoop John <anoop.hbase@gmail.com>, Sean Busbey
<busbey@apache.org>
 2019-03-06 22:37:54 +05:30
subrat.mishra 177d43d8db HBASE-21871 Added support to specify a peer table name in VerifyReplication tool 
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
 2019-03-06 23:27:44 +09:00
maoling 70558174f0 HBASE-21949 Fix flaky test TestHBaseTestingUtility.testMiniZooKeeperWithMultipleClientPorts 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-06 18:00:57 +08:00
zhangduo 7142cea121 HBASE-21980 Fix typo in AbstractTestAsyncTableRegionReplicasRead 2019-03-03 08:29:37 +08:00
meiyi 841a45afb7 HBASE-21974 Change Admin#grant/revoke parameter from UserPermission to user and Permission 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-02 23:41:48 +08:00
Syeda 030b4d12fb HBASE-21487 Concurrent modify table ops can lead to unexpected results 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-02 13:00:19 +08:00
Duo Zhang cbdbe6572b HBASE-21976 Deal with RetryImmediatelyException for batching request 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-02 12:14:16 +08:00
Reid Chan f748e489c5 HBASE-21481 [acl] Superuser's permissions should not be granted or revoked by any non-su global admin 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-01 23:37:28 +08:00
Duo Zhang 929a8aa5e8 HBASE-21082 Reimplement assign/unassign related procedure metrics 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-03-01 21:08:13 +08:00
Xu cang fd152c265e
HBASE-21952 Fix unit test: TestClientOperationInterrupt#testInterrupt50Percent 2019-02-28 22:20:18 -08:00
Jingyun Tian c19bc5911b HBASE-21934 RemoteProcedureDispatcher should track the ongoing dispatched calls 2019-03-01 11:00:07 +08:00
Guanghao Zhang c4f5d3c508 HBASE-21967 Split TestServerCrashProcedure and TestServerCrashProcedureWithReplicas 2019-02-28 17:46:02 +08:00
meiyi 9370347efe HBASE-21820 Implement CLUSTER quota scope 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-27 18:23:45 +08:00
Duo Zhang b1c42f1009 HBASE-21961 Infinite loop in AsyncNonMetaRegionLocator if there is only one region and we tried to locate before a non empty row 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-27 17:54:50 +08:00
Guanghao Zhang 6e06a0d790 HBASE-20724 Sometimes some compacted storefiles are still opened after region failover 2019-02-27 15:45:42 +08:00
Duo Zhang c33ceb23d3 HBASE-21943 The usage of RegionLocations.mergeRegionLocations is wrong for async client 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-26 11:21:55 +08:00
xuqinya 99362e894c HBASE-21942 [UI] requests per second is incorrect in rsgroup page(rsgroup.jsp) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-02-25 16:23:14 +01:00
zhangduo aa7d3ce39f HBASE-21944 Validate put for batch operation 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-24 20:19:51 +08:00
zhangduo a47c1ddcd2 HBASE-21945 Maintain the original order when sending batch request 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-24 17:55:49 +08:00
Guanghao Zhang 0fc5173eef HBASE-21922 BloomContext#sanityCheck may failed when use ROWPREFIX_DELIMITED bloom filter 2019-02-23 23:25:01 +08:00
Duo Zhang 07d84eb809 HBASE-21929 The checks at the end of TestRpcClientLeaks are not executed 
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-02-23 20:56:54 +08:00
Duo Zhang f0032c9255 HBASE-20587 Replace Jackson with shaded thirdparty gson 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-02-22 16:24:51 +08:00
Wellington Chevreuil 482b505796 HBASE-21505 - proposal for a more consistent report on status 
Signed-off-by: Jingyun Tian <tianjy@apache.org>
 2019-02-22 12:08:38 +08:00
meiyi dfb95cfd83 HBASE-21938 Add a new ClusterMetrics.Option SERVERS_NAME to only return the live region servers's name without metrics 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-22 10:41:51 +08:00
meiyi 9a55cbb2c1 HBASE-21783 Support exceed user/table/ns throttle quota if region server has available quota 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-21 15:36:37 +08:00
Toshihiro Suzuki 72df52283b HBASE-21867 Support multi-threads in HFileArchiver 2019-02-21 10:26:34 +09:00
zhangduo a551149ca7 HBASE-21927 Always fail the locate request when error occur 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-02-20 19:47:28 +08:00
Jingyun Tian eedc33dfd2 Revert "HBASE-21505 - proposal for a more consistent report on status" 
This reverts commit c578020588.
 2019-02-20 18:06:42 +08:00
Guanghao Zhang e218874e9b HBASE-21932 Use Runtime.getRuntime().halt to terminate regionserver when abort timeout 2019-02-20 15:50:14 +08:00
zhangduo e984515b74 HBASE-21928 Deprecated HConstants.META_QOS 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-02-20 14:16:40 +08:00
zhangduo e257f4698c HBASE-21930 Deal with ScannerResetException when opening region scanner 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-02-20 11:03:56 +08:00
Josh Elser b76b0191b1 HBASE-21915 Make FileLinkInputStream implement CanUnbuffer 
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
 2019-02-19 16:16:56 -05:00
Wellington Chevreuil c578020588 HBASE-21505 - proposal for a more consistent report on status 
Signed-off-by: Jingyun Tian <tianjy@apache.org>
 2019-02-19 10:51:05 +08:00
Xiang Li 7ecb45a4b0
HBASE-21866 Do not move the table to null rsgroup when creating an existing table 2019-02-18 10:54:22 -08:00
Nihal Jain 593745e8ac HBASE-17942 Disable region splits and merges per table 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-19 07:15:27 +08:00
lujie 7be71c0f55
HBASE-21740 Fix NPE while shutting down RS 2019-02-18 02:48:30 -08:00
Daisuke Kobayashi 40e1d9174e HBASE-21899 Fix missing variables for slf4j Logger 
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
 2019-02-17 20:14:48 +09:00
zhangduo dedab71381 HBASE-21909 Validate the put instance before executing in AsyncTable.put method 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-02-16 17:47:38 +08:00
zhangduo 0b2b474b4c HBASE-21908 Remove Scan.getScanMetrics 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-02-16 17:39:31 +08:00
Josh Elser ae0198084c HBASE-21872 Use a call that defaults to UTF-8 charset for string to byte encoding 
Fixed commit message

Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-02-15 12:11:40 -05:00
Josh Elser d0e4912f67 Revert "HBASE-21782 Use a call that defaults to UTF-8 charset for string to byte encoding" 
This reverts commit 3d4e1d57e5. Fixing incorrect Jira id.
 2019-02-15 12:11:29 -05:00
Duo Zhang 81e1e2f943 HBASE-21910 The nonce implementation is wrong for AsyncTable 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-15 20:24:34 +08:00
Guanghao Zhang 4b185664aa HBASE-21814 Remove the TODO in AccessControlLists#addUserPermission 2019-02-15 19:35:50 +08:00
Duo Zhang b73cffb10a HBASE-21875 Change the retry logic in RSProcedureDispatcher to 'retry by default, only if xxx' 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-15 11:05:01 +08:00
Josh Elser 3d4e1d57e5 HBASE-21782 Use a call that defaults to UTF-8 charset for string to byte encoding 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-02-14 12:02:49 -05:00
Duo Zhang b3eb70c32d HBASE-21890 Use execute instead of submit to submit a task in RemoteProcedureDispatcher 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-02-14 14:15:59 +08:00
Duo Zhang e06beb0d72 HBASE-21888 Add a isClosed method to AsyncConnection 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-14 11:41:16 +08:00
Sergey Shelukhin cd6042e020 HBASE-21849 master serving regions version is not handled correctly 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-02-13 16:06:48 -08:00
Sean Busbey 4273e42ce5 HBASE-21884 avoid autoboxing in ugi ref counting for secure bulk load 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-02-13 13:51:26 -06:00
zhangduo f1e5999ad2 HBASE-21859 Add clearRegionLocationCache method for AsyncConnection 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-02-13 10:07:29 +08:00
Sergey Shelukhin 9ef6bc4323 HBASE-21785 master reports open regions as RITs and also messes up rit age metric 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-02-12 12:53:17 -08:00
Sakthi 5049f460b8 HBASE-21780: Avoid a wide line on the RegionServer webUI for many ZooKeeper servers 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-02-12 10:58:53 +01:00
huzheng 1df571cb36 HBASE-18484 VerifyRep by snapshot does not work when Yarn/SourceHBase/PeerHBase located in three different HDFS clusters 2019-02-12 10:42:52 +08:00
Duo Zhang 78d3d5628a HBASE-21868 Remove legacy bulk load support 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-02-12 10:11:04 +08:00
zhangduo c48438fcb0 HBASE-21857 Addendum fix broken UTs 2019-02-11 10:06:54 +08:00
Sakthi abaeeace00
HBASE-21800: RegionServer aborted due to NPE from MetaTableMetrics coprocessor 
Have included code refactoring in MetaTableMetrics & LossyCounting
 2019-02-08 10:43:15 -08:00
zhangduo 6f16836c20 HBASE-21857 Do not need to check clusterKey if replicationEndpoint is provided when adding a peer 
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-02-08 19:47:37 +08:00
kpalanisamy a155d17fa6 HBASE-21816 : Print source cluster replication config directory 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
 2019-02-08 14:06:14 +09:00
zhangduo 7849fa32d6 HBASE-21843 RegionGroupingProvider breaks the meta wal file name pattern which may cause data loss for meta region 2019-02-07 08:28:57 +08:00
zhangduo 6b60c42690 HBASE-21838 Create a special ReplicationEndpoint just for verifying the WAL entries are fine 2019-02-06 18:11:03 +08:00
stack af923225d0 HBASE-19616 Review of LogCleaner Class 2019-02-04 22:16:26 -08:00
Nihal Jain 5f8bdd52a1 HBASE-21795 Client application may get stuck (time bound) if a table modify op is called immediately after split op 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-02-04 20:50:09 +08:00
zhangduo d69c3e5d48 HBASE-21840 TestHRegionWithInMemoryFlush fails with NPE 2019-02-04 19:25:59 +08:00
zhangduo 2b1b79f08b HBASE-21829 Use FutureUtils.addListener instead of calling whenComplete directly 2019-02-03 15:24:54 +08:00
zhangduo f26e1bb588 HBASE-21833 Use NettyAsyncFSWALConfigHelper.setEventLoopConfig to prevent creating too many netty event loop when executing TestHRegion 2019-02-03 14:59:55 +08:00
zhangduo 89c02dc0cc HBASE-21828 Make sure we do not return CompletionException when locating region 2019-02-02 21:13:45 +08:00
Sergey Shelukhin 946bc19242 HBASE-21811 region can be opened on two servers due to race condition with procedures and server reports 
The original fix is provided by Sergey Shelukhin, the UT is added by Duo Zhang

Amending-Author: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-02-02 17:39:31 +08:00
huzheng 81ebe6d40d HBASE-21764 Size of in-memory compaction thread pool shoud be configurable 2019-02-01 10:01:34 +08:00
Nihal Jain c5f4e84106 HBASE-21644 Modify table procedure runs infinitely for a table having region replication > 1 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-01-31 19:34:22 +08:00
Nihal Jain 1c71544497 HBASE-21404 Master/RS navbar active state does not work 
Signed-off-by: Jingyun Tian <tianjy@apache.org>
 2019-01-31 16:33:07 +08:00
Sergey Shelukhin c90e9ff5ef HBASE-21806 add an option to roll WAL on very slow syncs 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-01-30 16:43:42 -08:00
meiyi 5ddda1a1f6 HBASE-21733 SnapshotQuotaObserverChore should only fetch space quotas 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-30 17:51:25 +08:00
wanghuan 16c7f5dac9 HBASE-21699 Fixed create table failed when using SPLITS_FILE => 'splits.txt' 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-30 15:56:25 +08:00
meiyi f997252344 HBASE-21739 Move grant/revoke from regionserver to master 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-30 11:16:57 +08:00
Duo Zhang 7dc69b6128 HBASE-21792 Mark HTableMultiplexer as deprecated and remove it in 3.0.0 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-29 09:08:02 +08:00
zhangduo 274e4ccea8 HBASE-21789 Rewrite MetaTableAccessor.multiMutate with Table.coprocessorService 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-27 11:36:58 +08:00
zhangduo 1995f61d7f HBASE-21782 LoadIncrementalHFiles should not be IA.Public 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-27 11:24:55 +08:00
Duo Zhang 4f3b95b318 HBASE-21762 Move some methods in ClusterConnection to Connection 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-01-25 21:13:44 +08:00
meiyi 281558a3ab HBASE-21713 Support set region server throttle quota 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-25 13:50:42 +08:00
Wellington Chevreuil 54093b0d1f HBASE-20215 - Rename CollectionUtils to ConcurrentMapUtils 2019-01-24 20:55:15 -08:00
Jingyun Tian 91dffb043a HBASE-21729 Extract ProcedureCoordinatorRpcs and ProcedureMemberRpcs from CoordinatedStateManager 2019-01-25 11:15:55 +08:00
zhangduo e43c833145 HBASE-21770 Should deal with meta table in HRegionLocator.getAllRegionLocations 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-25 11:00:51 +08:00
zhangduo 416b70f461 HBASE-21761 Align the methods in RegionLocator and AsyncTableRegionLocator 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-24 15:21:11 +08:00
Tommy Li d187af00ca HBASE-21720 : metric to measure how actions are distributed to servers within a MultiAction 
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
 2019-01-23 17:52:58 -08:00
Nihal Jain 050caf425e
HBASE-21475 Put mutation (having TTL set) added via co-processor is retrieved even after TTL expires 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-01-23 16:57:28 -08:00
Allan Yang b5619a2a26 HBASE-21754 ReportRegionStateTransitionRequest should be executed in priority executor 2019-01-23 20:55:00 +08:00
Duo Zhang dfad304ddb HBASE-21753 Support getting the locations for all the replicas of a region 2019-01-23 18:09:39 +08:00
Sergey Shelukhin fa3946fbea HBASE-21626 log the regions blocking WAL from being archived ADDENDUM 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-22 15:15:38 -08:00
huzheng 35ed5d6c39 HBASE-21750 Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized 2019-01-22 19:58:03 +08:00
Nihal Jain f2820ea16f
HBASE-21749 RS UI may throw NPE and make rs-status page inaccessible with multiwal and replication 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-01-21 17:26:07 -08:00
huzheng 35df6147ee HBASE-21738 Remove all the CLSM#size operation in our memstore because it's an quite time consuming. 2019-01-21 16:52:49 +08:00
zhangduo a2f6768acd HBASE-21746 Fix two concern cases in RegionMover 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-20 08:57:01 +08:00
Duo Zhang 882bd564f4 HBASE-21726 Add getAllRegionLocations method to AsyncTableRegionLocator 2019-01-19 11:14:35 +08:00
zhangduo 44dc872b7b HBASE-19695 Handle disabled table for async client 
Signed-off-by: tianjingyun <tianjy1990@gmail.com>
 2019-01-17 18:34:12 +08:00
Beluga Behr 3e92cd5771 HBASE-20209 Do Not Use Both Map containsKey and get Methods in Replication Sink 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-01-16 09:39:40 -07:00
Duo Zhang 594341d6fe HBASE-21710 Add quota related methods to the Admin interface 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-01-16 21:08:47 +08:00
huzheng 15031c5bd5 HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case 2019-01-16 09:41:02 +08:00
tianjingyun c2c1af4927 HBASE-21647 Add status track for splitting WAL tasks 2019-01-15 16:38:37 -08:00
Pankaj 6da0b4ec34 HBASE-21639 maxHeapUsage value not read properly from config during EntryBuffers initialization 2019-01-15 12:18:28 -08:00
Pankaj bc0fb66e22 HBASE-21595, Print thread's information and stack traces when RS is aborting forcibly 2019-01-15 12:11:48 -08:00
Sakthi 93d4b95b3f HBASE-21225: Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE' 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-01-14 17:55:42 -07:00
Sergey Shelukhin e69ab24552 HBASE-21626 : log the regions blocking WAL from being archived 2019-01-14 14:52:24 -08:00
zhangduo c5691a9f60 HBASE-21705 Should treat meta table specially for some methods in AsyncAdmin 2019-01-13 13:40:52 +08:00
Duo Zhang 3d2580cd6d HBASE-21704 The implementation of DistributedHBaseCluster.getServerHoldingRegion is incorrect 2019-01-11 21:34:16 +08:00
Duo Zhang fbf79373e6 HBASE-21663 Add replica scan support 2019-01-11 14:19:05 +08:00
Duo Zhang 7bebdff6a2 HBASE-21580 Support getting Hbck instance from AsyncConnection 2019-01-11 11:26:44 +08:00
Nihal Jain 5d32e80f9e HBASE-21297 ModifyTableProcedure can throw TNDE instead of IOE in case of REGION_REPLICATION change 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-10 22:01:45 +08:00
Guanghao Zhang 8e39ec2c59 HBASE-21691 Fix flaky test TestRecoveredEdits 2019-01-10 10:06:45 +08:00
meiyi 620d70d618 HBASE-21694 Add append_peer_exclude_tableCFs and remove_peer_exclude_tableCFs shell commands 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-09 22:02:21 +08:00
Guanghao Zhang a5a61163f1 HBASE-21695 Fix flaky test TestRegionServerAbortTimeout 2019-01-09 21:58:19 +08:00
Sergey Shelukhin 37bc1686d6 HBASE-21614 RIT recovery with ServerCrashProcedure doesn't account for all regions 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2019-01-09 20:03:37 +08:00
Nihal Jain 5c902b48e5 HBASE-21645 Perform sanity check and disallow table creation/modification with region replication < 1 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-09 10:49:19 +08:00
Vladimir Rodionov d26acbe1db HBASE-21688: Address WAL filesystem issues 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-01-08 13:56:11 -05:00
zhangduo e9dae2adc3 HBASE-21683 Reset readsEnabled flag after successfully flushing the primary region 2019-01-08 16:06:34 +08:00
zhangduo 4f0514e39a HBASE-21682 Support getting from specific replica 2019-01-08 09:49:12 +08:00
tianjingyun 281d6429e5 HBASE-21588 Procedure v2 wal splitting implementation 2019-01-07 15:58:15 +08:00
meiyi 77db1fae09 HBASE-21159 Add shell command to switch throttle on or off 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-01-07 14:21:41 +08:00
zhangduo db66e6cc9e HBASE-17356 Add replica get support 2019-01-03 08:38:20 +08:00
Guanghao Zhang ec948f5d90 HBASE-21659 Avoid to load duplicate coprocessors in system config and table descriptor 2019-01-02 10:41:36 +08:00
Guanghao Zhang 3ab895979b HBASE-21660 Apply the cell to right memstore for increment/append operation 2019-01-01 17:32:44 +08:00
Guanghao Zhang f5ea00f724 HBASE-21643 Introduce two new region coprocessor method and deprecated postMutationBeforeWAL 2018-12-27 18:27:06 +08:00
huzheng c2d5991b82 HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time 2018-12-27 18:22:54 +08:00
Guanghao Zhang 4281cb3b95 HBASE-21640 Remove the TODO when increment zero 2018-12-26 21:47:44 +08:00
Andrey Elenskiy dbafa1be83 HBASE-21545 NEW_VERSION_BEHAVIOR breaks Get/Scan with specified columns 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Sakthi
 2018-12-23 22:01:11 -08:00
zhangduo 97fd647de2 HBASE-21635 Use maven enforcer to ban imports from illegal packages 2018-12-24 11:12:25 +08:00
Guanghao Zhang 7c0a3cc265 HBASE-21621 Reversed scan does not return expected number of rows 
The unit test is contributed by Nihal Jain
 2018-12-23 16:19:05 +08:00
Sakthi b2bf22e209 HBASE-21631: list_quotas should print human readable values for LIMIT 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-12-22 22:00:58 +08:00
openinx e160b5ac8d HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
 2018-12-21 15:21:53 -08:00
huzheng 12786f80c1 HBASE-21401 Sanity check when constructing the KeyValue 2018-12-21 18:01:35 +08:00
Guanghao Zhang ad819380c7 HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result 2018-12-21 09:49:24 +08:00
Pankaj 787567336a HBASE-21610, numOpenConnections metric is set to -1 when zero server channel exist 2018-12-20 16:36:42 -08:00
Guanghao Zhang 8991877bb2 HBASE-21514: Refactor CacheConfig(addendum) 2018-12-19 13:55:13 +08:00
Pankaj fb58a23e56 HBASE-21535, Zombie Master detector is not working 2018-12-18 20:51:01 -08:00
Jingyun Tian c448604ceb HBASE-21565 Delete dead server from dead server list too early leads to concurrent Server Crash Procedures(SCP) for a same server 2018-12-18 16:57:11 +08:00
xuqinya f78284685f HBASE-21592 quota.addGetResult(r) throw NPE 
Signed-off-by: huzheng <openinx@gmail.com>
 2018-12-18 16:15:51 +08:00
Guanghao Zhang 1971d02e72 HBASE-21514 Refactor CacheConfig 2018-12-18 13:43:30 +08:00
stack 68b5df0095 HBASE-21589 TestCleanupMetaWAL fails 2018-12-17 09:31:59 -08:00
huzheng ac0b3bb547 HBASE-21520 TestMultiColumnScanner cost long time when using ROWCOL bloom type 2018-12-15 21:08:52 +08:00
Sean Busbey 491153488e HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. (addendum) 2018-12-14 17:08:22 -06:00
meiyi 1b08ba7385 HBASE-21578 Fix wrong throttling exception for capacity unit 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-12-14 18:17:47 +08:00
Sergey Shelukhin 3ff274e22e HBASE-21575 : memstore above high watermark message is logged too much 2018-12-13 12:47:11 -08:00
Sergey Shelukhin 9a25d0c249 Revert "HIVE-21575 : memstore above high watermark message is logged too much" 
This reverts commit 4640ff5959.
 2018-12-13 12:46:39 -08:00
Lars Hofhansl cb1966dc2d HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. 2018-12-13 11:57:16 -08:00
huzheng f32d261843 HBASE-21582 If call HBaseAdmin#snapshotAsync but forget call isSnapshotFinished, then SnapshotHFileCleaner will skip to run every time 2018-12-13 10:35:20 +08:00
Sergey Shelukhin 4640ff5959 HIVE-21575 : memstore above high watermark message is logged too much 2018-12-12 11:02:25 -08:00
Josh Elser 67d6d5084c HBASE-21568 Use CacheConfig.DISABLED where we don't expect to have blockcache running 
This includes removing the "old way" of disabling blockcache in favor of the
new API.

Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-12-11 10:02:18 -05:00
zhangduo b09b87d143 HBASE-21570 Add write buffer periodic flush support for AsyncBufferedMutator 2018-12-11 14:51:26 +08:00
Guanghao Zhang 79d90c87b5 HBASE-21560 Return a new TableDescriptor for MasterObserver#preModifyTable to allow coprocessor modify the TableDescriptor 2018-12-08 09:28:14 +08:00
Guanghao Zhang 8d7061a487 HBASE-21554 Show replication endpoint classname for replication peer on master web UI 2018-12-07 13:31:59 +08:00
Allan Yang e0e0694fa1 HBASE-21413 Empty meta log doesn't get split when restart whole cluster 
Signed-off-by: stack <stack@apache.org>
 2018-12-06 21:21:41 -08:00
huzheng dfb9ae8e0e HBASE-21559 The RestoreSnapshotFromClientTestBase related UT are flaky 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-12-07 08:22:22 +08:00
Tommy Li 170df27b88 HBASE-21414 : StoreFileSize growth rate metric 
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
 2018-12-06 14:43:17 -08:00
huzheng 67ab8b888f HBASE-21551 Memory leak when use scan with STREAM at server side - (addendum) 2018-12-06 11:26:52 +08:00
huzheng 3b854859f6 HBASE-21551 Memory leak when use scan with STREAM at server side 2018-12-06 10:55:42 +08:00
Duo Zhang f49baf259e HBASE-21550 Add a new method preCreateTableRegionInfos for MasterObserver which allows CPs to modify the TableDescriptor 2018-12-06 08:30:32 +08:00
zhangduo 8bf966c8e9 HBASE-21541 Move MetaTableLocator.verifyRegionLocation to hbase-rsgroup module 2018-12-04 22:33:36 +08:00
zhangduo dec49135a3 HBASE-21534 Addendum output uncaught exception, fix the way that we add new region servers to avoid recreate a dead server 2018-12-03 08:19:21 +08:00
Duo Zhang d525ec6a12 HBASE-21534 TestAssignmentManager is flakey 2018-12-01 20:41:11 +08:00
Peter Somogyi 5c209f2cec HBASE-21479 Individual tests in TestHRegionReplayEvents class are failing 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-12-01 09:36:10 +01:00
Duo Zhang 766aa1bfcc HBASE-21486 The current replication implementation for peer in STANDBY state breaks serial replication 2018-12-01 12:15:18 +08:00
Peter Somogyi dfeab9f5c9 HBASE-21518 TestMasterFailoverWithProcedures is flaky 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-11-30 09:12:06 +01:00
huzheng d42e0ade1c HBASE-21504 If enable FIFOCompactionPolicy, a compaction may write a "empty" hfile whose maxTimeStamp is long max. This kind of hfile will never be archived. 2018-11-30 09:53:06 +08:00
Artem Ervits 3ad2a89fdf HBASE-18735 Provide an option to kill a MiniHBaseCluster without waiting on shutdown 
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-11-29 16:37:50 -05:00
meiyi f1f2b5a038 HBASE-21300 Fix the wrong reference file path when restoring snapshots for tables with MOB columns 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-11-29 11:23:45 +08:00
Duo Zhang d6e1d18be9 HBASE-21517 Move the getTableRegionForRow method from HMaster to TestMaster 2018-11-28 09:40:27 +08:00
BELUGA BEHR 7877e09b60 HBASE-21492 CellCodec Written To WAL Before It's Verified 2018-11-27 08:57:06 -08:00
lixiaobao 6f15cecaed HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method 
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
 2018-11-27 20:56:23 +08:00
zhangduo 39bc458eab Revert "HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method" 
Email address is broken.

This reverts commit 3133d43859.
 2018-11-27 20:55:04 +08:00
lixiaobao 3133d43859 HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method 
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
 2018-11-27 20:31:07 +08:00
Guanghao Zhang 34e1d744f7 HBASE-21498 Master OOM when SplitTableRegionProcedure new CacheConfig and instantiate a new BlockCache 2018-11-27 14:20:15 +08:00
zhangduo 1acbd36c90 HBASE-21154 Remove hbase:namespace table; fold it into hbase:meta 2018-11-26 14:51:56 +08:00
Duo Zhang a0e3cb6c0c HBASE-21508 Ignore the reportRegionStateTransition call from a dead server 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-11-26 14:32:14 +08:00
Ted Yu 27c0bf5c63 HBASE-21511 Remove in progress snapshot check in SnapshotFileCache#getUnreferencedFiles 2018-11-25 18:20:00 -08:00
zhangduo 701526d19f HBASE-21510 Test TestRegisterPeerWorkerWhenRestarting is flakey 2018-11-24 19:50:59 +08:00
Ted Yu d9c773b0a5 HBASE-21387 Addendum fix TestSnapshotFileCache 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-11-24 17:00:08 +08:00
huzheng 6d0dc960e6 HBASE-21387 Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files 2018-11-23 11:31:37 +08:00
Duo Zhang 5cc845b713 HBASE-21503 Replication normal source can get stuck due potential race conditions between source wal reader and wal provider initialization threads. 
Found and analysed by Wellington Chevreuil
 2018-11-21 17:14:54 +08:00
meiyi 5ded294419 HBASE-21034 Add new throttle type: read/write capacity unit 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-11-21 09:46:49 +08:00
Duo Zhang 405bf5e638 HBASE-21490 WALProcedure may remove proc wal files still with active procedures 
Signed-off-by: Allan Yang <allan163@apache.org>
 2018-11-19 08:21:28 -08:00
zhangduo b329e6e3f2 HBASE-21494 NPE when loading RecoverStandByProcedure 2018-11-19 09:35:18 +08:00
zhangduo f555258e7a HBASE-21480 Taking snapshot when RS crashes prevent we bring the regions online 2018-11-18 21:07:22 +08:00
zhangduo 43a10df70f HBASE-21485 Add more debug logs for remote procedure execution 2018-11-16 14:30:59 +08:00
Reid Chan 130057f137 HBASE-21255 [acl] Refactor TablePermission into three classes (Global, Namespace, Table) 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-11-15 11:34:16 +08:00
zhangduo 9e42a9e310 HBASE-21472 Should not persist the dispatched field for RegionRemoteProcedureBase 2018-11-15 09:41:38 +08:00
huzheng a8b642067d HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags 2018-11-14 23:00:12 +08:00
zhangduo 640a5e390b HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors 2018-11-14 18:48:33 +08:00
zhangduo 64c4861272 Revert "HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors" 
This reverts commit ffb003ee44.
 2018-11-13 22:24:59 +08:00
zhangduo 3eb27a099a Revert "HBASE-21465 Addendum change TestReportRegionStateTransitionRetry to MediumTests" 
This reverts commit 114377d426.
 2018-11-13 22:24:50 +08:00
Duo Zhang 114377d426 HBASE-21465 Addendum change TestReportRegionStateTransitionRetry to MediumTests 2018-11-13 14:59:20 +08:00
Duo Zhang ffb003ee44 HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors 2018-11-13 11:49:22 +08:00
Duo Zhang 55fa8f4b33 HBASE-21463 The checkOnlineRegionsReport can accidentally complete a TRSP 2018-11-13 11:31:03 +08:00
tedyu f770081129 HBASE-21466 WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir 2018-11-12 17:02:17 -08:00
huzheng 362b5dd259 Revert "HBASE-21401 Sanity check in BaseDecoder#parseCell" 
This reverts commit f17382792f.
 2018-11-12 11:37:46 +08:00
Duo Zhang 6786aca666 HBASE-21376 Add some verbose log to MasterProcedureScheduler 2018-11-10 17:17:12 +08:00
Duo Zhang fe2265fa4a HBASE-21451 The way we maintain the lastestPaths in ReplicationSourceManager is broken when sync replication is used 2018-11-09 14:53:33 +08:00
jingyuntian fa6373660f HBASE-21410 A helper page that help find all problematic regions and procedures 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2018-11-09 14:01:49 +08:00
Guanghao Zhang 13b4351012 Revert "HBASE-21410 A helper page that help find all problematic regions and procedures" 
This reverts commit 3c34073988.

missing sign-off.
 2018-11-09 14:01:29 +08:00
jingyuntian 3c34073988 HBASE-21410 A helper page that help find all problematic regions and procedures 2018-11-09 13:53:00 +08:00
Ben Lau d9f32137b6 HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-11-08 11:59:34 -08:00
Esteban Gutierrez a8ad61ec88
HBASE-20604 ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-11-08 10:22:22 -08:00
huzheng f17382792f HBASE-21401 Sanity check in BaseDecoder#parseCell 2018-11-08 20:07:04 +08:00
jingyuntian cf9b515563 HBASE-21419 Show sync replication related field for replication peer on master web UI 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2018-11-08 14:50:37 +08:00
zhangduo 6d46b8d256 HBASE-21441 NPE if RS restarts between REFRESH_PEER_SYNC_REPLICATION_STATE_ON_RS_BEGIN and TRANSIT_PEER_NEW_SYNC_REPLICATION_STATE 2018-11-07 16:10:42 +08:00
Allan Yang a31458bdee HBASE-21421 Do not kill RS if reportOnlineRegions fails 2018-11-06 14:58:35 +08:00
tedyu 7395ffac44 HBASE-21247 Custom WAL Provider cannot be specified by configuration whose value is outside the enums in Providers 2018-11-05 08:29:04 -08:00
Duo Zhang c8574ba3c5 HBASE-21420 Use procedure event to wake up the SyncReplicationReplayWALProcedures which wait for worker 2018-11-05 21:43:18 +08:00
Michael Stack d08990c962 HBASE-21425 2.1.1 fails to start over 1.x data; namespace not assigned 2018-11-03 09:46:19 -07:00
zhangduo 62fe365934 HBASE-21351 The force update thread may have race with PE worker when the procedure is rolling back 2018-11-03 08:24:11 +08:00
jingyuntian 25c964e9a3
HBASE-21407 Resolve NPE in backup Master UI 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-11-02 11:47:02 -07:00
zhangduo e7f6c2972d HBASE-21422 NPE in TestMergeTableRegionsProcedure.testMergeWithoutPONR 2018-11-02 20:54:00 +08:00
Beluga Behr 21b98e1075 HBASE-19682 Use Collections.emptyList() For Empty List Values 2018-11-01 08:51:11 -07:00
Guanghao Zhang 6bdaedd7ce HBASE-21388 No need to instantiate MemStoreLAB for master which not carry table 2018-11-01 16:15:18 +08:00
zhangduo 02f5f171f5 HBASE-21389 Revisit the procedure lock for sync replication 2018-10-30 18:11:20 +08:00
tianjingyun 116eee6747
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-10-29 20:55:37 -07:00
zhangduo d5e4faacc3 HBASE-21375 Revisit the lock and queue implementation in MasterProcedureScheduler 2018-10-29 19:56:49 +08:00
Guanghao Zhang c0b994b0c6 HBASE-21325 Force to terminate regionserver when abort hang in somewhere 2018-10-29 10:08:51 +08:00
Artem Ervits 7cdb525192 HBASE-21175 Partially initialized SnapshotHFileCleaner leads to NPE during TestHFileArchiving 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-10-26 16:44:33 -07:00
Duo Zhang 0ab7c3a189 HBASE-21391 RefreshPeerProcedure should also wait master initialized before executing 2018-10-26 21:44:56 +08:00
Guanghao Zhang 23b7510ae2 HBASE-21365 Throw exception when user put data with skip wal to a table which may be replicated 2018-10-26 17:43:38 +08:00
Guanghao Zhang cd943419b6 HBASE-21385 HTable.delete request use rpc call directly instead of AsyncProcess 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-10-25 16:22:36 -07:00
Michael Stack 6830a1c1a0 HBASE-21372) Set hbase.assignment.maximum.attempts to Long.MAX 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
 2018-10-24 09:07:40 -07:00
Duo Zhang 3fe8649b2c HBASE-21377 Add debug log for catching the root cause 2018-10-24 15:43:12 +08:00
xcang 1f437ac221
HBASE-21349 Do not run CatalogJanitor or Nomalizer when cluster is shutting down 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-10-23 14:45:05 -07:00
mazhenlin 1e9d998727
HBASE-21342 FileSystem in use may get closed by other bulk load call in secure bulkLoad 
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
 2018-10-23 15:51:46 -05:00
xcang 807736fcf1
HBASE-21338 Warn if balancer is an ill-fit for cluster size 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-10-23 13:23:24 -07:00
huzheng ae13b0b293 HBASE-21356 bulkLoadHFile API should ensure that rs has the source hfile's write permissionls 2018-10-23 10:18:40 +08:00
zhangduo 931156f66b HBASE-21336 Addendum remove unused code in HBTU 2018-10-22 20:26:48 +08:00
huzheng d0e7367c8d HBASE-21355 (addendum) replace the expensive reload storefiles with reading the merge result of compacted storefiles and current storefiles 2018-10-22 19:28:53 +08:00
zhangduo 3b66b65b9f HBASE-21336 Simplify the implementation of WALProcedureMap 2018-10-22 18:36:11 +08:00
huzheng 77ac352a95 HBASE-21355 HStore's storeSize is calculated repeatedly which causing the confusing region split 2018-10-22 09:43:14 +08:00
Duo Zhang 7d7293049a Revert "HBASE-21336 Simplify the implementation of WALProcedureMap" 
This reverts commit 7adf590106.
 2018-10-22 09:32:55 +08:00
zhangduo dd474ef199 HBASE-21334 TestMergeTableRegionsProcedure is flakey 2018-10-21 22:40:19 +08:00
Artem Ervits b723ce1051 HBASE-21194 Add tests in TestCopyTable which exercises MOB feature 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-10-20 08:10:27 -07:00
zhangduo 7adf590106 HBASE-21336 Simplify the implementation of WALProcedureMap 2018-10-20 21:59:46 +08:00
Toshihiro Suzuki 4bf3c5a702 HBASE-21200 Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner. 2018-10-20 08:34:23 +09:00
Mike Drob bc7628a8c3
HBASE-21073 Redo concept of maintenance mode 
Instead of being an ephemeral state set by hbck, maintenance mode is now
an explicit toggle set by either configuration property or environment
variable. In maintenance mode, master will host system tables and not
assign any user-space tables to RSs. This gives operators the ability to
affect repairs to meta table with fewer moving parts.
 2018-10-18 16:27:53 -05:00
jingyuntian 5fbb227deb
HBASE-21269　Forward-port HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign 2018-10-18 06:22:52 -07:00
haxiaolin 92fdc8dd51 HBASE-21055 NullPointerException when balanceOverall() but server balance info is null 
Signed-off-by: huzheng <openinx@gmail.com>
 2018-10-18 14:04:28 +08:00
Duo Zhang 5efa5f6de4 HBASE-21330 ReopenTableRegionsProcedure will enter an infinite loop if we schedule a TRSP at the same time 2018-10-18 11:29:12 +08:00
tedyu 1e339e6629 HBASE-21281 Update bouncycastle dependency - addendum adds dependency for hbase-server module 2018-10-17 15:59:41 -07:00
Michael Stack fd940f3b78
HBASE-21327 Fix minor logging issue where we don't report servername if no associated SCP 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2018-10-17 09:42:45 -07:00
Michael Stack 8cc56bd18c
HBASE-21320 [canary] Cleanup of usage and add commentary 
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
 2018-10-16 22:20:00 -07:00
subrat.mishra 3b91ae5b2a
HBASE-21263 Mention compression algorithm along with other storefile details 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
 2018-10-16 12:38:11 -07:00
zhangduo 0d9982901a HBASE-21278 Do not rollback successful sub procedures when rolling back a procedure 2018-10-16 15:12:49 +08:00
Andrew Purtell c9dcc9a065
HBASE-21266 Not running balancer because processing dead regionservers, but empty dead rs list 2018-10-15 22:28:36 -07:00
zhangduo fc7a6a64c2 HBASE-21311 Split TestRestoreSnapshotFromClient 2018-10-16 08:29:35 +08:00
Guanghao Zhang 4a043126b1 HBASE-21290 No need to instantiate BlockCache for master which not carry table 2018-10-15 17:21:17 +08:00
haxiaolin 7d798b3c73 HBASE-21260 The whole balancer plans might be aborted if there are more than one plans to move a same region 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2018-10-15 15:54:13 +08:00
zhangduo 6781918ca8 HBASE-21310 Split TestCloneSnapshotFromClient 2018-10-15 14:00:40 +08:00
zhangduo dde336f6ef HBASE-21309 Increase the waiting timeout for TestProcedurePriority 2018-10-14 08:46:18 +08:00
Michael Stack a292ab7c87 HBASE-21299 List counts of actual region states in master UI tables section 2018-10-12 11:02:36 -07:00
Guanghao Zhang fa5fa6ecdd HBASE-21289 Remove the log "'hbase.regionserver.maxlogs' was deprecated." in AbstractFSWAL 2018-10-12 20:27:10 +08:00
Duo Zhang 9e9a1e0f0d HBASE-21254 Need to find a way to limit the number of proc wal files 2018-10-12 11:05:13 +08:00
tedyu 924d183ba0 HBASE-21247 Allow WAL Provider to be specified by configuration without explicit enum in Providers - revert 2018-10-11 09:00:24 -07:00
Josh Elser 8b66dea2ff HBASE-21281 Upgrade bouncycastle to latest 
BC 1.47 introduced some incompatible API changes which came in via
a new Maven artifact. We don't use any changed API in HBase. This
also removes some unnecessary dependencies on bcprov in other
modules (presumably, they are vestiges)

Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
 2018-10-11 11:02:32 -04:00
Mike Drob db9a5b7da7 HBASE-21287 Allow configuring test master initialization wait time. 2018-10-11 09:43:04 -05:00
tedyu 0789f54454 HBASE-21247 Allow WAL Provider to be specified by configuration without explicit enum in Providers 2018-10-10 08:27:16 -07:00
Guanghao Zhang a1f28f3ca7 HBASE-21277 Prevent to add same table to two sync replication peer's config 2018-10-10 15:43:16 +08:00
Guanghao Zhang f122328758 HBASE-21251 Refactor RegionMover 2018-10-10 15:10:57 +08:00
Michael Stack 7c755bf06e HBASE-21280 Add anchors for each heading in UI 
Signed-off-by: Ted Yu <tedyu@apache.org>
 2018-10-09 22:50:19 -07:00
Duo Zhang e8df847d4e HBASE-21250 Addendum remove unused modification in hbase-server module 2018-10-08 14:55:55 +08:00