Commit Graph

7627 Commits

Author SHA1 Message Date
李小保 bb75773ba2 HBASE-22082 Should not use an instance to access static members, which will increases compilation costs.
Signed-off-by: stack <stack@apache.org>
2019-03-27 08:34:11 -07:00
Sakthi caa9650a70 HBASE-22094: Throw TableNotFoundException if table not exists in AsyncAdmin.compact
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-27 20:14:12 +08:00
pingsutw 56dd309b21 HBASE-22102 Remove AsyncAdmin.isTableAvailable(TableName, byte[][])
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-27 17:45:01 +08:00
meiyi 7b3ff56202 HBASE-21911 Move getUserPermissions from regionserver to master
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-27 11:22:21 +08:00
xcang baf3ae80f5
HBASE-22067 Fix log in StochasticLoadBalancer when balancer is ill-fit for cluster size 2019-03-26 11:42:21 -07:00
zhangduo 5f6143ebde HBASE-22074 Should use procedure store to persist the state in reportRegionStateTransition 2019-03-26 18:13:59 +08:00
yaojingyi f8524b8f8e HBASE-21964 unset Quota by Throttle Type
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-26 09:42:50 +08:00
Wei-Chiu Chuang 5e1e0ca810 HBASE-21619. Fix warning message caused by incorrect ternary operator evaluation
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-03-25 19:58:12 +01:00
stack 089a639724 HBASE-22052 pom cleaning; filter out jersey-core in hadoop2 to match hadoop3 and remove redunant version specifications
This is a reapply of a reverted commit. This commit includes
HBASE-22059 amendment and subsequent ammendments to HBASE-22052.
See HBASE-22052 for full story.

jersey-core is problematic. It was transitively included from hadoop
and polluting our CLASSPATH with an implementation of a 1.x version
of the javax.ws.rs.core.Response Interface from jsr311-api when we
want the javax.ws.rs-api 2.x version.

    M hbase-endpoint/pom.xml
    M hbase-http/pom.xml
    M hbase-mapreduce/pom.xml
    M hbase-rest/pom.xml
    M hbase-server/pom.xml
    M hbase-zookeeper/pom.xml
     Remove redundant version specification (and the odd property define
     done already up in parent pom).
    M hbase-it/pom.xml
    M hbase-rest/pom.xml
     Exclude jersey-core explicitly.

    M hbase-procedure/pom.xml
     Remove redundant version and classifier.

    M pom.xml
     Add jersey-core exclusions to all dependencies that pull it in
     except hadoop-minicluster. mr tests fail w/o the jersey-core
     so let it in for minicluster and then in modules, exclude it
     where it causes damage as in hbase-it.
2019-03-25 09:30:09 -04:00
Toshihiro Suzuki 44f8abd5c6 HBASE-22093 Combine TestRestoreSnapshotFromClientWithRegionReplicas to CloneSnapshotFromClientAfterSplittingRegionTestBase#testCloneSnapshotAfterSplittingRegion
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-03-24 15:07:54 +09:00
zhangduo 386703811d Revert "HBASE-21965 Fix failed split and merge transactions that have failed to roll back"
This reverts commit 7e3ca7063c.
2019-03-24 13:51:34 +08:00
Kevin Risden c144c814b0 HBASE-21895 - Error prone upgrade
* Upgrades to error prone 2.3.3
* Moves to error prone plugin to support 9+ JDKs
* Removes custom error prone plugin due to no usage

Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-24 13:13:07 +08:00
Toshihiro Suzuki 94c18f0653 HBASE-22095 Taking a snapshot fails in local mode
Signed-off-by: Zach York <zyork@apache.org>
2019-03-24 13:47:50 +09:00
pingsutw 21cb00eef6 HBASE-22064 Remove Admin.deleteSnapshot(byte[])
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-23 21:27:12 +08:00
Jingyun Tian 7e3ca7063c HBASE-21965 Fix failed split and merge transactions that have failed to roll back 2019-03-22 17:11:50 +08:00
Sakthi 36f0929efc
HBASE-21991: Fix MetaMetrics issues - [Race condition, Faulty remove logic], few improvements
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-21 13:55:08 -07:00
niuyulin cbd9c9b2e1 HBASE-22065 Add listTableDescriptors(List<TableName>) method in AsyncAdmin
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-21 22:35:45 +08:00
Jingyun Tian c52dd9efa0 HBASE-22061 SplitTableRegionProcedure should hold the lock of its daughter regions 2019-03-20 14:12:09 +08:00
meiyi 86dd92cccb HBASE-22015 UserPermission should be annotated as InterfaceAudience.Public
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-19 14:41:22 +08:00
zhangduo cc55835d03 HBASE-22040 Add mergeRegionsAsync with a List of region names method in AsyncAdmin
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-18 20:45:21 +08:00
Andrew Purtell 6cd78e899f
HBASE-21926 Profiler servlet 2019-03-17 18:48:12 -07:00
Nihal Jain 01e5af5a34 HBASE-20662 Increasing space quota on a violated table does not remove SpaceViolationPolicy.DISABLE enforcement
Signed-off-by: Josh Elser <elserj@apache.org>
2019-03-15 12:16:58 -04:00
Duo Zhang 3c5761e365 HBASE-22002 Remove the deprecated methods in Admin interface
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-14 21:42:23 +08:00
meiyi 908dea8e41 HBASE-21977 Skip replay WAL and update seqid when open regions restored from snapshot
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-12 21:24:43 +08:00
zhangduo 10ca598004 HBASE-22001 Polish the Admin interface
Signed-off-by: stack <stack@apache.org>
2019-03-11 14:38:31 +08:00
zhangduo 3ff2847457 HBASE-21736 Remove the server from online servers before scheduling SCP for it in hbck
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-03-09 08:55:17 +08:00
zhangduo 6e3987cf02 HBASE-22007 Add restoreSnapshot and cloneSnapshot with acl methods in AsyncAdmin
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-08 18:03:00 +08:00
Jack Bearden 65149bd8fc HBASE-20918 Re-enable TestRpcHandlerException
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-03-07 10:04:25 -06:00
stack c9e358908f HBASE-22006 Fix branch-2.1 findbugs warning; causes nightly show as failed.
(cherry picked from commit 18d02ffd5d)
2019-03-07 08:50:53 -06:00
ramkrishna fd6bc5d900 HBASE-21874 Bucket cache on Persistent memory
Signed-off-by: Anoop John <anoop.hbase@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 763202d48e)
2019-03-07 08:50:08 -06:00
Sean Busbey d9793c311c Revert "HBASE-21874 Bucket cache on Persistent memory"
This reverts commit 763202d48e.

bad signed-off-by line
2019-03-07 08:49:41 -06:00
Sean Busbey 415ff2a19d Revert "SE-22006 Fix branch-2.1 findbugs warning; causes nightly show as failed."
This reverts commit 18d02ffd5d.

bad commit message
2019-03-07 08:49:07 -06:00
stack 18d02ffd5d SE-22006 Fix branch-2.1 findbugs warning; causes nightly show as failed. 2019-03-06 16:01:58 -08:00
ramkrishna 763202d48e HBASE-21874 Bucket cache on Persistent memory
Signed-off-by: Anoop John <anoop.hbase@gmail.com>, Sean Busbey
<busbey@apache.org>
2019-03-06 22:37:54 +05:30
subrat.mishra 177d43d8db HBASE-21871 Added support to specify a peer table name in VerifyReplication tool
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-03-06 23:27:44 +09:00
maoling 70558174f0 HBASE-21949 Fix flaky test TestHBaseTestingUtility.testMiniZooKeeperWithMultipleClientPorts
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-06 18:00:57 +08:00
zhangduo 7142cea121 HBASE-21980 Fix typo in AbstractTestAsyncTableRegionReplicasRead 2019-03-03 08:29:37 +08:00
meiyi 841a45afb7 HBASE-21974 Change Admin#grant/revoke parameter from UserPermission to user and Permission
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-02 23:41:48 +08:00
Syeda 030b4d12fb HBASE-21487 Concurrent modify table ops can lead to unexpected results
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-02 13:00:19 +08:00
Duo Zhang cbdbe6572b HBASE-21976 Deal with RetryImmediatelyException for batching request
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-02 12:14:16 +08:00
Reid Chan f748e489c5 HBASE-21481 [acl] Superuser's permissions should not be granted or revoked by any non-su global admin
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-01 23:37:28 +08:00
Duo Zhang 929a8aa5e8 HBASE-21082 Reimplement assign/unassign related procedure metrics
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-01 21:08:13 +08:00
Xu cang fd152c265e
HBASE-21952 Fix unit test: TestClientOperationInterrupt#testInterrupt50Percent 2019-02-28 22:20:18 -08:00
Jingyun Tian c19bc5911b HBASE-21934 RemoteProcedureDispatcher should track the ongoing dispatched calls 2019-03-01 11:00:07 +08:00
Guanghao Zhang c4f5d3c508 HBASE-21967 Split TestServerCrashProcedure and TestServerCrashProcedureWithReplicas 2019-02-28 17:46:02 +08:00
meiyi 9370347efe HBASE-21820 Implement CLUSTER quota scope
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-27 18:23:45 +08:00
Duo Zhang b1c42f1009 HBASE-21961 Infinite loop in AsyncNonMetaRegionLocator if there is only one region and we tried to locate before a non empty row
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-27 17:54:50 +08:00
Guanghao Zhang 6e06a0d790 HBASE-20724 Sometimes some compacted storefiles are still opened after region failover 2019-02-27 15:45:42 +08:00
Duo Zhang c33ceb23d3 HBASE-21943 The usage of RegionLocations.mergeRegionLocations is wrong for async client
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-26 11:21:55 +08:00
xuqinya 99362e894c HBASE-21942 [UI] requests per second is incorrect in rsgroup page(rsgroup.jsp)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-02-25 16:23:14 +01:00
zhangduo aa7d3ce39f HBASE-21944 Validate put for batch operation
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-24 20:19:51 +08:00
zhangduo a47c1ddcd2 HBASE-21945 Maintain the original order when sending batch request
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-24 17:55:49 +08:00
Guanghao Zhang 0fc5173eef HBASE-21922 BloomContext#sanityCheck may failed when use ROWPREFIX_DELIMITED bloom filter 2019-02-23 23:25:01 +08:00
Duo Zhang 07d84eb809 HBASE-21929 The checks at the end of TestRpcClientLeaks are not executed
Signed-off-by: Xu Cang <xucang@apache.org>
2019-02-23 20:56:54 +08:00
Duo Zhang f0032c9255 HBASE-20587 Replace Jackson with shaded thirdparty gson
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-22 16:24:51 +08:00
Wellington Chevreuil 482b505796 HBASE-21505 - proposal for a more consistent report on status
Signed-off-by: Jingyun Tian <tianjy@apache.org>
2019-02-22 12:08:38 +08:00
meiyi dfb95cfd83 HBASE-21938 Add a new ClusterMetrics.Option SERVERS_NAME to only return the live region servers's name without metrics
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-22 10:41:51 +08:00
meiyi 9a55cbb2c1 HBASE-21783 Support exceed user/table/ns throttle quota if region server has available quota
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-21 15:36:37 +08:00
Toshihiro Suzuki 72df52283b HBASE-21867 Support multi-threads in HFileArchiver 2019-02-21 10:26:34 +09:00
zhangduo a551149ca7 HBASE-21927 Always fail the locate request when error occur
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 19:47:28 +08:00
Jingyun Tian eedc33dfd2 Revert "HBASE-21505 - proposal for a more consistent report on status"
This reverts commit c578020588.
2019-02-20 18:06:42 +08:00
Guanghao Zhang e218874e9b HBASE-21932 Use Runtime.getRuntime().halt to terminate regionserver when abort timeout 2019-02-20 15:50:14 +08:00
zhangduo e984515b74 HBASE-21928 Deprecated HConstants.META_QOS
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 14:16:40 +08:00
zhangduo e257f4698c HBASE-21930 Deal with ScannerResetException when opening region scanner
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 11:03:56 +08:00
Josh Elser b76b0191b1 HBASE-21915 Make FileLinkInputStream implement CanUnbuffer
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2019-02-19 16:16:56 -05:00
Wellington Chevreuil c578020588 HBASE-21505 - proposal for a more consistent report on status
Signed-off-by: Jingyun Tian <tianjy@apache.org>
2019-02-19 10:51:05 +08:00
Xiang Li 7ecb45a4b0
HBASE-21866 Do not move the table to null rsgroup when creating an existing table 2019-02-18 10:54:22 -08:00
Nihal Jain 593745e8ac HBASE-17942 Disable region splits and merges per table
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-19 07:15:27 +08:00
lujie 7be71c0f55
HBASE-21740 Fix NPE while shutting down RS 2019-02-18 02:48:30 -08:00
Daisuke Kobayashi 40e1d9174e HBASE-21899 Fix missing variables for slf4j Logger
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-02-17 20:14:48 +09:00
zhangduo dedab71381 HBASE-21909 Validate the put instance before executing in AsyncTable.put method
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-16 17:47:38 +08:00
zhangduo 0b2b474b4c HBASE-21908 Remove Scan.getScanMetrics
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-16 17:39:31 +08:00
Josh Elser ae0198084c HBASE-21872 Use a call that defaults to UTF-8 charset for string to byte encoding
Fixed commit message

Signed-off-by: Sean Busbey <busbey@apache.org>
2019-02-15 12:11:40 -05:00
Josh Elser d0e4912f67 Revert "HBASE-21782 Use a call that defaults to UTF-8 charset for string to byte encoding"
This reverts commit 3d4e1d57e5. Fixing incorrect Jira id.
2019-02-15 12:11:29 -05:00
Duo Zhang 81e1e2f943 HBASE-21910 The nonce implementation is wrong for AsyncTable
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-15 20:24:34 +08:00
Guanghao Zhang 4b185664aa HBASE-21814 Remove the TODO in AccessControlLists#addUserPermission 2019-02-15 19:35:50 +08:00
Duo Zhang b73cffb10a HBASE-21875 Change the retry logic in RSProcedureDispatcher to 'retry by default, only if xxx'
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-15 11:05:01 +08:00
Josh Elser 3d4e1d57e5 HBASE-21782 Use a call that defaults to UTF-8 charset for string to byte encoding
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-02-14 12:02:49 -05:00
Duo Zhang b3eb70c32d HBASE-21890 Use execute instead of submit to submit a task in RemoteProcedureDispatcher
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-14 14:15:59 +08:00
Duo Zhang e06beb0d72 HBASE-21888 Add a isClosed method to AsyncConnection
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-14 11:41:16 +08:00
Sergey Shelukhin cd6042e020 HBASE-21849 master serving regions version is not handled correctly
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-13 16:06:48 -08:00
Sean Busbey 4273e42ce5 HBASE-21884 avoid autoboxing in ugi ref counting for secure bulk load
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-02-13 13:51:26 -06:00
zhangduo f1e5999ad2 HBASE-21859 Add clearRegionLocationCache method for AsyncConnection
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-13 10:07:29 +08:00
Sergey Shelukhin 9ef6bc4323 HBASE-21785 master reports open regions as RITs and also messes up rit age metric
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-02-12 12:53:17 -08:00
Sakthi 5049f460b8 HBASE-21780: Avoid a wide line on the RegionServer webUI for many ZooKeeper servers
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-02-12 10:58:53 +01:00
huzheng 1df571cb36 HBASE-18484 VerifyRep by snapshot does not work when Yarn/SourceHBase/PeerHBase located in three different HDFS clusters 2019-02-12 10:42:52 +08:00
Duo Zhang 78d3d5628a HBASE-21868 Remove legacy bulk load support
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-12 10:11:04 +08:00
zhangduo c48438fcb0 HBASE-21857 Addendum fix broken UTs 2019-02-11 10:06:54 +08:00
Sakthi abaeeace00
HBASE-21800: RegionServer aborted due to NPE from MetaTableMetrics coprocessor
Have included code refactoring in MetaTableMetrics & LossyCounting
2019-02-08 10:43:15 -08:00
zhangduo 6f16836c20 HBASE-21857 Do not need to check clusterKey if replicationEndpoint is provided when adding a peer
Signed-off-by: Xu Cang <xucang@apache.org>
2019-02-08 19:47:37 +08:00
kpalanisamy a155d17fa6 HBASE-21816 : Print source cluster replication config directory
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-02-08 14:06:14 +09:00
zhangduo 7849fa32d6 HBASE-21843 RegionGroupingProvider breaks the meta wal file name pattern which may cause data loss for meta region 2019-02-07 08:28:57 +08:00
zhangduo 6b60c42690 HBASE-21838 Create a special ReplicationEndpoint just for verifying the WAL entries are fine 2019-02-06 18:11:03 +08:00
stack af923225d0 HBASE-19616 Review of LogCleaner Class 2019-02-04 22:16:26 -08:00
Nihal Jain 5f8bdd52a1 HBASE-21795 Client application may get stuck (time bound) if a table modify op is called immediately after split op
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-02-04 20:50:09 +08:00
zhangduo d69c3e5d48 HBASE-21840 TestHRegionWithInMemoryFlush fails with NPE 2019-02-04 19:25:59 +08:00
zhangduo 2b1b79f08b HBASE-21829 Use FutureUtils.addListener instead of calling whenComplete directly 2019-02-03 15:24:54 +08:00
zhangduo f26e1bb588 HBASE-21833 Use NettyAsyncFSWALConfigHelper.setEventLoopConfig to prevent creating too many netty event loop when executing TestHRegion 2019-02-03 14:59:55 +08:00
zhangduo 89c02dc0cc HBASE-21828 Make sure we do not return CompletionException when locating region 2019-02-02 21:13:45 +08:00
Sergey Shelukhin 946bc19242 HBASE-21811 region can be opened on two servers due to race condition with procedures and server reports
The original fix is provided by Sergey Shelukhin, the UT is added by Duo Zhang

Amending-Author: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-02-02 17:39:31 +08:00
huzheng 81ebe6d40d HBASE-21764 Size of in-memory compaction thread pool shoud be configurable 2019-02-01 10:01:34 +08:00
Nihal Jain c5f4e84106 HBASE-21644 Modify table procedure runs infinitely for a table having region replication > 1
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-01-31 19:34:22 +08:00
Nihal Jain 1c71544497 HBASE-21404 Master/RS navbar active state does not work
Signed-off-by: Jingyun Tian <tianjy@apache.org>
2019-01-31 16:33:07 +08:00
Sergey Shelukhin c90e9ff5ef HBASE-21806 add an option to roll WAL on very slow syncs
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-01-30 16:43:42 -08:00
meiyi 5ddda1a1f6 HBASE-21733 SnapshotQuotaObserverChore should only fetch space quotas
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 17:51:25 +08:00
wanghuan 16c7f5dac9 HBASE-21699 Fixed create table failed when using SPLITS_FILE => 'splits.txt'
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 15:56:25 +08:00
meiyi f997252344 HBASE-21739 Move grant/revoke from regionserver to master
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 11:16:57 +08:00
Duo Zhang 7dc69b6128 HBASE-21792 Mark HTableMultiplexer as deprecated and remove it in 3.0.0
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-29 09:08:02 +08:00
zhangduo 274e4ccea8 HBASE-21789 Rewrite MetaTableAccessor.multiMutate with Table.coprocessorService
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-27 11:36:58 +08:00
zhangduo 1995f61d7f HBASE-21782 LoadIncrementalHFiles should not be IA.Public
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-27 11:24:55 +08:00
Duo Zhang 4f3b95b318 HBASE-21762 Move some methods in ClusterConnection to Connection
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-01-25 21:13:44 +08:00
meiyi 281558a3ab HBASE-21713 Support set region server throttle quota
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-25 13:50:42 +08:00
Wellington Chevreuil 54093b0d1f HBASE-20215 - Rename CollectionUtils to ConcurrentMapUtils 2019-01-24 20:55:15 -08:00
Jingyun Tian 91dffb043a HBASE-21729 Extract ProcedureCoordinatorRpcs and ProcedureMemberRpcs from CoordinatedStateManager 2019-01-25 11:15:55 +08:00
zhangduo e43c833145 HBASE-21770 Should deal with meta table in HRegionLocator.getAllRegionLocations
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-25 11:00:51 +08:00
zhangduo 416b70f461 HBASE-21761 Align the methods in RegionLocator and AsyncTableRegionLocator
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-24 15:21:11 +08:00
Tommy Li d187af00ca HBASE-21720 : metric to measure how actions are distributed to servers within a MultiAction
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
2019-01-23 17:52:58 -08:00
Nihal Jain 050caf425e
HBASE-21475 Put mutation (having TTL set) added via co-processor is retrieved even after TTL expires
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-23 16:57:28 -08:00
Allan Yang b5619a2a26 HBASE-21754 ReportRegionStateTransitionRequest should be executed in priority executor 2019-01-23 20:55:00 +08:00
Duo Zhang dfad304ddb HBASE-21753 Support getting the locations for all the replicas of a region 2019-01-23 18:09:39 +08:00
Sergey Shelukhin fa3946fbea HBASE-21626 log the regions blocking WAL from being archived ADDENDUM
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-22 15:15:38 -08:00
huzheng 35ed5d6c39 HBASE-21750 Most of KeyValueUtil#length can be replaced by cell#getSerializedSize for better performance because the latter one has been optimized 2019-01-22 19:58:03 +08:00
Nihal Jain f2820ea16f
HBASE-21749 RS UI may throw NPE and make rs-status page inaccessible with multiwal and replication
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-21 17:26:07 -08:00
huzheng 35df6147ee HBASE-21738 Remove all the CLSM#size operation in our memstore because it's an quite time consuming. 2019-01-21 16:52:49 +08:00
zhangduo a2f6768acd HBASE-21746 Fix two concern cases in RegionMover
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-20 08:57:01 +08:00
Duo Zhang 882bd564f4 HBASE-21726 Add getAllRegionLocations method to AsyncTableRegionLocator 2019-01-19 11:14:35 +08:00
zhangduo 44dc872b7b HBASE-19695 Handle disabled table for async client
Signed-off-by: tianjingyun <tianjy1990@gmail.com>
2019-01-17 18:34:12 +08:00
Beluga Behr 3e92cd5771 HBASE-20209 Do Not Use Both Map containsKey and get Methods in Replication Sink
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-01-16 09:39:40 -07:00
Duo Zhang 594341d6fe HBASE-21710 Add quota related methods to the Admin interface
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-16 21:08:47 +08:00
huzheng 15031c5bd5 HBASE-21657 PrivateCellUtil#estimatedSerializedSizeOf has been the bottleneck in 100% scan case 2019-01-16 09:41:02 +08:00
tianjingyun c2c1af4927 HBASE-21647 Add status track for splitting WAL tasks 2019-01-15 16:38:37 -08:00
Pankaj 6da0b4ec34 HBASE-21639 maxHeapUsage value not read properly from config during EntryBuffers initialization 2019-01-15 12:18:28 -08:00
Pankaj bc0fb66e22 HBASE-21595, Print thread's information and stack traces when RS is aborting forcibly 2019-01-15 12:11:48 -08:00
Sakthi 93d4b95b3f HBASE-21225: Having RPC & Space quota on a table/Namespace doesn't allow space quota to be removed using 'NONE'
Signed-off-by: Josh Elser <elserj@apache.org>
2019-01-14 17:55:42 -07:00
Sergey Shelukhin e69ab24552 HBASE-21626 : log the regions blocking WAL from being archived 2019-01-14 14:52:24 -08:00
zhangduo c5691a9f60 HBASE-21705 Should treat meta table specially for some methods in AsyncAdmin 2019-01-13 13:40:52 +08:00
Duo Zhang 3d2580cd6d HBASE-21704 The implementation of DistributedHBaseCluster.getServerHoldingRegion is incorrect 2019-01-11 21:34:16 +08:00
Duo Zhang fbf79373e6 HBASE-21663 Add replica scan support 2019-01-11 14:19:05 +08:00
Duo Zhang 7bebdff6a2 HBASE-21580 Support getting Hbck instance from AsyncConnection 2019-01-11 11:26:44 +08:00
Nihal Jain 5d32e80f9e HBASE-21297 ModifyTableProcedure can throw TNDE instead of IOE in case of REGION_REPLICATION change
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-10 22:01:45 +08:00
Guanghao Zhang 8e39ec2c59 HBASE-21691 Fix flaky test TestRecoveredEdits 2019-01-10 10:06:45 +08:00
meiyi 620d70d618 HBASE-21694 Add append_peer_exclude_tableCFs and remove_peer_exclude_tableCFs shell commands
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-09 22:02:21 +08:00
Guanghao Zhang a5a61163f1 HBASE-21695 Fix flaky test TestRegionServerAbortTimeout 2019-01-09 21:58:19 +08:00
Sergey Shelukhin 37bc1686d6 HBASE-21614 RIT recovery with ServerCrashProcedure doesn't account for all regions
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-01-09 20:03:37 +08:00
Nihal Jain 5c902b48e5 HBASE-21645 Perform sanity check and disallow table creation/modification with region replication < 1
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-09 10:49:19 +08:00
Vladimir Rodionov d26acbe1db HBASE-21688: Address WAL filesystem issues
Signed-off-by: Josh Elser <elserj@apache.org>
2019-01-08 13:56:11 -05:00
zhangduo e9dae2adc3 HBASE-21683 Reset readsEnabled flag after successfully flushing the primary region 2019-01-08 16:06:34 +08:00
zhangduo 4f0514e39a HBASE-21682 Support getting from specific replica 2019-01-08 09:49:12 +08:00
tianjingyun 281d6429e5 HBASE-21588 Procedure v2 wal splitting implementation 2019-01-07 15:58:15 +08:00
meiyi 77db1fae09 HBASE-21159 Add shell command to switch throttle on or off
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-07 14:21:41 +08:00
zhangduo db66e6cc9e HBASE-17356 Add replica get support 2019-01-03 08:38:20 +08:00
Guanghao Zhang ec948f5d90 HBASE-21659 Avoid to load duplicate coprocessors in system config and table descriptor 2019-01-02 10:41:36 +08:00
Guanghao Zhang 3ab895979b HBASE-21660 Apply the cell to right memstore for increment/append operation 2019-01-01 17:32:44 +08:00
Guanghao Zhang f5ea00f724 HBASE-21643 Introduce two new region coprocessor method and deprecated postMutationBeforeWAL 2018-12-27 18:27:06 +08:00
huzheng c2d5991b82 HBASE-21642 CopyTable by reading snapshot and bulkloading will save a lot of time 2018-12-27 18:22:54 +08:00
Guanghao Zhang 4281cb3b95 HBASE-21640 Remove the TODO when increment zero 2018-12-26 21:47:44 +08:00
Andrey Elenskiy dbafa1be83 HBASE-21545 NEW_VERSION_BEHAVIOR breaks Get/Scan with specified columns
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Sakthi
2018-12-23 22:01:11 -08:00
zhangduo 97fd647de2 HBASE-21635 Use maven enforcer to ban imports from illegal packages 2018-12-24 11:12:25 +08:00
Guanghao Zhang 7c0a3cc265 HBASE-21621 Reversed scan does not return expected number of rows
The unit test is contributed by Nihal Jain
2018-12-23 16:19:05 +08:00
Sakthi b2bf22e209 HBASE-21631: list_quotas should print human readable values for LIMIT
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-22 22:00:58 +08:00
openinx e160b5ac8d HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-12-21 15:21:53 -08:00
huzheng 12786f80c1 HBASE-21401 Sanity check when constructing the KeyValue 2018-12-21 18:01:35 +08:00
Guanghao Zhang ad819380c7 HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result 2018-12-21 09:49:24 +08:00
Pankaj 787567336a HBASE-21610, numOpenConnections metric is set to -1 when zero server channel exist 2018-12-20 16:36:42 -08:00
Guanghao Zhang 8991877bb2 HBASE-21514: Refactor CacheConfig(addendum) 2018-12-19 13:55:13 +08:00
Pankaj fb58a23e56 HBASE-21535, Zombie Master detector is not working 2018-12-18 20:51:01 -08:00
Jingyun Tian c448604ceb HBASE-21565 Delete dead server from dead server list too early leads to concurrent Server Crash Procedures(SCP) for a same server 2018-12-18 16:57:11 +08:00
xuqinya f78284685f HBASE-21592 quota.addGetResult(r) throw NPE
Signed-off-by: huzheng <openinx@gmail.com>
2018-12-18 16:15:51 +08:00
Guanghao Zhang 1971d02e72 HBASE-21514 Refactor CacheConfig 2018-12-18 13:43:30 +08:00
stack 68b5df0095 HBASE-21589 TestCleanupMetaWAL fails 2018-12-17 09:31:59 -08:00
huzheng ac0b3bb547 HBASE-21520 TestMultiColumnScanner cost long time when using ROWCOL bloom type 2018-12-15 21:08:52 +08:00
Sean Busbey 491153488e HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. (addendum) 2018-12-14 17:08:22 -06:00
meiyi 1b08ba7385 HBASE-21578 Fix wrong throttling exception for capacity unit
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-14 18:17:47 +08:00
Sergey Shelukhin 3ff274e22e HBASE-21575 : memstore above high watermark message is logged too much 2018-12-13 12:47:11 -08:00
Sergey Shelukhin 9a25d0c249 Revert "HIVE-21575 : memstore above high watermark message is logged too much"
This reverts commit 4640ff5959.
2018-12-13 12:46:39 -08:00
Lars Hofhansl cb1966dc2d HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. 2018-12-13 11:57:16 -08:00
huzheng f32d261843 HBASE-21582 If call HBaseAdmin#snapshotAsync but forget call isSnapshotFinished, then SnapshotHFileCleaner will skip to run every time 2018-12-13 10:35:20 +08:00
Sergey Shelukhin 4640ff5959 HIVE-21575 : memstore above high watermark message is logged too much 2018-12-12 11:02:25 -08:00
Josh Elser 67d6d5084c HBASE-21568 Use CacheConfig.DISABLED where we don't expect to have blockcache running
This includes removing the "old way" of disabling blockcache in favor of the
new API.

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-11 10:02:18 -05:00
zhangduo b09b87d143 HBASE-21570 Add write buffer periodic flush support for AsyncBufferedMutator 2018-12-11 14:51:26 +08:00
Guanghao Zhang 79d90c87b5 HBASE-21560 Return a new TableDescriptor for MasterObserver#preModifyTable to allow coprocessor modify the TableDescriptor 2018-12-08 09:28:14 +08:00
Guanghao Zhang 8d7061a487 HBASE-21554 Show replication endpoint classname for replication peer on master web UI 2018-12-07 13:31:59 +08:00
Allan Yang e0e0694fa1 HBASE-21413 Empty meta log doesn't get split when restart whole cluster
Signed-off-by: stack <stack@apache.org>
2018-12-06 21:21:41 -08:00
huzheng dfb9ae8e0e HBASE-21559 The RestoreSnapshotFromClientTestBase related UT are flaky
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-12-07 08:22:22 +08:00
Tommy Li 170df27b88 HBASE-21414 : StoreFileSize growth rate metric
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
2018-12-06 14:43:17 -08:00
huzheng 67ab8b888f HBASE-21551 Memory leak when use scan with STREAM at server side - (addendum) 2018-12-06 11:26:52 +08:00
huzheng 3b854859f6 HBASE-21551 Memory leak when use scan with STREAM at server side 2018-12-06 10:55:42 +08:00
Duo Zhang f49baf259e HBASE-21550 Add a new method preCreateTableRegionInfos for MasterObserver which allows CPs to modify the TableDescriptor 2018-12-06 08:30:32 +08:00
zhangduo 8bf966c8e9 HBASE-21541 Move MetaTableLocator.verifyRegionLocation to hbase-rsgroup module 2018-12-04 22:33:36 +08:00
zhangduo dec49135a3 HBASE-21534 Addendum output uncaught exception, fix the way that we add new region servers to avoid recreate a dead server 2018-12-03 08:19:21 +08:00
Duo Zhang d525ec6a12 HBASE-21534 TestAssignmentManager is flakey 2018-12-01 20:41:11 +08:00
Peter Somogyi 5c209f2cec HBASE-21479 Individual tests in TestHRegionReplayEvents class are failing
Signed-off-by: Michael Stack <stack@apache.org>
2018-12-01 09:36:10 +01:00
Duo Zhang 766aa1bfcc HBASE-21486 The current replication implementation for peer in STANDBY state breaks serial replication 2018-12-01 12:15:18 +08:00
Peter Somogyi dfeab9f5c9 HBASE-21518 TestMasterFailoverWithProcedures is flaky
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-11-30 09:12:06 +01:00
huzheng d42e0ade1c HBASE-21504 If enable FIFOCompactionPolicy, a compaction may write a "empty" hfile whose maxTimeStamp is long max. This kind of hfile will never be archived. 2018-11-30 09:53:06 +08:00
Artem Ervits 3ad2a89fdf HBASE-18735 Provide an option to kill a MiniHBaseCluster without waiting on shutdown
Signed-off-by: Josh Elser <elserj@apache.org>
2018-11-29 16:37:50 -05:00
meiyi f1f2b5a038 HBASE-21300 Fix the wrong reference file path when restoring snapshots for tables with MOB columns
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-29 11:23:45 +08:00
Duo Zhang d6e1d18be9 HBASE-21517 Move the getTableRegionForRow method from HMaster to TestMaster 2018-11-28 09:40:27 +08:00
BELUGA BEHR 7877e09b60 HBASE-21492 CellCodec Written To WAL Before It's Verified 2018-11-27 08:57:06 -08:00
lixiaobao 6f15cecaed HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
2018-11-27 20:56:23 +08:00
zhangduo 39bc458eab Revert "HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method"
Email address is broken.

This reverts commit 3133d43859.
2018-11-27 20:55:04 +08:00
lixiaobao 3133d43859 HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
2018-11-27 20:31:07 +08:00
Guanghao Zhang 34e1d744f7 HBASE-21498 Master OOM when SplitTableRegionProcedure new CacheConfig and instantiate a new BlockCache 2018-11-27 14:20:15 +08:00
zhangduo 1acbd36c90 HBASE-21154 Remove hbase:namespace table; fold it into hbase:meta 2018-11-26 14:51:56 +08:00
Duo Zhang a0e3cb6c0c HBASE-21508 Ignore the reportRegionStateTransition call from a dead server
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-26 14:32:14 +08:00
Ted Yu 27c0bf5c63 HBASE-21511 Remove in progress snapshot check in SnapshotFileCache#getUnreferencedFiles 2018-11-25 18:20:00 -08:00
zhangduo 701526d19f HBASE-21510 Test TestRegisterPeerWorkerWhenRestarting is flakey 2018-11-24 19:50:59 +08:00
Ted Yu d9c773b0a5 HBASE-21387 Addendum fix TestSnapshotFileCache
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-11-24 17:00:08 +08:00
huzheng 6d0dc960e6 HBASE-21387 Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files 2018-11-23 11:31:37 +08:00
Duo Zhang 5cc845b713 HBASE-21503 Replication normal source can get stuck due potential race conditions between source wal reader and wal provider initialization threads.
Found and analysed by Wellington Chevreuil
2018-11-21 17:14:54 +08:00
meiyi 5ded294419 HBASE-21034 Add new throttle type: read/write capacity unit
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-21 09:46:49 +08:00
Duo Zhang 405bf5e638 HBASE-21490 WALProcedure may remove proc wal files still with active procedures
Signed-off-by: Allan Yang <allan163@apache.org>
2018-11-19 08:21:28 -08:00
zhangduo b329e6e3f2 HBASE-21494 NPE when loading RecoverStandByProcedure 2018-11-19 09:35:18 +08:00
zhangduo f555258e7a HBASE-21480 Taking snapshot when RS crashes prevent we bring the regions online 2018-11-18 21:07:22 +08:00
zhangduo 43a10df70f HBASE-21485 Add more debug logs for remote procedure execution 2018-11-16 14:30:59 +08:00
Reid Chan 130057f137 HBASE-21255 [acl] Refactor TablePermission into three classes (Global, Namespace, Table)
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-15 11:34:16 +08:00
zhangduo 9e42a9e310 HBASE-21472 Should not persist the dispatched field for RegionRemoteProcedureBase 2018-11-15 09:41:38 +08:00
huzheng a8b642067d HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags 2018-11-14 23:00:12 +08:00
zhangduo 640a5e390b HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors 2018-11-14 18:48:33 +08:00
zhangduo 64c4861272 Revert "HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors"
This reverts commit ffb003ee44.
2018-11-13 22:24:59 +08:00
zhangduo 3eb27a099a Revert "HBASE-21465 Addendum change TestReportRegionStateTransitionRetry to MediumTests"
This reverts commit 114377d426.
2018-11-13 22:24:50 +08:00
Duo Zhang 114377d426 HBASE-21465 Addendum change TestReportRegionStateTransitionRetry to MediumTests 2018-11-13 14:59:20 +08:00
Duo Zhang ffb003ee44 HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors 2018-11-13 11:49:22 +08:00
Duo Zhang 55fa8f4b33 HBASE-21463 The checkOnlineRegionsReport can accidentally complete a TRSP 2018-11-13 11:31:03 +08:00
tedyu f770081129 HBASE-21466 WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir 2018-11-12 17:02:17 -08:00
huzheng 362b5dd259 Revert "HBASE-21401 Sanity check in BaseDecoder#parseCell"
This reverts commit f17382792f.
2018-11-12 11:37:46 +08:00
Duo Zhang 6786aca666 HBASE-21376 Add some verbose log to MasterProcedureScheduler 2018-11-10 17:17:12 +08:00
Duo Zhang fe2265fa4a HBASE-21451 The way we maintain the lastestPaths in ReplicationSourceManager is broken when sync replication is used 2018-11-09 14:53:33 +08:00
jingyuntian fa6373660f HBASE-21410 A helper page that help find all problematic regions and procedures
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-09 14:01:49 +08:00
Guanghao Zhang 13b4351012 Revert "HBASE-21410 A helper page that help find all problematic regions and procedures"
This reverts commit 3c34073988.

missing sign-off.
2018-11-09 14:01:29 +08:00
jingyuntian 3c34073988 HBASE-21410 A helper page that help find all problematic regions and procedures 2018-11-09 13:53:00 +08:00
Ben Lau d9f32137b6 HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-11-08 11:59:34 -08:00
Esteban Gutierrez a8ad61ec88
HBASE-20604 ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-08 10:22:22 -08:00
huzheng f17382792f HBASE-21401 Sanity check in BaseDecoder#parseCell 2018-11-08 20:07:04 +08:00
jingyuntian cf9b515563 HBASE-21419 Show sync replication related field for replication peer on master web UI
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-11-08 14:50:37 +08:00
zhangduo 6d46b8d256 HBASE-21441 NPE if RS restarts between REFRESH_PEER_SYNC_REPLICATION_STATE_ON_RS_BEGIN and TRANSIT_PEER_NEW_SYNC_REPLICATION_STATE 2018-11-07 16:10:42 +08:00
Allan Yang a31458bdee HBASE-21421 Do not kill RS if reportOnlineRegions fails 2018-11-06 14:58:35 +08:00
tedyu 7395ffac44 HBASE-21247 Custom WAL Provider cannot be specified by configuration whose value is outside the enums in Providers 2018-11-05 08:29:04 -08:00
Duo Zhang c8574ba3c5 HBASE-21420 Use procedure event to wake up the SyncReplicationReplayWALProcedures which wait for worker 2018-11-05 21:43:18 +08:00
Michael Stack d08990c962 HBASE-21425 2.1.1 fails to start over 1.x data; namespace not assigned 2018-11-03 09:46:19 -07:00
zhangduo 62fe365934 HBASE-21351 The force update thread may have race with PE worker when the procedure is rolling back 2018-11-03 08:24:11 +08:00
jingyuntian 25c964e9a3
HBASE-21407 Resolve NPE in backup Master UI
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-02 11:47:02 -07:00
zhangduo e7f6c2972d HBASE-21422 NPE in TestMergeTableRegionsProcedure.testMergeWithoutPONR 2018-11-02 20:54:00 +08:00
Beluga Behr 21b98e1075 HBASE-19682 Use Collections.emptyList() For Empty List Values 2018-11-01 08:51:11 -07:00
Guanghao Zhang 6bdaedd7ce HBASE-21388 No need to instantiate MemStoreLAB for master which not carry table 2018-11-01 16:15:18 +08:00
zhangduo 02f5f171f5 HBASE-21389 Revisit the procedure lock for sync replication 2018-10-30 18:11:20 +08:00
tianjingyun 116eee6747
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-29 20:55:37 -07:00
zhangduo d5e4faacc3 HBASE-21375 Revisit the lock and queue implementation in MasterProcedureScheduler 2018-10-29 19:56:49 +08:00
Guanghao Zhang c0b994b0c6 HBASE-21325 Force to terminate regionserver when abort hang in somewhere 2018-10-29 10:08:51 +08:00
Artem Ervits 7cdb525192 HBASE-21175 Partially initialized SnapshotHFileCleaner leads to NPE during TestHFileArchiving
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-10-26 16:44:33 -07:00
Duo Zhang 0ab7c3a189 HBASE-21391 RefreshPeerProcedure should also wait master initialized before executing 2018-10-26 21:44:56 +08:00
Guanghao Zhang 23b7510ae2 HBASE-21365 Throw exception when user put data with skip wal to a table which may be replicated 2018-10-26 17:43:38 +08:00
Guanghao Zhang cd943419b6 HBASE-21385 HTable.delete request use rpc call directly instead of AsyncProcess
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-25 16:22:36 -07:00
Michael Stack 6830a1c1a0 HBASE-21372) Set hbase.assignment.maximum.attempts to Long.MAX
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-10-24 09:07:40 -07:00
Duo Zhang 3fe8649b2c HBASE-21377 Add debug log for catching the root cause 2018-10-24 15:43:12 +08:00
xcang 1f437ac221
HBASE-21349 Do not run CatalogJanitor or Nomalizer when cluster is shutting down
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-23 14:45:05 -07:00
mazhenlin 1e9d998727
HBASE-21342 FileSystem in use may get closed by other bulk load call in secure bulkLoad
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
2018-10-23 15:51:46 -05:00
xcang 807736fcf1
HBASE-21338 Warn if balancer is an ill-fit for cluster size
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-23 13:23:24 -07:00
huzheng ae13b0b293 HBASE-21356 bulkLoadHFile API should ensure that rs has the source hfile's write permissionls 2018-10-23 10:18:40 +08:00
zhangduo 931156f66b HBASE-21336 Addendum remove unused code in HBTU 2018-10-22 20:26:48 +08:00
huzheng d0e7367c8d HBASE-21355 (addendum) replace the expensive reload storefiles with reading the merge result of compacted storefiles and current storefiles 2018-10-22 19:28:53 +08:00
zhangduo 3b66b65b9f HBASE-21336 Simplify the implementation of WALProcedureMap 2018-10-22 18:36:11 +08:00
huzheng 77ac352a95 HBASE-21355 HStore's storeSize is calculated repeatedly which causing the confusing region split 2018-10-22 09:43:14 +08:00
Duo Zhang 7d7293049a Revert "HBASE-21336 Simplify the implementation of WALProcedureMap"
This reverts commit 7adf590106.
2018-10-22 09:32:55 +08:00
zhangduo dd474ef199 HBASE-21334 TestMergeTableRegionsProcedure is flakey 2018-10-21 22:40:19 +08:00
Artem Ervits b723ce1051 HBASE-21194 Add tests in TestCopyTable which exercises MOB feature
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-10-20 08:10:27 -07:00
zhangduo 7adf590106 HBASE-21336 Simplify the implementation of WALProcedureMap 2018-10-20 21:59:46 +08:00
Toshihiro Suzuki 4bf3c5a702 HBASE-21200 Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner. 2018-10-20 08:34:23 +09:00
Mike Drob bc7628a8c3
HBASE-21073 Redo concept of maintenance mode
Instead of being an ephemeral state set by hbck, maintenance mode is now
an explicit toggle set by either configuration property or environment
variable. In maintenance mode, master will host system tables and not
assign any user-space tables to RSs. This gives operators the ability to
affect repairs to meta table with fewer moving parts.
2018-10-18 16:27:53 -05:00
jingyuntian 5fbb227deb
HBASE-21269 Forward-port HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign 2018-10-18 06:22:52 -07:00
haxiaolin 92fdc8dd51 HBASE-21055 NullPointerException when balanceOverall() but server balance info is null
Signed-off-by: huzheng <openinx@gmail.com>
2018-10-18 14:04:28 +08:00
Duo Zhang 5efa5f6de4 HBASE-21330 ReopenTableRegionsProcedure will enter an infinite loop if we schedule a TRSP at the same time 2018-10-18 11:29:12 +08:00
tedyu 1e339e6629 HBASE-21281 Update bouncycastle dependency - addendum adds dependency for hbase-server module 2018-10-17 15:59:41 -07:00
Michael Stack fd940f3b78
HBASE-21327 Fix minor logging issue where we don't report servername if no associated SCP
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-10-17 09:42:45 -07:00
Michael Stack 8cc56bd18c
HBASE-21320 [canary] Cleanup of usage and add commentary
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
2018-10-16 22:20:00 -07:00
subrat.mishra 3b91ae5b2a
HBASE-21263 Mention compression algorithm along with other storefile details
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-10-16 12:38:11 -07:00
zhangduo 0d9982901a HBASE-21278 Do not rollback successful sub procedures when rolling back a procedure 2018-10-16 15:12:49 +08:00
Andrew Purtell c9dcc9a065
HBASE-21266 Not running balancer because processing dead regionservers, but empty dead rs list 2018-10-15 22:28:36 -07:00
zhangduo fc7a6a64c2 HBASE-21311 Split TestRestoreSnapshotFromClient 2018-10-16 08:29:35 +08:00
Guanghao Zhang 4a043126b1 HBASE-21290 No need to instantiate BlockCache for master which not carry table 2018-10-15 17:21:17 +08:00
haxiaolin 7d798b3c73 HBASE-21260 The whole balancer plans might be aborted if there are more than one plans to move a same region
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-10-15 15:54:13 +08:00
zhangduo 6781918ca8 HBASE-21310 Split TestCloneSnapshotFromClient 2018-10-15 14:00:40 +08:00
zhangduo dde336f6ef HBASE-21309 Increase the waiting timeout for TestProcedurePriority 2018-10-14 08:46:18 +08:00
Michael Stack a292ab7c87 HBASE-21299 List counts of actual region states in master UI tables section 2018-10-12 11:02:36 -07:00
Guanghao Zhang fa5fa6ecdd HBASE-21289 Remove the log "'hbase.regionserver.maxlogs' was deprecated." in AbstractFSWAL 2018-10-12 20:27:10 +08:00
Duo Zhang 9e9a1e0f0d HBASE-21254 Need to find a way to limit the number of proc wal files 2018-10-12 11:05:13 +08:00
tedyu 924d183ba0 HBASE-21247 Allow WAL Provider to be specified by configuration without explicit enum in Providers - revert 2018-10-11 09:00:24 -07:00
Josh Elser 8b66dea2ff HBASE-21281 Upgrade bouncycastle to latest
BC 1.47 introduced some incompatible API changes which came in via
a new Maven artifact. We don't use any changed API in HBase. This
also removes some unnecessary dependencies on bcprov in other
modules (presumably, they are vestiges)

Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
2018-10-11 11:02:32 -04:00
Mike Drob db9a5b7da7 HBASE-21287 Allow configuring test master initialization wait time. 2018-10-11 09:43:04 -05:00
tedyu 0789f54454 HBASE-21247 Allow WAL Provider to be specified by configuration without explicit enum in Providers 2018-10-10 08:27:16 -07:00
Guanghao Zhang a1f28f3ca7 HBASE-21277 Prevent to add same table to two sync replication peer's config 2018-10-10 15:43:16 +08:00
Guanghao Zhang f122328758 HBASE-21251 Refactor RegionMover 2018-10-10 15:10:57 +08:00
Michael Stack 7c755bf06e HBASE-21280 Add anchors for each heading in UI
Signed-off-by: Ted Yu <tedyu@apache.org>
2018-10-09 22:50:19 -07:00
Duo Zhang e8df847d4e HBASE-21250 Addendum remove unused modification in hbase-server module 2018-10-08 14:55:55 +08:00
zhangduo 118b074684 HBASE-21250 Refactor WALProcedureStore and add more comments for better understanding the implementation 2018-10-07 17:09:09 +08:00
Wellington Chevreuil 4508f670b1 HBASE-21185 - WALPrettyPrinter: Additional useful info to be printed by wal printer tool, for debugability purposes
Signed-off-by: Allan Yang <allan163@apache.org>
2018-10-04 03:32:18 -07:00
tedyu b9bb14e0fd HBASE-21221 Ineffective assertion in TestFromClientSide3#testMultiRowMutations - addendum tightens condition for finding exception 2018-10-03 08:22:57 -07:00
Xu Cang 42aa3dd463
HBASE-18549 Add metrics for failed replication queue recovery
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 18:38:55 -07:00
Xu Cang 1b7e4fdcfc
HBASE-19275 TestSnapshotFileCache never worked properly
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 17:12:00 -07:00
Guanghao Zhang f9d51b67e4 HBASE-21245 Add exponential backoff when retrying for sync replication related procedures 2018-09-30 20:05:34 +08:00