Commit Graph

7419 Commits

Author SHA1 Message Date
stack 089a639724 HBASE-22052 pom cleaning; filter out jersey-core in hadoop2 to match hadoop3 and remove redunant version specifications
This is a reapply of a reverted commit. This commit includes
HBASE-22059 amendment and subsequent ammendments to HBASE-22052.
See HBASE-22052 for full story.

jersey-core is problematic. It was transitively included from hadoop
and polluting our CLASSPATH with an implementation of a 1.x version
of the javax.ws.rs.core.Response Interface from jsr311-api when we
want the javax.ws.rs-api 2.x version.

    M hbase-endpoint/pom.xml
    M hbase-http/pom.xml
    M hbase-mapreduce/pom.xml
    M hbase-rest/pom.xml
    M hbase-server/pom.xml
    M hbase-zookeeper/pom.xml
     Remove redundant version specification (and the odd property define
     done already up in parent pom).
    M hbase-it/pom.xml
    M hbase-rest/pom.xml
     Exclude jersey-core explicitly.

    M hbase-procedure/pom.xml
     Remove redundant version and classifier.

    M pom.xml
     Add jersey-core exclusions to all dependencies that pull it in
     except hadoop-minicluster. mr tests fail w/o the jersey-core
     so let it in for minicluster and then in modules, exclude it
     where it causes damage as in hbase-it.
2019-03-25 09:30:09 -04:00
Toshihiro Suzuki 44f8abd5c6 HBASE-22093 Combine TestRestoreSnapshotFromClientWithRegionReplicas to CloneSnapshotFromClientAfterSplittingRegionTestBase#testCloneSnapshotAfterSplittingRegion
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-03-24 15:07:54 +09:00
zhangduo 386703811d Revert "HBASE-21965 Fix failed split and merge transactions that have failed to roll back"
This reverts commit 7e3ca7063c.
2019-03-24 13:51:34 +08:00
Kevin Risden c144c814b0 HBASE-21895 - Error prone upgrade
* Upgrades to error prone 2.3.3
* Moves to error prone plugin to support 9+ JDKs
* Removes custom error prone plugin due to no usage

Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-24 13:13:07 +08:00
Toshihiro Suzuki 94c18f0653 HBASE-22095 Taking a snapshot fails in local mode
Signed-off-by: Zach York <zyork@apache.org>
2019-03-24 13:47:50 +09:00
pingsutw 21cb00eef6 HBASE-22064 Remove Admin.deleteSnapshot(byte[])
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-23 21:27:12 +08:00
Jingyun Tian 7e3ca7063c HBASE-21965 Fix failed split and merge transactions that have failed to roll back 2019-03-22 17:11:50 +08:00
Sakthi 36f0929efc
HBASE-21991: Fix MetaMetrics issues - [Race condition, Faulty remove logic], few improvements
Signed-off-by: Xu Cang <xucang@apache.org>
2019-03-21 13:55:08 -07:00
niuyulin cbd9c9b2e1 HBASE-22065 Add listTableDescriptors(List<TableName>) method in AsyncAdmin
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-21 22:35:45 +08:00
Jingyun Tian c52dd9efa0 HBASE-22061 SplitTableRegionProcedure should hold the lock of its daughter regions 2019-03-20 14:12:09 +08:00
meiyi 86dd92cccb HBASE-22015 UserPermission should be annotated as InterfaceAudience.Public
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-19 14:41:22 +08:00
zhangduo cc55835d03 HBASE-22040 Add mergeRegionsAsync with a List of region names method in AsyncAdmin
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-18 20:45:21 +08:00
Andrew Purtell 6cd78e899f
HBASE-21926 Profiler servlet 2019-03-17 18:48:12 -07:00
Nihal Jain 01e5af5a34 HBASE-20662 Increasing space quota on a violated table does not remove SpaceViolationPolicy.DISABLE enforcement
Signed-off-by: Josh Elser <elserj@apache.org>
2019-03-15 12:16:58 -04:00
Duo Zhang 3c5761e365 HBASE-22002 Remove the deprecated methods in Admin interface
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-14 21:42:23 +08:00
meiyi 908dea8e41 HBASE-21977 Skip replay WAL and update seqid when open regions restored from snapshot
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-03-12 21:24:43 +08:00
zhangduo 10ca598004 HBASE-22001 Polish the Admin interface
Signed-off-by: stack <stack@apache.org>
2019-03-11 14:38:31 +08:00
zhangduo 3ff2847457 HBASE-21736 Remove the server from online servers before scheduling SCP for it in hbck
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-03-09 08:55:17 +08:00
zhangduo 6e3987cf02 HBASE-22007 Add restoreSnapshot and cloneSnapshot with acl methods in AsyncAdmin
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-03-08 18:03:00 +08:00
Jack Bearden 65149bd8fc HBASE-20918 Re-enable TestRpcHandlerException
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-03-07 10:04:25 -06:00
stack c9e358908f HBASE-22006 Fix branch-2.1 findbugs warning; causes nightly show as failed.
(cherry picked from commit 18d02ffd5d)
2019-03-07 08:50:53 -06:00
ramkrishna fd6bc5d900 HBASE-21874 Bucket cache on Persistent memory
Signed-off-by: Anoop John <anoop.hbase@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 763202d48e)
2019-03-07 08:50:08 -06:00
Sean Busbey d9793c311c Revert "HBASE-21874 Bucket cache on Persistent memory"
This reverts commit 763202d48e.

bad signed-off-by line
2019-03-07 08:49:41 -06:00
Sean Busbey 415ff2a19d Revert "SE-22006 Fix branch-2.1 findbugs warning; causes nightly show as failed."
This reverts commit 18d02ffd5d.

bad commit message
2019-03-07 08:49:07 -06:00
stack 18d02ffd5d SE-22006 Fix branch-2.1 findbugs warning; causes nightly show as failed. 2019-03-06 16:01:58 -08:00
ramkrishna 763202d48e HBASE-21874 Bucket cache on Persistent memory
Signed-off-by: Anoop John <anoop.hbase@gmail.com>, Sean Busbey
<busbey@apache.org>
2019-03-06 22:37:54 +05:30
subrat.mishra 177d43d8db HBASE-21871 Added support to specify a peer table name in VerifyReplication tool
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-03-06 23:27:44 +09:00
maoling 70558174f0 HBASE-21949 Fix flaky test TestHBaseTestingUtility.testMiniZooKeeperWithMultipleClientPorts
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-06 18:00:57 +08:00
zhangduo 7142cea121 HBASE-21980 Fix typo in AbstractTestAsyncTableRegionReplicasRead 2019-03-03 08:29:37 +08:00
meiyi 841a45afb7 HBASE-21974 Change Admin#grant/revoke parameter from UserPermission to user and Permission
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-02 23:41:48 +08:00
Syeda 030b4d12fb HBASE-21487 Concurrent modify table ops can lead to unexpected results
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-02 13:00:19 +08:00
Duo Zhang cbdbe6572b HBASE-21976 Deal with RetryImmediatelyException for batching request
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-02 12:14:16 +08:00
Reid Chan f748e489c5 HBASE-21481 [acl] Superuser's permissions should not be granted or revoked by any non-su global admin
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-01 23:37:28 +08:00
Duo Zhang 929a8aa5e8 HBASE-21082 Reimplement assign/unassign related procedure metrics
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-03-01 21:08:13 +08:00
Xu cang fd152c265e
HBASE-21952 Fix unit test: TestClientOperationInterrupt#testInterrupt50Percent 2019-02-28 22:20:18 -08:00
Jingyun Tian c19bc5911b HBASE-21934 RemoteProcedureDispatcher should track the ongoing dispatched calls 2019-03-01 11:00:07 +08:00
Guanghao Zhang c4f5d3c508 HBASE-21967 Split TestServerCrashProcedure and TestServerCrashProcedureWithReplicas 2019-02-28 17:46:02 +08:00
meiyi 9370347efe HBASE-21820 Implement CLUSTER quota scope
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-27 18:23:45 +08:00
Duo Zhang b1c42f1009 HBASE-21961 Infinite loop in AsyncNonMetaRegionLocator if there is only one region and we tried to locate before a non empty row
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-27 17:54:50 +08:00
Guanghao Zhang 6e06a0d790 HBASE-20724 Sometimes some compacted storefiles are still opened after region failover 2019-02-27 15:45:42 +08:00
Duo Zhang c33ceb23d3 HBASE-21943 The usage of RegionLocations.mergeRegionLocations is wrong for async client
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-26 11:21:55 +08:00
xuqinya 99362e894c HBASE-21942 [UI] requests per second is incorrect in rsgroup page(rsgroup.jsp)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-02-25 16:23:14 +01:00
zhangduo aa7d3ce39f HBASE-21944 Validate put for batch operation
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-24 20:19:51 +08:00
zhangduo a47c1ddcd2 HBASE-21945 Maintain the original order when sending batch request
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-24 17:55:49 +08:00
Guanghao Zhang 0fc5173eef HBASE-21922 BloomContext#sanityCheck may failed when use ROWPREFIX_DELIMITED bloom filter 2019-02-23 23:25:01 +08:00
Duo Zhang 07d84eb809 HBASE-21929 The checks at the end of TestRpcClientLeaks are not executed
Signed-off-by: Xu Cang <xucang@apache.org>
2019-02-23 20:56:54 +08:00
Duo Zhang f0032c9255 HBASE-20587 Replace Jackson with shaded thirdparty gson
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-22 16:24:51 +08:00
Wellington Chevreuil 482b505796 HBASE-21505 - proposal for a more consistent report on status
Signed-off-by: Jingyun Tian <tianjy@apache.org>
2019-02-22 12:08:38 +08:00
meiyi dfb95cfd83 HBASE-21938 Add a new ClusterMetrics.Option SERVERS_NAME to only return the live region servers's name without metrics
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-22 10:41:51 +08:00
meiyi 9a55cbb2c1 HBASE-21783 Support exceed user/table/ns throttle quota if region server has available quota
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-21 15:36:37 +08:00
Toshihiro Suzuki 72df52283b HBASE-21867 Support multi-threads in HFileArchiver 2019-02-21 10:26:34 +09:00
zhangduo a551149ca7 HBASE-21927 Always fail the locate request when error occur
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 19:47:28 +08:00
Jingyun Tian eedc33dfd2 Revert "HBASE-21505 - proposal for a more consistent report on status"
This reverts commit c578020588.
2019-02-20 18:06:42 +08:00
Guanghao Zhang e218874e9b HBASE-21932 Use Runtime.getRuntime().halt to terminate regionserver when abort timeout 2019-02-20 15:50:14 +08:00
zhangduo e984515b74 HBASE-21928 Deprecated HConstants.META_QOS
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 14:16:40 +08:00
zhangduo e257f4698c HBASE-21930 Deal with ScannerResetException when opening region scanner
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-02-20 11:03:56 +08:00
Josh Elser b76b0191b1 HBASE-21915 Make FileLinkInputStream implement CanUnbuffer
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2019-02-19 16:16:56 -05:00
Wellington Chevreuil c578020588 HBASE-21505 - proposal for a more consistent report on status
Signed-off-by: Jingyun Tian <tianjy@apache.org>
2019-02-19 10:51:05 +08:00
Xiang Li 7ecb45a4b0
HBASE-21866 Do not move the table to null rsgroup when creating an existing table 2019-02-18 10:54:22 -08:00
Nihal Jain 593745e8ac HBASE-17942 Disable region splits and merges per table
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-19 07:15:27 +08:00
lujie 7be71c0f55
HBASE-21740 Fix NPE while shutting down RS 2019-02-18 02:48:30 -08:00
Daisuke Kobayashi 40e1d9174e HBASE-21899 Fix missing variables for slf4j Logger
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-02-17 20:14:48 +09:00
zhangduo dedab71381 HBASE-21909 Validate the put instance before executing in AsyncTable.put method
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-16 17:47:38 +08:00
zhangduo 0b2b474b4c HBASE-21908 Remove Scan.getScanMetrics
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-16 17:39:31 +08:00
Josh Elser ae0198084c HBASE-21872 Use a call that defaults to UTF-8 charset for string to byte encoding
Fixed commit message

Signed-off-by: Sean Busbey <busbey@apache.org>
2019-02-15 12:11:40 -05:00
Josh Elser d0e4912f67 Revert "HBASE-21782 Use a call that defaults to UTF-8 charset for string to byte encoding"
This reverts commit 3d4e1d57e5. Fixing incorrect Jira id.
2019-02-15 12:11:29 -05:00
Duo Zhang 81e1e2f943 HBASE-21910 The nonce implementation is wrong for AsyncTable
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-15 20:24:34 +08:00
Guanghao Zhang 4b185664aa HBASE-21814 Remove the TODO in AccessControlLists#addUserPermission 2019-02-15 19:35:50 +08:00
Duo Zhang b73cffb10a HBASE-21875 Change the retry logic in RSProcedureDispatcher to 'retry by default, only if xxx'
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-15 11:05:01 +08:00
Josh Elser 3d4e1d57e5 HBASE-21782 Use a call that defaults to UTF-8 charset for string to byte encoding
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-02-14 12:02:49 -05:00
Duo Zhang b3eb70c32d HBASE-21890 Use execute instead of submit to submit a task in RemoteProcedureDispatcher
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-14 14:15:59 +08:00
Duo Zhang e06beb0d72 HBASE-21888 Add a isClosed method to AsyncConnection
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-14 11:41:16 +08:00
Sergey Shelukhin cd6042e020 HBASE-21849 master serving regions version is not handled correctly
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-13 16:06:48 -08:00
Sean Busbey 4273e42ce5 HBASE-21884 avoid autoboxing in ugi ref counting for secure bulk load
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-02-13 13:51:26 -06:00
zhangduo f1e5999ad2 HBASE-21859 Add clearRegionLocationCache method for AsyncConnection
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-02-13 10:07:29 +08:00
Sergey Shelukhin 9ef6bc4323 HBASE-21785 master reports open regions as RITs and also messes up rit age metric
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-02-12 12:53:17 -08:00
Sakthi 5049f460b8 HBASE-21780: Avoid a wide line on the RegionServer webUI for many ZooKeeper servers
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-02-12 10:58:53 +01:00
huzheng 1df571cb36 HBASE-18484 VerifyRep by snapshot does not work when Yarn/SourceHBase/PeerHBase located in three different HDFS clusters 2019-02-12 10:42:52 +08:00
Duo Zhang 78d3d5628a HBASE-21868 Remove legacy bulk load support
Signed-off-by: Michael Stack <stack@apache.org>
2019-02-12 10:11:04 +08:00
zhangduo c48438fcb0 HBASE-21857 Addendum fix broken UTs 2019-02-11 10:06:54 +08:00
Sakthi abaeeace00
HBASE-21800: RegionServer aborted due to NPE from MetaTableMetrics coprocessor
Have included code refactoring in MetaTableMetrics & LossyCounting
2019-02-08 10:43:15 -08:00
zhangduo 6f16836c20 HBASE-21857 Do not need to check clusterKey if replicationEndpoint is provided when adding a peer
Signed-off-by: Xu Cang <xucang@apache.org>
2019-02-08 19:47:37 +08:00
kpalanisamy a155d17fa6 HBASE-21816 : Print source cluster replication config directory
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-02-08 14:06:14 +09:00
zhangduo 7849fa32d6 HBASE-21843 RegionGroupingProvider breaks the meta wal file name pattern which may cause data loss for meta region 2019-02-07 08:28:57 +08:00
zhangduo 6b60c42690 HBASE-21838 Create a special ReplicationEndpoint just for verifying the WAL entries are fine 2019-02-06 18:11:03 +08:00
stack af923225d0 HBASE-19616 Review of LogCleaner Class 2019-02-04 22:16:26 -08:00
Nihal Jain 5f8bdd52a1 HBASE-21795 Client application may get stuck (time bound) if a table modify op is called immediately after split op
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-02-04 20:50:09 +08:00
zhangduo d69c3e5d48 HBASE-21840 TestHRegionWithInMemoryFlush fails with NPE 2019-02-04 19:25:59 +08:00
zhangduo 2b1b79f08b HBASE-21829 Use FutureUtils.addListener instead of calling whenComplete directly 2019-02-03 15:24:54 +08:00
zhangduo f26e1bb588 HBASE-21833 Use NettyAsyncFSWALConfigHelper.setEventLoopConfig to prevent creating too many netty event loop when executing TestHRegion 2019-02-03 14:59:55 +08:00
zhangduo 89c02dc0cc HBASE-21828 Make sure we do not return CompletionException when locating region 2019-02-02 21:13:45 +08:00
Sergey Shelukhin 946bc19242 HBASE-21811 region can be opened on two servers due to race condition with procedures and server reports
The original fix is provided by Sergey Shelukhin, the UT is added by Duo Zhang

Amending-Author: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-02-02 17:39:31 +08:00
huzheng 81ebe6d40d HBASE-21764 Size of in-memory compaction thread pool shoud be configurable 2019-02-01 10:01:34 +08:00
Nihal Jain c5f4e84106 HBASE-21644 Modify table procedure runs infinitely for a table having region replication > 1
Signed-off-by: zhangduo <zhangduo@apache.org>
2019-01-31 19:34:22 +08:00
Nihal Jain 1c71544497 HBASE-21404 Master/RS navbar active state does not work
Signed-off-by: Jingyun Tian <tianjy@apache.org>
2019-01-31 16:33:07 +08:00
Sergey Shelukhin c90e9ff5ef HBASE-21806 add an option to roll WAL on very slow syncs
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-01-30 16:43:42 -08:00
meiyi 5ddda1a1f6 HBASE-21733 SnapshotQuotaObserverChore should only fetch space quotas
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 17:51:25 +08:00
wanghuan 16c7f5dac9 HBASE-21699 Fixed create table failed when using SPLITS_FILE => 'splits.txt'
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 15:56:25 +08:00
meiyi f997252344 HBASE-21739 Move grant/revoke from regionserver to master
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-30 11:16:57 +08:00
Duo Zhang 7dc69b6128 HBASE-21792 Mark HTableMultiplexer as deprecated and remove it in 3.0.0
Signed-off-by: Michael Stack <stack@apache.org>
2019-01-29 09:08:02 +08:00