Commit Graph

18093 Commits

Author SHA1 Message Date
Andrew Purtell 21481143d8 HBASE-27050 Support unit test pattern matching again (#4447)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-22 19:46:46 -07:00
Andrew Purtell 67592eaba0 Preparing development version 2.4.14-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-22 09:51:14 -07:00
Andrew Purtell 249b5f1170 Preparing hbase release 2.4.13RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-22 09:51:11 -07:00
Duo Zhang ba3d86c972 HBASE-27141 Upgrade hbase-thirdparty dependency to 4.1.1 (#4552)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
(cherry picked from commit 9bae50f83c)

Conflicts:
	pom.xml
2022-06-22 23:38:41 +08:00
Andrew Purtell cd2a7ff1c0 HBASE-27051 TestReplicationSource.testReplicationSourceInitializingMetric is flaky (#4448)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-22 14:05:52 +02:00
Tak Lon (Stephen) Wu 230e0a24ec HBASE-27143 Add hbase-unsafe as a dependency for a MR job triggered by hbase shell (#4554)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-21 13:42:21 -07:00
xiaozhang0319 745cc7bc58 HBASE-27099 The log printing fspread/fsread cost time unit should be milliseconds (#4500)
Co-authored-by: xiaozhang <issac.zhang@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b498efdbc1)
2022-06-21 00:14:44 +08:00
SiCheng-Zheng eb41b47baa HBASE-27128 when open archiveRetries totalLogSize calculation mistake (#4546)
Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5833756e5e)
2022-06-20 23:48:51 +08:00
Xiaolin Ha 51e8f6e6dc
HBASE-27125 The batch size of cleaning expired mob files should have an upper bound(addendum) (#4553)
fix ut error
2022-06-20 11:44:31 +08:00
Xiaolin Ha 15a88efb17 HBASE-27125 The batch size of cleaning expired mob files should have an upper bound (#4541)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-18 02:09:00 +08:00
litao e21f164050
HBASE-27117 Update the method comments for RegionServerAccounting (#4532) 2022-06-16 17:20:19 -07:00
Mohammad Arshad b2f71f2049 HBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted
Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of
ByteBuffer's underlying array instead of original ByteBuffer

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2022-06-13 14:21:38 +02:00
Viraj Jasani ae1a0ed94e Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)" (#4524)
This reverts commit f3a48d1910.

Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
2022-06-12 10:25:28 -07:00
Andrew Purtell fdb91176b5 HBASE-27097 SimpleRpcServer is broken (#4521)
Apply https://issues.apache.org/jira/secure/attachment/13044874/MultiByteBuff.patch
from Lijin Bin on JIRA.

Co-authored-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-11 10:46:24 -07:00
Duo Zhang 42a51545f1 Revert "HBASE-27084 Add spotless:check in mvn verify stage (#4482)"
This reverts commit bcea930b23.
2022-06-12 00:13:28 +08:00
wenwj0 824b7295e8 HBASE-26923 PerformanceEvaluation support encryption option (#4489)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b7065c1cf5)

Conflicts:
	hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java
2022-06-11 21:30:34 +08:00
Nick Dimiduk c8f3c384ae HBASE-27102 Vacate the .idea folder in order to simplify spotless configuration
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-10 15:58:42 +02:00
Nick Dimiduk a3153bfde5
HBASE-27095 HbckChore should produce a report
In #4470 for HBASE-26192, it was noted that the HbckChore is kind of a pain to use and test
because it maintains a bunch of local state. By contract, the CatalogJanitorChore makes a nice
self-contained report. Let's update HbckChore to do the same.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-10 15:47:23 +02:00
wangzhi 3d82d2d9e7 HBASE-27093 AsyncNonMetaRegionLocator:put Complete CompletableFuture outside lock block (#4496)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 176c43c5ad)
2022-06-07 12:18:54 +08:00
Bryan Beaudreault f51e24773f HBASE-27038 CellComparator should extend Serializable (#4492)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-06 17:48:39 -04:00
Duo Zhang bcea930b23 HBASE-27084 Add spotless:check in mvn verify stage (#4482)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit a060e71c53)

Conflicts:
	pom.xml
2022-06-06 23:49:26 +08:00
liuzhuang2017 999801adad HBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. (#4481)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 12a9e6e5ec)

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ConstantSizeRegionSplitPolicy.java
2022-06-06 13:43:58 +08:00
huaxiangsun 976dbe8b2b
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() (#4442) (#4485)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-03 15:28:19 -07:00
skysiders 2e08c69c5c
HBASE-26985 check permission for SecureBulkLoadManager (#4379)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-02 15:30:31 -07:00
Duo Zhang 9ea3e39d7a HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing (#4449)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 313a37f7ac)
2022-06-03 00:23:45 +08:00
Xiaolin Ha df9739979e HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) (#4405)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 80f410ec3f)
2022-06-03 00:08:53 +08:00
LiangJun He 3ce6e1afe7 HBASE-27039 Some methods of MasterRegion should be annotated for testing only (#4433)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 15002fccb4)
2022-06-02 21:39:20 +08:00
Duo Zhang 2d70427a32 HBASE-27023 Fix license issues after running spotless:apply (#4458)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e555ac4a99)
2022-06-02 20:25:35 +08:00
Andrew Purtell f1c7f3a2f0 HBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE (#4476)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 12:43:50 -07:00
Duo Zhang a526252459 HBASE-26933 Addendum remove unused resources and links on site
(cherry picked from commit 4260e3afb7)
2022-05-22 16:33:28 +08:00
Duo Zhang d896958084 HBASE-26933 Remove all ref guide stuff on branch other than master (#4426)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 778ae2d655)

Conflicts:
	src/main/asciidoc/_chapters/compression.adoc
	src/main/asciidoc/_chapters/datamodel.adoc
	src/main/asciidoc/_chapters/hbase-default.adoc
	src/main/asciidoc/_chapters/offheap_read_write.adoc
	src/main/asciidoc/_chapters/ops_mgt.adoc
	src/main/asciidoc/_chapters/upgrading.adoc
	src/main/asciidoc/book.adoc
2022-05-22 15:24:28 +08:00
Junegunn Choi d310bf9623 HBASE-27030 Fix undefined local variable error in draining_servers.rb (#4427)
HBASE-21812 replaced a for-loop with an each block.
Each block introduces a new scope, so a local variable defined inside it
cannot be accessed afterwards.

  NameError: undefined local variable or method `admin' for main:Object
    getServerNames at /opt/khp/hbase/bin/draining_servers.rb:81
        addServers at /opt/khp/hbase/bin/draining_servers.rb:88
            <main> at /opt/khp/hbase/bin/draining_servers.rb:146

This commit defines the admin local variable in the current scope beforehand,
so that we can still access it after the block.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2b573ae377)
2022-05-22 15:07:35 +08:00
litao 45c577a099 HBASE-27047 Fix typo for metric drainingRegionServers (#4441)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 63fe279b45)
2022-05-22 15:03:29 +08:00
bitterfox 075f6e638f HBASE-27027 Use jetty SslContextFactory.Server instead of deprecated SslContextFactory (#4425)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 1be2c83b3d)
2022-05-22 11:36:11 +08:00
d-c-manning 6ae8c9a808 HBASE-27054 TestStochasticLoadBalancerRegionReplicaLargeCluster.testRegionReplicasOnLargeCluster is flaky (#4454)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancerRegionReplicaLargeCluster.java
2022-05-21 09:42:40 -07:00
litao d11298f404
HBASE-27018 Add a tool command list_liveservers (#4416)
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-19 15:50:05 -07:00
Sean Busbey 7b55552388 HBASE-27006 Move nightly integration testing to new larger test node class. (#4438)
(cherry picked from commit 76d20fc48a)
2022-05-19 11:48:43 -05:00
Viraj Jasani 91a44f5bac
HBASE-26523 + HBASE-25465 + HBASE-26855 backport to branch-2.4 (#4439)
* HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.1 (#3988)

Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>

* HBASE-25465 Use javac --release option for supporting cross version compilation (#4164)

Signed-off-by: Andrew Purtell <apurtell@apache.org>

* HBASE-26855 Delete unnecessary dependency on jaxb-runtime jar (#4236)

Signed-off-by: Duo Zhang <zhangduo@apache.org>

* spotless apply

Co-authored-by: Duo Zhang <zhangduo@apache.org>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-18 16:28:55 -07:00
Duo Zhang ee284b6107 HBASE-27024 The User API and Developer API links are broken on hbase.apache.org (#4424)
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit ba7ef0216a)
2022-05-18 21:21:32 +08:00
Duo Zhang 1ab7491c6d HBASE-27045 Disable TestClusterScopeQuotaThrottle (#4440)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 487cf301a4)
2022-05-18 20:51:56 +08:00
Nick Dimiduk 6b1a2c36c1 Revert "HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (#4394)"
This reverts commit 454206b592.
2022-05-18 13:06:34 +02:00
Mohammad Arshad 454206b592 HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (#4394)
Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of ByteBuffer's underlying array instead of original ByteBuffer

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit c198f23e5e)
2022-05-17 11:00:53 +05:30
litao 4f9896ebc0 HBASE-27032 The draining region servers metric description is incorrect (#4428)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit ed1665355a)
2022-05-17 10:47:52 +05:30
Tak Lon (Stephen) Wu 5b319752de
HBASE-27033 Backport "HBASE-27013 Introduce read all bytes when using pread for prefetch" (#4429)
- introduce optional flag `hfile.pread.all.bytes.enabled` for pread that must read full bytes with the next block header

Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2022-05-16 11:21:25 -07:00
litao aa7f98275f
HBASE-27003 Optimize log format for PerformanceEvaluation (#4411)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-10 22:33:04 -07:00
skysiders bba83dc931
HBASE-26994 MasterFileSystem create directory without permission check (#4391)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-08 13:29:33 -07:00
Rushabh Shah daaf5addbe HBASE-26963 ReplicationSource#removePeer hangs if we try to remove bad peer. (#4413)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
2022-05-07 17:45:39 +00:00
litao b8868f225a
HBASE-27000 Block cache stats (Misses Caching) display error in RS web UI (#4406)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-05 23:36:18 -07:00
Duo Zhang 7f7490ff47 HBASE-26995 Remove ref guide check in pre commit and nightly for branches other than master (#4399)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit 9a41117ca5)
2022-05-05 18:40:17 +08:00
Bryan Beaudreault 58aecd4f94 HBASE-26990 Add default implementation for BufferedMutator interface setters (#4387)
Signed-off-by: Josh Elser <elserj@apache.org>
2022-05-03 15:11:20 -04:00