Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,095 Commits 95 Branches 866 Tags
Commit Graph

18095 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Andrew Purtell
90fb1ddc1d Preparing hbase release 2.4.13RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
rel/2.4.13 2.4.13RC1 		2022-06-22 20:15:03 -07:00
Andrew Purtell
847665d9d6 HBASE-27151 TestMultiRespectsLimits.testBlockMultiLimits repeatable failure 
Revert "HBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted"

This reverts commit b2f71f2049c73c53ed7fe1400e8ff25612667b62.
 2022-06-22 20:11:42 -07:00
Andrew Purtell
21481143d8 HBASE-27050 Support unit test pattern matching again (#4447) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-06-22 19:46:46 -07:00
Andrew Purtell
67592eaba0 Preparing development version 2.4.14-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-06-22 09:51:14 -07:00
Andrew Purtell
249b5f1170 Preparing hbase release 2.4.13RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2.4.13RC0 		2022-06-22 09:51:11 -07:00
Duo Zhang
ba3d86c972 HBASE-27141 Upgrade hbase-thirdparty dependency to 4.1.1 (#4552) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
(cherry picked from commit 9bae50f83c6c300d8952527bece28c3d2c13e179)

Conflicts:
	pom.xml
 2022-06-22 23:38:41 +08:00
Andrew Purtell
cd2a7ff1c0 HBASE-27051 TestReplicationSource.testReplicationSourceInitializingMetric is flaky (#4448) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-06-22 14:05:52 +02:00
Tak Lon (Stephen) Wu
230e0a24ec HBASE-27143 Add hbase-unsafe as a dependency for a MR job triggered by hbase shell (#4554) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-21 13:42:21 -07:00
xiaozhang0319
745cc7bc58 HBASE-27099 The log printing fspread/fsread cost time unit should be milliseconds (#4500) 
Co-authored-by: xiaozhang <issac.zhang@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b498efdbc1f4f51d715edcf6b06456f04f518c7f)
 2022-06-21 00:14:44 +08:00
SiCheng-Zheng
eb41b47baa HBASE-27128 when open archiveRetries totalLogSize calculation mistake (#4546) 
Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5833756e5e7cdc01d50538e5c9f959a79fcfd7a3)
 2022-06-20 23:48:51 +08:00
Xiaolin Ha
51e8f6e6dc
HBASE-27125 The batch size of cleaning expired mob files should have an upper bound(addendum) (#4553) 
fix ut error
 2022-06-20 11:44:31 +08:00
Xiaolin Ha
15a88efb17 HBASE-27125 The batch size of cleaning expired mob files should have an upper bound (#4541) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-18 02:09:00 +08:00
litao
e21f164050
HBASE-27117 Update the method comments for RegionServerAccounting (#4532) 2022-06-16 17:20:19 -07:00
Mohammad Arshad
b2f71f2049 HBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted 
Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of
ByteBuffer's underlying array instead of original ByteBuffer

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2022-06-13 14:21:38 +02:00
Viraj Jasani
ae1a0ed94e Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)" (#4524) 
This reverts commit f3a48d19101a6a485628f71fc4b980fb95b44ad2.

Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
 2022-06-12 10:25:28 -07:00
Andrew Purtell
fdb91176b5 HBASE-27097 SimpleRpcServer is broken (#4521) 
Apply https://issues.apache.org/jira/secure/attachment/13044874/MultiByteBuff.patch
from Lijin Bin on JIRA.

Co-authored-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-06-11 10:46:24 -07:00
Duo Zhang
42a51545f1 Revert "HBASE-27084 Add spotless:check in mvn verify stage (#4482)" 
This reverts commit bcea930b232fb5474ff3c1bba9cc2b0225bacf09.
 2022-06-12 00:13:28 +08:00
wenwj0
824b7295e8 HBASE-26923 PerformanceEvaluation support encryption option (#4489) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b7065c1cf5297074e79e5c58b3ee1ba5fd1a7f55)

Conflicts:
	hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java
 2022-06-11 21:30:34 +08:00
Nick Dimiduk
c8f3c384ae HBASE-27102 Vacate the .idea folder in order to simplify spotless configuration 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-10 15:58:42 +02:00
Nick Dimiduk
a3153bfde5
HBASE-27095 HbckChore should produce a report 
In #4470 for HBASE-26192, it was noted that the HbckChore is kind of a pain to use and test
because it maintains a bunch of local state. By contract, the CatalogJanitorChore makes a nice
self-contained report. Let's update HbckChore to do the same.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-06-10 15:47:23 +02:00
wangzhi
3d82d2d9e7 HBASE-27093 AsyncNonMetaRegionLocator：put Complete CompletableFuture outside lock block (#4496) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 176c43c5ad1aab01eb2d2b05c0cb90132e8d19b1)
 2022-06-07 12:18:54 +08:00
Bryan Beaudreault
f51e24773f HBASE-27038 CellComparator should extend Serializable (#4492) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-06-06 17:48:39 -04:00
Duo Zhang
bcea930b23 HBASE-27084 Add spotless:check in mvn verify stage (#4482) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit a060e71c530556743189c9ee8b01a90e0f2891af)

Conflicts:
	pom.xml
 2022-06-06 23:49:26 +08:00
liuzhuang2017
999801adad HBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. (#4481) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 12a9e6e5ec7e3c86b60ae818d736b9f83fb69604)

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ConstantSizeRegionSplitPolicy.java
 2022-06-06 13:43:58 +08:00
huaxiangsun
976dbe8b2b
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() (#4442) (#4485) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-03 15:28:19 -07:00
skysiders
2e08c69c5c
HBASE-26985 check permission for SecureBulkLoadManager (#4379) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-06-02 15:30:31 -07:00
Duo Zhang
9ea3e39d7a HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing (#4449) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 313a37f7ac780a36b51064372868a31849df6727)
 2022-06-03 00:23:45 +08:00
Xiaolin Ha
df9739979e HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) (#4405) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 80f410ec3fddf35f77b1e3f2b352110d296a2415)
 2022-06-03 00:08:53 +08:00
LiangJun He
3ce6e1afe7 HBASE-27039 Some methods of MasterRegion should be annotated for testing only (#4433) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 15002fccb4abb187467a9355f436d533928da7ef)
 2022-06-02 21:39:20 +08:00
Duo Zhang
2d70427a32 HBASE-27023 Fix license issues after running spotless:apply (#4458) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e555ac4a99419401e293385e78816f4c3f87e771)
 2022-06-02 20:25:35 +08:00
Andrew Purtell
f1c7f3a2f0 HBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE (#4476) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-31 12:43:50 -07:00
Duo Zhang
a526252459 HBASE-26933 Addendum remove unused resources and links on site 
(cherry picked from commit 4260e3afb71b3272442bb2f69365fdf6914330e9)
 2022-05-22 16:33:28 +08:00
Duo Zhang
d896958084 HBASE-26933 Remove all ref guide stuff on branch other than master (#4426) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 778ae2d6551bd9b05511812696c83a4dad2c5f08)

Conflicts:
	src/main/asciidoc/_chapters/compression.adoc
	src/main/asciidoc/_chapters/datamodel.adoc
	src/main/asciidoc/_chapters/hbase-default.adoc
	src/main/asciidoc/_chapters/offheap_read_write.adoc
	src/main/asciidoc/_chapters/ops_mgt.adoc
	src/main/asciidoc/_chapters/upgrading.adoc
	src/main/asciidoc/book.adoc
 2022-05-22 15:24:28 +08:00
Junegunn Choi
d310bf9623 HBASE-27030 Fix undefined local variable error in draining_servers.rb (#4427) 
HBASE-21812 replaced a for-loop with an each block.
Each block introduces a new scope, so a local variable defined inside it
cannot be accessed afterwards.

  NameError: undefined local variable or method `admin' for main:Object
    getServerNames at /opt/khp/hbase/bin/draining_servers.rb:81
        addServers at /opt/khp/hbase/bin/draining_servers.rb:88
            <main> at /opt/khp/hbase/bin/draining_servers.rb:146

This commit defines the admin local variable in the current scope beforehand,
so that we can still access it after the block.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2b573ae377be926922f48238c4da45a2289f318f)
 2022-05-22 15:07:35 +08:00
litao
45c577a099 HBASE-27047 Fix typo for metric drainingRegionServers (#4441) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 63fe279b457c0775a986a096027b82c18e868d80)
 2022-05-22 15:03:29 +08:00
bitterfox
075f6e638f HBASE-27027 Use jetty SslContextFactory.Server instead of deprecated SslContextFactory (#4425) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 1be2c83b3dc8306050f67828c9c2e361f19481c6)
 2022-05-22 11:36:11 +08:00
d-c-manning
6ae8c9a808 HBASE-27054 TestStochasticLoadBalancerRegionReplicaLargeCluster.testRegionReplicasOnLargeCluster is flaky (#4454) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancerRegionReplicaLargeCluster.java
 2022-05-21 09:42:40 -07:00
litao
d11298f404
HBASE-27018 Add a tool command list_liveservers (#4416) 
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-19 15:50:05 -07:00
Sean Busbey
7b55552388 HBASE-27006 Move nightly integration testing to new larger test node class. (#4438) 
(cherry picked from commit 76d20fc48afc48b2e496c8aea830c46f76974a20)
 2022-05-19 11:48:43 -05:00
Viraj Jasani
91a44f5bac
HBASE-26523 + HBASE-25465 + HBASE-26855 backport to branch-2.4 (#4439) 
* HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.1 (#3988)

Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>

* HBASE-25465 Use javac --release option for supporting cross version compilation (#4164)

Signed-off-by: Andrew Purtell <apurtell@apache.org>

* HBASE-26855 Delete unnecessary dependency on jaxb-runtime jar (#4236)

Signed-off-by: Duo Zhang <zhangduo@apache.org>

* spotless apply

Co-authored-by: Duo Zhang <zhangduo@apache.org>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-18 16:28:55 -07:00
Duo Zhang
ee284b6107 HBASE-27024 The User API and Developer API links are broken on hbase.apache.org (#4424) 
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit ba7ef0216a2a13b82e936849dea006fec2061c03)
 2022-05-18 21:21:32 +08:00
Duo Zhang
1ab7491c6d HBASE-27045 Disable TestClusterScopeQuotaThrottle (#4440) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 487cf301a46a5df9201d24f19117b79967082b73)
 2022-05-18 20:51:56 +08:00
Nick Dimiduk
6b1a2c36c1 Revert "HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (#4394)" 
This reverts commit 454206b5926dbe6d6231236597b7004fec814f9d.
 2022-05-18 13:06:34 +02:00
Mohammad Arshad
454206b592 HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (#4394) 
Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of ByteBuffer's underlying array instead of original ByteBuffer

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit c198f23e5eb078abc47d4c3439477c6c2b4d5136)
 2022-05-17 11:00:53 +05:30
litao
4f9896ebc0 HBASE-27032 The draining region servers metric description is incorrect (#4428) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit ed1665355a221f9f36ce7c8905d9ed063c6e9eac)
 2022-05-17 10:47:52 +05:30
Tak Lon (Stephen) Wu
5b319752de
HBASE-27033 Backport "HBASE-27013 Introduce read all bytes when using pread for prefetch" (#4429) 
- introduce optional flag `hfile.pread.all.bytes.enabled` for pread that must read full bytes with the next block header

Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2022-05-16 11:21:25 -07:00
litao
aa7f98275f
HBASE-27003 Optimize log format for PerformanceEvaluation (#4411) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-10 22:33:04 -07:00
skysiders
bba83dc931
HBASE-26994 MasterFileSystem create directory without permission check (#4391) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-08 13:29:33 -07:00
Rushabh Shah
daaf5addbe HBASE-26963 ReplicationSource#removePeer hangs if we try to remove bad peer. (#4413) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
 2022-05-07 17:45:39 +00:00
litao
b8868f225a
HBASE-27000 Block cache stats (Misses Caching) display error in RS web UI (#4406) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-05 23:36:18 -07:00