18326 Commits

Author SHA1 Message Date
Bryan Beaudreault
b379d8e2cf HBASE-26945 Quotas causes too much load on meta for large clusters (#4576)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-06-23 16:48:07 -04:00
Kerasone
2b7347f23c HBASE-27001 The deleted variable cannot be printed out (#4479)
* The deleted variable cannot be printed out, add it

Co-authored-by: selina.yan <selina.yan@huolala.cn>

Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit b8558d30d0027d031ce6dec8b2ba0243c3a58554)
2022-06-23 22:44:27 +05:30
Pankaj
31acc8510f HBASE-27105 HBaseInterClusterReplicationEndpoint should honor replication adaptive timeout (#4569)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit c74bf8b6e2bbcde6baa7f6f0166236ebb7ef3503)
2022-06-23 22:24:53 +05:30
Duo Zhang
b47ca399c5 HBASE-27141 Upgrade hbase-thirdparty dependency to 4.1.1 (#4552)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
(cherry picked from commit 9bae50f83c6c300d8952527bece28c3d2c13e179)
2022-06-22 23:19:10 +08:00
litao
8828d07c87
HBASE-27098 Fix link for field comments (#4499)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-21 18:31:35 -07:00
Tak Lon (Stephen) Wu
f8159330aa HBASE-27143 Add hbase-unsafe as a dependency for a MR job triggered by hbase shell (#4554)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-21 13:41:14 -07:00
LiangJun He
53b57d686b HBASE-27028 Add a shell command for flushing master local region (#4539)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 666aa064e7cfe8efa2c020a6831206b71df0d8a9)
2022-06-21 13:35:38 +08:00
XinSun
135348192c HBASE-26956 ExportSnapshot tool supports removing TTL (#4538)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-21 09:27:09 +08:00
xiaozhang0319
b9d6d370f2 HBASE-27099 The log printing fspread/fsread cost time unit should be milliseconds (#4500)
Co-authored-by: xiaozhang <issac.zhang@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b498efdbc1f4f51d715edcf6b06456f04f518c7f)
2022-06-21 00:14:36 +08:00
SiCheng-Zheng
5833756e5e
HBASE-27128 when open archiveRetries totalLogSize calculation mistake (#4546)
Co-authored-by: zhengsicheng <zhengsicheng@jd.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-20 23:45:35 +08:00
Xiaolin Ha
a7083d93cb HBASE-27125 The batch size of cleaning expired mob files should have an upper bound (#4541)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-18 02:08:37 +08:00
litao
fa1b3eed99
HBASE-27117 Update the method comments for RegionServerAccounting (#4532) 2022-06-16 17:20:02 -07:00
xicm
591fda9fe4 HBASE-26167 Allow users to not start zookeeper and dfs cluster when using TestingHBaseCluster (#4534)
Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Yu Li <liyu@apache.org>
(cherry picked from commit 7fc167493398436dccc4bc7864f39b278f386119)

Conflicts:
	hbase-testing-util/src/main/java/org/apache/hadoop/hbase/testing/TestingHBaseClusterImpl.java
2022-06-15 13:44:38 +08:00
Mohammad Arshad
50e2499354 HBASE-26856 BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted
Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of
ByteBuffer's underlying array instead of original ByteBuffer

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2022-06-13 14:21:17 +02:00
Nick Dimiduk
ac7622c398
HBASE-26366 Provide meaningful parent spans to ZK interactions
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-13 10:33:49 +02:00
Viraj Jasani
9741f1a5c1 Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#3117)" (#4524)
This reverts commit f3a48d19101a6a485628f71fc4b980fb95b44ad2.

Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
2022-06-12 10:25:23 -07:00
Andrew Purtell
2ef58ab52f HBASE-27097 SimpleRpcServer is broken (#4521)
Apply https://issues.apache.org/jira/secure/attachment/13044874/MultiByteBuff.patch
from Lijin Bin on JIRA.

Co-authored-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-11 10:42:18 -07:00
Duo Zhang
adea9bdd95 Revert "HBASE-27084 Add spotless:check in mvn verify stage (#4482)"
This reverts commit 278939cd831dff26712af867ef64f87afb1f9730.
2022-06-12 00:12:59 +08:00
wenwj0
c645e21686 HBASE-26923 PerformanceEvaluation support encryption option (#4489)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit b7065c1cf5297074e79e5c58b3ee1ba5fd1a7f55)

Conflicts:
	hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java
2022-06-11 21:30:24 +08:00
Nick Dimiduk
f4a4f0c05e HBASE-27102 Vacate the .idea folder in order to simplify spotless configuration
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-10 15:57:52 +02:00
Nick Dimiduk
cc2af766d6
HBASE-27095 HbckChore should produce a report
In #4470 for HBASE-26192, it was noted that the HbckChore is kind of a pain to use and test
because it maintains a bunch of local state. By contract, the CatalogJanitorChore makes a nice
self-contained report. Let's update HbckChore to do the same.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-10 15:47:08 +02:00
Andrew Purtell
b7d7be0156 HBASE-27103 All MR UTs are broken because of ClassNotFound (#4514)
Signed-off-by: Sean Busbey <busbey@apache.org>
Co-authored-by: Duo Zhang <zhangduo@apache.org>
2022-06-09 10:01:21 -07:00
Nick Dimiduk
7ead4b1617 HBASE-27066 The Region Visualizer display failed
Reviewed-by: litao <tomleescut@gmail.com>
2022-06-09 13:09:38 +02:00
Nick Dimiduk
d24f4ce2f0 Revert "HBASE-27066 The Region Visualizer display failed (#4472)"
This reverts commit 8b9df125a365d2b048fa9a98719197cbb9d4b7bd.
2022-06-09 13:09:38 +02:00
wangzhi
5cc614f23f HBASE-27093 AsyncNonMetaRegionLocator:put Complete CompletableFuture outside lock block (#4496)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 176c43c5ad1aab01eb2d2b05c0cb90132e8d19b1)
2022-06-07 12:18:46 +08:00
Bryan Beaudreault
046e51085f HBASE-27038 CellComparator should extend Serializable (#4492)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-06 17:47:30 -04:00
Duo Zhang
278939cd83 HBASE-27084 Add spotless:check in mvn verify stage (#4482)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit a060e71c530556743189c9ee8b01a90e0f2891af)
2022-06-06 23:48:38 +08:00
liuzhuang2017
19f67d22d4 HBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. (#4481)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 12a9e6e5ec7e3c86b60ae818d736b9f83fb69604)
2022-06-06 13:42:08 +08:00
BukrosSzabolcs
8139cf6477 HBASE-27017: MOB snapshot is broken when FileBased SFT is used (#4466)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-06-06 00:29:27 +01:00
huaxiangsun
5a13ad8137
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() (#4442) (#4484)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-03 15:27:00 -07:00
skysiders
0c5d6601da
HBASE-26985 check permission for SecureBulkLoadManager (#4379)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-02 15:30:12 -07:00
Duo Zhang
2625c67e73 HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing (#4449)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 313a37f7ac780a36b51064372868a31849df6727)
2022-06-03 00:11:10 +08:00
Xiaolin Ha
8bf5256c24 HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) (#4405)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 80f410ec3fddf35f77b1e3f2b352110d296a2415)
2022-06-03 00:08:45 +08:00
LiangJun He
a93b7cd654 HBASE-27039 Some methods of MasterRegion should be annotated for testing only (#4433)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 15002fccb4abb187467a9355f436d533928da7ef)
2022-06-02 21:39:13 +08:00
Duo Zhang
b5dcb7d3a1 HBASE-27023 Fix license issues after running spotless:apply (#4458)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e555ac4a99419401e293385e78816f4c3f87e771)
2022-06-02 20:24:08 +08:00
Andrew Purtell
d2d3d64c6c Amend HBASE-27082 spotless:apply
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-01 10:49:35 -07:00
Duo Zhang
267e9fa48a HBASE-27082 Change the return value of RSGroupInfo.getServers from SortedSet to Set to keep compatibility (#4480)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfo.java
	hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroupsAdmin2.java
	hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestUpdateRSGroupConfiguration.java
2022-06-01 09:30:17 -07:00
Andrew Purtell
b7158a87ea Preparing development version 2.5.1-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-31 20:06:32 -07:00
Andrew Purtell
2da2dd917f Preparing hbase release 2.5.0RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2.5.0RC0
2022-05-31 20:06:29 -07:00
Andrew Purtell
4d6636dfea HBASE-27081 Fix disallowed compatibility breaks on branch-2.5 and branch-2
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-31 19:53:58 -07:00
Duo Zhang
0af4b5f1b0 HBASE-26063 The current checkcompatibility.py script can not compare master and rel/2.0.0 (#3457)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2022-05-31 18:27:09 -07:00
Andrew Purtell
2f63d99c48 HBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE (#4476)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 12:43:45 -07:00
litao
f0dcbe78a7 HBASE-27068 NPE occurs when the active master has not yet been elected (#4474)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
2022-05-31 11:50:36 -07:00
Andrew Purtell
2a59ebffaa HBASE-27064 CME in TestRegionNormalizerWorkQueue (#4468)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 11:33:43 -07:00
Istvan Toth
7f7c42e33e HBASE-27069 Hbase SecureBulkload permission regression (#4475)
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-05-31 10:10:28 +01:00
litao
8b9df125a3 HBASE-27066 The Region Visualizer display failed (#4472)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-29 11:56:39 -07:00
Andrew Purtell
e172b983ca HBASE-27065 [branch-2] Build against Hadoop 3.3.3 (#4471)
When building against Hadoop 3.3.3 and any future version of Hadoop
incorporating reload4j the new Enforcer rule we have active in
branch-2.5 and up to exclude other logging frameworks besides log4j2
will trigger. We need to add exclusions to prevent that from
happening so the build will succeed.

Also exclude leveldbjni-all to avoid a LICENSE file generation error.

Add netty-all to hadoop-hdfs test context... to fix tests failing
trying to init minidfscluster.

Co-authored-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-05-27 14:04:35 -07:00
Andrew Purtell
1813fc8bf4 HBASE-26854 Shell startup logs a bunch of noise (#4469)
Upon startup the shell logs a bunch of noise, mainly from zookeeper.
Also hide WARN level logging from the Hadoop libraries

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-27 14:01:19 -07:00
Sergey Soldatov
c9fc396dfa HBASE-27061 two phase bulkload is broken when SFT is in use. (#4465)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-05-26 13:55:31 +01:00
Tak Lon (Stephen) Wu
20aaa1e961 HBASE-27055 Add additional comments when using HBASE_TRACE_OPTS with standalone mode (#4452)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-05-24 09:30:58 -07:00