Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,310 Commits 95 Branches 866 Tags
Commit Graph

18310 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
skysiders
286c9c3327
HBASE-26985 check permission for SecureBulkLoadManager (#4379) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-06-02 15:29:43 -07:00
Huaxiang Sun
58aaed19b0 Revert "HBASE-26962: Add mob info in web UI (#4359)" 
This reverts commit 7a02cbfd7ee6418594a1cd241e10b54a0c837e23.
 2022-06-02 14:04:27 -07:00
huaxiangsun
672b0a5f5c
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() (#4442) (#4464) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-02 12:35:11 -07:00
Duo Zhang
f97af48d30 HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing (#4449) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 313a37f7ac780a36b51064372868a31849df6727)
 2022-06-03 00:10:53 +08:00
Xiaolin Ha
f61ac22f02 HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) (#4405) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 80f410ec3fddf35f77b1e3f2b352110d296a2415)
 2022-06-03 00:08:30 +08:00
liangxs
7a02cbfd7e HBASE-26962: Add mob info in web UI (#4359) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d03004060da4084ff858d999faca6d8a4244d8a5)
 2022-06-03 00:05:22 +08:00
LiangJun He
8270b5df5e HBASE-27039 Some methods of MasterRegion should be annotated for testing only (#4433) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 15002fccb4abb187467a9355f436d533928da7ef)
 2022-06-02 21:38:59 +08:00
litao
b21930f3fa HBASE-27037 Display the region server state on the Web UI (#4432) 
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit db992083aff354cc7bc5cee96af7db45d2852531)
 2022-06-02 21:33:07 +08:00
Duo Zhang
40c2743a0c HBASE-27023 Fix license issues after running spotless:apply (#4458) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e555ac4a99419401e293385e78816f4c3f87e771)
 2022-06-02 20:20:43 +08:00
Andrew Purtell
bcf3cd55fd Amend HBASE-27082 spotless:apply 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-06-01 10:50:44 -07:00
Duo Zhang
716a56c849 HBASE-27082 Change the return value of RSGroupInfo.getServers from SortedSet to Set to keep compatibility (#4480) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfo.java
	hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroupsAdmin2.java
	hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestUpdateRSGroupConfiguration.java
 2022-06-01 09:17:34 -07:00
Andrew Purtell
6dd1a6bef0 HBASE-27081 Fix disallowed compatibility breaks on branch-2.5 and branch-2 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-31 19:56:16 -07:00
Duo Zhang
e69da68f97 HBASE-26063 The current checkcompatibility.py script can not compare master and rel/2.0.0 (#3457) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2022-05-31 18:27:16 -07:00
Andrew Purtell
59700babd0 HBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE (#4476) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-31 12:43:41 -07:00
litao
f4f3e63f9f HBASE-27068 NPE occurs when the active master has not yet been elected (#4474) 
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
 2022-05-31 11:50:33 -07:00
Andrew Purtell
cfba2f2b14 HBASE-27064 CME in TestRegionNormalizerWorkQueue (#4468) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-31 11:33:38 -07:00
Istvan Toth
7fbfb10649 HBASE-27069 Hbase SecureBulkload permission regression (#4475) 
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>

(cherry picked from commit 4ce85aa39ffe353ec0d23dd7dd96e1052ac6af81)
 2022-05-31 10:07:23 +01:00
litao
5e54c6daf6 HBASE-27066 The Region Visualizer display failed (#4472) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-29 11:56:32 -07:00
Andrew Purtell
779e9859dc
HBASE-27065 [branch-2] Build against Hadoop 3.3.3 (#4471) 
When building against Hadoop 3.3.3 and any future version of Hadoop
incorporating reload4j the new Enforcer rule we have active in
branch-2.5 and up to exclude other logging frameworks besides log4j2
will trigger. We need to add exclusions to prevent that from
happening so the build will succeed.

Also exclude leveldbjni-all to avoid a LICENSE file generation error.

Add netty-all to hadoop-hdfs test context... to fix tests failing
trying to init minidfscluster.

Co-authored-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2022-05-27 14:03:41 -07:00
Andrew Purtell
20895c7ec5 HBASE-26854 Shell startup logs a bunch of noise (#4469) 
Upon startup the shell logs a bunch of noise, mainly from zookeeper.
Also hide WARN level logging from the Hadoop libraries

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-27 14:01:13 -07:00
Sergey Soldatov
50dd9619b0 HBASE-27061 two phase bulkload is broken when SFT is in use. (#4465) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-05-26 11:11:18 +01:00
Tak Lon (Stephen) Wu
02c1fef889 HBASE-27055 Add additional comments when using HBASE_TRACE_OPTS with standalone mode (#4452) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-05-24 09:29:17 -07:00
Xiaolin Ha
56b81b42d8
HBASE-26342 Support custom paths of independent configuration and pool for hfile cleaner (#4403) (#4461) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-24 15:51:52 +08:00
Xiaolin Ha
200cbcc34f
HBASE-26320 Implement a separate thread pool for the LogCleaner (#3712) (#4460) 
This avoids starvation when the archive directory is large and takes a long time
to iterate through.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
 2022-05-24 14:26:09 +08:00
Duo Zhang
4260e3afb7 HBASE-26933 Addendum remove unused resources and links on site 2022-05-22 16:10:52 +08:00
Duo Zhang
778ae2d655
HBASE-26933 Remove all ref guide stuff on branch other than master (#4426) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-05-22 15:12:52 +08:00
Junegunn Choi
d8d1089649 HBASE-27030 Fix undefined local variable error in draining_servers.rb (#4427) 
HBASE-21812 replaced a for-loop with an each block.
Each block introduces a new scope, so a local variable defined inside it
cannot be accessed afterwards.

  NameError: undefined local variable or method `admin' for main:Object
    getServerNames at /opt/khp/hbase/bin/draining_servers.rb:81
        addServers at /opt/khp/hbase/bin/draining_servers.rb:88
            <main> at /opt/khp/hbase/bin/draining_servers.rb:146

This commit defines the admin local variable in the current scope beforehand,
so that we can still access it after the block.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2b573ae377be926922f48238c4da45a2289f318f)
 2022-05-22 15:07:15 +08:00
litao
bc40edecfc HBASE-27047 Fix typo for metric drainingRegionServers (#4441) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 63fe279b457c0775a986a096027b82c18e868d80)
 2022-05-22 15:02:34 +08:00
bitterfox
a6b1c7e234 HBASE-27027 Use jetty SslContextFactory.Server instead of deprecated SslContextFactory (#4425) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 1be2c83b3dc8306050f67828c9c2e361f19481c6)
 2022-05-22 11:35:45 +08:00
d-c-manning
b00e3032a6 HBASE-27054 TestStochasticLoadBalancerRegionReplicaLargeCluster.testRegionReplicasOnLargeCluster is flaky (#4454) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancerRegionReplicaLargeCluster.java
 2022-05-21 09:23:05 -07:00
Xiaolin Ha
8bc55f8308 HBASE-27043 Let lock wait timeout to improve performance of SnapshotHFileCleaner (#4437) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-20 15:34:17 -07:00
Nick Dimiduk
2cae259f36
HBASE-27052 TestAsyncTableScanner.testScanWrongColumnFamily is flaky (#4455) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-20 15:13:57 -07:00
Andrew Purtell
7af82cf164 HBASE-27051 TestReplicationSource.testReplicationSourceInitializingMetric is flaky (#4448) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-20 15:11:19 -07:00
Andrew Purtell
a836fc86e8 HBASE-27050 Support unit test pattern matching again (#4447) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-20 15:09:01 -07:00
litao
8a3a94205b
HBASE-27018 Add a tool command list_liveservers (#4416) 
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-19 15:49:00 -07:00
Sean Busbey
f20f77120b HBASE-27006 Move nightly integration testing to new larger test node class. (#4438) 
(cherry picked from commit 76d20fc48afc48b2e496c8aea830c46f76974a20)
 2022-05-19 11:48:40 -05:00
Duo Zhang
f8e742d495 HBASE-27024 The User API and Developer API links are broken on hbase.apache.org (#4424) 
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit ba7ef0216a2a13b82e936849dea006fec2061c03)
 2022-05-18 21:07:03 +08:00
Duo Zhang
b9b5302929 HBASE-27045 Disable TestClusterScopeQuotaThrottle (#4440) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 487cf301a46a5df9201d24f19117b79967082b73)
 2022-05-18 20:47:20 +08:00
Nick Dimiduk
1e6d93a789 HBASE-26986 Trace a one-shot execution of a Master procedure 
This one adds a tracing context to the Master's ProcedureV2 execution. This ties all the spans
that result from a procedure execution back to a procedure by name. Maybe in a follow-on issue, we
can serialize span context along with procedures and display procedure start/stop/retry events and
parent-child hierarchy in tracing visualization.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-05-18 13:08:27 +02:00
Nick Dimiduk
71bd62da41 Revert "HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (#4394)" 
This reverts commit de9a17e75cc80e7a473f1a4269092a557b1105a0.
 2022-05-18 13:03:16 +02:00
Mohammad Arshad
de9a17e75c HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (#4394) 
Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of ByteBuffer's underlying array instead of original ByteBuffer

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit c198f23e5eb078abc47d4c3439477c6c2b4d5136)
 2022-05-17 10:58:06 +05:30
litao
31f4b422ab HBASE-27032 The draining region servers metric description is incorrect (#4428) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit ed1665355a221f9f36ce7c8905d9ed063c6e9eac)
 2022-05-17 10:38:15 +05:30
Andrew Purtell
2efaa7d221 HBASE-27019 Minor compression performance improvements (#4420) 
TRACE level logging is expensive enough to warrant removal. They were
useful during development but are now just overhead.

Also we unnecessarily create new compressor and decompressor instances
in the reset() methods for the Aircompressor and Lz4 codecs. Remove.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-05-13 18:30:54 -07:00
Rushabh Shah
7bc7eb5f48 HBASE-26905 ReplicationPeerManager#checkPeerExists should throw ReplicationPeerNotFoundException if peer doesn't exists (#4422) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-13 18:25:19 -07:00
Tak Lon (Stephen) Wu
43e8c11989 HBASE-27013 Introduce read all bytes when using pread for prefetch (#4414) 
- introduce optional flag `hfile.pread.all.bytes.enabled` for pread that must read full bytes with the next block header

Signed-off-by: Josh Elser <elserj@apache.org>
 2022-05-13 13:14:17 -07:00
Duo Zhang
62dbae2914 HBASE-26999 Addendum fix spotless errors 2022-05-13 09:57:26 +08:00
Wellington Chevreuil
930bc5368c HBASE-27021 StoreFileInfo should set its initialPath in a consistent way 
(Amending spotless errors after revert by Duo)
 2022-05-12 10:53:19 +01:00
Duo Zhang
e3359efe7a Revert "HBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419)" 
Revert due to failure spotless:check

This reverts commit aa31b0f695ab02015a7a183aaf10ac9963a22ddb.
 2022-05-12 10:53:10 +01:00
Wellington Ramos Chevreuil
b7647d8d5f HBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419) 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-05-12 10:52:47 +01:00
litao
5cfce692a5
HBASE-27003 Optimize log format for PerformanceEvaluation (#4411) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-10 22:32:36 -07:00