Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,301 Commits 95 Branches 866 Tags
Commit Graph

18301 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Bryan Beaudreault
046e51085f HBASE-27038 CellComparator should extend Serializable (#4492) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-06-06 17:47:30 -04:00
Duo Zhang
278939cd83 HBASE-27084 Add spotless:check in mvn verify stage (#4482) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit a060e71c530556743189c9ee8b01a90e0f2891af)
 2022-06-06 23:48:38 +08:00
liuzhuang2017
19f67d22d4 HBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. (#4481) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 12a9e6e5ec7e3c86b60ae818d736b9f83fb69604)
 2022-06-06 13:42:08 +08:00
BukrosSzabolcs
8139cf6477 HBASE-27017: MOB snapshot is broken when FileBased SFT is used (#4466) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-06-06 00:29:27 +01:00
huaxiangsun
5a13ad8137
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() (#4442) (#4484) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-03 15:27:00 -07:00
skysiders
0c5d6601da
HBASE-26985 check permission for SecureBulkLoadManager (#4379) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-06-02 15:30:12 -07:00
Duo Zhang
2625c67e73 HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing (#4449) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 313a37f7ac780a36b51064372868a31849df6727)
 2022-06-03 00:11:10 +08:00
Xiaolin Ha
8bf5256c24 HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) (#4405) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 80f410ec3fddf35f77b1e3f2b352110d296a2415)
 2022-06-03 00:08:45 +08:00
LiangJun He
a93b7cd654 HBASE-27039 Some methods of MasterRegion should be annotated for testing only (#4433) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 15002fccb4abb187467a9355f436d533928da7ef)
 2022-06-02 21:39:13 +08:00
Duo Zhang
b5dcb7d3a1 HBASE-27023 Fix license issues after running spotless:apply (#4458) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e555ac4a99419401e293385e78816f4c3f87e771)
 2022-06-02 20:24:08 +08:00
Andrew Purtell
d2d3d64c6c Amend HBASE-27082 spotless:apply 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-06-01 10:49:35 -07:00
Duo Zhang
267e9fa48a HBASE-27082 Change the return value of RSGroupInfo.getServers from SortedSet to Set to keep compatibility (#4480) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfo.java
	hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroupsAdmin2.java
	hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestUpdateRSGroupConfiguration.java
 2022-06-01 09:30:17 -07:00
Andrew Purtell
b7158a87ea Preparing development version 2.5.1-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-31 20:06:32 -07:00
Andrew Purtell
2da2dd917f Preparing hbase release 2.5.0RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2.5.0RC0 		2022-05-31 20:06:29 -07:00
Andrew Purtell
4d6636dfea HBASE-27081 Fix disallowed compatibility breaks on branch-2.5 and branch-2 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-31 19:53:58 -07:00
Duo Zhang
0af4b5f1b0 HBASE-26063 The current checkcompatibility.py script can not compare master and rel/2.0.0 (#3457) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2022-05-31 18:27:09 -07:00
Andrew Purtell
2f63d99c48 HBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE (#4476) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-31 12:43:45 -07:00
litao
f0dcbe78a7 HBASE-27068 NPE occurs when the active master has not yet been elected (#4474) 
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
 2022-05-31 11:50:36 -07:00
Andrew Purtell
2a59ebffaa HBASE-27064 CME in TestRegionNormalizerWorkQueue (#4468) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-31 11:33:43 -07:00
Istvan Toth
7f7c42e33e HBASE-27069 Hbase SecureBulkload permission regression (#4475) 
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-05-31 10:10:28 +01:00
litao
8b9df125a3 HBASE-27066 The Region Visualizer display failed (#4472) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-29 11:56:39 -07:00
Andrew Purtell
e172b983ca HBASE-27065 [branch-2] Build against Hadoop 3.3.3 (#4471) 
When building against Hadoop 3.3.3 and any future version of Hadoop
incorporating reload4j the new Enforcer rule we have active in
branch-2.5 and up to exclude other logging frameworks besides log4j2
will trigger. We need to add exclusions to prevent that from
happening so the build will succeed.

Also exclude leveldbjni-all to avoid a LICENSE file generation error.

Add netty-all to hadoop-hdfs test context... to fix tests failing
trying to init minidfscluster.

Co-authored-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2022-05-27 14:04:35 -07:00
Andrew Purtell
1813fc8bf4 HBASE-26854 Shell startup logs a bunch of noise (#4469) 
Upon startup the shell logs a bunch of noise, mainly from zookeeper.
Also hide WARN level logging from the Hadoop libraries

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-27 14:01:19 -07:00
Sergey Soldatov
c9fc396dfa HBASE-27061 two phase bulkload is broken when SFT is in use. (#4465) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-05-26 13:55:31 +01:00
Tak Lon (Stephen) Wu
20aaa1e961 HBASE-27055 Add additional comments when using HBASE_TRACE_OPTS with standalone mode (#4452) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-05-24 09:30:58 -07:00
Xiaolin Ha
e1843af1d5 HBASE-26342 Support custom paths of independent configuration and pool for hfile cleaner (#4403) (#4461) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-24 15:52:54 +08:00
Xiaolin Ha
4be25a3a61 HBASE-26320 Implement a separate thread pool for the LogCleaner (#3712) (#4460) 
This avoids starvation when the archive directory is large and takes a long time
to iterate through.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
 2022-05-24 14:34:47 +08:00
Duo Zhang
2294834a04 HBASE-26933 Addendum remove unused resources and links on site 
(cherry picked from commit 4260e3afb71b3272442bb2f69365fdf6914330e9)
 2022-05-22 16:33:09 +08:00
Duo Zhang
0f0f2d1015 HBASE-26933 Remove all ref guide stuff on branch other than master (#4426) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 778ae2d6551bd9b05511812696c83a4dad2c5f08)

 Conflicts:
	src/main/asciidoc/_chapters/configuration.adoc
	src/main/asciidoc/book.adoc
 2022-05-22 15:16:03 +08:00
Junegunn Choi
84a79dfbd4 HBASE-27030 Fix undefined local variable error in draining_servers.rb (#4427) 
HBASE-21812 replaced a for-loop with an each block.
Each block introduces a new scope, so a local variable defined inside it
cannot be accessed afterwards.

  NameError: undefined local variable or method `admin' for main:Object
    getServerNames at /opt/khp/hbase/bin/draining_servers.rb:81
        addServers at /opt/khp/hbase/bin/draining_servers.rb:88
            <main> at /opt/khp/hbase/bin/draining_servers.rb:146

This commit defines the admin local variable in the current scope beforehand,
so that we can still access it after the block.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2b573ae377be926922f48238c4da45a2289f318f)
 2022-05-22 15:07:28 +08:00
litao
cdf6076801 HBASE-27047 Fix typo for metric drainingRegionServers (#4441) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 63fe279b457c0775a986a096027b82c18e868d80)
 2022-05-22 15:03:22 +08:00
bitterfox
b83e03abc2 HBASE-27027 Use jetty SslContextFactory.Server instead of deprecated SslContextFactory (#4425) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 1be2c83b3dc8306050f67828c9c2e361f19481c6)
 2022-05-22 11:36:05 +08:00
d-c-manning
188dfeec5f HBASE-27054 TestStochasticLoadBalancerRegionReplicaLargeCluster.testRegionReplicasOnLargeCluster is flaky (#4454) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancerRegionReplicaLargeCluster.java
 2022-05-21 09:24:42 -07:00
Xiaolin Ha
f81bb8b6ec HBASE-27043 Let lock wait timeout to improve performance of SnapshotHFileCleaner (#4437) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-20 15:34:21 -07:00
Nick Dimiduk
8bbba7353e
HBASE-27052 TestAsyncTableScanner.testScanWrongColumnFamily is flaky (#4456) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-20 15:14:15 -07:00
Andrew Purtell
f982e6d39c HBASE-27051 TestReplicationSource.testReplicationSourceInitializingMetric is flaky (#4448) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-20 15:11:23 -07:00
Andrew Purtell
bad3f20a80 HBASE-27050 Support unit test pattern matching again (#4447) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-20 15:09:05 -07:00
litao
96182e2cf9
HBASE-27018 Add a tool command list_liveservers (#4416) 
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-19 15:49:36 -07:00
Sean Busbey
8487e8d2cf HBASE-27006 Move nightly integration testing to new larger test node class. (#4438) 
(cherry picked from commit 76d20fc48afc48b2e496c8aea830c46f76974a20)
 2022-05-19 11:48:41 -05:00
Duo Zhang
6774487750 HBASE-27024 The User API and Developer API links are broken on hbase.apache.org (#4424) 
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit ba7ef0216a2a13b82e936849dea006fec2061c03)
 2022-05-18 21:17:23 +08:00
Duo Zhang
9f5ef981f9 HBASE-27045 Disable TestClusterScopeQuotaThrottle (#4440) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 487cf301a46a5df9201d24f19117b79967082b73)
 2022-05-18 20:51:37 +08:00
Nick Dimiduk
c47a2c3841 HBASE-26986 Trace a one-shot execution of a Master procedure 
This one adds a tracing context to the Master's ProcedureV2 execution. This ties all the spans
that result from a procedure execution back to a procedure by name. Maybe in a follow-on issue, we
can serialize span context along with procedures and display procedure start/stop/retry events and
parent-child hierarchy in tracing visualization.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-05-18 13:08:42 +02:00
Nick Dimiduk
6bf8db8ec8 Revert "HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (#4394)" 
This reverts commit 04956ffe7e35c12b9f6b905692e154a436d56639.
 2022-05-18 13:05:09 +02:00
Mohammad Arshad
04956ffe7e HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (#4394) 
Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of ByteBuffer's underlying array instead of original ByteBuffer

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit c198f23e5eb078abc47d4c3439477c6c2b4d5136)
 2022-05-17 10:59:59 +05:30
litao
c4d7d55958 HBASE-27032 The draining region servers metric description is incorrect (#4428) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit ed1665355a221f9f36ce7c8905d9ed063c6e9eac)
 2022-05-17 10:44:40 +05:30
Andrew Purtell
2e4d9a2adf HBASE-27019 Minor compression performance improvements (#4420) 
TRACE level logging is expensive enough to warrant removal. They were
useful during development but are now just overhead.

Also we unnecessarily create new compressor and decompressor instances
in the reset() methods for the Aircompressor and Lz4 codecs. Remove.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-05-13 18:31:01 -07:00
Rushabh Shah
4ba62c82f8 HBASE-26905 ReplicationPeerManager#checkPeerExists should throw ReplicationPeerNotFoundException if peer doesn't exists (#4422) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-13 18:25:23 -07:00
Tak Lon (Stephen) Wu
603f3f5d0c HBASE-27013 Introduce read all bytes when using pread for prefetch (#4414) 
- introduce optional flag `hfile.pread.all.bytes.enabled` for pread that must read full bytes with the next block header

Signed-off-by: Josh Elser <elserj@apache.org>
 2022-05-13 13:30:39 -07:00
Duo Zhang
3ed733e865 HBASE-26999 Addendum fix spotless errors 2022-05-13 10:01:05 +08:00
Wellington Chevreuil
d55c90ee87 HBASE-27021 StoreFileInfo should set its initialPath in a consistent way 
(Amending spotless errors after revert by Duo)
 2022-05-12 11:12:06 +01:00