Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,499 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

18499 Commits

Author SHA1 Message Date
liuzhuang2017 19f67d22d4 HBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. (#4481) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 12a9e6e5ec)
 2022-06-06 13:42:08 +08:00
BukrosSzabolcs 8139cf6477 HBASE-27017: MOB snapshot is broken when FileBased SFT is used (#4466) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-06-06 00:29:27 +01:00
huaxiangsun 5a13ad8137
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() (#4442) (#4484) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-06-03 15:27:00 -07:00
skysiders 0c5d6601da
HBASE-26985 check permission for SecureBulkLoadManager (#4379) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-06-02 15:30:12 -07:00
Duo Zhang 2625c67e73 HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing (#4449) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 313a37f7ac)
 2022-06-03 00:11:10 +08:00
Xiaolin Ha 8bf5256c24 HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) (#4405) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 80f410ec3f)
 2022-06-03 00:08:45 +08:00
LiangJun He a93b7cd654 HBASE-27039 Some methods of MasterRegion should be annotated for testing only (#4433) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 15002fccb4)
 2022-06-02 21:39:13 +08:00
Duo Zhang b5dcb7d3a1 HBASE-27023 Fix license issues after running spotless:apply (#4458) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e555ac4a99)
 2022-06-02 20:24:08 +08:00
Andrew Purtell d2d3d64c6c Amend HBASE-27082 spotless:apply 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-06-01 10:49:35 -07:00
Duo Zhang 267e9fa48a HBASE-27082 Change the return value of RSGroupInfo.getServers from SortedSet to Set to keep compatibility (#4480) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfo.java
	hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestRSGroupsAdmin2.java
	hbase-rsgroup/src/test/java/org/apache/hadoop/hbase/rsgroup/TestUpdateRSGroupConfiguration.java
 2022-06-01 09:30:17 -07:00
Andrew Purtell b7158a87ea Preparing development version 2.5.1-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-31 20:06:32 -07:00
Andrew Purtell 2da2dd917f Preparing hbase release 2.5.0RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-31 20:06:29 -07:00
Andrew Purtell 4d6636dfea HBASE-27081 Fix disallowed compatibility breaks on branch-2.5 and branch-2 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-31 19:53:58 -07:00
Duo Zhang 0af4b5f1b0 HBASE-26063 The current checkcompatibility.py script can not compare master and rel/2.0.0 (#3457) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2022-05-31 18:27:09 -07:00
Andrew Purtell 2f63d99c48 HBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE (#4476) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-31 12:43:45 -07:00
litao f0dcbe78a7 HBASE-27068 NPE occurs when the active master has not yet been elected (#4474) 
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
 2022-05-31 11:50:36 -07:00
Andrew Purtell 2a59ebffaa HBASE-27064 CME in TestRegionNormalizerWorkQueue (#4468) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-31 11:33:43 -07:00
Istvan Toth 7f7c42e33e HBASE-27069 Hbase SecureBulkload permission regression (#4475) 
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-05-31 10:10:28 +01:00
litao 8b9df125a3 HBASE-27066 The Region Visualizer display failed (#4472) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-29 11:56:39 -07:00
Andrew Purtell e172b983ca HBASE-27065 [branch-2] Build against Hadoop 3.3.3 (#4471) 
When building against Hadoop 3.3.3 and any future version of Hadoop
incorporating reload4j the new Enforcer rule we have active in
branch-2.5 and up to exclude other logging frameworks besides log4j2
will trigger. We need to add exclusions to prevent that from
happening so the build will succeed.

Also exclude leveldbjni-all to avoid a LICENSE file generation error.

Add netty-all to hadoop-hdfs test context... to fix tests failing
trying to init minidfscluster.

Co-authored-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2022-05-27 14:04:35 -07:00
Andrew Purtell 1813fc8bf4 HBASE-26854 Shell startup logs a bunch of noise (#4469) 
Upon startup the shell logs a bunch of noise, mainly from zookeeper.
Also hide WARN level logging from the Hadoop libraries

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-27 14:01:19 -07:00
Sergey Soldatov c9fc396dfa HBASE-27061 two phase bulkload is broken when SFT is in use. (#4465) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2022-05-26 13:55:31 +01:00
Tak Lon (Stephen) Wu 20aaa1e961 HBASE-27055 Add additional comments when using HBASE_TRACE_OPTS with standalone mode (#4452) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2022-05-24 09:30:58 -07:00
Xiaolin Ha e1843af1d5 HBASE-26342 Support custom paths of independent configuration and pool for hfile cleaner (#4403) (#4461) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-24 15:52:54 +08:00
Xiaolin Ha 4be25a3a61 HBASE-26320 Implement a separate thread pool for the LogCleaner (#3712) (#4460) 
This avoids starvation when the archive directory is large and takes a long time
to iterate through.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
 2022-05-24 14:34:47 +08:00
Duo Zhang 2294834a04 HBASE-26933 Addendum remove unused resources and links on site 
(cherry picked from commit 4260e3afb7)
 2022-05-22 16:33:09 +08:00
Duo Zhang 0f0f2d1015 HBASE-26933 Remove all ref guide stuff on branch other than master (#4426) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 778ae2d655)

 Conflicts:
	src/main/asciidoc/_chapters/configuration.adoc
	src/main/asciidoc/book.adoc
 2022-05-22 15:16:03 +08:00
Junegunn Choi 84a79dfbd4 HBASE-27030 Fix undefined local variable error in draining_servers.rb (#4427) 
HBASE-21812 replaced a for-loop with an each block.
Each block introduces a new scope, so a local variable defined inside it
cannot be accessed afterwards.

  NameError: undefined local variable or method `admin' for main:Object
    getServerNames at /opt/khp/hbase/bin/draining_servers.rb:81
        addServers at /opt/khp/hbase/bin/draining_servers.rb:88
            <main> at /opt/khp/hbase/bin/draining_servers.rb:146

This commit defines the admin local variable in the current scope beforehand,
so that we can still access it after the block.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2b573ae377)
 2022-05-22 15:07:28 +08:00
litao cdf6076801 HBASE-27047 Fix typo for metric drainingRegionServers (#4441) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 63fe279b45)
 2022-05-22 15:03:22 +08:00
bitterfox b83e03abc2 HBASE-27027 Use jetty SslContextFactory.Server instead of deprecated SslContextFactory (#4425) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 1be2c83b3d)
 2022-05-22 11:36:05 +08:00
d-c-manning 188dfeec5f HBASE-27054 TestStochasticLoadBalancerRegionReplicaLargeCluster.testRegionReplicasOnLargeCluster is flaky (#4454) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancerRegionReplicaLargeCluster.java
 2022-05-21 09:24:42 -07:00
Xiaolin Ha f81bb8b6ec HBASE-27043 Let lock wait timeout to improve performance of SnapshotHFileCleaner (#4437) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-20 15:34:21 -07:00
Nick Dimiduk 8bbba7353e
HBASE-27052 TestAsyncTableScanner.testScanWrongColumnFamily is flaky (#4456) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-20 15:14:15 -07:00
Andrew Purtell f982e6d39c HBASE-27051 TestReplicationSource.testReplicationSourceInitializingMetric is flaky (#4448) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-20 15:11:23 -07:00
Andrew Purtell bad3f20a80 HBASE-27050 Support unit test pattern matching again (#4447) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-20 15:09:05 -07:00
litao 96182e2cf9
HBASE-27018 Add a tool command list_liveservers (#4416) 
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2022-05-19 15:49:36 -07:00
Sean Busbey 8487e8d2cf HBASE-27006 Move nightly integration testing to new larger test node class. (#4438) 
(cherry picked from commit 76d20fc48a)
 2022-05-19 11:48:41 -05:00
Duo Zhang 6774487750 HBASE-27024 The User API and Developer API links are broken on hbase.apache.org (#4424) 
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit ba7ef0216a)
 2022-05-18 21:17:23 +08:00
Duo Zhang 9f5ef981f9 HBASE-27045 Disable TestClusterScopeQuotaThrottle (#4440) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 487cf301a4)
 2022-05-18 20:51:37 +08:00
Nick Dimiduk c47a2c3841 HBASE-26986 Trace a one-shot execution of a Master procedure 
This one adds a tracing context to the Master's ProcedureV2 execution. This ties all the spans
that result from a procedure execution back to a procedure by name. Maybe in a follow-on issue, we
can serialize span context along with procedures and display procedure start/stop/retry events and
parent-child hierarchy in tracing visualization.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-05-18 13:08:42 +02:00
Nick Dimiduk 6bf8db8ec8 Revert "HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (#4394)" 
This reverts commit 04956ffe7e.
 2022-05-18 13:05:09 +02:00
Mohammad Arshad 04956ffe7e HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (#4394) 
Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of ByteBuffer's underlying array instead of original ByteBuffer

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit c198f23e5e)
 2022-05-17 10:59:59 +05:30
litao c4d7d55958 HBASE-27032 The draining region servers metric description is incorrect (#4428) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit ed1665355a)
 2022-05-17 10:44:40 +05:30
Andrew Purtell 2e4d9a2adf HBASE-27019 Minor compression performance improvements (#4420) 
TRACE level logging is expensive enough to warrant removal. They were
useful during development but are now just overhead.

Also we unnecessarily create new compressor and decompressor instances
in the reset() methods for the Aircompressor and Lz4 codecs. Remove.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2022-05-13 18:31:01 -07:00
Rushabh Shah 4ba62c82f8 HBASE-26905 ReplicationPeerManager#checkPeerExists should throw ReplicationPeerNotFoundException if peer doesn't exists (#4422) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-05-13 18:25:23 -07:00
Tak Lon (Stephen) Wu 603f3f5d0c HBASE-27013 Introduce read all bytes when using pread for prefetch (#4414) 
- introduce optional flag `hfile.pread.all.bytes.enabled` for pread that must read full bytes with the next block header

Signed-off-by: Josh Elser <elserj@apache.org>
 2022-05-13 13:30:39 -07:00
Duo Zhang 3ed733e865 HBASE-26999 Addendum fix spotless errors 2022-05-13 10:01:05 +08:00
Wellington Chevreuil d55c90ee87 HBASE-27021 StoreFileInfo should set its initialPath in a consistent way 
(Amending spotless errors after revert by Duo)
 2022-05-12 11:12:06 +01:00
Duo Zhang 28f848a35e Revert "HBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419)" 
Revert due to failure spotless:check

This reverts commit aa31b0f695.
 2022-05-12 11:11:55 +01:00
Wellington Ramos Chevreuil ea37b782e1 HBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419) 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-05-12 11:11:42 +01:00