Duo Zhang
313a37f7ac
HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing ( #4449 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-06-02 23:55:23 +08:00
liangxs
d03004060d
HBASE-26962: Add mob info in web UI ( #4359 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-02 23:53:03 +08:00
Xiaolin Ha
80f410ec3f
HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) ( #4405 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-02 23:52:14 +08:00
litao
ac8b51718f
HBASE-27036 Displays the number of decommissioned region server for status command ( #4431 )
...
add decommissionedServers to cluster metric
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org
2022-06-02 23:51:39 +08:00
LiangJun He
15002fccb4
HBASE-27039 Some methods of MasterRegion should be annotated for testing only ( #4433 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-02 21:27:25 +08:00
litao
db992083af
HBASE-27037 Display the region server state on the Web UI ( #4432 )
...
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-02 21:19:45 +08:00
Duo Zhang
e555ac4a99
HBASE-27023 Fix license issues after running spotless:apply ( #4458 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-06-02 20:18:00 +08:00
Duo Zhang
99e4e3ea3e
HBASE-27082 Change the return value of RSGroupInfo.getServers from SortedSet to Set to keep compatibility ( #4480 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-06-01 08:30:52 -07:00
Andrew Purtell
540fe8bbfa
HBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE ( #4476 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 12:43:04 -07:00
Andrew Purtell
f356bf1c91
HBASE-27067 Upgrade pyjwt to version 2.4.0 or later for dev-support/git-jira-release-audit ( #4473 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-05-31 11:52:52 -07:00
litao
d532135a26
HBASE-27068 NPE occurs when the active master has not yet been elected ( #4474 )
...
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
2022-05-31 11:49:49 -07:00
Andrew Purtell
88d9c4bef4
HBASE-27064 CME in TestRegionNormalizerWorkQueue ( #4468 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 11:33:06 -07:00
Istvan Toth
4ce85aa39f
HBASE-27069 Hbase SecureBulkload permission regression ( #4475 )
...
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-05-31 09:52:35 +01:00
litao
5c116d239f
HBASE-27066 The Region Visualizer display failed ( #4472 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-29 11:53:50 -07:00
Andrew Purtell
cf0ed2e1be
HBASE-27065 Build against Hadoop 3.3.3 ( #4467 )
...
When building against Hadoop 3.3.3 and any future version of Hadoop
incorporating reload4j the new Enforcer rule we have active in
branch-2.5 and up to exclude other logging frameworks besides log4j2
will trigger. We need to add exclusions to prevent that from
happening so the build will succeed.
Also exclude leveldbjni-all to avoid a LICENSE file generation error.
Add netty-all to hadoop-hdfs test context... to fix tests failing
trying to init minidfscluster.
Co-authored-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-05-27 14:03:23 -07:00
Andrew Purtell
9fcaf854ed
HBASE-26854 Shell startup logs a bunch of noise ( #4469 )
...
Upon startup the shell logs a bunch of noise, mainly from zookeeper.
Also hide WARN level logging from the Hadoop libraries
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-27 14:00:41 -07:00
Sergey Soldatov
fdf054de2c
HBASE-27061 two phase bulkload is broken when SFT is in use. ( #4465 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-05-26 11:01:21 +01:00
Duo Zhang
286f6c5af4
HBASE-26649 Addendum fix spotless error
2022-05-25 21:28:47 +08:00
Tak Lon (Stephen) Wu
194f8c2c41
HBASE-27055 Add additional comments when using HBASE_TRACE_OPTS with standalone mode ( #4452 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-05-24 09:27:15 -07:00
Xiaolin Ha
bc21967946
HBASE-26342 Support custom paths of independent configuration and pool for hfile cleaner ( #4403 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-24 09:53:48 +08:00
huaxiangsun
623f8affe2
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() ( #4442 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-05-23 08:54:00 -07:00
bitterfox
1be2c83b3d
HBASE-27027 Use jetty SslContextFactory.Server instead of deprecated SslContextFactory ( #4425 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-05-22 11:32:17 +08:00
Junegunn Choi
2b573ae377
HBASE-27030 Fix undefined local variable error in draining_servers.rb ( #4427 )
...
HBASE-21812 replaced a for-loop with an each block.
Each block introduces a new scope, so a local variable defined inside it
cannot be accessed afterwards.
NameError: undefined local variable or method `admin' for main:Object
getServerNames at /opt/khp/hbase/bin/draining_servers.rb:81
addServers at /opt/khp/hbase/bin/draining_servers.rb:88
<main> at /opt/khp/hbase/bin/draining_servers.rb:146
This commit defines the admin local variable in the current scope beforehand,
so that we can still access it after the block.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-05-22 11:31:48 +08:00
litao
63fe279b45
HBASE-27047 Fix typo for metric drainingRegionServers ( #4441 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-05-22 11:28:01 +08:00
d-c-manning
cec35b6e80
HBASE-27054 TestStochasticLoadBalancerRegionReplicaLargeCluster.testRegionReplicasOnLargeCluster is flaky ( #4454 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-21 09:17:04 -07:00
Xiaolin Ha
1aa07d5e6b
HBASE-27043 Let lock wait timeout to improve performance of SnapshotHFileCleaner ( #4437 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-20 15:32:58 -07:00
Nick Dimiduk
bf5f0c7e7f
HBASE-27052 TestAsyncTableScanner.testScanWrongColumnFamily is flaky ( #4451 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-20 15:13:23 -07:00
Andrew Purtell
42a64f2a4d
HBASE-27051 TestReplicationSource.testReplicationSourceInitializingMetric is flaky ( #4448 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-20 15:10:42 -07:00
Andrew Purtell
a0f576cce4
HBASE-27050 Support unit test pattern matching again ( #4447 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-20 15:07:10 -07:00
litao
c7eb30d910
HBASE-27018 Add a tool command list_liveservers ( #4416 )
...
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-19 15:47:16 -07:00
Sean Busbey
76d20fc48a
HBASE-27006 Move nightly integration testing to new larger test node class. ( #4438 )
2022-05-18 14:18:49 -05:00
Duo Zhang
487cf301a4
HBASE-27045 Disable TestClusterScopeQuotaThrottle ( #4440 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-05-18 20:29:06 +08:00
Nick Dimiduk
f5fd353b81
Revert "HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted ( #4394 )"
...
This reverts commit c198f23e5e
.
2022-05-18 13:00:03 +02:00
LiangJun He
b787648847
HBASE-27040 Optimize the log display of the ZKProcedureUtil.java ( #4434 )
...
Signed-off-by: Yu Li <liyu@apache.org>
2022-05-17 15:29:43 +08:00
Mohammad Arshad
c198f23e5e
HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted ( #4394 )
...
Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of ByteBuffer's underlying array instead of original ByteBuffer
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2022-05-17 10:54:38 +05:30
litao
ed1665355a
HBASE-27032 The draining region servers metric description is incorrect ( #4428 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2022-05-17 10:35:35 +05:30
Nick Dimiduk
ad64a9baae
HBASE-26986 Trace a one-shot execution of a Master procedure
...
This one adds a tracing context to the Master's ProcedureV2 execution. This ties all the spans
that result from a procedure execution back to a procedure by name. Maybe in a follow-on issue, we
can serialize span context along with procedures and display procedure start/stop/retry events and
parent-child hierarchy in tracing visualization.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-05-16 11:39:21 +02:00
Andrew Purtell
369adcdf35
HBASE-27019 Minor compression performance improvements ( #4420 )
...
TRACE level logging is expensive enough to warrant removal. They were
useful during development but are now just overhead.
Also we unnecessarily create new compressor and decompressor instances
in the reset() methods for the Aircompressor and Lz4 codecs. Remove.
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-05-13 18:29:10 -07:00
Rushabh Shah
27ced7074a
HBASE-26905 ReplicationPeerManager#checkPeerExists should throw ReplicationPeerNotFoundException if peer doesn't exists ( #4422 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-13 18:24:19 -07:00
Tak Lon (Stephen) Wu
0eb1a4e5ed
HBASE-27013 Introduce read all bytes when using pread for prefetch ( #4414 )
...
- introduce optional flag `hfile.pread.all.bytes.enabled` for pread that must read full bytes with the next block header
2022-05-13 12:16:35 -07:00
Duo Zhang
ba7ef0216a
HBASE-27024 The User API and Developer API links are broken on hbase.apache.org ( #4424 )
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-05-13 15:05:37 +08:00
Wellington Chevreuil
3fbf66729d
HBASE-27021 StoreFileInfo should set its initialPath in a consistent way
...
(Amending spotless errors after revert by Duo)
2022-05-12 10:34:29 +01:00
Duo Zhang
141b827f47
Revert "HBASE-27021 StoreFileInfo should set its initialPath in a consistent way ( #4419 )"
...
Revert due to failure spotless:check
This reverts commit aa31b0f695
.
2022-05-12 16:42:30 +08:00
Wellington Ramos Chevreuil
aa31b0f695
HBASE-27021 StoreFileInfo should set its initialPath in a consistent way ( #4419 )
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-05-12 09:36:46 +01:00
litao
a712f9fa34
HBASE-27020 Fix spotless warn for master branch ( #4417 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed by: Rushabh Shah <shahrs87@gmail.com>
2022-05-11 14:36:37 +08:00
litao
c269dc5711
HBASE-27003 Optimize log format for PerformanceEvaluation ( #4411 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-10 22:31:44 -07:00
Wellington Ramos Chevreuil
f6e9d3e1dd
HBASE-26999 HStore should try write WAL compaction marker before repl… ( #4407 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-09 10:24:47 +01:00
litao
e8b44d948c
HBASE-27015. Fix log format for ServerManager ( #4415 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-08 13:33:17 -07:00
skysiders
5d6c0a9ca5
HBASE-26994 MasterFileSystem create directory without permission check ( #4391 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-08 13:26:53 -07:00
Andrew Purtell
0a12926f1d
HBASE-26330 Document new provided compression codecs ( #4396 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
2022-05-07 11:25:43 -07:00