Commit Graph

19461 Commits

Author SHA1 Message Date
Nick Dimiduk ad64a9baae HBASE-26986 Trace a one-shot execution of a Master procedure
This one adds a tracing context to the Master's ProcedureV2 execution. This ties all the spans
that result from a procedure execution back to a procedure by name. Maybe in a follow-on issue, we
can serialize span context along with procedures and display procedure start/stop/retry events and
parent-child hierarchy in tracing visualization.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-05-16 11:39:21 +02:00
Andrew Purtell 369adcdf35
HBASE-27019 Minor compression performance improvements (#4420)
TRACE level logging is expensive enough to warrant removal. They were
useful during development but are now just overhead.

Also we unnecessarily create new compressor and decompressor instances
in the reset() methods for the Aircompressor and Lz4 codecs. Remove.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-05-13 18:29:10 -07:00
Rushabh Shah 27ced7074a
HBASE-26905 ReplicationPeerManager#checkPeerExists should throw ReplicationPeerNotFoundException if peer doesn't exists (#4422)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-13 18:24:19 -07:00
Tak Lon (Stephen) Wu 0eb1a4e5ed
HBASE-27013 Introduce read all bytes when using pread for prefetch (#4414)
- introduce optional flag `hfile.pread.all.bytes.enabled` for pread that must read full bytes with the next block header
2022-05-13 12:16:35 -07:00
Duo Zhang ba7ef0216a
HBASE-27024 The User API and Developer API links are broken on hbase.apache.org (#4424)
Signed-off-by: Sean Busbey <busbey@apache.org>
2022-05-13 15:05:37 +08:00
Wellington Chevreuil 3fbf66729d HBASE-27021 StoreFileInfo should set its initialPath in a consistent way
(Amending spotless errors after revert by Duo)
2022-05-12 10:34:29 +01:00
Duo Zhang 141b827f47 Revert "HBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419)"
Revert due to failure spotless:check

This reverts commit aa31b0f695.
2022-05-12 16:42:30 +08:00
Wellington Ramos Chevreuil aa31b0f695
HBASE-27021 StoreFileInfo should set its initialPath in a consistent way (#4419)
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-05-12 09:36:46 +01:00
litao a712f9fa34
HBASE-27020 Fix spotless warn for master branch (#4417)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed by: Rushabh Shah <shahrs87@gmail.com>
2022-05-11 14:36:37 +08:00
litao c269dc5711
HBASE-27003 Optimize log format for PerformanceEvaluation (#4411)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-10 22:31:44 -07:00
Wellington Ramos Chevreuil f6e9d3e1dd
HBASE-26999 HStore should try write WAL compaction marker before repl… (#4407)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-09 10:24:47 +01:00
litao e8b44d948c
HBASE-27015. Fix log format for ServerManager (#4415)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-08 13:33:17 -07:00
skysiders 5d6c0a9ca5
HBASE-26994 MasterFileSystem create directory without permission check (#4391)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-08 13:26:53 -07:00
Andrew Purtell 0a12926f1d
HBASE-26330 Document new provided compression codecs (#4396)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Viraj Jasani<virajjasani@apache.org
2022-05-07 11:25:43 -07:00
Andrew Purtell 73ee1b3abc HBASE-27014 Update downloads.xml for release 2.4.12
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-07 11:16:51 -07:00
Rushabh Shah 2d1e3c9268
HBASE-26963 ReplicationSource#removePeer hangs if we try to remove bad peer. (#4361)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-05-07 10:37:05 -07:00
litao e9046a64f4
HBASE-27000 Block cache stats (Misses Caching) display error in RS web UI (#4406)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-05 23:32:28 -07:00
huaxiangsun 597098ebba
HBASE-26984 Chaos Monkey thread dies in ITBLL Chaos GracefulRollingRestartRsAction (#4383)
There are two cases here:
  1. Chaos Monkey thread died and there is no chaos after that.
  2. Sometimes, regions are being moved back too quick that region server has not finished its initliazation yet.
     wait sometime to make sure that region server finishes its initialization.

Signed-off-by:  Wellington Chevreuil <wellington.chevreuil@gmail.com>
2022-05-05 09:37:41 -05:00
Duo Zhang 9e03253447 HBASE-26995 Remove ref guide check in pre commit and nightly for branches other than master (#4399)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit 9a41117ca5)
2022-05-05 18:39:34 +08:00
Duo Zhang 5cb0ecfd17
HBASE-26931 Add the information of EOL releases to our ref guide on master branch (#4388)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2022-05-05 18:26:26 +08:00
Bryan Beaudreault 64a6ba3647
HBASE-26990 Add default implementation for BufferedMutator interface setters (#4387)
Signed-off-by: Josh Elser <elserj@apache.org>
2022-05-03 14:57:49 -04:00
Duo Zhang 386869a428
HBASE-26892 Add spotless:check in our pre commit general check (#4393)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-05-03 21:14:24 +08:00
Nick Dimiduk 404e1d6870 HBASE-26648 Improve fidelity of RegionLocator spans (addendum)
Addendum extends the test case to cover both `RpcConnectionRegistry` and `ZKConnectionRegistry`.
2022-05-03 14:00:53 +02:00
d-c-manning da55154056
HBASE-26989 TestStochasticLoadBalancer fixes for performance and consistency (#4385)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Reviewed by: Rushabh Shah <shahrs87@gmail.com>
2022-05-02 10:33:13 -07:00
Duo Zhang 9c8c9e7fbf HBASE-26899 Run spotless:apply
Closes #4312
2022-05-01 22:15:09 +08:00
Duo Zhang 0edecbf9e0 HBASE-26899 tweak pom and formatter
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-05-01 21:26:40 +08:00
Andrew Purtell 152ecad53a
HBASE-26992 Brotli compressor has unexpected behavior during reinitialization (#4389)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-30 09:11:33 -07:00
chenglei f5a566ea1b
HBASE-26960 Another case for unnecessary replication suspending in Re… (#4355) 2022-04-30 11:37:02 +08:00
LiangJun He b0c2832b6e
HBASE-26976 Update related comments after HMaster can load the live RS infos from local region (#4375)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Yu Li <liyu@apache.org>
2022-04-30 10:53:13 +08:00
Bryan Beaudreault da37896588
HBASE-26886 Add unit test for custom RpcControllerFactory ability to overwrite priorities (#4277)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-29 19:01:08 -07:00
d-c-manning 4a33ed1c61
HBASE-26988 dynamic configuration of loadbalance.bytable (#4384)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-04-29 14:23:32 -07:00
Nick Dimiduk ebfac2164a HBASE-26648 Improve fidelity of RegionLocator spans
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-29 10:53:06 +02:00
LiangJun He 7d5bf1c4f2 HBASE-26943 HMaster page style display confusion (#4369)
Signed-off-by: Yu Li <liyu@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-04-29 15:56:42 +08:00
LiangJun He 23971b2861 Revert "HBASE-26943 HMaster page style display confusion" and "HBASE-26943 Formatting bootstrap.min.css" (#4369)
This reverts commits 242a194b3c and d0318732b7.

Signed-off-by: Yu Li <liyu@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-04-29 15:56:21 +08:00
Duo Zhang f4eb9071fd
HBASE-26917 Do not add --threads when running 'mvn site' (#4354)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-04-29 08:05:00 +08:00
d-c-manning f848c61e3d
HBASE-22349 slop in StochasticLoadBalancer (#4371)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-04-28 12:28:15 -07:00
xicm ec78c2677b
HBASE-25694 Improve the shell's 'status replication' command output (#4272)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-28 23:10:46 +08:00
liangxs cdf81ea5cc
HBASE-26975 Add on heap and off heap memstore info in rs web UI (#4368)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-28 23:08:53 +08:00
liangxs c02e7553d4
HBASE-26980 Update javadoc of BucketCache.java (#4374)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-28 23:08:40 +08:00
liangxs bf93df0870
HBASE-26978 Update inmemory_compaction.adoc (#4372)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-28 23:01:40 +08:00
Andrew Purtell 90d42f2733
HBASE-26979 StoreFileListFile logs frequent stacktraces at INFO level (#4373)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-27 18:02:00 -07:00
Bri Augenreich ee0c921258
HBASE-26581 Add metrics for failed replication edits (#4347)
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-04-26 17:42:54 -04:00
LiangJun He ba713ac379 HBASE-26951 HMaster should exit gracefully, when stopped via hbase-daemon.sh (#4358)
Signed-off-by: Yu Li <liyu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-04-27 00:21:57 +08:00
Wellington Ramos Chevreuil af13c6d4c6
HBASE-26971 SnapshotInfo --snapshot param is marked as required even when trying to list all snapshots (#4366)
Signed-off-by: Josh Elser <elserj@apache.org>
2022-04-25 12:30:07 +01:00
Andrew Purtell f5b10e0115
HBASE-26959 Brotli compression support (#4353)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-04-22 16:42:12 -07:00
Bryan Beaudreault 9a88092817
HBASE-26891 Make MetricsConnection scope configurable (#4285)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-04-22 09:07:47 -04:00
Ruanhui f2f2a89592
HBASE-26942 cache region locations when getAllRegionLocations (#4335)
HBASE-26942 cache region locations when getAllRegionLocations

Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-04-22 07:48:27 -04:00
liangxs 41ae90d63f
HBASE-26964: Fix MobCompactPartitionPolicy import in admin.rb (#4362)
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2022-04-21 23:12:47 +05:30
Duo Zhang 82e47cde27
HBASE-25058 Export necessary modules when running under JDK11 (#4337)
Singed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-04-21 23:49:27 +08:00
Duo Zhang 13d932cba3
HBASE-26947 Implement a special TestAppender to limit the size of test output (#4340)
Singed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2022-04-21 23:00:19 +08:00