18715 Commits

Author SHA1 Message Date
chenglei
10309c637e
HBASE-27539 Encapsulate and centralise access to ref count through StoreFileInfo (#4938)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-12-24 19:28:09 +08:00
Duo Zhang
cdc48fca41 HBASE-27514 Move some persistent states from zookeeper to master region (#4925)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit dcfde79f7e51f7141d8c10116bffcaeda85d1c73)
2022-12-22 12:48:21 +08:00
Bryan Beaudreault
edc2cbd18a HBASE-27233 Read blocks into off-heap if caching is disabled for read (#4931)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-12-21 12:34:56 -05:00
Victor
b63e4b73e5 HBASE-27540 add client side counter metrics for failed rpc calls (#4929)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-12-21 08:51:02 -05:00
Wellington Chevreuil
d10a44fde2 HBASE-27474 Addendum: fix spotless issues introduced by conflicts resolution 2022-12-21 11:45:28 +00:00
Wellington Ramos Chevreuil
012306b62d HBASE-27474 Evict blocks on split/merge; Avoid caching reference/hlinks if compaction is enabled (#4868)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit 222ec684d68de25d20dac3be2614863c1c4cbd20)
2022-12-19 12:05:06 +00:00
Ray Mattingly
bc58d6d861 HBASE-27253 make slowlog configurations dynamic (#4926)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-12-15 17:54:11 -05:00
Bri Augenreich
c802f9d047 HBASE-27390 getClusterMetrics NullPointerException when ServerTask status null (#4853)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-12-15 11:58:42 -05:00
LYCJeff
1e53a34271 HBASE-27530 Fix comment syntax errors (#4910)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f9518cc1a13becb669a3ca5c257850c4fcea989c)
2022-12-14 23:26:49 +08:00
Duo Zhang
65bf98c6eb HBASE-27524 Fix python requirements problem (#4918)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
(cherry picked from commit 8b4e134f8cf71c1b6155839439e7c1d995573c5a)
2022-12-14 00:19:21 +08:00
Duo Zhang
f32733dfbe HBASE-27459 Improve our hbase_docker to be able to build and start standalone clusters other than master branch (#4861)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
(cherry picked from commit d78d40404c1f8fb2327e14f4dee3f7fef4483fff)
2022-12-14 00:18:35 +08:00
Vaibhav Joshi
2e94f6fb50
HBASE-27527 Port HBASE-27498 to branch-2 (#4919)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2022-12-12 11:01:09 -08:00
Luca Kovács
98d66828bd HBASE-27435 Make Prometheus metrics queryable (#4879)
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
2022-12-12 12:00:06 +01:00
Duo Zhang
ed53549104 HBASE-27513 Modify README.txt to mention how to contribue (#4913)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Zheng Hu <openinx@gmail.com>
(cherry picked from commit 4d70f94ffe2c7ba59a269c16a6464c98ca10d978)
2022-12-10 23:27:44 +08:00
chenglei
c2084564a2
HBASE-27519 Another case for FNFE on StoreFileScanner after a flush followed by a compaction (#4921)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-12-10 11:00:53 +08:00
Bri Augenreich
d87ab898bf
HBASE-27491: do not clear cache on RejectedExecutionException (#4914)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-12-09 08:45:40 -05:00
Shanky Sharma
66ddfb414e HBASE-22924 GitHUB PR job should use when clause to filter to just PRs (#4915)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e1ad781dd9ddc201123a63122e22496ee7f8a4b0)
2022-12-08 21:19:33 +08:00
Bryan Beaudreault
f320ad9354
HBASE-27490 Locating regions for all actions of batch requests can exceed operation timeout (#4908)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-12-06 08:03:23 -05:00
Victor
8c4f0e3fd1
HBASE-27466: Making metrics instance containing one or more connections. (#4874) (#4909)
Signed-off-by: David Manning <67607031+d-c-manning@users.noreply.github.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-12-05 12:24:15 -08:00
Bri Augenreich
7b4b4ce81e
HBASE-27487: Slow meta can create pathological feedback loop with multigets (#4900)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-12-01 08:13:47 -05:00
cxzl25
3040cc764b
HBASE-27512 Add file .git-blame-ignore-revs (#4907)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-12-01 20:13:49 +08:00
Bri Augenreich
53b4b4e941
HBASE-27494: Fix missing meta cache dropping exception metrics (#4902)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-11-30 13:03:19 -05:00
Duo Zhang
4d29ef8bb4 HBASE-27510 Should use 'org.apache.hbase.thirdparty.io.netty.tryReflectionSetAccessible' (#4898)
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 3ffc0b55528c232c4e2fc0c67bc78a564591efb9)
2022-11-29 20:46:46 +08:00
mrzhao
92265d39e5 HBASE-27503 Support replace <FILE-PATH> in GC_OPTS for ZGC (#4892)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7fc4d9938436052b40bd899f463f5743beff09f2)
2022-11-29 00:02:57 +08:00
Andor Molnár
e90a351d0d
HBASE-27347 Port FileWatcher from ZK to autodetect keystore/truststore changes in TLS connections (branch-2) (#4897)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-11-28 08:06:29 -05:00
Ruanhui
983eb0c0be HBASE-27463 Reset sizeOfLogQueue when refresh replication source (#4863)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Rushabh Shah <shahrs87@gmail.com>
(cherry picked from commit bb9f43c6f9079b196e7a9d5a5eb35e721b092052)
2022-11-27 23:42:53 +08:00
Wellington Ramos Chevreuil
8a76451a9b HBASE-27484 FNFE on StoreFileScanner after a flush followed by a compaction (#4882)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-11-25 22:00:01 +00:00
Peter Somogyi
59f92a8f60 HBASE-27506 Optionally disable sorting directories by size in CleanerChore (#4896)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 1ddb5bb43cfe4f543710a84884a5df20d02ff0a8)
2022-11-25 15:32:54 +01:00
Duo Zhang
82cbf6b88d HBASE-27501 The .flattened-pom.xml for some modules are not installed (#4893)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
(cherry picked from commit 84749b054c5697cb0f3240fa3c0f976cf5df865d)
2022-11-23 20:56:37 +08:00
Ruanhui
c56197248e HBASE-27445 fix the result of DirectMemoryUtils#getDirectMemorySize (#4846)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2f4758ee592959ee5ddd646a6769bb81a781d610)
2022-11-23 20:47:52 +08:00
mokai
838638fdab HBASE-27504 Remove duplicated config 'hbase.normalizer.merge.min_region_age.days' in hbase-default.xml (#4894)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c691091f780150d41f6205666b6c221618567ee6)
2022-11-23 20:43:42 +08:00
LiangJun He
8c2f4b2aaa
HBASE-27444 Add tool commands list_enabled_tables and list_disabled_tables (#4880)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-23 10:29:37 +08:00
Charles Connell
5976684168 HBASE-27496 Optionally limit the amount of plans executed in the Normalizer (#4888)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-11-22 13:08:43 -05:00
Bryan Beaudreault
ad8d38b61f HBASE-27408 Improve BucketAllocatorException log to always include HFile name (#4886)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-11-21 08:22:42 -05:00
Tak Lon (Stephen) Wu
66aedcae02 HBASE-27495 Improve HFileLinkCleaner to validate back reference links ahead the next traverse (#4887)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
2022-11-20 14:52:12 -08:00
chenglei
daa39a46ab HBASE-27464 In memory compaction 'COMPACT' may cause data corruption when adding cells large than maxAlloc(default 256k) size (#4881)
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7b0ac6451d6ca51c310c41a194628f90e3815c17)
2022-11-17 23:21:38 +08:00
YiweiLi4
309ed58f07 HBASE-27479 fix flaky test testClone in TestTaskMonitor (#4876)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a2075f51a84676c4fac7eb697a21255abddf143a)
2022-11-17 21:37:00 +08:00
Duo Zhang
8b2c7b1b49 HBASE-27423 Upgrade hbase-thirdparty to 4.1.3 and upgrade Jackson for CVE-2022-42003/42004 (#4878)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 07a3ffdd97f22b7c1cf4dbfe23a029bec2b28336)
2022-11-17 21:35:13 +08:00
mrzhao
43b1c9722b HBASE-27379 fix numOpenConnections metric is one less than the actual (#4884)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d7c4447dd2c14bec591597a74f043b36f35bd6a3)
2022-11-16 16:43:29 +08:00
Bri Augenreich
53e872e5f1
HBASE-26809: Report client backoff time for server overloaded (#4786)
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-11-15 15:41:08 -05:00
Xin Sun
7bba9ae24e HBASE-27469 IllegalArgumentException is thrown by SnapshotScannerHDFSAclController when dropping a table (#4865)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-15 11:59:10 +08:00
SiCheng-Zheng
71826de852
HBASE-27309 Add major compact table or region operation on master web table page (#4870)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-12 21:15:20 +08:00
Duo Zhang
35817bcaf1 HBASE-27480 Skip error prone for hadoop2/3 checkes in our nightly jobs (#4877)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 085325c6961e99ebadb9da3ce014d6216e03b6ea)
2022-11-11 14:42:00 +08:00
Duo Zhang
e007e23625 HBASE-27475 Use different jdks when running hadoopcheck in personality scripts (#4875)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 260cd485db36f8d04b91062012addc632ca29ec9)
2022-11-10 23:20:35 +08:00
Duo Zhang
1588fc0332 HBASE-27472 The personality script set wrong hadoop2 check version for branch-2 (#4866)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 6c32d1a3fb218f3639a6c2037d84624bcf74575a)
2022-11-10 12:58:34 +08:00
Duo Zhang
6446d2064a HBASE-27473 Fix spotbugs warnings in hbase-rest Client.getResponseBody (#4867)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 2d87994f685849219dfde87a111f9f79b6278c17)
2022-11-10 12:57:58 +08:00
Rushabh Shah
ecf3debd42
HBASE-26913 Replication Observability Framework (#4862)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-11-08 13:05:42 -08:00
Duo Zhang
ea4ccf0044 HBASE-27443 Use java11 in the general check of our jenkins job (#4845)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 5c6ff7dc47b5340ff02e0dec144424ab91407e07)
2022-11-08 00:00:56 +08:00
Ruanhui
b8dacbec60 HBASE-27414 Adjust hfilelink alternative paths order (#4847)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
(cherry picked from commit 1bebf8699fd2f03e88dcd37cb9dc7d20bacfa3f2)
2022-11-05 23:03:16 +08:00
Duo Zhang
1eac50af9c HBASE-27460 Fix the hadolint errors after HBASE-27456 (#4860)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit e7d1a6a0525fcadf1cd0294d7a09af432a1af853)
2022-11-03 18:38:32 +08:00