Commit Graph

18233 Commits

Author SHA1 Message Date
liuzhongjun 56ebf93870 HBASE-27560 fix consistencyCheck did not report the hole on last region (#4950)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c1b9d8ba06)
2023-01-11 18:13:39 +08:00
dependabot[bot] 0382b348cb HBASE-27566 Bump gitpython from 3.1.29 to 3.1.30 in /dev-support (#4957)
Bumps [gitpython](https://github.com/gitpython-developers/GitPython) from 3.1.29 to 3.1.30.
- [Release notes](https://github.com/gitpython-developers/GitPython/releases)
- [Changelog](https://github.com/gitpython-developers/GitPython/blob/main/CHANGES)
- [Commits](https://github.com/gitpython-developers/GitPython/compare/3.1.29...3.1.30)

---
updated-dependencies:
- dependency-name: gitpython
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 991ca9598b)
2023-01-11 11:14:01 +08:00
Peter Somogyi 695dce5bd5
HBASE-27556 Reuse Zookeeper session of Master in LogCleaner (#4946)
Backport of HBASE-23340
hmaster /hbase/replication/rs session expired (hbase replication default value is true, we don't use )
causes logcleaner can not clean oldWALs, which resulits in oldWALs too large (more than 2TB))

Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2023-01-06 20:45:28 +01:00
dependabot[bot] 9cae2bb70e HBASE-27548 Bump jettison from 1.5.1 to 1.5.2 (#4943)
Bumps [jettison](https://github.com/jettison-json/jettison) from 1.5.1 to 1.5.2.
- [Release notes](https://github.com/jettison-json/jettison/releases)
- [Commits](https://github.com/jettison-json/jettison/compare/jettison-1.5.1...jettison-1.5.2)

---
updated-dependencies:
- dependency-name: org.codehaus.jettison:jettison
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bfc9fc9605)
2023-01-03 14:18:30 +08:00
Victor 7f7fe55943 HBASE-27540 add client side counter metrics for failed rpc calls (#4929)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-12-21 09:01:55 -05:00
LYCJeff 9164ed4815 HBASE-27530 Fix comment syntax errors (#4910)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f9518cc1a1)
2022-12-14 23:27:12 +08:00
Duo Zhang 7a80b01e8e HBASE-27524 Fix python requirements problem (#4918)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
(cherry picked from commit 8b4e134f8c)
2022-12-14 00:20:14 +08:00
Duo Zhang fc03580e4a HBASE-27459 Improve our hbase_docker to be able to build and start standalone clusters other than master branch (#4861)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
(cherry picked from commit d78d40404c)
2022-12-14 00:20:05 +08:00
Duo Zhang 5f9e0d0fca HBASE-27513 Modify README.txt to mention how to contribue (#4913)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Zheng Hu <openinx@gmail.com>
(cherry picked from commit 4d70f94ffe)
2022-12-10 23:28:04 +08:00
chenglei bc45f1584e
HBASE-27519 Another case for FNFE on StoreFileScanner after a flush followed by a compaction (#4923)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-12-10 12:41:05 +08:00
Vaibhav Joshi ccd1d8a293 HBASE-27498: Added logic in ConnectionImplementation.getKeepAliveMasterService to avoid expensive rpc calls in synchronized block (#4889)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2022-12-09 08:35:58 -08:00
Bri Augenreich f1bfda1aa3 HBASE-27491 Do not clear cache on RejectedExecutionException (#4914)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-12-09 08:59:45 -05:00
Shanky Sharma cc86844b8a HBASE-22924 GitHUB PR job should use when clause to filter to just PRs (#4915)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e1ad781dd9)
2022-12-08 21:19:56 +08:00
Bryan Beaudreault 4814438cdf HBASE-27487 Addendum remove unused imports 2022-12-02 08:04:10 -05:00
Bri Augenreich fea54b6afa HBASE-27487: Slow meta can create pathological feedback loop with multigets (#4900)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-12-01 08:32:03 -05:00
cxzl25 5bb47ca0fb
HBASE-27512 Add file .git-blame-ignore-revs (#4906)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-12-01 20:15:36 +08:00
Bri Augenreich 751b6b9b68 HBASE-27494: Fix missing meta cache dropping exception metrics (#4902)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-11-30 13:06:16 -05:00
Wellington Ramos Chevreuil 6e562bb84b HBASE-27484 FNFE on StoreFileScanner after a flush followed by a compaction (#4882)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-11-29 11:54:58 +00:00
mrzhao 48c8bcf179 HBASE-27503 Support replace <FILE-PATH> in GC_OPTS for ZGC (#4892)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7fc4d99384)
2022-11-29 00:03:27 +08:00
Peter Somogyi f0c857a784
HBASE-26320 Implement a separate thread pool for the LogCleaner (#4895)
This avoids starvation when the archive directory is large and takes a long time
to iterate through.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
Co-authored-by: Xiaolin Ha <haxiaolin@apache.org>
2022-11-27 19:14:44 +01:00
Ruanhui 5ce1d8f9bd HBASE-27463 Reset sizeOfLogQueue when refresh replication source (#4863)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Rushabh Shah <shahrs87@gmail.com>
(cherry picked from commit bb9f43c6f9)
2022-11-27 23:50:05 +08:00
Peter Somogyi 0a37292113 HBASE-27506 Optionally disable sorting directories by size in CleanerChore (#4896)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit b68dcf46e9)
2022-11-25 15:54:52 +01:00
Ruanhui a3ac3c581d HBASE-27445 fix the result of DirectMemoryUtils#getDirectMemorySize (#4846)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2f4758ee59)
2022-11-23 20:48:15 +08:00
mokai 1c9f6c5ccd HBASE-27504 Remove duplicated config 'hbase.normalizer.merge.min_region_age.days' in hbase-default.xml (#4894)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c691091f78)
2022-11-23 20:44:02 +08:00
chenglei acc4d13e7f HBASE-27464 In memory compaction 'COMPACT' may cause data corruption when adding cells large than maxAlloc(default 256k) size (#4881)
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7b0ac6451d)
2022-11-17 23:21:59 +08:00
YiweiLi4 fd92057f22 HBASE-27479 fix flaky test testClone in TestTaskMonitor (#4876)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a2075f51a8)
2022-11-17 21:39:31 +08:00
Duo Zhang d1ac1d57c9 HBASE-27423 Upgrade hbase-thirdparty to 4.1.3 and upgrade Jackson for CVE-2022-42003/42004 (#4878)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 07a3ffdd97)
2022-11-17 21:36:41 +08:00
mrzhao 843cc5f952 HBASE-27379 fix numOpenConnections metric is one less than the actual (#4884)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d7c4447dd2)
2022-11-16 16:43:45 +08:00
Peter Somogyi ba53872fb1
HBASE-27001 The deleted variable cannot be printed out (#4883)
* The deleted variable cannot be printed out, add it

Co-authored-by: selina.yan <selina.yan@huolala.cn>

Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit b8558d30d0)
2022-11-15 17:22:37 +01:00
Xin Sun f7b2efc7b7 HBASE-27469 IllegalArgumentException is thrown by SnapshotScannerHDFSAclController when dropping a table (#4865)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-15 13:00:57 +08:00
Duo Zhang 0ff4402ead HBASE-27480 Skip error prone for hadoop2/3 checkes in our nightly jobs (#4877)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 085325c696)
2022-11-11 14:42:16 +08:00
Duo Zhang 1fb7c3b39c HBASE-27475 Use different jdks when running hadoopcheck in personality scripts (#4875)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 260cd485db)
2022-11-10 23:20:50 +08:00
Duo Zhang 32c8dd3c04 HBASE-27472 The personality script set wrong hadoop2 check version for branch-2 (#4866)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 6c32d1a3fb)
2022-11-10 12:58:58 +08:00
Duo Zhang aa8ca7e1b9 HBASE-27473 Fix spotbugs warnings in hbase-rest Client.getResponseBody (#4867)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 2d87994f68)
2022-11-10 12:58:15 +08:00
Duo Zhang 4605c323cc HBASE-27443 Use java11 in the general check of our jenkins job (#4845)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 5c6ff7dc47)
2022-11-08 00:20:33 +08:00
Ruanhui 5f55ff7578 HBASE-27414 Adjust hfilelink alternative paths order (#4847)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
(cherry picked from commit 1bebf8699f)
2022-11-05 23:03:34 +08:00
Duo Zhang b5489fae51 HBASE-27460 Fix the hadolint errors after HBASE-27456 (#4860)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit e7d1a6a052)
2022-11-03 18:39:32 +08:00
Duo Zhang 9a110f5087 HBASE-27456 Upgrade the dockerfile used in nightly and pre commit to ubuntu 22.04 (#4857)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 3f17745f6e)
2022-11-01 11:36:39 +08:00
Duo Zhang a6a5f03e5b HBASE-27437 TestHeapSize is flaky (#4841)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit dad9a7da92)

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/io/TestHeapSize.java
2022-10-28 23:22:56 +08:00
Duo Zhang 73169be87c HBASE-27450 Update all our python scripts to use python3 (#4851)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit cdabfd3ca8)
2022-10-28 19:00:57 +08:00
Duo Zhang 4fdd2392be HBASE-27446 Spotbugs 4.7.2 report a lot of logging errors when generating report (#4848)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit d80053641d)
2022-10-28 18:44:15 +08:00
Duo Zhang a8d9726091 HBASE-25983 javadoc generation fails on openjdk-11.0.11+9 (#4837)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 792f12b616)
2022-10-25 22:59:57 +08:00
tianliuliu 098e59863b HBASE-27440 fix table HistogramMetrics leak in table metrics map (#4838)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d187f6908e)
2022-10-24 18:56:49 +08:00
Duo Zhang 1c2813bc0e
HBASE-27441 Use jdk 11.0.16 instead of 11.0.16.1 for branch-2.4 (#4843)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2022-10-24 12:30:58 +08:00
Sean Busbey 053a0da962 HBASE-27425 run flaky test job once an hour. (#4828)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c8e2d80036)
2022-10-21 14:27:27 +08:00
d-c-manning cbad5f595c HBASE-27159 Emit source metrics for BlockCacheExpressHitPercent (#4830)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-17 14:19:59 -07:00
Victor 39c596fe7a HBASE-27426 - Fix ZKWatcher shutdown seqence to avoid InterruptExcept… (#4829)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Co-authored-by: Victor Li <victor.li@salesforce.com>
2022-10-17 13:28:10 -07:00
Peter Somogyi 8d81f87cad HBASE-27431 Remove TestRemoteTable.testLimitedScan (#4832)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-10-17 09:40:59 +02:00
Andrew Purtell de02ee2970 Preparing development version 2.4.16-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-13 11:39:40 -07:00
Andrew Purtell 35310fcd6b Preparing hbase release 2.4.15RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-10-13 11:39:36 -07:00