Commit Graph

18248 Commits

Author SHA1 Message Date
Wei-Chiu Chuang bfee537c94 HBASE-25516 [JDK17] reflective access Field.class.getDeclaredField("modifiers") not supported (#3443)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
(cherry picked from commit 29cd782d25)
2023-01-24 22:51:05 +08:00
Duo Zhang 667af49955 HBASE-27578 Upgrade hbase-thirdparty to 4.1.4 (#4985)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
(cherry picked from commit a0fdfa782b)
(cherry picked from commit 83d450d5b5)
2023-01-21 16:42:12 +08:00
Bryan Beaudreault a7f776f06e HBASE-27579 CatalogJanitor can cause data loss due to errors during cleanMergeRegion (#4986)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-20 13:01:00 -05:00
Dongjoon Hyun 67a30f364f HBASE-27562 Publish SBOM artifacts (#4953)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5feb06bd69)
2023-01-20 16:27:43 +08:00
tianhang b9cf8a1f19 HBASE-27564 Add default encryption type for MiniKDC to fix failed tests on JDK11+ (#4968)
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 8e11f91b3b)
2023-01-20 16:27:21 +08:00
tianhang e63331e93e
HBASE-27557 [JDK17] Update shade plugin version (#4970)
Signed-off-by Reid Chan <reidchan@apache.org>
2023-01-20 13:32:47 +08:00
dependabot[bot] 9e2a17c4af HBASE-27575 Bump future from 0.18.2 to 0.18.3 in /dev-support (#4980)
Bumps [future](https://github.com/PythonCharmers/python-future) from 0.18.2 to 0.18.3.
- [Release notes](https://github.com/PythonCharmers/python-future/releases)
- [Changelog](https://github.com/PythonCharmers/python-future/blob/master/docs/changelog.rst)
- [Commits](https://github.com/PythonCharmers/python-future/compare/v0.18.2...v0.18.3)

---
updated-dependencies:
- dependency-name: future
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-01-19 18:25:29 -08:00
Andrew Purtell 0a88314cda HBASE-27561 hbase.master.port is ignored in processing of hbase.masters (#4952)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/MasterRegistry.java
2023-01-17 13:55:39 -08:00
Nick Dimiduk 181ffe7714 HBASE-27568 ChaosMonkey add support for JournalNodes (#4963)
Signed-off-by: Reid Chan <reidchan@apache.org>
2023-01-17 18:37:09 +01:00
Viraj Jasani 6d2064d443
HBASE-27529 Provide RS coproc ability to attach WAL extended attributes to mutations at replication sink (#4924)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-01-16 11:49:11 -08:00
Nick Dimiduk 6244891df9 HBASE-27567 Introduce ChaosMonkey Action to print HDFS Cluster status
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-16 15:52:34 +01:00
Nick Dimiduk ae1ec90680 HBASE-27563 ChaosMonkey sometimes generates invalid boundaries for random item selection
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-12 18:09:44 +01:00
Nick Dimiduk 849332d217 Revert "Backport "HBASE-27563 ChaosMonkey sometimes generates invalid boundaries for random item selection" to branch-2.4 (#4962)"
This reverts commit f245c64993.
2023-01-12 17:57:55 +01:00
Nick Dimiduk f245c64993
Backport "HBASE-27563 ChaosMonkey sometimes generates invalid boundaries for random item selection" to branch-2.4 (#4962)
HBASE-27563 ChaosMonkey sometimes generates invalid boundaries for random item selection

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-12 17:57:06 +01:00
Peter Somogyi 4902c08def HBASE-27565 Make the initial corePoolSize configurable for ChoreService (#4958)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-12 14:54:31 +01:00
liuzhongjun 56ebf93870 HBASE-27560 fix consistencyCheck did not report the hole on last region (#4950)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c1b9d8ba06)
2023-01-11 18:13:39 +08:00
dependabot[bot] 0382b348cb HBASE-27566 Bump gitpython from 3.1.29 to 3.1.30 in /dev-support (#4957)
Bumps [gitpython](https://github.com/gitpython-developers/GitPython) from 3.1.29 to 3.1.30.
- [Release notes](https://github.com/gitpython-developers/GitPython/releases)
- [Changelog](https://github.com/gitpython-developers/GitPython/blob/main/CHANGES)
- [Commits](https://github.com/gitpython-developers/GitPython/compare/3.1.29...3.1.30)

---
updated-dependencies:
- dependency-name: gitpython
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 991ca9598b)
2023-01-11 11:14:01 +08:00
Peter Somogyi 695dce5bd5
HBASE-27556 Reuse Zookeeper session of Master in LogCleaner (#4946)
Backport of HBASE-23340
hmaster /hbase/replication/rs session expired (hbase replication default value is true, we don't use )
causes logcleaner can not clean oldWALs, which resulits in oldWALs too large (more than 2TB))

Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2023-01-06 20:45:28 +01:00
dependabot[bot] 9cae2bb70e HBASE-27548 Bump jettison from 1.5.1 to 1.5.2 (#4943)
Bumps [jettison](https://github.com/jettison-json/jettison) from 1.5.1 to 1.5.2.
- [Release notes](https://github.com/jettison-json/jettison/releases)
- [Commits](https://github.com/jettison-json/jettison/compare/jettison-1.5.1...jettison-1.5.2)

---
updated-dependencies:
- dependency-name: org.codehaus.jettison:jettison
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bfc9fc9605)
2023-01-03 14:18:30 +08:00
Victor 7f7fe55943 HBASE-27540 add client side counter metrics for failed rpc calls (#4929)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-12-21 09:01:55 -05:00
LYCJeff 9164ed4815 HBASE-27530 Fix comment syntax errors (#4910)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f9518cc1a1)
2022-12-14 23:27:12 +08:00
Duo Zhang 7a80b01e8e HBASE-27524 Fix python requirements problem (#4918)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
(cherry picked from commit 8b4e134f8c)
2022-12-14 00:20:14 +08:00
Duo Zhang fc03580e4a HBASE-27459 Improve our hbase_docker to be able to build and start standalone clusters other than master branch (#4861)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
(cherry picked from commit d78d40404c)
2022-12-14 00:20:05 +08:00
Duo Zhang 5f9e0d0fca HBASE-27513 Modify README.txt to mention how to contribue (#4913)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Zheng Hu <openinx@gmail.com>
(cherry picked from commit 4d70f94ffe)
2022-12-10 23:28:04 +08:00
chenglei bc45f1584e
HBASE-27519 Another case for FNFE on StoreFileScanner after a flush followed by a compaction (#4923)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2022-12-10 12:41:05 +08:00
Vaibhav Joshi ccd1d8a293 HBASE-27498: Added logic in ConnectionImplementation.getKeepAliveMasterService to avoid expensive rpc calls in synchronized block (#4889)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2022-12-09 08:35:58 -08:00
Bri Augenreich f1bfda1aa3 HBASE-27491 Do not clear cache on RejectedExecutionException (#4914)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-12-09 08:59:45 -05:00
Shanky Sharma cc86844b8a HBASE-22924 GitHUB PR job should use when clause to filter to just PRs (#4915)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e1ad781dd9)
2022-12-08 21:19:56 +08:00
Bryan Beaudreault 4814438cdf HBASE-27487 Addendum remove unused imports 2022-12-02 08:04:10 -05:00
Bri Augenreich fea54b6afa HBASE-27487: Slow meta can create pathological feedback loop with multigets (#4900)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-12-01 08:32:03 -05:00
cxzl25 5bb47ca0fb
HBASE-27512 Add file .git-blame-ignore-revs (#4906)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-12-01 20:15:36 +08:00
Bri Augenreich 751b6b9b68 HBASE-27494: Fix missing meta cache dropping exception metrics (#4902)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-11-30 13:06:16 -05:00
Wellington Ramos Chevreuil 6e562bb84b HBASE-27484 FNFE on StoreFileScanner after a flush followed by a compaction (#4882)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2022-11-29 11:54:58 +00:00
mrzhao 48c8bcf179 HBASE-27503 Support replace <FILE-PATH> in GC_OPTS for ZGC (#4892)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7fc4d99384)
2022-11-29 00:03:27 +08:00
Peter Somogyi f0c857a784
HBASE-26320 Implement a separate thread pool for the LogCleaner (#4895)
This avoids starvation when the archive directory is large and takes a long time
to iterate through.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
Co-authored-by: Xiaolin Ha <haxiaolin@apache.org>
2022-11-27 19:14:44 +01:00
Ruanhui 5ce1d8f9bd HBASE-27463 Reset sizeOfLogQueue when refresh replication source (#4863)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Rushabh Shah <shahrs87@gmail.com>
(cherry picked from commit bb9f43c6f9)
2022-11-27 23:50:05 +08:00
Peter Somogyi 0a37292113 HBASE-27506 Optionally disable sorting directories by size in CleanerChore (#4896)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit b68dcf46e9)
2022-11-25 15:54:52 +01:00
Ruanhui a3ac3c581d HBASE-27445 fix the result of DirectMemoryUtils#getDirectMemorySize (#4846)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2f4758ee59)
2022-11-23 20:48:15 +08:00
mokai 1c9f6c5ccd HBASE-27504 Remove duplicated config 'hbase.normalizer.merge.min_region_age.days' in hbase-default.xml (#4894)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c691091f78)
2022-11-23 20:44:02 +08:00
chenglei acc4d13e7f HBASE-27464 In memory compaction 'COMPACT' may cause data corruption when adding cells large than maxAlloc(default 256k) size (#4881)
Co-authored-by: comnetwork <comnetwork@163.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7b0ac6451d)
2022-11-17 23:21:59 +08:00
YiweiLi4 fd92057f22 HBASE-27479 fix flaky test testClone in TestTaskMonitor (#4876)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a2075f51a8)
2022-11-17 21:39:31 +08:00
Duo Zhang d1ac1d57c9 HBASE-27423 Upgrade hbase-thirdparty to 4.1.3 and upgrade Jackson for CVE-2022-42003/42004 (#4878)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 07a3ffdd97)
2022-11-17 21:36:41 +08:00
mrzhao 843cc5f952 HBASE-27379 fix numOpenConnections metric is one less than the actual (#4884)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d7c4447dd2)
2022-11-16 16:43:45 +08:00
Peter Somogyi ba53872fb1
HBASE-27001 The deleted variable cannot be printed out (#4883)
* The deleted variable cannot be printed out, add it

Co-authored-by: selina.yan <selina.yan@huolala.cn>

Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit b8558d30d0)
2022-11-15 17:22:37 +01:00
Xin Sun f7b2efc7b7 HBASE-27469 IllegalArgumentException is thrown by SnapshotScannerHDFSAclController when dropping a table (#4865)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-11-15 13:00:57 +08:00
Duo Zhang 0ff4402ead HBASE-27480 Skip error prone for hadoop2/3 checkes in our nightly jobs (#4877)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 085325c696)
2022-11-11 14:42:16 +08:00
Duo Zhang 1fb7c3b39c HBASE-27475 Use different jdks when running hadoopcheck in personality scripts (#4875)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 260cd485db)
2022-11-10 23:20:50 +08:00
Duo Zhang 32c8dd3c04 HBASE-27472 The personality script set wrong hadoop2 check version for branch-2 (#4866)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 6c32d1a3fb)
2022-11-10 12:58:58 +08:00
Duo Zhang aa8ca7e1b9 HBASE-27473 Fix spotbugs warnings in hbase-rest Client.getResponseBody (#4867)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 2d87994f68)
2022-11-10 12:58:15 +08:00
Duo Zhang 4605c323cc HBASE-27443 Use java11 in the general check of our jenkins job (#4845)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit 5c6ff7dc47)
2022-11-08 00:20:33 +08:00