Commit Graph

19749 Commits

Author SHA1 Message Date
tianhang bc31e68e85
HBASE-27661 Set size of systable queue in UT (#5053)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-25 23:15:09 +08:00
Victor 36bb0d1f6c
HBASE-15242: add client side metrics for timeout and remote exceptions. (#5023)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-02-24 16:25:01 -08:00
huaxiangsun 22dbb7afc3
HBASE-27250 MasterRpcService#setRegionStateInMeta does not support replica region encodedNames or region names
- Added sanity check to make sure input region encoded name or region name is valid
- Assignment improvements pertaining to read replica regions
- make several MetaTableAccessor methods more precise in their handling of replica regions
- hbck2 setRegionStateInMeta and HBCKServerCrashProcedure handle read replicas
- separate AM helper methods -- loading RegionInfo from cache vs. refreshing cache from meta
- AM helper method support loading RegionInfo from cache via either region name and encoded region
  name (both caches are maintained, and under lock)
- consolidate, extend tests to cover read replica regions

Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-02-21 13:47:27 +01:00
chenglei cf179d3fb9
HBASE-27654 IndexBlockEncoding is missing in HFileContextBuilder copy constructor (#5039)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-20 17:42:00 +08:00
Kerasone 5f0dcdd121
HBASE-27636 The "CREATE_TIME_TS" value of the hfile generated by the HFileOutputFormat2 class is 0 (#5034)
Co-authored-by: selina.yan <selina.yan@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-18 10:46:09 +08:00
Bryan Beaudreault 1664b6b3f5
HBASE-27648 CopyOnWriteArrayMap does not honor contract of ConcurrentMap.putIfAbsent (#5031)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-17 19:17:52 -05:00
tianhang a1cf0731e3
HBASE-27643 [JDK17] Add-opens java.util.concurrent (#5028)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-17 21:12:26 +08:00
Duo Zhang 2bbe036e29
HBASE-27637 Zero length value would cause value compressor read nothing and not advance the position of the InputStream (#5025)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-02-15 12:00:08 +08:00
Xiaolin Ha 8ba56cccd3
HBASE-21521 Expose master startup status via web UI (#4788)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-13 18:55:55 +08:00
tianhang e71253f4d8
HBASE-27602 Remove the impact of operating env on testHFileCleaning (#5003)
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-11 19:39:03 +08:00
Duo Zhang 833b10e8ba
HBASE-27621 Also clear the Dictionary when resetting when reading compressed WAL file (#5016)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-02-11 19:34:17 +08:00
Wellington Ramos Chevreuil a854cba59f
HBASE-27619 Bulkload fails when trying to bulkload files with invalid names after HBASE-26707 (#5014)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-02-09 12:40:00 +00:00
Peter Somogyi d2c5af11ea
HBASE-27590 Change Iterable to List in SnapshotFileCache (#4995)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-09 11:20:35 +01:00
dependabot[bot] 6a34aa8195
HBASE-27622 Bump cryptography in /dev-support/git-jira-release-audit (#5015)
Bumps [cryptography](https://github.com/pyca/cryptography) from 3.3.2 to 39.0.1.
- [Release notes](https://github.com/pyca/cryptography/releases)
- [Changelog](https://github.com/pyca/cryptography/blob/main/CHANGELOG.rst)
- [Commits](https://github.com/pyca/cryptography/compare/3.3.2...39.0.1)

---
updated-dependencies:
- dependency-name: cryptography
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-08 19:26:25 +08:00
Bryan Beaudreault 1a9e465e35
HBASE-27534 Addendum fix test crash (#5011) 2023-02-07 17:05:01 -05:00
Tak Lon (Stephen) Wu 198a3b7e89
HBASE-27611 update download.xml for release 2.5.3 (#5009)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-05 22:58:47 -08:00
Bryan Beaudreault fa6b5d17c2
HBASE-27534 Determine too large requests by response block size rather than just cell size (#5007)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-05 16:54:21 -05:00
Duo Zhang 0cfe043e85
HBASE-27610 Add 2.4.16 to download page (#5008)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2023-02-05 20:45:23 +08:00
Bryan Beaudreault 7b26b2aefe
HBASE-27570 Unify tracking of block IO across all read request types (#5004)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-04 12:14:05 -05:00
Bryan Beaudreault 95039f08b1
HBASE-27580 Reverse scan over rows with tags throw exceptions when using DataBlockEncoding (#5006)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-04 12:12:29 -05:00
tianhang e45c59c71b
HBASE-27600 Make the behavior of hadoop profile consistent (#5000)
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-04 17:48:05 +08:00
tianhang 0b032558d5
HBASE-27599 Cleanup wrong dependency in dependencyManagement (#4999)
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-04 17:47:22 +08:00
Duo Zhang bbc20f3611
HBASE-27608 Use lowercase image reference name in our docker file (#5005)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-03 11:24:12 +08:00
Duo Zhang 55b4bbc057 HBASE-27598 Addendum remove references to mockito-core.version in pom 2023-02-02 22:12:43 +08:00
tianhang a3686eb052
HBASE-27595 ThreadGroup is removed since Hadoop 3.2.4 (#5001)
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-02 14:15:44 +08:00
tianhang 8e72cc6ee0
HBASE-27581 [JDK17] Fix failure TestHBaseTestingUtil#testResolvePortConflict (#4991)
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-31 10:19:57 +08:00
Bryan Beaudreault 76207257bb
HBASE-27558 Scan quotas and limits should account for total block IO (#4967)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-30 09:27:45 -05:00
chaijunjie0101 382681e2d6 HBASE-26967 FilterList with FuzzyRowFilter and SingleColumnValueFilter evaluated with operator MUST_PASS_ONE doesn't work as expected(#4820)
Close #4820

Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-29 17:19:08 +08:00
Duo Zhang bd7a78add5
HBASE-27598 Upgrade mockito to 4.x (#4998)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2023-01-29 11:29:51 +08:00
EungsopYoo 45fd3f628a
HBASE-27547 Close store file readers after region warmup (#4942)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-28 22:12:18 +08:00
Rajeshbabu Chintaguntla 235864056c
HBASE-27585 Bump up jruby to 9.3.9.0 and related joni and jcodings to 2.1.43 and 1.0.57 respectively (#4992)
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2023-01-28 10:18:56 +08:00
tianhang 06f294e637
HBASE-27591 [JDK17] Fix failure TestImmutableScan#testScanCopyConstructor (#4994)
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-27 22:42:24 +08:00
Rajeshbabu Chintaguntla 5516fb86b6
HBASE-27586 Bump up commons-codec to 1.15 (#4993)
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2023-01-27 22:40:04 +08:00
Andrew Purtell 01e5eac80b
HBASE-27588 "Instantiating StoreFileTracker impl" INFO level logging is too chatty (#4989)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-01-25 14:40:24 -08:00
Duo Zhang 5bdf264633
HBASE-27583 Remove -X option when building protoc check in nightly and pre commit job (#4988)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-01-24 23:31:12 +08:00
Wellington Ramos Chevreuil ea4cb641d7
HBASE-27551 Add config options to delay assignment to retain last region location (#4945)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-24 02:36:50 +00:00
Duo Zhang 83d450d5b5 HBASE-27578 Addendum remove staging repo 2023-01-21 16:39:02 +08:00
Bryan Beaudreault cc4fd8bebb
HBASE-27579 CatalogJanitor can cause data loss due to errors during cleanMergeRegion (#4986)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-20 12:29:16 -05:00
Duo Zhang a0fdfa782b
HBASE-27578 Upgrade hbase-thirdparty to 4.1.4 (#4985)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-01-20 09:08:31 -08:00
curie71 913cf6b96d
HBASE-27528 log duplication issues in MasterRpcServices. (#4951)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-20 15:53:32 +08:00
Dongjoon Hyun 5feb06bd69
HBASE-27562 Publish SBOM artifacts (#4953)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-20 15:53:06 +08:00
dependabot[bot] 29d4632b13
HBASE-27575 Bump future from 0.18.2 to 0.18.3 in /dev-support (#4980)
Bumps [future](https://github.com/PythonCharmers/python-future) from 0.18.2 to 0.18.3.
- [Release notes](https://github.com/PythonCharmers/python-future/releases)
- [Changelog](https://github.com/PythonCharmers/python-future/blob/master/docs/changelog.rst)
- [Commits](https://github.com/PythonCharmers/python-future/compare/v0.18.2...v0.18.3)

---
updated-dependencies:
- dependency-name: future
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-01-19 18:03:33 -08:00
BukrosSzabolcs ad8f28e297
HBASE-27493: Allow namespace admins to clone snapshots created by them (#4885)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-01-18 11:01:56 +01:00
Jarryd Lee d799c3c3c3
HBASE-27541 Backups should be able to be restored to a separate filesystem (#4933)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-01-17 20:09:01 -05:00
Andrew Purtell 71d0862d84
HBASE-27561 hbase.master.port is ignored in processing of hbase.masters (#4952)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2023-01-17 13:20:03 -08:00
Nick Dimiduk da261344cc
HBASE-27568 ChaosMonkey add support for JournalNodes (#4963)
Signed-off-by: Reid Chan <reidchan@apache.org>
2023-01-17 09:55:18 +08:00
Viraj Jasani cc54d22fb4
HBASE-27529 Provide RS coproc ability to attach WAL extended attributes to mutations at replication sink (#4924)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-01-16 10:46:14 -08:00
Nick Dimiduk 7ed2cb99f9
HBASE-27567 Introduce ChaosMonkey Action to print HDFS Cluster status
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-16 14:40:50 +01:00
Nick Dimiduk 2a7c69d30e HBASE-27563 ChaosMonkey sometimes generates invalid boundaries for random item selection
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-12 17:54:30 +01:00
Peter Somogyi dff8e50849
HBASE-27565 Make the initial corePoolSize configurable for ChoreService (#4958)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-01-12 14:41:41 +01:00