Commit Graph

18606 Commits

Author SHA1 Message Date
Rajeshbabu Chintaguntla ab8aa62030 HBASE-27669 chaos-daemon.sh should make use hbase script start/stop chaosagent and chaos monkey runner (#5078)
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc8b13e468)
2023-03-09 10:58:07 +08:00
huaxiangsun 6e31c18bf2 HBASE-27250 MasterRpcService#setRegionStateInMeta does not support replica region encodedNames or region names
- Added sanity check to make sure input region encoded name or region name is valid
- Assignment improvements pertaining to read replica regions
- make several MetaTableAccessor methods more precise in their handling of replica regions
- hbck2 setRegionStateInMeta and HBCKServerCrashProcedure handle read replicas
- separate AM helper methods -- loading RegionInfo from cache vs. refreshing cache from meta
- AM helper method support loading RegionInfo from cache via either region name and encoded region
  name (both caches are maintained, and under lock)
- consolidate, extend tests to cover read replica regions

Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-03-08 14:41:48 +01:00
haxiaolin 2cdcab2b9c Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#4536) (#5086)"
This reverts commit 1ac7bbc8f3.
2023-03-06 18:02:34 +08:00
Xiaolin Ha 1ac7bbc8f3
HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#4536) (#5086)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-06 14:20:57 +08:00
Xiaolin Ha 6d463f7aab
HBASE-27672 Read RPC threads may BLOCKED at the Configuration.get when using java compression (#5075) (#5084)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-06 12:53:47 +08:00
alan.zhao 4effc85e44 HBASE-27670 Improve FSUtils to directly obtain FSDataOutputStream (#5064)
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 59fdaa28f7)
2023-03-04 22:39:03 +08:00
Jan Hentschel 555bf91f2b HBASE-23983 Fixed Spotbugs complaint in RegionStates related to ignored return value
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-03 10:45:28 +01:00
Minwoo Kang cbfdbff841 HBASE-23561 acquire lock before update regionsMap (#1263)
Addendum: tie add and delete of regionMap and encodedRegionsMap

Signed-off-by: stack <stack@apache.org>
2023-03-03 10:42:39 +01:00
Minwoo Kang 26dcc133e2 HBASE-23561 Look up of Region in Master by encoded region name is O(n) (#1193)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-03-03 10:42:39 +01:00
Ruanhui 79a7bf770a
HBASE-27458 Use ReadWriteLock for region scanner readpoint map (#5069)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-02 11:24:20 +08:00
Nick Dimiduk a5d0f2696a HBASE-23102: Improper Usage of Map putIfAbsent (#828)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Co-authored-by: belugabehr <12578579+belugabehr@users.noreply.github.com>
2023-03-01 14:59:49 +01:00
Bryan Beaudreault faf2ead301 HBASE-27666 Addendum fix import in test 2023-02-28 14:24:00 -05:00
Bryan Beaudreault 21e3fab299 HBASE-27666 Allow preCompact hooks to return scanners whose cells can be shipped (#5056)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-28 14:03:51 -05:00
okumin 16b9bb8557 HBASE-27655 Remove the empty path annotation from ClusterMetricsResource
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-02-28 14:39:21 +01:00
Yuta Imazu d3264617d3 HBASE-24781 Clean up peer metrics when disabling peer (#4997)
Co-authored-by: Yuta Imazu <yuta.imazu@linecorp.com>
Signed-off-by: Duo Zhang <zhangduo@apache.or
(cherry picked from commit ef6a1130d0)
2023-02-28 13:35:14 +08:00
Duo Zhang c319c6f0a3 HBASE-27668 PB's parseDelimitedFrom can successfully return when there are not enough bytes (#5059)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit d1fede72c3)
2023-02-28 10:08:19 +08:00
Bryan Beaudreault a3ed4a19d7 HBASE-27650 Merging empty regions corrupts meta cache (branch-2) (#5038)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-27 20:41:04 -05:00
Duo Zhang c29355ecd7 HBASE-27644 Should not return false when WALKey has no following KVs while reading WAL file (#5032)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 4a9cf99b2f)

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplit.java
2023-02-26 16:26:45 +08:00
Bryan Beaudreault 683c37e262 HBASE-27649 WALPlayer does not properly dedupe overridden cell versions (#5058)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-25 15:13:28 -05:00
tianhang 32d33735df HBASE-27661 Set size of systable queue in UT (#5053)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc31e68e85)
2023-02-25 23:38:26 +08:00
Victor 7cb4a58bb1 HBASE-15242: add client side metrics for timeout and remote exceptions. (#5023)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-02-24 16:29:22 -08:00
chenglei 3dd64aa051
HBASE-27654 IndexBlockEncoding is missing in HFileContextBuilder copy constructor (#5044)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-20 18:16:08 +08:00
chenglei 431eda158b
Revert "HBASE-29654 IndexBlockEncoding is missing in HFileContextBuilder copy constructor (#5042)" (#5043)
This reverts commit eb18f545f6.
2023-02-20 18:10:37 +08:00
chenglei eb18f545f6
HBASE-29654 IndexBlockEncoding is missing in HFileContextBuilder copy constructor (#5042)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-20 18:09:30 +08:00
Kerasone 96e05fe7ba HBASE-27636 The "CREATE_TIME_TS" value of the hfile generated by the HFileOutputFormat2 class is 0 (#5034)
Co-authored-by: selina.yan <selina.yan@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5f0dcdd121)
2023-02-18 10:48:27 +08:00
Bryan Beaudreault e845e2e4dc HBASE-27648 CopyOnWriteArrayMap does not honor contract of ConcurrentMap.putIfAbsent (#5031)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-17 19:20:13 -05:00
tianhang 9889ee2100 HBASE-27645 [JDK17] Use ReflectionUtils#getModifiersField in UT (#5029)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 3b8d7ad512)
2023-02-17 21:17:52 +08:00
tianhang 138ae0a33d HBASE-27643 [JDK17] Add-opens java.util.concurrent (#5028)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a1cf0731e3)
2023-02-17 21:17:27 +08:00
Duo Zhang b60fecd18d HBASE-27637 Zero length value would cause value compressor read nothing and not advance the position of the InputStream (#5025)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 2bbe036e29)
2023-02-15 12:15:29 +08:00
Xiaolin Ha f676130e13
HBASE-21521 Expose master startup status via web UI (#4788) (#5022)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-02-14 15:07:25 +08:00
Duo Zhang d401913501 HBASE-27621 Also clear the Dictionary when resetting when reading compressed WAL file (#5016)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 833b10e8ba)
2023-02-11 19:55:11 +08:00
tianhang 34465acd36 HBASE-27602 Remove the impact of operating env on testHFileCleaning (#5003)
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e71253f4d8)
2023-02-11 19:41:47 +08:00
Nihal Jain a38ffec51b HBASE-27626 Suppress noisy logging in client.ConnectionImplementation (#5019)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-02-09 10:31:10 -08:00
Peter Somogyi 9fdda0202f
HBASE-27628 Spotless fix in RELEASENOTES.md (#5018) 2023-02-09 17:31:31 +01:00
Peter Somogyi d48e7af6cb HBASE-27590 Change Iterable to List in SnapshotFileCache (#4995)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d2c5af11ea)
2023-02-09 15:21:04 +01:00
Wellington Ramos Chevreuil 83276aa0db HBASE-27619 Bulkload fails when trying to bulkload files with invalid names after HBASE-26707 (#5014)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-02-09 09:22:40 -04:00
Bryan Beaudreault 86957f2a50 HBASE-27580 Reverse scan over rows with tags throw exceptions when using DataBlockEncoding (#5006)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-02-04 12:31:56 -05:00
Duo Zhang 7fe1d22fb5 HBASE-27608 Use lowercase image reference name in our docker file (#5005)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
(cherry picked from commit bbc20f3611)
2023-02-03 11:39:33 +08:00
tianhang 0967364b03 HBASE-27595 ThreadGroup is removed since Hadoop 3.2.4 (#5001)
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a3686eb052)
2023-02-02 14:21:46 +08:00
Tak Lon (Stephen) Wu f91e8f883c Preparing development version 2.5.4-SNAPSHOT
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-02-01 08:54:32 +00:00
Tak Lon (Stephen) Wu d385524561 Preparing hbase release 2.5.3RC2; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-02-01 08:54:22 +00:00
Duo Zhang 7e2c9e96f4 Revert "HBASE-27585 Bump up jruby to 9.3.9.0 and related joni and jcodings to 2.1.43 and 1.0.57 respectively (#4992)"
This reverts commit 47c3186da3.
2023-02-01 11:41:19 +08:00
tianhang 073560abc1 HBASE-27581 [JDK17] Fix failure TestHBaseTestingUtil#testResolvePortConflict (#4991)
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 8e72cc6ee0)
2023-01-31 11:20:53 +08:00
Tak Lon (Stephen) Wu bd1e626051 Preparing development version 2.5.4-SNAPSHOT
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-01-29 14:20:46 +00:00
Tak Lon (Stephen) Wu 601b1e394f Preparing hbase release 2.5.3RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-01-29 14:20:31 +00:00
chaijunjie0101 4caa19f6a9 HBASE-26967 FilterList with FuzzyRowFilter and SingleColumnValueFilter evaluated with operator MUST_PASS_ONE doesn't work as expected(#4820)
Close #4820

Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 382681e2d6)
2023-01-29 17:39:59 +08:00
Tak Lon (Stephen) Wu 0e645ce8c4 Preparing development version 2.5.4-SNAPSHOT
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-01-29 07:11:10 +00:00
Tak Lon (Stephen) Wu d5b03d490b Preparing hbase release 2.5.3RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2023-01-29 07:10:41 +00:00
Tak Lon (Stephen) Wu 2167e8e3ef HBASE-27547 Addendum: add missing import 2023-01-28 20:27:25 -08:00
EungsopYoo f65dfe50a3 HBASE-27547 Close store file readers after region warmup (#4942)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 45fd3f628a)
2023-01-28 23:21:42 +08:00