Commit Graph

8591 Commits

Author SHA1 Message Date
Bryan Beaudreault 9cf0af6e79 HBASE-26537: Make HBASE-15676 backwards compatible, using a flag on the proto (#3931)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-13 13:34:10 -08:00
Guanghao Zhang 140b5d8d26 HBASE-24870 Ignore TestAsyncTableRSCrashPublish (#2248)
Signed-off-by: meiyi <myimeiyi@gmail.com>
2021-12-06 19:07:07 -08:00
LiangJun He ec52519f7c HBASE-26462 Should persist restoreAcl flag in the procedure state for CloneSnapshotProcedure and RestoreSnapshotProcedure (#3921)
Signed-off-by: Yu Li <liyu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-06 23:16:15 +08:00
RamanChodzka 074456e190 HBASE-26533 KeyValueScanner might not be properly closed when using InternalScan.checkOnlyMemStore() (#3917)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-05 22:35:07 +08:00
Tomu Tsuruhara 19d991d291 HBASE-26517 Add auth method information to AccessChecker audit log (#3897)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-04 23:14:42 +08:00
Bryan Beaudreault d504504875
HBASE-26304 Reflect out of band locality improvements in metrics and balancer (#3895)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-04 12:23:09 +08:00
Nick Dimiduk d1c68a2d5c HBASE-26471 Move tracing semantic attributes to their own class (#3896)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2021-12-01 13:24:08 -08:00
Rushabh Shah 6fc5bbc19a
HBASE-26468 Region Server doesn't exit cleanly incase it crashes. (#3865) (#3862)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-12-01 11:06:07 +05:30
Duo Zhang 774484ed44 HBASE-25905 Shutdown of WAL stuck at waitForSafePoint (#3898)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-01 08:34:08 +08:00
Duo Zhang 799217ee69 HBASE-26455 TestStochasticLoadBalancerRegionReplicaWithRacks fails consistently (#3879)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-11-28 22:23:21 +08:00
chenglei 5437532910 HBASE-26476 Make DefaultMemStore extensible for HStore.memstore (#3869)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-27 12:06:35 +08:00
chenglei 5101f372e4 HBASE-26465 MemStoreLAB may be released early when its SegmentScanner is scanning (#3859)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-11-25 21:35:55 +08:00
Yutong Xiao 6aa2daa2c2 HBASE-26477 Fix MiniMapReduceCluster failure under Java17 (#3878)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-25 16:27:23 +08:00
Duo Zhang fa34cfc7d1 Revert "Backport HBASE-26477 Fix MiniMapReduceCluster failure under Java17 to branch-2 (#3878)"
This reverts commit ccf150434d.
2021-11-25 16:27:11 +08:00
Yutong Xiao ccf150434d
Backport HBASE-26477 Fix MiniMapReduceCluster failure under Java17 to branch-2 (#3878)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-25 16:25:44 +08:00
liangxs 2798ef132b HBASE-26479 Print too slow/big scan's operation_id in region server log (#3870)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-25 11:43:01 +08:00
Andrew Purtell 52ce87780a Revert "HBASE-26479 Print too slow/big scan's operation_id in region server log (#3870)"
This reverts commit b437a96272.
2021-11-24 17:34:01 -05:00
liangxs b437a96272 HBASE-26479 Print too slow/big scan's operation_id in region server log (#3870)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-24 23:38:16 +08:00
Duo Zhang 0a51d2b5be HBASE-26475 The flush and compact methods in HTU should skip processing secondary replicas (#3868)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-11-23 18:51:25 +08:00
Xiaolin Ha f8d03d1227 HBASE-26249 Ameliorate compaction made by bulk-loading files (#3831) (#3874)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-23 15:52:47 +08:00
haxiaolin 61406252a5 Revert "Backport HBASE-26249 Ameliorate compaction made by bulk-loading files (#3831) (#3874)"
This reverts commit 5843a9a44c.
2021-11-23 15:52:34 +08:00
Xiaolin Ha 5843a9a44c
Backport HBASE-26249 Ameliorate compaction made by bulk-loading files (#3831) (#3874)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-23 15:45:21 +08:00
zhengzhuobinzzb 4312f817f3 HBASE-26467 Fix bug for MemStoreLABImpl.forceCopyOfBigCellInto(Cell) (#3858)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: chenglei <chenglei@apache.org>
2021-11-21 21:02:18 +08:00
ss77892 e549384437 HBASE-26463 Unreadable table names after HBASE-24605 (#3853)
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-21 20:49:13 +08:00
Xiaolin Ha 8d3562c6fa
HBASE-26421 Use HFileLink file to replace entire file's reference when splitting (#3854)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-18 21:37:10 +08:00
Josh Elser 4a8da47f74 HBASE-26267 Don't try to recover WALs from a WAL dir which doesn't exist (#3679)
We currently cause an error to be thrown by trying to list a
non-existent directory. We see that the master region directory exists
on the filesystem, but forget to make sure that the master region's WAL
directory also exists before we try to list it.
2021-11-16 16:27:45 -05:00
Andrew Purtell e65f28cc57 HBASE-26444 BucketCacheWriter should log only the BucketAllocatorException message, not the full stack trace (#3840)
Signed-off-by: Anoop <anoopsamjohn@apache.org>
2021-11-15 16:13:36 -08:00
Andrew Purtell 23024edba2 HBASE-26443 Some BaseLoadBalancer log lines should be at DEBUG level (#3838)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-11-15 16:06:59 -08:00
chenglei 98a4fb8086 HBASE-26438 Fix flaky test TestHStore.testCompactingMemStoreCellExceedInmemoryFlushSize (#3834)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-12 23:03:37 +08:00
Zhuoyue Huang ad36941932 HBASE-26450 Server configuration will overwrite HStore configuration after using shell command 'update_config' (#3843)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
2021-11-12 11:43:48 +08:00
Yutong Xiao 9db7630d23 HBASE-26410 Fix HBase TestCanaryTool for Java17 (#3809)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-09 22:21:01 +08:00
clarax cc2e4aec87
HBASE-26337 Optimization for weighted random generators (#3828)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-09 21:27:44 +08:00
Andrew Purtell 1302073dfe HBASE-26430 Increase log level in DefaultHeapMemoryTuner from DEBUG to INFO (#3820)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-11-08 18:35:39 -08:00
Andrew Purtell 201b3c7fc7 HBASE-26429 HeapMemoryManager fails memstore flushes with NPE if enabled (#3819)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-11-08 18:32:17 -08:00
Xiaolin Ha 2fbb375cd5 HBASE-25322 Redundant Reference file in bottom region of split (#3814)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-08 14:48:55 +08:00
haxiaolin ebd89b58eb Revert "HBASE-25322 Redundant Reference file in bottom region of split (#3814)"
This reverts commit a6edf44175.
2021-11-08 11:40:43 +08:00
Xiaolin Ha a6edf44175 HBASE-25322 Redundant Reference file in bottom region of split (#3814)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-05 18:17:47 +08:00
clarax e06208f3d6
HBASE-26311 Balancer gets stuck in cohosted replica distribution (#3804)
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2021-11-03 11:58:38 -07:00
clarax 9eb3706021
HBASE-26309 Balancer tends to move regions to the server at the end of list (#3811)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-02 21:58:50 +08:00
XinSun 063e0e2e92 HBASE-26406 Can not add peer replicating to non-HBase (#3806)
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

(cherry picked from commit b9b7fec57f)
2021-11-02 15:03:33 +08:00
chenglei e89f62e611
HBASE-26384 Segment already flushed to hfile may still be remained in CompactingMemStore (#3779)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-01 23:05:57 +08:00
Andrew Purtell f2c58fcf68 HBASE-26353 Support loadable dictionaries in hbase-compression-zstd (#3787)
ZStandard supports initialization of compressors and decompressors with a
precomputed dictionary, which can dramatically improve and speed up compression
of tables with small values. For more details, please see

  The Case For Small Data Compression
  https://github.com/facebook/zstd#the-case-for-small-data-compression

Signed-off-by: Duo Zhang <zhangduo@apache.org>

Conflicts:
	hbase-compression/hbase-compression-zstd/src/main/java/org/apache/hadoop/hbase/io/compress/zstd/ZstdCodec.java
2021-10-27 07:57:16 -07:00
chenglei b4177577ac HBASE-26394 Cache in RSRpcServices.executeProcedures does not take effect (#3794)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-10-26 15:44:17 +08:00
clarax 32eb23c8f3
HBASE-26327 Replicas cohosted on a rack shouldn't keep triggering balancer (#3788)
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2021-10-25 15:44:11 -07:00
Anoop Sam John 444dec9289 HBASE-26190 High rate logging of BucketAllocatorException: Allocation too big - Addendum (#3792) 2021-10-24 09:22:26 +05:30
clarax f299d56934
HBASE-26308 Sum of multiplier of cost functions is not populated properly when we have a shortcut for trigger (#3783) 2021-10-22 09:46:58 -07:00
Sourabh Dhanotia eea2ea8576
HBASE-26368 Fix checkstyle issues for HRegionServer for branch-2 (#3781) (#3764)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-10-22 12:51:29 +05:30
binlijin 0eaadd92d8 HBASE-26385 Clear CellScanner when replay (#3773)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2021-10-21 21:56:39 +08:00
Andrew Purtell dce45ec16a HBASE-26383 HBCK incorrectly reports inconsistencies for recently split regions following a master failover (#3775)
A regression was introduced by HBASE-25847 which changed regionInfo#isParentSplit
to regionState#isSplit. The region state after restart is CLOSED instead of SPLIT.
We need to check both regionState and regionInfo for split status.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-10-20 15:55:07 -07:00
Viraj Jasani 5c4a053f2a
HBASE-26371 Prioritize meta region move over other region moves in region_mover (#3771) (#3767)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-20 23:06:25 +05:30