ca3ba494cb
HBASE-26526 Introduce a timeout to shutdown of WAL ( #3297 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-07 12:26:59 +08:00
bdbb4fa087
HBASE-26525 Use unique thread name for group WALs ( #3903 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-07 12:19:33 +08:00
9cf224d4fe
HBASE-26462 Should persist restoreAcl flag in the procedure state for CloneSnapshotProcedure and RestoreSnapshotProcedure ( #3921 )
...
Signed-off-by: Yu Li <liyu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-06 22:58:38 +08:00
554580f966
HBASE-26533 KeyValueScanner might not be properly closed when using InternalScan.checkOnlyMemStore() ( #3917 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-05 22:34:30 +08:00
cf5bc6afca
HBASE-26517 Add auth method information to AccessChecker audit log ( #3897 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-04 22:59:29 +08:00
6d28bc6dd9
HBASE-26524 Addendum fix TestConstraints ( #3912 )
2021-12-02 12:55:41 -08:00
ea824df571
HBASE-26471 Move tracing semantic attributes to their own class ( #3896 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2021-12-01 09:21:20 -08:00
d1762f5209
HBASE-26468 Region Server doesn't exit cleanly incase it crashes. ( #3862 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-12-01 11:04:35 +05:30
358c4dc902
HBASE-25905 Shutdown of WAL stuck at waitForSafePoint ( #3898 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-01 08:24:46 +08:00
e311e23ac6
HBASE-26476 Make DefaultMemStore extensible for HStore.memstore ( #3869 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-27 12:05:47 +08:00
1b27124c61
HBASE-26304 Reflect out of band locality improvements in metrics and balancer ( #3803 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-27 12:01:46 +08:00
9fd58fecf0
HBASE-26465 MemStoreLAB may be released early when its SegmentScanner is scanning ( #3859 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-11-25 20:32:28 +08:00
c148d5bb3f
HBASE-26479 Print too slow/big scan's operation_id in region server log ( #3870 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-24 23:35:00 +08:00
96d699a8f0
HBASE-26477 Fix MiniMapReduceCluster failure under Java17 ( #3867 )
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-23 18:39:38 +08:00
1c48248ef8
HBASE-26475 The flush and compact methods in HTU should skip processing secondary replicas ( #3868 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-11-23 18:31:18 +08:00
b870b6d9ac
HBASE-26249 Ameliorate compaction made by bulk-loading files ( #3831 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-23 11:15:49 +08:00
2aafd31ff5
Revert "HBASE-26249 Ameliorate compaction made by bul… ( #3831 )"
...
This reverts commit 5e62e2aa8d
2021-11-23 11:15:14 +08:00
5e62e2aa8d
HBASE-26249 Ameliorate compaction made by bul… ( #3831 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-23 11:14:26 +08:00
04635f405a
HBASE-26467 Fix bug for MemStoreLABImpl.forceCopyOfBigCellInto(Cell) ( #3858 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: chenglei <chenglei@apache.org>
2021-11-21 20:59:11 +08:00
7a80b3a4f7
HBASE-26463 Unreadable table names after HBASE-24605 ( #3853 )
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-21 20:44:57 +08:00
b2571df7ae
HBASE-26421 Use HFileLink file to replace entire file's reference when splitting ( #3842 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-18 21:36:36 +08:00
1c47f80d83
HBASE-26267 Don't try to recover WALs from a WAL dir which doesn't exist ( #3679 )
...
We currently cause an error to be thrown by trying to list a
non-existent directory. We see that the master region directory exists
on the filesystem, but forget to make sure that the master region's WAL
directory also exists before we try to list it.
2021-11-16 16:26:55 -05:00
d92e9089de
HBASE-26444 BucketCacheWriter should log only the BucketAllocatorException message, not the full stack trace ( #3840 )
...
Signed-off-by: Anoop <anoopsamjohn@apache.org>
2021-11-15 16:11:53 -08:00
69a4eda35f
HBASE-26443 Some BaseLoadBalancer log lines should be at DEBUG level ( #3838 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-11-15 16:05:27 -08:00
8458e44a1a
HBASE-26438 Fix flaky test TestHStore.testCompactingMemStoreCellExceedInmemoryFlushSize ( #3834 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-12 22:51:40 +08:00
539e161e74
HBASE-26450 Server configuration will overwrite HStore configuration after using shell command 'update_config' ( #3843 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
2021-11-12 11:40:55 +08:00
058d3a45b4
Revert "HBASE-26450 Server configuration will overwrite HStore configuration … ( #3843 )"
...
This reverts commit 628b8b7f65
2021-11-12 11:34:38 +08:00
628b8b7f65
HBASE-26450 Server configuration will overwrite HStore configuration … ( #3843 )
...
* HBASE-26450 Server configuration will overwrite HStore configuration After using shell command 'updateConfiguration'
2021-11-12 11:10:38 +08:00
e1ca056676
HBASE-26410 Fix HBase TestCanaryTool for Java17 ( #3809 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-09 22:11:21 +08:00
407a5bd812
HBASE-26430 Increase log level in DefaultHeapMemoryTuner from DEBUG to INFO ( #3820 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-11-08 18:34:14 -08:00
b03ed8bae0
HBASE-26429 HeapMemoryManager fails memstore flushes with NPE if enabled ( #3819 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-11-08 18:31:21 -08:00
a6c09a84a7
HBASE-25322 Redundant Reference file in bottom region of split ( #3814 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-05 18:16:14 +08:00
cd7a5099d4
HBASE-26311 Balancer gets stuck in cohosted replica distribution ( #3724 )
...
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2021-11-03 11:57:37 -07:00
b9b7fec57f
HBASE-26406 Can not add peer replicating to non-HBase ( #3806 )
...
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-02 14:26:25 +08:00
558ab925ed
HBASE-26384 Segment already flushed to hfile may still be remained in CompactingMemStore ( #3777 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-01 23:05:15 +08:00
45f76a4104
HBASE-26353 Support loadable dictionaries in hbase-compression-zstd ( #3787 )
...
ZStandard supports initialization of compressors and decompressors with a
precomputed dictionary, which can dramatically improve and speed up compression
of tables with small values. For more details, please see
The Case For Small Data Compression
https://github.com/facebook/zstd#the-case-for-small-data-compression
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-10-27 07:39:55 -07:00
8e7f78cb44
HBASE-26396 Remove duplicate thread creation during migrating rsgroup ( #3795 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-10-27 22:01:15 +08:00
773ff28967
HBASE-26394 Cache in RSRpcServices.executeProcedures does not take effect ( #3794 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-10-26 14:44:33 +08:00
84a527bdcc
HBASE-26190 High rate logging of BucketAllocatorException: Allocation too big - Addendum ( #3792 )
2021-10-24 09:19:10 +05:30
0d8e5e5219
HBASE-26368 Fix checkstyle issues for HRegionServer ( #3764 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-10-22 12:50:45 +05:30
4838246ba3
HBASE-26385 Clear CellScanner when replay ( #3773 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2021-10-21 21:30:19 +08:00
64eb237120
HBASE-26383 HBCK incorrectly reports inconsistencies for recently split regions following a master failover ( #3775 )
...
A regression was introduced by HBASE-25847 which changed regionInfo#isParentSplit
to regionState#isSplit. The region state after restart is CLOSED instead of SPLIT.
We need to check both regionState and regionInfo for split status.
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-10-20 15:48:36 -07:00
856d08e863
HBASE-26371 Prioritize meta region move over other region moves in region_mover ( #3767 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-20 23:05:12 +05:30
8a6fed7b19
HBASE-26316 Per-table or per-CF compression codec setting overrides ( #3730 )
...
We get and retain Compressor instances in HFileBlockDefaultEncodingContext,
and could in theory call Compressor#reinit when setting up the context,
to update compression parameters like level and buffer size, but we do
not plumb through the CompoundConfiguration from the Store into the
encoding context. As a consequence we can only update codec parameters
globally in system site conf files.
Fine grained configurability is important for algorithms like ZStandard
(ZSTD), which offers more than 20 compression levels, where at level 1
it is almost as fast as LZ4, and where at higher levels it utilizes
computationally expensive techniques to rival LZMA at compression ratio
but trades off significantly for reduced compresson throughput. The ZSTD
level that should be set for a given column family or table will vary by
use case.
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-10-19 12:04:25 -07:00
23e7aa5ccc
HBASE-26320 Implement a separate thread pool for the LogCleaner ( #3712 )
...
This avoids starvation when the archive directory is large and takes a long time
to iterate through.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
2021-10-18 16:21:01 -07:00
ad7d698622
HBASE-26350 Add a DEBUG when we fail the SASL handshake
...
Closes #3743
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2021-10-14 15:19:30 -04:00
6e7e69a0a7
HBASE-26348 Implement a special procedure to migrate rs group information when upgrading ( #3746 )
...
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Reviewed-by: GeorryHuang <215175212@qq.com>
2021-10-14 22:51:37 +08:00
891e90f08f
HBASE-26190 High rate logging of Bucket Allocator Allocation fails ( #3648 )
...
* HBASE-26190 High rate logging of BucketAllocatorException: Allocation too big
Reduce the frequency of allocation failed traces by printing them
preiodically (once per minute). Record the allocation failures in the
Bucket Cache Stats and let the stat thread dump cumulative allocation
failures alongside other traces it dumps.
Also, this change adds trace for the Table name, Column Family and
HFileName for the most recent allocation failure in last 1 minute.
Signed-off-by: Anoop <anoopsamjohn@apache.org>
2021-10-14 13:13:17 +05:30
39a20c528e
HBASE-26324 Reuse compressors and decompressors in WAL CompressionContext ( #3728 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-10-07 09:45:17 -07:00
42fe5e5baa
HBASE-26259 Fallback support to pure Java compression ( #3691 )
...
This change introduces provided compression codecs to HBase as
new Maven modules. Each module provides compression codec support
that formerly required Hadoop native codecs, which in turn relies
on native code integration, which may or may not be available on
a given hardware platform or in an operational environment. We
now provide codecs in the HBase distribution for users whom for
whatever reason cannot or do not wish to deploy the Hadoop native
codecs.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-10-06 13:17:18 -07:00
Xiaolin Ha
LiangJun He
RamanChodzka
Tomu Tsuruhara
Tak Lon (Stephen) Wu
Nick Dimiduk
Rushabh Shah
Duo Zhang
chenglei
Bryan Beaudreault
liangxs
Yutong Xiao
zhengzhuobinzzb
ss77892
Josh Elser
Andrew Purtell
Zhuoyue Huang
Xiaolin Ha
clarax
XinSun
Anoop Sam John
Sourabh Dhanotia
binlijin
Viraj Jasani
z-york
KulwantSingh011