Commit Graph

18189 Commits

Author SHA1 Message Date
Tomu Tsuruhara 19d991d291 HBASE-26517 Add auth method information to AccessChecker audit log (#3897)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-04 23:14:42 +08:00
Bryan Beaudreault d504504875
HBASE-26304 Reflect out of band locality improvements in metrics and balancer (#3895)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-04 12:23:09 +08:00
Andrew Purtell 4a00ce1cd5
HBASE-26535 [site, branch-2] DependencyManagement report is broken (#3915)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-04 11:59:31 +08:00
Nick Dimiduk d1c68a2d5c HBASE-26471 Move tracing semantic attributes to their own class (#3896)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2021-12-01 13:24:08 -08:00
Istvan Toth 061ccffb9e HBASE-26512 Make timestamp format configurable in HBase shell scan output
Signed-off-by: Josh Elser <elserj@apache.org
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-12-01 10:12:10 -05:00
Rushabh Shah 6fc5bbc19a
HBASE-26468 Region Server doesn't exit cleanly incase it crashes. (#3865) (#3862)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-12-01 11:06:07 +05:30
Duo Zhang 774484ed44 HBASE-25905 Shutdown of WAL stuck at waitForSafePoint (#3898)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-12-01 08:34:08 +08:00
Duo Zhang 799217ee69 HBASE-26455 TestStochasticLoadBalancerRegionReplicaWithRacks fails consistently (#3879)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2021-11-28 22:23:21 +08:00
Ruanhui 4fb3e304e2 HBASE-26485 Introduce a method to clean restore directory after Snapshot Scan (#3877)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-27 20:41:49 +08:00
chenglei 5437532910 HBASE-26476 Make DefaultMemStore extensible for HStore.memstore (#3869)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-27 12:06:35 +08:00
chenglei 5101f372e4 HBASE-26465 MemStoreLAB may be released early when its SegmentScanner is scanning (#3859)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-11-25 21:35:55 +08:00
Yutong Xiao 6aa2daa2c2 HBASE-26477 Fix MiniMapReduceCluster failure under Java17 (#3878)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-25 16:27:23 +08:00
Duo Zhang fa34cfc7d1 Revert "Backport HBASE-26477 Fix MiniMapReduceCluster failure under Java17 to branch-2 (#3878)"
This reverts commit ccf150434d.
2021-11-25 16:27:11 +08:00
Yutong Xiao ccf150434d
Backport HBASE-26477 Fix MiniMapReduceCluster failure under Java17 to branch-2 (#3878)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-25 16:25:44 +08:00
liangxs 2798ef132b HBASE-26479 Print too slow/big scan's operation_id in region server log (#3870)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-25 11:43:01 +08:00
Andrew Purtell 52ce87780a Revert "HBASE-26479 Print too slow/big scan's operation_id in region server log (#3870)"
This reverts commit b437a96272.
2021-11-24 17:34:01 -05:00
zhengzhuobinzzb 9275159289 HBASE-26482 HMaster may clean wals that is replicating in rare cases (#3876)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-24 23:38:36 +08:00
liangxs b437a96272 HBASE-26479 Print too slow/big scan's operation_id in region server log (#3870)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-24 23:38:16 +08:00
Duo Zhang 0a51d2b5be HBASE-26475 The flush and compact methods in HTU should skip processing secondary replicas (#3868)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-11-23 18:51:25 +08:00
Xiaolin Ha f8d03d1227 HBASE-26249 Ameliorate compaction made by bulk-loading files (#3831) (#3874)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-23 15:52:47 +08:00
haxiaolin 61406252a5 Revert "Backport HBASE-26249 Ameliorate compaction made by bulk-loading files (#3831) (#3874)"
This reverts commit 5843a9a44c.
2021-11-23 15:52:34 +08:00
Xiaolin Ha 5843a9a44c
Backport HBASE-26249 Ameliorate compaction made by bulk-loading files (#3831) (#3874)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-23 15:45:21 +08:00
markjens ad0ed956c2
HBASE-26470 Use openlabtesting protoc on linux arm64 in HBASE 2.x (#3860)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-22 23:13:27 +08:00
zhengzhuobinzzb 4312f817f3 HBASE-26467 Fix bug for MemStoreLABImpl.forceCopyOfBigCellInto(Cell) (#3858)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: chenglei <chenglei@apache.org>
2021-11-21 21:02:18 +08:00
ss77892 e549384437 HBASE-26463 Unreadable table names after HBASE-24605 (#3853)
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-21 20:49:13 +08:00
Xiaolin Ha 8d3562c6fa
HBASE-26421 Use HFileLink file to replace entire file's reference when splitting (#3854)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-18 21:37:10 +08:00
Josh Elser 4a8da47f74 HBASE-26267 Don't try to recover WALs from a WAL dir which doesn't exist (#3679)
We currently cause an error to be thrown by trying to list a
non-existent directory. We see that the master region directory exists
on the filesystem, but forget to make sure that the master region's WAL
directory also exists before we try to list it.
2021-11-16 16:27:45 -05:00
Andrew Purtell 4fb8a7f7e5 HBASE-26446 CellCounter should report serialized cell size counts too (#3841)
Add the following stats for a given table:
 - 7. Total size of serialized cells of each CF.
 - 8. Total size of serialized cells of each qualifier.
 - 9. Total size of serialized cells across all rows.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-11-15 16:46:01 -08:00
Andrew Purtell e65f28cc57 HBASE-26444 BucketCacheWriter should log only the BucketAllocatorException message, not the full stack trace (#3840)
Signed-off-by: Anoop <anoopsamjohn@apache.org>
2021-11-15 16:13:36 -08:00
Andrew Purtell 23024edba2 HBASE-26443 Some BaseLoadBalancer log lines should be at DEBUG level (#3838)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-11-15 16:06:59 -08:00
chenglei 98a4fb8086 HBASE-26438 Fix flaky test TestHStore.testCompactingMemStoreCellExceedInmemoryFlushSize (#3834)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-12 23:03:37 +08:00
mkkumar 4483bf43a4
HBASE-26432 enable tracing from shell (#3823)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2021-11-12 22:49:45 +08:00
Zhuoyue Huang ad36941932 HBASE-26450 Server configuration will overwrite HStore configuration after using shell command 'update_config' (#3843)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
2021-11-12 11:43:48 +08:00
Nick Dimiduk d3f5a4acd3 HBASE-26436 check-aggregate-license error related to javadns after HADOOP-17317
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2021-11-11 07:47:19 -08:00
Nick Dimiduk f90882aa86
HBASE-26414 Tracing INSTRUMENTATION_NAME is incorrect (#3810)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-10 12:53:36 +08:00
Yutong Xiao 9db7630d23 HBASE-26410 Fix HBase TestCanaryTool for Java17 (#3809)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-09 22:21:01 +08:00
clarax cc2e4aec87
HBASE-26337 Optimization for weighted random generators (#3828)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-09 21:27:44 +08:00
Andrew Purtell 1302073dfe HBASE-26430 Increase log level in DefaultHeapMemoryTuner from DEBUG to INFO (#3820)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-11-08 18:35:39 -08:00
Andrew Purtell 201b3c7fc7 HBASE-26429 HeapMemoryManager fails memstore flushes with NPE if enabled (#3819)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-11-08 18:32:17 -08:00
Xiaolin Ha 2fbb375cd5 HBASE-25322 Redundant Reference file in bottom region of split (#3814)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-08 14:48:55 +08:00
haxiaolin ebd89b58eb Revert "HBASE-25322 Redundant Reference file in bottom region of split (#3814)"
This reverts commit a6edf44175.
2021-11-08 11:40:43 +08:00
Xiaolin Ha a6edf44175 HBASE-25322 Redundant Reference file in bottom region of split (#3814)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-05 18:17:47 +08:00
Nick Dimiduk 2a2f618c9b HBASE-26363 OpenTelemetry configuration support for per-process service names
Exposes process-specific tracing arguments for most of the commands that we can launch from
`bin/hbase`. In addition to serving as an on/off flag, `HBASE_TRACE_OPTS` acts as the site-wide
configuration setting. Additional variables are provided for each applicable command, giving
operators fine-grain control over which processes participate in the tracing system, and to what
degree.

Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2021-11-04 11:39:36 -07:00
clarax e06208f3d6
HBASE-26311 Balancer gets stuck in cohosted replica distribution (#3804)
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2021-11-03 11:58:38 -07:00
clarax 9eb3706021
HBASE-26309 Balancer tends to move regions to the server at the end of list (#3811)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-02 21:58:50 +08:00
XinSun 063e0e2e92 HBASE-26406 Can not add peer replicating to non-HBase (#3806)
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

(cherry picked from commit b9b7fec57f)
2021-11-02 15:03:33 +08:00
chenglei e89f62e611
HBASE-26384 Segment already flushed to hfile may still be remained in CompactingMemStore (#3779)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-01 23:05:57 +08:00
Rushabh Shah 19433ba677
HBASE-26404 Update javadoc for CellUtil#createCell with tags methods. (#3801)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-01 15:58:31 +08:00
Andrew Purtell 60f01153f7 Amend HBASE-26353 Support loadable dictionaries in hbase-compression-zstd (#3787)
Resolve a new spotbugs warning in DictionaryCache

Signed-off-by: Andrew Purtell <apache.org>
2021-10-29 09:24:54 -07:00
Duo Zhang 9ce0066cde HBASE-26319 Make flaky find job track more builds (#3791)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-10-29 17:00:23 +08:00