Commit Graph

18072 Commits

Author SHA1 Message Date
liuzhuang2017 999801adad HBASE-27080 Optimize debug output log of ConstantSizeRegionSplitPolicy class. (#4481)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 12a9e6e5ec)

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ConstantSizeRegionSplitPolicy.java
2022-06-06 13:43:58 +08:00
huaxiangsun 976dbe8b2b
HBASE-26649 Support meta replica LoadBalance mode for RegionLocator#getAllRegionLocations() (#4442) (#4485)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-06-03 15:28:19 -07:00
skysiders 2e08c69c5c
HBASE-26985 check permission for SecureBulkLoadManager (#4379)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-06-02 15:30:31 -07:00
Duo Zhang 9ea3e39d7a HBASE-27046 The filenum in AbstractFSWAL should be monotone increasing (#4449)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 313a37f7ac)
2022-06-03 00:23:45 +08:00
Xiaolin Ha df9739979e HBASE-26680 Close and do not write trailer for the broken WAL writer(addendum) (#4405)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 80f410ec3f)
2022-06-03 00:08:53 +08:00
LiangJun He 3ce6e1afe7 HBASE-27039 Some methods of MasterRegion should be annotated for testing only (#4433)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 15002fccb4)
2022-06-02 21:39:20 +08:00
Duo Zhang 2d70427a32 HBASE-27023 Fix license issues after running spotless:apply (#4458)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit e555ac4a99)
2022-06-02 20:25:35 +08:00
Andrew Purtell f1c7f3a2f0 HBASE-27079 Lower some DEBUG level logs in ReplicationSourceWALReader to TRACE (#4476)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-31 12:43:50 -07:00
Duo Zhang a526252459 HBASE-26933 Addendum remove unused resources and links on site
(cherry picked from commit 4260e3afb7)
2022-05-22 16:33:28 +08:00
Duo Zhang d896958084 HBASE-26933 Remove all ref guide stuff on branch other than master (#4426)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 778ae2d655)

Conflicts:
	src/main/asciidoc/_chapters/compression.adoc
	src/main/asciidoc/_chapters/datamodel.adoc
	src/main/asciidoc/_chapters/hbase-default.adoc
	src/main/asciidoc/_chapters/offheap_read_write.adoc
	src/main/asciidoc/_chapters/ops_mgt.adoc
	src/main/asciidoc/_chapters/upgrading.adoc
	src/main/asciidoc/book.adoc
2022-05-22 15:24:28 +08:00
Junegunn Choi d310bf9623 HBASE-27030 Fix undefined local variable error in draining_servers.rb (#4427)
HBASE-21812 replaced a for-loop with an each block.
Each block introduces a new scope, so a local variable defined inside it
cannot be accessed afterwards.

  NameError: undefined local variable or method `admin' for main:Object
    getServerNames at /opt/khp/hbase/bin/draining_servers.rb:81
        addServers at /opt/khp/hbase/bin/draining_servers.rb:88
            <main> at /opt/khp/hbase/bin/draining_servers.rb:146

This commit defines the admin local variable in the current scope beforehand,
so that we can still access it after the block.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 2b573ae377)
2022-05-22 15:07:35 +08:00
litao 45c577a099 HBASE-27047 Fix typo for metric drainingRegionServers (#4441)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 63fe279b45)
2022-05-22 15:03:29 +08:00
bitterfox 075f6e638f HBASE-27027 Use jetty SslContextFactory.Server instead of deprecated SslContextFactory (#4425)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 1be2c83b3d)
2022-05-22 11:36:11 +08:00
d-c-manning 6ae8c9a808 HBASE-27054 TestStochasticLoadBalancerRegionReplicaLargeCluster.testRegionReplicasOnLargeCluster is flaky (#4454)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancerRegionReplicaLargeCluster.java
2022-05-21 09:42:40 -07:00
litao d11298f404
HBASE-27018 Add a tool command list_liveservers (#4416)
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-19 15:50:05 -07:00
Sean Busbey 7b55552388 HBASE-27006 Move nightly integration testing to new larger test node class. (#4438)
(cherry picked from commit 76d20fc48a)
2022-05-19 11:48:43 -05:00
Viraj Jasani 91a44f5bac
HBASE-26523 + HBASE-25465 + HBASE-26855 backport to branch-2.4 (#4439)
* HBASE-26523 Upgrade hbase-thirdparty dependency to 4.0.1 (#3988)

Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>

* HBASE-25465 Use javac --release option for supporting cross version compilation (#4164)

Signed-off-by: Andrew Purtell <apurtell@apache.org>

* HBASE-26855 Delete unnecessary dependency on jaxb-runtime jar (#4236)

Signed-off-by: Duo Zhang <zhangduo@apache.org>

* spotless apply

Co-authored-by: Duo Zhang <zhangduo@apache.org>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-05-18 16:28:55 -07:00
Duo Zhang ee284b6107 HBASE-27024 The User API and Developer API links are broken on hbase.apache.org (#4424)
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit ba7ef0216a)
2022-05-18 21:21:32 +08:00
Duo Zhang 1ab7491c6d HBASE-27045 Disable TestClusterScopeQuotaThrottle (#4440)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 487cf301a4)
2022-05-18 20:51:56 +08:00
Nick Dimiduk 6b1a2c36c1 Revert "HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (#4394)"
This reverts commit 454206b592.
2022-05-18 13:06:34 +02:00
Mohammad Arshad 454206b592 HBASE-26856:BufferedDataBlockEncoder.OnheapDecodedCell value can get corrupted (#4394)
Created OnheapDecodedCell and OffheapDecodedExtendedCell objects with duplicate copy of ByteBuffer's underlying array instead of original ByteBuffer

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit c198f23e5e)
2022-05-17 11:00:53 +05:30
litao 4f9896ebc0 HBASE-27032 The draining region servers metric description is incorrect (#4428)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit ed1665355a)
2022-05-17 10:47:52 +05:30
Tak Lon (Stephen) Wu 5b319752de
HBASE-27033 Backport "HBASE-27013 Introduce read all bytes when using pread for prefetch" (#4429)
- introduce optional flag `hfile.pread.all.bytes.enabled` for pread that must read full bytes with the next block header

Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2022-05-16 11:21:25 -07:00
litao aa7f98275f
HBASE-27003 Optimize log format for PerformanceEvaluation (#4411)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-10 22:33:04 -07:00
skysiders bba83dc931
HBASE-26994 MasterFileSystem create directory without permission check (#4391)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-08 13:29:33 -07:00
Rushabh Shah daaf5addbe HBASE-26963 ReplicationSource#removePeer hangs if we try to remove bad peer. (#4413)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
2022-05-07 17:45:39 +00:00
litao b8868f225a
HBASE-27000 Block cache stats (Misses Caching) display error in RS web UI (#4406)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2022-05-05 23:36:18 -07:00
Duo Zhang 7f7490ff47 HBASE-26995 Remove ref guide check in pre commit and nightly for branches other than master (#4399)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit 9a41117ca5)
2022-05-05 18:40:17 +08:00
Bryan Beaudreault 58aecd4f94 HBASE-26990 Add default implementation for BufferedMutator interface setters (#4387)
Signed-off-by: Josh Elser <elserj@apache.org>
2022-05-03 15:11:20 -04:00
Duo Zhang 1d63799f96 HBASE-26892 Add spotless:check in our pre commit general check (#4393)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
(cherry picked from commit 386869a428)
2022-05-03 21:26:48 +08:00
Duo Zhang 02dd256703 HBASE-26899 Run spotless:apply 2022-05-01 23:10:46 +08:00
Duo Zhang 247cfbad80 HBASE-26617 Use spotless to reduce the pain on fixing checkstyle issues
Also include the tweaked pom and eclipse formatter file in HBASE-26899

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
2022-05-01 23:08:15 +08:00
Andrew Purtell 526bdf61d0 Preparing development version 2.4.13-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-04-29 19:32:49 -07:00
Andrew Purtell 8382f55b15 Preparing hbase release 2.4.12RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-04-29 19:32:46 -07:00
Bryan Beaudreault 6d3b583abf
HBASE-26860 Backport "HBASE-25681 Add a switch for server/table queryMeter" to branch-2.4 (#4240)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-04-29 18:57:23 -07:00
Duo Zhang 485d6f89a6 HBASE-26917 Do not add --threads when running 'mvn site' (#4354)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit f4eb9071fd)
2022-04-29 17:49:52 +08:00
Duo Zhang d1de64d382 HBASE-26932 Skip generating ref guide when running 'mvn site' on branch other than master (#4360)
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 30908482c5)
2022-04-29 08:27:19 +08:00
liangxs 95f9792c3a HBASE-26980 Update javadoc of BucketCache.java (#4374)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit c02e7553d4)
2022-04-28 23:12:51 +08:00
Bri Augenreich 282c1c2737 HBASE-26581 Add metrics for failed replication edits (#4347)
Co-authored-by: Briana Augenreich <baugenreich@hubspot.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-04-26 17:45:36 -04:00
Wellington Ramos Chevreuil 828025bb37 HBASE-26971 SnapshotInfo --snapshot param is marked as required even when trying to list all snapshots (#4366)
Signed-off-by: Josh Elser <elserj@apache.org>
(cherry picked from commit af13c6d4c6)
2022-04-26 15:02:17 +01:00
Ruanhui 7715e37d37
HBASE-26942 cache region locations when getAllRegionLocations (#4357)
Co-authored-by: huiruan <huiruan@tencent.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2022-04-22 07:53:01 -04:00
Duo Zhang d9f4c519ca HBASE-26941 LocalHBaseCluster.waitOnRegionServer should not call join while interrupted (#4352)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 35aa57e445)
2022-04-17 23:27:19 +08:00
Pankaj eea9e78d17 HBASE-26944 Possible resource leak while creating new region scanner (#4339)
* HBASE-26944 Possible resource leak while creating new region scanner

Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 62e3efccef)
2022-04-15 11:42:34 +05:30
Duo Zhang 1fc186643f Revert "HBASE-26941 LocalHBaseCluster.waitOnRegionServer should quit while thread is interrupted (#4333)"
This reverts commit c10e4bd330.
2022-04-13 11:48:23 +08:00
Duo Zhang c10e4bd330 HBASE-26941 LocalHBaseCluster.waitOnRegionServer should quit while thread is interrupted (#4333)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
(cherry picked from commit 8247b7c722)
2022-04-13 11:10:45 +08:00
eomiks 02d51b0618 HBASE-26895 on hbase shell, 'delete/deleteall' for a columnfamily is not working (#4283)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit ea9bc92ce2)
2022-04-12 20:47:47 +08:00
eomiks df01fd4c25 HBASE-26901 delete with null columnQualifier occurs NullPointerException when NewVersionBehavior is on (#4295)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 7ac9e0be27)
2022-04-12 20:32:50 +08:00
huaxiangsun 7ac7954372
HBASE-26618 Involving primary meta region in meta scan with CatalogRe… (#4321) (#4328)
Signed-off-by: Michael Stack <stack@apache.org>
2022-04-11 10:26:42 -07:00
Peter Somogyi b63225d17e HBASE-26880 Misspelling commands in hbase shell will crash the shell (#4325)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-04-11 10:47:19 +02:00
Duo Zhang 3d9892cf6a HBASE-26922 Fix LineLength warnings as much as possible if it can not be fixed by spotless (#4324)
Signed-off-by: Yulin Niu <niuyulin@apache.org
(cherry picked from commit 3ae0d9012c)
2022-04-09 23:54:32 +08:00