Commit Graph

17797 Commits

Author SHA1 Message Date
clarax dd2ae3605d
HBASE-25739 TableSkewCostFunction need to use aggregated deviation - … (#3481)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
    Signed-off-by: stack <stack@duboce.net>
    Reviewed-by: Nick Dimiduk <ndimiduk@apache.org>
2021-07-16 10:53:41 -07:00
YutSean 5ee1447b55 HBASE-26083 In branch-2 & branch-1 L1 miss metric is always 0 when using CombinedBlockCache (#3473)
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by Reid Chan <reidchan@apache.org>
2021-07-16 10:38:05 +08:00
binlijin 1d0cfa9ed4 HBASE-26086 TestHRegionReplayEvents do not pass in branch-2 and throws NullPointerException (#3480)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-07-15 09:53:34 +08:00
Xiaolin Ha b83fec48dc
HBASE-26036 DBB released too early in HRegion.get() and dirty data for some operations (#3436) (#3486) (#3487)
Signed-off-by: Michael Stack <stack@apache.org>
2021-07-14 16:40:25 +08:00
Duo Zhang 273c5c567d HBASE-26068 The last assertion in TestHStore.testRefreshStoreFilesNotChanged is wrong (#3461)
Signed-off-by: Yulin Niu <niuyulin@apache.org
2021-07-07 14:39:14 +08:00
Viraj Jasani 4bd7aed064
HBASE-22923 Consider minVersionToMoveSysTables while moving region and creating regionPlan (ADDENDUM) (#3455)
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-07-03 22:45:17 +05:30
mokai fbafc92e3e HBASE-26030 hbase-cleanup.sh did not clean the wal dir if hbase.wal.dir configured individually (#3432)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-07-03 11:21:30 +08:00
Almog Tavor ee7f15a675 HBASE-26035 Redundant null check in the compareTo function (#3433)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-07-01 22:58:06 +08:00
bsglz fe6c75cb50 HBASE-26027 The calling of HTable.batch blocked at AsyncRequestFuture… (#3419)
* HBASE-26027 The calling of HTable.batch blocked at AsyncRequestFutureImpl.waitUntilDone caused by ArrayStoreException

(cherry picked from commit 1d6eb77ef8)
2021-07-01 19:18:49 +08:00
Viraj Jasani c50867348b
HBASE-22923 min version of RegionServer to move system table regions (#3439) (#3438)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-07-01 16:24:47 +05:30
Viraj Jasani 5b5c92f427
HBASE-25902 Add missing CFs in meta during HBase 1 to 2 Upgrade (#3417)
Signed-off-by: Michael Stack <stack@apache.org>
2021-07-01 15:14:23 +05:30
bsglz 399b58e7c6 HBASE-26028 The view as json page shows exception when using TinyLfuBlockCache (#3420)
(cherry picked from commit 147b030c1f)
2021-07-01 10:36:20 +08:00
Duo Zhang c5a6e19be0 HBASE-26039 TestReplicationKillRS is useless after HBASE-23956 (#3440)
Signed-off-by: Michael Stack <stack@apache.org>
2021-06-30 08:32:36 +08:00
GeorryHuang 270b3facce HBASE-25980 Master table.jsp pointed at meta throws 500 when no all r… (#3373)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-27 22:33:48 +08:00
GeorryHuang 414deeea83 HBASE-26015 Should implement getRegionServers(boolean) method in Asyn… (#3406)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-27 22:13:36 +08:00
YutSean 886a36af0e HBASE-26025 Add a flag to mark if the IOError can be solved by retry in thrift IOError (#3416)
Signed-off-by: Reid Chan <reidchan@apache.org>
(cherry-picked from 84ae6185b8)
2021-06-25 17:10:55 +08:00
Viraj Jasani 3ecfd35f6a
HBASE-26012 Improve logging and dequeue logic in DelayQueue (#3397)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-24 15:29:12 +05:30
YutSean 3a6441c946 HBASE-26013 Get operations readRows metrics becomes zero after HBASE-25677 (#3411)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-06-24 15:37:46 +08:00
Duo Zhang b453cbd819 HBASE-26020 Split TestWALEntryStream.testDifferentCounts out (#3409)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-06-23 23:19:28 +08:00
litao 8d1473d321
HBASE-25934 Add username for RegionScannerHolder (#3325)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-06-23 12:55:21 +05:30
lujiefsi f09924b650 HBASE-25877 Add access check for compactionSwitch (#3253)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-22 23:47:04 +08:00
belugabehr ea439c652a HBASE-25937: Clarify UnknownRegionException (#3330)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-22 22:44:21 +08:00
Duo Zhang ad545aa548 HBASE-25992 Addendum add missing catch WALEntryFilterRetryableException back 2021-06-21 23:59:11 +08:00
YutSean 02714cbc18 HBASE-26001 When turn on access control, the cell level TTL of Increment and Append operations is invalid (#3403)
Signed-off-by: Reid Chan <reidchan@apache.org>
(cherry-picked from 029dc81b39)
2021-06-21 15:30:20 +08:00
Viraj Jasani 0c1d1d26a8
HBASE-25698 Fixing IllegalReferenceCountException when using TinyLfuBlockCache (#3215)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2021-06-21 12:57:48 +05:30
Duo Zhang beaeb0dfec HBASE-25992 Polish the ReplicationSourceWALReader code for 2.x after HBASE-25596 (#3376)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-06-20 16:44:51 +08:00
Bharath Vissapragada 58f067dc4d
HBASE-25998: Redo synchronization in SyncFuture (#3400)
Currently uses coarse grained synchronized approach that seems to
create a lot of contention. This patch

- Uses a reentrant lock instead of synchronized monitor
- Switches to a condition variable based waiting rather than busy wait
- Removed synchronization for unnecessary fields

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 6bafb59642)
2021-06-18 10:37:01 -07:00
Bharath Vissapragada a4ceabdc76
HBASE-25984: Avoid premature reuse of sync futures in FSHLog (#3371) (#3393)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 5a19bcfa98)
2021-06-17 12:28:18 -07:00
litao 49131fa9d2 HBASE-26000 Optimize the display of ZK dump in the master web UI (#3383)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 555f8b461f)
2021-06-15 14:16:19 +01:00
binlijin 814b196f03 HBASE-25997 NettyRpcFrameDecoder decode request header wrong when han… (#3380)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-15 14:42:26 +08:00
Toshihiro Suzuki b061d477a8 HBASE-26002 MultiRowMutationEndpoint should return the result of the conditional update (#3386)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-15 13:57:25 +09:00
Duo Zhang 5159eaec12 HBASE-25995 Change the method name for DoubleArrayCost.setCosts (#3381)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-06-15 12:06:02 +08:00
Michael Stack a7d10e550f HBASE-25989 FanOutOneBlockAsyncDFSOutput using shaded protobuf in hdfs 3.3+ (#3368)
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-12 08:30:00 -06:00
Duo Zhang 711b76c24f
HBASE-25947 Backport 'HBASE-25894 Improve the performance for region load and region count related cost functions' to branch-2.4 and branch-2.3 (#3339)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2021-06-11 09:33:08 +08:00
Mate Szalay-Beko 4b8fe9d7c7 HBASE-25993 Make excluded SSL cipher suites configurable for all Web UIs (#3375)
When starting a jetty http server, one can explicitly exclude certain (unsecure)
SSL cipher suites. This can be especially important, when the HBase cluster
needs to be compliant with security regulations (e.g. FIPS).

Currently it is possible to set the excluded ciphers for the ThriftServer
("hbase.thrift.ssl.exclude.cipher.suites") or for the RestServer
("hbase.rest.ssl.exclude.cipher.suites"), but one can not configure it for the
regular InfoServer started by e.g. the master or region servers.

In this commit I want to introduce a new configuration
"ssl.server.exclude.cipher.list" to configure the excluded cipher suites for the
http server started by the InfoServer. This parameter has the same name and will
work in the same way, as it was already implemented in hadoop (e.g. for hdfs/yarn).
See: HADOOP-12668, HADOOP-14341

Co-authored-by: Mate Szalay-Beko <symat@apache.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-06-10 16:59:29 +02:00
Zheng Wang 1fd584ed2f HBASE-25967 The readRequestsCount does not calculate when the outResults is empty 2021-06-10 11:08:30 +08:00
Mate Szalay-Beko 74d330cf67 HBASE-25987 Make SSL keystore type configurable for HBase ThriftServer (#3367)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.com>
(cherry picked from commit 7f7a293cb5)
2021-06-09 16:57:51 +01:00
Xiaolin Ha 7436a345be HBASE-25981 JVM crash when displaying RegionServer UI (#3364)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-09 18:18:48 +08:00
Michael Stack 39a577fbbf
HBASE-25969 Purge netty-all transitive includes (#3353)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Xiaolin Ha
2021-06-08 07:33:25 -07:00
Pankaj 246560ea04 HBASE-25918 Upgrade hbase-thirdparty dependency to 3.5.1 (#3317)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit be14605898)
2021-06-08 11:12:33 +05:30
Andrew Purtell 09eebe5cd0 Preparing development version 2.4.5-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-06-07 15:21:44 -07:00
Andrew Purtell 20e7ba45b0 Preparing hbase release 2.4.4RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-06-07 15:21:39 -07:00
Duo Zhang 6d1d64caf7 HBASE-25963 HBaseCluster should be marked as IA.Public (#3348)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-06-06 21:27:18 +08:00
Haoning Sun 7102dd0654 HBASE-25930 Thrift does not support requests in Kerberos environment (#3326)
Co-authored-by: sunhaoning <sunhaoning@qianxin.com>
Signed-off-by: Istvan Toth <stoty@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
2021-06-04 08:33:05 +02:00
meiyi 2dd7ec9d9e HBASE-25929 RegionServer JVM crash when compaction (#3318)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-03 17:34:53 +08:00
Bharath Vissapragada 8a41cb7f1d
HBASE-25932: Ensure replication reads the trailer bytes from WAL. (#3332) (#3346)
This bug was exposed by the test from HBASE-25924. Since this wal
implementations close the wal asynchronously, replication can potentially
miss the trailer bytes. (see jira comment for detailed analysis).

While this is not a correctness problem (since trailer does not have any entry data),
it erroneously bumps a metric that is used to track skipped bytes in WAL resulting
in false alarms which is something we should avoid.

Reviewed-by: Rushabh Shah <rushabh.shah@salesforce.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
(cherry picked from commit b04c3c7786)
2021-06-01 08:04:02 -07:00
Anoop Sam John 1972261826 HBASE-25903 ReadOnlyZKClient APIs - CompletableFuture.get() calls can cause threads to hang forver when ZK client create throws Non IOException (#3293)
Signed-off-by: zhangduo <zhangduo@apache.org>
2021-05-31 11:41:34 +05:30
Michael Stack 97e66a8af6 HBASE-25941 TestRESTServerSSL fails because of jdk bug (#3335)
Signed-off-by: Wei-Chiu Chuang weichiu@apache.org
2021-05-30 21:35:45 -07:00
Bharath Vissapragada cc1e19879d
HBASE-25942: Get rid of null regioninfo in wrapped connection exceptions (#3337)
Reviewed-by: Tamanna Mehta
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 528f543e23)
2021-05-30 21:15:56 -07:00
Michael Stack a43afa3576 HBASE-25940 Update Compression/TestCompressionTest: LZ4, SNAPPY, LZO (#3334)
Undo asserts that LZ4 and SNAPPY fails if their native libs are NOT
loaded; as of hadoop 3.3.1, LZ4 and SNAPPY can work w/o native libs.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-05-29 09:10:23 -07:00