Commit Graph

17821 Commits

Author SHA1 Message Date
Bharath Vissapragada 58f067dc4d
HBASE-25998: Redo synchronization in SyncFuture (#3400)
Currently uses coarse grained synchronized approach that seems to
create a lot of contention. This patch

- Uses a reentrant lock instead of synchronized monitor
- Switches to a condition variable based waiting rather than busy wait
- Removed synchronization for unnecessary fields

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 6bafb59642)
2021-06-18 10:37:01 -07:00
Bharath Vissapragada a4ceabdc76
HBASE-25984: Avoid premature reuse of sync futures in FSHLog (#3371) (#3393)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
(cherry picked from commit 5a19bcfa98)
2021-06-17 12:28:18 -07:00
litao 49131fa9d2 HBASE-26000 Optimize the display of ZK dump in the master web UI (#3383)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 555f8b461f)
2021-06-15 14:16:19 +01:00
binlijin 814b196f03 HBASE-25997 NettyRpcFrameDecoder decode request header wrong when han… (#3380)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-15 14:42:26 +08:00
Toshihiro Suzuki b061d477a8 HBASE-26002 MultiRowMutationEndpoint should return the result of the conditional update (#3386)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-15 13:57:25 +09:00
Duo Zhang 5159eaec12 HBASE-25995 Change the method name for DoubleArrayCost.setCosts (#3381)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-06-15 12:06:02 +08:00
Michael Stack a7d10e550f HBASE-25989 FanOutOneBlockAsyncDFSOutput using shaded protobuf in hdfs 3.3+ (#3368)
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-12 08:30:00 -06:00
Duo Zhang 711b76c24f
HBASE-25947 Backport 'HBASE-25894 Improve the performance for region load and region count related cost functions' to branch-2.4 and branch-2.3 (#3339)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2021-06-11 09:33:08 +08:00
Mate Szalay-Beko 4b8fe9d7c7 HBASE-25993 Make excluded SSL cipher suites configurable for all Web UIs (#3375)
When starting a jetty http server, one can explicitly exclude certain (unsecure)
SSL cipher suites. This can be especially important, when the HBase cluster
needs to be compliant with security regulations (e.g. FIPS).

Currently it is possible to set the excluded ciphers for the ThriftServer
("hbase.thrift.ssl.exclude.cipher.suites") or for the RestServer
("hbase.rest.ssl.exclude.cipher.suites"), but one can not configure it for the
regular InfoServer started by e.g. the master or region servers.

In this commit I want to introduce a new configuration
"ssl.server.exclude.cipher.list" to configure the excluded cipher suites for the
http server started by the InfoServer. This parameter has the same name and will
work in the same way, as it was already implemented in hadoop (e.g. for hdfs/yarn).
See: HADOOP-12668, HADOOP-14341

Co-authored-by: Mate Szalay-Beko <symat@apache.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-06-10 16:59:29 +02:00
Zheng Wang 1fd584ed2f HBASE-25967 The readRequestsCount does not calculate when the outResults is empty 2021-06-10 11:08:30 +08:00
Mate Szalay-Beko 74d330cf67 HBASE-25987 Make SSL keystore type configurable for HBase ThriftServer (#3367)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.com>
(cherry picked from commit 7f7a293cb5)
2021-06-09 16:57:51 +01:00
Xiaolin Ha 7436a345be HBASE-25981 JVM crash when displaying RegionServer UI (#3364)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-09 18:18:48 +08:00
Michael Stack 39a577fbbf
HBASE-25969 Purge netty-all transitive includes (#3353)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Xiaolin Ha
2021-06-08 07:33:25 -07:00
Pankaj 246560ea04 HBASE-25918 Upgrade hbase-thirdparty dependency to 3.5.1 (#3317)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit be14605898)
2021-06-08 11:12:33 +05:30
Andrew Purtell 09eebe5cd0 Preparing development version 2.4.5-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-06-07 15:21:44 -07:00
Andrew Purtell 20e7ba45b0 Preparing hbase release 2.4.4RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-06-07 15:21:39 -07:00
Duo Zhang 6d1d64caf7 HBASE-25963 HBaseCluster should be marked as IA.Public (#3348)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-06-06 21:27:18 +08:00
Haoning Sun 7102dd0654 HBASE-25930 Thrift does not support requests in Kerberos environment (#3326)
Co-authored-by: sunhaoning <sunhaoning@qianxin.com>
Signed-off-by: Istvan Toth <stoty@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
2021-06-04 08:33:05 +02:00
meiyi 2dd7ec9d9e HBASE-25929 RegionServer JVM crash when compaction (#3318)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-03 17:34:53 +08:00
Bharath Vissapragada 8a41cb7f1d
HBASE-25932: Ensure replication reads the trailer bytes from WAL. (#3332) (#3346)
This bug was exposed by the test from HBASE-25924. Since this wal
implementations close the wal asynchronously, replication can potentially
miss the trailer bytes. (see jira comment for detailed analysis).

While this is not a correctness problem (since trailer does not have any entry data),
it erroneously bumps a metric that is used to track skipped bytes in WAL resulting
in false alarms which is something we should avoid.

Reviewed-by: Rushabh Shah <rushabh.shah@salesforce.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
(cherry picked from commit b04c3c7786)
2021-06-01 08:04:02 -07:00
Anoop Sam John 1972261826 HBASE-25903 ReadOnlyZKClient APIs - CompletableFuture.get() calls can cause threads to hang forver when ZK client create throws Non IOException (#3293)
Signed-off-by: zhangduo <zhangduo@apache.org>
2021-05-31 11:41:34 +05:30
Michael Stack 97e66a8af6 HBASE-25941 TestRESTServerSSL fails because of jdk bug (#3335)
Signed-off-by: Wei-Chiu Chuang weichiu@apache.org
2021-05-30 21:35:45 -07:00
Bharath Vissapragada cc1e19879d
HBASE-25942: Get rid of null regioninfo in wrapped connection exceptions (#3337)
Reviewed-by: Tamanna Mehta
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 528f543e23)
2021-05-30 21:15:56 -07:00
Michael Stack a43afa3576 HBASE-25940 Update Compression/TestCompressionTest: LZ4, SNAPPY, LZO (#3334)
Undo asserts that LZ4 and SNAPPY fails if their native libs are NOT
loaded; as of hadoop 3.3.1, LZ4 and SNAPPY can work w/o native libs.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-05-29 09:10:23 -07:00
Sandeep Pal d37f490d40
HBASE-25927: Fix the log messages by not stringifying the exceptions in log (#3338)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
(cherry picked from commit 9a2027bf71)
2021-05-28 21:35:44 -07:00
Duo Zhang 042aa14fb7 HBASE-25938 The SnapshotOfRegionAssignmentFromMeta.initialize call in FavoredNodeLoadBalancer is just a dummy one (#3329)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-05-29 11:11:06 +08:00
stack 548a99741d HBASE-25908 Exclude jakarta.activation-api (#3299) Reapply of a revert because commit message was in wrong format
Signed-off-by: stack <stack@apache.org>
2021-05-28 13:31:04 -07:00
stack aef520d04c Revert "Subject: [PATCH] HBASE-25908 Exclude jakarta.activation-api (#3299)"
This reverts commit b086e7db7a.
2021-05-28 13:28:00 -07:00
Victor 296be5b426
HBASE-25910 - Fix port assignment test (#3308)
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-05-28 20:53:42 +05:30
Wei-Chiu Chuang b086e7db7a Subject: [PATCH] HBASE-25908 Exclude jakarta.activation-api (#3299)
Signed-off-by: stack <stack@apache.org>
2021-05-27 18:48:34 -07:00
stack e84b8891b0 Revert "HBASE-25908 Exclude jakarta.activation-api (#3299)"
This reverts commit 9d18d770b9.
2021-05-27 18:41:54 -07:00
Wei-Chiu Chuang 9d18d770b9 HBASE-25908 Exclude jakarta.activation-api (#3299)
Signed-off-by: stack <stack@apache.org>
2021-05-27 18:36:51 -07:00
Wellington Ramos Chevreuil fa577ad92c HBASE-25933 Log trace raw exception, instead of cause message in NettyRpcServerRequestDecoder (#3323)
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>

(Cherry picked from commit feb89d988b)
2021-05-27 20:04:42 +01:00
Rushabh Shah 286899450d HBASE-25924 Re-compute size of WAL file while removing from WALEntryStream (#3315)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-05-26 10:43:48 -07:00
Pankaj 22c26f1fc8 HBASE-25875 RegionServer failed to start with IllegalThreadStateException due to race condition in AuthenticationTokenSecretManager (#3250)
* HBASE-25875 RegionServer failed to start with IllegalThreadStateException due to race condition in AuthenticationTokenSecretManager's start & retrievePassword method

Signed-off-by: stack <stack@apache.com>
(cherry picked from commit 2126ec94f0)
2021-05-26 00:14:32 +05:30
GeorryHuang 4e079ace58
HBASE-25906 UI of master-status to show recent history of balancer desicion (#3303) (#3296)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-05-25 12:42:01 +05:30
Anoop Sam John 0df3deab92 HBASE-25898 RS getting aborted due to NPE in Replication WALEntryStream (#3292)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
2021-05-24 23:46:26 +05:30
GeorryHuang a7e6cac7a0 HBASE-25791 UI of master-status to show a recent history of that why balancer was rejected to run (#3278)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-05-24 21:40:13 +08:00
caoliqing 1e1ac9eda3 HBASE-25892: 'False' should be 'True' in auditlog of listLabels (#3273)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-05-22 17:25:51 +08:00
sambong0113 0e18900c36 HBASE-25817 Memory leak from thrift server hashMap (#3257)
Use GuavaCache in thrift server hashmap

Signed-off-by: Michael Stack <stack@apache.org>
2021-05-22 10:51:36 +08:00
Sandeep Pal 646dbfee03
HBASE-25848: Add flexibility to backup replication in case replication filter throws an exception (#3289) 2021-05-21 11:55:47 -07:00
Rushabh Shah 700499be36
HBASE-25827 Per Cell TTL tags get duplicated with increments causing tags length overflow (#3290)(#3210)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-05-21 23:00:52 +05:30
Andrew Purtell e82340ec64 Preparing development version 2.4.4-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-05-19 12:38:15 -07:00
Andrew Purtell 401b60b217 Preparing hbase release 2.4.3RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-05-19 12:38:07 -07:00
Andrew Purtell bf518cff56 Revert "HBASE-25875 RegionServer failed to start with IllegalThreadStateException due to race condition in AuthenticationTokenSecretManager (#3250)"
This reverts commit 21c1dc7e6c.
2021-05-19 12:29:24 -07:00
Andrew Purtell 2fec951303 Revert "HBASE-25032 Do not assign regions to region server which has not called regionServerReport yet (#3268)"
This reverts commit 2bf86468d8.
2021-05-19 12:29:12 -07:00
Andrew Purtell ca3b267130 Revert "Amend HBASE-25032: Compliation fix for TestRSGroupsKillRS"
This reverts commit 4d44bfa8ad.
2021-05-19 12:29:03 -07:00
Andrew Purtell 4eaba9e9b1 Revert "Preparing hbase release 2.4.3RC1; tagging and updates to CHANGES.md and RELEASENOTES.md"
This reverts commit c2707bc6a8.
2021-05-19 12:28:57 -07:00
Andrew Purtell 49ed8cc306 Revert "Preparing development version 2.4.4-SNAPSHOT"
This reverts commit cf287aaf95.
2021-05-19 12:28:48 -07:00
Andrew Purtell cf287aaf95 Preparing development version 2.4.4-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-05-19 11:13:54 -07:00