Commit Graph

19005 Commits

Author SHA1 Message Date
lujiefsi d9bd29603b
HBASE-25877 Add access check for compactionSwitch (#3253)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-22 23:37:36 +08:00
belugabehr d44292ac1a
HBASE-25937: Clarify UnknownRegionException (#3330)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-22 22:36:30 +08:00
YutSean f640eef924
HBASE-26013 Get operations readRows metrics becomes zero after HBASE-25677 (#3404)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-06-22 11:38:42 +08:00
Duo Zhang c5461aaa5b HBASE-25992 Addendum add missing catch WALEntryFilterRetryableException back 2021-06-21 23:58:08 +08:00
Viraj Jasani 9f4177f7b4
HBASE-25698 Fixing IllegalReferenceCountException when using TinyLfuBlockCache (#3215)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2021-06-21 11:50:33 +05:30
Duo Zhang d2923755ec
HBASE-25992 Polish the ReplicationSourceWALReader code for 2.x after HBASE-25596 (#3376)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-06-20 16:32:42 +08:00
GeorryHuang f0a39590d0
HBASE-26005 Update ref guide about the EOL for 2.2.x (#3388)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-19 00:06:37 +08:00
YutSean 53f61ef8d5
HBASE-26001 When turn on access control, the cell level TTL of Increment and Append operations is invalid (#3385)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-06-18 11:15:45 +08:00
Bharath Vissapragada 336d8464cc
HBASE-25998: Redo synchronization in SyncFuture (#3382)
Currently uses coarse grained synchronized approach that seems to
create a lot of contention. This patch

- Uses a reentrant lock instead of synchronized monitor
- Switches to a condition variable based waiting rather than busy wait
- Removed synchronization for unnecessary fields

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-06-17 12:21:05 -07:00
Duo Zhang eb242be674
HBASE-25976 Implement a master based ReplicationTracker (#3390)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-06-17 18:24:49 +08:00
Bharath Vissapragada 5a19bcfa98
HBASE-25984: Avoid premature reuse of sync futures in FSHLog (#3371)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-06-16 14:30:15 -07:00
niuyulin 7466e08aec
HBASE-26008 Fix typo in AsyncConnectionImpl (#3391)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-16 19:00:03 +08:00
litao 555f8b461f
HBASE-26000 Optimize the display of ZK dump in the master web UI (#3383)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-15 14:10:55 +01:00
binlijin 8f618a0846
HBASE-25997 NettyRpcFrameDecoder decode request header wrong when han… (#3380)
* HBASE-25997 NettyRpcFrameDecoder decode request header wrong when handleTooBigRequest
2021-06-15 14:25:18 +08:00
Duo Zhang 480b6bb637
HBASE-25995 Change the method name for DoubleArrayCost.setCosts (#3381)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-06-15 11:53:00 +08:00
Andrew Purtell e551cd6b60 Amend HBASE-26003 Update downloads.xml for release 2.4.4
Fix typo (informational only nit)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-06-14 17:49:31 -07:00
Andrew Purtell 0c0ea5ec4e HBASE-26003 Update downloads.xml for release 2.4.4
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-06-14 17:46:47 -07:00
Toshihiro Suzuki 4262887432 HBASE-26002 MultiRowMutationEndpoint should return the result of the conditional update (addendum)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-15 09:42:49 +09:00
Andrew Purtell 97f90e0be2
HBASE-25994 Active WAL tailing fails when WAL value compression is enabled (#3377)
Depending on which compression codec is used, a short read of the
compressed bytes can cause catastrophic errors that confuse the WAL reader.
This problem can manifest when the reader is actively tailing the WAL for
replication. To avoid these issues when WAL value compression is enabled,
BoundedDelegatingInputStream should assume enough bytes are available to
supply a reader up to its bound. This behavior is valid per the contract
of available(), which provides an _estimate_ of available bytes, and
equivalent to IOUtils.readFully but without requiring an intermediate
buffer.

Added TestReplicationCompressedWAL and TestReplicationValueCompressedWAL.
Without the WALCellCodec change TestReplicationValueCompressedWAL will
fail.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-06-14 17:16:31 -07:00
Toshihiro Suzuki a35ec994b9 HBASE-26002 MultiRowMutationEndpoint should return the result of the conditional update (addendum)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-15 08:03:30 +09:00
Toshihiro Suzuki ec31818574
HBASE-26002 MultiRowMutationEndpoint should return the result of the conditional update (#3384) 2021-06-15 07:43:27 +09:00
Michael Stack ba6995e083
HBASE-25989 FanOutOneBlockAsyncDFSOutput using shaded protobuf in hdfs 3.3+ (#3368)
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-12 07:27:34 -07:00
Reid Chan ad44577d63 HBASE-25999 Add 1.7.0 to download page 2021-06-12 15:50:11 +08:00
Mate Szalay-Beko 6b81ff94a5
HBASE-25993 Make excluded SSL cipher suites configurable for all Web UIs (#3375)
When starting a jetty http server, one can explicitly exclude certain (unsecure)
SSL cipher suites. This can be especially important, when the HBase cluster
needs to be compliant with security regulations (e.g. FIPS).

Currently it is possible to set the excluded ciphers for the ThriftServer
("hbase.thrift.ssl.exclude.cipher.suites") or for the RestServer
("hbase.rest.ssl.exclude.cipher.suites"), but one can not configure it for the
regular InfoServer started by e.g. the master or region servers.

In this commit I want to introduce a new configuration
"ssl.server.exclude.cipher.list" to configure the excluded cipher suites for the
http server started by the InfoServer. This parameter has the same name and will
work in the same way, as it was already implemented in hadoop (e.g. for hdfs/yarn).
See: HADOOP-12668, HADOOP-14341

Co-authored-by: Mate Szalay-Beko <symat@apache.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-06-10 16:47:54 +02:00
bsglz 329f0baa98
HBASE-25967 The readRequestsCount does not calculate when the outResu… (#3351)
* HBASE-25967 The readRequestsCount does not calculate when the outResults is empty

Co-authored-by: Zheng Wang <wangzheng@apache.org>
2021-06-10 09:37:31 +08:00
Mate Szalay-Beko 7f7a293cb5
HBASE-25987 Make SSL keystore type configurable for HBase ThriftServer (#3367)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.com>
2021-06-09 16:51:45 +01:00
Xiaolin Ha 471e8159f0
HBASE-25981 JVM crash when displaying RegionServer UI (#3364)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-09 18:11:18 +08:00
Michael Stack 1654dcfbfb
HBASE-25969 Purge netty-all transitive includes (#3353) (#3365)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
Signed-off-by: Xiaolin Ha
2021-06-08 21:33:15 -07:00
Pankaj be14605898
HBASE-25918 Upgrade hbase-thirdparty dependency to 3.5.1 (#3317)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-08 09:37:46 +08:00
GeorryHuang 40a3d57628
HBASE-22708 Remove the deprecated methods in Hbck interface (#3362)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-08 09:33:08 +08:00
GeorryHuang 456c7f964a
HBASE-25977 Remove 2.2.7 from download page (#3361)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-07 11:43:15 +08:00
Duo Zhang eddf4cc3a1
HBASE-25963 HBaseCluster should be marked as IA.Public (#3348)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-06-06 21:20:59 +08:00
Peter Somogyi de06e20e0a
HBASE-25970 MOB data loss - incorrect concatenation of MOB_FILE_REFS (#3355)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2021-06-05 08:57:26 +02:00
Haoning Sun 1ecff8a390
HBASE-25930 Thrift does not support requests in Kerberos environment (#3326)
Co-authored-by: sunhaoning <sunhaoning@qianxin.com>
Signed-off-by: Istvan Toth <stoty@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
2021-06-04 08:15:25 +02:00
meiyi 4671cb1801
HBASE-25929 RegionServer JVM crash when compaction (#3318)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-03 17:17:17 +08:00
xijiawen 426c3c16f3
HBASE-25799 add clusterReadRequests and clusterWriteRequests jmx (#3188)
* HBASE-25799 add clusterReadRequests and clusterWriteRequests jmx

Co-authored-by: stevenxi <stevenxi@tencent.com>
2021-06-03 15:48:03 +08:00
Andrew Purtell 335305e0cf
HBASE-25911 Replace calls to System.currentTimeMillis with EnvironmentEdgeManager.currentTime (#3302)
We introduced EnvironmentEdgeManager as a way to inject alternate clocks
for unit tests. In order for this to be effective, all callers that would
otherwise use System.currentTimeMillis() must call
EnvironmentEdgeManager.currentTime() instead, except the implementers of
EnvironmentEdge.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-06-01 09:57:48 -07:00
Andrew Purtell e9f595307a HBASE-25956 Add 2.4.3 to download page
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-06-01 09:40:48 -07:00
Bharath Vissapragada 4fb0861214
HBASE-25932 addendum: Add test comments. (#3344)
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
2021-06-01 08:03:25 -07:00
Bharath Vissapragada b04c3c7786
HBASE-25932: Ensure replication reads the trailer bytes from WAL. (#3332)
This bug was exposed by the test from HBASE-25924. Since this wal
implementations close the wal asynchronously, replication can potentially
miss the trailer bytes. (see jira comment for detailed analysis).

While this is not a correctness problem (since trailer does not have any entry data),
it erroneously bumps a metric that is used to track skipped bytes in WAL resulting
in false alarms which is something we should avoid.

Reviewed-by: Rushabh Shah <rushabh.shah@salesforce.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
2021-05-31 22:12:47 -07:00
Duo Zhang 06c6e06803
HBASE-25916 Move FavoredNodeLoadBalancer to hbase-balancer module (#3327)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-05-31 22:55:04 +08:00
Anoop Sam John 1ccba10847
HBASE-25903 ReadOnlyZKClient APIs - CompletableFuture.get() calls can cause threads to hang forver when ZK client create throws Non IOException (#3293)
Signed-off-by: zhangduo <zhangduo@apache.org>
2021-05-31 11:37:40 +05:30
mokai bd4c4cec1f
HBASE-25948 Remove deprecated ZK command 'rmr' in hbase-cleanup.sh (#3343)
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2021-05-31 11:01:45 +05:30
Michael Stack d164314489
HBASE-25941 TestRESTServerSSL fails because of jdk bug (#3335)
Signed-off-by: Wei-Chiu Chuang weichiu@apache.org
2021-05-30 21:31:48 -07:00
Bharath Vissapragada 528f543e23
HBASE-25942: Get rid of null regioninfo in wrapped connection exceptions (#3337)
Reviewed-by: Tamanna Mehta
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-05-30 21:06:57 -07:00
Duo Zhang f2ff816532
HBASE-25939 Move more tests code for StochasticLoadBalancer to hbase-balancer module (#3331)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-05-30 22:00:18 +08:00
Michael Stack f119a865cf
HBASE-25940 Update Compression/TestCompressionTest: LZ4, SNAPPY, LZO (#3334)
Undo asserts that LZ4 and SNAPPY fails if their native libs are NOT
loaded; as of hadoop 3.3.1, LZ4 and SNAPPY can work w/o native libs.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-05-29 09:02:52 -07:00
Sandeep Pal 9a2027bf71
HBASE-25927: Fix the log messages by not stringifying the exceptions in log (#3338)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-05-28 21:28:19 -07:00
Duo Zhang c1d299fc1d
HBASE-25938 The SnapshotOfRegionAssignmentFromMeta.initialize call in FavoredNodeLoadBalancer is just a dummy one (#3329)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-05-29 11:04:41 +08:00
Victor 3f7d2897a1
HBASE-25910 - Fix port assignment test (#3308)
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-05-28 20:52:07 +05:30