Commit Graph

8828 Commits

Author SHA1 Message Date
Duo Zhang 02d263e7dd
HBASE-26118 The HStore.commitFile and HStore.moveFileIntoPlace almost have the same logic (#3525)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-07-26 20:58:16 +08:00
Wei-Chiu Chuang 4a3c7d73b0
HBASE-21946 Use ByteBuffer pread instead of byte[] pread in HFileBlock when applicable (#3434)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-07-26 02:31:39 -07:00
Wei-Chiu Chuang c74366c498
HBASE-26049 Remove DfsBuilderUtility (#3444)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-07-26 02:30:22 -07:00
Duo Zhang f0324a7516
HBASE-26119 Polish TestAsyncNonMetaRegionLocator (#3526)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2021-07-26 16:57:49 +08:00
GeorryHuang 8ae394285a
HBASE-26091 Remove FirstKeyValueMatchingQualifiersFilter (#3497)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-07-25 21:12:20 +08:00
Rushabh Shah 0294c73f1f
HBASE-26093 Replication is stuck due to zero length wal file in oldWALs directory (#3504)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-07-23 09:32:55 -07:00
Peter Somogyi 3c70bc1f31
HBASE-26107 MOB compaction with missing files catches incorrect exception (#3511)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2021-07-22 10:16:03 +02:00
meiyi 9e27de6aed
HBASE-24734 RegionInfo#containsRange should support check meta table (#3496)
Signed-off-by: zhangduo <zhangduo@apache.org>
2021-07-22 16:07:52 +08:00
gkanade 21c4578f22
HBASE-24984 WAL corruption due to early DBBs re-use when Durability.ASYNC_WAL is used with multi operation (#3495)
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Anoop <anoopsamjohn@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.org>
2021-07-21 12:18:54 +05:30
Duo Zhang 16721239e7
HBASE-26100 Set version as 3.0.0-alpha-2-SNAPSHOT in master (#3508)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-07-20 23:04:08 +08:00
Aman Poonia 0f313176be
HBASE-25986 set default value of normalization enabled from hbase site (#3372)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-07-19 15:25:36 +05:30
Duo Zhang d30cc27097
HBASE-26081 Copy HBTU to hbase-testing-util, rename the HBTU related classes in hbase-server and mark them as IA.LimitedPrivate (#3478)
Signed-off-by: Michael Stack <stack@apache.org>
2021-07-19 09:29:08 +08:00
Duo Zhang 83d1bf1667
HBASE-26090 Remove the deprecated methods in Scan which should be removed in 3.0.0 (#3493)
Signed-off-by: Yi Mei <myimeiyi@gmail.com>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-07-16 22:27:22 +08:00
YutSean 3666357ba0
HBASE-26083 L1 miss metric is incorrect when using CombinedBlockCache (#3491)
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by Reid Chan <reidchan@apache.org>
2021-07-16 10:25:56 +08:00
Xiaolin Ha 0836695459
HBASE-26036 DBB released too early in HRegion.get() and dirty data for some operations (#3436)
Signed-off-by: Michael Stack <stack@apache.org>
2021-07-14 11:26:38 +08:00
Duo Zhang 9f21eec777
HBASe-26082 Mark LocalHBaseCluster as IA.Private (#3471)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2021-07-13 15:14:50 +08:00
clarax 1e763d521f
HBASE-25973 Balancer should explain progress in a better way in log (#3356)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2021-07-12 10:10:24 -07:00
mokai bb84892550
HBASE-25700 Enhance znode parent validation when add_peer (#3458)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2021-07-11 20:45:25 +08:00
Duo Zhang e65fc9226f
HBASE-26069 Remove HStore.compactRecentForTestingAssumingDefaultPolic… (#3462)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-07-07 21:34:52 +08:00
Wei-Chiu Chuang 29cd782d25
HBASE-25516 [JDK17] reflective access Field.class.getDeclaredField("modifiers") not supported (#3443)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2021-07-07 16:00:57 +08:00
Duo Zhang 7e5a0dbebf
HBASE-26068 The last assertion in TestHStore.testRefreshStoreFilesNotChanged is wrong (#3461)
Signed-off-by: Yulin Niu <niuyulin@apache.org
2021-07-07 14:34:42 +08:00
Duo Zhang a3ad97fbfc
HBASE-26065 StripeStoreFileManager does not need to throw IOException for most methods (#3459)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-07-05 22:16:00 +08:00
Viraj Jasani 1883889e26
HBASE-22923 Consider minVersionToMoveSysTables while moving region and creating regionPlan (ADDENDUM) (#3455)
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-07-03 22:41:28 +05:30
Wei-Chiu Chuang 82c44b49f5
HBASE-26050 Remove the reflection used in FSUtils.isInSafeMode (#3445)
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-07-01 23:19:03 -07:00
Wei-Chiu Chuang fab0505257
HBASE-26051 Remove reflections used to access HDFS EC APIs (#3446)
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-07-02 11:10:52 +08:00
Duo Zhang 5118321ec9
HBASE-26059 Set version as 3.0.0-alpha-1 in master in prep for first RC of 3.0.0-alpha-1 (#3453)
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2021-07-02 07:50:41 +08:00
Viraj Jasani 84f9900c99
HBASE-22923 min version of RegionServer to move system table regions (#3439) (#3438)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-07-01 16:02:37 +05:30
Viraj Jasani 4c7da496ad
HBASE-25902 Add missing CFs in meta during HBase 1 to 2 Upgrade (#3441) (#3417)
Signed-off-by: Michael Stack <stack@apache.org>
2021-07-01 15:13:25 +05:30
bsglz 147b030c1f
HBASE-26028 The view as json page shows exception when using TinyLfuBlockCache (#3420) 2021-06-30 11:36:00 +08:00
Duo Zhang 51893b9ba3
HBASE-26029 It is not reliable to use nodeDeleted event to track region server's death (#3430)
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2021-06-30 08:44:19 +08:00
Duo Zhang 64d4915ca8
HBASE-26039 TestReplicationKillRS is useless after HBASE-23956 (#3440)
Signed-off-by: Michael Stack <stack@apache.org>
2021-06-30 08:00:17 +08:00
GeorryHuang 22ec681ad9
HBASE-25980 Master table.jsp pointed at meta throws 500 when no all r… (#3374)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-27 22:30:28 +08:00
GeorryHuang fb4af2a8bf
HBASE-25914 Provide slow/large logs on RegionServer UI (#3319)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
2021-06-27 22:26:35 +08:00
GeorryHuang e6eb65733a
HBASE-26015 Should implement getRegionServers(boolean) method in Asyn… (#3406)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-27 21:58:18 +08:00
Duo Zhang 39d143f290
HBASE-26020 Split TestWALEntryStream.testDifferentCounts out (#3409)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2021-06-23 22:46:07 +08:00
litao fa2d127b7f
HBASE-25934 Add username for RegionScannerHolder (#3325)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-06-23 12:34:43 +05:30
lujiefsi d9bd29603b
HBASE-25877 Add access check for compactionSwitch (#3253)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-22 23:37:36 +08:00
belugabehr d44292ac1a
HBASE-25937: Clarify UnknownRegionException (#3330)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-22 22:36:30 +08:00
YutSean f640eef924
HBASE-26013 Get operations readRows metrics becomes zero after HBASE-25677 (#3404)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-06-22 11:38:42 +08:00
Duo Zhang c5461aaa5b HBASE-25992 Addendum add missing catch WALEntryFilterRetryableException back 2021-06-21 23:58:08 +08:00
Viraj Jasani 9f4177f7b4
HBASE-25698 Fixing IllegalReferenceCountException when using TinyLfuBlockCache (#3215)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2021-06-21 11:50:33 +05:30
Duo Zhang d2923755ec
HBASE-25992 Polish the ReplicationSourceWALReader code for 2.x after HBASE-25596 (#3376)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-06-20 16:32:42 +08:00
YutSean 53f61ef8d5
HBASE-26001 When turn on access control, the cell level TTL of Increment and Append operations is invalid (#3385)
Signed-off-by: Reid Chan <reidchan@apache.org>
2021-06-18 11:15:45 +08:00
Bharath Vissapragada 336d8464cc
HBASE-25998: Redo synchronization in SyncFuture (#3382)
Currently uses coarse grained synchronized approach that seems to
create a lot of contention. This patch

- Uses a reentrant lock instead of synchronized monitor
- Switches to a condition variable based waiting rather than busy wait
- Removed synchronization for unnecessary fields

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-06-17 12:21:05 -07:00
Duo Zhang eb242be674
HBASE-25976 Implement a master based ReplicationTracker (#3390)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-06-17 18:24:49 +08:00
Bharath Vissapragada 5a19bcfa98
HBASE-25984: Avoid premature reuse of sync futures in FSHLog (#3371)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-06-16 14:30:15 -07:00
binlijin 8f618a0846
HBASE-25997 NettyRpcFrameDecoder decode request header wrong when han… (#3380)
* HBASE-25997 NettyRpcFrameDecoder decode request header wrong when handleTooBigRequest
2021-06-15 14:25:18 +08:00
Toshihiro Suzuki 4262887432 HBASE-26002 MultiRowMutationEndpoint should return the result of the conditional update (addendum)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-15 09:42:49 +09:00
Andrew Purtell 97f90e0be2
HBASE-25994 Active WAL tailing fails when WAL value compression is enabled (#3377)
Depending on which compression codec is used, a short read of the
compressed bytes can cause catastrophic errors that confuse the WAL reader.
This problem can manifest when the reader is actively tailing the WAL for
replication. To avoid these issues when WAL value compression is enabled,
BoundedDelegatingInputStream should assume enough bytes are available to
supply a reader up to its bound. This behavior is valid per the contract
of available(), which provides an _estimate_ of available bytes, and
equivalent to IOUtils.readFully but without requiring an intermediate
buffer.

Added TestReplicationCompressedWAL and TestReplicationValueCompressedWAL.
Without the WALCellCodec change TestReplicationValueCompressedWAL will
fail.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-06-14 17:16:31 -07:00
Toshihiro Suzuki a35ec994b9 HBASE-26002 MultiRowMutationEndpoint should return the result of the conditional update (addendum)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-06-15 08:03:30 +09:00