Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,528 Commits 95 Branches 866 Tags
Commit Graph

8741 Commits

Author SHA1 Message Date
Andrew Purtell
f93c9c6f15
HBASE-25385 TestCurrentHourProvider fails if the latest timezone changes are not present (#3012) 
Disable this problematic test for now. May be removed after additional
discussion.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-03-03 18:12:15 -08:00
niuyulin
e80b901e47
HBASE-25603 Add switch for compaction after bulkload (#2982) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-03-04 10:09:08 +08:00
Akshay Sudheer
5d9a6ed1fe
HBASE-25367 Sort broken after Change 'State time' in UI (#2964) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2021-03-03 13:57:42 +05:30
Narges Shadab
e099ef349b
HBASE-25626 Possible Resource Leak in HeterogeneousRegionCountCostFunction 
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by shahrs87 <shahrs87@gmail.com>
 2021-03-03 11:45:56 +05:30
Akshay Sudheer
157200ef83
HBASE-25402 Sorting order by start key or end key is not considering empty start key/end key (#2955) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2021-03-03 09:38:55 +05:30
Balazs Meszaros
a984358d9f
HBASE-25586 Fix HBASE-22492 on branch-2 (SASL GapToken) (#2961) 
ServerCall.java: calling wrapWithSasl() was moved to getResponse(), so
the SASL wrapping is delayed until the reply is sent back to the client.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-02-26 14:05:59 +01:00
XinSun
8d0de96976
HBASE-25590 Bulkload replication HFileRefs cannot be cleared in some cases where set exclude-namespace/exclude-table-cfs (#2969) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-02-26 09:50:23 +08:00
Sandeep Pal
3f1c486ddb
HBASE-25596: Fix NPE and avoid permanent unreplicated data due to EOF (#2987) 
Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-02-25 13:36:11 -08:00
XinSun
51a3d45f9d
HBASE-25598 TestFromClientSide5.testScanMetrics is flaky (#2977) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-02-24 14:15:51 +08:00
Andrew Purtell
8f03c4429f
HBASE-25556 Frequent replication "Encountered a malformed edit" warnings (#2965) 
ProtobufLogReader#readNext may be called by code that attempts to advance
the reader but does not necessarily expect to succeed, for example
WALEntryStream#tryAdvanceEntry. Much of the logging in this method is
at TRACE level. Other logging at WARN level will be frequently emitted, as
often as several per minute, and this will cause false positive assessment
from operators that they are experiencing a bug. Fix the mixed intent with
respect to log levels in readNext. Log at only DEBUG level or below.

Signed-off-by: Sean Busbey <busbey@apache.org>
 2021-02-23 14:38:45 -08:00
Toshihiro Suzuki
5fa15cfde3
HBASE-25575 Should validate Puts in RowMutations (#2954) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-02-22 10:46:16 +09:00
Toshihiro Suzuki
d8b86627ea
HBASE-25574 Revisit put/delete/increment/append related RegionObserver methods (#2953) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-02-22 09:37:30 +09:00
XinSun
ed90a14995
HBASE-25562 ReplicationSourceWALReader log and handle exception immediately without retrying (#2943) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: shahrs87
 2021-02-20 10:20:54 +08:00
shahrs87
88057d8ab6
HBASE-25539: Add age of oldest wal metric (#2945) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-02-18 20:58:24 -08:00
Sandeep Pal
1beda0d598
HBASE-25541 : Setting the path to null when we dequeue the current log (#2959) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-02-18 11:53:52 +05:30
Bharath Vissapragada
618236dd90
HBASE-25547: Thread pools should release unused resources (#2922) 
Plumbs the configuration needed to enable core thread timeout on non-critical thread pools.
Currently only enabled for thread pools with op-codes RS_LOG_REPLAY_OPS, RS_PARALLEL_SEEK, MASTER_SNAPSHOT_OPERATIONS, MASTER_MERGE_OPERATIONS. Others can be added later as
needed.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-02-16 11:12:00 -08:00
pustota2009
b6649a8784
HBASE-23887 Bug fix heavyEvictionMbSizeLimit (ADDENDUM) (#2957) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-15 20:43:33 +05:30
pustota2009
b2f85e5fd2
HBASE-23887 AdaptiveLRU cache (#2934) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-13 19:57:28 +05:30
GeorryHuang
3e743df6d0
HBASE-25364 Redo the getMidPoint() in HFileWriterImpl to get rid of the double comparison process (#2741) 
Signed-off-by: niuyulin <nyl353@163.com>
Signed-off-by: stack <stack@apache.org>
 2021-02-10 08:31:07 -08:00
Baiqiang Zhao
25e3633e62
HBASE-25534 Honor TableDescriptor settings earlier in normalization (#2917) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-02-09 16:45:26 -08:00
XinSun
4a3ff98943
HBASE-25559 Terminate threads of oldsources while RS is closing (#2938) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-02-09 16:32:46 +08:00
haxl
0353909bc2
HBASE-25507 Leak of ESTABLISHED sockets when compaction encountered "java.io.IOException: Invalid HFile block magic" (#2882) 
Signed-off-by: Ramkrishna <ramkrishna@apache.org>
Signed-off-by: stack <stack@apache.org>
 2021-02-08 22:14:00 -08:00
Michael Stack
ae063f953e HBASE-25542 Add client detail to scan name so when lease expires, we … (#2930) 
* HBASE-25542 Add client detail to scan name so when lease expires, we have clue on who was scanning

When we create a scanner lease, record client ip and port (removed
unnecessary store of scannerName).

Signed-off-by: Clara Xiong <clarax98007@gmail.com>
 2021-02-08 14:40:31 -08:00
GeorryHuang
ce9c9b453f
HBASE-25550 More readable Competition Time (#2925) 2021-02-08 13:12:24 -08:00
XinSun
355bccbd0b
HBASE-25560 Remove unused parameter named peerId in the constructor method of CatalogReplicationSourcePeer (#2939) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-08 12:29:05 -08:00
XinSun
d6aff6cbae
HBASE-25553 It is better for ReplicationTracker.getListOfRegionServers to return ServerName instead of String (#2928) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-07 17:13:47 +08:00
Baiqiang Zhao
304379605a
HBASE-25554 NPE when init RegionMover (#2927) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-05 14:01:53 +05:30
YutSean
7905749733
HBASE-25543 When configuration hadoop.security.authorization is set to false, the system will still try to authorize an RPC and raise AccessDeniedException (#2919) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
 2021-02-05 15:37:34 +08:00
stack
3a690931f5 HBASE-25546 PerfTestCompactionPolicies is failing because of NPE (addendum2); add class comment 2021-02-04 11:27:06 -08:00
robin7roy
1e8ff16eae
HBASE-25546 PerfTestCompactionPolicies is failing because of NPE (addendum) (#2926) 
Added HBaseClassTestRule for PerfTestCompactionPolicies
 2021-02-04 07:25:40 -08:00
robin7roy
d6d67d1e9f
HBASE-25546 PerfTestCompactionPolicies is failing because of NPE (#2921) 
Adds mock for getRegionInfo which was missing earlier.

Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2021-02-03 10:34:34 +05:30
Pankaj
a04ea7ea44
HBASE-24900 Make retain assignment configurable during SCP (#2313) 
Retain assignment will be useful in non-cloud scenario where RegionServer and Datanode are deployed in same machine and will avoid remote read.

Signed-off-by: Guanghao Zhang <zghao@apache.org> 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2021-02-01 10:37:57 +05:30
shahrs87
d234b4dec2
[HBASE-25536] Remove 0 length wal file from logQueue if it belongs to old sources (#2908) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-29 17:47:30 +05:30
Bharath Vissapragada
de51a40b53
HBASE-25528: Dedicated merge dispatch threadpool on master (#2904) 
Adds "hbase.master.executor.merge.dispatch.threads" and defaults to 2.

Also adds additional logging that includes the number of split plans
and merge plans computed for each normalizer run.

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-28 09:33:35 -08:00
Bo Cui
4aff481318
HBASE-25506 ServerManager#startChore affects MTTR of HMaster (#2889) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-01-28 22:55:05 +08:00
Aman Poonia
4a66f68f9c
HBASE-25523 Region normalizer chore thread is getting killed (#2903) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-26 11:55:12 +05:30
Baiqiang Zhao
0b0cdcac53
HBASE-25522 Remove deprecated methods in ReplicationPeerConfig (#2898) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-24 21:07:03 +05:30
huaxiangsun
5c13c68494
HBASE-25368 Filter out more invalid encoded name in isEncodedRegionNa… (#2868) 
HBASE-25368 Filter out more invalid encoded name in isEncodedRegionName(byte[] regionName)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-01-20 09:04:50 -08:00
Duo Zhang
a37e727990
HBASE-25509 ChoreService.cancelChore will not call ScheduledChore.cle… (#2890) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-20 16:10:36 +08:00
Baiqiang Zhao
871eb09b3d
HBASE-25482 Improve SimpleRegionNormalizer#getAverageRegionSizeMb (#2858) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-01-19 11:09:50 -08:00
Baiqiang Zhao
bc4f5c2709
HBASE-25513 When the table is turned on normalize, the first region may not be merged even the size is 0 (#2887) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-01-19 07:53:51 -08:00
Anjan Das
d5debe15b5
HBASE-25475 : Unset zk based wal splitting explicitly in tests (ADDENDUM) (#2891) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-17 16:31:07 +05:30
Christine Feng
643548f5f5
HBASE-25478 - Implement retries when enabling tables in TestRegionReplicaReplicationEndpoint (#2866) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-16 13:33:13 +05:30
Anjan Das
1474ebcc69
HBASE-25475: Improve UT added as part of HBASE-25445 in TestSplitWALManager (#2855) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-01-15 12:18:12 +05:30
Baiqiang Zhao
9b670a489b
HBASE-25431 MAX_FILESIZE and MEMSTORE_FLUSHSIZE should not be set negative number (#2803) 
Signed-off-by: stack <stack@apache.org>
 2021-01-14 22:00:50 -08:00
caroliney14
dfefff7e59
HBASE-25329 Dump ritsOverThreshold in logs (#2761) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-13 12:10:12 +05:30
Viraj Jasani
a3913a39c3
HBASE-25211 : Rack awareness in RegionMover (#2795) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-01-12 15:31:26 -08:00
Tak Lon (Stephen) Wu
686b72c44e
HBASE-25249 Adding StoreContext (#2800) 
Adding StoreContext which contains the metadata about the HStore. This
metadata can be used across the HFileWriter/Readers and other HStore
consumers without the need of passing around the complete store and
exposing its internals.

Co-authored-by: Abhishek Khanna <akkhanna@amazon.com>

Signed-off-by: stack <stack@apache.org>
Signed-off-by: Zach York <zyork@apache.org>
 2021-01-08 20:16:45 -08:00
xijiawen
5c233e9785
HBASE-25459 WAL can't be cleaned in some scenes (#2848) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-01-08 16:00:15 +00:00
Bo Cui
a348204d4a
HBASE-25483 set the loadMeta log level to debug (#2859) 
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
 2021-01-08 19:27:23 +05:30