Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,731 Commits 95 Branches 866 Tags
Commit Graph

8415 Commits

Author SHA1 Message Date
Michael Stack
45b3280497 HBASE-25570 On largish cluster, "CleanerChore: Could not delete dir..." makes master log unreadable (#2949) 
Turn down the amount we log. If you want to see the full exception
enable TRACE-level logging.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: shahrs87
 2021-03-11 21:36:31 -08:00
Peter Somogyi
af8dc2e4df HBASE-25587 [hbck2] Schedule SCP for all unknown servers (#2978) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-03-11 17:22:08 +01:00
meiyi
b5fc5e17e2 HBASE-25636 Expose HBCK report as metrics (#3031) 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2021-03-11 15:15:23 +08:00
Duo Zhang
d546c8e77c HBASE-25629 Reimplement TestCurrentHourProvider to not depend on unstable TZs (#3013) 
Signed-off-by: XinSun <ddupgs@gmail.com>
 2021-03-10 23:53:59 +08:00
Wellington Ramos Chevreuil
7adc00044c HBASE-25548 Optionally allow snapshots to preserve cluster's max file… (#2923) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
(cherry picked from commit 373dc7788d66ba7f7c49d727373c521c639d613c)
 2021-03-10 10:35:58 +00:00
Anoop Sam John
29d771fab9
HBASE-25582 Support setting scan ReadType to be STREAM at cluster level (#3040) 
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-03-10 13:23:15 +05:30
Narges Shadab
884cb0bd2c
HBASE-25646: Possible Resource Leak in CatalogJanitor #3036 
Close the stream using a try-with-resources block.

Reviewed-by: Aman Poonia <aman.poonia.29@gmail.com>
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
(cherry picked from commit 573daed419e381dd9cfd115f459cb5237d8b0740)
 2021-03-09 09:11:02 -08:00
Bharath Vissapragada
321b5c7979
HBASE-25547: Thread pools should release unused resources (#3037) 
* HBASE-25547: Thread pools should release unused resources (#2922)

Plumbs the configuration needed to enable core thread timeout on non-critical thread pools.
Currently only enabled for thread pools with op-codes RS_LOG_REPLAY_OPS, RS_PARALLEL_SEEK, MASTER_SNAPSHOT_OPERATIONS, MASTER_MERGE_OPERATIONS. Others can be added later as
needed.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 618236dd9040625cf38a4d98338ccff8ab35bfec)

* HBASE-25547 (addendum): Roll ExecutorType into ExecutorConfig

Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 4c822d7463589796472725524be4fa2509c7bcef)
 2021-03-09 09:03:16 -08:00
Duo Zhang
f1dfd3b0fe HBASE-23578 [UI] Master UI shows long stack traces when table is broken (#3014) 
Co-authored-by: Shuhei Yamasaki <yamasakisua@oss.nttdata.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-03-07 21:36:24 +08:00
niuyulin
88b9e98a7d HBASE-25637 Rename method completeCompaction to refreshStoreSizeAndTotalBytes (#3023) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-03-06 18:43:47 +08:00
Narges Shadab
c9d0ec903d
HBASE-25626 Possible Resource Leak in HeterogeneousRegionCountCostFunction 
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by shahrs87 <shahrs87@gmail.com>
 2021-03-05 08:56:12 +05:30
Rahul Kumar
e57c73a137
HBASE-25460 : Expose drainingServers as cluster metric (#2994) (#2995) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-03-04 12:48:57 +05:30
Andrew Purtell
dce639ae81 HBASE-25385 TestCurrentHourProvider fails if the latest timezone changes are not present (#3012) 
Disable this problematic test for now. May be removed after additional
discussion.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-03-03 18:16:20 -08:00
niuyulin
621edfe1da HBASE-25603 Add switch for compaction after bulkload (#2982) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-03-04 10:11:19 +08:00
Sandeep Pal
80b835927c
HBASE-25596: Fix NPE and avoid permanent unreplicated data due to EOF (#3008) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-03-03 11:38:46 -08:00
Akshay Sudheer
63f2c1cdac HBASE-25367 Sort broken after Change 'State time' in UI (#2964) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit 5d9a6ed1fe47f0186acf08165c3b82ff63276f35)
 2021-03-03 14:00:05 +05:30
Mohammad Arshad
1cd8638508 HBASE-25371: When openRegion fails during initial verification(before… (#2785) 
Signed-off-by: stack <stack@apache.org>
 2021-03-03 08:28:21 +08:00
Andrew Purtell
0849fae730 Revert "HBASE-25596: Fix NPE and avoid permanent unreplicated data due to EOF (#2990)" 
This reverts commit d724d0576fcafb507b32d3f6636228d559a924fa.
 2021-03-02 12:26:23 -08:00
Balazs Meszaros
f2f4b3f3ad HBASE-25586 Fix HBASE-22492 on branch-2 (SASL GapToken) (#2961) 
ServerCall.java: calling wrapWithSasl() was moved to getResponse(), so
the SASL wrapping is delayed until the reply is sent back to the client.

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-02-26 14:09:24 +01:00
XinSun
328ff8c05a HBASE-25590 Bulkload replication HFileRefs cannot be cleared in some cases where set exclude-namespace/exclude-table-cfs (#2969) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-02-26 09:58:05 +08:00
Sandeep Pal
d724d0576f
HBASE-25596: Fix NPE and avoid permanent unreplicated data due to EOF (#2990) 
Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-02-25 13:36:31 -08:00
XinSun
e863df383b HBASE-25598 TestFromClientSide5.testScanMetrics is flaky (#2977) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-02-24 14:19:36 +08:00
Andrew Purtell
fb0d7724aa HBASE-25556 Frequent replication "Encountered a malformed edit" warnings (#2965) 
ProtobufLogReader#readNext may be called by code that attempts to advance
the reader but does not necessarily expect to succeed, for example
WALEntryStream#tryAdvanceEntry. Much of the logging in this method is
at TRACE level. Other logging at WARN level will be frequently emitted, as
often as several per minute, and this will cause false positive assessment
from operators that they are experiencing a bug. Fix the mixed intent with
respect to log levels in readNext. Log at only DEBUG level or below.

Signed-off-by: Sean Busbey <busbey@apache.org>
 2021-02-23 14:41:49 -08:00
Toshihiro Suzuki
cfbae4d3a3 HBASE-25575 Should validate Puts in RowMutations 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-02-22 11:02:13 +09:00
Toshihiro Suzuki
5356edfe63 HBASE-25574 Revisit put/delete/increment/append related RegionObserver methods 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-02-22 09:51:12 +09:00
XinSun
a3edcc2854 HBASE-25562 ReplicationSourceWALReader log and handle exception immediately without retrying (#2943) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: shahrs87
 2021-02-20 10:23:54 +08:00
shahrs87
6a4c9be967
HBASE-25539: Add age of oldest wal metric (#2962) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-02-18 20:59:07 -08:00
Sandeep Pal
ec680c52e0
HBASE-25541 : Setting the path to null when we dequeue the current log (#2959) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-02-18 11:55:59 +05:30
pustota2009
d784e3f177
HBASE-23887 Bug fix heavyEvictionMbSizeLimit (ADDENDUM) (#2957) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-15 20:45:27 +05:30
Mohammad Arshad
2e31d1d46e
HBASE-25571: Compilation error in branch-2 after HBASE-25364 (#2951) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-13 21:41:04 +05:30
pustota2009
2d5a5db80e
HBASE-23887 AdaptiveLRU cache (#2934) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-13 19:58:55 +05:30
GeorryHuang
a61f1082de HBASE-25364 Redo the getMidPoint() in HFileWriterImpl to get rid of the double comparison process (#2741) 
Signed-off-by: niuyulin <nyl353@163.com>
Signed-off-by: stack <stack@apache.org>
 2021-02-10 08:31:51 -08:00
XinSun
b05dcac9fd HBASE-25559 Terminate threads of oldsources while RS is closing (#2938) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-02-09 16:40:52 +08:00
haxl
e332c9498c HBASE-25507 Leak of ESTABLISHED sockets when compaction encountered "java.io.IOException: Invalid HFile block magic" (#2882) 
Signed-off-by: Ramkrishna <ramkrishna@apache.org>
Signed-off-by: stack <stack@apache.org>
 2021-02-08 22:15:43 -08:00
Michael Stack
3c29eaed35
HBASE-25542 Add client detail to scan name so when lease expires, we … (#2930) 
* HBASE-25542 Add client detail to scan name so when lease expires, we have clue on who was scanning

When we create a scanner lease, record client ip and port (removed
unnecessary store of scannerName).

Signed-off-by: Clara Xiong <clarax98007@gmail.com>
 2021-02-08 14:33:00 -08:00
GeorryHuang
2a4e0382d2 HBASE-25550 More readable Competition Time (#2925) 2021-02-08 13:13:41 -08:00
XinSun
6fd23b2a11 HBASE-25560 Remove unused parameter named peerId in the constructor method of CatalogReplicationSourcePeer (#2939) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-08 12:30:52 -08:00
XinSun
471f52350a HBASE-25553 It is better for ReplicationTracker.getListOfRegionServers to return ServerName instead of String (#2928) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-07 18:54:44 +08:00
YutSean
eecb508e40
HBASE-25543 When configuration hadoop.security.authorization is set to false, the system will still try to authorize an RPC and raise AccessDeniedException (#2929) (#2919) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
 2021-02-05 22:07:21 +05:30
Baiqiang Zhao
fe0d888633
HBASE-25554 NPE when init RegionMover (#2927) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-05 14:04:24 +05:30
Pankaj
3896e10728 HBASE-24900 Make retain assignment configurable during SCP (#2313) 
Retain assignment will be useful in non-cloud scenario where RegionServer and Datanode are deployed in same machine and will avoid remote read.

Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
(cherry picked from commit a04ea7ea4493f5bc583b4d08a2a6a88e7c6b8c54)
 2021-02-01 10:47:19 +05:30
shahrs87
2c72225d13
HBASE-25536 Remove 0 length wal file from logQueue if it belongs to old sources (#2908) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-29 17:49:50 +05:30
Bharath Vissapragada
b930ea1ebb
HBASE-25528: Dedicated merge dispatch threadpool on master (#2910) 
Adds "hbase.master.executor.merge.dispatch.threads" and defaults to 2.

Also adds additional logging that includes the number of split plans
and merge plans computed for each normalizer run.

(cherry picked from commit 36b4698cea9485f4d491612342b8c841e1c3db86)

Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-01-28 16:09:18 -08:00
Aman Poonia
818000de7b
HBASE-25523 Region normalizer chore thread is getting killed (#2903) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-26 11:56:39 +05:30
Duo Zhang
423ffb8a76 HBASE-25509 fix typo when resolving conflicts 2021-01-20 23:35:49 +08:00
Duo Zhang
f70229b193 HBASE-25509 ChoreService.cancelChore will not call ScheduledChore.cle… (#2890) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-20 23:24:16 +08:00
Christine Feng
854f75982f
HBASE-25478 : Implement retries when enabling tables in TestRegionReplicaReplicationEndpoint (#2896) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-20 11:32:43 +05:30
Anjan Das
fbc44784db
HBASE-25475 : Unset zk based wal splitting explicitly in tests (ADDENDUM) (#2891) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-17 16:34:25 +05:30
Anjan Das
24739256aa
HBASE-25475: Improve UT added as part of HBASE-25445 in TestSplitWALManager (#2855) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-01-15 12:29:23 +05:30
Baiqiang Zhao
f391a2b865 HBASE-25431 MAX_FILESIZE and MEMSTORE_FLUSHSIZE should not be set negative number (#2803) 
Signed-off-by: stack <stack@apache.org>
 2021-01-14 22:01:50 -08:00