Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,839 Commits 95 Branches 866 Tags
Commit Graph

8498 Commits

Author SHA1 Message Date
Andrew Purtell
4240dca4ff HBASE-25556 Frequent replication "Encountered a malformed edit" warnings (#2965) 
ProtobufLogReader#readNext may be called by code that attempts to advance
the reader but does not necessarily expect to succeed, for example
WALEntryStream#tryAdvanceEntry. Much of the logging in this method is
at TRACE level. Other logging at WARN level will be frequently emitted, as
often as several per minute, and this will cause false positive assessment
from operators that they are experiencing a bug. Fix the mixed intent with
respect to log levels in readNext. Log at only DEBUG level or below.

Signed-off-by: Sean Busbey <busbey@apache.org>
 2021-02-23 14:41:31 -08:00
Toshihiro Suzuki
9cfeec0deb HBASE-25575 Should validate Puts in RowMutations 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-02-22 11:04:09 +09:00
Toshihiro Suzuki
b78366cf50 HBASE-25574 Revisit put/delete/increment/append related RegionObserver methods 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-02-22 10:16:42 +09:00
XinSun
c1a9e8973a HBASE-25562 ReplicationSourceWALReader log and handle exception immediately without retrying (#2943) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: shahrs87
 2021-02-20 10:28:18 +08:00
shahrs87
627ac016cc
HBASE-25539: Add age of oldest wal metric (#2962) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
(cherry picked from commit 6a4c9be967f1b0c29cf937927e0b6aec929721f9)
 2021-02-18 21:26:39 -08:00
Sandeep Pal
f637a60992
HBASE-25541 : Setting the path to null when we dequeue the current log (#2959) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-02-18 11:57:01 +05:30
pustota2009
83cc05a14e
HBASE-23887 Bug fix heavyEvictionMbSizeLimit (ADDENDUM) (#2957) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-15 20:46:14 +05:30
pustota2009
79272e481b
HBASE-23887 AdaptiveLRU cache (#2934) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-13 20:12:16 +05:30
Baiqiang Zhao
56937056ea HBASE-25534 Honor TableDescriptor settings earlier in normalization (#2917) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-02-09 16:57:59 -08:00
XinSun
e7414f98fd HBASE-25559 Terminate threads of oldsources while RS is closing (#2938) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-02-09 16:57:29 +08:00
haxl
6849279023 HBASE-25507 Leak of ESTABLISHED sockets when compaction encountered "java.io.IOException: Invalid HFile block magic" (#2882) 
Signed-off-by: Ramkrishna <ramkrishna@apache.org>
Signed-off-by: stack <stack@apache.org>
 2021-02-08 22:16:18 -08:00
Michael Stack
de9bbd6968 HBASE-25542 Add client detail to scan name so when lease expires, we … (#2930) 
* HBASE-25542 Add client detail to scan name so when lease expires, we have clue on who was scanning

When we create a scanner lease, record client ip and port (removed
unnecessary store of scannerName).

Signed-off-by: Clara Xiong <clarax98007@gmail.com>
 2021-02-08 14:39:30 -08:00
Baiqiang Zhao
2989f8edb0 HBASE-25431 MAX_FILESIZE and MEMSTORE_FLUSHSIZE should not be set negative number (#2803) 
Signed-off-by: stack <stack@apache.org>
 2021-02-08 14:39:25 -08:00
XinSun
87e516da6c HBASE-25553 It is better for ReplicationTracker.getListOfRegionServers to return ServerName instead of String (#2928) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-07 19:06:46 +08:00
YutSean
829790e11a
HBASE-25543 When configuration hadoop.security.authorization is set to false, the system will still try to authorize an RPC and raise AccessDeniedException (#2929) (#2919) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
 2021-02-05 22:08:32 +05:30
Baiqiang Zhao
1b6bf2bcd0
HBASE-25554 NPE when init RegionMover (#2927) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-05 14:05:23 +05:30
Pankaj
7a8e6a7106 HBASE-24900 Make retain assignment configurable during SCP (#2313) 
Retain assignment will be useful in non-cloud scenario where RegionServer and Datanode are deployed in same machine and will avoid remote read.

Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
(cherry picked from commit a04ea7ea4493f5bc583b4d08a2a6a88e7c6b8c54)
 2021-02-01 10:55:23 +05:30
shahrs87
8055a64b80
HBASE-25536 Remove 0 length wal file from logQueue if it belongs to old sources (#2908) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-29 17:56:17 +05:30
Bharath Vissapragada
083b632c4b
HBASE-25528: Dedicated merge dispatch threadpool on master 
Adds "hbase.master.executor.merge.dispatch.threads" and defaults to 2.

Also adds additional logging that includes the number of split plans
and merge plans computed for each normalizer run.

(cherry picked from commit 36b4698cea9485f4d491612342b8c841e1c3db86)
 2021-01-28 16:15:27 -08:00
Aman Poonia
8a330d4591
HBASE-25523 Region normalizer chore thread is getting killed (#2903) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-26 11:57:17 +05:30
Duo Zhang
219273768e HBASE-25509 fix typo when resolving conflicts 2021-01-20 23:37:02 +08:00
Duo Zhang
559a1f0a28 HBASE-25509 ChoreService.cancelChore will not call ScheduledChore.cle… (#2890) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-20 23:25:30 +08:00
Christine Feng
bc827f8b5b
HBASE-25478 : Implement retries when enabling tables in TestRegionReplicaReplicationEndpoint (#2896) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-20 11:34:02 +05:30
Baiqiang Zhao
47fbff98e3 HBASE-25482 Improve SimpleRegionNormalizer#getAverageRegionSizeMb (#2858) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-01-19 14:49:01 -08:00
Baiqiang Zhao
cc5b884a8d HBASE-25513 When the table is turned on normalize, the first region may not be merged even the size is 0 (#2887) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-01-19 11:05:13 -08:00
Anjan Das
7aca7814d9
HBASE-25475 : Unset zk based wal splitting explicitly in tests (ADDENDUM) (#2891) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-17 16:35:05 +05:30
Andrew Purtell
bab2d41390 Preparing development version 2.4.2-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-01-15 10:51:49 -08:00
Akshay Sudheer
caea47ae1d HBASE-25404 Procedures table Id under master web UI gets word break to single character (#2783) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-01-15 10:32:10 -08:00
Andrew Purtell
4c3e174297 Revert "Preparing development version 2.4.2-SNAPSHOT" 
This reverts commit e0aa0155423d75bd5a5d1a718fa513810afb3960.
 2021-01-15 10:19:09 -08:00
Anjan Das
dea4aa97ea
HBASE-25475: Improve UT added as part of HBASE-25445 in TestSplitWALManager (#2855) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-01-15 12:36:38 +05:30
Andrew Purtell
e0aa015542 Preparing development version 2.4.2-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-01-14 12:55:38 -08:00
Andrew Purtell
67a87017b4 Revert "Preparing development version 2.4.2-SNAPSHOT" 
This reverts commit 00fec5a2f7cdb2e715d8b58c3cb2ece65e24feb6.
 2021-01-14 12:54:05 -08:00
Andrew Purtell
00fec5a2f7 Preparing development version 2.4.2-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-01-14 11:43:50 -08:00
Andrew Purtell
3f495149e9 Revert "Preparing development version 2.4.2-SNAPSHOT" 
This reverts commit 9f17bd2f1bd86465d700c69f25313f4c7971139d.
 2021-01-14 11:00:42 -08:00
Tak Lon (Stephen) Wu
83a6ca54bd Backport "HBASE-25249 Adding StoreContext" to branch-2 (#2869) 
Co-authored-by: Abhishek Khanna <akkhanna@amazon.com>

Signed-off-by: Zach York <zyork@apache.org>
 2021-01-14 10:56:26 -08:00
Andrew Purtell
9f17bd2f1b Preparing development version 2.4.2-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-01-13 18:03:20 -08:00
Andrew Purtell
422a8cc32d Revert "Preparing development version 2.4.2-SNAPSHOT" 
This reverts commit 29619049b2d4afb32a4470f5131e258e3e44f87b.
 2021-01-13 17:44:09 -08:00
Andrew Purtell
29619049b2 Preparing development version 2.4.2-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-01-13 11:39:43 -08:00
Andrew Purtell
645b564310 HBASE-25504 [branch-2.4] Restore method removed by HBASE-25277 to LP(CONFIG) coprocessors 
Restore removed method overrides for AccessController and VisibilityController,
which are both LimitedPrivate(CONFIG) interfaces and per compatibility
guidelines cannot have methods removed in patch releases.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-01-13 11:04:19 -08:00
Andrew Purtell
6125d4ef84 Revert "[branch-2.4] Restore AccessController method removed by HBASE-25277" 
This reverts commit d3b1689f6051b541f9d2428a07b6e29d55e8a792.
 2021-01-13 11:04:19 -08:00
caroliney14
a35a8ad5f3
HBASE-25329 Dump ritsOverThreshold in logs (#2761) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-01-14 00:10:06 +05:30
Andrew Purtell
d3b1689f60 [branch-2.4] Restore AccessController method removed by HBASE-25277 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-01-13 10:24:09 -08:00
Andrew Purtell
85075940c0 Revert "Preparing development version 2.4.2-SNAPSHOT" 
This reverts commit 51c55fcc2f9190e946c7ac0ffd03d39c15072c02.
 2021-01-13 10:24:09 -08:00
Andrew Purtell
51c55fcc2f Preparing development version 2.4.2-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-01-12 17:06:38 -08:00
Andrew Purtell
35044cc40c Preparing hbase release 2.4.1RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-01-12 17:06:33 -08:00
Viraj Jasani
e8279b26fa HBASE-25211 : Rack awareness in RegionMover (#2795) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-01-12 15:37:53 -08:00
Wellington Ramos Chevreuil
cc12edbe17 HBASE-24813 ReplicationSource should clear buffer usage on Replicatio… (#2546) (#2849) 
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2021-01-12 09:45:51 +00:00
xijiawen
aa27488268 HBASE-25459 WAL can't be cleaned in some scenes (#2848) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 6a401d89f89c4c394ea7f4282edcd07afbac167a)
 2021-01-11 10:06:09 +00:00
Bo Cui
8b48c60347 HBASE-25483 set the loadMeta log level to debug (#2859) 
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
(cherry picked from commit a348204d4a77c0e15ddfd459cecfc4d3427d0a63)
 2021-01-08 19:32:48 +05:30
xijiawen
99f2b71cc9 HBASE-25434 SlowDelete & SlowPut metric value should use updateDelete & updatePut (#2837) 
Signed-off-by: Zheng Wang <wangzheng@apache.org>
(cherry picked from commit 7d70141b90d188d69e259ad5de435dad4eed5bf8)
 2021-01-08 19:02:59 +08:00