Zheng Wang
64fe71dba3
HBASE-24821 simplify the logic of getRegionInfo in TestFlushFromClient to reduce redundancy code
...
Closes #2200
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-05 20:01:12 +05:30
gkanade
b0863c5832
writer null check if not initialized yet during syncrunner run ( #2201 )
...
Signed-off-by: Ramkrishna <ramkrishna@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: AnoopSamJohn<anoopsamjohn@apache.org>
2020-08-05 18:44:12 +05:30
Viraj Jasani
8979202c7a
HBASE-24795 : RegionMover to deal with unknown region while (un)loading
...
* RegionMover to ignore move failures for split/merged regions with ack mode
* Refactor MoveWithAck and MoveWithoutAck as high level classes
* UT for RegionMover gracefully handling split/merged regions while loading regions and throwing failure while loading offline regions
Closes #2172
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
2020-08-04 15:59:12 +05:30
Michael Stack
8c4f8e28e4
HBASE-24808 skip empty log cleaner delegate class names (WAS => cleaner.CleanerChore: Can NOT create CleanerDelegate= ClassNotFoundException) ( #2181 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-08-03 13:15:19 -07:00
Michael Stack
86d2e37bc6
HBASE-24767 Change default to false for HBASE-15519 per-user metrics Set hbase.regionserver.user.metrics.enabled default to false; i.e. off. ( #2132 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-08-03 11:36:19 -07:00
Zheng Wang
8b1c86a54d
HBASE-24704 Make Table Schema easier to view with multiple families
...
Closes #2182
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-08-02 23:39:09 +05:30
Sean Busbey
0806349ada
HBASE-24805 HBaseTestingUtility.getConnection should be threadsafe
...
* refactor how we use connection to rely on the access method
* refactor initialization and cleanup of the shared connection
* incompatibly change HCTU's Configuration member variable to be final so it can be safely accessed from multiple threads.
Closes #2180
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 86ebbdd8a2df89de37c2c3bd50e64292eaf28b11)
2020-08-02 00:51:03 -05:00
Anoop Sam John
86fccba0d0
HBASE-24695 FSHLog - close the current WAL file in a background thread. ( #2183 )
...
Signed-off-by: Ramkrishna <ramkrishna@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-08-01 22:46:32 +05:30
bsglz
1c45c8c7db
HBASE-24404 Support flush a single column family of region ( #2098 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2020-07-31 09:31:14 +01:00
Sean Busbey
cb179467fe
HBASE-24794 hbase.rowlock.wait.duration should not be <= 0 ( #2174 )
...
if hbase.rowlock.wait.duration is <=0 then log a message and treat it as a value of 1ms.
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 840a55761b4b3db6bfcf8ca5b7ae67509fc21566)
2020-07-30 12:50:48 -05:00
Sandeep Pal
6c61c50df7
HBASE-24788: Fix the connection leaks on getting hbase admin from unclosed connection ( #2173 )
...
Signed-off-by: Ted Yu <tyu@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-07-30 10:32:32 -07:00
ddupg
13f9f7a2c1
HBASE-24797 Move log code out of loop
...
Closes #2175
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-30 15:18:48 +05:30
Bharath Vissapragada
06236dbfcc
HBASE-20226: Parallelize region manifest deletes ( #2159 )
...
We observed this delete call to be a bottleneck for table with lots of
regions. Patch attempts to parallelize them.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit f07f30ae24e6d0e9151bb76aebf78928ec9572e3)
2020-07-29 11:08:19 -07:00
WenFeiYi
bba70f08ea
HBASE-24752 NPE/500 accessing webui on master startup
...
Closes #2148
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-29 20:24:22 +05:30
Michael Stack
20990b9c04
HBASE-24766 Document Remote Procedure Execution ( #2131 )
...
Add outline of how the mechanism works generally.
Signed-off-by: Anoop Sam John anoopsamjohn@apache.org
Signed-off-by: Viraj Jasani vjasani@apache.org
Signed-off-by: Jan Hentschel jan.hentschel@ultratendency.com
2020-07-29 07:44:01 -07:00
stack
edb4cd534c
HBASE-24632 Enable procedure-based log splitting as default in hbase3 Add deprecation of 'classic' zk-based WAL splitter.
...
Also fix three bugs:
* We were trying to delete non-empty directory; weren't doing
accounting for meta WALs where meta had moved off the server
(successfully)
* We were deleting split WALs rather than archiving them.
* We were not handling corrupt files.
Deprecations and removal of tests of old system.
2020-07-27 08:23:29 -07:00
Wellington Ramos Chevreuil
fce52fe6bb
HBASE-24758 Avoid flooding replication source RSes logs when no sinks… ( #2118 )
...
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 8c0d7fa5b8971de8bc7062675ba96a6091263776)
2020-07-27 12:43:57 +01:00
WenFeiYi
2bb76c0a51
HBASE-24665 ( #2150 )
...
Co-authored-by: wen_yi <liu.wenwen@immomo.com>
Signed-off-by: Anoop <anoopsamjohn@apache.org>
Signed-off-by: Ramkrishna <ramkrishna@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-27 16:39:49 +05:30
Viraj Jasani
6cb51cc0f0
HBASE-24757 : ReplicationSink should limit row count in batch mutation based on hbase.rpc.rows.warning.threshold ( #2136 )
...
Closes #2127
Signed-off-by: stack <stack@apache.org>
2020-07-24 20:32:40 +05:30
Guanghao Zhang
70ab0dc324
HBASE-24743 Reject to add a peer which replicate to itself earlier ( #2124 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-07-24 08:09:02 +08:00
Viraj Jasani
ce4e692699
HBASE-24718 : Generic NamedQueue framework for multiple use-cases (Refactor SlowLog responses) ( #2110 )
...
Closes #2052
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2020-07-22 11:36:19 +05:30
surbhi
33102a1265
HBASE-22146 Removing a namespace-level space quota does not remove policies against contained tables
...
Closes #1935
Signed-off-by: Josh Elser <elserj@apache.org>
2020-07-21 21:24:06 -04:00
Viraj Jasani
5bb76bf22d
Revert "HBASE-24743 Reject to add a peer which replicate to itself earlier ( #2071 )"
...
This reverts commit 5db3ec2cfb0bc44c99d7bd3bc61a45ecd258c3b6.
TestReplicationAdmin and TestReplicationShell are broken on branch-2 and master respectively
2020-07-21 20:20:51 +05:30
Mingliang Liu
3c91c33452
HBASE-24696 Include JVM information on Web UI under "Software Attributes"
...
Closes #2087
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-07-21 16:55:44 +05:30
Sanjeet Nishad
70d1b35a4b
HBASE-24714 Error message is displayed in UI of table's compaction state if any region of that table is not open
...
Closes #2047
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-21 12:35:08 +05:30
sguggilam
19d0f364ed
HBASE-24740 Enable journal logging for HBase snapshot operation ( #2104 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
(cherry picked from commit 430602aed82c09cfac6781dbd3dc5eba0dfef4af)
2020-07-20 18:56:37 -07:00
Guanghao Zhang
5db3ec2cfb
HBASE-24743 Reject to add a peer which replicate to itself earlier ( #2071 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-07-21 09:06:54 +08:00
stack
620470607e
Revert "HBASE-24718 : Generic NamedQueue framework for multiple use-cases (Refactor SlowLog responses)"
...
Causes TestAdminShell and TestThriftHBaseServiceHandler to fail 100% of the time in branch-2.
This reverts commit 8ae3480e70e8900c0c53b60f9bac69967813f1fc.
2020-07-20 14:50:03 -07:00
Wellington Ramos Chevreuil
8c89582633
HBASE-24747 Log an ERROR if HBaseSaslRpcServer initialisation fails with an uncaught exception ( #2079 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
(cherry picked from commit bd42c75cac47123368b031a0645a557106be8018)
2020-07-20 10:29:04 +01:00
Zheng Wang
0a8a7fa2ed
HBASE-24709 Support MoveCostFunction use a lower multiplier in offpeak hours
...
Closes #2099
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2020-07-19 20:11:20 +05:30
Michael Stack
552008c577
HBASE-24698 Turn OFF Canary WebUI as default ( #2037 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-07-17 15:52:21 -07:00
Zheng Wang
4001d3f2d2
HBASE-24746 The sort icons overlap the col name in master UI
...
Closes #2078
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-17 21:51:49 +05:30
Viraj Jasani
8ae3480e70
HBASE-24718 : Generic NamedQueue framework for multiple use-cases (Refactor SlowLog responses)
...
Closes #2052
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2020-07-17 19:57:05 +05:30
bsglz
ec3beaf5a2
HBASE-24664 Some changing of split region by overall region size rather than only one store size ( #2054 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2020-07-17 10:47:01 +01:00
bsglz
bf368a01bc
HBASE-24382 Flush partial stores of region filtered by seqId when archive wal due to too many wals ( #2049 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2020-07-17 10:40:50 +01:00
Lars
86f00e4749
HBASE-24742 Improve performance of SKIP vs SEEK logic.
2020-07-16 13:10:06 -07:00
huaxiangsun
0e45e377b8
HBASE-24705 MetaFixer#fixHoles() does not include the case for read replicas (i.e, replica regions are not created) ( #2062 ) ( #2068 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-14 22:38:01 -07:00
BukrosSzabolcs
7900afdb4f
HBASE-24720: Meta replicas not cleaned when disabled ( #2057 )
...
- make sure to always clean up excess meta replicas not just when their
number get decreased
- make sure NotServingRegionException is handled properly even when
wrapped
- add test
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2020-07-14 19:06:01 +02:00
WenFeiYi
e1d1304cb1
HBASE-24578 [WAL] Add a parameter to config RingBufferEventHandler's SyncFuture count
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-07-14 10:39:19 +08:00
Geoffrey Jacoby
a3567037c6
HBASE-23744 - FastPathBalancedQueueRpcExecutor should enforce queue length of 0
...
Closes #1094
Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-13 12:19:02 +05:30
Zheng Wang
fce1df9a3c
HBASE-24586 Add table level locality in table.jsp
...
Closes #2048
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-11 17:20:22 +05:30
chenglei
deff4c88d3
HBASE-24625 AsyncFSWAL.getLogFileSizeIfBeingWritten does not return the expected synced file length.( #2034 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-07-11 16:35:10 +08:00
Joseph295
ff2951e672
HBASE-24663 Add procedure process time statistics UI ( #2035 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-07-10 15:05:57 +08:00
niuyulin
eee467d119
HBASE-24653 Show snapshot owner on Master WebUI ( #2016 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-07-10 15:05:48 +08:00
XinSun
5fcffae5db
HBASE-24431 RSGroupInfo add configuration map to store something extra ( #2031 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-07-08 14:39:41 +08:00
Toshihiro Suzuki
f771fd26b4
HBASE-24650 Change the return types of the new checkAndMutate methods introduced in HBASE-8458 ( #2033 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-07-08 08:00:48 +09:00
Duo Zhang
28602d6fdb
Revert "HBASE-24625 AsyncFSWAL.getLogFileSizeIfBeingWritten does not return the expected synced file length. ( #1970 )"
...
This reverts commit f8349199290a642c91908dd13037227f9eaebb35.
2020-07-07 18:16:58 +08:00
WenFeiYi
5416cef27f
HBASE-24546 CloneSnapshotProcedure unlimited retry ( #1900 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-07-06 13:59:07 +08:00
chenglei
f834919929
HBASE-24625 AsyncFSWAL.getLogFileSizeIfBeingWritten does not return the expected synced file length. ( #1970 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-07-04 21:12:07 +08:00
Baiqiang Zhao
cb154d50aa
HBASE-24560 Add a new option of designatedfile in RegionMover
...
Closes #1901
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-07-01 20:28:35 +05:30