17314 Commits

Author SHA1 Message Date
Wellington Ramos Chevreuil
dedb630da0
HBASE-24813 ReplicationSource should clear buffer usage on Replicatio… (#2453)
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-10-01 08:03:46 +01:00
Duo Zhang
b568b3e5a6 HBASE-25134 Migrate HBase PreCommit jenkins job from Hadoop to hbase (#2488) 2020-10-01 14:50:14 +08:00
Duo Zhang
f7a4cbd78c HBASE-25133 Migrate HBase Nightly jenkins job from Hadoop to hbase (#2487) 2020-10-01 14:43:55 +08:00
Duo Zhang
fc8c12e575 HBASE-25132 Migrate flaky test jenkins job from Hadoop to hbase (#2485) 2020-10-01 14:37:41 +08:00
Michael Stack
f52e5c797f
HBASE-25109 Add MR Counters to WALPlayer; currently hard to tell if it is doing anything (#2468)
Add MR counters so operator can see if WALPlayer run actually did
anything. Fix bugs in usage (it enforced two args though usage
describes allowing one arg only). Clean up usage output. In
particular add note on wal file separator as hbase by default uses
the ',' in its WAL file names which could befuddle operator
trying to do simple import.

Signed-off-by: Huaxiang Sun <huaxiangsun@apache.com>
2020-09-30 09:34:15 -07:00
Duo Zhang
f973a8087f HBASE-25103 Remove ZNodePaths.metaReplicaZNodes (#2464)
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.com>
2020-09-29 15:51:06 +08:00
Duo Zhang
e11914a8b4 HBASE-25107 Migrate flaky reporting jenkins job from Hadoop to hbase (#2466)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-29 15:26:41 +08:00
Duo Zhang
4e400f2e3e Revert "HBASE-25017 Migrate flaky reporting jenkins job from Hadoop to hbase (#2466)"
This reverts commit 5218774cf6f189cd20d96b9fc94677bffe262b2d.
2020-09-29 15:26:33 +08:00
Duo Zhang
5218774cf6 HBASE-25017 Migrate flaky reporting jenkins job from Hadoop to hbase (#2466)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-28 20:10:37 +08:00
Toshihiro Suzuki
4941fc02ea HBASE-25096 WAL size in RegionServer UI is wrong (#2456)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-28 14:49:04 +09:00
Mohammad Arshad
bd2dd21e48 HBASE-25077: hbck.jsp page loading fails, logs NPE in master log. (#2433)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj Kumar<pankajkumar@apache.org>
2020-09-27 14:06:29 +08:00
Joseph295
6b93373a0a
HBASE-25088 CatalogFamilyFormat/MetaTableAccessor.parseRegionInfoFromRegionName incorrectly setEndKey to regionId (#2462)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-09-27 11:05:16 +08:00
meiyi
0e6775c919 HBASE-25097 Wrong RIT page number in Master UI (#2458)
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
2020-09-25 18:41:36 +08:00
Bharath Vissapragada
505ceacb4b
HBASE-25082: Per table WAL metrics: appendCount and appendSize (#2440)
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Ankit Jain <jain.ankit@salesforce.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 56c7505f8f3c59261693bd8631cfcc4e709ead23)
2020-09-23 21:07:44 -07:00
Andrew Purtell
b2f2c79d8f HBASE-25079 Upgrade Bootstrap to 3.3.7 (#2442)
Signed-off-by: Viraj Jasani<virajjasani@apache.org>
2020-09-23 14:57:42 -07:00
王伟
49af9d8e91 HBASE-25073 Should not use XXXService.Interface.class.getSimpleName as stub key prefix in AsyncConnectionImpl (#2443)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-09-23 14:41:03 +08:00
stack
7a1fda667e Revert "HBASE-25068 Pass WALFactory to Replication so it knows of all WALProviders, not just default/user-space"
This reverts commit b5a242f42a919e85a72406964db95d430dd6e881.
2020-09-22 20:51:13 -07:00
stack
b5a242f42a HBASE-25068 Pass WALFactory to Replication so it knows of all WALProviders, not just default/user-space
Pass WALFactory to Replication instead of WALProvider. WALFactory has all
WALProviders in it, not just the user-space WALProvider. Do this so
ReplicationService has access to all WALProviders in the Server (To be
exploited by the follow-on patch in HBASE-25055)

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-09-22 12:07:00 -07:00
stack
97979436f8 HBASE-25067 Edit of log messages around async WAL Replication; checkstyle fixes; and a bugfix
Editing logging around region replicas: shortening and adding context.
Checkstyle fixes in edited files while I was in there.
Bug fix in AssignRegionHandler -- was using M_RS_CLOSE_META to open
a Region instead of a M_RS_OPEN_META.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-09-22 10:13:03 -07:00
lujiefsi
d638ec26ff HBASE-24976 REST Server failes to start without any error message
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-21 08:29:56 +08:00
niuyulin
5e910fa0d6
HBASE-25072 Remove the unnecessary System.out.println in MasterRegistry (#2429)
Co-authored-by: niuyulin <niuyulin@xiaomi.com>
Signed-off-by: Jan Hentschel <janh@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-20 20:12:29 +02:00
Viraj Jasani
93935e7e25
HBASE-24896 : Jira number correction in comment (ADDENDUM) 2020-09-20 14:37:14 +05:30
stack
cef1220590
HBASE-24896 'Stuck' in static initialization creating RegionInfo instance
Closes #2423

Untangle RegionInfo, RegionInfoBuilder, and MutableRegionInfo static
initializations some. Move MutableRegionInfo from inner-class of
RegionInfoBuilder to be (package private) standalone. Undo static
initializing references from RI to RIB.

Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-20 14:11:55 +05:30
Duo Zhang
fe03a35ea2 HBASE-25066 Use FutureUtils.rethrow in AsyncTableResultScanner to better catch the stack trace (#2420)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-20 11:28:01 +08:00
Mohammad Arshad
bc9921627a HBASE-25069: Display region name instead of encoded region name in HBCK report page. (#2428)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-20 09:02:13 +08:00
KevinSmile
7aa36ae10a
HBASE-24481 REST - Fix incorrect response code of get-regions in rest api
Closes #2425

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-19 19:50:12 +05:30
Joseph295
de2f538bc9 HBASE-24991 Replace MovedRegionsCleaner with guava cache (#2357)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-19 14:58:21 +08:00
Hyeran Lee
7adf80fa6c HBASE-25057: Fix typo memeber (#2414)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-09-19 14:39:50 +08:00
shahrs87
7fe07e90eb
[HBASE-24956] ConnectionManager#locateRegionInMeta waits for user region lock indefinitely. (#2322)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-Off-By: Andrew Purtell <apurtell@apache.org>
Signed-off by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-17 09:26:35 -07:00
Viraj Jasani
4316dc738c
HBASE-24528 : BalancerDecision queue implementation in HMaster with Admin API (#2411)
* Admin API getLogEntries() for ring buffer use-cases: so far, provides balancerDecision and slowLogResponse
* Refactor RPC call for similar use-cases
* Single RPC API getLogEntries() for both Master.proto and Admin.proto

Closes #2261

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-09-17 18:51:42 +05:30
Joseph295
dacedb9d07 HBASE-25047 WAL split edits number is negative in RegionServerUI (#2408)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-17 09:39:22 +08:00
Duo Zhang
0f3a66554f HBASE-25021 Nightly job should skip hadoop-2 integration test for master (#2409)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-17 09:01:11 +08:00
Duo Zhang
7a3bb8aefe HBASE-25037 Lots of thread pool are changed to non daemon after HBASE-24750 which causes trouble when shutting down (#2407)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-16 22:03:42 +08:00
XinSun
d15074981f
HBASE-25012 HBASE-24359 causes replication missed log of some RemoteException (#2383)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-16 18:00:35 +08:00
Mohammad Arshad
5a610cb055 HBASE-25009: Hbck chore logs wrong message when loading regions from RS (#2379)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-16 09:08:53 +08:00
XinSun
4d012db00f HBASE-25014 ScheduledChore is never triggered when initalDelay > 1.5*period (#2395)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-16 09:01:37 +08:00
Viraj Jasani
ddddd2a822
HBASE-24831 : Addendum for source compatibility
Closes #2403

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-09-15 20:20:26 +05:30
ramkrish86
3cb4b29fa3
HBASE-25002 Create simple pattern matching query for retrieving metri… (#2370) (#2398)
* HBASE-25002 Create simple pattern matching query for retrieving metrics matching the pattern

* Address review comments

* Final set of comments addressed

* Address checkstyle comments
2020-09-14 19:44:00 +05:30
Duo Zhang
b0c6305686 HBASE-25022 Remove 'hbase.testing.nocluster' config (#2394)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-09-14 21:26:30 +08:00
niuyulin
79eee6affc
HBASE-25016 addendum: should also close the Table which is returned by calling getMetaHTable
Closes #2393

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-14 12:40:10 +05:30
niuyulin
67233dcb42
HBASE-25016 Should close ResultScanner in MetaTableAccessor.scanByRegionEncodedName
Closes #2390

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-13 17:57:30 +05:30
Clara Xiong
4087743745
HBASE-25006 Make the cost functions optional for StochastoicBalancer
Closes #2386

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-09-13 14:20:56 +05:30
Sandeep Pal
a0e25c4dc3
HBASE-24974: Provide a flexibility to print only row key and filter for multiple tables in the WALPrettyPrinter (#2387) (#2388)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-09-12 12:49:10 -07:00
Bharath Vissapragada
a2979db27d
Revert "HBASE-24974: Provide a flexibility to print only row key and filter for multiple tables in the WALPrettyPrinter (#2387)"
This reverts commit b39199f43b18af0c4dd8e23d4a21cd45b9ec82f0.
2020-09-11 13:06:17 -07:00
Sandeep Pal
b39199f43b
HBASE-24974: Provide a flexibility to print only row key and filter for multiple tables in the WALPrettyPrinter (#2387)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-09-11 12:44:34 -07:00
Javier Akira Luca de Tena
cd66d8cba5
HBASE-24994 Add hedgedReadOpsInCurThread metric (#2367)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-09-11 13:49:11 +08:00
Toshihiro Suzuki
2a63d467f4 HBASE-24776 [hbtop] Support Batch mode (#2291)
Signed-off-by: stack <stack@apache.org>
2020-09-11 10:04:01 +09:00
ankitjain64
7df1b92528
HBASE-24764: Add support of adding default peer configs via hbase-site.xml for all replication peers. (#2284)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-09-10 10:10:58 -07:00
WenFeiYi
aa3e9dedf0 HBASE-24958 CompactingMemStore.timeOfOldestEdit error update (#2321) 2020-09-10 09:48:09 -07:00
Viraj Jasani
5018c0b380
HBASE-25004 : Log RegionTooBusyException details (#2371)
Signed-off-by: mnpoonia <apoonia@salesforce.com>
Signed-off-by: stack <stack@apache.org>
2020-09-10 21:26:49 +05:30