Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,442 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

16442 Commits

Author SHA1 Message Date
Sean Busbey 82037ee3f2 HBASE-23228 Allow for jdk8 specific modules on branch-1 in precommit/nightly testing (#804) 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-11-08 10:08:56 -06:00
chenxu14 235d03bc07 HBASE-22888 Share some stuffs with the initial reader when new stream reader created (#581) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-11-08 14:30:49 +08:00
Duo Zhang cddf8b0ae4 HBASE-23236 Upgrade to yetus 0.11.1 
Signed-off-by: stack <stack@apache.org>
 2019-11-08 13:48:07 +08:00
Karthik Palanisamy 10b38d5f82 HBASE-23263 NPE in Quotas.jsp (#800) 
Signed-off-by: Guangxu Cheng <guangxucheng@gmail.com>
 2019-11-08 09:56:35 +08:00
Karthik Palanisamy 0a20c4010f HBASE-23262 Cannot load Master UI (#799) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-11-08 09:50:32 +08:00
lijinbin e8c16a2fb9 HBASE-22480 Get block from BlockCache once and return this block to BlockCache twice make ref count error. 2019-11-08 09:35:37 +08:00
Shardul Singh d1864ae8af HBASE-22980 HRegionPartioner getPartition() method incorrectly partitions the regions of the table. (#590) 
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Guangxu Cheng <guangxucheng@gmail.com>
 2019-11-07 10:08:03 +08:00
Viraj Jasani 29c27e3d04
HBASE-23212 Dynamically reload configs for Region Recovery chore (#802) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-11-06 15:54:57 -08:00
Michael Stack ea20bb35be HBASE-21458 Error: Could not find or load main class org.apache.hadoop.hbase.util.GetJavaProperty 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-11-05 22:55:13 -06:00
ravowlga123 d4c23ee0c6
HBASE-23250 Log message about CleanerChore delegate initialization should be at INFO 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-11-05 20:23:37 +01:00
Josh Elser 46a18833a0 HBASE-23082 Backport of low latency space quotas for hbase snapshots 
Includes the following, incorporating HBASE-20439 and HBASE-20440, too.

1)
HBASE-18133 Decrease quota reaction latency by HBase

Certain operations in HBase are known to directly affect
the utilization of tables on HDFS. When these actions
occur, we can circumvent the normal path and notify the
Master directly. This results in a much faster response to
changes in HDFS usage.

This requires FS scanning by the RS to be decoupled from
the reporting of sizes to the Master. An API inside each
RS is made so that any operation can hook into this call
in the face of other operations (e.g. compaction, flush,
bulk load).

2)
HBASE-18135 Implement mechanism for RegionServers to report file archival for space quotas

This de-couples the snapshot size calculation from the
SpaceQuotaObserverChore into another API which both the periodically
invoked Master chore and the Master service endpoint can invoke. This
allows for multiple sources of snapshot size to reported (from the
multiple sources we have in HBase).

When a file is archived, snapshot sizes can be more quickly realized and
the Master can still perform periodical computations of the total
snapshot size to account for any delayed/missing/lost file archival RPCs.

3)
HBASE-20531 RS may throw NPE when close meta regions in shutdown procedure.
 2019-11-04 16:54:18 -05:00
Michael Stack ac0a605ee9 HBASE-23243 [pv2] Filter out SUCCESS procedures; on decent-sized cluster, plethora overwhelms problems (#790) 
Signed-off-by: GuangxuCheng  <guangxucheng@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-11-04 09:17:47 -08:00
Michael Stack 4f39b93a34 HBASE-23247 [hbck2] Schedule SCPs for 'Unknown Servers' (#791) 
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-11-04 09:01:25 -08:00
binlijin c8c8eef0d4 HBASE-23241 TestExecutorService sometimes fail (#782) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2019-11-04 17:19:13 +08:00
stack df04fbc6db HBASE-23244 NPEs running Canary (#784) 
Addendum to fix findbugs complaint.
 2019-11-02 09:34:53 -07:00
Michael Stack 74e17be4e2
HBASE-23244 NPEs running Canary (#784) 
Signed-off-by: Viraj Jasani <virajjasani007@gmail.com>
 2019-11-01 21:40:23 -07:00
Wellington Chevreuil 18f1aacae0 HBASE-23238 Additional test and checks for null references on ScannerCallableWithReplicas (#780) 
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 577db5d7e5)
 2019-11-01 10:32:12 +00:00
stack 55210571c2 Revert "HBASE-22917 Proc-WAL roll fails saying someone else has already created log (#544)" 
This reverts commit 834f7bf970.
 2019-10-31 10:37:08 -07:00
stack 97644e20bb Revert "Revert "HBASE-23191 EOFE log spam (#733)"" 
Reapply. Reverted wrong commit.

This reverts commit 87b4cfabda.
 2019-10-31 10:35:39 -07:00
stack 87b4cfabda Revert "HBASE-23191 EOFE log spam (#733)" 
This reverts commit f0c38e8ae6.
 2019-10-31 08:11:21 -07:00
chenxu14 26663585de HBASE-23184 The HeapAllocation in WebUI is not accurate (#730) 
Signed-off-by: stack <stack@apache.org>
 2019-10-31 17:57:52 +08:00
Michael Stack 471538ca9e HBASE-23221 Polish the WAL interface after HBASE-23181 (#774) 
Removes the closeRegion flag added by HBASE-23181 and instead
relies on reading meta WALEdit content. Modified how qualifier is
written when the meta WALEdit is for a RegionEventDescriptor
so the 'type' is added to the qualifer so can figure type
w/o having to deserialize protobuf value content: e.g.
HBASE::REGION_EVENT::REGION_CLOSE

Added doc on WALEdit and tried to formalize the 'meta' WALEdit
type and how it works. Needs complete redo in part as suggested
by HBASE-8457. Meantime, some doc and cleanup.

Also changed the LogRoller constructor to remove redundant param.
Because of constructor change, need to change also
TestFailedAppendAndSync, TestWALLockup, TestAsyncFSWAL &
WALPerformanceEvaluation.java

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
 2019-10-30 22:10:51 -07:00
binlijin 9ab0489eab HBASE-23231 ReplicationSource do not update metrics after refresh (#778) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-10-31 09:39:49 +08:00
Ankit Singhal 19adfee3d4 HBASE-23175 Yarn unable to acquire delegation token for HBase Spark jobs 2019-10-30 14:50:32 -07:00
binlijin f02757d38a HBASE-22739 ArrayIndexOutOfBoundsException when balance (#729) 
Signed-off-by: stack <stack@apache.org>
 2019-10-30 13:33:41 -07:00
Michael Stack 77de8e21e4 HBASE-23192 CatalogJanitor consistencyCheck does not log problematic row on exception (#734) 
Adds logging of row and complaint if consistency check fails during CJ
checking. Adds a few more null checks. Does edit on the 'HBCK Report'
top line.

Signed-off-by: Reid Chan <reidchan@apache.org>
 2019-10-30 13:11:11 -07:00
Pankaj 834f7bf970 HBASE-22917 Proc-WAL roll fails saying someone else has already created log (#544) 
Signed-off-by: stack <stack@apache.org>
 2019-10-30 13:00:33 -07:00
Karthik Palanisamy f0c38e8ae6 HBASE-23191 EOFE log spam (#733) 
Convert log message added for 2.2.0 from INFO to DEBUG.

Signed-off-by: stack <stack@apache.org>
 2019-10-30 12:50:11 -07:00
Ankit Singhal d5f6329fac HBASE-20827 Use backoff on CallQueueTooBigException when reporting region state transition 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-10-30 11:42:59 -04:00
Wei-Chiu Chuang d9180ab6d7 HBASE-23227 Upgrade jackson-databind to 2.9.10.1 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-10-29 21:08:02 -05:00
Karthik Palanisamy fe23e3fd5b HBASE-23208 Unit formatting in Master & RS UI 
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 257ccad31c)
 2019-10-29 10:38:07 -05:00
Wellington Chevreuil d2a027d8be HBASE-23136 PartionedMobFileCompactor bulkloaded files shouldn't get replicated (addressing buklload replication related issue raised in HBASE-22380) 
Signed-off-by: Josh Elser <elserj@apache.org>
(cherry picked from commit 4d414020bb, then resolved conflicts)
 2019-10-29 11:14:32 +00:00
binlijin cab9ccc26d HBASE-23187 Update parent region state to SPLIT in meta (#732) 
* HBASE-23187 Update parent region state to SPLIT in meta
 2019-10-29 12:42:28 +08:00
Karthik Palanisamy b18681cb3b HBASE-23199 Error populating Table-Attribute fields (#741) 
Signed-off-by: GuangxuCheng  <guangxucheng@gmail.com>
 2019-10-29 11:44:01 +08:00
Sean Busbey ff2b290268 HBASE-23222 MOB compaction supportability improvements 
* better logging on MOB compaction process
* HFileCleanerDelegate to optionally halt removal of mob hfiles
* use archiving when removing committed mob file after bulkload ref failure

closes #763

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
 2019-10-28 09:47:55 -05:00
Peter Somogyi b309617b0a HBASE-15519 Add per-user metrics with lossy counting (addendum) 2019-10-28 11:47:37 +01:00
Duo Zhang 3dba799837 HBASE-23181 Blocked WAL archive: "LogRoller: Failed to schedule flush of XXXX, because it is not online on us" (#753) 
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: stack <stack@apache.org>
 2019-10-26 20:47:29 +08:00
Viraj Jasani 33e8156ebc HBASE-22460 : Reopen regions with very high Store Ref Counts (#750) 
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
 2019-10-24 21:20:24 +05:30
Pierre Zemb d9c36e0dcf HBASE-23073 Add an optional costFunction to balance regions according to a capacity rule (#677) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 42d535a57a)
 2019-10-24 08:54:10 +01:00
Duo Zhang f19b8096f1 HBASE-23193 ConnectionImplementation.isTableAvailable can not deal with meta table on branch-2.x 2019-10-24 10:51:50 +08:00
Andrew Purtell 75dad6cd14
HBASE-23207 Log a region open journal (#751) 
Signed-off-by: Abhishek Singh Chouhan <achouhan@apache.org>
 2019-10-23 17:18:33 -07:00
Ankit Singhal ddd61aa825 HBASE-15519 Add per-user metrics with lossy counting 
Introducing property hbase.regionserver.user.metrics.enabled(Default:true)
to disable user metrics in case it accounts for any performance issues

Close #661

Signed-off-by: Josh Elser <elserj@apache.org>
 2019-10-23 11:54:16 -04:00
Caroline Zhou ee6897b2ad HBASE-23172 HBase Canary region success count metrics reflect column family successes, not region successes 2019-10-21 09:03:47 -07:00
meiyi 11bf11499f HBASE-23042 Parameters are incorrect in procedures jsp (#728) 2019-10-21 10:15:37 +08:00
meiyi d841245115 HBASE-23170 Admin#getRegionServers use ClusterMetrics.Option.SERVERS_NAME (#721) 2019-10-18 10:09:42 +08:00
chenxu14 b0b7e5f5b8 HBASE-23107 Avoid temp byte array creation when doing cacheDataOnWrite (#678) 
Signed-off-by: huzheng <openinx@gmail.com>
Signed-off-by: stack <stack@apache.org>
 2019-10-17 09:47:14 +08:00
stack cc76318f76 HBASE-23177 If fail to open reference because FNFE, make it plain it is a Reference Signed-off-by: Duo Zhang <zhangduo@apache.org> Signed-off-by: Sean Busbey <busbey@apache.org> Signed-off-by: Viraj Jasani <virajjasani007@gmail.com> 2019-10-16 12:34:06 -07:00
binlijin b909363038 HBASE-22370 ByteBuf LEAK ERROR (#720) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-10-16 20:46:50 +08:00
Guangxu Cheng f620e1dae4 HBASE-20626 Change the value of "Requests Per Second" on WEBUI 2019-10-16 15:25:19 +08:00
Guanghao Zhang 18ff188d9d HBASE-23155 May NPE when concurrent AsyncNonMetaRegionLocator#updateCachedLocationOnError (#718) 2019-10-15 11:34:12 +08:00