Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,007 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

7814 Commits

Author SHA1 Message Date
chenxu14 34661050c8 HBASE-22888 Share some stuffs with the initial reader when new stream reader created (#581) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-11-08 13:54:53 +08:00
Bharath Vissapragada c2e01f2398 HBASE-23257: Track clusterID in stand by masters (#798) 
This patch implements a simple cache that all the masters
can lookup to serve cluster ID to clients. Active HMaster
is still responsible for creating it but all the masters
will read it from fs to serve clients.

RPCs exposing it will come in a separate patch as a part of
HBASE-18095.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Guangxu Cheng <guangxucheng@gmail.com>
 2019-11-08 10:32:44 +08:00
Karthik Palanisamy 264d3e3b16 HBASE-23263 NPE in Quotas.jsp (#800) 
Signed-off-by: Guangxu Cheng <guangxucheng@gmail.com>
 2019-11-08 09:55:57 +08:00
Karthik Palanisamy c348e642d9 HBASE-23262 Cannot load Master UI (#799) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-11-08 09:49:35 +08:00
lijinbin 02f264321b HBASE-22480 Get block from BlockCache once and return this block to BlockCache twice make ref count error. 2019-11-08 09:34:58 +08:00
Nick Dimiduk 12c19a6e51
HBASE-23230 Enforce member visibility in HRegionServer (#775) 
* Clean up a bunch of private variable leakage into other
   classes. Reduces visibility as much as possible, providing getters
   where access remains necessary or making use of getters that
   already exist. There remains an insidious relationship between
   `HRegionServer` and `RSRpcServices`.
 * Rename `fs` to `dataFs`, `rootDir` as `dataRootDir` so as to
   distinguish from the new `walFs`, `walRootDir` (and make it easier
   to spot bugs).
 * Cleanup or delete a bunch of lack-luster javadoc comments.
 * Delete a handful of methods that are unused according to static
   analysis.
 * Reduces the warning count as reported by IntelliJ from 100 to 7.

Signed-off-by: stack <stack@apache.org>
 2019-11-07 15:27:02 -08:00
ravowlga123 56e63b106c HBASE-23250 Log message about CleanerChore delegate initialization should be at INFO 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-11-05 20:21:16 +01:00
Viraj Jasani 10cc64a7d6 HBASE-23212 : Dynamically reload configs for Region Recovery chore (#773) 
* HBASE-23212 : Dynamically reload configs for Region Recovery chore

* remove redundant volatile
 2019-11-04 11:36:38 -08:00
Michael Stack 2f8860b1da HBASE-23243 [pv2] Filter out SUCCESS procedures; on decent-sized cluster, plethora overwhelms problems (#790) 
Signed-off-by: GuangxuCheng  <guangxucheng@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-11-04 09:18:09 -08:00
Michael Stack bbfc73789f HBASE-23247 [hbck2] Schedule SCPs for 'Unknown Servers' (#791) 
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-11-04 09:01:56 -08:00
binlijin 90007b7e80
HBASE-23241 TestExecutorService sometimes fail (#782) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2019-11-04 17:15:50 +08:00
stack 3ccfd50bd9 HBASE-23244 NPEs running Canary (#784) 
Addendum to fix findbugs complaint.
 2019-11-02 09:35:15 -07:00
Michael Stack c58e80fbe6 HBASE-23244 NPEs running Canary (#784) 
Signed-off-by: Viraj Jasani <virajjasani007@gmail.com>
 2019-11-01 21:41:22 -07:00
Wellington Chevreuil b8a4504a26 HBASE-23238 Additional test and checks for null references on ScannerCallableWithReplicas (#780) 
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 577db5d7e5 - Test only, removed changes from no more exisiting ScannerCallableWithReplicas class)
 2019-11-01 12:15:41 +00:00
Michael Stack e1b4a2a895 HBASE-23221 Polish the WAL interface after HBASE-23181 (#774) 
Removes the closeRegion flag added by HBASE-23181 and instead
relies on reading meta WALEdit content. Modified how qualifier is
written when the meta WALEdit is for a RegionEventDescriptor
so the 'type' is added to the qualifer so can figure type
w/o having to deserialize protobuf value content: e.g.
HBASE::REGION_EVENT::REGION_CLOSE

Added doc on WALEdit and tried to formalize the 'meta' WALEdit
type and how it works. Needs complete redo in part as suggested
by HBASE-8457. Meantime, some doc and cleanup.

Also changed the LogRoller constructor to remove redundant param.
Because of constructor change, need to change also
TestFailedAppendAndSync, TestWALLockup, TestAsyncFSWAL &
WALPerformanceEvaluation.java

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lijin Bin <binlijin@apache.org>
 2019-10-31 18:52:04 +08:00
chenxu14 255be63e1d HBASE-23184 The HeapAllocation in WebUI is not accurate (#730) 
Signed-off-by: stack <stack@apache.org>
 2019-10-31 17:53:24 +08:00
Duo Zhang 2451c2c532 HBASE-23231 Addendum remove redundant metrics.clear in ReplicationSource 
This is only a problem on master which was introduced when we merge sync replication feature branch back
 2019-10-31 09:40:43 +08:00
binlijin 3152d9981b HBASE-23231 ReplicationSource do not update metrics after refresh (#778) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-10-31 09:23:59 +08:00
Ankit Singhal 0108e57309 HBASE-23175 Yarn unable to acquire delegation token for HBase Spark jobs 2019-10-30 14:49:04 -07:00
binlijin e808ea1d04 HBASE-22739 ArrayIndexOutOfBoundsException when balance (#729) 
Signed-off-by: stack <stack@apache.org>
 2019-10-30 13:28:01 -07:00
Michael Stack 54425bf87b
HBASE-23192 CatalogJanitor consistencyCheck does not log problematic row on exception (#734) 
Adds logging of row and complaint if consistency check fails during CJ
checking. Adds a few more null checks. Does edit on the 'HBCK Report'
top line.

Signed-off-by: Reid Chan <reidchan@apache.org>
 2019-10-30 13:10:19 -07:00
Karthik Palanisamy 0a4c0b2dd6 HBASE-23191 EOFE log spam (#733) 
Convert log message added for 2.2.0 from INFO to DEBUG.

Signed-off-by: stack <stack@apache.org>
 2019-10-30 12:49:04 -07:00
Ankit Singhal 41bec4b8b1 HBASE-20827 Use backoff on CallQueueTooBigException when reporting region state transition 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-10-30 11:32:43 -04:00
Viraj Jasani 7b4dd9587b Revert "HBASE-23194 Remove unused methods from TokenUtil (#737)" 
This reverts commit d7b90b3199.
 2019-10-29 10:51:32 +01:00
binlijin 9a80618765
HBASE-23187 Update parent region state to SPLIT in meta (#732) 
* HBASE-23187 Update parent region state to SPLIT in meta
 2019-10-29 11:35:46 +08:00
Karthik Palanisamy 02370911b0 HBASE-23199 Error populating Table-Attribute fields (#741) 
Signed-off-by: GuangxuCheng  <guangxucheng@gmail.com>
 2019-10-29 11:31:25 +08:00
Sean Busbey a881678ef4 HBASE-23222 MOB compaction supportability improvements 
* better logging on MOB compaction process
* HFileCleanerDelegate to optionally halt removal of mob hfiles
* use archiving when removing committed mob file after bulkload ref failure

closes #763

Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Balazs Meszaros <meszibalu@apache.org>
 2019-10-28 08:59:01 -05:00
Duo Zhang 7b5cd0152f
HBASE-23181 Blocked WAL archive: "LogRoller: Failed to schedule flush of XXXX, because it is not online on us" (#753) 
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: stack <stack@apache.org>
 2019-10-26 20:37:37 +08:00
Viraj Jasani d7b90b3199 HBASE-23194 Remove unused methods from TokenUtil (#737) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-10-25 10:22:06 +02:00
Karthik Palanisamy 8f92a14cd1 HBASE-23203 NPE in RSGroup info (#747) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-10-25 08:43:34 +08:00
Pierre Zemb 42d535a57a HBASE-23073 Add an optional costFunction to balance regions according to a capacity rule (#677) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2019-10-24 08:46:34 +01:00
Andrew Purtell b14ba58c5a
HBASE-23207 Log a region open journal (#751) 
Signed-off-by: Abhishek Singh Chouhan <achouhan@apache.org>
 2019-10-23 17:17:06 -07:00
Ankit Singhal 59fc163e94 HBASE-15519 Add per-user metrics with lossy counting 
Introducing property hbase.regionserver.user.metrics.enabled(Default:true)
to disable user metrics in case it accounts for any performance issues

Close #661

Signed-off-by: Josh Elser <elserj@apache.org>
 2019-10-23 11:54:31 -04:00
Viraj Jasani 14dcf1d0c6 HBASE-22460 : Reopen regions with very high Store Ref Counts (#600) 
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
 2019-10-23 21:16:47 +05:30
Viraj Jasani 2ad62b0162 HBASE-22679 : Revamping CellUtil (#735) 
* HBASE-22679 : Revamping CellUtil

* checkstyle fix

* incorporating review

* minor indentation
 2019-10-21 23:04:21 -07:00
Caroline Zhou af1910ccf3 HBASE-23172 HBase Canary region success count metrics reflect column family successes, not region successes 2019-10-21 09:02:21 -07:00
meiyi da9a53ed4d
HBASE-23042 Parameters are incorrect in procedures jsp (#728) 2019-10-21 10:09:05 +08:00
Wellington Ramos Chevreuil 4d414020bb
HBASE-23136 (#712) 
* HBASE-23136 PartionedMobFileCompactor bulkloaded files shouldn't get replicated (addressing buklload replication related issue raised in HBASE-22380)

Signed-off-by: Josh Elser <elserj@apache.org>
 2019-10-18 15:07:11 +01:00
meiyi 946f1e9e25
HBASE-23170 Admin#getRegionServers use ClusterMetrics.Option.SERVERS_NAME (#721) 2019-10-18 09:35:35 +08:00
chenxu14 0043dfebc5 HBASE-23107 Avoid temp byte array creation when doing cacheDataOnWrite (#678) 
Signed-off-by: huzheng <openinx@gmail.com>
Signed-off-by: stack <stack@apache.org>
 2019-10-17 09:44:40 +08:00
stack 820a416f04 HBASE-23177 If fail to open reference because FNFE, make it plain it is a Reference 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Viraj Jasani <virajjasani007@gmail.com>
 2019-10-16 12:32:26 -07:00
binlijin 395cfceb0b HBASE-22370 ByteBuf LEAK ERROR (#720) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-10-16 20:41:27 +08:00
Guangxu Cheng 17495d812d HBASE-20626 Change the value of "Requests Per Second" on WEBUI 2019-10-16 14:25:14 +08:00
Guanghao Zhang 7924ba39e7
HBASE-23155 May NPE when concurrent AsyncNonMetaRegionLocator#updateCachedLocationOnError (#718) 2019-10-15 11:16:43 +08:00
Duo Zhang 6aec958d66
HBASE-23163 Refactor HStore.getStorefilesSize related methods (#719) 
Signed-off-by: Lijin Bin <binlijin@apache.org>
 2019-10-14 18:09:57 +08:00
Lijin Bin 9e628b715d HBASE-23159 HStore#getStorefilesSize may throw NPE 2019-10-12 19:44:42 -07:00
Andrew Purtell 73d69c6157
HBASE-23153 PrimaryRegionCountSkewCostFunction SLB function should implement CostFunction#isNeeded (#714) 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2019-10-12 13:14:13 -07:00
Karthik Palanisamy c0a09ccbbd HBASE-23152 Compaction_switch does not work by RegionServer name (#713) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 Signed-off-by: stack <stack@apache.org>
 2019-10-12 09:08:20 -07:00
zbq.dean 5848e149f4 HBASE-23056 Block count is 0 when BucketCache using persistent IOEngine and retrieve from file 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2019-10-12 14:49:11 +08:00
chenxu14 1aee5f0552 HBASE-23083 Collect Executor status info periodically and report to (#664) 
metrics system
Signed-off-by: stack <stack@apache.org>
 2019-10-11 12:05:53 -07:00