Commit Graph

7072 Commits

Author SHA1 Message Date
ramie-raufdeen 668a179882
HBASE-19418 configurable range of delay in PeriodicMemstoreFlusher
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 14:27:07 -07:00
xcang 704f8b81bb
HBASE-18451 PeriodicMemstoreFlusher should inspect the queue before adding a delayed flush request, fix logging
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 11:50:08 -07:00
zhangduo d39ea25d44 HBASE-21244 Skip persistence when retrying for assignment related procedures 2018-09-28 21:22:23 +08:00
zhangduo 3baafbed52 HBASE-21248 Implement exponential backoff when retrying for ModifyPeerProcedure 2018-09-28 20:20:48 +08:00
Allan Yang 86cb8e48ad HBASE-21228 Memory leak since AbstractFSWAL caches Thread object and never clean later 2018-09-27 16:24:17 +08:00
Michael Stack 1154f81230 HBASE-21232 Show table state in Tables view on Master home page 2018-09-26 10:58:16 -07:00
zhangduo d7e08317d2 HBASE-21227 Implement exponential retrying backoff for Assign/UnassignRegionHandler introduced in HBASE-21217 2018-09-26 20:53:56 +08:00
Allan Yang 7b2f5950ed HBASE-21212 Wrong flush time when update flush metric 2018-09-26 19:38:15 +08:00
Zach York 0e173d38b0 HBASE-20734 Colocate recovered edits directory with hbase.wal.dir
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-26 11:20:57 +08:00
Mingliang Liu 08c4d70aaf
HBASE-21164 reportForDuty should do backoff rather than retry
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.
2018-09-25 11:32:28 -07:00
tedyu b8134fe5b6 HBASE-21221 Ineffective assertion in TestFromClientSide3#testMultiRowMutations 2018-09-25 09:17:26 -07:00
zhangduo 8eaaa63114 HBASE-21217 Revisit the executeProcedure method for open/close region 2018-09-25 17:30:21 +08:00
Andrew Purtell 7ab77518a2
Amend HBASE-20704 Sometimes some compacted storefiles are not archived on region close
Forward port small logging improvements from branch-1 version of this change.
2018-09-21 16:12:33 -07:00
Guangxu Cheng 3de02d57f6
HBASE-20636 Introduce two bloom filter type : ROWPREFIX and ROWPREFIX_DELIMITED
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-09-21 16:06:39 -07:00
Michael Stack 98909f4a9d
HBASE-21214 [hbck2] setTableState just sets hbase:meta state, not in-memory state 2018-09-21 16:04:59 -07:00
openinx ddd30a2241 HBASE-21206 Scan with batch size may return incomplete cells 2018-09-20 22:36:24 +08:00
tianjingyun cd161d976e HBASE-21204 NPE when scan raw DELETE_FAMILY_VERSION and codec is not set
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-09-20 06:57:50 -07:00
Umesh Agashe dc767c06d2
HBASE-21023 Added bypassProcedure() API to HbckService 2018-09-19 15:18:16 -07:00
Michael Stack 3a0fcd56cf
HBASE-21156 [hbck2] Queue an assign of hbase:meta and bulk assign/unassign
Adds 'raw' assigns and unassigns methods to Hbck Service.

Fixes HbckService so it works when cluster is Kerberized.
2018-09-19 10:06:16 -07:00
tedyu 69431c75c1 HBASE-21102 ServerCrashProcedure should select target server where no other replicas exist for the current region - addendum fixes NPE 2018-09-19 07:17:13 -07:00
Vasudevan cebb725a9f HBASE-21102 - ServerCrashProcedure should select target server where no
other replicas exist for the current region -  fix flaky test (Ram)
2018-09-18 11:28:23 +05:30
tedyu 1cf920db43 HBASE-21160 Assertion in TestVisibilityLabelsWithDeletes#testDeleteColumnsWithoutAndWithVisibilityLabels is ignored (liubangchen) 2018-09-17 08:25:11 -07:00
Michael Stack 6d7bc0e98b HBASE-21191 Add a holding-pattern if no assign for meta or namespace (Can happen if masterprocwals have been cleared).
Add a check for hbase:meta being online before we go to read it.
If not online, move into a holding-pattern until rectified, probably
by external operator.

Incorporates bulk of patch made by Allan Yang over on HBASE-21035.

M hbase-common/src/main/java/org/apache/hadoop/hbase/util/RetryCounterFactory.java

 Add a Constructor for case where retries are for ever.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Move stuff around so that the first hbase:meta read is the AM#loadMeta.
 Previously, checking table state and/or favored nodes could end up
 trying to read a meta that was not onlined holding up master startup.
 Do similar for the namespace table. Adds new methods isMeta and
 isNamespace which check that the regions/tables are online.. if not,
 we wait logging with a back-off that assigns need to be run.

Signed-off-by: Allan Yang <allan163@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-09-16 21:44:17 -07:00
Francis Liu cdfe808892 HBASE-20704 Sometimes some compacted storefiles are not archived on region close 2018-09-16 18:26:28 -07:00
Ted Yu 9da20a4116 HBASE-21097 Flush pressure assertion may fail in testFlushThroughputTuning
Amending-Author: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-09-15 18:20:35 +08:00
Mike Drob 0075093d21
HBASE-21168 Insecure Randomness in BloomFilterUtil
Flagged by Fortify static analysis

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-12 09:51:45 -05:00
Tyler Mi 5c1b325b51 HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
Signed-off-by: Zach York <zyork@apache.org>
2018-09-11 16:23:16 -07:00
Nihal Jain c372175da4
HBASE-21021 Result returned by Append operation should be ordered
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-11 14:43:52 -07:00
Duo Zhang 2ab8122a24 HBASE-21172 Addendum fix comment 2018-09-11 17:32:01 +08:00
Duo Zhang c59ecfb961 HBASE-21172 Reimplement the retry backoff logic for ReopenTableRegionsProcedure 2018-09-11 15:13:58 +08:00
Guangxu Cheng bea26e98e6 HBASE-21173 Remove the duplicate HRegion#close in TestHRegion
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-11 11:06:23 +08:00
Guangxu Cheng 2aae247e3f HBASE-21158 Empty qualifier cell is always returned when using QualifierFilter 2018-09-10 21:32:46 +08:00
Vasudevan b09dbb443e HBASE-21102 - ServerCrashProcedure should select target server where no
other replicas exist for the current region (fix compilation issue)
2018-09-10 13:23:53 +05:30
Vasudevan dc3ada2614 HBASE-21102 ServerCrashProcedure should select target server where no
other replicas exist for the current region (Ram)
2018-09-10 13:12:02 +05:30
Toshihiro Suzuki a51c333856 HBASE-21052 After restoring a snapshot, table.jsp page for the table gets stuck 2018-09-09 10:23:50 +09:00
zhangduo b04b4b0fd1 HBASE-21144 Addendum fix race when testing whether a procedure is finished 2018-09-08 08:57:56 +08:00
Guangxu Cheng c3419be003 HBASE-21001 ReplicationObserver fails to load in HBase 2.0.0 2018-09-07 23:42:02 +08:00
Michael Stack aab3a8a870
HBASE-21155 Save on a few log strings and some churn in wal splitter by skipping out early if no logs in dir; ADDENDUM
Address review comments.

Signed-off-by: Mike Drob <mdrob@apache.org>
2018-09-06 17:25:39 -07:00
Michael Stack 3ac3249423
HBASE-21155 Save on a few log strings and some churn in wal splitter by skipping out early if no logs in dir 2018-09-06 16:52:47 -07:00
Vasudevan b3908a26ff HBASE-21161 Enable the test added in HBASE-20741 that was removed
accidentally (Ram)
2018-09-06 16:51:40 +05:30
Mingliang Liu a37c40faa5 HBASE-21138 Close HRegion instance at the end of every test in TestHRegion
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-09-06 03:59:44 -07:00
Huaxiang Sun bdc168713d HBASE-21107 add a metrics for netty direct memory 2018-09-05 16:04:25 -07:00
Guangxu Cheng b62ac3cb11 HBASE-20892 [UI] Start / End keys are empty on table.jsp 2018-09-05 09:09:04 +08:00
Vasudevan c6a65ba63f HBASE-20741 - Split of a region with replicas creates all daughter regions
and its replica in same server (Addendum for duo's comments in RB)
2018-09-04 16:38:09 +05:30
Duo Zhang f504c4d797 HBASE-21144 AssignmentManager.waitForAssignment is not stable 2018-09-04 17:07:51 +08:00
Vasudevan 83131b1ac4 HBASE-20741 Split of a region with replicas creates all daughter regions
and its replica in same server (Ram)

Signed-off-by: Huaxiang Sun, Michael Stack
2018-09-04 11:18:51 +05:30
Vasudevan e4c4035ed8 HBASE-20741 Split of a region with replicas creates all daughter regions
and its replica in same server (Ram)

Signed-off-by: Huaxiang Sun, Michael Stack
2018-09-04 11:08:03 +05:30
Reid Chan 245bb44703 HBASE-21129 Clean up duplicate codes in #equals and #hashCode methods of Filter
Signed-off-by Ted Yu <yuzhihong@gmail.com>
2018-09-04 11:09:21 +08:00
David Manning 5cca61c4d0 HBASE-21126 Configurable number of allowed failures for ZooKeeper Canary
Signed-off-by: Josh Elser <elserj@apache.org>
2018-09-03 19:27:23 -07:00
zhangduo dc79029966 HBASE-21136 NPE in MetricsTableSourceImpl.updateFlushTime 2018-09-02 18:35:45 +08:00