Commit Graph

7062 Commits

Author SHA1 Message Date
tedyu b8134fe5b6 HBASE-21221 Ineffective assertion in TestFromClientSide3#testMultiRowMutations 2018-09-25 09:17:26 -07:00
zhangduo 8eaaa63114 HBASE-21217 Revisit the executeProcedure method for open/close region 2018-09-25 17:30:21 +08:00
Andrew Purtell 7ab77518a2
Amend HBASE-20704 Sometimes some compacted storefiles are not archived on region close
Forward port small logging improvements from branch-1 version of this change.
2018-09-21 16:12:33 -07:00
Guangxu Cheng 3de02d57f6
HBASE-20636 Introduce two bloom filter type : ROWPREFIX and ROWPREFIX_DELIMITED
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-09-21 16:06:39 -07:00
Michael Stack 98909f4a9d
HBASE-21214 [hbck2] setTableState just sets hbase:meta state, not in-memory state 2018-09-21 16:04:59 -07:00
openinx ddd30a2241 HBASE-21206 Scan with batch size may return incomplete cells 2018-09-20 22:36:24 +08:00
tianjingyun cd161d976e HBASE-21204 NPE when scan raw DELETE_FAMILY_VERSION and codec is not set
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-09-20 06:57:50 -07:00
Umesh Agashe dc767c06d2
HBASE-21023 Added bypassProcedure() API to HbckService 2018-09-19 15:18:16 -07:00
Michael Stack 3a0fcd56cf
HBASE-21156 [hbck2] Queue an assign of hbase:meta and bulk assign/unassign
Adds 'raw' assigns and unassigns methods to Hbck Service.

Fixes HbckService so it works when cluster is Kerberized.
2018-09-19 10:06:16 -07:00
tedyu 69431c75c1 HBASE-21102 ServerCrashProcedure should select target server where no other replicas exist for the current region - addendum fixes NPE 2018-09-19 07:17:13 -07:00
Vasudevan cebb725a9f HBASE-21102 - ServerCrashProcedure should select target server where no
other replicas exist for the current region -  fix flaky test (Ram)
2018-09-18 11:28:23 +05:30
tedyu 1cf920db43 HBASE-21160 Assertion in TestVisibilityLabelsWithDeletes#testDeleteColumnsWithoutAndWithVisibilityLabels is ignored (liubangchen) 2018-09-17 08:25:11 -07:00
Michael Stack 6d7bc0e98b HBASE-21191 Add a holding-pattern if no assign for meta or namespace (Can happen if masterprocwals have been cleared).
Add a check for hbase:meta being online before we go to read it.
If not online, move into a holding-pattern until rectified, probably
by external operator.

Incorporates bulk of patch made by Allan Yang over on HBASE-21035.

M hbase-common/src/main/java/org/apache/hadoop/hbase/util/RetryCounterFactory.java

 Add a Constructor for case where retries are for ever.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Move stuff around so that the first hbase:meta read is the AM#loadMeta.
 Previously, checking table state and/or favored nodes could end up
 trying to read a meta that was not onlined holding up master startup.
 Do similar for the namespace table. Adds new methods isMeta and
 isNamespace which check that the regions/tables are online.. if not,
 we wait logging with a back-off that assigns need to be run.

Signed-off-by: Allan Yang <allan163@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-09-16 21:44:17 -07:00
Francis Liu cdfe808892 HBASE-20704 Sometimes some compacted storefiles are not archived on region close 2018-09-16 18:26:28 -07:00
Ted Yu 9da20a4116 HBASE-21097 Flush pressure assertion may fail in testFlushThroughputTuning
Amending-Author: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-09-15 18:20:35 +08:00
Mike Drob 0075093d21
HBASE-21168 Insecure Randomness in BloomFilterUtil
Flagged by Fortify static analysis

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-12 09:51:45 -05:00
Tyler Mi 5c1b325b51 HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
Signed-off-by: Zach York <zyork@apache.org>
2018-09-11 16:23:16 -07:00
Nihal Jain c372175da4
HBASE-21021 Result returned by Append operation should be ordered
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-11 14:43:52 -07:00
Duo Zhang 2ab8122a24 HBASE-21172 Addendum fix comment 2018-09-11 17:32:01 +08:00
Duo Zhang c59ecfb961 HBASE-21172 Reimplement the retry backoff logic for ReopenTableRegionsProcedure 2018-09-11 15:13:58 +08:00
Guangxu Cheng bea26e98e6 HBASE-21173 Remove the duplicate HRegion#close in TestHRegion
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-11 11:06:23 +08:00
Guangxu Cheng 2aae247e3f HBASE-21158 Empty qualifier cell is always returned when using QualifierFilter 2018-09-10 21:32:46 +08:00
Vasudevan b09dbb443e HBASE-21102 - ServerCrashProcedure should select target server where no
other replicas exist for the current region (fix compilation issue)
2018-09-10 13:23:53 +05:30
Vasudevan dc3ada2614 HBASE-21102 ServerCrashProcedure should select target server where no
other replicas exist for the current region (Ram)
2018-09-10 13:12:02 +05:30
Toshihiro Suzuki a51c333856 HBASE-21052 After restoring a snapshot, table.jsp page for the table gets stuck 2018-09-09 10:23:50 +09:00
zhangduo b04b4b0fd1 HBASE-21144 Addendum fix race when testing whether a procedure is finished 2018-09-08 08:57:56 +08:00
Guangxu Cheng c3419be003 HBASE-21001 ReplicationObserver fails to load in HBase 2.0.0 2018-09-07 23:42:02 +08:00
Michael Stack aab3a8a870
HBASE-21155 Save on a few log strings and some churn in wal splitter by skipping out early if no logs in dir; ADDENDUM
Address review comments.

Signed-off-by: Mike Drob <mdrob@apache.org>
2018-09-06 17:25:39 -07:00
Michael Stack 3ac3249423
HBASE-21155 Save on a few log strings and some churn in wal splitter by skipping out early if no logs in dir 2018-09-06 16:52:47 -07:00
Vasudevan b3908a26ff HBASE-21161 Enable the test added in HBASE-20741 that was removed
accidentally (Ram)
2018-09-06 16:51:40 +05:30
Mingliang Liu a37c40faa5 HBASE-21138 Close HRegion instance at the end of every test in TestHRegion
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-09-06 03:59:44 -07:00
Huaxiang Sun bdc168713d HBASE-21107 add a metrics for netty direct memory 2018-09-05 16:04:25 -07:00
Guangxu Cheng b62ac3cb11 HBASE-20892 [UI] Start / End keys are empty on table.jsp 2018-09-05 09:09:04 +08:00
Vasudevan c6a65ba63f HBASE-20741 - Split of a region with replicas creates all daughter regions
and its replica in same server (Addendum for duo's comments in RB)
2018-09-04 16:38:09 +05:30
Duo Zhang f504c4d797 HBASE-21144 AssignmentManager.waitForAssignment is not stable 2018-09-04 17:07:51 +08:00
Vasudevan 83131b1ac4 HBASE-20741 Split of a region with replicas creates all daughter regions
and its replica in same server (Ram)

Signed-off-by: Huaxiang Sun, Michael Stack
2018-09-04 11:18:51 +05:30
Vasudevan e4c4035ed8 HBASE-20741 Split of a region with replicas creates all daughter regions
and its replica in same server (Ram)

Signed-off-by: Huaxiang Sun, Michael Stack
2018-09-04 11:08:03 +05:30
Reid Chan 245bb44703 HBASE-21129 Clean up duplicate codes in #equals and #hashCode methods of Filter
Signed-off-by Ted Yu <yuzhihong@gmail.com>
2018-09-04 11:09:21 +08:00
David Manning 5cca61c4d0 HBASE-21126 Configurable number of allowed failures for ZooKeeper Canary
Signed-off-by: Josh Elser <elserj@apache.org>
2018-09-03 19:27:23 -07:00
zhangduo dc79029966 HBASE-21136 NPE in MetricsTableSourceImpl.updateFlushTime 2018-09-02 18:35:45 +08:00
Allan Yang 7c1fad4992
HBASE-21083 Introduce a mechanism to bypass the execution of a stuck procedure 2018-08-30 12:23:24 -07:00
Duo Zhang 98600f1860 HBASE-21128 TestAsyncRegionAdminApi.testAssignRegionAndUnassignRegion is broken 2018-08-30 10:09:44 +08:00
Xu Cang e903ae5d5e HBASE-15728 Add Per-Table metrics back
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-08-29 15:21:00 -07:00
krish.dey fcd883b5dd HBASE-20942 Fix ArrayIndexOutOfBoundsException for RpcServer TRACE logging
Also makes the trace log message length configurable.

Signed-off-by: Josh Elser <elserj@apache.org>
2018-08-28 11:01:49 -04:00
zhangduo 3afe9fb7e6 HBASE-21017 Revisit the expected states for open/close 2018-08-28 14:49:22 +08:00
Umesh Agashe 3813f0ac3d HBASE-20941 Created and implemented HbckService in master
Added API setTableStateInMeta() to update table state only in Meta. This will be used by hbck2 tool.
2018-08-27 12:11:52 -07:00
Mingliang Liu 6dd5383033 HBASE-21071 HBaseTestingUtility::startMiniCluster() to use builder pattern
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-27 10:20:31 -07:00
tedyu 9e2732edbb HBASE-21088 HStoreFile should be closed in HStore#hasReferences 2018-08-27 09:36:44 -07:00
zhangduo 993e74b747 HBASE-21072 Addendum do not write lock file when running TestHBaseFsckReplication 2018-08-27 21:03:32 +08:00
Toshihiro Suzuki f05f116327 HBASE-21084 When cloning a snapshot including a split parent region, the split parent region of the cloned table will be online 2018-08-26 13:57:44 +09:00