Commit Graph

15545 Commits

Author SHA1 Message Date
tedyu 84896deb1c HBASE-21102 ServerCrashProcedure should select target server where no other replicas exist for the current region - addendum fixes NPE 2018-09-19 07:17:55 -07:00
Vasudevan 13581e527d HBASE-21102 - ServerCrashProcedure should select target server where no
other replicas exist for the current region -  fix flaky test (Ram)
2018-09-18 11:30:49 +05:30
Michael Stack 6616fd2e0f HBASE-21191 Add a holding-pattern if no assign for meta or namespace (Can happen if masterprocwals have been cleared).
Add a check for hbase:meta being online before we go to read it.
If not online, move into a holding-pattern until rectified, probably
by external operator.

Incorporates bulk of patch made by Allan Yang over on HBASE-21035.

M hbase-common/src/main/java/org/apache/hadoop/hbase/util/RetryCounterFactory.java

 Add a Constructor for case where retries are for ever.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Move stuff around so that the first hbase:meta read is the AM#loadMeta.
 Previously, checking table state and/or favored nodes could end up
 trying to read a meta that was not onlined holding up master startup.
 Do similar for the namespace table. Adds new methods isMeta and
 isNamespace which check that the regions/tables are online.. if not,
 we wait logging with a back-off that assigns need to be run.

Signed-off-by: Allan Yang <allan163@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-09-16 21:43:48 -07:00
Francis Liu 7a1b4d449d HBASE-20704 Sometimes some compacted storefiles are not archived on region close 2018-09-16 18:28:24 -07:00
Ted Yu 966e3751c2 HBASE-21097 Flush pressure assertion may fail in testFlushThroughputTuning
Amending-Author: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-09-15 18:36:33 +08:00
Toshihiro Suzuki fb54152e8c HBASE-21182 Failed to execute start-hbase.sh 2018-09-14 22:21:10 +09:00
Sean Busbey 715b95ca5b HBASE-21189 flaky job should gather machine stats
Signed-off-by: Michael Stack <stack@apache.org>
(cherry picked from commit 5d14c1af65)
2018-09-12 23:09:08 -05:00
Michael Stack 9d13196485 HBASE-21190 Log files and count of entries in each as we load from the MasterProcWAL store 2018-09-12 10:21:12 -07:00
Mike Drob e9d23d5d25 HBASE-21168 Insecure Randomness in BloomFilterUtil
Flagged by Fortify static analysis

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-12 09:51:57 -05:00
Guangxu Cheng e1548d3349 HBASE-21179 Fix the number of actions in responseTooSlow log 2018-09-12 10:45:55 +08:00
Guangxu Cheng 45cd6ae2d9 HBASE-21174 [REST] Failed to parse empty qualifier in TableResource#getScanResource
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-09-12 10:37:40 +08:00
Tyler Mi d40348e8cd HBASE-21098 Improve Snapshot Performance with Temporary Snapshot Directory when rootDir on S3
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-11 16:31:56 -07:00
TAK LON WU b82a1d65dd
HBASE-21181 Use the same filesystem for wal archive directory and wal directory
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-11 15:50:51 -07:00
Nihal Jain c0acad92d2
HBASE-21021 Result returned by Append operation should be ordered
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-11 14:55:32 -07:00
Duo Zhang 6e699b0694 HBASE-21172 Addendum fix comment 2018-09-11 17:32:38 +08:00
Duo Zhang 55e1297d96 HBASE-21172 Reimplement the retry backoff logic for ReopenTableRegionsProcedure 2018-09-11 15:14:02 +08:00
Guangxu Cheng 52d50cc426 HBASE-21173 Remove the duplicate HRegion#close in TestHRegion
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2018-09-11 11:20:23 +08:00
Guangxu Cheng 1a7dba44ce HBASE-21158 Empty qualifier cell is always returned when using QualifierFilter 2018-09-10 21:51:48 +08:00
Vasudevan 2be9196ba7 HBASE-21102 - ServerCrashProcedure should select target server where no
other replicas exist for the current region (ram)
2018-09-10 13:31:36 +05:30
Duo Zhang d35e2f35a4 HBASE-21144 AssignmentManager.waitForAssignment is not stable 2018-09-10 12:19:04 +08:00
Michael Stack 64a32e6733 HBASE-21171 [amv2] Tool to parse a directory of MasterProcWALs standalone
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-09-09 09:28:08 -07:00
Toshihiro Suzuki 49501cd5b5 HBASE-21052 After restoring a snapshot, table.jsp page for the table gets stuck 2018-09-09 10:25:10 +09:00
Andrew Purtell 7d9e5538ba
HBASE-20307 LoadTestTool prints too much zookeeper logging (Colin Garcia) 2018-09-07 15:09:36 -07:00
Guangxu Cheng 1b65c2f161 HBASE-21001 ReplicationObserver fails to load in HBase 2.0.0 2018-09-07 23:44:03 +08:00
Guangxu Cheng de4c64c144 HBASE-21143 Update findbugs-maven-plugin to 3.0.4 2018-09-07 09:40:48 +08:00
Michael Stack 3f8c15ad2b
HBASE-21155 Save on a few log strings and some churn in wal splitter by skipping out early if no logs in dir; ADDENDUM
Address review comments.

Signed-off-by: Mike Drob <mdrob@apache.org>
2018-09-06 17:25:20 -07:00
Michael Stack 62919a3791
HBASE-21155 Save on a few log strings and some churn in wal splitter by skipping out early if no logs in dir 2018-09-06 16:45:53 -07:00
Mingliang Liu bbd9131c59 HBASE-21138 Close HRegion instance at the end of every test in TestHRegion
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-09-06 15:01:19 -07:00
Vasudevan 1798032ace HBASE-21161 Enable the test added in HBASE-20741 that was removed
accidentally (Ram)
2018-09-06 16:53:16 +05:30
Duo Zhang f61f3c7f65 HBASE-21157 Split TableInputFormatScan to individual tests 2018-09-06 13:56:36 +08:00
Huaxiang Sun 83c871add8 HBASE-21107 add a metrics for netty direct memory 2018-09-05 16:10:17 -07:00
Sean Busbey bc3ab81720 HBASE-21153 Shaded client jars should always build in relevant phase to avoid confusion
Signed-off-by: Michael Stack <stack@apache.org>
2018-09-05 16:46:16 -05:00
Guanghao Zhang d39be48f04 HBASE-21127 TableRecordReader need to handle cursor result too 2018-09-05 10:41:02 +08:00
Guangxu Cheng dee13ea401 HBASE-20892 [UI] Start / End keys are empty on table.jsp 2018-09-05 09:21:38 +08:00
Vasudevan 1a5aedab34 HBASE-20741 Split of a region with replicas creates all daughter regions
and its replica in same server (Ram)

Signed-off-by: Huaxiang Sun, Michael Stack, Duo Zhang
2018-09-04 16:26:11 +05:30
Reid Chan 0409c54ba7 HBASE-21129 Clean up duplicate codes in #equals and #hashCode methods of Filter
Signed-off-by Ted Yu <yuzhihong@gmail.com>
2018-09-04 11:15:57 +08:00
David Manning 58365c8dd2 HBASE-21126 Configurable number of allowed failures for ZooKeeper Canary
Signed-off-by: Josh Elser <elserj@apache.org>
2018-09-03 19:35:28 -07:00
zhangduo 68c5313ca4 HBASE-21136 NPE in MetricsTableSourceImpl.updateFlushTime 2018-09-02 18:32:24 +08:00
Guangxu Cheng 1a324e3a71 HBASE-21132 return wrong result in rest multiget 2018-09-02 14:27:50 +08:00
Sakthi 1cc62e9286 HBASE-20482 Printed a link to the ref guide chapter for the shell during startup
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-08-31 12:13:00 -05:00
Duo Zhang cf59f2a1d2 HBASE-21128 TestAsyncRegionAdminApi.testAssignRegionAndUnassignRegion is broken 2018-08-30 10:09:49 +08:00
Xu Cang 72a29211cc HBASE-15728 Add Per-Table metrics back
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSource.java
	hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsTableSource.java
	hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsTableWrapperAggregate.java
	hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsTableSourceImpl.java
	hbase-hadoop2-compat/src/test/java/org/apache/hadoop/hbase/regionserver/MetricsTableWrapperStub.java
	hbase-hadoop2-compat/src/test/java/org/apache/hadoop/hbase/regionserver/TestMetricsTableSourceImpl.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsTableWrapperAggregateImpl.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestMetricsTableAggregate.java
2018-08-29 16:27:15 -07:00
Allan Yang 737ac48473
HBASE-21083 Introduce a mechanism to bypass the execution of a stuck procedure 2018-08-28 20:19:55 -07:00
krish.dey 22254cf4ce HBASE-20942 Fix ArrayIndexOutOfBoundsException for RpcServer TRACE logging
Also makes the trace log message length configurable.

Signed-off-by: Josh Elser <elserj@apache.org>
2018-08-28 11:02:18 -04:00
zhangduo fc21dc854b HBASE-21017 Revisit the expected states for open/close 2018-08-28 14:49:47 +08:00
Toshihiro Suzuki 9b7c530b6c HBASE-21084 When cloning a snapshot including a split parent region, the split parent region of the cloned table will be online - addendum 2018-08-28 15:34:52 +09:00
zhangduo 7343da4178 HBASE-20968 list_procedures_test fails due to no matching regex 2018-08-28 14:23:29 +08:00
Umesh Agashe cdf5cfa396 HBASE-20941 Created and implemented HbckService in master
Added API setTableStateInMeta() to update table state only in Meta. This will be used by hbck2 tool.
2018-08-27 12:10:33 -07:00
Mingliang Liu a0cbfb8ea6 HBASE-21071 HBaseTestingUtility::startMiniCluster() to use builder pattern
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-08-27 10:22:04 -07:00
tedyu f9790b01d9 HBASE-21088 HStoreFile should be closed in HStore#hasReferences 2018-08-27 09:38:03 -07:00