Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
15,532 Commits 95 Branches 866 Tags
Commit Graph

6925 Commits

Author SHA1 Message Date
Nihal Jain
f8281aa208 HBASE-20485 Copy constructor of Scan doesn't copy the readType and replicaId 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-05-09 16:39:57 +08:00
Guanghao Zhang
3a2a76f6f8 HBASE-20536 Make TestRegionServerAccounting stable and it should not use absolute number 2018-05-08 08:20:48 +08:00
Michael Stack
bb1a935636 HBASE-20538 TestSaslFanOutOneBlockAsyncDFSOutput failing: UnrecoverableKeyException: Rejected by the jceks.key.serialFilter or jdk.serialFilter property 
Disable test TestSaslFanOutOneBlockAsyncDFSOutput for the moment.
Depends on HDFS-13494
 2018-05-07 09:54:32 -07:00
huzheng
971f5350e8 HBASE-20531 RS may throw NPE when close meta regions in shutdown procedure. 2018-05-06 11:18:23 +08:00
jingyuntian
87f5b5f341 HBASE-20378 Provide a hbck option to cleanup replication barrier for a table 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-05-04 15:27:33 +08:00
huzheng
6225b4a492 HBASE-20481 Replicate entries from same region serially in ReplicationEndpoint for serial replication 2018-05-04 15:22:02 +08:00
Guanghao Zhang
9b9f851470 HBASE-20524 Need to clear metrics when ReplicationSourceManager refresh replication sources 2018-05-04 14:31:41 +08:00
Michael Stack
09ca619389
HBASE-20507 Do not need to call recoverLease on the broken file when we fail to create a wal writer 2018-05-03 12:30:13 -07:00
Chia-Ping Tsai
4cb444e77b
HBASE-20169 NPE when calling HBTU.shutdownMiniCluster (TestAssignmentManagerMetrics is flakey); AMENDMENT 2018-05-02 16:14:58 -07:00
Umesh Agashe
c4b4023b60 HBASE-20514 On Master restart if table is stuck in DISABLING state, CLOSED regions should not be considered stuck in-transition 
On startup CLOSED regions of DISABLED and DISABLING tables are treated the same way as not in-transition.
 2018-05-02 12:18:24 -07:00
tedyu
2e9b96e4f1 HBASE-20414 TestLockProcedure#testMultipleLocks may fail on slow machine 2018-05-02 06:39:51 -07:00
zhangduo
5bdb52af2f HBASE-20507 Do not need to call recoverLease on the broken file when we fail to create a wal writer 2018-05-02 10:26:55 +08:00
Michael Stack
5a071dbe2b HBASE-20492 UnassignProcedure is stuck in retry loop on region stuck in OPENING state 
Add backoff when stuck in RegionTransitionProcedure, the subclass of
AssignProcedure and UnassignProcedure. Can happen when we go to
transition but the current Region state is not what we expect.

M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/Procedure.java
 Add doc on being able to suspend and wait on a timeout.

M hbase-protocol-shaded/src/main/protobuf/MasterProcedure.proto
 Add 'attempt' counter so we can do backoff when we get stuck.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignProcedure.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/UnassignProcedure.java
 Add persistence of new 'attempt' counter

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionTransitionProcedure.java
 Doc data members that are persisted by subclasses given this is 'odd'.
 Add a counter for 'attempts' used when 'stuck' to implement backoff.
 Add suspend with timeout when 'stuck'. Add callback when timeout is
 exhausted which does wakeup of this procedure.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/assignment/TestUnexpectedStateException.java
 Test of backoff.
 2018-04-30 20:40:22 -07:00
Nihal Jain
6d080762ef HBASE-20499 Replication/Priority executors can use specific max queue length as default value instead of general maxQueueLength 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-04-30 07:42:32 -07:00
huzheng
a136303833 HBASE-20497 The getRecoveredQueueStartPos always return 0 in RecoveredReplicationSourceShipper 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-04-28 20:50:30 +08:00
zhangduo
4be96dd8a6 HBASE-20476 Open sequence number could go backwards in AssignProcedure 2018-04-28 06:49:50 +08:00
Balazs Meszaros
650340abb5 HBASE-20487 Sorting table regions by region name does not work on web UI 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-04-27 11:13:00 -07:00
huzheng
e9a278adc6 HBASE-20475 Fix the flaky TestReplicationDroppedTables unit test - addendum 2018-04-27 21:38:15 +08:00
zhangduo
39cf42be9a HBASE-20476 Add more logs for debugging 2018-04-27 16:02:05 +08:00
zhangduo
96ed407c69 HBASE-20476 Fix the flaky TestReplicationSmallTests unit test 2018-04-27 10:25:52 +08:00
Sakthi
f761689136 HBASE-20040 Fixed: Master UI should include "Cluster Key" needed to use the cluster as a replication sink 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-04-26 06:43:55 -05:00
huzheng
12c45cb2e8 HBASE-20475 Fix the flaky TestReplicationDroppedTables unit test. 2018-04-25 11:21:59 +08:00
Rich Fecher
a8be3bb814 HBASE-20466 Consistently use override mechanism for exempt classes in CoprocessorClassloader 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-04-23 07:47:30 -07:00
Michael Stack
1633d9d61d HBASE-20470 [2.0.0RC1] has broken unit tests... 
Fix test that depended upon flush being slow and one family only.
Fix MemStoreSize compare to allow passing alternate implementation
(needed when IMC was no longer default everywhere).
 2018-04-22 15:33:25 -07:00
Huaxiang Sun
e22f9e2d97 HBASE-19924 hbase rpc throttling does not work for multi() with request count rater. 2018-04-20 16:54:03 -07:00
Nihal Jain
758f4296a4 HBASE-20450 Provide metrics for number of total active, priority and replication rpc handlers 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-04-20 16:24:32 -07:00
Toshihiro Suzuki
4e183748c7 HBASE-20006 TestRestoreSnapshotFromClientWithRegionReplicas is flakey 
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-04-20 10:51:11 -05:00
Sean Busbey
914de11416 HBASE-20442 clean up incorrect use of commons-collections 3 
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>
 2018-04-20 07:30:34 -05:00
Sean Busbey
09749f1574 HBASE-20440 Clean up incorrect use of commons-lang 2.y 
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>
 2018-04-20 07:29:23 -05:00
Sean Busbey
b1fc00e16f HBASE-20439 Clean up incorrect use of commons-logging in hbase-server 
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>
 2018-04-20 07:27:18 -05:00
jingyuntian
556b223744 HBASE-18059 remove scanner order related code 2018-04-18 19:38:08 -07:00
Umesh Agashe
6ca8261fc0 HBASE-18792 Disabled destructive (mostly write) operations in hbck for HBase 2.0+ 
HBase server versioned is checked after connecting to the server and then following operations are not allowed:
-fix, -fixAssignments, -fixMeta, -fixHdfsHoles, -fixHdfsOrphans, -fixTableOrphans, -fixHdfsOverlaps, -maxMerge
-sidelineBigOverlaps, -maxOverlapsToSideline, -fixSplitParents, -removeParents, -fixEmptyMetaCells
-repair, -repairHoles
 2018-04-18 15:22:39 -07:00
Nihal Jain
6ce1136eba HBASE-20452 Master UI: Table merge button should validate required fields before submit 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-04-18 14:55:12 -07:00
wangyu
80cbc0d1fe HBASE-20449 The minimun number of region should be configurable in Normalizer 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-04-18 08:45:52 -07:00
Sean Busbey
824ee525df HBASE-20404 Fixes to CleanChore correctness and operability. 
* Make CleanerChore less chatty: move WARN message to DEBUG when we expect non-empty dirs
* Make CleanerChore less chatty: move IOE we'll retry to INFO
* CleanerChore should treat IOE for FileStatus as a failure
* Add tests asserting assumptions in above

Signed-off-by: Reid Chan <reidddchan@outlook.com>
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-17 11:32:44 -05:00
Balazs Meszaros
b926d359b2 HBASE-20398 Redirect doesn't work on web UI 2018-04-17 09:18:52 -07:00
Balazs Meszaros
32764bfb2c HBASE-20399 Fix merge layout 2018-04-17 09:17:25 -07:00
huzheng
42d5447cfb HBASE-20128 Add new UTs which extends the old replication UTs but set replication scope to SERIAL 2018-04-17 10:56:21 +08:00
Huaxiang Sun
1fe3d6a0e9 HBASE-19994 Create a new class for RPC throttling exception, make it retryable 2018-04-16 17:27:14 -07:00
Wei-Chiu Chuang
44ebd28093 HBASE-19963 TestFSHDFSUtils assumes wrong default port for Hadoop 3.0.1+ 
Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-04-16 12:00:17 -05:00
zhangduo
773aff90fd HBASE-20417 Do not read wal entries when peer is disabled 2018-04-16 22:07:33 +08:00
lujie
1339ff9666 HBASE-20419 Fix potential NPE in ZKUtil#listChildrenAndWatchForNewChildren callers 
Signed-off-by: Yu Li <liyu@apache.org>
 2018-04-16 16:06:57 +08:00
Peter Somogyi
125767b44e HBASE-20409 Set hbase.client.meta.operation.timeout in TestClientOperationTimeout 
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
 2018-04-15 10:12:00 +02:00
zhangduo
edf5049502 HBASE-20294 Also cleanup last pushed sequence id in ReplicationBarrierCleaner 2018-04-14 14:56:18 +08:00
zhangduo
5a633adffe HBASE-20377 Deal with table in enabling and disabling state when modifying serial replication peer 2018-04-13 20:33:29 +08:00
Guangxu Cheng
5a69465ea0 HBASE-20243 [Shell] Add shell command to create a new table by cloning the existent table 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-04-11 19:33:56 -07:00
Apekshit Sharma
281c29ff60 HBASE-20350 NullPointerException in Scanner during close() 2018-04-11 14:34:57 -07:00
Umesh Agashe
199b392ec8 HBASE-20310 Fixed false inconsistency shown by hbck -metaonly option on HBase 2 
When -metaonly option is specified then tablesInfo is not populated for all tables from hdfs causing false inconsistency of dangling state in meta.
 2018-04-11 12:51:12 -07:00
Toshihiro Suzuki
072c503ec7 HBASE-20219 An error occurs when scanning with reversed=true and loadColumnFamiliesOnDemand=true 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-04-11 09:59:45 -07:00
Balazs Meszaros
35b4adf3ed HBASE-20382 If RSGroups not enabled, rsgroup.jsp prints stack trace 2018-04-11 09:50:07 -07:00