Commit Graph

6608 Commits

Author SHA1 Message Date
Chia-Ping Tsai 2f4d0b94bc HBASE-19720 Rename WALKey#getTabnename to WALKey#getTableName 2018-02-02 19:43:26 +08:00
zhangduo fc6d140adf HBASE-19904 Break dependency of WAL constructor on Replication 2018-02-02 14:10:29 +08:00
tedyu a11258599e HBASE-19895 Add keepDeletedCells option in ScanOptions for customizing scanInfo in pre-hooks (Ankit Singhal) 2018-02-01 18:27:18 -08:00
Mike Drob 99b9fff07b HBASE-19841 Every HTU should be local until DFS starts 2018-02-01 20:24:11 -06:00
zhangduo 94dad844af HBASE-19913 Split TestStochasticLoadBalancer2 2018-02-02 08:29:28 +08:00
Michael Stack 3622bb0333 HBASE-19147 TestCacheOnWrite Times Out 2018-02-01 16:14:51 -08:00
Chia-Ping Tsai adccbb7edf HBASE-19897 RowMutations should follow the fluent pattern 2018-02-02 05:33:08 +08:00
Peter Somogyi d472422475 HBASE-19884 BucketEntryGroup's equals, hashCode and compareTo methods are not consistent
Move back to default equals and hashCode.
Remove compareTo and Comparator to PriorityQueue.

Signed-off-by: Michael Stack <stack@apache.org>
2018-02-01 13:21:58 -08:00
kewang 38c8144a06 HBASE-19912 Remove useless 'writeToWAL' flag of Region#checkAndRowMutate
Signed-off-by: Michael Stack <stack@apache.org>
2018-02-01 12:33:48 -08:00
Umesh Agashe 57911d02c6 HBASE-19839 Fixed flakey tests TestMergeTableRegionsProcedure#testRollbackAndDoubleExecution and TestSplitTableRegionProcedure#testRollbackAndDoubleExecution
* Added a comment in MergeTableRegionsProcedure and SplitTableRegionProcedure explaining specific rollbacks has side effect that AssignProcedure/s are submitted asynchronously and those procedures may continue to execute even after rollback() is done.
* Updated comments in tests with correct rollback state to abort
* Added overloaded method MasterProcedureTestingUtility#testRollbackAndDoubleExecution which takes additional argument for waiting on all procedures to finish before asserting conditions
* Updated TestMergeTableRegionsProcedure#testRollbackAndDoubleExecution and TestSplitTableRegionProcedure#testRollbackAndDoubleExecution to use newly added method

Signed-off-by: Michael Stack <stack@apache.org>
2018-02-01 12:01:30 -08:00
Michael Stack b21b8bfb91 HBASE-19906 TestZooKeeper Timeout Includes move of TestQoSFunction from smalltests to mediumtests; it timedout in a run. 2018-02-01 10:53:18 -08:00
Michael Stack 9272f40a5c HBASE-19911 Convert some tests from small to medium because they are timing out: TestNettyRpcServer, TestClientClusterStatus; ADDENDUM changes TestCheckTestClasses to be medium sized test 2018-01-31 20:27:34 -08:00
Michael Stack b9cb1187b5 HBASE-19911 Convert some tests from small to medium because they are timing out: TestNettyRpcServer, TestClientClusterStatus 2018-01-31 20:23:14 -08:00
Michael Stack e17529ba73 HBASE-19910 TestBucketCache TimesOut 2018-01-31 18:17:01 -08:00
Michael Stack 28ee4be0fe HBASE-19909 TestRegionLocationFinder Timeout 2018-01-31 17:55:16 -08:00
Michael Stack bc0e9ce8f4 HBASE-19908 TestCoprocessorShortCircuitRPC Timeout.... 2018-01-31 17:32:39 -08:00
Michael Stack 414b2d0889 HBASE-19907 TestMetaWithReplicas still flakey 2018-01-31 15:17:38 -08:00
Michael Stack 60827fc1ea HBASE-19528 Major Compaction Tool; ADDENDUM
Add @ClassRule to new tests and rename those added here so they
align w/ how we name other Test classes.
2018-01-31 14:18:24 -08:00
Rahul Gidwani 4b3b627abe HBASE-19528 - Major Compaction Tool 2018-01-31 10:18:03 -08:00
zhangduo 7c318cead9 HBASE-19887 Do not overwrite the surefire junit listener property in the pom of sub modules 2018-01-31 20:49:18 +08:00
binlijin f7faad0477 HBASE-19728 Add lock to filesCompacting in all place. 2018-01-31 14:05:30 +08:00
Peter Somogyi 194890b694
HBASE-19868 TestCoprocessorWhitelistMasterObserver is flakey
Recategorize TestCoprocessorWhitelistMasterObserver as Large test
2018-01-30 06:01:24 -08:00
Michael Stack 98c9d8f7a1 HBASE-19868 TestCoprocessorWhitelistMasterObserver is flakey 2018-01-29 21:35:28 -08:00
Peter Somogyi 34c6c99041
HBASE-19811 Fix findbugs and error-prone warnings in hbase-server (branch-2) - addendum
Signed-off-by: Michael Stack <stack@apache.org>
2018-01-29 14:03:08 -08:00
Michael Stack 0b9a0dc951
HBASE-19840 Flakey TestMetaWithReplicas; ADDENDUM to fix Checksyte 2018-01-29 09:36:30 -08:00
Michael Stack 4f547b3817
HBASE-19840 Flakey TestMetaWithReplicas
Fix two issues:

 # Meta Replicas can all be assigned to the same server. This
 will call the test to hang when we do our kill of the server
 hosting meta because there'll be no replicas to read from
 as test intends. Check is to look for this condition on
 startup and adjust if we come across it. Replicas cross-cut
 assignment. They need work.
 # Other issue was shutdown. The master started toward the
 end of the test may not have come up fully by the time
 shutdown is called. We could be stuck assigning the
 meta replicas. Have shutdown shutdown the procedure
 executor engine.

There is other cleanup and notes in the below.

M HMaster
 Remove the silly stops in startup now we have real
 means of shutting down Master during init.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterMetaBootstrap.java
 This replica stuff was doing stuff it shouldn't be doing
 like setting core Master state flags. It may have made
 sense once but now meta is assigned by a Pv2 Procedure
 so the flag setting in here is meddlesome. Clear out
 methods no longer needed.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
 Remove unused methods.
 Changes local variable names so they align w/ our naming elsewhere in
 code base.

M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMetaWithReplicas.java
 Check for all replicas on the one server.
2018-01-29 09:21:30 -08:00
zhangduo dab51c7900 HBASE-19885 Promote TestAssignmentManager to LargeTests 2018-01-30 00:24:45 +08:00
zhangduo 5b93ea1556 HBASE-19866 TestRegionServerReportForDuty doesn't timeout
Synchronized on authManager instead of RpcServer
2018-01-29 21:23:47 +08:00
zhangduo 305da1098a HBASE-19882 Promote TestProcedureManager to MediumTests 2018-01-29 17:48:44 +08:00
zhangduo f9480a56c7 HBASE-19881 Promote TestRegionReplicaReplicationEndpoint to LargeTests 2018-01-29 16:15:45 +08:00
zhangduo 94dfc7d60a HBASE-19880 Promote TestFuzzyRowFilterEndToEnd to LargeTests 2018-01-29 16:15:18 +08:00
zhangduo 80438924ff HBASE-19879 Promote TestAcidGuaranteesXXX to LargeTests 2018-01-29 14:55:04 +08:00
zhangduo 918599ef12 HBASE-19873 Add a CategoryBasedTimeout ClassRule for all UTs 2018-01-29 08:43:56 +08:00
Jan Hentschel 851e17987d HBASE-19869 TestLockManager now uses the right class for logging 2018-01-28 13:54:57 +01:00
zhangduo f1502a3aca HBASE-19867 Split TestStochasticLoadBalancer into several small tests 2018-01-27 18:25:46 +08:00
Michael Stack a5a8c4f3f2
Revert "HBASE-19841 LocalHTU to not enforce stream capabilities"
At Mike Drobs' request!
2018-01-26 15:11:50 -08:00
Mike Drob 9ea152d235 HBASE-19841 LocalHTU to not enforce stream capabilities 2018-01-26 10:50:16 -06:00
haxiaolin 94a1c051ba HBASE-19861 - Avoid using RPCs when querying table infos for master status pages
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-26 08:02:14 -08:00
Guanghao Zhang 39b912aae9 HBASE-19818 Scan time limit not work if the filter always filter row key 2018-01-26 17:02:22 +08:00
Apekshit Sharma 01c34243fe HBASE-19866 Add cateogry based timeout using Timeout Rule to TestRegionServerReportForDuty. 2018-01-26 00:30:56 -08:00
Apekshit Sharma 1beb687f4e HBASE-19862 addendum: Checkstyle fixes, remove unused imports and variables. Add @Rule for timeout. 2018-01-26 00:24:35 -08:00
Apekshit Sharma 61358985b1 HBASE-19862 Fix TestTokenAuthentication - mock RegionCoprocessorEnvironment should be of type HasRegionServerServices also. 2018-01-25 23:15:45 -08:00
Thiruvel Thirumoolan ce50830a0a HBASE-19756 Master NPE during completed failed proc eviction
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-01-24 16:42:58 -08:00
Michael Stack 970636c5af HBASE-19838 Can not shutdown backup master cleanly when it has already tried to become the active master
On Master@shutdown, close the shared Master connection to kill any
ongoing RPCs by hosted clients.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
Call close ont the Master shared clusterconnection to kill any ongoing
rpcs.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
Remove guts of close; we were closing the Masters connection....not
our responsibility.

Added unit test written by Duo Zhang which demonstrates the case where
Master will not go down.

Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-23 11:07:00 +08:00
Chia-Ping Tsai 541f8ad8a8 HBASE-4224 Need a flush by regionserver rather than by table option 2018-01-23 09:51:05 +08:00
Peter Somogyi 93a182f286 HBASE-19811 Fix findbugs and error-prone warnings in hbase-server (branch-2)
Signed-off-by: Michael Stack <stack@apache.org>
2018-01-22 17:20:59 -08:00
Michael Stack d49357f265 HBASE-19840 Flakey TestMetaWithReplicas
Adding debuging
2018-01-22 12:28:56 -08:00
Rahul Gidwani b577fa0814 HBASE-15321 - Ability to open a HRegion from hdfs snapshot. 2018-01-22 12:09:38 -08:00
Sergey Soldatov be496ba8ea HBASE-19774 incorrect behavior of locateRegionInMeta 2018-01-22 11:48:55 -08:00
Michael Stack c60359959c HBASE-19837 Flakey TestRegionLoad
Add debug, change name of the rows so readable.
2018-01-22 08:01:57 -08:00
zhangduo 86f4df5f74 HBASE-19836 Fix TestZooKeeper.testLogSplittingAfterMasterRecoveryDueToZKExpiry 2018-01-22 18:32:31 +08:00
Michael Stack f3c563fc00 HBASE-19837 Flakey TestRegionLoad
Add debug, change name of the rows so readable.
2018-01-21 23:24:23 -08:00
Michael Stack 27d00f5861 HBASE-19794 TestZooKeeper hangs
Kill backup master first

Add some cleanup around NamespaceManager

Shorten the timeout waiting on namespace manager as workaround
until we have better soln for interrupting ongoing client rpcs.
Do it in general for all tests.

Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-21 20:59:16 +08:00
Michael Stack 7fe4aa6fe4 HBASE-19828 Flakey TestRegionsOnMasterOptions.testRegionsOnAllServers
Rename the PE Worker threads.

Send an interrupt if worker taking a long time to go down
(it may be RPC'ing out to a dead server, retrying so
interrupt). Also join on the ProcedureExecutor shutting down.
This will make problems shutting down more obvious.

Disable TestRegionsOnMasterOptions. Master carrying Regions is broke.
2018-01-19 21:54:19 -08:00
Artem Ervits 11d6e6b1e6 HBASE-19829 hadoop-minicluster pulls zookeeper:test-jar:tests 3.4.6
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-19 15:18:22 -08:00
Michael Stack 579586c697
HBASE-19827 Addendum for Flakey TestAssignmentManager Don't clear old location from RTP... 2018-01-19 13:46:44 -08:00
Michael Stack c66b42fd9d Revert "HBASE-19827 Addendum for Flakey TestAssignmentManager"
Premature commit.

This reverts commit fa66c7e28e.
2018-01-19 11:47:28 -08:00
Reid Chan 298dc0c626 HBASE-19822 Override cancel(boolean) in LogCleaner (Addendum)
Signed-off-by: Michael Stack <stack@apache.org>
2018-01-19 11:46:46 -08:00
Michael Stack fa66c7e28e HBASE-19827 Addendum for Flakey TestAssignmentManager
Don't clear old location from RTP...
2018-01-19 10:59:47 -08:00
Michael Stack 8b520ce50d HBASE-19822 HFileCleaner threads stick around after shutdown stuck on queue#take Interrupt wait on queue when cancel is called. 2018-01-18 13:52:51 -08:00
Guangxu Cheng cde1f821eb HBASE-19799 Add web UI to rsgroup
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-18 12:49:43 -08:00
Michael Stack 581fabe7b2 HBASE-19815 Flakey TestAssignmentManager.testAssignWithRandExec (Part Two).
Part One cleaned up a ClassCastException.

Part Two adds the ServerCrashProcedure#handleRIT behavior to RecoverMetaProcedure.

Adds debug in the test.
2018-01-18 11:32:21 -08:00
Michael Stack 646770dd51 HBASE-19527 Make ExecutorService threads daemon=true
Set the ProcedureExcecutor worker threads as daemon.
Ditto for the timeout thread.

Remove hack from TestRegionsOnMasterOptions that was
put in place because the test would not go down.
2018-01-18 11:30:15 -08:00
lixiang b3eff31432 HBASE-19821 TestCleanerChore#testOnConfigurationChange() requires at least 4 processors to get passed
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-18 11:20:29 -08:00
Apekshit Sharma 09ffbb5b68 HBASE-19820 Restore public constructor of MiniHBaseCluster (API compat). 2018-01-18 09:05:30 -08:00
tedyu 7573e07cc6 HBASE-19806 Lower max versions for table column family of hbase:meta 2018-01-18 07:57:22 -08:00
zhangduo 678b98a726 HBASE-19812 TestFlushSnapshotFromClient fails because of failing region.flush 2018-01-18 16:23:07 +08:00
Scott Wilson e3d15834cb HBASE-19816 Refresh repliation sinks on UnknownHostException
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-17 16:24:48 -08:00
Michael Stack eeb40ff66c
Revert "HBASE-19791 TestZKAsyncRegistry hangs"
Premature push

This reverts commit d3a306d81d.
2018-01-17 15:19:48 -08:00
Michael Stack 53d0c2388d HBASE-19815 Flakey TestAssignmentManager.testAssignWithRandExec 2018-01-17 13:52:39 -08:00
Michael Stack a3c98b2dd8
HBASE-19808 Reenable TestMultiParallel 2018-01-17 08:58:37 -08:00
Reid Chan 8a8be33c71 HBASE-19736 Remove BaseLogCleanerDelegate deprecated #isLogDeletable(FileStatus) and use #isFileDeletable(FileStatus) instead
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-01-17 21:16:23 +08:00
zhangduo d8d6ecdad1 HBASE-19792 TestReplicationSmallTests.testDisableEnable fails 2018-01-17 14:23:05 +08:00
Michael Stack d3a306d81d
HBASE-19791 TestZKAsyncRegistry hangs 2018-01-16 12:34:05 -08:00
Vasudevan d155a4e33d HBASE-19732 Replica regions does not return back the MSLAB chunks to pool
(Ram)
2018-01-15 22:20:27 +05:30
zhangduo 3a66f15557 HBASE-19797 Operator priority leads to wrong logic in ReplicationSourceWALReader 2018-01-15 18:10:50 +08:00
zhangduo 3b638f7ea1 HBASE-19793 Minor improvements on Master/RS startup 2018-01-15 17:53:28 +08:00
zhangduo e546034f09 HBASE-19795 Move the tests which only need zookeeper in TestZooKeeper to hbase-zookeeper module 2018-01-15 10:57:51 +08:00
zhangduo c554340a91 HBASE-19768 RegionServer startup failing when DN is dead 2018-01-14 17:30:50 +08:00
Michael Stack 4ddfecac56 HBASE-19787 Fix or disable tests broken in branch-2 so can cut beta-1
M dev-support/make_rc.sh
  Disable checkstyle building site. Its an issue being fixed over in HBASE-19780

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
  The clusterid was being set into the process only after the
  regionserver registers with the Master. That can be too late for some
  test clients in particular. e.g. TestZKAsyncRegistry needs it as soon
  as it goes to run which could be before Master had called its run
  method  which is regionserver run method which then calls back to the
  master to register itself... and only then do we set the clusterid.
  HBASE-19694 changed start order which made it so this test failed.
  Setting the clusterid right after we set it in zk makes the test pass.

  Another change was that backup masters were not going down on stop.
  Backup masters were sleeping for the default zk period which is 90
  seconds. They were not being woken up to check for stop. On stop
  master now tells active master manager.

M hbase-server/src/test/java/org/apache/hadoop/hbase/TestJMXConnectorServer.java
  Prevent creation of acl table. Messes up our being able to go down
  promptly.

M hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestRegionsOnMasterOptions.java
M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReadRequestMetrics.java
  Disabled for now because it wants to run with regions on the Master...
  currently broke!

M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestZKAsyncRegistry.java
  Add a bit of debugging.

M hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDLSAsyncFSWAL.java
  Disabled. Fails 40% of the time.

M hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDLSFSHLog.java
  Disabled. Fails 33% of the time.

Disabled stochastic load balancer for favored nodes because it fails on
occasion and we are not doing favored nodes in branch-2.
2018-01-12 14:09:56 -08:00
Michael Stack c799b0e69b
HBASE-19694 The initialization order for a fresh cluster is incorrect Addendum. Adds in a missing line that helps debugging. 2018-01-12 13:09:05 -08:00
Guanghao Zhang 20ccaef841 HBASE-19783 Change replication peer cluster key/endpoint from a not-null value to null is not allowed
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-12 21:41:51 +08:00
Chia-Ping Tsai 4bd6ac3e10
HBASE-19746 Add default impl to Cell#getType 2018-01-11 15:03:20 -08:00
Michael Stack 3787c60cd1
HBASE-19694 The initialization order for a fresh cluster is
incorrect; ADDENDUM Fix compile issue.
2018-01-11 14:37:18 -08:00
Michael Stack d0aff98a67
HBASE-19694 The initialization order for a fresh cluster is incorrect
Become active Master before calling the super class's run method. Have
the wait-on-becoming-active-Master be in-line rather than off in a
background thread (i.e. undo running thread in startActiveMasterManager)

Purge the fragile HBASE-16367 hackery that attempted to fix this issue
previously by adding a latch to try and hold up superclass RegionServer
until cluster id set by subclass Master.
2018-01-11 14:29:11 -08:00
zhangduo e0eea94c98 HBASE-19758 Split TestHCM to several smaller tests
Signed-off-by: Michael Stack <stack@apache.org>
2018-01-11 11:39:51 -08:00
Rahul Gidwani 200c3d3b8e HBASE-11409 - Add more flexibility for input directory structure to LoadIncrementalHFiles 2018-01-11 11:05:11 -08:00
Rahul Gidwani 9f69be0011 Revert due to missing JIRA ticket - "Add more flexibility for input directory structure to LoadIncrementalHFiles"
This reverts commit ee3accb370.
2018-01-11 10:42:17 -08:00
Chia-Ping Tsai c88e444408 HBASE-19685 Fix TestFSErrorsExposed#testFullSystemBubblesFSErrors by increasing scanner timeout.
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-01-11 10:34:54 -08:00
Apekshit Sharma 15bb49d803 Revert due to missing author. "HBASE-19685 Fix TestFSErrorsExposed#testFullSystemBubblesFSErrors by increasing scanner timeout."
This reverts commit 0b9dc14dbc.
2018-01-11 10:34:42 -08:00
Apekshit Sharma 0b9dc14dbc HBASE-19685 Fix TestFSErrorsExposed#testFullSystemBubblesFSErrors by increasing scanner timeout. 2018-01-11 10:31:45 -08:00
zhangduo 71a1192d67 HBASE-19751 Use RegionInfo directly instead of an identifier and a namespace when getting WAL 2018-01-11 15:47:34 +08:00
huzheng 8bf6adbe75 HBASE-19749 Revisit logic of UserScanQueryMatcher#mergeFilterResponse method 2018-01-11 12:05:02 +08:00
tedyu b568cf4ebd HBASE-19740 Repeated error message for NamespaceExistException 2018-01-10 18:25:45 -08:00
Rahul Gidwani ee3accb370 Add more flexibility for input directory structure to LoadIncrementalHFiles 2018-01-10 13:37:14 -08:00
huzheng 67a2c62a6a HBASE-19748 TestRegionReplicaFailover and TestRegionReplicaReplicationEndpoint UT hangs 2018-01-10 18:17:35 +08:00
Michael Stack 09c11b0ca4 HBASE-19743 Disable TestMemstoreLABWithoutPool
This is a revert of a revert, i.e., a reapplication only this time
I'm pushing w/ the right JIRA number
2018-01-09 18:21:38 -08:00
Michael Stack 88864f3d5d Revert "HBASE-19742 Disable TestMemstoreLABWithoutPool"
Revert because have wrong JIRA number.

This reverts commit 1454c44bcb.
2018-01-09 18:21:20 -08:00
Michael Stack 669b08f8ec HBASE-19742 Disable TestMemstoreLABWithoutPool 2018-01-09 14:33:29 -08:00
Guangxu Cheng 81ea657ed1 HBASE-19483 Add proper privilege check for rsgroup commands addendum
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-09 07:58:20 -08:00
Guanghao Zhang f458b89c05 HBASE-19139 Create Async Admin methods for Clear Block Cache 2018-01-09 14:43:01 +08:00
zhangduo eb88b69845 HBASE-19719 Fix checkstyle issues 2018-01-09 13:11:01 +08:00
Guanghao Zhang 2d5267331e HBASE-19711 TestReplicationAdmin.testConcurrentPeerOperations hangs
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-09 13:11:01 +08:00
zhangduo ec364d0d6c HBASE-19707 Race in start and terminate of a replication source after we async start replicatione endpoint 2018-01-09 13:11:01 +08:00
Guanghao Zhang 01f1fc8284 HBASE-19636 All rs should already start work with the new peer change when replication peer procedure is finished
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-09 13:11:01 +08:00
zhangduo 1a89793ee8 HBASE-19634 Add permission check for executeProcedures in AccessController 2018-01-09 13:11:01 +08:00
zhangduo 8eeedf0403 HBASE-19697 Remove TestReplicationAdminUsingProcedure 2018-01-09 13:11:01 +08:00
huzheng a5cfc51cbe HBASE-19661 Replace ReplicationStateZKBase with ZKReplicationStorageBase 2018-01-09 13:11:01 +08:00
zhangduo 368db315a6 HBASE-19687 Move the logic in ReplicationZKNodeCleaner to ReplicationChecker and remove ReplicationZKNodeCleanerChore 2018-01-09 13:11:01 +08:00
Guanghao Zhang d95ee41583 HBASE-19544 Add UTs for testing concurrent modifications on replication peer
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-09 13:11:01 +08:00
zhangduo d357920988 HBASE-19686 Use KeyLocker instead of ReentrantLock in PeerProcedureHandlerImpl 2018-01-09 13:11:01 +08:00
zhangduo a85a215f36 HBASE-19623 Create replication endpoint asynchronously when adding a replication source 2018-01-09 13:11:01 +08:00
zhangduo 19707a85dd HBASE-19633 Clean up the replication queues in the postPeerModification stage when removing a peer 2018-01-09 13:11:01 +08:00
huzheng f89920a60f HBASE-19622 Reimplement ReplicationPeers with the new replication storage interface 2018-01-09 13:11:01 +08:00
zhangduo 62a4f5bb46 HBASE-19635 Introduce a thread at RS side to call reportProcedureDone 2018-01-09 13:11:01 +08:00
zhangduo f4703c6ed3 HBASE-19617 Remove ReplicationQueues, use ReplicationQueueStorage directly 2018-01-09 13:11:01 +08:00
zhangduo 5fc90244a8 HBASE-19642 Fix locking for peer modification procedure 2018-01-09 13:11:01 +08:00
zhangduo fdc907140b HBASE-19592 Add UTs to test retry on update zk failure 2018-01-09 13:11:01 +08:00
Guanghao Zhang 1025388da6 HBASE-19630 Add peer cluster key check when add new replication peer
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-09 13:11:01 +08:00
Guanghao Zhang 65eb91f84e HBASE-19573 Rewrite ReplicationPeer with the new replication storage interface 2018-01-09 13:11:01 +08:00
zhangduo c4fa568b47 HBASE-19599 Remove ReplicationQueuesClient, use ReplicationQueueStorage directly 2018-01-09 13:11:01 +08:00
zhangduo 5e6c303528 HBASE-19543 Abstract a replication storage interface to extract the zk specific code 2018-01-09 13:11:01 +08:00
huzheng 8f5e54a456 HBASE-19525 RS side changes for moving peer modification from zk watcher to procedure 2018-01-09 13:11:01 +08:00
zhangduo 7afae59323 HBASE-19580 Use slf4j instead of commons-logging in new, just-added Peer Procedure classes 2018-01-09 13:11:01 +08:00
Guanghao Zhang 17762c60cc HBASE-19520 Add UTs for the new lock type PEER
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-09 13:11:01 +08:00
zhangduo 62496b5f36 HBASE-19564 Procedure id is missing in the response of peer related operations 2018-01-09 13:11:01 +08:00
zhangduo 7f4bd0d371 HBASE-19524 Master side changes for moving peer modification from zk watcher to procedure 2018-01-09 13:11:01 +08:00
zhangduo f17198ff19 HBASE-19216 Implement a general framework to execute remote procedure on RS 2018-01-09 13:11:01 +08:00
Guangxu Cheng 7ddf79946d HBASE-19483 Add proper privilege check for rsgroup commands
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-08 19:48:37 -08:00
huzheng c5277d5f88 HBASE-19729 UserScanQueryMatcher#mergeFilterResponse should return INCLUDE_AND_SEEK_NEXT_ROW when filterResponse is INCLUDE_AND_SEEK_NEXT_ROW 2018-01-09 07:19:40 +08:00
zhangduo 2509a150c0
HBASE-19731 TestFromClientSide#testCheckAndDeleteWithCompareOp and testNullQualifier are flakey 2018-01-08 10:35:36 -08:00
Jan Hentschel 2af61718b1 HBASE-19541 Removed unnecessary semicolons in hbase-server 2018-01-08 16:43:43 +01:00
BELUGA BEHR afc2cdbaff HBASE-19684 BlockCacheKey toString Performance
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-08 17:06:21 +08:00
Chia-Ping Tsai 7378dad5a9 HBASE-19712 Fix TestSnapshotQuotaObserverChore#testSnapshotSize 2018-01-08 08:47:18 +08:00
tedyu 5a66eb978c HBASE-19696 Filter returning INCLUDE_AND_NEXT_COL doesn't skip remaining versions when scan has explicit columns (Ankit Singhal) 2018-01-07 07:50:00 -08:00
Josh Elser 45e46bb242 HBASE-19709 Ensure that we don't set a poolSize of 0
In some situations, Runtime.getRuntime().getAvailableProcessors()
may return 0 which would result in calculatePoolSize returning 0
which will trigger an exception. Guard against this case.

Signed-off-by: Reid Chan <reidddchan@outlook.com>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-01-05 18:44:35 -05:00
Beluga Behr a30d9fe8d9
HBASE-19651 Remove LimitInputStream 2018-01-05 16:59:29 -06:00
Michael Stack 2bf2b5b2c1
Revert "Revert "Revert "HBASE-19651 Remove LimitInputStream"""
This reverts commit 032701c96c.
2018-01-05 16:58:26 -06:00
Michael Stack 032701c96c
Revert "Revert "HBASE-19651 Remove LimitInputStream""
This reverts commit e5f7030ded.
2018-01-05 16:55:59 -06:00
Beluga Behr e5f7030ded
Revert "HBASE-19651 Remove LimitInputStream"
Revert to put Beluga in place as author.

This reverts commit 032fdc53de.
2018-01-05 16:55:01 -06:00
Janos Gub 9cd0e1a490 HBASE-17436 Add column to master web UI for displaying region states when listing regions of a table.
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-01-05 14:32:27 -08:00
tedyu 5ce9351129 HBASE-19483 Add proper privilege check for rsgroup commands - revert due to pending review comment 2018-01-05 12:06:31 -08:00
Guangxu Cheng fc7736eb00 HBASE-19483 Add proper privilege check for rsgroup commands
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-05 11:18:07 -08:00
Michael Stack 032fdc53de
HBASE-19651 Remove LimitInputStream
Signed-off-by: Beluga Behr <dam6923@gmail.com>
2018-01-05 08:31:11 -06:00
Reid Chan bff937a767 HBASE-19688 TimeToLiveProcedureWALCleaner should extends BaseLogCleanerDelegate
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-04 10:26:23 -08:00
Chia-Ping Tsai 8119acfca7 HBASE-19596 RegionMetrics/ServerMetrics/ClusterMetrics should apply to all public classes 2018-01-04 13:13:34 +08:00
Chia-Ping Tsai 338a74e737 HBASE-19490 Rare failure in TestRateLimiter 2018-01-04 10:46:43 +08:00
BELUGA BEHR 301062566a HBASE-19613 Miscellaneous changes to WALSplitter.
* Use ArrayList instead LinkedList
* Use Apache Commons where appropriate
* Parameterize and improve logging
2018-01-03 18:30:10 -08:00
huzheng 6e136f26bf HBASE-18806 VerifyRep by snapshot need not to restore snapshot for each mapper 2018-01-04 10:10:03 +08:00
Josh Elser 9a98bb4ce9 HBASE-19691 Removes Global(A) requirement for getClusterStatus
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-01-03 18:47:53 -05:00