5b95ea01da
HBASE-19965 Fix flaky TestAsyncRegionAdminApi; ADDENDUM do same to TestAsyncTableAdminAPI
2018-02-12 22:53:29 -08:00
7104364a4d
HBASE-19965 Fix flaky TestAsyncRegionAdminApi
2018-02-12 22:24:50 -08:00
b19531f04b
HBASE-19970 Remove unused functions from TableAuthManager.
...
Functions deleted: setTableUserPermissions, setTableGroupPermissions, setNamespaceUserPermissions,
setNamespaceGroupPermissions, writeTableToZooKeeper, writeNamespaceToZooKeeper
2018-02-12 16:02:48 -08:00
e94f082776
HBASE-19986 If HBaseTestClassRule timesout a test, thread dump
2018-02-12 15:13:42 -08:00
1ae64ccee0
HBASE-19972 Should rethrow the RetriesExhaustedWithDetailsException when failed to apply the batch in ReplicationSink; ADDENDUM to fix TestReplicationSink
2018-02-12 10:48:21 -08:00
c7473df2c3
HBASE-16060 1.x clients cannot access table state talking to 2.0 cluster
...
This patch adds mirroring of table state out to zookeeper. HBase-1.x
clients look for table state in zookeeper, not in hbase:meta where
hbase-2.x maintains table state.
The patch also moves and refactors the 'migration' code that was put in
place by HBASE-13032.
D hbase-client/src/main/java/org/apache/hadoop/hbase/CoordinatedStateException.java
Unused.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
Move table state migration code from Master startup out to
TableStateManager where it belongs. Also start
MirroringTableStateManager dependent on config.
A hbase-server/src/main/java/org/apache/hadoop/hbase/master/MirroringTableStateManager.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/TableStateManager.java
Move migration from zookeeper of table state in here. Also plumb in
mechanism so subclass can get a chance to look at table state as we do
the startup fixup full-table scan of meta.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
Bug-fix. Now we create regions in CLOSED state but we fail to check
table state; were presuming table always enabled. Meant on startup
there'd be an unassigned region that never got assigned.
A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMirroringTableStateManager.java
Test migration and mirroring.
2018-02-12 08:22:14 -08:00
43f507dfa8
HBASE-19554 Dump thread info before failure
2018-02-12 16:06:50 +08:00
d793db7c7d
HBASE-19972 Should rethrow the RetriesExhaustedWithDetailsException when failed to apply the batch in ReplicationSink
2018-02-12 15:15:08 +08:00
3f127063ff
HBASE-19966 The WriteEntry for WALKey maybe null if we failed to call WAL.append
2018-02-09 19:11:08 -08:00
4461cb7d7a
HBASE-19942 (addendum) Fix flaky TestSimpleRpcScheduler
2018-02-09 13:38:05 +08:00
bc080e7500
HBASE-19835 Use explicit casting to avoid side effects
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-02-08 12:33:08 -08:00
c93ba37dfc
HBASE-19956 Remove category as a consideration timing out tests; set all test to timeout at 10minutes regardless
2018-02-07 20:10:36 -08:00
8f1e01b6e5
HBASE-19951 Cleanup the explicit timeout value for test method
2018-02-07 16:39:54 -08:00
7d449892af
HBASE-19947 ITU should overwrite HTU local FS
2018-02-07 16:56:11 -06:00
e71b0bf19d
HBASE-19929 Call RS.stop on a session expired RS may hang
2018-02-07 15:53:08 +08:00
e2636c81f7
HBASE-19900 Region-level exception destroy the result of batch
2018-02-07 08:38:04 +08:00
f481386e3e
HBASE-19942 Fix flaky TestSimpleRpcScheduler
2018-02-07 08:00:01 +08:00
4d24b19822
HBASE-19886 Display maintenance mode in shell, web UI
2018-02-06 14:53:48 -08:00
f155da3791
HBASE-19946 More test clean up for local-mode HTU
2018-02-06 15:39:17 -06:00
89baad5bbe
HBASE-19940 TestMetaShutdownHandler flakey; ADDENDUM: yet more debug
2018-02-06 09:48:26 -08:00
ca6b37d63c
HBASE-19940 TestMetaShutdownHandler flakey; ADDENDUM: more debug
2018-02-06 06:35:02 -08:00
fb480775d5
HBASE-19944 Fix timeout TestVisibilityLabelsWithCustomVisLabService
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-02-06 20:30:16 +08:00
e4aeb46177
HBASE-19941 Flaky TestCreateTableProcedure times out in nightly, needs to LargeTests
2018-02-05 22:11:53 -08:00
b9175680b6
HBASE-19934 HBaseSnapshotException when read replicas is enabled and online snapshot is taken after region splitting (Toshihiro Suzuki)
2018-02-05 21:06:20 -08:00
53e5707224
HBASE-19939 Fixed NPE in tests TestSplitTableRegionProcedure#testSplitWithoutPONR() and testRecoveryAndDoubleExecution()
...
Value of 'htd' is null as it is initialized in the constructor but when the object is deserialized its null. Got rid of member variable htd and made it local to method.
2018-02-05 20:48:20 -08:00
8b6b3326a6
HBASE-19927 Addendum join on RegionServerThread instead of HRegionServer
2018-02-06 10:01:41 +08:00
7723a3d60d
HBASE-19940 TestMetaShutdownHandler flakey
2018-02-05 12:38:51 -08:00
a1600c1490
HBASE-19840 Flakey TestMetaWithReplicas; ADDENDUM Adding debug
2018-02-05 11:00:46 -08:00
29016bc100
HBASE-19837 Flakey TestRegionLoad; ADDENDUM Report more often and wait less time on change (also add some debug on TestMetaShutdown test)
2018-02-05 08:39:52 -08:00
f0a5f12d97
HBASE-19703 Functionality added as part of HBASE-12583 is not working after moving the split code to master
...
Co-authored-by: Michael Stack <stack@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-02-05 23:41:32 +08:00
514eadbe95
HBASE-19658 make the test testFlatteningToJumboCellChunkMap() stable, by eliminating the possibility of third cell to be added while in-memory-flush is still in progress
2018-02-05 11:29:10 +02:00
30a7e4a35c
HBASE-19554 reenable TestDLSAsyncFSWAL/TestDLSFSHLog for debugging
2018-02-05 08:58:30 +08:00
054acca866
HBASE-19927 TestFullLogReconstruction flakey
2018-02-05 08:41:37 +08:00
32d1903377
HBASE-19931 TestMetaWithReplicas failing 100% of the time in testHBaseFsckWithMetaReplicas
2018-02-04 14:37:13 -08:00
2d5b36d194
HBASE-19905 ReplicationSyncUp tool will not exit if a peer replication is disabled
...
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-02-04 18:12:46 +05:30
3b603d2c08
HBASE-19926 Use a separated class to implement the WALActionListener for Replication
2018-02-04 20:32:14 +08:00
cb138c2da8
HBASE-19914 Refactor TestVisibilityLabelsOnNewVersionBehaviorTable
2018-02-04 13:37:09 +08:00
a3233572ac
HBASE-19928 TestVisibilityLabelsOnNewVersionBehaviorTable fails
2018-02-03 10:17:16 -08:00
00653a4d18
HBASE-19919 Tidying up logging; ADDENDUM Fix tests w/ mocked Servers
2018-02-03 09:25:45 -08:00
66a11f2ac0
HBASE-19904 Break dependency of WAL constructor on Replication
2018-02-03 17:11:30 +08:00
bac4687345
HBASE-19919 Tidying up logging
2018-02-02 22:42:30 -08:00
897afb7d18
HBASE-19726 Failed to start HMaster due to infinite retrying on meta assign
2018-02-02 18:30:24 -08:00
3398637bcd
HBASE-19918 Promote TestAsyncClusterAdminApi to LargeTests
2018-02-03 09:40:58 +08:00
b0bf6f504e
HBASE-19720 Rename WALKey#getTabnename to WALKey#getTableName
2018-02-02 20:02:04 +08:00
efed668f74
HBASE-19895 Add keepDeletedCells option in ScanOptions for customizing scanInfo in pre-hooks (Ankit Singhal)
2018-02-01 18:28:05 -08:00
a165bd766a
HBASE-19841 Every HTU should be local until DFS starts
2018-02-01 20:23:56 -06:00
79ccb0b38e
HBASE-19913 Split TestStochasticLoadBalancer2
2018-02-02 08:29:33 +08:00
ea8290f3dc
HBASE-19147 TestCacheOnWrite Times Out
2018-02-01 16:15:50 -08:00
6a1ed25581
HBASE-19897 RowMutations should follow the fluent pattern
2018-02-02 05:24:08 +08:00
7fe215db5f
HBASE-19884 BucketEntryGroup's equals, hashCode and compareTo methods are not consistent
...
Move back to default equals and hashCode.
Remove compareTo and Comparator to PriorityQueue.
Signed-off-by: Michael Stack <stack@apache.org>
2018-02-01 13:21:23 -08:00
86ca65218d
HBASE-19912 Remove useless 'writeToWAL' flag of Region#checkAndRowMutate
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-02-01 12:34:46 -08:00
4cdc13b86e
HBASE-19839 Fixed flakey tests TestMergeTableRegionsProcedure#testRollbackAndDoubleExecution and TestSplitTableRegionProcedure#testRollbackAndDoubleExecution
...
* Added a comment in MergeTableRegionsProcedure and SplitTableRegionProcedure explaining specific rollbacks has side effect that AssignProcedure/s are submitted asynchronously and those procedures may continue to execute even after rollback() is done.
* Updated comments in tests with correct rollback state to abort
* Added overloaded method MasterProcedureTestingUtility#testRollbackAndDoubleExecution which takes additional argument for waiting on all procedures to finish before asserting conditions
* Updated TestMergeTableRegionsProcedure#testRollbackAndDoubleExecution and TestSplitTableRegionProcedure#testRollbackAndDoubleExecution to use newly added method
Signed-off-by: Michael Stack <stack@apache.org>
2018-02-01 12:01:57 -08:00
23471deb75
HBASE-19906 TestZooKeeper Timeout Includes move of TestQoSFunction from smalltests to mediumtests; it timedout in a run.
2018-02-01 10:53:51 -08:00
4c210eb212
HBASE-19911 Convert some tests from small to medium because they are timing out: TestNettyRpcServer, TestClientClusterStatus; ADDENDUM changes TestCheckTestClasses to be medium sized test
2018-01-31 20:28:02 -08:00
ba265a7e51
HBASE-19911 Convert some tests from small to medium because they are timing out: TestNettyRpcServer, TestClientClusterStatus
2018-01-31 20:21:57 -08:00
113432c9b9
HBASE-19910 TestBucketCache TimesOut
2018-01-31 18:17:22 -08:00
faea89ea4f
HBASE-19909 TestRegionLocationFinder Timeout
2018-01-31 17:53:48 -08:00
13f92b7daa
HBASE-19908 TestCoprocessorShortCircuitRPC Timeout....
2018-01-31 17:34:05 -08:00
7a82126f8b
Revert "HBASE-19906 TestZooKeeper Timeout"
...
Revert. Pushed prematurely.
This reverts commit 80af9bdef0
2018-01-31 15:56:26 -08:00
e6d2682f0f
HBASE-19907 TestMetaWithReplicas still flakey
2018-01-31 15:18:45 -08:00
80af9bdef0
HBASE-19906 TestZooKeeper Timeout
2018-01-31 15:18:38 -08:00
4148d7c614
HBASE-19528 - Major Compaction Tool
2018-01-31 14:37:48 -08:00
28d13c54a9
HBASE-19887 Do not overwrite the surefire junit listener property in the pom of sub modules
2018-01-31 20:49:25 +08:00
b3824b8c92
HBASE-19728 Add lock to filesCompacting in all place.
2018-01-31 14:18:27 +08:00
0ee280db22
HBASE-19868 TestCoprocessorWhitelistMasterObserver is flakey
...
Recategorize TestCoprocessorWhitelistMasterObserver as Large test
2018-01-30 06:01:50 -08:00
364650bad5
HBASE-19868 TestCoprocessorWhitelistMasterObserver is flakey
2018-01-29 21:33:16 -08:00
90a75fb052
HBASE-19888 Move branch-2 version from 2.0.0-beta-1 to 2.0.0-beta-2-SNAPSHOT
2018-01-29 14:17:54 -08:00
27d73dec8a
HBASE-19811 Fix findbugs and error-prone warnings in hbase-server (branch-2) - addendum
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-01-29 14:02:42 -08:00
bbf3bae72a
HBASE-19873 Add a CategoryBasedTimeout ClassRule for all UTs
2018-01-29 12:41:14 -08:00
7cbb70945a
HBASE-19840 Flakey TestMetaWithReplicas; ADDENDUM to fix Checksyte
2018-01-29 09:35:52 -08:00
77607e4961
HBASE-19840 Flakey TestMetaWithReplicas
...
Fix two issues:
# Meta Replicas can all be assigned to the same server. This
will call the test to hang when we do our kill of the server
hosting meta because there'll be no replicas to read from
as test intends. Check is to look for this condition on
startup and adjust if we come across it. Replicas cross-cut
assignment. They need work.
# Other issue was shutdown. The master started toward the
end of the test may not have come up fully by the time
shutdown is called. We could be stuck assigning the
meta replicas. Have shutdown shutdown the procedure
executor engine.
There is other cleanup and notes in the below.
M HMaster
Remove the silly stops in startup now we have real
means of shutting down Master during init.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterMetaBootstrap.java
This replica stuff was doing stuff it shouldn't be doing
like setting core Master state flags. It may have made
sense once but now meta is assigned by a Pv2 Procedure
so the flag setting in here is meddlesome. Clear out
methods no longer needed.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
Remove unused methods.
Changes local variable names so they align w/ our naming elsewhere in
code base.
M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMetaWithReplicas.java
Check for all replicas on the one server.
2018-01-29 09:26:41 -08:00
1efa050ebf
HBASE-19885 Promote TestAssignmentManager to LargeTests
2018-01-30 00:25:32 +08:00
f8bde7b76c
HBASE-19866 TestRegionServerReportForDuty doesn't timeout
...
Synchronized on authManager instead of RpcServer
2018-01-29 21:23:57 +08:00
5b0d7dc45b
HBASE-19882 Promote TestProcedureManager to MediumTests
2018-01-29 17:50:29 +08:00
cdda0a79ea
HBASE-19881 Promote TestRegionReplicaReplicationEndpoint to LargeTests
2018-01-29 16:15:55 +08:00
b75c85a075
HBASE-19880 Promote TestFuzzyRowFilterEndToEnd to LargeTests
2018-01-29 16:15:36 +08:00
5ef5c5a247
HBASE-19879 Promote TestAcidGuaranteesXXX to LargeTests
2018-01-29 14:57:31 +08:00
380169eaf2
HBASE-19869 TestLockManager now uses the right class for logging
2018-01-28 14:04:46 +01:00
b355af0fad
HBASE-19867 Split TestStochasticLoadBalancer into several small tests
2018-01-27 18:26:01 +08:00
4c4352c727
HBASE-19861 - Avoid using RPCs when querying table infos for master status pages
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-26 08:02:43 -08:00
c88e570dc1
HBASE-19818 Scan time limit not work if the filter always filter row key
2018-01-26 17:06:00 +08:00
c16dae13f2
HBASE-19866 Add cateogry based timeout using Timeout Rule to TestRegionServerReportForDuty.
2018-01-26 00:44:04 -08:00
f8295a810d
HBASE-19862 addendum: Checkstyle fixes, remove unused imports and variables. Add @Rule for timeout.
2018-01-26 00:25:11 -08:00
dbe5cbf5ae
HBASE-19862 Fix TestTokenAuthentication - mock RegionCoprocessorEnvironment should be of type HasRegionServerServices also.
2018-01-25 23:55:12 -08:00
c9950b5a79
HBASE-19756 Master NPE during completed failed proc eviction
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-01-24 16:43:08 -08:00
739b9b4a8e
HBASE-19838 Can not shutdown backup master cleanly when it has already tried to become the active master
...
On Master@shutdown, close the shared Master connection to kill any
ongoing RPCs by hosted clients.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
Call close ont the Master shared clusterconnection to kill any ongoing
rpcs.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
Remove guts of close; we were closing the Masters connection....not
our responsibility.
Added unit test written by Duo Zhang which demonstrates the case where
Master will not go down.
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-23 11:09:42 +08:00
f952779ba2
HBASE-4224 Need a flush by regionserver rather than by table option
2018-01-23 09:47:15 +08:00
b1269ec57f
HBASE-19811 Fix findbugs and error-prone warnings in hbase-server (branch-2)
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-01-22 17:14:15 -08:00
1e5fc1ed63
HBASE-19840 Flakey TestMetaWithReplicas
...
Adding debuging
2018-01-22 12:26:03 -08:00
0fa24dddb9
HBASE-15321 - Ability to open a HRegion from hdfs snapshot.
2018-01-22 12:13:13 -08:00
6f8c31242a
HBASE-19774 incorrect behavior of locateRegionInMeta
2018-01-22 11:49:19 -08:00
d4ffee2023
HBASE-19837 Flakey TestRegionLoad
...
Add debug, change name of the rows so readable.
2018-01-22 08:00:26 -08:00
5cce0f8f7d
HBASE-19836 Fix TestZooKeeper.testLogSplittingAfterMasterRecoveryDueToZKExpiry
2018-01-22 18:30:11 +08:00
b44be75bd1
HBASE-19837 Flakey TestRegionLoad
...
Add debug, change name of the rows so readable.
2018-01-21 23:24:58 -08:00
c1470714bb
HBASE-19794 TestZooKeeper hangs
...
Kill backup master first
Add some cleanup around NamespaceManager
Shorten the timeout waiting on namespace manager as workaround
until we have better soln for interrupting ongoing client rpcs.
Do it in general for all tests.
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-21 20:59:31 +08:00
86ecc963e4
HBASE-19828 Flakey TestRegionsOnMasterOptions.testRegionsOnAllServers
...
Rename the PE Worker threads.
Send an interrupt if worker taking a long time to go down
(it may be RPC'ing out to a dead server, retrying so
interrupt). Also join on the ProcedureExecutor shutting down.
This will make problems shutting down more obvious.
Disable TestRegionsOnMasterOptions. Master carrying Regions is broke.
2018-01-19 21:54:44 -08:00
8f713fcc19
HBASE-19829 hadoop-minicluster pulls zookeeper:test-jar:tests 3.4.6
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-19 15:22:15 -08:00
0f9a837bd1
HBASE-19827 Addendum for Flakey TestAssignmentManager Don't clear old location from RTP...
2018-01-19 13:47:11 -08:00
3131234ffd
HBASE-19822 Override cancel(boolean) in LogCleaner (Addendum)
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-01-19 11:48:16 -08:00
c01dc69123
HBASE-19799 Add web UI to rsgroup
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-18 19:30:06 -08:00
a57769a15c
HBASE-19822 HFileCleaner threads stick around after shutdown stuck on queue#take Interrupt wait on queue when cancel is called.
2018-01-18 13:53:11 -08:00
13547d53eb
HBASE-19815 Flakey TestAssignmentManager.testAssignWithRandExec (Part Two).
...
Part One cleaned up a ClassCastException.
Part Two adds the ServerCrashProcedure#handleRIT behavior to RecoverMetaProcedure.
Adds debug in the test.
2018-01-18 11:32:37 -08:00
7225899e01
HBASE-19527 Make ExecutorService threads daemon=true
...
Set the ProcedureExcecutor worker threads as daemon.
Ditto for the timeout thread.
Remove hack from TestRegionsOnMasterOptions that was
put in place because the test would not go down.
2018-01-18 11:30:46 -08:00
a2d9a17851
HBASE-19821 TestCleanerChore#testOnConfigurationChange() requires at least 4 processors to get passed
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-18 11:20:52 -08:00
25621c6ea2
HBASE-19820 Restore public constructor of MiniHBaseCluster (API compat).
2018-01-18 09:07:30 -08:00
251826e138
HBASE-19806 Lower max versions for table column family of hbase:meta
2018-01-18 07:58:44 -08:00
d7e2e0d02c
HBASE-19812 TestFlushSnapshotFromClient fails because of failing region.flush
2018-01-18 16:23:15 +08:00
0f2c1fa066
HBASE-19816 Refresh repliation sinks on UnknownHostException
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-17 16:25:17 -08:00
af2d890055
Revert "HBASE-19527 Make ExecutorService threads daemon=true"
...
Applied prematurely. Revert.
This reverts commit 5e4ed33fa2
2018-01-17 15:08:42 -08:00
0f5b0fb759
HBASE-19815 Flakey TestAssignmentManager.testAssignWithRandExec
2018-01-17 13:50:42 -08:00
5e4ed33fa2
HBASE-19527 Make ExecutorService threads daemon=true
...
Set the ProcedureExcecutor worker threads as daemon.
Ditto for the timeout thread.
Remove hack from TestRegionsOnMasterOptions that was
put in place because the test would not go down.
2018-01-17 13:41:38 -08:00
addd716549
HBASE-19808 Reenable TestMultiParallel
2018-01-17 08:59:05 -08:00
f22cf7226e
HBASE-19736 Remove BaseLogCleanerDelegate deprecated #isLogDeletable(FileStatus) and use #isFileDeletable(FileStatus) instead
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-01-17 21:25:20 +08:00
48bb19012c
HBASE-19792 TestReplicationSmallTests.testDisableEnable fails
2018-01-17 14:23:17 +08:00
f23fd7208b
HBASE-19732 Replica regions does not return back the MSLAB chunks to pool
...
(Ram)
2018-01-15 22:15:01 +05:30
e014e5f8ef
HBASE-19797 Operator priority leads to wrong logic in ReplicationSourceWALReader
2018-01-15 18:10:56 +08:00
204a4539c4
HBASE-19793 Minor improvements on Master/RS startup
2018-01-15 17:54:01 +08:00
8dd4bf8e54
HBASE-19795 Move the tests which only need zookeeper in TestZooKeeper to hbase-zookeeper module
2018-01-15 10:58:03 +08:00
ffa28502c4
HBASE-19768 RegionServer startup failing when DN is dead
2018-01-14 17:31:23 +08:00
026f535a77
HBASE-19787 Fix or disable tests broken in branch-2 so can cut beta-1
...
M dev-support/make_rc.sh
Disable checkstyle building site. Its an issue being fixed over in HBASE-19780
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
The clusterid was being set into the process only after the
regionserver registers with the Master. That can be too late for some
test clients in particular. e.g. TestZKAsyncRegistry needs it as soon
as it goes to run which could be before Master had called its run
method which is regionserver run method which then calls back to the
master to register itself... and only then do we set the clusterid.
HBASE-19694 changed start order which made it so this test failed.
Setting the clusterid right after we set it in zk makes the test pass.
Another change was that backup masters were not going down on stop.
Backup masters were sleeping for the default zk period which is 90
seconds. They were not being woken up to check for stop. On stop
master now tells active master manager.
M hbase-server/src/test/java/org/apache/hadoop/hbase/TestJMXConnectorServer.java
Prevent creation of acl table. Messes up our being able to go down
promptly.
M hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestRegionsOnMasterOptions.java
M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerReadRequestMetrics.java
Disabled for now because it wants to run with regions on the Master...
currently broke!
M hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestZKAsyncRegistry.java
Add a bit of debugging.
M hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDLSAsyncFSWAL.java
Disabled. Fails 40% of the time.
M hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDLSFSHLog.java
Disabled. Fails 33% of the time.
Disabled stochastic load balancer for favored nodes because it fails on
occasion and we are not doing favored nodes in branch-2.
2018-01-12 14:09:23 -08:00
d8271b0361
HBASE-19694 The initialization order for a fresh cluster is incorrect Addendum. Adds in a missing line that helps debugging.
2018-01-12 13:08:27 -08:00
72702eeb70
HBASE-19783 Change replication peer cluster key/endpoint from a not-null value to null is not allowed
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-12 21:41:57 +08:00
3e6f80dcd5
HBASE-19746 Add default impl to Cell#getType
2018-01-11 15:04:25 -08:00
1a11fc92b1
HBASE-19694 The initialization order for a fresh cluster is incorrect
...
Become active Master before calling the super class's run method. Have
the wait-on-becoming-active-Master be in-line rather than off in a
background thread (i.e. undo running thread in startActiveMasterManager)
Purge the fragile HBASE-16367 hackery that attempted to fix this issue
previously by adding a latch to try and hold up superclass RegionServer
until cluster id set by subclass Master.
2018-01-11 14:25:25 -08:00
0dacdde0f9
HBASE-19758 Split TestHCM to several smaller tests
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-01-11 11:40:48 -08:00
3849db8f1d
HBASE-11409 - Add more flexibility for input directory structure to LoadIncrementalHFiles
2018-01-11 11:07:47 -08:00
482d413e0a
Revert due to missing jira ticket "Add more flexibility for input directory structure to LoadIncrementalHFiles"
...
This reverts commit d524768528
2018-01-11 11:07:10 -08:00
5d4140e09d
HBASE-19685 Fix TestFSErrorsExposed#testFullSystemBubblesFSErrors by increasing scanner timeout.
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-01-11 10:35:36 -08:00
31fe5dbf6b
Revert due to missing author. "HBASE-19685 Fix TestFSErrorsExposed#testFullSystemBubblesFSErrors by increasing scanner timeout."
...
This reverts commit 0b9dc14dbc
2018-01-11 10:35:32 -08:00
bf3c207785
HBASE-19685 Fix TestFSErrorsExposed#testFullSystemBubblesFSErrors by increasing scanner timeout.
2018-01-11 10:32:26 -08:00
814d08a2d6
HBASE-19751 Use RegionInfo directly instead of an identifier and a namespace when getting WAL
2018-01-11 15:48:33 +08:00
98e56ae4c6
HBASE-19749 Revisit logic of UserScanQueryMatcher#mergeFilterResponse method
2018-01-11 12:06:12 +08:00
47326729fe
HBASE-19740 Repeated error message for NamespaceExistException
2018-01-10 18:26:23 -08:00
d524768528
Add more flexibility for input directory structure to LoadIncrementalHFiles
2018-01-10 13:42:34 -08:00
345b8ba9a1
HBASE-19743 Disable TestMemstoreLABWithoutPool
...
This is a revert of a revert, i.e., a reapplication only this time
I'm pushing w/ the right JIRA number
2018-01-09 18:22:36 -08:00
950ecd2764
Revert "HBASE-19742 Disable TestMemstoreLABWithoutPool"
...
Revert because have wrong JIRA number.
This reverts commit 1454c44bcb
2018-01-09 18:20:37 -08:00
1454c44bcb
HBASE-19742 Disable TestMemstoreLABWithoutPool
2018-01-09 14:32:58 -08:00
3fa3dcd9f9
HBASE-19483 Add proper privilege check for rsgroup commands
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-09 08:11:07 -08:00
895267d09c
HBASE-19139 Create Async Admin methods for Clear Block Cache
2018-01-09 14:55:21 +08:00
d9ca212d55
HBASE-19729 UserScanQueryMatcher#mergeFilterResponse should return INCLUDE_AND_SEEK_NEXT_ROW when filterResponse is INCLUDE_AND_SEEK_NEXT_ROW
2018-01-09 07:22:09 +08:00
4c31374a90
HBASE-19731 TestFromClientSide#testCheckAndDeleteWithCompareOp and testNullQualifier are flakey
2018-01-08 10:34:57 -08:00
c8e8f7008d
HBASE-19684 BlockCacheKey toString Performance
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-08 17:06:34 +08:00
1e352f6247
HBASE-19358 Improve the stability of splitting log when do fail over
...
Signed-off-by: Yu Li <liyu@apache.org>
2018-01-08 10:57:46 +08:00
a66e923106
HBASE-19712 Fix TestSnapshotQuotaObserverChore#testSnapshotSize
2018-01-08 08:52:28 +08:00
0168c1e6cb
HBASE-19696 Filter returning INCLUDE_AND_NEXT_COL doesn't skip remaining versions when scan has explicit columns (Ankit Singhal)
2018-01-07 07:50:33 -08:00
443b27b707
HBASE-19709 Ensure that we don't set a poolSize of 0
...
In some situations, Runtime.getRuntime().getAvailableProcessors()
may return 0 which would result in calculatePoolSize returning 0
which will trigger an exception. Guard against this case.
Signed-off-by: Reid Chan <reidddchan@outlook.com>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-01-05 18:36:50 -05:00
ce80e8e38f
HBASE-19651 Remove LimitInputStream; AMENDMENT: fix compile
2018-01-05 17:28:40 -06:00
88c7493948
HBASE-19651 Remove LimitInputStream
2018-01-05 17:01:50 -06:00
e7da907c3c
Revert "HBASE-19651 Remove LimitInputStream"
...
Revert to fix author.
This reverts commit 4c19e1f4e3
2018-01-05 16:59:59 -06:00
4c19e1f4e3
HBASE-19651 Remove LimitInputStream
...
Signed-off-by: Beluga Behr <dam6923@gmail.com>
2018-01-05 08:38:12 -06:00
e35fec284d
HBASE-19688 TimeToLiveProcedureWALCleaner should extends BaseLogCleanerDelegate
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-04 10:26:51 -08:00
654edc5fa5
HBASE-19596 RegionMetrics/ServerMetrics/ClusterMetrics should apply to all public classes
2018-01-04 13:05:21 +08:00
f993425f01
HBASE-19490 Rare failure in TestRateLimiter
2018-01-04 10:43:26 +08:00
59558f020f
HBASE-19613 Miscellaneous changes to WALSplitter.
...
* Use ArrayList instead LinkedList
* Use Apache Commons where appropriate
* Parameterize and improve logging
2018-01-03 18:39:14 -08:00
16e8422855
HBASE-18806 VerifyRep by snapshot need not to restore snapshot for each mapper
2018-01-04 10:12:53 +08:00
f0011ebfe0
HBASE-19691 Removes Global(A) requirement for getClusterStatus
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-01-03 19:02:26 -05:00
97dc7d87cd
HBASE-19654 Remove misleading and chatty debug message in ReplicationLogCleaner
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-01-03 06:58:57 -08:00
47a264a6aa
HBASE-19620 Add UT to confirm the race in MasterRpcServices.getProcedureResult
2018-01-03 20:29:02 +08:00
37f846dc0c
HBASE-19666 TestDefaultCompactSelection test failed
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-01-03 19:12:17 +08:00
76580fa991
HBASE-19675 Miscellaneous HStore Class Improvements.
...
* Use HashSet instead of List for a variable which is only used for lookups
* Remove logging code guards in favor of slf4j parameters
* Use CollectionsUtils.isEmpty() consistently
* Small check-style fixes
2018-01-02 15:21:15 -08:00
97c770a1d3
HBASE-19667 Get rid of MasterEnvironment#supportGroupCPs
2018-01-03 05:03:57 +08:00
69e161cf64
HBASE-19676 CleanerChore logging improvements (BELUGA BEHR)
2018-01-02 06:27:41 -08:00
488797f4bb
HBASE-19658: Fixing small problem and enabling test
2018-01-02 12:54:05 +02:00
99399cdeef
HBASE-19671 Fix TestMultiParallel#testActiveThreadsCount
2018-01-02 17:05:47 +08:00
3f1cfc8f08
HBASE-19679 Superusers Logging and Data Structures (BELUGA BEHR)
2018-01-01 14:19:04 -08:00
c394f3919e
HBASE-19678 HBase Admin security capabilities should be represented as a Set - revert due to wrong issue
2018-01-01 14:16:46 -08:00
c2ca90f0fb
HBASE-19678 HBase Admin security capabilities should be represented as a Set (BELUGA BEHR)
2017-12-31 11:32:14 -08:00
2f5ca9010b
HBASE-19677 Miscellaneous HFileCleaner Improvements (BELUGA BEHR)
2017-12-31 09:47:53 -08:00
5b3513a5ee
HBASE-19672 Correct comments for default values of major compaction in SortedCompactionPolicy#getNextMajorCompactTime()
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-12-30 16:28:09 -08:00
24b7fc92f0
HBASE-19649 Use singleton feature for ImmutableSegment
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-30 06:42:24 +08:00
9e141d12a4
HBASE-8518 Get rid of hbase.hstore.compaction.complete setting
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-30 04:32:12 +08:00
5612f2f692
HBASE-19428 Deprecate the compareTo(Row)
2017-12-29 20:07:21 +08:00
0907563eb7
HBASE-19282: Making CellChunkMap the default index (CellSet delegatee) for ImmutableSegments, when MSLAB is used.
...
In order to avoid additional user settings. If no MSLAB is requested the index is going to be CellArrayMap
Signed-off-by: Anastasia Braginsky <anastas@yahoo-inc.com>
Signed-off-by: Michael Stack <stack@apache.org>
2017-12-28 16:49:56 -08:00
b4e3798bb9
HBASE-19660 Up default retries from 10 to 15 and blocking store files limit from 10 to 16
2017-12-28 15:02:23 -08:00
a8ef734ddd
HBASE-19651 Remove LimitInputStream
...
Signed-off-by: Beluga Behr <dam6923@gmail.com>
2017-12-28 13:08:46 -08:00
d8775d08ae
HBASE-19656 Disable TestAssignmentManagerMetrics for beta-1
2017-12-28 12:15:00 -08:00
f96f89157d
HBASE-19133 Transfer big cells or upserted/appended cells into
...
MSLAB upon flattening to CellChunkMap
Signed-off-by: Gali Sheffi <gsheffi@oath.com>
2017-12-28 10:53:06 -08:00
64cb777a8a
HBASE-19552 find-and-replace thirdparty offset
2017-12-28 12:01:25 -06:00
968b938fde
HBASE-19552 Update hbase-thirdparty version
...
Some manual cleanup of changing package names in pom files and getting
rid of the no-longer-needed netty system property.
This commit will break compilation, package renames in source code are
done in follow-on commits using straightforward find and replace.
's/org.apache.hadoop.hbase.shaded.com.google/org.apache.hbase.thirdparty.com.google/'
's/org.apache.hadoop.hbase.shaded.io.netty/org.apache.hbase.thirdparty.io.netty/'
2017-12-28 11:58:49 -06:00
33ce14cb29
HBASE-19643 Need to update cache location when get error in AsyncBatchRpcRetryingCaller
2017-12-28 14:44:17 +08:00
97f0aad66e
HBASE-19626 Rename Cell.DataType to Cell.Type
2017-12-28 12:59:28 +08:00
50348cc1a4
HBASE-19652 Turn down CleanerChore logging; too chatty
2017-12-27 20:50:46 -08:00
d6d8369655
HBASE-19648 Move branch-2 version from 2.0.0-beta-1-SNAPSHOT to 2.0.0-beta-1
2017-12-27 14:41:19 -08:00
e4ab29ada2
HBASE-19647 Logging cleanups; emit regionname when RegionTooBusyException inside RetriesExhausted... make netty connect/disconnect TRACE-level; ADDENDUM
2017-12-27 14:14:37 -08:00
7dee1bcd31
HBASE-19644 add the checkstyle rule to reject the illegal imports
2017-12-28 04:17:45 +08:00
cc8b37f847
HBASE-19647 Logging cleanups; emit regionname when RegionTooBusyException inside RetriesExhausted... make netty connect/disconnect TRACE-level
2017-12-27 11:56:40 -08:00
2468f30029
HBASE-19628 ByteBufferCell should extend ExtendedCell
2017-12-27 23:02:18 +08:00
0454a389a3
HBASE-19629 RawCell#getTags should return the Iterator<Tag> in order to avoid iterating through whole tag array at once
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-27 21:30:08 +08:00
9c9beb79ef
HBASE-19615 CompositeImmutableSegment ArrayList Instead of LinkedList
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-27 10:00:51 +08:00
f0781d49e4
HBASE-19624 TestIOFencing hangs
2017-12-27 09:38:17 +08:00
8362b0dba5
HBASE-19550 Wrap the cell passed via Mutation#add(Cell) to be of ExtendedCell
2017-12-26 16:43:01 +08:00
2abf7b508c
HBASE-19621 Revisit the methods in ReplicationPeerConfigBuilder
2017-12-26 14:44:07 +08:00
65159dc256
HBASE-19618 Remove replicationQueuesClient.class/replicationQueues.class config and remove table based ReplicationQueuesClient/ReplicationQueues implementation
2017-12-26 14:44:02 +08:00
33f2e6535c
HBASE-19608 Race in MasterRpcServices.getProcedureResult
2017-12-25 11:52:38 +08:00
1e490dcc11
HBASE-19602 Cleanup the usage of ReplicationAdmin from document
2017-12-23 19:05:04 +08:00
b552eb2ff9
HBASE-19576 Introduce builder for ReplicationPeerConfig and make it immutable
2017-12-23 19:04:58 +08:00
96ae9add68
HBASE-19514 TestJMXListener now uses random port
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2017-12-22 18:46:52 +01:00
79d4f6c11c
HBASE-19593 Possible NPE if wal is closed during waledit append.(Rajeshabbu)
2017-12-22 17:21:30 +05:30
d4af099e9e
HBASE-19496 Reusing the ByteBuffer in rpc layer corrupt the ServerLoad and RegionLoad
2017-12-22 18:58:08 +08:00
3a210d514c
HBASE-19590 Remove the duplicate code in deprecated ReplicationAdmin
2017-12-22 18:36:28 +08:00
Michael Stack
Apekshit Sharma
zhangduo
huzheng
Guanghao Zhang
Aman Poonia
Mike Drob
Chia-Ping Tsai
Balazs Meszaros
Umesh Agashe
tedyu
Rajeshbabu Chintaguntla
anastas
Ashish Singhi
Peter Somogyi
kewang
Rahul Gidwani
binlijin
Duo Zhang
Jan Hentschel
haxiaolin
Thiruvel Thirumoolan
Sergey Soldatov
Artem Ervits
Reid Chan
Guangxu Cheng
lixiang
Scott Wilson
Vasudevan
Rahul Gidwani
BELUGA BEHR
Jingyun Tian
Josh Elser
Xiang Li
brandboat
gsheffi