Commit Graph

14546 Commits

Author SHA1 Message Date
Guanghao Zhang 3e2941a49e HBASE-16868 Add a replicate_all flag to avoid misuse the namespaces and table-cfs config of replication peer 2017-11-23 14:54:19 +08:00
Reid Chan 2442cbb6ab HBASE-18309 Support multi threads in CleanerChore
Signed-off-by: Yu Li <liyu@apache.org>
2017-11-23 11:23:26 +08:00
Gary Helmling cdc2bb17ff HBASE-19332 DumpReplicationQueues misreports total WAL size 2017-11-22 16:25:12 -08:00
Josh Elser 6f0c9fbfd1 HBASE-19317 Set a high NodeManager max disk utilization if not already set
This avoids the situation where the build machine has sufficient disk
space (a few GB's at most) to run an HBase test, but the default YARN
configuration would preclude the NM's from starting correctly. This
should eliminate a trivial source of build flakiness based on the host
machines being used.

Signed-off-by: Ted Yu <tedyu@apache.org>
2017-11-22 17:06:49 -05:00
Josh Elser b0b6064293 HBASE-19310 Avoid an NPE IntegrationTestImportTsv when outside of the context of JUnit
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
2017-11-22 17:06:49 -05:00
Peter Somogyi 548ebbc574
HBASE-19330 Remove duplicated dependency from hbase-rest
Remove the duplicated hbase-hadoop-compat dependency.

Signed-off-by: Michael Stack <stack@apache.org>
2017-11-22 12:47:12 -08:00
Michael Stack 194efe3e5a
HBASE-19122 preCompact and preFlush can bypass by returning null scanner; shut it down
Removed TestHRegion#testMemstoreSizeWithFlushCanceling test.
CPs are not able to cancel a flush any more so this test was
failing; removed it (It was testing memory accounting kept
working across a cancelled flush).

Signed-off-by: Michael Stack <stack@apache.org>
2017-11-22 08:01:01 -08:00
wuguoquan 7acf3f9a9c HBASE-19321 ZKAsyncRegistry ctor would hang when zookeeper cluster is not available 2017-11-22 15:41:44 +08:00
zhangduo 1a4037b9dc HBASE-19311 Promote TestAcidGuarantees to LargeTests and start mini cluster once to make it faster 2017-11-22 14:10:10 +08:00
Apekshit 3b2b22b5fa HBASE-19291 Use common header and footer for JSP pages
Use header and footer in our *.jsp pages to avoid unnecessary redundancy (copy-paste of code)

Misc edits:
- Due to redundancy, new additions make it to some places but not others. For eg there are missing links to "/logLevel", "/processRS.jsp" in few places.
- Fix processMaster.jsp wrongly pointing to rs-status instead of master-status (probably due to copy paste from processRS.jsp)
- Deleted a bunch of extraneous "</a>" in processMaster.jsp & processRS.jsp
- Added missing </div> tag in snapshot.jsp
- Deleted fossils of html5shiv.js. It's uses and the js itself were deleted in the commit "819aed4ccd073d818bfef5931ec8d248bfae5f1f"
- Fixed wrongly matched heading tags
- Deleted some unused variables

Tested:
Ran standalone cluster and opened each page to make sure it looked right.

Sidenote:
Looks like HBASE-3835 started the work of converting from jsp to jamon, but the work didn't finish. Now we have a mix of jsp and jamon. Needs reconciling, but later.
2017-11-21 13:52:32 -08:00
anoopsamjohn 984e0ecfc4 HBASE-19301 Provide way for CPs to create short circuited connection with custom configurations. 2017-11-21 19:04:53 +05:30
zhangduo 48cf4c7abe HBASE-19313 Call blockUntilConnected when constructing ZKAsyncRegistry(temporary workaround) 2017-11-21 21:28:54 +08:00
Sergey Soldatov 0e289a851b HBASE-19304 KEEP_DELETED_CELLS should ignore case
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-11-21 20:40:56 +08:00
Guanghao Zhang e1133d5201 HBASE-19293 Support add a disabled state replication peer directly 2017-11-21 15:26:06 +08:00
Frank Welsch 8f806ab486 HBASE-16574 Book updates for backup and restore
Signed-off-by: Josh Elser <elserj@apache.org>
2017-11-20 13:12:00 -05:00
tedyu 9b7b83d862 HBASE-19288 Intermittent test failure in TestHStore.testRunDoubleMemStoreCompactors 2017-11-19 20:23:12 -08:00
Michael Stack b4fbf5fe18 HBASE-19299 Assert only one Connection is constructed when calculating splits in a MultiTableInputFormat
Adds a test suite that has one test in it. Does a bunch of mocking so
getSplits can run. Has counter in mocked Connection constructor so can
count how many Connections made during call to getSplits. Verified that
assert fails if more than one Connection made.
2017-11-18 16:04:27 -08:00
Michael Stack 08544e54a9 HBASE-19123 Purge 'complete' support from Coprocesor Observers 2017-11-18 16:04:27 -08:00
Michael Stack 777b653b45
HBASE-19260 Add lock back to avoid parallel accessing meta to locate region 2017-11-17 14:03:56 -08:00
Apekshit Sharma 330b0d05b9 HBASE-19114 Split out o.a.h.h.zookeeper from hbase-server and hbase-client
- Moved DrainingServerTracker and RegionServerTracker to hbase-server:o.a.h.h.master.
- Moved SplitOrMergeTracker to oahh.master (because it depends on a PB)
- Moving hbase-client:oahh.zookeeper.*  to hbase-zookeeper module.  After HBASE-19200, hbase-client doesn't need them anymore (except 3 classes).
- Renamed some classes to use a consistent naming for classes - ZK instead of mix of ZK, Zk , ZooKeeper. Couldn't rename following public classes: MiniZooKeeperCluster, ZooKeeperConnectionException. Left RecoverableZooKeeper for lack of better name. (suggestions?)
- Sadly, can't move tests out because they depend on HBaseTestingUtility (which defeats part of the purpose - trimming down hbase-server tests. We need to promote more use of mocks in our tests)
2017-11-17 13:20:18 -08:00
Guangxu Cheng ca74ec7740
HBASE-19269 Reenable TestShellRSGroups
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-17 11:56:22 -08:00
zhangduo 907b268fd4 HBASE-19271 Update ref guide about the async client to reflect the change in HBASE-19251
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-17 10:38:59 -08:00
Guangxu Cheng e8ae6d4b73 HBASE-19274 Log IOException when unable to determine the size of committed file
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-11-17 03:00:36 -08:00
tedyu e6e731cb86 HBASE-19273 IntegrationTestBulkLoad#installSlowingCoproc() uses read-only HTableDescriptor 2017-11-16 21:04:33 -08:00
Guanghao Zhang 52273aa8f3 HBASE-18911 Unify Admin and AsyncAdmin's methods name 2017-11-17 09:46:54 +08:00
huzheng d726492838 HBASE-19252 Move the transform logic of FilterList into transformCell() method to avoid extra ref to question cell 2017-11-17 09:26:04 +08:00
Michael Stack 5b13b624bb
HBASE-19181 LogRollBackupSubprocedure will fail if we use AsyncFSWAL instead of FSHLog (Vladimir Rodionov) 2017-11-16 15:04:07 -08:00
Michael Stack f7212aaeba
HBASE-19268 Enable Replica tests that were disabled by Proc-V2 AM in HBASE-14614 2017-11-16 13:49:45 -08:00
Michael Stack 6f9651b417 HBASE-19276 RegionPlan should correctly implement equals and hashCode
Andrew's patch that adds equals and hash but revamping compare also.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-11-16 13:27:14 -08:00
Guanghao Zhang d8fb10c832 HBASE-19009 implement modifyTable and enable/disableTableReplication for AsyncAdmin (addendum) 2017-11-16 16:28:56 +08:00
Umesh Agashe 570d786ac4
HBASE-18964 Deprecated RowProcessor and Region#processRowsWithLocks() methods that take RowProcessor as an argument
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-15 23:40:00 -08:00
Michael Stack b35e18cccd
HBASE-19270 Reenable TestRegionMergeTransactionOnCluster#testMergeWithReplicas disable by HBASE-14614 2017-11-15 23:37:48 -08:00
Michael Stack 6d39b011d4
HBASE-18356 Enable TestFavoredStochasticBalancerPickers#testPickers that was disabled by Proc-V2 AM in HBASE-14614
Rebase/Fixup

Signed-off-by: Thiruvel Thirumoolan <thiruvel at yahoo-inc dot com>
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-15 23:32:33 -08:00
Michael Stack 92f53218e3
HBASE-19278 Reenable cleanup in test teardown in TestAccessController3 disabled by HBASE-14614
Remove a few unused imports.

Remove TestAsyncRegionAdminApi#testOffline, a test for a condition that
no longer exists (no offlining supported in hbase2).

M hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestAccessController3.java
 Uncomment cleanup called in test teardown.
2017-11-15 23:26:58 -08:00
zhangduo 54827cf613 HBASE-19251 Merge RawAsyncTable and AsyncTable 2017-11-16 14:36:28 +08:00
Michael Stack 3a4655019d HBASE-18357 Enable disabled tests in TestHCM that were disabled by Proc-V2 AM in HBASE-14614
Restore testRegionCaching and testMulti to working state (required
fixing move procedure and looking for a new exception).

testClusterStatus is broke because multicast is broken.
2017-11-15 18:39:28 -08:00
zhangduo d4babbf060 HBASE-19262 Revisit checkstyle rules 2017-11-16 09:43:08 +08:00
Guanghao Zhang 600fdee844 HBASE-19009 implement modifyTable and enable/disableTableReplication for AsyncAdmin 2017-11-16 07:07:20 +08:00
Sean Busbey d89682ea98 HBASE-19223 Note availability of Date Tiered Compaction in 1.y release for those upgrading from 0.98
Signed-off-by: Yu Li <liyu@apache.org>
Signed-off-by: Mike Drob <mdrob@apache.org>
2017-11-15 10:30:47 -06:00
Sean Busbey df98d6848f HBASE-19248 Move tests that need to look at Connection internals to test of said internals.
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-11-15 08:38:12 -06:00
anoopsamjohn 7d70487442 HBASE-19235 CoprocessorEnvironment should be exposed to CPs. 2017-11-15 14:49:42 +05:30
Guanghao Zhang 249bc09d8d HBASE-19255 PerformanceEvaluation class not found when run PE test 2017-11-15 15:04:33 +08:00
Michael Stack 797670b129
HBASE-19245 MultiTableInputFormatBase#getSplits creates a Connection per Table
We make one Connection only instead of a Connection per table (Change is
just moving one line it involves right-shifting body of the function)
2017-11-14 21:47:35 -08:00
Umesh Agashe 0ac18a8126
HBASE-18963 Removed MultiRowMutationProcessor and modified mutateRows...() to use batchMutate() with atomic set to true 2017-11-14 21:44:30 -08:00
Lars Hofhansl 0c4fbcc329 HBASE-12091 Optionally ignore edits for dropped tables for replication. 2017-11-14 17:08:14 -08:00
tedyu f9b19c6e33 HBASE-19210 TestNamespacesInstanceResource fails 2017-11-14 11:04:31 -08:00
zhangduo e0580b20d1 HBASE-19243 Start mini cluster once before class for TestFIFOCompactionPolicy 2017-11-14 15:40:24 +08:00
Sean Busbey 7406c83ef6 HBASE-19249 test for "hbase antipatterns" should check _count_ of occurance rather than text of
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-11-13 22:35:10 -06:00
Abhishek Singh Chouhan 9ed6cf5cb8 HBASE-19215 Incorrect exception handling on the client causes incorrect call timeouts and byte buffer allocations on the server
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-11-13 18:02:22 -08:00
Andrew Purtell b2c2729c42 HBASE-19250 TestClientClusterStatus is flaky 2017-11-13 18:02:22 -08:00