Commit Graph

14535 Commits

Author SHA1 Message Date
Guanghao Zhang d6a4a3dc33 HBASE-19396 Fix flaky test TestHTableMultiplexerFlushCache 2017-12-02 20:12:38 +08:00
Andrew Purtell c0da74f7c1 HBASE-19406 Fix CompactionRequest equals and hashCode 2017-12-01 19:15:11 -08:00
libisthanks 5e0d00f884 HBASE-19336 Improve rsgroup to allow assign all tables within a specified namespace by only writing namespace
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2017-12-02 09:27:29 +08:00
Josh Elser 835d15bf97 HBASE-19285 Implements table-level latency histograms
For a egionserver's view of a table (the regions
that belong to a table hosted on a regionserver),
this change tracks the latencies of operations that
affect the regions for this table.

Tracking at the per-table level avoids the memory bloat
and performance impact that accompanied the previous
per-region latency metrics while still providing important
details for operators to consume.

Signed-Off-By: Andrew Purtell <apurtell@apache.org>
2017-12-01 17:46:09 -05:00
Mike Drob 680a534acd HBASE-19390 Temporary downgrade to Jetty 9.3 to match hadoop 2017-12-01 14:38:48 -06:00
Michael Stack 2e8bd0036d HBASE-19392 TestReplicaWithCluster#testReplicaGetWithPrimaryAndMetaDown failure in master
Signed-off-by: Huaxiang Sun <hsun@apache.org>
2017-11-30 22:45:39 -08:00
zhangduo 49a9fe4883 HBASE-19344 improve asyncWAL by using Independent thread for netty #IO in FanOutOneBlockAsyncDFSOutput 2017-12-01 11:19:03 +08:00
Guangxu Cheng cc3f804b07
HBASE-19326 Remove decommissioned servers from rsgroup
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-30 16:10:28 -08:00
Chia-Ping Tsai c64546aa31 HBASE-19350 TestMetaWithReplicas is flaky 2017-12-01 03:39:44 +08:00
Harshal Deepakkumar Jain e0dd26de8e HBASE-19388 - Incorrect value is being set for Compaction Pressure in RegionLoadStats object inside HRegion class
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-11-30 08:47:23 -08:00
meiyi 6a6409a30a HBASE-17918 document serial replication
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-11-30 21:27:39 +08:00
Toshihiro Suzuki 9692b61a0a HBASE-18112 Write RequestTooBigException back to client for NettyRpcServer
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-11-30 17:06:34 +08:00
Yuqi Gu ddbff4fd87 HBASE-19386 Enable Arm64 unaligned support for HBase
On Arm64, java.nio.Bits.unaligned() wrongly returns false due to a JDK bug.
This causes HBase UnsafeAvailChecker wrongly returning false on Arm64.
And it slso cause FuzzyRowFilter Unit test failed.
Fix it by providing a hard-code to enbale Arm64 unaligned support.

Jira: HBASE-19386

Change-Id: I3ab821dacbe42b18cd515080da1fa3dc1f1e1d28
Signed-off-by: Yuqi Gu <yuqi.gu@arm.com>
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-11-30 00:42:21 -08:00
zhangduo 9434d52c19 HBASE-19346 Use EventLoopGroup to create AsyncFSOutput 2017-11-30 15:22:23 +08:00
Michael Stack 91e75b2a2f HBASE-19385 [1.3] TestReplicator failed 1.3 nightly 2017-11-29 23:14:22 -08:00
Apekshit Sharma 81b95afbee HBASE-19367 Refactoring in RegionStates, and RSProcedureDispatcher
- Adding javadoc comments
- Bug: ServerStateNode#regions is HashSet but there's no synchronization to prevent concurrent addRegion/removeRegion. Let's use concurrent set instead.
- Use getRegionsInTransitionCount() directly to avoid instead of getRegionsInTransition().size() because the latter copies everything into a new array - what a waste for just the size.
- There's mixed use of getRegionNode and getRegionStateNode for same return type - RegionStateNode. Changing everything to getRegionStateNode. Similarly rename other *RegionNode() fns to *RegionStateNode().
- RegionStateNode#transitionState() return value is useless since it always returns it's first param.
- Other minor improvements
2017-11-29 22:40:11 -08:00
Apekshit Sharma 5b7f9c2535 HBASE-19382 Update report-flakies.py script to handle yetus builds. 2017-11-29 22:21:10 -08:00
Michael Stack 79a89beb2e HBASE-19383 [1.2] java.lang.AssertionError: expected:<2> but was:<1> at
org.apache.hadoop.hbase.TestChoreService.testTriggerNowFailsWhenNotScheduled(TestChoreService.java:707)
2017-11-29 20:46:18 -08:00
Guanghao Zhang abb535eef6
HBASE-19359 Revisit the default config of hbase client retries number 2017-11-29 10:32:42 -08:00
zhangduo f81ac42aa3
HBASE-19372 Remove the Span object in SyncFuture as it is useless now
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-29 09:11:46 -08:00
binlijin 8b32d37929 HBASE-19290 Reduce zk request when doing split log 2017-11-29 18:42:14 +08:00
Guangxu Cheng b4a4be65ea HBASE-19362 Remove unused imports from hbase-thrift module
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2017-11-29 11:00:59 +01:00
Jerry He e67a3699c4 HBASE-19096 Add RowMutions batch support in AsyncTable
Signed-off-by: Jerry He <jerryjch@apache.org>
2017-11-28 18:42:17 -08:00
zhangduo 93b91e2cc6 HBASE-17049 Do not issue sync request when there are still entries in ringbuffer 2017-11-29 10:19:42 +08:00
Balazs Meszaros f6582400be
HBASE-19242 Add MOB compact support for AsyncAdmin
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Guanghao Zhang <zghaobac@gmail.com>
2017-11-28 15:03:50 -08:00
Peter Somogyi 520b9efc2d HBASE-19363 Tests under TestCheckAndMutate are identical
Remove testCheckAndMutateUsingNewComparisonOperatorInstead

Signed-off-by: Michael Stack <stack@apache.org>
2017-11-28 12:18:51 -08:00
Peter Somogyi b5a01685f4 HBASE-19351 Deprecated is missing in Table implementations
Signed-off-by: Michael Stack <stack@apache.org>
2017-11-28 11:17:35 -08:00
Chia-Ping Tsai b75510284f HBASE-19342 fix TestTableBasedReplicationSourceManagerImpl#testRemovePeerMetricsCleanup 2017-11-28 18:06:38 +08:00
Balazs Meszaros 0f33931b2a
HBASE-19328 Remove asked if splittable log messages
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-11-27 21:06:49 -08:00
binlijin 3863559b07 HBASE-19338 Performance regression in RegionServerRpcQuotaManager to get ugi 2017-11-28 09:57:35 +08:00
tedyu b048207c8e HBASE-19355 Missing dependency on hbase-zookeeper module causes CopyTable to fail 2017-11-27 17:39:42 -08:00
Apekshit Sharma e70b628544 HBASE-19335 Fix waitUntilAllRegionsAssigned(). Ignore assignments to killed servers and when region state != OPEN.
Update timeouts for TestRegionObserverInterface.
Reason: There are ~10 tests there, each with 5 min individual timeout. Too much. The test class is labelled MediumTests,
let's used that with our standard CategoryBasedTimeout. 3 min per test function should be enough even on slower Apache machines.
2017-11-27 16:20:15 -08:00
Balazs Meszaros 7c1c370f2f HBASE-18601 Update Htrace to 4.2 (addendum)
- TraceTree fix

Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-11-28 06:59:57 +08:00
Josh Elser 5c1acf4792 HBASE-19318 Use the PB service interface as the judge of whether some security feature exists
Hard-coded checks on HBase implementations (e.g. AccessController and
VisibilityController) preclude custom implementations of authorization
and visibility labels (Apache Ranger).

Signed-off-by: Ted Yu <tedyu@apache.org>
2017-11-27 17:49:23 -05:00
Apekshit Sharma f886716617 HBASE-19319 Fix bug in synchronizing over ProcedureEvent
Also moves event related functions (wake/wait/suspend) from ProcedureScheduler to ProcedureEvent class
2017-11-27 11:51:17 -08:00
Guangxu Cheng 5a0881a98b HBASE-19325 Pass a list of server name to postClearDeadServers
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-11-28 02:47:06 +08:00
Guanghao Zhang f521000d78 HBASE-19337 AsyncMetaTableAccessor may hang when call ScanController.terminate many times 2017-11-25 19:29:08 +08:00
Vasudevan 73e3af00e9 HBASE-19092 Make Tag IA.LimitedPrivate and expose for CPs (Ram) 2017-11-24 12:21:38 +05:30
Chia-Ping Tsai 8572364c37 HBASE-19266 TestAcidGuarantees should cover adaptive in-memory compaction 2017-11-24 00:16:50 +08:00
Guanghao Zhang 3e2941a49e HBASE-16868 Add a replicate_all flag to avoid misuse the namespaces and table-cfs config of replication peer 2017-11-23 14:54:19 +08:00
Reid Chan 2442cbb6ab HBASE-18309 Support multi threads in CleanerChore
Signed-off-by: Yu Li <liyu@apache.org>
2017-11-23 11:23:26 +08:00
Gary Helmling cdc2bb17ff HBASE-19332 DumpReplicationQueues misreports total WAL size 2017-11-22 16:25:12 -08:00
Josh Elser 6f0c9fbfd1 HBASE-19317 Set a high NodeManager max disk utilization if not already set
This avoids the situation where the build machine has sufficient disk
space (a few GB's at most) to run an HBase test, but the default YARN
configuration would preclude the NM's from starting correctly. This
should eliminate a trivial source of build flakiness based on the host
machines being used.

Signed-off-by: Ted Yu <tedyu@apache.org>
2017-11-22 17:06:49 -05:00
Josh Elser b0b6064293 HBASE-19310 Avoid an NPE IntegrationTestImportTsv when outside of the context of JUnit
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
2017-11-22 17:06:49 -05:00
Peter Somogyi 548ebbc574
HBASE-19330 Remove duplicated dependency from hbase-rest
Remove the duplicated hbase-hadoop-compat dependency.

Signed-off-by: Michael Stack <stack@apache.org>
2017-11-22 12:47:12 -08:00
Michael Stack 194efe3e5a
HBASE-19122 preCompact and preFlush can bypass by returning null scanner; shut it down
Removed TestHRegion#testMemstoreSizeWithFlushCanceling test.
CPs are not able to cancel a flush any more so this test was
failing; removed it (It was testing memory accounting kept
working across a cancelled flush).

Signed-off-by: Michael Stack <stack@apache.org>
2017-11-22 08:01:01 -08:00
wuguoquan 7acf3f9a9c HBASE-19321 ZKAsyncRegistry ctor would hang when zookeeper cluster is not available 2017-11-22 15:41:44 +08:00
zhangduo 1a4037b9dc HBASE-19311 Promote TestAcidGuarantees to LargeTests and start mini cluster once to make it faster 2017-11-22 14:10:10 +08:00
Apekshit 3b2b22b5fa HBASE-19291 Use common header and footer for JSP pages
Use header and footer in our *.jsp pages to avoid unnecessary redundancy (copy-paste of code)

Misc edits:
- Due to redundancy, new additions make it to some places but not others. For eg there are missing links to "/logLevel", "/processRS.jsp" in few places.
- Fix processMaster.jsp wrongly pointing to rs-status instead of master-status (probably due to copy paste from processRS.jsp)
- Deleted a bunch of extraneous "</a>" in processMaster.jsp & processRS.jsp
- Added missing </div> tag in snapshot.jsp
- Deleted fossils of html5shiv.js. It's uses and the js itself were deleted in the commit "819aed4ccd073d818bfef5931ec8d248bfae5f1f"
- Fixed wrongly matched heading tags
- Deleted some unused variables

Tested:
Ran standalone cluster and opened each page to make sure it looked right.

Sidenote:
Looks like HBASE-3835 started the work of converting from jsp to jamon, but the work didn't finish. Now we have a mix of jsp and jamon. Needs reconciling, but later.
2017-11-21 13:52:32 -08:00
anoopsamjohn 984e0ecfc4 HBASE-19301 Provide way for CPs to create short circuited connection with custom configurations. 2017-11-21 19:04:53 +05:30