5160 Commits

Author SHA1 Message Date
Xu Cang
99189f284b HBASE-20858 Port HBASE-20695 (Implement table level RegionServer replication metrics) to branch-1
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-09 12:19:21 -07:00
TAK LON WU
a52c6bf2f3 HBASE-20557 Backport HBASE-17215 to branch-1
The second backport of HBASE-20555

Signed-off-by: Zach York <zyork@apache.org>
2018-07-09 11:32:04 -07:00
Abhishek Singh Chouhan
a4db453c6d HBASE-20806 Split style journal for flushes and compactions 2018-07-09 18:44:07 +05:30
Nihal Jain
77e5668ed2 HBASE-20808 Wrong shutdown order between Chores and ChoreService
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-07 00:32:33 +08:00
Josh Elser
154b77307f HBASE-20826 Truncate really long RpcServer warnings unless TRACE is on
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-07-05 17:21:30 -07:00
Yu Li
50f7894cc4 HBASE-20691 Change the default WAL storage policy back to "NONE""
This partially reverts HBASE-19858 and adds more doc about why we choose "NONE" as the default.
2018-07-05 15:26:56 +08:00
huzheng
a25cf7bbdb HBASE-20789 TestBucketCache#testCacheBlockNextBlockMetadataMissing is flaky 2018-07-04 09:49:07 +08:00
Nihal Jain
f94ad9d78f HBASE-20450 Provide metrics for number of total active, priority and replication rpc handlers
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-02 11:19:19 -07:00
jingyuntian
cc8e1cc393 HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-29 15:25:06 -07:00
Xu Cang
2fd69cf93c HBASE-19722 Implement a meta query statistics metrics source
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-28 17:17:50 -07:00
Reid Chan
c81d0aff95 HBASE-20732 Shutdown scan pool when master is stopped 2018-06-28 12:36:50 +08:00
Michael Stack
03946a389a HBASE-20785 NPE getting metrics in PE testing scans 2018-06-27 12:04:21 -07:00
Michael Stack
ccead1264c HBASE-20770 WAL cleaner logs way too much; gets clogged when lots of work to do
General log cleanup; setting stuff that can flood the log to TRACE.

Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-06-26 15:54:47 -07:00
Monani Mihir
4936750d3a HBASE-20701 too much logging when balancer runs from BaseLoadBalancer
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-25 17:17:31 -07:00
tedyu
6fa9f0bea9 HBASE-20723 Custom hbase.wal.dir results in data loss because we write recovered edits into a different place than where the recovering region server looks for them 2018-06-15 19:51:33 -07:00
Zach York
bed3b2bbae HBASE-20556 Backport HBASE-16490 to branch-1
Backport by: taklonwu@gmail.com

Signed-off-by: Zach York <zyork@apache.org>
2018-06-12 12:34:05 -07:00
Josh Elser
c596fb6c3f HBASE-20605 Excludes Azure's new filesystem from the SecureBulkLoadEndpoint perm check
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-06-06 16:23:51 -04:00
Andrew Purtell
409531209e HBASE-20670 NPE in HMaster#isInMaintenanceMode 2018-06-04 13:03:16 -07:00
Andrew Purtell
07487cb0b1 HBASE-20667 Rename TestGlobalThrottler to TestReplicationGlobalThrottler 2018-06-01 16:47:26 -07:00
Xu Cang
a25878cf40 HBASE-18116 Replication source in-memory accounting should not include bulk transfer hfiles
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-06-01 13:34:43 -07:00
Andrew Purtell
08b7ed1656 Revert "HBASE-18116 fix replication source in-memory calculation by excluding bulk load file"
This reverts commit dcb5b5a0124d4204c979d13b84c60f7de1ab4929.
2018-05-31 15:28:50 -07:00
Xu Cang
dcb5b5a012 HBASE-18116 fix replication source in-memory calculation by excluding bulk load file
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-05-31 14:22:07 -07:00
Andrew Purtell
f4ac15999a Amend HBASE-20646 TestWALProcedureStoreOnHDFS failing on branch-1
Suppress error-prone false positive
2018-05-30 13:46:46 -07:00
Andrew Purtell
011989665e HBASE-20597 Serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint 2018-05-29 11:25:25 -07:00
Andrew Purtell
5a0bb1c6b8 Revert "HBASE-20597 Use a lock to serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint"
This reverts commit 1b70763b9ee6b23a0a3c9db0474c4c6654ce7189.
2018-05-29 11:25:25 -07:00
Toshihiro Suzuki
289d588af3 HBASE-20647 Backport HBASE-20616 "TruncateTableProcedure is stuck in retry loop in TRUNCATE_TABLE_CREATE_FS_LAYOUT state" to branch-1
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-25 06:18:43 -07:00
Andrew Purtell
87d4e4e4e2 HBASE-20646 TestWALProcedureStoreOnHDFS failing on branch-1 2018-05-24 18:06:12 -07:00
Thiruvel Thirumoolan
b892be7440 HBASE-20548 Master fails to startup on large clusters, refreshing block distribution
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-24 12:27:19 -07:00
Andrew Purtell
1b70763b9e HBASE-20597 Use a lock to serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint 2018-05-23 16:45:55 -07:00
Xu Cang
6d1aa2800b HBASE-20486 Change default throughput controller to PressureAwareThroughputController
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-22 12:43:31 -07:00
Balazs Meszaros
2d493556f3 HBASE-20571 JMXJsonServlet generates invalid JSON if it has NaN in metrics
- CacheStats won't generate NaN metrics.
- JSONBean class will serialize special floating point values as
  "NaN", "Infinity" or "-Infinity"

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-16 11:50:31 -07:00
Thiruvel Thirumoolan
2a309d71cc HBASE-20545 Improve performance of BaseLoadBalancer.retainAssignment
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-15 18:17:52 -07:00
Zach York
944a221b74 HBASE-20447 Only fail cacheBlock if block collisions aren't related to next block metadata
When we pread, we don't force the read to read all of the next block header.
However, when we get into a race condition where two opener threads try to
cache the same block and one thread read all of the next block header and
the other one didn't, it will fail the open process. This is especially important
in a splitting case where it will potentially fail the split process.
Instead, in the caches, we should only fail if the required blocks are different.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-14 16:09:36 -07:00
Ashish Singhi
ca544a155c HBASE-20004 Client is not able to execute REST queries in a secure cluster
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-05-10 22:49:08 +05:30
Andrew Purtell
c191462ac3 HBASE-20554 "WALs outstanding" message from CleanerChore is noisy 2018-05-09 19:13:17 -07:00
Zach York
5406f63332 HBASE-20204 Add locking to RefreshFileConnections in BucketCache
This is a follow-up to HBASE-20141 where Anoop suggested adding locking
for refreshing channels.
2018-05-09 14:15:02 -07:00
Andrew Purtell
9d9d5aec0e HBASE-20505 PE should support multi column family read and write cases 2018-05-07 18:39:18 -07:00
Vasudevan
91f3de89ab HBASE-20523 PE tool should support configuring client side buffering sizes
(Ram)
2018-05-07 14:41:08 +05:30
Andrew Purtell
23b9054089 HBASE-20513 Collect and emit ScanMetrics in PerformanceEvaluation 2018-05-04 17:59:28 -07:00
Andrew Purtell
fd24083e26 HBASE-20517 Fix PerformanceEvaluation 'column' parameter 2018-05-04 17:24:38 -07:00
Andrew Purtell
e793e7c30c HBASE-20493 Port HBASE-19994 (Create a new class for RPC throttling exception, make it retryable) to branch-1 2018-04-26 15:38:40 -07:00
Andrew Purtell
71c573239b HBASE-20496 TestGlobalThrottler failing on branch-1 since revert of HBASE-9465
Temporarily disable TestGlobalThrottler on branch-1
2018-04-26 15:38:40 -07:00
Huaxiang Sun
eb67d4e308 HBASE-19924 hbase rpc throttling does not work for multi() with request count rater. 2018-04-26 10:43:59 -07:00
Toshihiro Suzuki
f11cf007a2 HBASE-20229 ConnectionImplementation.locateRegions() returns duplicated entries when region replication is on 2018-04-25 13:36:12 -07:00
Kevin Risden
e60189035e HBASE-20406 HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/http/TestHttpServer.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
2018-04-20 22:45:49 -05:00
Sean Busbey
eacf3cb296 Revert "HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods"
This reverts commit fe84833ea22c30b68022203132706ebb1e526852.

missing jira key
2018-04-20 22:45:37 -05:00
Kevin Risden
fe84833ea2 HBase Thrift HTTP - Shouldn't handle TRACE/OPTIONS methods
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/http/TestHttpServer.java
	hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
2018-04-20 15:15:31 -05:00
Toshihiro Suzuki
8a244e51d7 HBASE-20006 TestRestoreSnapshotFromClientWithRegionReplicas is flakey
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
Signed-off-by: Sean Busbey <busbey@apache.org>

 Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRestoreSnapshotFromClientWithRegionReplicas.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionReplayEvents.java
2018-04-20 11:34:45 -05:00
Toshihiro Suzuki
03eb3d24b6 HBASE-19850 The number of Offline Regions is wrong after restoring a snapshot
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-17 20:29:50 -07:00
Sean Busbey
ce4c243399 HBASE-20404 Fixes to CleanChore correctness and operability.
* Make CleanerChore less chatty: move WARN message to DEBUG when we expect non-empty dirs
* Make CleanerChore less chatty: move IOE we'll retry to INFO
* CleanerChore should treat IOE for FileStatus as a failure
* Add tests asserting assumptions in above

Signed-off-by: Reid Chan <reidddchan@outlook.com>
Signed-off-by: Mike Drob <mdrob@apache.org>

 Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/cleaner/CleanerChore.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/cleaner/TestCleanerChore.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSUtils.java
2018-04-17 13:05:41 -05:00