5171 Commits

Author SHA1 Message Date
Ankit Singhal
56aa9ab8a3 HBASE-20908 Infinite loop on regionserver if region replica are reduced
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-23 13:11:39 -07:00
Toshihiro Suzuki
2eaa24a132 HBASE-17885 Backport HBASE-15871 to branch-1
HBASE-15871 Memstore flush doesn't finish because of backwardseek() in memstore scanner (ramkrishna.s.vasudevan)

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-23 12:27:52 -07:00
tedyu
a7fe71da88 HBASE-20917 MetaTableMetrics#stop references uninitialized requestsMap for non-meta region 2018-07-23 10:04:10 -07:00
TAK LON WU
9db4a4059a HBASE-20401 Make MAX_WAIT and waitIfNotFinished in CleanerContext configurable
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-23 17:16:08 +08:00
TAK LON WU
896b69a0fc HBASE-20559 Backport HBASE-18083 (Make large/small file clean thread number configurable in HFileCleaner) to branch-1
The last port commit of HBASE-20555

Signed-off-by: Yu Li <liyu@apache.org>
2018-07-23 11:36:47 +08:00
TAK LON WU
780724b15a HBASE-20558 Port HBASE-17854 (Use StealJobQueue in HFileCleaner after HBASE-17215) to branch-1
The third port commit of HBASE-20555
2018-07-20 16:11:09 -07:00
Ankit
e5618a6674 HBASE-20672 New metrics ReadRequestRate and WriteRequestRate
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-19 15:36:01 -07:00
jingyuntian
15ed2e86e1 HBASE-20855 PeerConfigTracker only supporting one listener will cause problem when there is a recovered replication queue
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-19 08:43:23 -07:00
tedyu
7211d13ac8 HBASE-20889 PE scan is failing with NullPointerException 2018-07-16 09:53:47 -07:00
zhaoyuan
6edb27e1e6 HBASE-20697 Can't cache All region locations of the specify table by calling table.getRegionLocator().getAllRegionLocations()
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-07-11 11:33:32 +08:00
Huaxiang Sun
f2dc754aa3 HBASE-20651 Master, prevents hbck or shell command to reassign the split parent region
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2018-07-10 16:07:30 -07:00
Xu Cang
99189f284b HBASE-20858 Port HBASE-20695 (Implement table level RegionServer replication metrics) to branch-1
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-07-09 12:19:21 -07:00
TAK LON WU
a52c6bf2f3 HBASE-20557 Backport HBASE-17215 to branch-1
The second backport of HBASE-20555

Signed-off-by: Zach York <zyork@apache.org>
2018-07-09 11:32:04 -07:00
Abhishek Singh Chouhan
a4db453c6d HBASE-20806 Split style journal for flushes and compactions 2018-07-09 18:44:07 +05:30
Nihal Jain
77e5668ed2 HBASE-20808 Wrong shutdown order between Chores and ChoreService
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-07-07 00:32:33 +08:00
Josh Elser
154b77307f HBASE-20826 Truncate really long RpcServer warnings unless TRACE is on
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-07-05 17:21:30 -07:00
Yu Li
50f7894cc4 HBASE-20691 Change the default WAL storage policy back to "NONE""
This partially reverts HBASE-19858 and adds more doc about why we choose "NONE" as the default.
2018-07-05 15:26:56 +08:00
huzheng
a25cf7bbdb HBASE-20789 TestBucketCache#testCacheBlockNextBlockMetadataMissing is flaky 2018-07-04 09:49:07 +08:00
Nihal Jain
f94ad9d78f HBASE-20450 Provide metrics for number of total active, priority and replication rpc handlers
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-07-02 11:19:19 -07:00
jingyuntian
cc8e1cc393 HBASE-20769 getSplits() has a out of bounds problem in TableSnapshotInputFormatImpl
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-29 15:25:06 -07:00
Xu Cang
2fd69cf93c HBASE-19722 Implement a meta query statistics metrics source
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-28 17:17:50 -07:00
Reid Chan
c81d0aff95 HBASE-20732 Shutdown scan pool when master is stopped 2018-06-28 12:36:50 +08:00
Michael Stack
03946a389a HBASE-20785 NPE getting metrics in PE testing scans 2018-06-27 12:04:21 -07:00
Michael Stack
ccead1264c HBASE-20770 WAL cleaner logs way too much; gets clogged when lots of work to do
General log cleanup; setting stuff that can flood the log to TRACE.

Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-06-26 15:54:47 -07:00
Monani Mihir
4936750d3a HBASE-20701 too much logging when balancer runs from BaseLoadBalancer
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-06-25 17:17:31 -07:00
tedyu
6fa9f0bea9 HBASE-20723 Custom hbase.wal.dir results in data loss because we write recovered edits into a different place than where the recovering region server looks for them 2018-06-15 19:51:33 -07:00
Zach York
bed3b2bbae HBASE-20556 Backport HBASE-16490 to branch-1
Backport by: taklonwu@gmail.com

Signed-off-by: Zach York <zyork@apache.org>
2018-06-12 12:34:05 -07:00
Josh Elser
c596fb6c3f HBASE-20605 Excludes Azure's new filesystem from the SecureBulkLoadEndpoint perm check
Signed-off-by: Ted Yu <yuzhihong@gmail.com>
2018-06-06 16:23:51 -04:00
Andrew Purtell
409531209e HBASE-20670 NPE in HMaster#isInMaintenanceMode 2018-06-04 13:03:16 -07:00
Andrew Purtell
07487cb0b1 HBASE-20667 Rename TestGlobalThrottler to TestReplicationGlobalThrottler 2018-06-01 16:47:26 -07:00
Xu Cang
a25878cf40 HBASE-18116 Replication source in-memory accounting should not include bulk transfer hfiles
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-06-01 13:34:43 -07:00
Andrew Purtell
08b7ed1656 Revert "HBASE-18116 fix replication source in-memory calculation by excluding bulk load file"
This reverts commit dcb5b5a0124d4204c979d13b84c60f7de1ab4929.
2018-05-31 15:28:50 -07:00
Xu Cang
dcb5b5a012 HBASE-18116 fix replication source in-memory calculation by excluding bulk load file
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-05-31 14:22:07 -07:00
Andrew Purtell
f4ac15999a Amend HBASE-20646 TestWALProcedureStoreOnHDFS failing on branch-1
Suppress error-prone false positive
2018-05-30 13:46:46 -07:00
Andrew Purtell
011989665e HBASE-20597 Serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint 2018-05-29 11:25:25 -07:00
Andrew Purtell
5a0bb1c6b8 Revert "HBASE-20597 Use a lock to serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint"
This reverts commit 1b70763b9ee6b23a0a3c9db0474c4c6654ce7189.
2018-05-29 11:25:25 -07:00
Toshihiro Suzuki
289d588af3 HBASE-20647 Backport HBASE-20616 "TruncateTableProcedure is stuck in retry loop in TRUNCATE_TABLE_CREATE_FS_LAYOUT state" to branch-1
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-25 06:18:43 -07:00
Andrew Purtell
87d4e4e4e2 HBASE-20646 TestWALProcedureStoreOnHDFS failing on branch-1 2018-05-24 18:06:12 -07:00
Thiruvel Thirumoolan
b892be7440 HBASE-20548 Master fails to startup on large clusters, refreshing block distribution
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-24 12:27:19 -07:00
Andrew Purtell
1b70763b9e HBASE-20597 Use a lock to serialize access to a shared reference to ZooKeeperWatcher in HBaseReplicationEndpoint 2018-05-23 16:45:55 -07:00
Xu Cang
6d1aa2800b HBASE-20486 Change default throughput controller to PressureAwareThroughputController
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-22 12:43:31 -07:00
Balazs Meszaros
2d493556f3 HBASE-20571 JMXJsonServlet generates invalid JSON if it has NaN in metrics
- CacheStats won't generate NaN metrics.
- JSONBean class will serialize special floating point values as
  "NaN", "Infinity" or "-Infinity"

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-16 11:50:31 -07:00
Thiruvel Thirumoolan
2a309d71cc HBASE-20545 Improve performance of BaseLoadBalancer.retainAssignment
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-15 18:17:52 -07:00
Zach York
944a221b74 HBASE-20447 Only fail cacheBlock if block collisions aren't related to next block metadata
When we pread, we don't force the read to read all of the next block header.
However, when we get into a race condition where two opener threads try to
cache the same block and one thread read all of the next block header and
the other one didn't, it will fail the open process. This is especially important
in a splitting case where it will potentially fail the split process.
Instead, in the caches, we should only fail if the required blocks are different.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-14 16:09:36 -07:00
Ashish Singhi
ca544a155c HBASE-20004 Client is not able to execute REST queries in a secure cluster
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-05-10 22:49:08 +05:30
Andrew Purtell
c191462ac3 HBASE-20554 "WALs outstanding" message from CleanerChore is noisy 2018-05-09 19:13:17 -07:00
Zach York
5406f63332 HBASE-20204 Add locking to RefreshFileConnections in BucketCache
This is a follow-up to HBASE-20141 where Anoop suggested adding locking
for refreshing channels.
2018-05-09 14:15:02 -07:00
Andrew Purtell
9d9d5aec0e HBASE-20505 PE should support multi column family read and write cases 2018-05-07 18:39:18 -07:00
Vasudevan
91f3de89ab HBASE-20523 PE tool should support configuring client side buffering sizes
(Ram)
2018-05-07 14:41:08 +05:30
Andrew Purtell
23b9054089 HBASE-20513 Collect and emit ScanMetrics in PerformanceEvaluation 2018-05-04 17:59:28 -07:00