Commit Graph

7146 Commits

Author SHA1 Message Date
Allan Yang 681864cff0 HBASE-21754 ReportRegionStateTransitionRequest should be executed in priority executor 2019-01-23 21:34:48 +08:00
Nihal Jain 76df1c1590
HBASE-21749 RS UI may throw NPE and make rs-status page inaccessible with multiwal and replication
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-01-21 17:26:23 -08:00
huzheng 51b04f6f74 HBASE-21738 Remove all the CLSM#size operation in our memstore because it's an quite time consuming. 2019-01-21 17:28:47 +08:00
zhangduo 8615258d06 HBASE-21746 Fix two concern cases in RegionMover
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-20 08:57:31 +08:00
Guanghao Zhang 450124fe56 Revert "HBASE-21034 Add new throttle type: read/write capacity unit"
This reverts commit 483b7d008e.
2019-01-19 09:49:04 +08:00
zhangduo b06387b2b0 HBASE-19695 Handle disabled table for async client
Signed-off-by: tianjingyun <tianjy1990@gmail.com>
2019-01-18 09:48:27 +08:00
meiyi 483b7d008e HBASE-21034 Add new throttle type: read/write capacity unit
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-17 17:59:27 +08:00
tedyu 6c18d97357 HBASE-20917 MetaTableMetrics#stop references uninitialized requestsMap for non-meta region
with addendum

(cherry picked from commit 654480326b)
(cherry picked from commit 3787c72953)
2019-01-15 13:39:24 -07:00
Xu Cang d89e5270aa HBASE-19722 Meta query statistics metrics source
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 58ccd3dc7e)
2019-01-15 13:39:24 -07:00
Sean Busbey 47099d1b17 HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit. (addendum)
(cherry picked from commit a284c493b127fbf785fbee401f0854ad1979eb26)
(cherry picked from commit aa36c3f6b6)
2019-01-15 13:30:35 -07:00
Lars Hofhansl 5c7c425e34 HBASE-21590 Optimize trySkipToNextColumn in StoreScanner a bit.
(cherry picked from commit 11193d7cc1)
2019-01-15 13:30:35 -07:00
Pankaj 12dfc8bafd HBASE-21639 maxHeapUsage value not read properly from config during EntryBuffers initialization 2019-01-15 12:19:10 -08:00
zhangduo b26bcb852c HBASE-21705 Should treat meta table specially for some methods in AsyncAdmin 2019-01-13 13:41:10 +08:00
Duo Zhang d7db78b74c HBASE-21704 The implementation of DistributedHBaseCluster.getServerHoldingRegion is incorrect 2019-01-11 21:22:25 +08:00
Duo Zhang d04282627f HBASE-21663 Add replica scan support 2019-01-11 14:19:22 +08:00
Duo Zhang 3f750955b5 HBASE-21580 Support getting Hbck instance from AsyncConnection 2019-01-11 11:55:35 +08:00
Nihal Jain f357412941 HBASE-21297 ModifyTableProcedure can throw TNDE instead of IOE in case of REGION_REPLICATION change
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-10 22:23:31 +08:00
Guanghao Zhang 3e9e13f141 HBASE-21691 Fix flaky test TestRecoveredEdits 2019-01-10 14:39:42 +08:00
meiyi 117d12e9c6 HBASE-21694 Add append_peer_exclude_tableCFs and remove_peer_exclude_tableCFs shell commands
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-10 09:38:08 +08:00
Nihal Jain 111c827d1f HBASE-21645 Perform sanity check and disallow table creation/modification with region replication < 1
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-01-09 11:44:17 +08:00
stack 5364601dea HBASE-21698 Move version in branch-2.1 from 2.1.2 to 2.1.3-SNAPSHOT 2019-01-08 16:01:07 -08:00
zhangduo 1c73b230b8 HBASE-21683 Reset readsEnabled flag after successfully flushing the primary region 2019-01-08 15:51:52 +08:00
zhangduo 3de116af46 HBASE-21682 Support getting from specific replica 2019-01-08 09:49:22 +08:00
zhangduo 0c3da777e3 HBASE-17356 Add replica get support 2019-01-03 09:24:55 +08:00
Guanghao Zhang e669896502 HBASE-21640 Remove the TODO when increment zero 2018-12-26 21:56:39 +08:00
Andrey Elenskiy bfd75d81f9 HBASE-21545 NEW_VERSION_BEHAVIOR breaks Get/Scan with specified columns
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Sakthi
2018-12-23 22:02:46 -08:00
Duo Zhang 48786ad4a3 HBASE-21635 Use maven enforcer to ban imports from illegal packages 2018-12-24 11:30:28 +08:00
Guanghao Zhang 685a17a800 HBASE-21621 Reversed scan does not return expected number of rows
The unit test is contributed by Nihal Jain
2018-12-23 16:38:10 +08:00
Sakthi 7e911d9e21 HBASE-21631: list_quotas should print human readable values for LIMIT
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-22 22:10:26 +08:00
openinx c5810f19a6 HBASE-21620 Problem in scan query when using more than one column prefix filter in some cases
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-12-21 15:21:12 -08:00
huzheng 8f39e7633e HBASE-21401 Sanity check when constructing the KeyValue 2018-12-21 18:34:28 +08:00
Guanghao Zhang 512a6322d9 HBASE-21618 Scan with the same startRow(inclusive=true) and stopRow(inclusive=false) returns one result 2018-12-21 09:54:58 +08:00
Pankaj a76a842a61 HBASE-21610, numOpenConnections metric is set to -1 when zero server channel exist 2018-12-20 16:36:02 -08:00
Guanghao Zhang 27a0f205c5 HBASE-21498 Master OOM when SplitTableRegionProcedure new CacheConfig and instantiate a new BlockCache 2018-12-19 14:16:05 +08:00
xuqinya 8339e44361 HBASE-21592 quota.addGetResult(r) throw NPE
Signed-off-by: huzheng <openinx@gmail.com>
2018-12-18 16:40:26 +08:00
stack 7bed742931 HBASE-21589 TestCleanupMetaWAL fails 2018-12-17 09:31:13 -08:00
huzheng a700f1b02f HBASE-21520 TestMultiColumnScanner cost long time when using ROWCOL bloom type 2018-12-14 17:40:10 +08:00
Guanghao Zhang 0bb6f9e870 HBASE-21554 Show replication endpoint classname for replication peer on master web UI 2018-12-13 13:57:41 +08:00
huzheng 763e395d9e HBASE-21582 If call HBaseAdmin#snapshotAsync but forget call isSnapshotFinished, then SnapshotHFileCleaner will skip to run every time 2018-12-12 22:07:46 +08:00
Josh Elser 911b322e9f HBASE-21568 Use CacheConfig.DISABLED where we don't expect to have blockcache running
This includes removing the "old way" of disabling blockcache in favor of the
new API.

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-12-11 11:58:40 -05:00
zhangduo 492ca34025 HBASE-21570 Add write buffer periodic flush support for AsyncBufferedMutator 2018-12-11 15:29:56 +08:00
Allan Yang c9e85773d9 HBASE-21413 Empty meta log doesn't get split when restart whole cluster
Signed-off-by: stack <stack@apache.org>
2018-12-06 21:15:30 -08:00
huzheng 45324b6bb2 HBASE-21559 The RestoreSnapshotFromClientTestBase related UT are flaky
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-12-07 08:26:02 +08:00
stack ec39dc8c14 Revert "Backport "HBASE-21126 Add ability for HBase Canary to ignore a configurable number of ZooKeeper down nodes" to branch-2.0"
This reverts commit f60617ca0f.

Misapplied. Revert to fix.
2018-12-05 22:24:09 -08:00
David Manning f60617ca0f Backport "HBASE-21126 Add ability for HBase Canary to ignore a configurable number of ZooKeeper down nodes" to branch-2.0
Signed-off-by: Michael Stack <stack@apache.org>
2018-12-05 22:19:20 -08:00
stack 7c1f15bd2a HBASE-21558 Set version to 2.1.2 on branch-2.1 so can cut an RC 2018-12-05 21:24:04 -08:00
huzheng 0b181af4ec HBASE-21551 Memory leak when use scan with STREAM at server side - (addendum) 2018-12-06 11:28:28 +08:00
huzheng e9b0d73793 HBASE-21551 Memory leak when use scan with STREAM at server side 2018-12-06 10:58:04 +08:00
Peter Somogyi 58cfed60ec HBASE-21479 Individual tests in TestHRegionReplayEvents class are failing
Signed-off-by: Michael Stack <stack@apache.org>
2018-12-01 09:58:14 +01:00
Peter Somogyi 4ebbfa3d60 HBASE-21518 TestMasterFailoverWithProcedures is flaky
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-11-30 09:14:20 +01:00
huzheng bba29961e0 HBASE-21504 If enable FIFOCompactionPolicy, a compaction may write a "empty" hfile whose maxTimeStamp is long max. This kind of hfile will never be archived. 2018-11-30 09:55:12 +08:00
Artem Ervits 349a961554 HBASE-18735 Provide an option to kill a MiniHBaseCluster without waiting on shutdown
Signed-off-by: Josh Elser <elserj@apache.org>
2018-11-29 17:18:42 -05:00
meiyi 001aabd40a HBASE-21300 Fix the wrong reference file path when restoring snapshots for tables with MOB columns
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-29 17:53:05 +08:00
Duo Zhang 7946f96035 HBASE-21517 Move the getTableRegionForRow method from HMaster to TestMaster 2018-11-28 09:45:18 +08:00
BELUGA BEHR 15ebfe42a3 HBASE-21492 CellCodec Written To WAL Before It's Verified 2018-11-27 08:57:49 -08:00
lixiaobao a53b85ec22 HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
2018-11-27 20:58:39 +08:00
zhangduo b81cec47ec Revert "HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method"
This reverts commit 13955ba532.
2018-11-27 20:58:34 +08:00
lixiaobao 13955ba532 HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
2018-11-27 20:31:54 +08:00
Ted Yu 5ec30837ac HBASE-21511 Remove in progress snapshot check in SnapshotFileCache#getUnreferencedFiles 2018-11-25 18:27:52 -08:00
Ted Yu 795f677983 HBASE-21387 Addendum fix TestSnapshotFileCache
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-11-24 17:00:40 +08:00
huzheng a1d0199a16 HBASE-21387 Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files 2018-11-23 11:38:26 +08:00
Duo Zhang 0557afc461 HBASE-21503 Replication normal source can get stuck due potential race conditions between source wal reader and wal provider initialization threads.
Found and analysed by Wellington Chevreuil
2018-11-21 17:53:41 +08:00
Duo Zhang 030d06141c HBASE-21490 WALProcedure may remove proc wal files still with active procedures
Signed-off-by: Allan Yang <allan163@apache.org>
2018-11-19 08:20:49 -08:00
zhangduo 297d49b680 HBASE-21480 Taking snapshot when RS crashes prevent we bring the regions online 2018-11-18 21:08:00 +08:00
zhangduo e5758e86a8 HBASE-21485 Add more debug logs for remote procedure execution 2018-11-16 14:32:27 +08:00
Ankit Singhal d0c2e60e36 HBASE-21440 Assign procedure on the crashed server is not properly interrupted 2018-11-14 22:33:13 -08:00
huzheng f8213a719f HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags 2018-11-14 23:17:52 +08:00
Allan Yang 0f295de156 HBASE-21468 separate workers for meta table is not working 2018-11-14 11:43:41 +08:00
jingyuntian c95832159f HBASE-21410 A helper page that help find all problematic regions and procedures 2018-11-13 11:11:36 +08:00
huzheng e9e9d0dcef Revert "HBASE-21401 Sanity check in BaseDecoder#parseCell"
This reverts commit 0ec9f81bc8.
2018-11-12 11:43:37 +08:00
Duo Zhang ffefc49e85 HBASE-21376 Add some verbose log to MasterProcedureScheduler 2018-11-10 17:17:31 +08:00
Ben Lau 0875fa0634
HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancer.java
2018-11-08 14:09:55 -08:00
Esteban Gutierrez 3a13088a2e
HBASE-20604 ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-08 10:22:21 -08:00
huzheng 0ec9f81bc8 HBASE-21401 Sanity check in BaseDecoder#parseCell 2018-11-08 20:28:48 +08:00
tedyu 0250b4b536 HBASE-21247 Custom Meta WAL Provider doesn't default to custom WAL Provider whose configuration value is outside the enums in Providers 2018-11-06 12:36:29 -08:00
Sean Busbey 6f9084380b HBASE-21442 Update branch-2.1 for next development cycle
* update pom versions to 2.1.2-SNAPSHOT
* update CHANGES.md to mark release date (as of arriving in dist/release svn repo)
2018-11-06 14:19:47 -06:00
Allan Yang 5b8c767374 HBASE-21421 Do not kill RS if reportOnlineRegions fails 2018-11-06 14:51:54 +08:00
Allan Yang 0b7c66642b HBASE-21423 Procedures for meta table/region should be able to execute in separate workers 2018-11-05 20:37:15 +08:00
Allan Yang 9e52e9eb7d HBASE-21395 Abort split/merge procedure if there is a table procedure of the same table going on 2018-11-05 20:12:00 +08:00
Michael Stack 8df5878932 HBASE-21425 2.1.1 fails to start over 1.x data; namespace not assigned 2018-11-03 09:45:36 -07:00
zhangduo 46eb8f1d0d HBASE-21351 The force update thread may have race with PE worker when the procedure is rolling back 2018-11-03 08:25:43 +08:00
jingyuntian 3836967e05
HBASE-21407 Resolve NPE in backup Master UI
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-02 11:46:15 -07:00
Guanghao Zhang 29e3eec703 HBASE-21388 No need to instantiate MemStoreLAB for master which not carry table 2018-11-01 16:27:23 +08:00
Michael Stack 29d6eeb6e8
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService
ADDENDUM
2018-10-31 10:15:04 -07:00
Duo Zhang bddd488c34 HBASE-21237 Use CompatRemoteProcedureResolver to dispatch open/close region requests to RS 2018-10-30 17:36:44 +08:00
tianjingyun 422e98957b
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-29 20:56:44 -07:00
zhangduo 2466032fdd HBASE-21375 Revisit the lock and queue implementation in MasterProcedureScheduler 2018-10-29 20:18:10 +08:00
Michael Stack 066082dff4
HBASE-21397 Set version to 2.1.1 on branch-2.1 in prep for first RC 2018-10-26 12:56:24 -07:00
Duo Zhang 24f5f7afa8 HBASE-21391 RefreshPeerProcedure should also wait master initialized before executing 2018-10-26 21:45:08 +08:00
Michael Stack 940326d8f5
Revert "HBASE-21376 Add some verbose log to MasterProcedureScheduler"
This reverts commit 71224ee530.
2018-10-26 06:10:47 -07:00
Allan Yang 71224ee530
HBASE-21376 Add some verbose log to MasterProcedureScheduler 2018-10-26 05:54:50 -07:00
Mike Drob 127de9e637
HBASE-21380 Filter finished SCP at start 2018-10-25 20:28:51 -07:00
Michael Stack 7de5f1d60d
Revert "HBASE-21380 Completed SCPs shouldn't add to dead servers in processing"
This reverts commit 1add6e9ca4.
2018-10-25 20:26:43 -07:00
Mike Drob 1add6e9ca4
HBASE-21380 Completed SCPs shouldn't add to dead servers in processing
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-25 19:18:15 -07:00
Guanghao Zhang 7c3033d704 HBASE-21385 HTable.delete request use rpc call directly instead of AsyncProcess
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-25 16:21:58 -07:00
Michael Stack 2e9381a839 HBASE-21372) Set hbase.assignment.maximum.attempts to Long.MAX
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-10-24 09:07:01 -07:00
Allan Yang 6c9e3d0670 HBASE-21364 Procedure holds the lock should put to front of the queue after restart 2018-10-24 10:52:52 +08:00
mazhenlin d35f65f396 HBASE-21342 FileSystem in use may get closed by other bulk load call in secure bulkLoad
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
2018-10-23 16:46:28 -05:00
xcang ae13a5c6ea
HBASE-21349 Do not run CatalogJanitor or Nomalizer when cluster is shutting down
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-23 14:44:22 -07:00
xcang 3979aebebf
HBASE-21338 Warn if balancer is an ill-fit for cluster size
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-23 13:22:41 -07:00