5688944721
HBASE-21517 Move the getTableRegionForRow method from HMaster to TestMaster
2018-11-28 09:41:45 +08:00
3c043440a8
HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method
...
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
2018-11-27 20:58:24 +08:00
beeb38d4dc
Revert "HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method"
...
This reverts commit 6aa57f71f0
2018-11-27 20:58:14 +08:00
6aa57f71f0
HBASE-21507 Compaction failed when execute AbstractMultiFileWriter.beforeShipped() method
...
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
2018-11-27 20:31:42 +08:00
958e84d023
HBASE-21498 Master OOM when SplitTableRegionProcedure new CacheConfig and instantiate a new BlockCache
2018-11-27 14:23:27 +08:00
33c4da5558
HBASE-21508 Ignore the reportRegionStateTransition call from a dead server
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-26 14:32:33 +08:00
7f02645741
HBASE-21511 Remove in progress snapshot check in SnapshotFileCache#getUnreferencedFiles
2018-11-25 18:22:53 -08:00
1731666b43
HBASE-21387 Addendum fix TestSnapshotFileCache
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-11-24 17:00:31 +08:00
cc26c8716f
HBASE-21387 Race condition surrounding in progress snapshot handling in snapshot cache leads to loss of snapshot files
2018-11-23 11:51:58 +08:00
248b8a6f56
HBASE-21503 Replication normal source can get stuck due potential race conditions between source wal reader and wal provider initialization threads.
...
Found and analysed by Wellington Chevreuil
2018-11-21 17:59:06 +08:00
d590d6e472
HBASE-21034 Add new throttle type: read/write capacity unit
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-21 09:50:07 +08:00
6a64811f44
HBASE-21490 WALProcedure may remove proc wal files still with active procedures
...
Signed-off-by: Allan Yang <allan163@apache.org>
2018-11-19 08:21:09 -08:00
7d16cf0977
HBASE-21480 Taking snapshot when RS crashes prevent we bring the regions online
2018-11-18 21:07:27 +08:00
37540b541d
HBASE-21485 Add more debug logs for remote procedure execution
2018-11-16 14:47:24 +08:00
6ab0fbb1f1
HBASE-21255 [acl] Refactor TablePermission into three classes (Global, Namespace, Table)
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-15 11:45:24 +08:00
17055cdc70
HBASE-21472 Should not persist the dispatched field for RegionRemoteProcedureBase
2018-11-15 09:41:43 +08:00
a765859131
HBASE-21473 RowIndexSeekerV1 may return cell with extra two \x00\x00 bytes which has no tags
2018-11-14 23:13:04 +08:00
fbf5e9e0c4
HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors
2018-11-14 18:55:27 +08:00
a44515aea7
Revert "HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors"
...
This reverts commit a27eea0807
2018-11-13 22:24:02 +08:00
f8970bdf04
Revert "HBASE-21465 Addendum change TestReportRegionStateTransitionRetry to MediumTests"
...
This reverts commit 3153aae128
2018-11-13 22:23:25 +08:00
3153aae128
HBASE-21465 Addendum change TestReportRegionStateTransitionRetry to MediumTests
2018-11-13 14:59:48 +08:00
a27eea0807
HBASE-21465 Retry on reportRegionStateTransition can lead to unexpected errors
2018-11-13 11:52:12 +08:00
ea3b2dfaeb
HBASE-21463 The checkOnlineRegionsReport can accidentally complete a TRSP
2018-11-13 11:17:52 +08:00
61f1d9735b
HBASE-21466 WALProcedureStore uses wrong FileSystem if wal.dir is not under rootdir
2018-11-12 17:02:45 -08:00
98ad5ca6e5
Revert "HBASE-21401 Sanity check in BaseDecoder#parseCell"
...
This reverts commit b6d32e8a10
2018-11-12 11:42:04 +08:00
f1d9f59bfe
HBASE-21376 Add some verbose log to MasterProcedureScheduler
2018-11-10 17:17:24 +08:00
6f602db5f2
HBASE-21410 A helper page that help find all problematic regions and procedures
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-11-09 14:02:57 +08:00
f936a1045d
Revert "HBASE-21410 A helper page that help find all problematic regions and procedures"
...
This reverts commit a2f650a0ec
2018-11-09 14:02:38 +08:00
a2f650a0ec
HBASE-21410 A helper page that help find all problematic regions and procedures
2018-11-09 13:56:43 +08:00
13b68abb58
HBASE-21439 RegionLoads aren't being used in RegionLoad cost functions
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/master/balancer/TestStochasticLoadBalancer.java
2018-11-08 14:08:52 -08:00
dcdebbffdc
HBASE-20604 ProtobufLogReader#readNext can incorrectly loop to the same position in the stream until the the WAL is rolled
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-11-08 10:22:11 -08:00
b6d32e8a10
HBASE-21401 Sanity check in BaseDecoder#parseCell
2018-11-08 20:14:03 +08:00
399fbb2aa6
HBASE-21247 Custom Meta WAL Provider doesn't default to custom WAL Provider whose configuration value is outside the enums in Providers
2018-11-06 12:35:31 -08:00
d544b7adea
HBASE-21421 Do not kill RS if reportOnlineRegions fails
2018-11-06 14:56:33 +08:00
a0bba8db46
HBASE-21425 2.1.1 fails to start over 1.x data; namespace not assigned
2018-11-03 09:45:57 -07:00
4f22397ad4
HBASE-21351 The force update thread may have race with PE worker when the procedure is rolling back
2018-11-03 08:24:25 +08:00
1bd98bb608
HBASE-21407 Resolve NPE in backup Master UI
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-11-02 11:46:47 -07:00
943f65f3b5
HBASE-21422 NPE in TestMergeTableRegionsProcedure.testMergeWithoutPONR
2018-11-02 20:55:36 +08:00
3d3dd04651
HBASE-19682 Use Collections.emptyList() For Empty List Values
2018-11-01 08:59:14 -07:00
b9c9f1d61f
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService (addendum for branch-2)
2018-11-01 18:05:01 +08:00
2d0810a006
HBASE-21388 No need to instantiate MemStoreLAB for master which not carry table
2018-11-01 16:20:49 +08:00
857abfb082
HBASE-21322 Add a scheduleServerCrashProcedure() API to HbckService
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-29 20:56:11 -07:00
eb0f9e15d1
HBASE-21375 Revisit the lock and queue implementation in MasterProcedureScheduler
2018-10-29 20:01:53 +08:00
6fbd70a611
HBASE-21325 Force to terminate regionserver when abort hang in somewhere
2018-10-29 10:12:21 +08:00
4ded55702d
HBASE-21391 RefreshPeerProcedure should also wait master initialized before executing
2018-10-26 21:45:03 +08:00
f71768308c
HBASE-21385 HTable.delete request use rpc call directly instead of AsyncProcess
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-25 16:22:18 -07:00
8c1b534ee8
HBASE-21372) Set hbase.assignment.maximum.attempts to Long.MAX
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Allan Yang <allan163@apache.org>
2018-10-24 09:07:24 -07:00
f3da04a552
HBASE-21349 Do not run CatalogJanitor or Nomalizer when cluster is shutting down
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-23 14:44:45 -07:00
390c3227e2
HBASE-21342 FileSystem in use may get closed by other bulk load call in secure bulkLoad
...
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tyu@apache.org>
2018-10-23 15:52:05 -05:00
d4ce9e534e
HBASE-21338 Warn if balancer is an ill-fit for cluster size
...
Signed-off-by: Michael Stack <stack@apache.org>
2018-10-23 13:23:03 -07:00
bf2ce5488d
HBASE-21356 bulkLoadHFile API should ensure that rs has the source hfile's write permissionls
2018-10-23 10:25:06 +08:00
328555a374
HBASE-21336 Addendum remove unused code in HBTU
2018-10-22 20:27:11 +08:00
ff2b332aef
HBASE-21355 (addendum) replace the expensive reload storefiles with reading the merge result of compacted storefiles and current storefiles
2018-10-22 19:33:36 +08:00
0cefe7312c
HBASE-21336 Simplify the implementation of WALProcedureMap
2018-10-22 18:36:16 +08:00
69e65f1bd7
HBASE-21334 TestMergeTableRegionsProcedure is flakey
2018-10-22 14:18:59 +08:00
6dce9cd218
HBASE-21355 HStore's storeSize is calculated repeatedly which causing the confusing region split
2018-10-22 10:21:57 +08:00
46fe6c0e92
HBASE-21200 Memstore flush doesn't finish because of seekToPreviousRow() in memstore scanner.
2018-10-20 08:35:41 +09:00
444f15785c
HBASE-21073 Redo concept of maintenance mode
...
Instead of being an ephemeral state set by hbck, maintenance mode is now
an explicit toggle set by either configuration property or environment
variable. In maintenance mode, master will host system tables and not
assign any user-space tables to RSs. This gives operators the ability to
affect repairs to meta table with fewer moving parts.
2018-10-19 10:04:35 -05:00
4a609db30c
HBASE-21269 Forward-port HBASE-21213 [hbck2] bypass leaves behind state in RegionStates when assign/unassign
2018-10-18 06:22:22 -07:00
20a9b8ad00
HBASE-21055 NullPointerException when balanceOverall() but server balance info is null
...
Signed-off-by: huzheng <openinx@gmail.com>
2018-10-18 14:06:08 +08:00
d7d3beb6bc
HBASE-21330 ReopenTableRegionsProcedure will enter an infinite loop if we schedule a TRSP at the same time
2018-10-18 11:34:43 +08:00
3563f48900
HBASE-21281 Update bouncycastle dependency - addendum adds dependency for hbase-server module
2018-10-17 16:00:28 -07:00
f32d3e1e2c
HBASE-21327 Fix minor logging issue where we don't report servername if no associated SCP
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-10-17 09:38:26 -07:00
c67f7f14e2
HBASE-21320 [canary] Cleanup of usage and add commentary
...
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
2018-10-16 22:19:34 -07:00
1a0e1039a2
HBASE-21311 Split TestRestoreSnapshotFromClient
2018-10-17 11:18:34 +08:00
6511dae07a
HBASE-21263 Mention compression algorithm along with other storefile details
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-10-16 12:47:11 -07:00
26292ab3d6
HBASE-21310 Split TestCloneSnapshotFromClient
2018-10-16 15:33:43 +08:00
c79927bc22
HBASE-21278 Do not rollback successful sub procedures when rolling back a procedure
2018-10-16 15:12:55 +08:00
3097bbc730
HBASE-21266 Not running balancer because processing dead regionservers, but empty dead rs list
2018-10-15 22:28:16 -07:00
5a6b68012d
HBASE-21290 No need to instantiate BlockCache for master which not carry table
2018-10-15 17:25:07 +08:00
287697bfdf
HBASE-21260 The whole balancer plans might be aborted if there are more than one plans to move a same region
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2018-10-15 15:54:25 +08:00
f01ea9b094
HBASE-21309 Increase the waiting timeout for TestProcedurePriority
2018-10-15 15:27:01 +08:00
9d6afa9d72
HBASE-21299 List counts of actual region states in master UI tables section
2018-10-12 11:02:16 -07:00
2ab7e13dfa
HBASE-21289 Remove the log "'hbase.regionserver.maxlogs' was deprecated." in AbstractFSWAL
2018-10-12 20:38:19 +08:00
9da4c1393d
HBASE-21254 Need to find a way to limit the number of proc wal files
2018-10-12 11:05:21 +08:00
33d72e4db4
HBASE-21281 Upgrade bouncycastle to latest
...
BC 1.47 introduced some incompatible API changes which came in via
a new Maven artifact. We don't use any changed API in HBase. This
also removes some unnecessary dependencies on bcprov in other
modules (presumably, they are vestiges)
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Ted Yu <tedyu@apache.org>
2018-10-11 10:53:02 -04:00
81adb704c8
HBASE-21287 Allow configuring test master initialization wait time.
2018-10-11 09:50:37 -05:00
91aceeb28d
HBASE-21251 Refactor RegionMover
2018-10-10 15:14:57 +08:00
701fe7a0c8
HBASE-21280 Add anchors for each heading in UI
...
Signed-off-by: Ted Yu <tedyu@apache.org>
2018-10-09 22:49:54 -07:00
17bd935301
HBASE-21250 Addendum remove unused modification in hbase-server module
2018-10-08 14:56:25 +08:00
e1c89e5f8e
HBASE-21250 Refactor WALProcedureStore and add more comments for better understanding the implementation
2018-10-07 17:12:27 +08:00
9e3f3fdc1f
HBASE-21185 - WALPrettyPrinter: Additional useful info to be printed by wal printer tool, for debugability purposes
...
Signed-off-by: Allan Yang <allan163@apache.org>
2018-10-04 03:31:15 -07:00
8a5537b5f5
HBASE-18549 Add metrics for failed replication queue recovery
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 18:39:03 -07:00
44b01d5908
HBASE-19275 TestSnapshotFileCache never worked properly
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 17:12:18 -07:00
1728a20be2
HBASE-21248 Implement exponential backoff when retrying for ModifyPeerProcedure
2018-09-29 13:35:04 +08:00
3d1a2dbe68
HBASE-21196 HTableMultiplexer clears the meta cache after every put operation
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 16:35:53 -07:00
f9e18cf31b
HBASE-20857 balancer status tag in jmx metrics
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 16:12:04 -07:00
40c1f072b4
HBASE-21207 Add client side sorting functionality in master web UI for table and region server details
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 15:29:49 -07:00
5fe40089f3
HBASE-19418 configurable range of delay in PeriodicMemstoreFlusher
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 14:27:28 -07:00
c9c861dbb9
HBASE-18451 PeriodicMemstoreFlusher should inspect the queue before adding a delayed flush request, fix logging
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-09-28 11:50:19 -07:00
1109ebb617
HBASE-21244 Skip persistence when retrying for assignment related procedures
2018-09-28 21:09:41 +08:00
7b71903baf
HBASE-21228 Memory leak since AbstractFSWAL caches Thread object and never clean later
2018-09-27 16:11:47 +08:00
38d6829a62
HBASE-21232 Show table state in Tables view on Master home page
2018-09-26 10:57:53 -07:00
51854a41fc
HBASE-21227 Implement exponential retrying backoff for Assign/UnassignRegionHandler introduced in HBASE-21217
2018-09-26 20:54:06 +08:00
f3c3c7c422
HBASE-21212 Wrong flush time when update flush metric
2018-09-26 19:17:35 +08:00
21fafbaf53
HBASE-20734 Colocate recovered edits directory with hbase.wal.dir
...
Amending-Author: Reid Chan <reidchan@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2018-09-26 11:49:21 +08:00
0f514ab75a
HBASE-21164 reportForDuty should do backoff rather than retry
...
Remove unused methods from Sleeper (its ok, its @Private).
Remove notion of startTime from Sleeper handling (it is is unused).
Allow passing in how long to sleep so can maintain externally.
In HRS, use a RetryCounter to calculate backoff sleep time for when
reportForDuty is failing against a struggling Master.
2018-09-25 11:32:15 -07:00
fa2888ebf0
HBASE-21217 Revisit the executeProcedure method for open/close region
2018-09-25 18:10:47 +08:00
20974513d9
Amend HBASE-20704 Sometimes some compacted storefiles are not archived on region close
...
Forward port small logging improvements from branch-1 version of this change.
2018-09-21 16:12:44 -07:00
fd68e7593e
HBASE-20636 Introduce two bloom filter type : ROWPREFIX and ROWPREFIX_DELIMITED
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Amending-Author: Andrew Purtell <apurtell@apache.org>
2018-09-21 16:06:34 -07:00
Duo Zhang
lixiaobao
lixiaobao
Guanghao Zhang
Ted Yu
huzheng
meiyi
Reid Chan
jingyuntian
Ben Lau
Esteban Gutierrez
Allan Yang
Michael Stack
Beluga Behr
xcang
mazhenlin
Toshihiro Suzuki
Mike Drob
haxiaolin
subrat.mishra
Andrew Purtell
Josh Elser
Wellington Chevreuil
Nihal Jain
Kiran Kumar Maturi
Archana Katiyar
ramie-raufdeen
Zach York
Mingliang Liu
Guangxu Cheng