c7d1085fa2
HBASE-19999 Remove the SYNC_REPLICATION_ENABLED flag
2018-06-28 18:07:44 +08:00
183b8d0581
HBASE-19973 Implement a procedure to replay sync replication wal for standby cluster
2018-06-28 18:07:44 +08:00
45794d4156
HBASE-19943 Only allow removing sync replication peer which is in DA state
2018-06-28 18:07:44 +08:00
0c97cda2a9
HBASE-19990 Create remote wal directory when transitting to state S
2018-06-28 18:07:44 +08:00
a41c549ca4
HBASE-19082 Reject read/write from client but accept write from replication in state S
2018-06-28 18:07:44 +08:00
39dd81a7c6
HBASE-19957 General framework to transit sync replication state
2018-06-28 18:07:44 +08:00
00e54aae24
HBASE-19935 Only allow table replication for sync replication for now
2018-06-28 18:07:44 +08:00
1481bd9481
HBASE-19864 Use protobuf instead of enum.ordinal to store SyncReplicationState
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-06-28 18:07:44 +08:00
d8842dc3d4
HBASE-19857 Complete the procedure for adding a sync replication peer
2018-06-28 18:07:44 +08:00
2acebac00e
HBASE-19781 Add a new cluster state flag for synchronous replication
2018-06-28 18:07:44 +08:00
274b813e12
HBASE-19747 Introduce a special WALProvider for synchronous replication
2018-06-28 18:07:44 +08:00
b4a1dbf768
HBASE-19078 Add a remote peer cluster wal directory config for synchronous replication
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-06-28 18:07:44 +08:00
b3dea0378e
HBASE-19083 Introduce a new log writer which can write to two HDFSes
2018-06-28 18:07:44 +08:00
c23e61f20d
HBASE-20781 Save recalculating families in a WALEdit batch of Cells
...
Pass the Set of families through to the WAL rather than recalculate
a Set already known.
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-06-27 22:04:57 -07:00
74e5c776b3
HBASE-20732 Shutdown scan pool when master is stopped
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-06-28 11:42:18 +08:00
a8b16ac907
HBASE-20798 Duplicate thread names of StoreFileOpenerThread and StoreFileCloserThread (Zephyr Guo)
2018-06-27 17:21:07 -07:00
952bb96c8a
HBASE-19164: Remove UUID.randomUUID in tests.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-27 10:34:16 -05:00
6a0c67344a
HBASE-20194 Basic Replication WebUI - Master
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-06-26 18:26:54 +08:00
4ba6242a62
HBASE-20780 ServerRpcConnection logging cleanup Get rid of one of the logging lines in ServerRpcConnection by amalgamating all into one new-style log line.
2018-06-25 16:43:11 -07:00
0db2b628d6
HBASE-20770 WAL cleaner logs way too much; gets clogged when lots of work to do
...
General log cleanup; setting stuff that can flood the log to TRACE.
2018-06-25 12:13:04 -07:00
025ddce868
HBASE-20403. Fix race between prefetch task and non-pread HFile reads
...
With prefetch-on-open enabled, the task doing the prefetching was using
non-positional (i.e. streaming) reads. If the main (non-prefetch) thread
was also using non-positional reads, these two would conflict, because
inputstreams are not thread-safe for non-positional reads.
In the case of an encrypted filesystem, this could cause JVM crashes,
etc, as underlying cipher buffers were freed underneath the racing
threads. In the case of a non-encrypted filesystem, less severe errors
would be thrown. The included unit test reproduces the latter case.
2018-06-25 11:54:52 -07:00
9640ebacd4
HBASE-20777 RpcConnection could still remain opened after we shutdown the NettyRpcServer
2018-06-25 14:15:15 +08:00
daad14428d
HBASE-20778 Make it so WALPE runs on DFS
2018-06-23 23:33:53 -07:00
55147c7eae
HBASE-20775 Addendum disable REGIONS_ON_MASTER for TEstMultiParallel
2018-06-23 17:38:50 +08:00
14087cc919
HBASE-20775 TestMultiParallel is flakey
2018-06-22 21:32:07 +08:00
177458d9d0
HBASE-18569 Add prefetch support for async region locator
2018-06-22 18:25:31 +08:00
98245ca6e4
HBASE-20740 StochasticLoadBalancer should consider CoprocessorService request factor when computing cost (chenxu)
2018-06-22 00:26:14 -07:00
7b716c964b
HBASE-20752 Make sure the regions are truly reopened after ReopenTableRegionsProcedure
2018-06-22 14:04:33 +08:00
0d784efc37
HBASE-20767 Always close hbaseAdmin along with connection in HBTU
2018-06-21 21:01:19 +08:00
72784c2d83
HBASE-20642 Clients should re-use the same nonce across DDL operations
...
Also changes modify table operations to help the case where a MTP spans
two master, avoiding the sanity-checks propagating back to the client
unnecessarily.
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2018-06-20 14:56:10 -07:00
e989a9927e
HBASE-20706 Prevent MTP from trying to reopen non-OPEN regions
...
ModifyTableProcedure is using MoveRegionProcedure in a way
that was unintended from the original implementation. As such,
we have to guard against certain usages of it. We know we can
re-open OPEN regions, but regions in OPENING will similarly
soon be OPEN (thus, we want to reopen those regions too).
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-06-20 14:19:28 -07:00
4cb70ea9f5
HBASE-20739 Add priority for SCP
2018-06-20 15:17:07 +08:00
c08eff67af
HBASE-20742 Always create WAL directory for region server
2018-06-20 14:21:23 +08:00
21684a32fa
HBASE-20745 Log when master proc wal rolls
2018-06-19 19:53:51 -07:00
6dbbd78aa0
HBASE-20708 Remove the usage of RecoverMetaProcedure in master startup
2018-06-19 15:02:10 +08:00
b336da925a
HBASE-20727 Persist FlushedSequenceId to speed up WAL split after cluster restart
2018-06-19 09:45:47 +08:00
f1b536bad4
HBASE-20332 shaded mapreduce module shouldn't include hadoop
...
* modify the jar checking script to take args; make hadoop stuff optional
* separate out checking the artifacts that have hadoop vs those that don't.
* * Unfortunately means we need two modules for checking things
* * put in a safety check that the support script for checking jar contents is maintained in both modules
* * have to carve out an exception for o.a.hadoop.metrics2. :(
* fix duplicated class warning
* clean up dependencies in hbase-server and some modules that depend on it.
* allow Hadoop to have its own htrace where it needs it
* add a precommit check to make sure we're not using old htrace imports
2018-06-18 11:31:04 -07:00
ac5bb8155b
HBASE-20723 Custom hbase.wal.dir results in data loss because we write recovered edits into a different place than where the recovering region server looks for them
2018-06-15 19:40:48 -07:00
0e43abc78a
HBASE-20737 put collection into ArrayList instead of addAll function
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-06-16 03:25:42 +08:00
86653c708f
HBASE-20695 Implement table level RegionServer replication metrics
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-06-15 10:38:49 +08:00
0b28155d27
HBASE-20625 refactor some WALCellCodec related code
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2018-06-14 19:37:01 +08:00
423a0ab71a
HBASE-20722 Make RegionServerTracker only depend on children changed event
2018-06-14 08:36:37 +08:00
ec66434380
HBASE-20561 The way we stop a ReplicationSource may cause the RS down
2018-06-13 17:58:59 +08:00
edf60b965b
HBASE-20672 Adding new Metrics readRequestRate and writeRequestRate - revert pending discussion
2018-06-11 18:47:30 -07:00
c323e7bfaa
HBASE-20656 Validate pre-2.0 coprocessors against HBase 2.0+
...
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-11 10:26:58 -05:00
eb13cdd7ed
HBASE-20707 Move MissingSwitchDefault case check
...
Perform this check using error-prone instead of checkstyle because the
former can handle enum switches somewhat more intelligently.
2018-06-11 09:57:50 -05:00
573b57d437
HBASE-20700 Move meta region when server crash can cause the procedure to be stuck
2018-06-11 14:57:31 +08:00
cc7aefe0bb
HBASE-20698 (addendum) Master don't record right server version until new started region server call regionServerReport method
2018-06-10 08:23:28 +08:00
5fd16f3853
HBASE-20698 Master don't record right server version until new started region server call regionServerReport method
2018-06-09 14:40:43 +08:00
519236b4af
HBASE-20672 Adding new Metrics readRequestRate and writeRequestRate
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-06-08 13:48:33 -07:00
Guanghao Zhang
huzheng
zhangduo
Michael Stack
Reid Chan
tedyu
Sahil Aggarwal
jingyuntian
Todd Lipcon
Ankit Singhal
Josh Elser
Allan Yang
Sean Busbey
taiynlee
Xu Cang
Balazs Meszaros
Mike Drob
Ankit