Xu Cang
3df8b6f7bb
HBASE-18549 Add metrics for failed replication queue recovery
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 18:39:07 -07:00
Guanghao Zhang
0b0257b412
HBASE-20678 NPE in ReplicationSourceManager#NodeFailoverWorker
2018-06-05 14:59:22 +08:00
maoling
4c95b82b61
HBASE-19761:Fix Checkstyle errors in hbase-zookeeper
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2018-06-02 10:17:27 +02:00
huzheng
be3df29cef
HBASE-20128 Add new UTs which extends the old replication UTs but set replication scope to SERIAL
2018-05-14 19:32:39 +08:00
huzheng
72093178fb
HBASE-20475 Fix the flaky TestReplicationDroppedTables unit test.
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-04-28 18:46:41 +08:00
Sean Busbey
24eb141bac
HBASE-20442 clean up incorrect use of commons-collections 3
...
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>
Conflicts:
hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/master/BackupLogCleaner.java
2018-04-20 08:17:22 -05:00
zhangduo
74ab10c353
HBASE-20296 Remove last pushed sequence ids when removing tables from a peer
2018-04-09 15:18:44 +08:00
zhangduo
ead569c951
HBASE-20285 Delete all last pushed sequence ids when removing a peer or removing the serial flag for a peer
2018-04-09 15:18:44 +08:00
huzheng
83488b866f
HBASE-20138 Find a way to deal with the conflicts when updating replication position
2018-04-09 15:18:44 +08:00
tianjingyun
3b015d60a4
HBASE-20227 Add UT for ReplicationUtils.contains method
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-04-09 15:18:44 +08:00
zhangduo
9369cf26eb
HBASE-20147 Serial replication will be stuck if we create a table with serial replication but add it to a peer after there are region moves
2018-04-09 15:18:44 +08:00
zhangduo
40ad5aeafe
HBASE-20116 addendum fix javadoc and also a simple optimization
2018-04-09 15:18:44 +08:00
huzheng
2b9fed863f
HBASE-20116 Optimize the region last pushed sequence id layout on zk
2018-04-09 15:18:44 +08:00
zhangduo
16a4dd6b8f
HBASE-20206 WALEntryStream should not switch WAL file silently
2018-04-09 15:18:44 +08:00
zhangduo
644bfe36b2
HBASE-20117 Cleanup the unused replication barriers in meta table
2018-04-09 15:18:44 +08:00
zhangduo
cea5199ea1
HBASE-20148 Make serial replication as a option for a peer instead of a table
2018-04-09 15:18:44 +08:00
huzheng
1d11cdb26c
HBASE-20050 Reimplement updateReplicationPositions logic in serial replication based on the newly introduced replication storage layer
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-04-09 15:18:44 +08:00
BELUGA BEHR
039bc73571
HBASE-19488 Move to using Apache commons CollectionUtils
...
Signed-off-by: Apekshit Sharma <appy@apache.org>
2018-04-04 14:16:33 -07:00
Michael Stack
3f1c86786c
HBASE-20213 [LOGGING] Aligning formatting and logging less (compactions,
...
in-memory compactions)
Log less. Log using same format as used elsewhere in log.
Align logs in HFileArchiver with how we format elsewhere. Removed
redundant 'region' qualifiers, tried to tighten up the emissions so
easier to read the long lines.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ChunkCreator.java
Add a label for each of the chunkcreators we make (I was confused by
two chunk creater stats emissions in log file -- didn't know that one
was for data and the other index).
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CompactSplit.java
Formatting. Log less.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreCompactionStrategy.java
Make the emissions in here trace-level. When more than a few regions,
log is filled with this stuff.
2018-03-16 13:07:34 -07:00
Guanghao Zhang
55d0d3026a
HBASE-19923 Reset peer state and config when refresh replication source failed
2018-03-09 20:55:48 +08:00
zhangduo
abaa80f26e
HBASE-19873 addendum add missing rule for new tests
2018-03-09 20:55:48 +08:00
zhangduo
1c32241a00
HBASE-19719 Fix checkstyle issues
2018-03-09 20:55:48 +08:00
Guanghao Zhang
d36aacdf9e
HBASE-19636 All rs should already start work with the new peer change when replication peer procedure is finished
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-03-09 20:55:48 +08:00
huzheng
5655b3c0ca
HBASE-19661 Replace ReplicationStateZKBase with ZKReplicationStorageBase
2018-03-09 20:55:48 +08:00
zhangduo
b84fbde175
HBASE-19687 Move the logic in ReplicationZKNodeCleaner to ReplicationChecker and remove ReplicationZKNodeCleanerChore
2018-03-09 20:55:48 +08:00
zhangduo
5d922a5e0c
HBASE-19623 Create replication endpoint asynchronously when adding a replication source
2018-03-09 20:55:48 +08:00
zhangduo
525fef572e
HBASE-19633 Clean up the replication queues in the postPeerModification stage when removing a peer
2018-03-09 20:55:48 +08:00
huzheng
1e36a84afc
HBASE-19622 Reimplement ReplicationPeers with the new replication storage interface
2018-03-09 20:55:48 +08:00
zhangduo
d9b5eb3abb
HBASE-19617 Remove ReplicationQueues, use ReplicationQueueStorage directly
2018-03-09 20:55:48 +08:00
Guanghao Zhang
eae251d203
HBASE-19573 Rewrite ReplicationPeer with the new replication storage interface
2018-03-09 20:55:48 +08:00
zhangduo
15055a421b
HBASE-19599 Remove ReplicationQueuesClient, use ReplicationQueueStorage directly
2018-03-09 20:55:48 +08:00
zhangduo
1de08ded58
HBASE-19543 Abstract a replication storage interface to extract the zk specific code
2018-03-09 20:55:48 +08:00
huzheng
3fd417600e
HBASE-19525 RS side changes for moving peer modification from zk watcher to procedure
2018-03-09 20:55:48 +08:00
zhangduo
5e410d8140
HBASE-19524 Master side changes for moving peer modification from zk watcher to procedure
2018-03-09 20:55:48 +08:00
Ben Lau
0743bda059
HBASE-18282 ReplicationLogCleaner can delete WALs not yet replicated in case of a KeeperException
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-02-14 17:23:09 -08:00
zhangduo
66a11f2ac0
HBASE-19904 Break dependency of WAL constructor on Replication
2018-02-03 17:11:30 +08:00
Michael Stack
bac4687345
HBASE-19919 Tidying up logging
2018-02-02 22:42:30 -08:00
Guanghao Zhang
72702eeb70
HBASE-19783 Change replication peer cluster key/endpoint from a not-null value to null is not allowed
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-01-12 21:41:57 +08:00
Mike Drob
64cb777a8a
HBASE-19552 find-and-replace thirdparty offset
2017-12-28 12:01:25 -06:00
Guanghao Zhang
920005a2dc
HBASE-19621 (addendum) Revisit the methods in ReplicationPeerConfigBuilder
2017-12-26 21:56:40 +08:00
Guanghao Zhang
2abf7b508c
HBASE-19621 Revisit the methods in ReplicationPeerConfigBuilder
2017-12-26 14:44:07 +08:00
Guanghao Zhang
65159dc256
HBASE-19618 Remove replicationQueuesClient.class/replicationQueues.class config and remove table based ReplicationQueuesClient/ReplicationQueues implementation
2017-12-26 14:44:02 +08:00
Guanghao Zhang
b552eb2ff9
HBASE-19576 Introduce builder for ReplicationPeerConfig and make it immutable
2017-12-23 19:04:58 +08:00
Balazs Meszaros
992b5d8630
HBASE-10092 Move up on to log4j2
...
Changes:
- replaced commons-logging to slf4j everywhere
- log.XXX(Throwable) calls were replaced with log.XXX(t.toString(), t)
- log.XXX(Object) calls were replaced with log.XXX(Objects.toString(obj))
- log.fatal() calls were replaced with log.error(HBaseMarkers.FATAL, ...)
- programmatic log4j configuration was removed from the unit test
This commit does not affect the current logging configurations, because log4j
is still on the classpath. slf4j-log4j12 binds log4j to slf4j.
Signed-off-by: Michael Stack <stack@apache.org>
2017-12-20 22:58:12 -08:00
Guanghao Zhang
60cd494d1c
HBASE-19492 Add EXCLUDE_NAMESPACE and EXCLUDE_TABLECFS support to replication peer config
2017-12-19 16:57:38 +08:00
Peter Somogyi
2043c337d8
HBASE-19498 Fix findbugs and error-prone warnings in hbase-client (branch-2)
...
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-12-15 15:57:01 -08:00
Peter Somogyi
941acc5c05
HBASE-19213 Align check and mutate operations in Table and AsyncTable
...
- Deprecates old checkAnd*() operations in Table
- Adds Table#CheckAndMutateBuilder and implements it in HTable
Commiter note: When committing the patch, noticed redundant {@inheritDoc} being added in HTable.
Removed new and olds ones.
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-12-12 20:46:39 -08:00
Guanghao Zhang
ca6e7e68f4
HBASE-16868 Add a replicate_all flag to avoid misuse the namespaces and table-cfs config of replication peer
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2017-11-23 15:08:03 +08:00
Guanghao Zhang
c978f8ab23
HBASE-19293 Support add a disabled state replication peer directly
2017-11-21 15:37:33 +08:00
Apekshit Sharma
e0c4f374b5
HBASE-19114 Split out o.a.h.h.zookeeper from hbase-server and hbase-client
...
- Moved DrainingServerTracker and RegionServerTracker to hbase-server:o.a.h.h.master.
- Moved SplitOrMergeTracker to oahh.master (because it depends on a PB)
- Moving hbase-client:oahh.zookeeper.* to hbase-zookeeper module. After HBASE-19200, hbase-client doesn't need them anymore (except 3 classes).
- Renamed some classes to use a consistent naming for classes - ZK instead of mix of ZK, Zk , ZooKeeper. Couldn't rename following public classes: MiniZooKeeperCluster, ZooKeeperConnectionException. Left RecoverableZooKeeper for lack of better name. (suggestions?)
- Sadly, can't move tests out because they depend on HBaseTestingUtility (which defeats part of the purpose - trimming down hbase-server tests. We need to promote more use of mocks in our tests)
2017-11-17 13:23:28 -08:00