Duo Zhang
fe2992a312
HBASE-27806 Support dynamic reinitializing replication peer storage ( #5195 )
...
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 18ae733b15
)
2023-04-23 23:15:27 +08:00
Duo Zhang
04a4ac5ae9
HBASE-27728 Implement a tool to migrate replication peer data between different storage implementation ( #5179 )
...
Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 31c4aea48c
)
Conflicts:
hbase-client/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationPeerConfig.java
hbase-replication/src/test/java/org/apache/hadoop/hbase/replication/ReplicationPeerStorageTestBase.java
2023-04-17 22:47:52 +08:00
Duo Zhang
3e6e9c5cca
HBASE-27727 Implement filesystem based Replication peer storage ( #5165 )
...
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit a71105997f
)
2023-04-13 19:45:20 +08:00
Duo Zhang
738ed028ad
HBASE-27434 Use ${revision} as placeholder for maven version to make it easier to control the version from command line ( #4836 )
...
Signed-off-by: GeorryHuang <huangzhuoyue@apache.org>
(cherry picked from commit 2fc879e863
)
2022-10-24 12:05:01 +08:00
Duo Zhang
5cab4be075
HBASE-27401 Clean up current broken 'n's in our javadoc ( #4812 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit 63cdd026f0
)
Conflicts:
hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/impl/BackupManager.java
hbase-client/src/main/java/org/apache/hadoop/hbase/HRegionLocation.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/Append.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/Mutation.java
hbase-client/src/main/java/org/apache/hadoop/hbase/client/Scan.java
hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueExcludeFilter.java
hbase-client/src/main/java/org/apache/hadoop/hbase/filter/SingleColumnValueFilter.java
hbase-client/src/main/java/org/apache/hadoop/hbase/security/visibility/VisibilityClient.java
hbase-client/src/main/java/org/apache/hadoop/hbase/shaded/protobuf/RequestConverter.java
hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestReplication.java
hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteTable.java
hbase-rsgroup/src/main/java/org/apache/hadoop/hbase/rsgroup/RSGroupInfoManager.java
hbase-server/src/main/java/org/apache/hadoop/hbase/HBaseServerBase.java
hbase-server/src/main/java/org/apache/hadoop/hbase/coprocessor/MasterObserver.java
hbase-server/src/main/java/org/apache/hadoop/hbase/mob/MobUtils.java
hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/flush/RegionServerFlushTableProcedureManager.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/Region.java
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/HBaseReplicationEndpoint.java
hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/MetricsSource.java
hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtil.java
hbase-server/src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
hbase-server/src/test/java/org/apache/hadoop/hbase/tool/TestBulkLoadHFilesSplitRecovery.java
hbase-thrift/src/main/java/org/apache/hadoop/hbase/thrift/ThriftUtilities.java
2022-10-06 22:13:14 +08:00
Duo Zhang
1a5b1b266c
HBASE-26899 Run spotless:apply
2022-05-01 22:41:49 +08:00
Duo Zhang
340cc6c6f1
HBASE-26802 Backport the log4j2 changes to branch-2 ( #4166 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-11 11:17:43 -08:00
Andrew Purtell
300f9b9576
HBASE-26582 Prune use of Random and SecureRandom objects ( #4118 )
...
Avoid the pattern where a Random object is allocated, used once or twice, and
then left for GC. This pattern triggers warnings from some static analysis tools
because this pattern leads to poor effective randomness. In a few cases we were
legitimately suffering from this issue; in others a change is still good to
reduce noise in analysis results.
Use ThreadLocalRandom where there is no requirement to set the seed to gain
good reuse.
Where useful relax use of SecureRandom to simply Random or ThreadLocalRandom,
which are unlikely to block if the system entropy pool is low, if we don't need
crypographically strong randomness for the use case. The exception to this is
normalization of use of Bytes#random to fill byte arrays with randomness.
Because Bytes#random may be used to generate key material it must be backed by
SecureRandom.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-08 15:22:00 -08:00
Duo Zhang
4644efb9f3
HBASE-26691 Replacing log4j with reload4j for branch-2.x ( #4050 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-04 12:06:34 -08:00
Andrew Purtell
b1bc5f3a5c
Renumber to 2.6.0-SNAPSHOT after branching branch-2.5
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-08 16:54:32 -08:00
zhengzhuobinzzb
9275159289
HBASE-26482 HMaster may clean wals that is replicating in rare cases ( #3876 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-24 23:38:36 +08:00
Duo Zhang
748e369629
HBASE-26029 It is not reliable to use nodeDeleted event to track region server's death ( #3430 )
...
Signed-off-by: Xin Sun <ddupgs@gmail.com>
2021-06-30 11:46:09 +08:00
Duo Zhang
26c4e86ebd
HBASE-25976 Implement a master based ReplicationTracker ( #3390 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2021-06-17 18:38:43 +08:00
XinSun
471f52350a
HBASE-25553 It is better for ReplicationTracker.getListOfRegionServers to return ServerName instead of String ( #2928 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-02-07 18:54:44 +08:00
Viraj Jasani
0788547fea
HBASE-25474 : Bump HBase version on branch-2 ( #2871 )
...
Signed-off-by: stack <stack@apache.org>
2021-01-12 10:20:22 +05:30
Duo Zhang
9325a775fe
HBASE-25452 Use MatcherAssert.assertThat instead of org.junit.Assert.assertThat ( #2826 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-12-30 10:03:39 +08:00
Sandeep Pal
aa5a477426
HBASE-25383: Ability to update and remove peer base config
...
Closes #2778
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-12-18 14:20:36 +05:30
Andrew Purtell
1b6399a480
HBASE-24640 [branch-2] Purge use of VisibleForTesting ( #2696 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-11-25 14:15:32 -08:00
stack
97979436f8
HBASE-25067 Edit of log messages around async WAL Replication; checkstyle fixes; and a bugfix
...
Editing logging around region replicas: shortening and adding context.
Checkstyle fixes in edited files while I was in there.
Bug fix in AssignRegionHandler -- was using M_RS_CLOSE_META to open
a Region instead of a M_RS_OPEN_META.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-09-22 10:13:03 -07:00
ankitjain64
7df1b92528
HBASE-24764: Add support of adding default peer configs via hbase-site.xml for all replication peers. ( #2284 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-09-10 10:10:58 -07:00
Duo Zhang
dc2146069c
HBASE-24309 Avoid introducing log4j and slf4j-log4j dependencies for … ( #1697 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-13 17:59:21 +08:00
Nick Dimiduk
ffb2359146
HBASE-24013 Bump branch-2 version to 2.4.0-SNAPSHOT ( #1309 )
...
Increment version in poms with
```
$ mvn org.codehaus.mojo:versions-maven-plugin:2.7:set -DnewVersion=2.4.0-SNAPSHOT -DgenerateBackupPoms=false
```
Verified no dangling references with
```
$ find . -iname '*pom.xml' -exec grep -n '2.3.0-SNAPSHOT' {} +
```
Verified build with
```
$ JAVA_HOME=/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home mvn clean package -DskipTests
$ JAVA_HOME=/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home mvn clean package -DskipTests -Dhadoop.profile=3.0
```
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-03-19 08:01:43 -07:00
Michael Stack
ebd37a314c
HBASE-23993 Use loopback for zk standalone server in minizkcluster ( #1291 )
...
hbase-zookeeper/src/main/java/org/apache/hadoop/hbase/zookeeper/MiniZooKeeperCluster.java
Have client and server use loopback instead of 'localhost'
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
2020-03-17 20:14:24 -07:00
Peter Somogyi
3f646d8a81
HBASE-23642 Reintroduce ReplicationUtils.contains as deprecated ( #983 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
2020-01-04 12:14:19 +01:00
ddupg
997684f24d
HBASE-23345 Table need to replication unless all of cfs are excluded
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-12-04 09:19:38 +08:00
chenxu14
46c090ce45
HBASE-23293 [REPLICATION] make ship edits timeout configurable ( #882 )
...
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
2019-11-28 11:01:18 +08:00
Viraj Jasani
e153f58937
HBASE-22633 remove redundant substring call with append for ZKReplicationQueueStorage
...
Signed-off-by: Sakthi <sakthivel.azhaku@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-06-28 15:03:13 +02:00
Jan Hentschel
6cff25cc23
HBASE-22344 Documented the deprecation of public and limited private APIs ( #208 )
...
Signed-off-by: stack <stack@apache.org>
2019-06-17 22:29:51 +02:00
Jan Hentschel
c0eed64cbf
HBASE-22357 Fixed remaining Checkstyle issues in hbase-replication
2019-06-10 00:26:25 +02:00
Andrew Purtell
2c55bd9344
HBASE-22449 https everywhere in Maven metadata ( #247 )
2019-05-21 12:38:42 -07:00
Sean Busbey
4862a596ef
HBASE-22083 move eclipse settings into a profile.
...
Signed-off-by: stack <stack@apache.org>
Conflicts:
hbase-backup/pom.xml
hbase-hadoop-compat/pom.xml
hbase-protocol/pom.xml
2019-04-25 14:38:38 -05:00
Guanghao Zhang
16665b6e93
HBASE-21799 Update branch-2 version to 2.3.0-SNAPSHOT
2019-01-29 21:53:21 +08:00
Xu Cang
8a5537b5f5
HBASE-18549 Add metrics for failed replication queue recovery
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-10-01 18:39:03 -07:00
zhangduo
dde042cc93
HBASE-20776 Update branch-2 version to 2.2.0-SNAPSHOT
2018-06-22 22:15:18 +08:00
Sean Busbey
ee84a8f243
HBASE-20332 shaded mapreduce module shouldn't include hadoop
...
* modify the jar checking script to take args; make hadoop stuff optional
* separate out checking the artifacts that have hadoop vs those that don't.
* * Unfortunately means we need two modules for checking things
* * put in a safety check that the support script for checking jar contents is maintained in both modules
* * have to carve out an exception for o.a.hadoop.metrics2. :(
* fix duplicated class warning
* clean up dependencies in hbase-server and some modules that depend on it.
* allow Hadoop to have its own htrace where it needs it
* add a precommit check to make sure we're not using old htrace imports
Conflicts:
hbase-backup/pom.xml
hbase-checkstyle/src/main/resources/hbase/checkstyle-suppressions.xml
Signed-off-by: Mike Drob <mdrob@apache.org>
2018-06-18 14:02:48 -07:00
Guanghao Zhang
0b0257b412
HBASE-20678 NPE in ReplicationSourceManager#NodeFailoverWorker
2018-06-05 14:59:22 +08:00
maoling
4c95b82b61
HBASE-19761:Fix Checkstyle errors in hbase-zookeeper
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2018-06-02 10:17:27 +02:00
huzheng
be3df29cef
HBASE-20128 Add new UTs which extends the old replication UTs but set replication scope to SERIAL
2018-05-14 19:32:39 +08:00
huzheng
72093178fb
HBASE-20475 Fix the flaky TestReplicationDroppedTables unit test.
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-04-28 18:46:41 +08:00
Sean Busbey
24eb141bac
HBASE-20442 clean up incorrect use of commons-collections 3
...
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>
Conflicts:
hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/master/BackupLogCleaner.java
2018-04-20 08:17:22 -05:00
zhangduo
74ab10c353
HBASE-20296 Remove last pushed sequence ids when removing tables from a peer
2018-04-09 15:18:44 +08:00
zhangduo
ead569c951
HBASE-20285 Delete all last pushed sequence ids when removing a peer or removing the serial flag for a peer
2018-04-09 15:18:44 +08:00
huzheng
83488b866f
HBASE-20138 Find a way to deal with the conflicts when updating replication position
2018-04-09 15:18:44 +08:00
tianjingyun
3b015d60a4
HBASE-20227 Add UT for ReplicationUtils.contains method
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-04-09 15:18:44 +08:00
zhangduo
9369cf26eb
HBASE-20147 Serial replication will be stuck if we create a table with serial replication but add it to a peer after there are region moves
2018-04-09 15:18:44 +08:00
zhangduo
40ad5aeafe
HBASE-20116 addendum fix javadoc and also a simple optimization
2018-04-09 15:18:44 +08:00
huzheng
2b9fed863f
HBASE-20116 Optimize the region last pushed sequence id layout on zk
2018-04-09 15:18:44 +08:00
zhangduo
16a4dd6b8f
HBASE-20206 WALEntryStream should not switch WAL file silently
2018-04-09 15:18:44 +08:00
zhangduo
644bfe36b2
HBASE-20117 Cleanup the unused replication barriers in meta table
2018-04-09 15:18:44 +08:00
zhangduo
cea5199ea1
HBASE-20148 Make serial replication as a option for a peer instead of a table
2018-04-09 15:18:44 +08:00