Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,126 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

100 Commits

Author SHA1 Message Date
Duo Zhang 5844b53dea HBASE-26802 Backport the log4j2 changes to branch-2 (#4166) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-hadoop-compat/pom.xml
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
	hbase-shaded/hbase-shaded-client-byo-hadoop/pom.xml
	hbase-shaded/hbase-shaded-client/pom.xml
	hbase-shaded/hbase-shaded-mapreduce/pom.xml
	hbase-shaded/hbase-shaded-testing-util/pom.xml
	hbase-shaded/pom.xml
	hbase-testing-util/pom.xml
 2022-03-11 11:38:37 -08:00
Andrew Purtell 5386325acd HBASE-26582 Prune use of Random and SecureRandom objects (#4118) 
Avoid the pattern where a Random object is allocated, used once or twice, and
then left for GC. This pattern triggers warnings from some static analysis tools
because this pattern leads to poor effective randomness. In a few cases we were
legitimately suffering from this issue; in others a change is still good to
reduce noise in analysis results.

Use ThreadLocalRandom where there is no requirement to set the seed to gain
good reuse.

Where useful relax use of SecureRandom to simply Random or ThreadLocalRandom,
which are unlikely to block if the system entropy pool is low, if we don't need
crypographically strong randomness for the use case. The exception to this is
normalization of use of Bytes#random to fill byte arrays with randomness.
Because Bytes#random may be used to generate key material it must be backed by
SecureRandom.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2022-03-11 15:06:48 +08:00
Duo Zhang 71ddf74dda HBASE-26691 Replacing log4j with reload4j for branch-2.x (#4050) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2022-03-04 12:08:36 -08:00
zhengzhuobinzzb 9275159289 HBASE-26482 HMaster may clean wals that is replicating in rare cases (#3876) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-11-24 23:38:36 +08:00
Duo Zhang 748e369629 HBASE-26029 It is not reliable to use nodeDeleted event to track region server's death (#3430) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
 2021-06-30 11:46:09 +08:00
Duo Zhang 26c4e86ebd HBASE-25976 Implement a master based ReplicationTracker (#3390) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2021-06-17 18:38:43 +08:00
XinSun 471f52350a HBASE-25553 It is better for ReplicationTracker.getListOfRegionServers to return ServerName instead of String (#2928) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-02-07 18:54:44 +08:00
Viraj Jasani 0788547fea
HBASE-25474 : Bump HBase version on branch-2 (#2871) 
Signed-off-by: stack <stack@apache.org>
 2021-01-12 10:20:22 +05:30
Duo Zhang 9325a775fe HBASE-25452 Use MatcherAssert.assertThat instead of org.junit.Assert.assertThat (#2826) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-12-30 10:03:39 +08:00
Sandeep Pal aa5a477426
HBASE-25383: Ability to update and remove peer base config 
Closes #2778

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-12-18 14:20:36 +05:30
Andrew Purtell 1b6399a480
HBASE-24640 [branch-2] Purge use of VisibleForTesting (#2696) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2020-11-25 14:15:32 -08:00
stack 97979436f8 HBASE-25067 Edit of log messages around async WAL Replication; checkstyle fixes; and a bugfix 
Editing logging around region replicas: shortening and adding context.
Checkstyle fixes in edited files while I was in there.
Bug fix in AssignRegionHandler -- was using M_RS_CLOSE_META to open
a Region instead of a M_RS_OPEN_META.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-09-22 10:13:03 -07:00
ankitjain64 7df1b92528
HBASE-24764: Add support of adding default peer configs via hbase-site.xml for all replication peers. (#2284) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-09-10 10:10:58 -07:00
Duo Zhang dc2146069c
HBASE-24309 Avoid introducing log4j and slf4j-log4j dependencies for … (#1697) 
Signed-off-by: stack <stack@apache.org>
 2020-05-13 17:59:21 +08:00
Nick Dimiduk ffb2359146
HBASE-24013 Bump branch-2 version to 2.4.0-SNAPSHOT (#1309) 
Increment version in poms with

```
$ mvn org.codehaus.mojo:versions-maven-plugin:2.7:set -DnewVersion=2.4.0-SNAPSHOT -DgenerateBackupPoms=false
```

Verified no dangling references with

```
$ find . -iname '*pom.xml' -exec grep -n '2.3.0-SNAPSHOT' {} +
```

Verified build with

```
$ JAVA_HOME=/Library/Java/JavaVirtualMachines/adoptopenjdk-8.jdk/Contents/Home mvn clean package -DskipTests
$ JAVA_HOME=/Library/Java/JavaVirtualMachines/adoptopenjdk-11.jdk/Contents/Home mvn clean package -DskipTests -Dhadoop.profile=3.0
```

Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-03-19 08:01:43 -07:00
Michael Stack ebd37a314c
HBASE-23993 Use loopback for zk standalone server in minizkcluster (#1291) 
hbase-zookeeper/src/main/java/org/apache/hadoop/hbase/zookeeper/MiniZooKeeperCluster.java
 Have client and server use loopback instead of 'localhost'

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
 2020-03-17 20:14:24 -07:00
Peter Somogyi 3f646d8a81
HBASE-23642 Reintroduce ReplicationUtils.contains as deprecated (#983) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <janh@apache.org>
 2020-01-04 12:14:19 +01:00
ddupg 997684f24d HBASE-23345 Table need to replication unless all of cfs are excluded 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-12-04 09:19:38 +08:00
chenxu14 46c090ce45 HBASE-23293 [REPLICATION] make ship edits timeout configurable (#882) 
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
 2019-11-28 11:01:18 +08:00
Viraj Jasani e153f58937 HBASE-22633 remove redundant substring call with append for ZKReplicationQueueStorage 
Signed-off-by: Sakthi <sakthivel.azhaku@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-06-28 15:03:13 +02:00
Jan Hentschel 6cff25cc23
HBASE-22344 Documented the deprecation of public and limited private APIs (#208) 
Signed-off-by: stack <stack@apache.org>
 2019-06-17 22:29:51 +02:00
Jan Hentschel c0eed64cbf
HBASE-22357 Fixed remaining Checkstyle issues in hbase-replication 2019-06-10 00:26:25 +02:00
Andrew Purtell 2c55bd9344
HBASE-22449 https everywhere in Maven metadata (#247) 2019-05-21 12:38:42 -07:00
Sean Busbey 4862a596ef HBASE-22083 move eclipse settings into a profile. 
Signed-off-by: stack <stack@apache.org>

 Conflicts:
	hbase-backup/pom.xml
	hbase-hadoop-compat/pom.xml
	hbase-protocol/pom.xml
 2019-04-25 14:38:38 -05:00
Guanghao Zhang 16665b6e93 HBASE-21799 Update branch-2 version to 2.3.0-SNAPSHOT 2019-01-29 21:53:21 +08:00
Xu Cang 8a5537b5f5
HBASE-18549 Add metrics for failed replication queue recovery 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-10-01 18:39:03 -07:00
zhangduo dde042cc93 HBASE-20776 Update branch-2 version to 2.2.0-SNAPSHOT 2018-06-22 22:15:18 +08:00
Sean Busbey ee84a8f243 HBASE-20332 shaded mapreduce module shouldn't include hadoop 
* modify the jar checking script to take args; make hadoop stuff optional
* separate out checking the artifacts that have hadoop vs those that don't.
* * Unfortunately means we need two modules for checking things
* * put in a safety check that the support script for checking jar contents is maintained in both modules
* * have to carve out an exception for o.a.hadoop.metrics2. :(
* fix duplicated class warning
* clean up dependencies in hbase-server and some modules that depend on it.
* allow Hadoop to have its own htrace where it needs it
* add a precommit check to make sure we're not using old htrace imports

 Conflicts:
	hbase-backup/pom.xml
	hbase-checkstyle/src/main/resources/hbase/checkstyle-suppressions.xml

Signed-off-by: Mike Drob <mdrob@apache.org>
 2018-06-18 14:02:48 -07:00
Guanghao Zhang 0b0257b412 HBASE-20678 NPE in ReplicationSourceManager#NodeFailoverWorker 2018-06-05 14:59:22 +08:00
maoling 4c95b82b61 HBASE-19761:Fix Checkstyle errors in hbase-zookeeper 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2018-06-02 10:17:27 +02:00
huzheng be3df29cef HBASE-20128 Add new UTs which extends the old replication UTs but set replication scope to SERIAL 2018-05-14 19:32:39 +08:00
huzheng 72093178fb HBASE-20475 Fix the flaky TestReplicationDroppedTables unit test. 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-04-28 18:46:41 +08:00
Sean Busbey 24eb141bac HBASE-20442 clean up incorrect use of commons-collections 3 
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Yu Li <liyu@apache.org>

 Conflicts:
	hbase-backup/src/main/java/org/apache/hadoop/hbase/backup/master/BackupLogCleaner.java
 2018-04-20 08:17:22 -05:00
zhangduo 74ab10c353 HBASE-20296 Remove last pushed sequence ids when removing tables from a peer 2018-04-09 15:18:44 +08:00
zhangduo ead569c951 HBASE-20285 Delete all last pushed sequence ids when removing a peer or removing the serial flag for a peer 2018-04-09 15:18:44 +08:00
huzheng 83488b866f HBASE-20138 Find a way to deal with the conflicts when updating replication position 2018-04-09 15:18:44 +08:00
tianjingyun 3b015d60a4 HBASE-20227 Add UT for ReplicationUtils.contains method 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-04-09 15:18:44 +08:00
zhangduo 9369cf26eb HBASE-20147 Serial replication will be stuck if we create a table with serial replication but add it to a peer after there are region moves 2018-04-09 15:18:44 +08:00
zhangduo 40ad5aeafe HBASE-20116 addendum fix javadoc and also a simple optimization 2018-04-09 15:18:44 +08:00
huzheng 2b9fed863f HBASE-20116 Optimize the region last pushed sequence id layout on zk 2018-04-09 15:18:44 +08:00
zhangduo 16a4dd6b8f HBASE-20206 WALEntryStream should not switch WAL file silently 2018-04-09 15:18:44 +08:00
zhangduo 644bfe36b2 HBASE-20117 Cleanup the unused replication barriers in meta table 2018-04-09 15:18:44 +08:00
zhangduo cea5199ea1 HBASE-20148 Make serial replication as a option for a peer instead of a table 2018-04-09 15:18:44 +08:00
huzheng 1d11cdb26c HBASE-20050 Reimplement updateReplicationPositions logic in serial replication based on the newly introduced replication storage layer 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-04-09 15:18:44 +08:00
BELUGA BEHR 039bc73571 HBASE-19488 Move to using Apache commons CollectionUtils 
Signed-off-by: Apekshit Sharma <appy@apache.org>
 2018-04-04 14:16:33 -07:00
Chia-Ping Tsai dd9e46bbf5 HBASE-20212 Make all Public classes have InterfaceAudience category 
Signed-off-by: tedyu <yuzhihong@gmail.com>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-03-22 18:09:54 +08:00
Michael Stack 3f1c86786c HBASE-20213 [LOGGING] Aligning formatting and logging less (compactions, 
in-memory compactions)

Log less. Log using same format as used elsewhere in log.

Align logs in HFileArchiver with how we format elsewhere. Removed
redundant 'region' qualifiers, tried to tighten up the emissions so
easier to read the long lines.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/ChunkCreator.java
 Add a label for each of the chunkcreators we make (I was confused by
two chunk creater stats emissions in log file -- didn't know that one
was for data and the other index).

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/CompactSplit.java
 Formatting. Log less.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreCompactionStrategy.java
 Make the emissions in here trace-level. When more than a few regions,
log is filled with this stuff.
 2018-03-16 13:07:34 -07:00
Guanghao Zhang 55d0d3026a HBASE-19923 Reset peer state and config when refresh replication source failed 2018-03-09 20:55:48 +08:00
zhangduo abaa80f26e HBASE-19873 addendum add missing rule for new tests 2018-03-09 20:55:48 +08:00
zhangduo 1c32241a00 HBASE-19719 Fix checkstyle issues 2018-03-09 20:55:48 +08:00