Commit Graph

354 Commits

Author SHA1 Message Date
Bryan Beaudreault 83d5a9ea27 HBASE-26878 TableInputFormatBase should cache RegionSizeCalculator (#4271)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-24 16:25:10 -07:00
xicm 9043cb90d0 HBASE-26720 ExportSnapshot should validate the source snapshot before copying files (#4216)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-16 20:16:36 +08:00
Andrew Purtell ec40003898 Preparing development version 2.4.12-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-15 10:17:31 -07:00
Andrew Purtell 7e672a0da0 Preparing hbase release 2.4.11RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-15 10:17:28 -07:00
Andrew Purtell 95f4128973 Preparing development version 2.4.12-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-14 15:55:02 -07:00
Andrew Purtell 2743fa5b9c Preparing hbase release 2.4.11RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-14 15:54:59 -07:00
Andrew Purtell 210517040b HBASE-26582 Prune use of Random and SecureRandom objects (#4118)
Avoid the pattern where a Random object is allocated, used once or twice, and
then left for GC. This pattern triggers warnings from some static analysis tools
because this pattern leads to poor effective randomness. In a few cases we were
legitimately suffering from this issue; in others a change is still good to
reduce noise in analysis results.

Use ThreadLocalRandom where there is no requirement to set the seed to gain
good reuse.

Where useful relax use of SecureRandom to simply Random or ThreadLocalRandom,
which are unlikely to block if the system entropy pool is low, if we don't need
crypographically strong randomness for the use case. The exception to this is
normalization of use of Bytes#random to fill byte arrays with randomness.
Because Bytes#random may be used to generate key material it must be backed by
SecureRandom.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-08 16:12:08 -08:00
Duo Zhang 694e9faad5 HBASE-26691 Replacing log4j with reload4j for branch-2.x (#4050)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	pom.xml
2022-03-04 12:10:43 -08:00
Mike Drob c3ac78691e HBASE-26622 Update error-prone to 2.10
Author:    Mike Drob <mdrob@apache.org>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-03 11:52:16 +01:00
Andrew Purtell 819afc7a39 Preparing development version 2.4.11-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-28 09:53:11 -08:00
Andrew Purtell 3e5359c73d Preparing hbase release 2.4.10RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-28 09:53:07 -08:00
Andrew Purtell 9e8b5a89e5 Revert "Preparing development version 2.4.11-SNAPSHOT"
Revert "Preparing hbase release 2.4.10RC1; tagging and updates to CHANGES.md and RELEASENOTES.md"

This reverts commit 31a9beaf94.
This reverts commit 0dc107e15b.
This reverts commit a86548a257.
This reverts commit 27343174e7.
2022-02-28 09:17:45 -08:00
Andrew Purtell 31a9beaf94 Preparing development version 2.4.11-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-28 08:48:55 -08:00
Andrew Purtell 0dc107e15b Preparing hbase release 2.4.10RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-28 08:48:52 -08:00
Andrew Purtell a86548a257 Preparing development version 2.4.11-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-25 18:34:32 -08:00
Andrew Purtell 27343174e7 Preparing hbase release 2.4.10RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-25 18:34:29 -08:00
meiyi b68c4aae06 HBASE-26646 WALPlayer should obtain token from filesystem (#4003)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-07 18:00:58 +08:00
meiyi a7c4a394a9 HBASE-26625 ExportSnapshot tool failed to copy data files for tables with merge region (#3981)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-30 12:17:40 +08:00
Andrew Purtell 6449087228 Preparing development version 2.4.10-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-17 18:52:26 -08:00
Andrew Purtell c49f7f63fc Preparing hbase release 2.4.9RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-17 18:51:25 -08:00
Andrew Purtell 6e25a4e2f9 Revert "Preparing hbase release 2.4.9RC0; tagging and updates to CHANGES.md and RELEASENOTES.md"
This reverts commit 53391b269c.
2021-12-17 18:34:37 -08:00
Andrew Purtell 2059cda314 Revert "Preparing development version 2.4.10-SNAPSHOT"
This reverts commit deb570b2e9.
2021-12-17 18:34:37 -08:00
Andrew Purtell deb570b2e9 Preparing development version 2.4.10-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-17 17:04:46 -08:00
Andrew Purtell 53391b269c Preparing hbase release 2.4.9RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-17 17:04:42 -08:00
Ruanhui 3e14c8d6e6 HBASE-26485 Introduce a method to clean restore directory after Snapshot Scan (#3877)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-27 20:42:01 +08:00
Istvan Toth 5fbb089c92 HBASE-26398 CellCounter fails for large tables filling up local disk (#3798)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 60254bc184)
2021-10-28 09:50:13 +01:00
Andrew Purtell 377c0586ab Preparing development version 2.4.9-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-27 08:37:23 -07:00
Andrew Purtell f844d09157 Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-27 08:37:17 -07:00
Andrew Purtell d91738b9be Revert "Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md"
This reverts commit 281294f655.
2021-10-27 08:25:10 -07:00
Andrew Purtell 33ba3c60b9 Revert "Preparing development version 2.4.9-SNAPSHOT"
This reverts commit 86c97a8b1a.
2021-10-27 08:25:08 -07:00
Andrew Purtell 86c97a8b1a Preparing development version 2.4.9-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-20 16:08:26 -07:00
Andrew Purtell 281294f655 Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-20 16:08:21 -07:00
Andrew Purtell 2ca84d531a Preparing development version 2.4.8-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-08 17:10:33 -07:00
Andrew Purtell dad725bbe2 Preparing hbase release 2.4.7RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-08 17:10:27 -07:00
bitterfox a6329385a0 HBASE-26238 Short message by Result#compareResults for VerifyReplication to avoid OOME (#3647)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-28 23:16:33 +08:00
Josh Elser 74eff79c27 HBASE-26273 Force ReadType.STREAM when the user does not explicitly set a ReadType on the Scan for a Snapshot-based Job
HBase 2 moved over Scans to use PREAD by default instead of STREAM like
HBase 1. In the context of a MapReduce job, we can generally expect that
clients using the InputFormat (batch job) would be reading most of the
data for a job. Cater to them, but still give users who want PREAD the
ability to do so.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2021-09-13 19:31:48 -04:00
bitterfox ff0a33ec40 HBASE-26272 Fix TestTableMapReduceUntil failure in branch-2 (#3676)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-13 10:48:35 +08:00
Wellington Ramos Chevreuil 30ae596308 HBASE-26276 Allow HashTable/SyncTable to perform rawScan when comparing cells (#3673)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry-picked from commit ee632bdcae)
2021-09-10 16:47:58 +01:00
huaxiangsun be23541f11
HBASE-26255 Add an option to use region location from meta table in TableSnapshotInputFormat (#3661) (#3669)
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-09-09 10:43:53 -07:00
Andrew Purtell 24971e8073 Preparing development version 2.4.7-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-09-03 09:41:58 -07:00
Andrew Purtell 7374d396c2 Preparing hbase release 2.4.6RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-09-03 09:41:52 -07:00
Rushabh Shah f9a9b6eaee HBASE-26106 AbstractFSWALProvider#getArchivedLogPath doesn't look for wal file in all oldWALs directory. (#3636)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

Conflicts:
	hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestWALRecordReader.java
2021-09-02 12:08:49 -07:00
bitterfox 875f3afc2a HBASE-26205 Use specified cluster conf for UserProvider in TableMRUtil#initCredentialsForCluster (#3592)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Rushabh Shah <shahrs87@gmail.com>
2021-09-01 20:48:26 +08:00
bitterfox 20279c704d HBASE-26204 Obtain credential for VerifyReplication with peerQuorumAddress (#3625)
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry-picked from commit d781113a08)
2021-08-26 11:03:55 +01:00
bitterfox 6cc26c2487 HBASE-26196 Support configuration override for remote cluster of HFileOutputFormat locality sensitive (#3582)
Signed-off-by: stack <stack@apache.org>
2021-08-16 10:30:15 -07:00
Andrew Purtell 4ec1333df8 Preparing development version 2.4.6-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-07-27 09:34:19 -07:00
Andrew Purtell 03b8c0cf42 Preparing hbase release 2.4.5RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-07-27 09:34:14 -07:00
Andrew Purtell 845e6f0216 Preparing development version 2.4.6-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-07-26 17:24:44 -07:00
Andrew Purtell 4810fd1096 Preparing hbase release 2.4.5RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-07-26 17:24:37 -07:00
Andrew Purtell 67163bb1da Preparing development version 2.4.6-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-07-23 09:55:58 -07:00