354 Commits

Author SHA1 Message Date
Bryan Beaudreault
83d5a9ea27 HBASE-26878 TableInputFormatBase should cache RegionSizeCalculator (#4271)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-24 16:25:10 -07:00
xicm
9043cb90d0 HBASE-26720 ExportSnapshot should validate the source snapshot before copying files (#4216)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2022-03-16 20:16:36 +08:00
Andrew Purtell
ec40003898 Preparing development version 2.4.12-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-15 10:17:31 -07:00
Andrew Purtell
7e672a0da0 Preparing hbase release 2.4.11RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-15 10:17:28 -07:00
Andrew Purtell
95f4128973 Preparing development version 2.4.12-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-14 15:55:02 -07:00
Andrew Purtell
2743fa5b9c Preparing hbase release 2.4.11RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-14 15:54:59 -07:00
Andrew Purtell
210517040b HBASE-26582 Prune use of Random and SecureRandom objects (#4118)
Avoid the pattern where a Random object is allocated, used once or twice, and
then left for GC. This pattern triggers warnings from some static analysis tools
because this pattern leads to poor effective randomness. In a few cases we were
legitimately suffering from this issue; in others a change is still good to
reduce noise in analysis results.

Use ThreadLocalRandom where there is no requirement to set the seed to gain
good reuse.

Where useful relax use of SecureRandom to simply Random or ThreadLocalRandom,
which are unlikely to block if the system entropy pool is low, if we don't need
crypographically strong randomness for the use case. The exception to this is
normalization of use of Bytes#random to fill byte arrays with randomness.
Because Bytes#random may be used to generate key material it must be backed by
SecureRandom.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-03-08 16:12:08 -08:00
Duo Zhang
694e9faad5 HBASE-26691 Replacing log4j with reload4j for branch-2.x (#4050)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	pom.xml
2022-03-04 12:10:43 -08:00
Mike Drob
c3ac78691e HBASE-26622 Update error-prone to 2.10
Author:    Mike Drob <mdrob@apache.org>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-03-03 11:52:16 +01:00
Andrew Purtell
819afc7a39 Preparing development version 2.4.11-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-28 09:53:11 -08:00
Andrew Purtell
3e5359c73d Preparing hbase release 2.4.10RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-28 09:53:07 -08:00
Andrew Purtell
9e8b5a89e5 Revert "Preparing development version 2.4.11-SNAPSHOT"
Revert "Preparing hbase release 2.4.10RC1; tagging and updates to CHANGES.md and RELEASENOTES.md"

This reverts commit 31a9beaf949385d75a23c672572fbb70c937cf97.
This reverts commit 0dc107e15b5684aea64892fa4db460724de2a779.
This reverts commit a86548a25755c574c76ef27c374fe05be295d057.
This reverts commit 27343174e7837f5859b0e7bd8cc23ec0e62a25c1.
2022-02-28 09:17:45 -08:00
Andrew Purtell
31a9beaf94 Preparing development version 2.4.11-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-28 08:48:55 -08:00
Andrew Purtell
0dc107e15b Preparing hbase release 2.4.10RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-28 08:48:52 -08:00
Andrew Purtell
a86548a257 Preparing development version 2.4.11-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-25 18:34:32 -08:00
Andrew Purtell
27343174e7 Preparing hbase release 2.4.10RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2022-02-25 18:34:29 -08:00
meiyi
b68c4aae06 HBASE-26646 WALPlayer should obtain token from filesystem (#4003)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2022-01-07 18:00:58 +08:00
meiyi
a7c4a394a9 HBASE-26625 ExportSnapshot tool failed to copy data files for tables with merge region (#3981)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-12-30 12:17:40 +08:00
Andrew Purtell
6449087228 Preparing development version 2.4.10-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-17 18:52:26 -08:00
Andrew Purtell
c49f7f63fc Preparing hbase release 2.4.9RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-17 18:51:25 -08:00
Andrew Purtell
6e25a4e2f9 Revert "Preparing hbase release 2.4.9RC0; tagging and updates to CHANGES.md and RELEASENOTES.md"
This reverts commit 53391b269c6dcc5051b21527cafb8e6d8cd2c4e9.
2021-12-17 18:34:37 -08:00
Andrew Purtell
2059cda314 Revert "Preparing development version 2.4.10-SNAPSHOT"
This reverts commit deb570b2e935e0ceb60e6c312a778c24277eb36a.
2021-12-17 18:34:37 -08:00
Andrew Purtell
deb570b2e9 Preparing development version 2.4.10-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-17 17:04:46 -08:00
Andrew Purtell
53391b269c Preparing hbase release 2.4.9RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-12-17 17:04:42 -08:00
Ruanhui
3e14c8d6e6 HBASE-26485 Introduce a method to clean restore directory after Snapshot Scan (#3877)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-11-27 20:42:01 +08:00
Istvan Toth
5fbb089c92 HBASE-26398 CellCounter fails for large tables filling up local disk (#3798)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 60254bc18476195d60669ee4a357aee7d68797c9)
2021-10-28 09:50:13 +01:00
Andrew Purtell
377c0586ab Preparing development version 2.4.9-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-27 08:37:23 -07:00
Andrew Purtell
f844d09157 Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-27 08:37:17 -07:00
Andrew Purtell
d91738b9be Revert "Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md"
This reverts commit 281294f655817f086a0ffcc2d66bf5827d0521e2.
2021-10-27 08:25:10 -07:00
Andrew Purtell
33ba3c60b9 Revert "Preparing development version 2.4.9-SNAPSHOT"
This reverts commit 86c97a8b1a25c89d3812486a286259426b5eec42.
2021-10-27 08:25:08 -07:00
Andrew Purtell
86c97a8b1a Preparing development version 2.4.9-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-20 16:08:26 -07:00
Andrew Purtell
281294f655 Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-20 16:08:21 -07:00
Andrew Purtell
2ca84d531a Preparing development version 2.4.8-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-08 17:10:33 -07:00
Andrew Purtell
dad725bbe2 Preparing hbase release 2.4.7RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-08 17:10:27 -07:00
bitterfox
a6329385a0 HBASE-26238 Short message by Result#compareResults for VerifyReplication to avoid OOME (#3647)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-28 23:16:33 +08:00
Josh Elser
74eff79c27 HBASE-26273 Force ReadType.STREAM when the user does not explicitly set a ReadType on the Scan for a Snapshot-based Job
HBase 2 moved over Scans to use PREAD by default instead of STREAM like
HBase 1. In the context of a MapReduce job, we can generally expect that
clients using the InputFormat (batch job) would be reading most of the
data for a job. Cater to them, but still give users who want PREAD the
ability to do so.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2021-09-13 19:31:48 -04:00
bitterfox
ff0a33ec40 HBASE-26272 Fix TestTableMapReduceUntil failure in branch-2 (#3676)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-13 10:48:35 +08:00
Wellington Ramos Chevreuil
30ae596308 HBASE-26276 Allow HashTable/SyncTable to perform rawScan when comparing cells (#3673)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry-picked from commit ee632bdcaefe34f2f51d2f528a480bd492e3a2ae)
2021-09-10 16:47:58 +01:00
huaxiangsun
be23541f11
HBASE-26255 Add an option to use region location from meta table in TableSnapshotInputFormat (#3661) (#3669)
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-09-09 10:43:53 -07:00
Andrew Purtell
24971e8073 Preparing development version 2.4.7-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-09-03 09:41:58 -07:00
Andrew Purtell
7374d396c2 Preparing hbase release 2.4.6RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-09-03 09:41:52 -07:00
Rushabh Shah
f9a9b6eaee HBASE-26106 AbstractFSWALProvider#getArchivedLogPath doesn't look for wal file in all oldWALs directory. (#3636)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

Conflicts:
	hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestWALRecordReader.java
2021-09-02 12:08:49 -07:00
bitterfox
875f3afc2a HBASE-26205 Use specified cluster conf for UserProvider in TableMRUtil#initCredentialsForCluster (#3592)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Rushabh Shah <shahrs87@gmail.com>
2021-09-01 20:48:26 +08:00
bitterfox
20279c704d HBASE-26204 Obtain credential for VerifyReplication with peerQuorumAddress (#3625)
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry-picked from commit d781113a080cb31499f3225cba24dd4d5ef2d4c6)
2021-08-26 11:03:55 +01:00
bitterfox
6cc26c2487 HBASE-26196 Support configuration override for remote cluster of HFileOutputFormat locality sensitive (#3582)
Signed-off-by: stack <stack@apache.org>
2021-08-16 10:30:15 -07:00
Andrew Purtell
4ec1333df8 Preparing development version 2.4.6-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-07-27 09:34:19 -07:00
Andrew Purtell
03b8c0cf42 Preparing hbase release 2.4.5RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-07-27 09:34:14 -07:00
Andrew Purtell
845e6f0216 Preparing development version 2.4.6-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-07-26 17:24:44 -07:00
Andrew Purtell
4810fd1096 Preparing hbase release 2.4.5RC1; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-07-26 17:24:37 -07:00
Andrew Purtell
67163bb1da Preparing development version 2.4.6-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-07-23 09:55:58 -07:00