Commit Graph

17822 Commits

Author SHA1 Message Date
Andrew Purtell dad725bbe2 Preparing hbase release 2.4.7RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-10-08 17:10:27 -07:00
Duo Zhang b1772fbec2 HBASE-26317 Publish the test logs for pre commit jenkins job to nightlies (#3715)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-10-07 23:46:15 +08:00
Duo Zhang 09c19dd5b9 HBASE-26313 Publish the test logs for our nightly jobs to nightlies.apache.org (#3713)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-10-07 23:40:20 +08:00
Duo Zhang 3f59174553 HBASE-26318 Publish test logs for flaky jobs to nightlies (#3717)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-10-07 23:34:38 +08:00
chenglei 3cc539a561 HBASE-26295 BucketCache could not free BucketEntry which restored fro… (#3699)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-29 21:47:11 +08:00
richardantal 43455061d3 HBASE-26289 Hbase scan setMaxResultsPerColumnFamily not giving right results (#3688)
Co-authored-by: Duo Zhang <zhangduo@apache.org>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2021-09-29 10:23:43 +02:00
bitterfox a6329385a0 HBASE-26238 Short message by Result#compareResults for VerifyReplication to avoid OOME (#3647)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-28 23:16:33 +08:00
clarax dc2bb6a908 HBASE-26297 Balancer run is improperly triggered by accuracy error of double comparison (#3698)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-26 23:45:37 +08:00
Andrew Purtell 8bd4b2c9f3 Amend HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job
Compliation fixes for CombinedBlockCache and TestClientSideRegionScanner.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-09-22 12:20:00 -07:00
Tak Lon (Stephen) Wu 6ca495b273 HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job (#3684)
Introduce `hfile.onheap.block.cache.fixed.size`
and default to disable. when using ClientSideRegionScanner
it will be enabled with a fixed size for caching
INDEX/LEAF_INDEX block when a client, e.g.
snapshot scanner, scans the entire HFile
and does not need to seek/reseek to index
block multiple times.

Signed-off-by: Josh Elser <elserj@apache.org>
2021-09-22 09:39:38 -07:00
meiyi 6f68d2765c HBASE-26261 Store configuration loss when use update_config (#3664)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-22 19:08:07 +08:00
meiyi d75d73bcc7 HBASE-26270 Provide getConfiguration method for Region and Store interface (#3671)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-09-22 11:24:19 +08:00
chenglei 9414e3b471 HBASE-26281 DBB got from BucketCache would be freed unexpectedly before RPC completed (#3680)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-17 22:29:18 +08:00
Josh Elser 74eff79c27 HBASE-26273 Force ReadType.STREAM when the user does not explicitly set a ReadType on the Scan for a Snapshot-based Job
HBase 2 moved over Scans to use PREAD by default instead of STREAM like
HBase 1. In the context of a MapReduce job, we can generally expect that
clients using the InputFormat (batch job) would be reading most of the
data for a job. Cater to them, but still give users who want PREAD the
ability to do so.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2021-09-13 19:31:48 -04:00
bitterfox ff0a33ec40 HBASE-26272 Fix TestTableMapReduceUntil failure in branch-2 (#3676)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-13 10:48:35 +08:00
Wellington Ramos Chevreuil 30ae596308 HBASE-26276 Allow HashTable/SyncTable to perform rawScan when comparing cells (#3673)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry-picked from commit ee632bdcae)
2021-09-10 16:47:58 +01:00
huaxiangsun be23541f11
HBASE-26255 Add an option to use region location from meta table in TableSnapshotInputFormat (#3661) (#3669)
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2021-09-09 10:43:53 -07:00
Xiaolin Ha 466d2d5563 HBASE-26229 Limit count and size of L0 files compaction in StripeCompactionPolicy (#3646)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-09 18:30:24 +08:00
hapihu 9e04033ad2 [HBASE-26243]Fix typo for file "hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java" (#3650)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-09 12:22:19 +08:00
chenglei b78d35598c HBASE-26197 Fix some obvious bugs in MultiByteBuff.put (#3586)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-07 23:49:08 +08:00
Andrew Purtell 24971e8073 Preparing development version 2.4.7-SNAPSHOT
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-09-03 09:41:58 -07:00
Andrew Purtell 7374d396c2 Preparing hbase release 2.4.6RC0; tagging and updates to CHANGES.md and RELEASENOTES.md
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2021-09-03 09:41:52 -07:00
Rushabh Shah f9a9b6eaee HBASE-26106 AbstractFSWALProvider#getArchivedLogPath doesn't look for wal file in all oldWALs directory. (#3636)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

Conflicts:
	hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestWALRecordReader.java
2021-09-02 12:08:49 -07:00
Andrew Purtell d1aa68bd11 HBASE-25588 Excessive logging of "hbase.zookeeper.useMulti is deprecated. Default to true always." (#3640)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Duo Zhang <zhangduo@apache.org>
2021-09-02 10:18:47 -07:00
XinSun 067f609ec6 HBASE-25773 TestSnapshotScannerHDFSAclController.setupBeforeClass is flaky (#3651)
Signed-off-by: Duo Zhang <zhangduo@apache.org>

(cherry picked from commit 345d7256c8)
2021-09-02 15:33:24 +08:00
bitterfox 875f3afc2a HBASE-26205 Use specified cluster conf for UserProvider in TableMRUtil#initCredentialsForCluster (#3592)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Rushabh Shah <shahrs87@gmail.com>
2021-09-01 20:48:26 +08:00
chenglei cf4c764d16 HBASE-26210 HBase Write should be doomed to hang when cell size exceeds InmemoryFlushSize for CompactingMemStore (#3604)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-01 18:17:26 +08:00
chenglei 8085e4c5de HBASE-26244 Avoid trim the error stack trace when running UT with maven (#3654)
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-09-01 15:21:30 +08:00
Andrew Purtell 122efbcd82 HBASE-25642 Fix or stop warning about already cached block (#3638)
Our logs have as a fairly common occurrence: 2021-03-05 22:24:31,034 WARN
[StoreFileOpener-foo-1] hfile.BlockCacheUtil: Caching an already cached
block: blah.bub. This is harmless and can happen in rare cases (see HBASE-8547)

Because it is harmless, log at DEBUG level, not WARN.

Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Rushabh Shah <rushabh.shah@salesforce.com>
2021-08-31 09:26:14 -07:00
keyserbrian1 133237582f HBASE-26232 SEEK_NEXT_USING_HINT is ignored on reversed Scans (#3639)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-29 21:43:02 +08:00
Andrew Purtell 21e2c1b7c6 HBASE-26189 Reduce log level of CompactionProgress notice to DEBUG (#3579)
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2021-08-27 10:15:19 -07:00
Pankaj 1a5b9b7ff6 HBASE-26227 Forward port HBASE-26223 test code to branch-2.4+ (#3632)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-27 16:47:06 +08:00
bitterfox 20279c704d HBASE-26204 Obtain credential for VerifyReplication with peerQuorumAddress (#3625)
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry-picked from commit d781113a08)
2021-08-26 11:03:55 +01:00
lpalasthy da74b8c8fb HBASE-26219 Negative time is logged while waiting on regionservers (#3622)
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-25 16:40:16 +02:00
Xiaolin Ha d6b2257655 HBASE-26087 JVM crash when displaying RPC params by MonitoredRPCHandler (#3489)
Signed-off-by: stack <stack@apache.org>
2021-08-18 14:41:56 +08:00
Bo Cui 125544acfa HBASE-24570 connection#close throws NPE 2021-08-16 17:05:28 -07:00
eomiks 96015e9669 HBASE-24652 master-status UI make date type fields sortable 2021-08-16 16:02:52 -07:00
stack 2ad7905ddc HBASE-26200 Revert "HBASE-25165 Change 'State time' in UI so sorts (#2508)"
This reverts commit d07d181ea4.
2021-08-16 13:46:05 -07:00
bitterfox 6cc26c2487 HBASE-26196 Support configuration override for remote cluster of HFileOutputFormat locality sensitive (#3582)
Signed-off-by: stack <stack@apache.org>
2021-08-16 10:30:15 -07:00
lzx404243 627e0d61ba HBASE-25680 Non-idempotent test in TestReplicationHFileCleaner (#2984)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-14 11:11:46 +08:00
chenglei 8fced2d7f8 HBASE-26026 HBase Write may be stuck forever when using CompactingMemStore (#3421)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-12 23:22:09 +08:00
Xiaolin Ha 2d89b08eb0 HBASE-26155 JVM crash when scan (#3553)
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-12 17:20:18 +08:00
Rushabh Shah 9d34fa7d58
HBASE-26185 Return mutable list in AssignmentManager#getExcludedServersForSystemTable (#3577)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2021-08-12 13:48:17 +05:30
Viraj Jasani cd007eb6b2
HBASE-26185 Fix TestMaster#testMoveRegionWhenNotInitialized in the presence of hbase.min.version.move.system.tables (#3573)
Signed-off-by: Michael Stack <stack@apache.org>
2021-08-10 10:59:14 +05:30
Richard Marscher 66f931c433 HBASE-6908: Add pluggable rpc queue implementation (#3522)
Can pass in a FQCN to load as the call queue implementation.

Standardized arguments to the constructor are the max queue length, the
PriorityFunction, and the Configuration.

`PluggableBlockingQueue` abstract class provided to help guide the
correct constructor signature

Hard fails if the class fails to load as a `BlockingQueue<CallRunner>`

Signed-off-by: stack <stack@apache.org>
2021-08-09 12:56:25 -07:00
Peter Somogyi 78051e577c HBASE-26176 Correct regex in hbase-personality.sh (#3567)
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2021-08-09 11:06:52 +02:00
Duo Zhang 3182507652 HBASE-26179 TestRequestTooBigException spends too much time to finish (#3571)
Signed-off-by: Yulin Niu <niuyulin@apache.org>
2021-08-07 23:08:10 +08:00
Xiaolin Ha 2ea2f800b0 HBASE-26170 handleTooBigRequest in NettyRpcServer didn't skip enough bytes (#3564)
Signed-off-by: stack <stack@apache.com>
2021-08-05 08:18:09 -07:00
chenglei 9a469aeaae HBASE-26142 NullPointerException when set 'hbase.hregion.memstore.mslab.indexchunksize.percent' to zero (#3531)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2021-08-05 21:04:57 +08:00
Bryan Beaudreault 27b0c41cb2
HBASE-26160: Configurable disallowlist for live editing of loglevels (#3558)
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2021-08-05 11:12:10 +08:00