Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,839 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

17839 Commits

Author SHA1 Message Date
binlijin 446630b713 HBASE-26385 Clear CellScanner when replay (#3773) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Pankaj Kumar <pankajkumar@apache.org>
 2021-10-21 21:56:54 +08:00
Andrew Purtell 86c97a8b1a Preparing development version 2.4.9-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-20 16:08:26 -07:00
Andrew Purtell 281294f655 Preparing hbase release 2.4.8RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-20 16:08:21 -07:00
KulwantSingh011 67967f265f HBASE-26190 High rate logging of BucketAllocatorException: Allocation too big (#3752) 
Reduce the frequency of allocation failed traces by printing them
preiodically (once per minute). Record the allocation failures in the
Bucket Cache Stats and let the stat thread dump cumulative allocation
failures alongside other traces it dumps.

Also, this change adds trace for the Table name, Column Family and
HFileName for the most recent allocation failure in last 1 minute.

Signed-off-by: Anoop <anoopsamjohn@apache.org>
 2021-10-20 15:55:10 -07:00
Andrew Purtell 4149459dde HBASE-26383 HBCK incorrectly reports inconsistencies for recently split regions following a master failover (#3775) 
A regression was introduced by HBASE-25847 which changed regionInfo#isParentSplit
to regionState#isSplit. The region state after restart is CLOSED instead of SPLIT.
We need to check both regionState and regionInfo for split status.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2021-10-20 15:55:10 -07:00
Viraj Jasani 09ffa49df8
HBASE-26371 Prioritize meta region move over other region moves in region_mover (#3769) (#3767) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-20 23:07:28 +05:30
Wellington Ramos Chevreuil 7bbbd3dafc HBASE-26364 TestThriftServer is failing 100% in our flaky test job (#3759) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 4454c2f909)
 2021-10-18 15:32:40 +01:00
Horváth Dóra 533f53587a HBASE-26284 Add HBase Thrift API to get all table names along with wh… (#3693) (#3745) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 6d0777a551)
 2021-10-18 10:08:21 +01:00
Duo Zhang 65c6a6a4c6 HBASE-26360 Use gen_redirect_html for linking test logs (#3755) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-10-17 23:24:45 +08:00
Josh Elser a372d437b3 HBASE-26350 Add a DEBUG when we fail the SASL handshake 
Closes #3743

Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2021-10-14 15:42:53 -04:00
Duo Zhang 7827b96d16 HBASE-26341 Upload dashboard html for flaky find job to nightlies (#3742) 
Signed-off-by: Yulin Niu <niuyulin@apache.org>
 2021-10-14 23:08:04 +08:00
chenglei 52d1dc0915 HBASE-26344 Fix Bug for MultiByteBuff.put(int, byte) (#3741) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-10-14 22:55:57 +08:00
Peter Somogyi c42d6ccc1a
HBASE-26329 Upgrade commons-io to 2.11.0 (#3735) 
Includes HBASE-25451 changes required for commons-io 2.8.0+ upgrade.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-10-10 09:47:57 +02:00
Sean Busbey 28e0fbc704 HBASE-26186 jenkins script for caching artifacts should verify cached file before relying on it. (#3590) 
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-10-09 13:25:20 +08:00
xicm db7c35e23e HBASE-26312 Shell scan fails with timestamp (#3734) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-10-09 10:34:13 +08:00
Duo Zhang d0818fbde5 HBASE-26339 SshPublisher will skip uploading artifacts if the build is failure (#3736) 
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
 2021-10-09 09:58:01 +08:00
Andrew Purtell 2ca84d531a Preparing development version 2.4.8-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-08 17:10:33 -07:00
Andrew Purtell dad725bbe2 Preparing hbase release 2.4.7RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-10-08 17:10:27 -07:00
Duo Zhang b1772fbec2 HBASE-26317 Publish the test logs for pre commit jenkins job to nightlies (#3715) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-10-07 23:46:15 +08:00
Duo Zhang 09c19dd5b9 HBASE-26313 Publish the test logs for our nightly jobs to nightlies.apache.org (#3713) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-10-07 23:40:20 +08:00
Duo Zhang 3f59174553 HBASE-26318 Publish test logs for flaky jobs to nightlies (#3717) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-10-07 23:34:38 +08:00
chenglei 3cc539a561 HBASE-26295 BucketCache could not free BucketEntry which restored fro… (#3699) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-29 21:47:11 +08:00
richardantal 43455061d3 HBASE-26289 Hbase scan setMaxResultsPerColumnFamily not giving right results (#3688) 
Co-authored-by: Duo Zhang <zhangduo@apache.org>

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2021-09-29 10:23:43 +02:00
bitterfox a6329385a0 HBASE-26238 Short message by Result#compareResults for VerifyReplication to avoid OOME (#3647) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-28 23:16:33 +08:00
clarax dc2bb6a908 HBASE-26297 Balancer run is improperly triggered by accuracy error of double comparison (#3698) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-26 23:45:37 +08:00
Andrew Purtell 8bd4b2c9f3 Amend HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job 
Compliation fixes for CombinedBlockCache and TestClientSideRegionScanner.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-09-22 12:20:00 -07:00
Tak Lon (Stephen) Wu 6ca495b273 HBASE-26274 Create an option to reintroduce BlockCache to mapreduce job (#3684) 
Introduce `hfile.onheap.block.cache.fixed.size`
and default to disable. when using ClientSideRegionScanner
it will be enabled with a fixed size for caching
INDEX/LEAF_INDEX block when a client, e.g.
snapshot scanner, scans the entire HFile
and does not need to seek/reseek to index
block multiple times.

Signed-off-by: Josh Elser <elserj@apache.org>
 2021-09-22 09:39:38 -07:00
meiyi 6f68d2765c HBASE-26261 Store configuration loss when use update_config (#3664) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-22 19:08:07 +08:00
meiyi d75d73bcc7 HBASE-26270 Provide getConfiguration method for Region and Store interface (#3671) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2021-09-22 11:24:19 +08:00
chenglei 9414e3b471 HBASE-26281 DBB got from BucketCache would be freed unexpectedly before RPC completed (#3680) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-17 22:29:18 +08:00
Josh Elser 74eff79c27 HBASE-26273 Force ReadType.STREAM when the user does not explicitly set a ReadType on the Scan for a Snapshot-based Job 
HBase 2 moved over Scans to use PREAD by default instead of STREAM like
HBase 1. In the context of a MapReduce job, we can generally expect that
clients using the InputFormat (batch job) would be reading most of the
data for a job. Cater to them, but still give users who want PREAD the
ability to do so.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
 2021-09-13 19:31:48 -04:00
bitterfox ff0a33ec40 HBASE-26272 Fix TestTableMapReduceUntil failure in branch-2 (#3676) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-13 10:48:35 +08:00
Wellington Ramos Chevreuil 30ae596308 HBASE-26276 Allow HashTable/SyncTable to perform rawScan when comparing cells (#3673) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry-picked from commit ee632bdcae)
 2021-09-10 16:47:58 +01:00
huaxiangsun be23541f11
HBASE-26255 Add an option to use region location from meta table in TableSnapshotInputFormat (#3661) (#3669) 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2021-09-09 10:43:53 -07:00
Xiaolin Ha 466d2d5563 HBASE-26229 Limit count and size of L0 files compaction in StripeCompactionPolicy (#3646) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-09 18:30:24 +08:00
hapihu 9e04033ad2 [HBASE-26243]Fix typo for file "hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java" (#3650) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-09 12:22:19 +08:00
chenglei b78d35598c HBASE-26197 Fix some obvious bugs in MultiByteBuff.put (#3586) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-07 23:49:08 +08:00
Andrew Purtell 24971e8073 Preparing development version 2.4.7-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-09-03 09:41:58 -07:00
Andrew Purtell 7374d396c2 Preparing hbase release 2.4.6RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2021-09-03 09:41:52 -07:00
Rushabh Shah f9a9b6eaee HBASE-26106 AbstractFSWALProvider#getArchivedLogPath doesn't look for wal file in all oldWALs directory. (#3636) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>

Conflicts:
	hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/mapreduce/TestWALRecordReader.java
 2021-09-02 12:08:49 -07:00
Andrew Purtell d1aa68bd11 HBASE-25588 Excessive logging of "hbase.zookeeper.useMulti is deprecated. Default to true always." (#3640) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Duo Zhang <zhangduo@apache.org>
 2021-09-02 10:18:47 -07:00
XinSun 067f609ec6 HBASE-25773 TestSnapshotScannerHDFSAclController.setupBeforeClass is flaky (#3651) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>

(cherry picked from commit 345d7256c8)
 2021-09-02 15:33:24 +08:00
bitterfox 875f3afc2a HBASE-26205 Use specified cluster conf for UserProvider in TableMRUtil#initCredentialsForCluster (#3592) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Reviewed-by: Rushabh Shah <shahrs87@gmail.com>
 2021-09-01 20:48:26 +08:00
chenglei cf4c764d16 HBASE-26210 HBase Write should be doomed to hang when cell size exceeds InmemoryFlushSize for CompactingMemStore (#3604) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-01 18:17:26 +08:00
chenglei 8085e4c5de HBASE-26244 Avoid trim the error stack trace when running UT with maven (#3654) 
Signed-off-by: Geoffrey Jacoby <gjacoby@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-09-01 15:21:30 +08:00
Andrew Purtell 122efbcd82 HBASE-25642 Fix or stop warning about already cached block (#3638) 
Our logs have as a fairly common occurrence: 2021-03-05 22:24:31,034 WARN
[StoreFileOpener-foo-1] hfile.BlockCacheUtil: Caching an already cached
block: blah.bub. This is harmless and can happen in rare cases (see HBASE-8547)

Because it is harmless, log at DEBUG level, not WARN.

Signed-off-by: Baiqiang Zhao <zhaobaiqiang@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Reviewed-by: Rushabh Shah <rushabh.shah@salesforce.com>
 2021-08-31 09:26:14 -07:00
keyserbrian1 133237582f HBASE-26232 SEEK_NEXT_USING_HINT is ignored on reversed Scans (#3639) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-08-29 21:43:02 +08:00
Andrew Purtell 21e2c1b7c6 HBASE-26189 Reduce log level of CompactionProgress notice to DEBUG (#3579) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2021-08-27 10:15:19 -07:00
Pankaj 1a5b9b7ff6 HBASE-26227 Forward port HBASE-26223 test code to branch-2.4+ (#3632) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2021-08-27 16:47:06 +08:00
bitterfox 20279c704d HBASE-26204 Obtain credential for VerifyReplication with peerQuorumAddress (#3625) 
Signed-off-by: Rushabh Shah <shahrs87@gmail.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry-picked from commit d781113a08)
 2021-08-26 11:03:55 +01:00