Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,651 Commits 95 Branches 866 Tags
Commit Graph

18651 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Nick Dimiduk
07bdc09ee5 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (#5145) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-05-01 17:45:38 +02:00
Duo Zhang
b50022d6cf HBASE-27819 10k RpcServer.MAX_REQUEST_SIZE is not enough in ReplicationDroppedTable related tests (#5208) 
Also modified the tests so we will only start the cluster once instead
of start it in setUpBeforeClass and then restart it when running the
actual test method

Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 21d61cfa1c469c31041151481d6b5c5381393599)
 2023-05-01 21:47:41 +08:00
Andor Molnár
ea82b9c72f HBASE-27810. Check if the executor has already been shut down before submitting new job (#5207) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a6e89bf624d70a7f220f961e4f8808374400d774)
 2023-04-28 16:48:36 +02:00
Nihal Jain
4800976ae3 HBASE-27792 Guard Master/RS Dump Servlet behind admin walls (#5176) 2023-04-28 20:01:44 +05:30
Nick Dimiduk
1b603fad1a HBASE-27808 Change flatten mode for oss in our pom file (#5201) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a2cfa6822ae84b0a87d5e90c5e588cb900852eba)
 2023-04-28 11:40:25 +08:00
Duo Zhang
d7c5e47767 HBASE-27818 Split TestReplicationDroppedTables (#5206) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 1ced254b8d1208f543f936d477ff751b06e2ab73)
 2023-04-28 10:00:13 +08:00
Nihal Jain
3267c76a74 HBASE-20804 Document and add tests for HBaseConfTool (#5190) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e86f9308944bd57f34da64746adfda75f093b825)
 2023-04-23 23:43:46 +08:00
haosen chen
2980ef4b4b HBASE-27807 PressureAwareCompactionThroughputController#tune log the opposite of the actual scenario (#5198) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 95f83cb8e242f5d8b9fb55b9d406c3ba54b5cb92)
 2023-04-23 23:34:19 +08:00
Nihal Jain
4ee389adc4 HBASE-27791 Upgrade vega and its related js libraries (#5173) 
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-04-18 12:16:09 +02:00
Andrew Purtell
8516bb5c71 HBASE-27796 Improve MemcachedBlockCache (#5181) 
Track and log better stats.
Fix use of memcached API such that we are not accidentally immediately expiring keys.
Use a default retention period of 30 days, the max per memcached spec.
Use set instead of add to store keys.
Gracefully handle failures to cache and read timeouts.
Add unit tests using jmemcached as a test dependency.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-04-17 14:13:19 -07:00
lizhexi0928
690ca8c562
[HBASE-27789] Backport "HBASE-24914 Remove duplicate code appearing continuously in method ReplicationPeerManager.updatePeerConfig" to branch-2 (#5180) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-04-14 11:43:31 +01:00
Kota-SH
3dda428417 HBASE-27422: Support replication for hbase:acl (#4827) 
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>

(cherry picked from commit 856fa145372b85e7f600f7c959b69ee62702dfb1)
 2023-04-14 10:36:40 +01:00
Bryan Beaudreault
1e97fbfc9f HBASE-27768 Race conditions in BlockingRpcConnection (#5154) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2023-04-10 15:23:34 -04:00
tianhang
65e579c060 HBASE-27713 Remove numRegions in Region Metrics (#5107) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 251e4984776e2ee13ae4df1de4c000f35a58ad59)
 2023-04-08 15:09:37 +08:00
Nick Dimiduk
a72b516fb0 HBASE-27720 TestClusterRestartFailover is flakey due to metrics assertion (#5110) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f36587c6486468f6b19f7419c9a263ed81d8bdc7)
 2023-04-08 11:05:42 +08:00
chenglei
045aa9f780
HBASE-27778 Incorrect ReplicationSourceWALReader. totalBufferUsed may cause replication hang up (#5162) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-07 15:07:20 +08:00
Andrew Purtell
f8f06fcd0a Preparing development version 2.5.5-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-04-06 09:09:26 -07:00
Andrew Purtell
2e426ab69d Preparing hbase release 2.5.4RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
rel/2.5.4 2.5.4RC0 		2023-04-06 09:09:24 -07:00
Andrew Purtell
7164d6c533 Revert "Preparing development version 2.5.5-SNAPSHOT" 
This reverts commit 0583060305ddc8f0762ef4997fb46a79682e831a.

Revert "Preparing hbase release 2.5.4RC0; tagging and updates to CHANGES.md and RELEASENOTES.md"

This reverts commit 0ab2fb24abe823050d253064d5052513df4c9500.

Retry tagging and preparation for 2.5.4RC0 after addressing local release build
errors.
 2023-04-06 09:04:42 -07:00
Andrew Purtell
0583060305 Preparing development version 2.5.5-SNAPSHOT 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-04-05 22:07:09 -07:00
Andrew Purtell
0ab2fb24ab Preparing hbase release 2.5.4RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-04-05 22:07:07 -07:00
Bryan Beaudreault
e9c14e0fbf HBASE-27704 Quotas can drastically overflow configured limit (#5153) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-04-03 17:08:50 -04:00
Bryan Beaudreault
694752b781 HBASE-27758 Inconsistent synchronization in MetricsUserSourceImpl (#5149) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-31 09:18:45 -04:00
Rishabh Murarka
9931edb851 HBASE-27726 Handling of ruby shell SyntaxError exceptions (#5147) 
Co-authored-by: Rishabh Murarka <rmurarka@visa.com>
 2023-03-29 14:33:04 +05:30
dependabot[bot]
49baa793cb HBASE-27748 Bump jettison from 1.5.2 to 1.5.4 (#5136) 
Bumps [jettison](https://github.com/jettison-json/jettison) from 1.5.2 to 1.5.4.
- [Release notes](https://github.com/jettison-json/jettison/releases)
- [Commits](https://github.com/jettison-json/jettison/compare/jettison-1.5.2...jettison-1.5.4)

---
updated-dependencies:
- dependency-name: org.codehaus.jettison:jettison
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 735fb4338876b8d7da9dcad7383bdf1fc9c90c87)
 2023-03-24 21:57:01 +08:00
Duo Zhang
23ce03c7c5 HBASE-27732 NPE in TestBasicWALEntryStreamFSHLog.testEOFExceptionInOldWALsDirectory (#5119) 
Add a 'closed' flag in WALProps in AbstractFSWAL to indicate that whether a WAL
file has been closed, if not, we will not try to archive it. Will mark it as
closed after we fully close it in the background close task, and try to archive
again.

Also modified some tests since now the archiving of a rolled WAL file is also
asynchronous, we need to wait instead of asserting directly.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 230fdc0b50578144d3e0916c33d4532bb8644763)
 2023-03-24 17:45:55 +08:00
Duo Zhang
32f95c4b13 HBASE-26866 Shutdown WAL may abort region server (#4254) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit b67c16a7636958970d37bfcd775fd55e8de98177)
 2023-03-24 16:08:56 +08:00
Xiaolin Ha
17deed9533 HBASE-26526 Introduce a timeout to shutdown of WAL (#3297) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit ca3ba494cbc322b0824d2d755bcf4191c3a525ed)
 2023-03-24 16:08:36 +08:00
Andrew Purtell
e1b58290d1 HBASE-27744 Update compression dependencies (#5137) 
Update compression codec dependencies:

 - aircompressor 0.21 -> 0.24
 - brotli4j 1.8.0 -> 1.11.0
 - snappy 1.1.8.4 -> 1.1.9.1
 - zstd-jni 1.5.0-4 -> 1.5.4-2

and add a new supplemental model for new brotli4j dependency.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-23 13:10:31 -07:00
Nick Dimiduk
6024a24957 HBASE-27741 Fall back to protoc osx-x86_64 on Apple Silicon 
Old protobuf-2.5 doesn't know about Apple Silicon. Fall back to the x86 binary and hope that
rosetta continues to work.

https://cwiki.apache.org/confluence/display/HADOOP/Develop+on+Apple+Silicon+%28M1%29+macOS

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2023-03-22 15:15:29 +01:00
Xiaolin Ha
40d2545200 HBASE-27676 Scan handlers in the RPC executor should match at least one scan queues (#5074) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-22 08:11:59 +08:00
xuzifu666
8e2f6f8238 HBASE-27736 HFileSystem.getLocalFs is not used (#5125) 
Co-authored-by: xuyu <11161569@vivo.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit dd3b1630e848d34db432526dee86289439594510)
 2023-03-21 22:56:55 +08:00
Nick Dimiduk
241c197315 HBASE-27737 Add supplemental model for com.aayushatharva.brotli4j:native-osx-aarch64 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2023-03-21 15:23:57 +01:00
Victor
56613517fb
HBASE-27684: add client metrics related to user region lock. (#5081) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Rushabh Shah <shahrs87@apache.org>
Signed-off-by: Tanuj Khurana <tkhurana@apache.org>
 2023-03-20 22:37:05 -07:00
Nick Dimiduk
85b599b96a HBASE-27651 hbase-daemon.sh foreground_start should propagate SIGHUP and SIGTERM 
Introduce separate `trap`s for SIGHUP vs. the rest. Treat `SIGINT`, `SIGKILL`, and `EXIT` identically, as before. Use the signal name without `SIG` prefix for increased portability, as per the POSIX man page for `trap`.

`SIGTERM` handler will now honor `HBASE_STOP_TIMEOUT` as described in the file header.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2023-03-20 15:37:01 +01:00
Xiaolin Ha
0bc7f56a00
HBASE-27646 Should not use pread when prefetching in HFilePreadReader (#5063) (#5124) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-20 19:26:47 +08:00
chaijunjie0101
c0760d39dc HBASE-27718 The regionStateNode only need remove once in regionOffline (#5106) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e6977a95975580831a31d122c800d01cadac007a)
 2023-03-19 20:19:48 +08:00
slfan1989
e68d0cf159 HBASE-27729. Missed one parameter when logging exception in StoreFileListFile. (#5114) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 3c2c685892740af68428f8bb715ca4234b6ff320)
 2023-03-19 20:05:55 +08:00
Nihal Jain
620ab79b59
HBASE-27671 Client should not be able to restore/clone a snapshot after it has TTL expired it's TTL has expired (#5117) ( #5109) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-03-18 00:08:34 -07:00
Bryan Beaudreault
29c3230da7 HBASE-27710 ByteBuff ref counting is too expensive for on-heap buffers (#5115) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-17 15:25:06 -04:00
Nick Dimiduk
4156139fda HBASE-27708 CPU hot-spot resolving User subject 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-16 13:57:13 +01:00
Nick Dimiduk
d151af1663
HBASE-27652 Client-side lock contention around Configuration when using read replica regions 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-15 16:08:19 +01:00
Duo Zhang
ffff78a00d HBASE-27714 WALEntryStreamTestBase creates a new HBTU in startCluster method which causes all sub classes are testing default configurations (#5101) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit ce7b1d4e4ff2b5456c8655558378a127f3274107)
 2023-03-15 10:55:48 +08:00
alan.zhao
becbc3f8b2 HBASE-27688 HFile splitting occurs during bulkload, the CREATE_TIME_TS of hfileinfo is 0 (#5097) 
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 6920e72f50b35eea79921f20dbe6a15f5cfdf492)
 2023-03-15 08:21:39 +08:00
Horváth Dóra
37a8e5b1c2 HBASE-27685 Enable code coverage reporting to SonarQube in HBase (#5076) 
(cherry picked from commit 72d5a46899ef0866d777f0a9508649beed6d8dd3)
 2023-03-10 20:29:02 +01:00
Rajeshbabu Chintaguntla
ab8aa62030 HBASE-27669 chaos-daemon.sh should make use hbase script start/stop chaosagent and chaos monkey runner (#5078) 
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc8b13e468a258b4ee47e40cf3645bf27d66471d)
 2023-03-09 10:58:07 +08:00
huaxiangsun
6e31c18bf2 HBASE-27250 MasterRpcService#setRegionStateInMeta does not support replica region encodedNames or region names 
- Added sanity check to make sure input region encoded name or region name is valid
- Assignment improvements pertaining to read replica regions
- make several MetaTableAccessor methods more precise in their handling of replica regions
- hbck2 setRegionStateInMeta and HBCKServerCrashProcedure handle read replicas
- separate AM helper methods -- loading RegionInfo from cache vs. refreshing cache from meta
- AM helper method support loading RegionInfo from cache via either region name and encoded region
  name (both caches are maintained, and under lock)
- consolidate, extend tests to cover read replica regions

Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
Co-authored-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2023-03-08 14:41:48 +01:00
haxiaolin
2cdcab2b9c Revert "HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#4536) (#5086)" 
This reverts commit 1ac7bbc8f37492c310262548e348632ff271ec81.
 2023-03-06 18:02:34 +08:00
Xiaolin Ha
1ac7bbc8f3
HBASE-25709 Close region may stuck when region is compacting and skipped most cells read (#4536) (#5086) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-06 14:20:57 +08:00
Xiaolin Ha
6d463f7aab
HBASE-27672 Read RPC threads may BLOCKED at the Configuration.get when using java compression (#5075) (#5084) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-06 12:53:47 +08:00