Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,715 Commits 95 Branches 866 Tags
Commit Graph

18715 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Duo Zhang
1df5e40f73 HBASE-27823 Addendum fix compile error 2023-05-04 23:03:26 +08:00
Duo Zhang
558913ea1a HBASE-27823 NPE in ClaimReplicationQueuesProcedure when running TestAssignmentManager.testAssignSocketTimeout (#5216) 
Also done some cleanup around the MockMasterServices related classes and tests

Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 89e80da57f29b501ffe9ca852bca8dcd3462ef86)
 2023-05-04 22:35:15 +08:00
Duo Zhang
438d93b30f HBASE-27822 TestFromClientSide5.testAppendWithoutWAL is flaky (#5211) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit b59eb9640749bfb1bc22bbcb4a36921b79ad176f)
 2023-05-04 22:24:56 +08:00
Duo Zhang
835077fa35 HBASE-27821 Split TestFuzzyRowFilterEndToEnd (#5209) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 4e69921a001decc73a3fb0bc0d7e94789b440afb)
 2023-05-04 22:05:42 +08:00
Duo Zhang
bf20017148
HBASE-27806 Addendum fix error prone error (#5214) 2023-05-03 19:52:01 +08:00
Nick Dimiduk
b776c121d0 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (addendum) 
Make use of `%notEmpty` pattern with MDC logging. Will function as expected once we upgrade to
Log4J 2.21.0+.
 2023-05-01 17:45:05 +02:00
Nick Dimiduk
da81079365 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (#5145) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-05-01 17:45:05 +02:00
Duo Zhang
ce4a2bf77f HBASE-27819 10k RpcServer.MAX_REQUEST_SIZE is not enough in ReplicationDroppedTable related tests (#5208) 
Also modified the tests so we will only start the cluster once instead
of start it in setUpBeforeClass and then restart it when running the
actual test method

Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 21d61cfa1c469c31041151481d6b5c5381393599)
 2023-05-01 21:22:09 +08:00
Andor Molnár
de3d0aefe1 HBASE-27810. Check if the executor has already been shut down before submitting new job (#5207) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a6e89bf624d70a7f220f961e4f8808374400d774)
 2023-04-28 16:47:29 +02:00
Nihal Jain
adfcea8073 HBASE-27792 Guard Master/RS Dump Servlet behind admin walls (#5176) 2023-04-28 19:39:03 +05:30
Nick Dimiduk
0fb5053a43 HBASE-27808 Change flatten mode for oss in our pom file (#5201) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a2cfa6822ae84b0a87d5e90c5e588cb900852eba)
 2023-04-28 11:40:13 +08:00
Duo Zhang
aa7486d598 HBASE-27818 Split TestReplicationDroppedTables (#5206) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 1ced254b8d1208f543f936d477ff751b06e2ab73)
 2023-04-28 10:00:02 +08:00
Nihal Jain
7434374900 HBASE-20804 Document and add tests for HBaseConfTool (#5190) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e86f9308944bd57f34da64746adfda75f093b825)
 2023-04-23 23:43:35 +08:00
haosen chen
157df067a4 HBASE-27807 PressureAwareCompactionThroughputController#tune log the opposite of the actual scenario (#5198) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 95f83cb8e242f5d8b9fb55b9d406c3ba54b5cb92)
 2023-04-23 23:34:08 +08:00
Duo Zhang
fe2992a312 HBASE-27806 Support dynamic reinitializing replication peer storage (#5195) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 18ae733b15ae2bc316f41af1a46e5619d2b35fe2)
 2023-04-23 23:15:27 +08:00
Ray Mattingly
e9ffc1b07e
HBASE-27535: Separate slowlog thresholds for scans vs other requests (#5188) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-04-21 21:20:04 -07:00
chenglei
0787199feb
HBASE-27785 Encapsulate and centralize totalBufferUsed in ReplicationSourceManager (#5196) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-21 21:52:40 +08:00
Duo Zhang
92a2868f37
HBASE-27783 Implement a shell command to disable all peer modification (#5182)(#5191) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-04-21 09:57:28 +08:00
Bryan Beaudreault
2ad3a804c8 HBASE-27787 Downgrade noisy info log in NettyRpcConnection when TLS enabled (#5169) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-18 14:33:29 -04:00
Nihal Jain
f6900f8c63 HBASE-27791 Upgrade vega and its related js libraries (#5173) 
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-04-18 12:15:07 +02:00
Andrew Purtell
95c72bf38c HBASE-27796 Improve MemcachedBlockCache (#5181) 
Track and log better stats.
Fix use of memcached API such that we are not accidentally immediately expiring keys.
Use a default retention period of 30 days, the max per memcached spec.
Use set instead of add to store keys.
Gracefully handle failures to cache and read timeouts.
Add unit tests using jmemcached as a test dependency.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-04-17 14:13:04 -07:00
Duo Zhang
04a4ac5ae9 HBASE-27728 Implement a tool to migrate replication peer data between different storage implementation (#5179) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 31c4aea48c3d4bc7585784dd65375edbb4e61a8a)

Conflicts:
	hbase-client/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationPeerConfig.java
	hbase-replication/src/test/java/org/apache/hadoop/hbase/replication/ReplicationPeerStorageTestBase.java
 2023-04-17 22:47:52 +08:00
Ray Mattingly
1ae057b89f
HBASE-27536: Include more request information in slowlog for Scans (#5166) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-04-16 10:11:35 -04:00
Kota-SH
b75c72d925 HBASE-27422: Support replication for hbase:acl (#4827) 
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>

(cherry picked from commit 856fa145372b85e7f600f7c959b69ee62702dfb1)
 2023-04-14 10:27:19 +01:00
Duo Zhang
3e6e9c5cca HBASE-27727 Implement filesystem based Replication peer storage (#5165) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit a71105997f2c08c74f3713925847cce3d44134bc)
 2023-04-13 19:45:20 +08:00
Bryan Beaudreault
08489365a5
HBASE-27768 Race conditions in BlockingRpcConnection (#5154) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2023-04-10 15:23:03 -04:00
Bryan Beaudreault
a67a8f7fd3 HBASE-27780 FileChangeWatcher improvements (#5164) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-08 10:25:32 -04:00
tianhang
6305c7a4f2 HBASE-27713 Remove numRegions in Region Metrics (#5107) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 251e4984776e2ee13ae4df1de4c000f35a58ad59)
 2023-04-08 15:09:25 +08:00
Nick Dimiduk
f8c234e8d0 HBASE-27720 TestClusterRestartFailover is flakey due to metrics assertion (#5110) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f36587c6486468f6b19f7419c9a263ed81d8bdc7)
 2023-04-08 11:05:33 +08:00
chenglei
62ea717b31
HBASE-27778 Incorrect ReplicationSourceWALReader. totalBufferUsed may cause replication hang up (#5160) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-06 21:37:10 +08:00
bsglz
85793655d3 HBASE-27765 Add biggest cell related info into web ui (#5151) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a363b76d815a71c4acd96abca1a2578af57ede78)
 2023-04-05 23:18:13 +08:00
Bryan Beaudreault
cc00b8b8a8 HBASE-27758 Inconsistent synchronization in MetricsUserSourceImpl (#5149) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-31 09:17:30 -04:00
Bryan Beaudreault
9f4b31e619
HBASE-27704 Quotas can drastically overflow configured limit (#5153) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-03-30 09:13:00 -04:00
Bryan Beaudreault
e77e3ffa8f
HBASE-27756 Make request guardrail configs in RSRpcServices live updatable (#5152) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-03-30 09:12:26 -04:00
Rishabh Murarka
753eaefa29 HBASE-27726 Handling of ruby shell SyntaxError exceptions (#5147) 
Co-authored-by: Rishabh Murarka <rmurarka@visa.com>
 2023-03-29 14:23:15 +05:30
Xiaolin Ha
45e3451997
HBASE-27333 Abort RS when the hostname is different from master seen (#4732) (#5148) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-03-29 11:42:32 +08:00
Bryan Beaudreault
e33afb4524
HBASE-27532 Add block bytes scanned metrics (#5146) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2023-03-28 13:56:37 -04:00
Kota-SH
61e18a3d6c HBASE-27750: Update the list of prefetched Hfiles upon block eviction (#5140) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-03-27 10:57:57 +01:00
dependabot[bot]
6d9ac13f80 HBASE-27748 Bump jettison from 1.5.2 to 1.5.4 (#5136) 
Bumps [jettison](https://github.com/jettison-json/jettison) from 1.5.2 to 1.5.4.
- [Release notes](https://github.com/jettison-json/jettison/releases)
- [Commits](https://github.com/jettison-json/jettison/compare/jettison-1.5.2...jettison-1.5.4)

---
updated-dependencies:
- dependency-name: org.codehaus.jettison:jettison
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 735fb4338876b8d7da9dcad7383bdf1fc9c90c87)
 2023-03-24 21:56:49 +08:00
Duo Zhang
17d15a135a HBASE-27732 NPE in TestBasicWALEntryStreamFSHLog.testEOFExceptionInOldWALsDirectory (#5119) 
Add a 'closed' flag in WALProps in AbstractFSWAL to indicate that whether a WAL
file has been closed, if not, we will not try to archive it. Will mark it as
closed after we fully close it in the background close task, and try to archive
again.

Also modified some tests since now the archiving of a rolled WAL file is also
asynchronous, we need to wait instead of asserting directly.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 230fdc0b50578144d3e0916c33d4532bb8644763)
 2023-03-24 17:43:30 +08:00
Duo Zhang
3b24b3b969 HBASE-26866 Shutdown WAL may abort region server (#4254) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit b67c16a7636958970d37bfcd775fd55e8de98177)
 2023-03-24 15:59:29 +08:00
Xiaolin Ha
62fc8c81a3 HBASE-26526 Introduce a timeout to shutdown of WAL (#3297) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit ca3ba494cbc322b0824d2d755bcf4191c3a525ed)
 2023-03-24 15:58:49 +08:00
Andrew Purtell
dd3cdf13cf HBASE-27744 Update compression dependencies (#5137) 
Update compression codec dependencies:

 - aircompressor 0.21 -> 0.24
 - brotli4j 1.8.0 -> 1.11.0
 - snappy 1.1.8.4 -> 1.1.9.1
 - zstd-jni 1.5.0-4 -> 1.5.4-2

and add a new supplemental model for new brotli4j dependency.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-23 13:10:28 -07:00
Nick Dimiduk
29ca26a765
HBASE-27741 Fall back to protoc osx-x86_64 on Apple Silicon 
Old protobuf-2.5 doesn't know about Apple Silicon. Fall back to the x86 binary and hope that
rosetta continues to work.

https://cwiki.apache.org/confluence/display/HADOOP/Develop+on+Apple+Silicon+%28M1%29+macOS

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2023-03-22 14:24:07 +01:00
Xiaolin Ha
d4edfe404e HBASE-27676 Scan handlers in the RPC executor should match at least one scan queues (#5074) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-22 08:10:56 +08:00
xuzifu666
a10cbf8319 HBASE-27736 HFileSystem.getLocalFs is not used (#5125) 
Co-authored-by: xuyu <11161569@vivo.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit dd3b1630e848d34db432526dee86289439594510)
 2023-03-21 22:55:16 +08:00
Nick Dimiduk
29dfd005cf HBASE-27737 Add supplemental model for com.aayushatharva.brotli4j:native-osx-aarch64 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2023-03-21 15:23:43 +01:00
Victor
ff9754049b
HBASE-27684: add client metrics related to user region lock. (#5081) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Rushabh Shah <shahrs87@apache.org>
Signed-off-by: Tanuj Khurana <tkhurana@apache.org>
 2023-03-20 22:36:08 -07:00
Nick Dimiduk
e7a958a45f HBASE-27651 hbase-daemon.sh foreground_start should propagate SIGHUP and SIGTERM 
Introduce separate `trap`s for SIGHUP vs. the rest. Treat `SIGINT`, `SIGKILL`, and `EXIT` identically, as before. Use the signal name without `SIG` prefix for increased portability, as per the POSIX man page for `trap`.

`SIGTERM` handler will now honor `HBASE_STOP_TIMEOUT` as described in the file header.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2023-03-20 15:36:33 +01:00
Xiaolin Ha
873f8987f1
HBASE-27646 Should not use pread when prefetching in HFilePreadReader (#5063) (#5122) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-20 19:26:17 +08:00