Commit Graph

19741 Commits

Author SHA1 Message Date
Duo Zhang 89e80da57f
HBASE-27823 NPE in ClaimReplicationQueuesProcedure when running TestAssignmentManager.testAssignSocketTimeout (#5216)
Also done some cleanup around the MockMasterServices related classes and tests

Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-05-04 20:59:07 +08:00
Duo Zhang b59eb96407
HBASE-27822 TestFromClientSide5.testAppendWithoutWAL is flaky (#5211)
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-05-04 20:58:38 +08:00
Duo Zhang 4e69921a00
HBASE-27821 Split TestFuzzyRowFilterEndToEnd (#5209)
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-05-04 20:58:20 +08:00
Nihal Jain 216cdf9f69
Add nihaljain to the developer list (#5219) 2023-05-03 19:57:54 +05:30
Duo Zhang 21d61cfa1c
HBASE-27819 10k RpcServer.MAX_REQUEST_SIZE is not enough in ReplicationDroppedTable related tests (#5208)
Also modified the tests so we will only start the cluster once instead
of start it in setUpBeforeClass and then restart it when running the
actual test method

Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-05-01 21:14:46 +08:00
Yash Dodeja 1f605cc642
HBASE-27693 Support for Hadoop's LDAP Authentication mechanism (#5144) 2023-04-28 23:58:36 +08:00
Andor Molnár a6e89bf624
HBASE-27810. Check if the executor has already been shut down before submitting new job (#5207)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-28 16:46:22 +02:00
Nick Dimiduk a2cfa6822a
HBASE-27808 Change flatten mode for oss in our pom file (#5201)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-28 11:38:15 +08:00
Duo Zhang 1ced254b8d
HBASE-27818 Split TestReplicationDroppedTables (#5206)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-04-28 09:58:05 +08:00
Duo Zhang 3593288d60
HBASE-27803 Update ref guide about the changes of the replication storage related concepts (#5199)
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-04-25 21:51:51 +08:00
Nihal Jain a1f2b4e1d0
HBASE-27792 Guard Master/RS Dump Servlet behind admin walls (#5176) 2023-04-25 09:42:01 +05:30
Nick Dimiduk 22164147d0 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (addendum)
Make use of `%notEmpty` pattern with MDC logging. Will function as expected once we upgrade to
Log4J 2.21.0+.
2023-04-24 17:55:18 +02:00
haosen chen 95f83cb8e2
HBASE-27807 PressureAwareCompactionThroughputController#tune log the opposite of the actual scenario (#5198)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-23 23:20:47 +08:00
Nihal Jain e86f930894
HBASE-20804 Document and add tests for HBaseConfTool (#5190)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-23 23:20:12 +08:00
Duo Zhang 18ae733b15
HBASE-27806 Support dynamic reinitializing replication peer storage (#5195)
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-04-23 22:25:31 +08:00
Ray Mattingly ced4ff1804
HBASE-27535: Separate slowlog thresholds for scans vs other requests (#5188)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-04-21 21:16:57 -07:00
chenglei 269586c4cf
HBASE-27785 Encapsulate and centralize totalBufferUsed in Replication… (#5168)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-21 20:59:16 +08:00
Duo Zhang f5ee958ead HBASE-27783 Addendum forward port the test improvement when backporting to branch-2 2023-04-20 15:25:59 +08:00
Duo Zhang 398c5ef313
HBASE-27783 Implement a shell command to disable all peer modification (#5182)
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-04-19 22:07:29 +08:00
Bryan Beaudreault 94a8f319bc
HBASE-27787 Downgrade noisy info log in NettyRpcConnection when TLS enabled (#5169)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-18 14:32:41 -04:00
Andrew Purtell d56e7f291f
HBASE-27796 Improve MemcachedBlockCache (#5181)
Track and log better stats.
Fix use of memcached API such that we are not accidentally immediately expiring keys.
Use a default retention period of 30 days, the max per memcached spec.
Use set instead of add to store keys.
Gracefully handle failures to cache and read timeouts.
Add unit tests using jmemcached as a test dependency.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-04-17 13:20:55 -07:00
Duo Zhang 31c4aea48c
HBASE-27728 Implement a tool to migrate replication peer data between different storage implementation (#5179)
Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-04-17 22:13:19 +08:00
Nick Dimiduk 63471efa25
HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (#5145)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-17 14:22:04 +02:00
Nihal Jain 24c471a0b3
HBASE-27791 Upgrade vega and its related js libraries (#5173)
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-04-17 12:46:07 +02:00
Ray Mattingly 2b098b0819
HBASE-27536: Include more request information in slowlog for Scans (#5155)
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-04-16 10:03:53 -04:00
Andrew Purtell 1e75a2a9a2 HBASE-27797 Update downloads.xml for release 2.5.4 2023-04-14 18:05:21 -07:00
Kota-SH 856fa14537
HBASE-27422: Support replication for hbase:acl (#4827)
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-04-14 10:19:29 +01:00
Duo Zhang a71105997f
HBASE-27727 Implement filesystem based Replication peer storage (#5165)
Signed-off-by: Liangjun He <heliangjun@apache.org>
2023-04-13 18:58:02 +08:00
Bryan Beaudreault e4b4cef80e
HBASE-27780 FileChangeWatcher improvements (#5164)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-08 10:23:55 -04:00
tianhang 251e498477
HBASE-27713 Remove numRegions in Region Metrics (#5107)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-08 11:02:39 +08:00
Nick Dimiduk f36587c648
HBASE-27720 TestClusterRestartFailover is flakey due to metrics assertion (#5110)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-08 11:02:09 +08:00
Tak Lon (Stephen) Wu 164b8e2600
HBASE-27772 Add 2.4.17 to download page (#5161)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-07 01:22:29 -07:00
chenglei a370099aaa
HBASE-27778 Incorrect ReplicationSourceWALReader.totalBufferUsed may … (#5158)
HBASE-27778 Incorrect ReplicationSourceWALReader.totalBufferUsed may cause replication hang up
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-06 21:14:33 +08:00
Yash Dodeja f27823e62d
HBASE-27662 Correct the line logged with flag hbase.procedure.upgrade-to-2-2 in docs (#5159)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-05 23:30:40 +08:00
bsglz a363b76d81
HBASE-27765 Add biggest cell related info into web ui (#5151)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-04-05 21:42:13 +08:00
Nick Dimiduk 308cdb08c7
HBASE-27774 Move Dockerfile and python-requirements.txt used only by flaky-tests job
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2023-04-04 13:35:16 +02:00
Bryan Beaudreault 143e9b4ff6
HBASE-27758 Inconsistent synchronization in MetricsUserSourceImpl (#5149)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-31 08:10:58 -04:00
Bryan Beaudreault e5620e26a2
HBASE-27756 Make request guardrail configs in RSRpcServices live updatable (#5141)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-03-29 16:20:29 -04:00
Bryan Beaudreault c52f4b286c
HBASE-27704 Quotas can drastically overflow configured limit (#5099)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-03-29 16:19:13 -04:00
Rishabh Murarka efb360d33f
HBASE-27726 Handling of ruby shell SyntaxError exceptions (#5147)
Co-authored-by: Rishabh Murarka <rmurarka@visa.com>
2023-03-28 16:45:47 +05:30
Xiaolin Ha f5437b9ceb
HBASE-27333 Abort RS when the hostname is different from master seen (#4732)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2023-03-28 15:17:16 +08:00
Bryan Beaudreault c825c960d6
HBASE-27532 Add block bytes scanned metrics (#5067)
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
2023-03-27 16:03:15 -04:00
Kota-SH a6dad700db
HBASE-27750: Update the list of prefetched Hfiles upon block eviction (#5140)
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2023-03-27 10:49:55 +01:00
dependabot[bot] 735fb43388 HBASE-27748 Bump jettison from 1.5.2 to 1.5.4 (#5136)
Bumps [jettison](https://github.com/jettison-json/jettison) from 1.5.2 to 1.5.4.
- [Release notes](https://github.com/jettison-json/jettison/releases)
- [Commits](https://github.com/jettison-json/jettison/compare/jettison-1.5.2...jettison-1.5.4)

---
updated-dependencies:
- dependency-name: org.codehaus.jettison:jettison
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-24 21:55:02 +08:00
Duo Zhang de91a8d83a Revert "Bump jettison from 1.5.2 to 1.5.4 (#5136)"
This reverts commit 6cc6182646.
2023-03-24 21:54:53 +08:00
dependabot[bot] 6cc6182646
Bump jettison from 1.5.2 to 1.5.4 (#5136)
Bumps [jettison](https://github.com/jettison-json/jettison) from 1.5.2 to 1.5.4.
- [Release notes](https://github.com/jettison-json/jettison/releases)
- [Commits](https://github.com/jettison-json/jettison/compare/jettison-1.5.2...jettison-1.5.4)

---
updated-dependencies:
- dependency-name: org.codehaus.jettison:jettison
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-24 21:54:23 +08:00
Duo Zhang 230fdc0b50
HBASE-27732 NPE in TestBasicWALEntryStreamFSHLog.testEOFExceptionInOldWALsDirectory (#5119)
Add a 'closed' flag in WALProps in AbstractFSWAL to indicate that whether a WAL
file has been closed, if not, we will not try to archive it. Will mark it as
closed after we fully close it in the background close task, and try to archive
again.

Also modified some tests since now the archiving of a rolled WAL file is also
asynchronous, we need to wait instead of asserting directly.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
2023-03-24 14:17:39 +08:00
Andrew Purtell 3e08f9230c
HBASE-27744 Update compression dependencies (#5137)
Update compression codec dependencies:

 - aircompressor 0.21 -> 0.24
 - brotli4j 1.8.0 -> 1.11.0
 - snappy 1.1.8.4 -> 1.1.9.1
 - zstd-jni 1.5.0-4 -> 1.5.4-2

and add a new supplemental model for new brotli4j dependency.

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2023-03-23 13:05:55 -07:00
Peter Somogyi 18ba51afcb
HBASE-27745 Document protoc workarounds with Apple Silicon (#5139)
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2023-03-23 17:19:35 +01:00
Xiaolin Ha 7d6a79b768
HBASE-27676 Scan handlers in the RPC executor should match at least one scan queues (#5074)
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
2023-03-22 08:07:31 +08:00