Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,319 Commits 95 Branches 866 Tags
Commit Graph

18319 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Nick Dimiduk
c02eb87239 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (addendum for branch-2.4,5) 2023-05-01 17:45:58 +02:00
Nick Dimiduk
ed76779b90 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (addendum) 
Make use of `%notEmpty` pattern with MDC logging. Will function as expected once we upgrade to
Log4J 2.21.0+.
 2023-05-01 17:45:58 +02:00
Nick Dimiduk
1d3d900957 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (#5145) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-05-01 17:45:58 +02:00
Duo Zhang
a417e5e61e HBASE-27819 10k RpcServer.MAX_REQUEST_SIZE is not enough in ReplicationDroppedTable related tests (#5208) 
Also modified the tests so we will only start the cluster once instead
of start it in setUpBeforeClass and then restart it when running the
actual test method

Signed-off-by: Liangjun He <heliangjun@apache.org>
(cherry picked from commit 21d61cfa1c469c31041151481d6b5c5381393599)
 2023-05-01 21:47:47 +08:00
Duo Zhang
34b5d64ae0 HBASE-27818 Split TestReplicationDroppedTables (#5206) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 1ced254b8d1208f543f936d477ff751b06e2ab73)
 2023-04-28 10:00:21 +08:00
Nihal Jain
14bee69f77 HBASE-20804 Document and add tests for HBaseConfTool (#5190) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e86f9308944bd57f34da64746adfda75f093b825)
 2023-04-23 23:43:52 +08:00
haosen chen
0e224b1ef6 HBASE-27807 PressureAwareCompactionThroughputController#tune log the opposite of the actual scenario (#5198) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 95f83cb8e242f5d8b9fb55b9d406c3ba54b5cb92)
 2023-04-23 23:34:25 +08:00
Kota-SH
81671f2b3f HBASE-27422: Support replication for hbase:acl (#4827) 
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>

(cherry-picked from commit 856fa145372b85e7f600f7c959b69ee62702dfb1)
 2023-04-14 10:55:17 +01:00
Bryan Beaudreault
6b6902d2b9 HBASE-27768 Race conditions in BlockingRpcConnection (#5154) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2023-04-10 15:30:03 -04:00
tianhang
c1743794ac HBASE-27713 Remove numRegions in Region Metrics (#5107) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 251e4984776e2ee13ae4df1de4c000f35a58ad59)
 2023-04-08 15:09:45 +08:00
Nick Dimiduk
34e05b7ce4 HBASE-27720 TestClusterRestartFailover is flakey due to metrics assertion (#5110) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit f36587c6486468f6b19f7419c9a263ed81d8bdc7)
 2023-04-08 11:05:48 +08:00
chenglei
dbb222cad4
HBASE-27778 Incorrect ReplicationSourceWALReader.totalBufferUsed may cause replication hang up (#5163) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-07 16:45:01 +08:00
Bryan Beaudreault
67db87d879 HBASE-27704 Quotas can drastically overflow configured limit (#5153) 
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-04-03 17:12:43 -04:00
Bryan Beaudreault
dedf1f9fbe HBASE-27758 Inconsistent synchronization in MetricsUserSourceImpl (#5149) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-03 17:12:39 -04:00
Tak Lon (Stephen) Wu
cc57d676cd Preparing development version 2.4.18-SNAPSHOT 
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
 2023-03-31 18:03:45 +00:00
Tak Lon (Stephen) Wu
7fd096f39b Preparing hbase release 2.4.17RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
2.4.17RC0 rel/2.4.17 		2023-03-31 18:03:27 +00:00
Rishabh Murarka
912b6d18c0 HBASE-27726 Handling of ruby shell SyntaxError exceptions (#5147) 
Co-authored-by: Rishabh Murarka <rmurarka@visa.com>
 2023-03-29 14:33:24 +05:30
dependabot[bot]
b0b03732d3 HBASE-27748 Bump jettison from 1.5.2 to 1.5.4 (#5136) 
Bumps [jettison](https://github.com/jettison-json/jettison) from 1.5.2 to 1.5.4.
- [Release notes](https://github.com/jettison-json/jettison/releases)
- [Commits](https://github.com/jettison-json/jettison/compare/jettison-1.5.2...jettison-1.5.4)

---
updated-dependencies:
- dependency-name: org.codehaus.jettison:jettison
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 735fb4338876b8d7da9dcad7383bdf1fc9c90c87)
 2023-03-24 21:57:08 +08:00
Duo Zhang
e95b47e856 HBASE-27732 NPE in TestBasicWALEntryStreamFSHLog.testEOFExceptionInOldWALsDirectory (#5119) 
Add a 'closed' flag in WALProps in AbstractFSWAL to indicate that whether a WAL
file has been closed, if not, we will not try to archive it. Will mark it as
closed after we fully close it in the background close task, and try to archive
again.

Also modified some tests since now the archiving of a rolled WAL file is also
asynchronous, we need to wait instead of asserting directly.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 230fdc0b50578144d3e0916c33d4532bb8644763)
 2023-03-24 17:59:21 +08:00
Duo Zhang
00fc40ab9b HBASE-26866 Shutdown WAL may abort region server (#4254) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit b67c16a7636958970d37bfcd775fd55e8de98177)
 2023-03-24 16:09:03 +08:00
Xiaolin Ha
007eacc69e HBASE-26526 Introduce a timeout to shutdown of WAL (#3297) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit ca3ba494cbc322b0824d2d755bcf4191c3a525ed)
 2023-03-24 16:08:41 +08:00
Nick Dimiduk
39c4d01c87 HBASE-27741 Fall back to protoc osx-x86_64 on Apple Silicon 
Old protobuf-2.5 doesn't know about Apple Silicon. Fall back to the x86 binary and hope that
rosetta continues to work.

https://cwiki.apache.org/confluence/display/HADOOP/Develop+on+Apple+Silicon+%28M1%29+macOS

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2023-03-22 15:19:18 +01:00
Xiaolin Ha
8b0ae80da9 HBASE-27676 Scan handlers in the RPC executor should match at least one scan queues (#5074) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-22 08:11:30 +08:00
Victor
de375bc6c8
HBASE-27684: add client metrics related to user region lock. (#5081) (#5133) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Rushabh Shah <shahrs87@apache.org>
Signed-off-by: Tanuj Khurana <tkhurana@apache.org>
 2023-03-21 16:46:00 -07:00
xuzifu666
4ebf6c8d55 HBASE-27736 HFileSystem.getLocalFs is not used (#5125) 
Co-authored-by: xuyu <11161569@vivo.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit dd3b1630e848d34db432526dee86289439594510)
 2023-03-21 22:57:04 +08:00
Nihal Jain
7fa8f4d309
HBASE-27671 Client should not be able to restore/clone a snapshot after it has TTL expired it's TTL has expired (#5118) 2023-03-20 15:13:31 -07:00
Nick Dimiduk
5b50d70e40 HBASE-27651 hbase-daemon.sh foreground_start should propagate SIGHUP and SIGTERM 
Introduce separate `trap`s for SIGHUP vs. the rest. Treat `SIGINT`, `SIGKILL`, and `EXIT` identically, as before. Use the signal name without `SIG` prefix for increased portability, as per the POSIX man page for `trap`.

`SIGTERM` handler will now honor `HBASE_STOP_TIMEOUT` as described in the file header.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2023-03-20 15:37:31 +01:00
Xiaolin Ha
fde0f4b5ee
HBASE-27646 Should not use pread when prefetching in HFilePreadReader (#5063) (#5123) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-20 19:26:32 +08:00
chaijunjie0101
7e1f243c4e HBASE-27718 The regionStateNode only need remove once in regionOffline (#5106) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e6977a95975580831a31d122c800d01cadac007a)
 2023-03-19 20:19:55 +08:00
Bryan Beaudreault
acda5b7f73 HBASE-27710 ByteBuff ref counting is too expensive for on-heap buffers (#5115) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-17 15:25:24 -04:00
Duo Zhang
5f2f73db80 HBASE-27714 WALEntryStreamTestBase creates a new HBTU in startCluster method which causes all sub classes are testing default configurations (#5101) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit ce7b1d4e4ff2b5456c8655558378a127f3274107)
 2023-03-15 10:55:54 +08:00
alan.zhao
52d3824bd8 HBASE-27688 HFile splitting occurs during bulkload, the CREATE_TIME_TS of hfileinfo is 0 (#5097) 
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 6920e72f50b35eea79921f20dbe6a15f5cfdf492)
 2023-03-15 08:21:49 +08:00
Horváth Dóra
e2e7968cb1 HBASE-27685 Enable code coverage reporting to SonarQube in HBase (#5076) 
(cherry picked from commit 72d5a46899ef0866d777f0a9508649beed6d8dd3)
 2023-03-10 21:40:57 +01:00
Rajeshbabu Chintaguntla
ad90a7b046 HBASE-27669 chaos-daemon.sh should make use hbase script start/stop chaosagent and chaos monkey runner (#5078) 
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc8b13e468a258b4ee47e40cf3645bf27d66471d)
 2023-03-09 10:58:15 +08:00
alan.zhao
11d3a9d61b HBASE-27670 Improve FSUtils to directly obtain FSDataOutputStream (#5064) 
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 59fdaa28f726dcd65fbfb58f9ea6aa499f2a903c)
 2023-03-04 22:39:10 +08:00
Ruanhui
1ea4473cba
HBASE-27458 Use ReadWriteLock for region scanner readpoint map (#5068) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-02 11:24:58 +08:00
Yuta Imazu
3fab7b3f29 HBASE-24781 Clean up peer metrics when disabling peer (#4997) 
Co-authored-by: Yuta Imazu <yuta.imazu@linecorp.com>
Signed-off-by: Duo Zhang <zhangduo@apache.or
(cherry picked from commit ef6a1130d0f1a186b1d31f11be26ec95e3588ae2)
 2023-02-28 13:35:21 +08:00
Bryan Beaudreault
4b30d41672 HBASE-27650 Merging empty regions corrupts meta cache (branch-2) (#5038) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-27 21:15:37 -05:00
Duo Zhang
890c89b5c0 HBASE-27668 PB's parseDelimitedFrom can successfully return when there are not enough bytes (#5059) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit d1fede72c340f6eeb145410e88b089e636fd6f5e)
 2023-02-28 10:07:32 +08:00
Victor
426425944e
HBASE-15242: add client side metrics for timeout and remote exceptions. (#5023) (#5054) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-02-27 10:16:17 -08:00
Duo Zhang
22093cb442 HBASE-27644 Should not return false when WALKey has no following KVs while reading WAL file (#5032) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 4a9cf99b2f8cd2fa646a5c43280e2d91d2dccafd)

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplit.java
 2023-02-26 16:32:44 +08:00
tianhang
c49b5e7acc HBASE-27661 Set size of systable queue in UT (#5053) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc31e68e857c5bb51b7de77c2f5c2e06153d0cd1)
 2023-02-25 23:38:34 +08:00
Kerasone
44c4e90b33 HBASE-27636 The "CREATE_TIME_TS" value of the hfile generated by the HFileOutputFormat2 class is 0 (#5034) 
Co-authored-by: selina.yan <selina.yan@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5f0dcdd121833e7665633aabc7706ae1b18f8672)
 2023-02-18 10:48:33 +08:00
Bryan Beaudreault
1b8434b232 HBASE-27648 CopyOnWriteArrayMap does not honor contract of ConcurrentMap.putIfAbsent (#5031) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-17 19:19:24 -05:00
tianhang
d3c5e1db0c HBASE-27645 [JDK17] Use ReflectionUtils#getModifiersField in UT (#5029) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 3b8d7ad51219c98d586b31c02dd58aaa8a7696cf)
 2023-02-17 21:18:09 +08:00
tianhang
41427cfd74 HBASE-27643 [JDK17] Add-opens java.util.concurrent (#5028) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a1cf0731e362a22cdde4a2085c724891a8051494)
 2023-02-17 21:17:36 +08:00
Xiaolin Ha
2dd582ccc4
HBASE-21521 Expose master startup status via web UI (#4788) (#5021) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-02-14 15:07:47 +08:00
Peter Somogyi
6c5c65a342 HBASE-27590 Change Iterable to List in SnapshotFileCache (#4995) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d2c5af11ea46c86c592751608e44f563406aa4f3)
 2023-02-13 14:38:13 +01:00
Peter Somogyi
c580835860
HBASE-27629 Let lock wait timeout to improve performance of SnapshotHFileCleaner (#5020) 
Backport of HBASE-27043

Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-13 14:00:14 +01:00
Duo Zhang
8df32127ef HBASE-27621 Also clear the Dictionary when resetting when reading compressed WAL file (#5016) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 833b10e8bab7c28457caa854c0f714b489f88fa3)
 2023-02-11 20:20:02 +08:00