Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
18,303 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

18303 Commits

Author SHA1 Message Date
Rishabh Murarka 912b6d18c0 HBASE-27726 Handling of ruby shell SyntaxError exceptions (#5147) 
Co-authored-by: Rishabh Murarka <rmurarka@visa.com>
 2023-03-29 14:33:24 +05:30
dependabot[bot] b0b03732d3 HBASE-27748 Bump jettison from 1.5.2 to 1.5.4 (#5136) 
Bumps [jettison](https://github.com/jettison-json/jettison) from 1.5.2 to 1.5.4.
- [Release notes](https://github.com/jettison-json/jettison/releases)
- [Commits](https://github.com/jettison-json/jettison/compare/jettison-1.5.2...jettison-1.5.4)

---
updated-dependencies:
- dependency-name: org.codehaus.jettison:jettison
  dependency-type: direct:production
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 735fb43388)
 2023-03-24 21:57:08 +08:00
Duo Zhang e95b47e856 HBASE-27732 NPE in TestBasicWALEntryStreamFSHLog.testEOFExceptionInOldWALsDirectory (#5119) 
Add a 'closed' flag in WALProps in AbstractFSWAL to indicate that whether a WAL
file has been closed, if not, we will not try to archive it. Will mark it as
closed after we fully close it in the background close task, and try to archive
again.

Also modified some tests since now the archiving of a rolled WAL file is also
asynchronous, we need to wait instead of asserting directly.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 230fdc0b50)
 2023-03-24 17:59:21 +08:00
Duo Zhang 00fc40ab9b HBASE-26866 Shutdown WAL may abort region server (#4254) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit b67c16a763)
 2023-03-24 16:09:03 +08:00
Xiaolin Ha 007eacc69e HBASE-26526 Introduce a timeout to shutdown of WAL (#3297) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
(cherry picked from commit ca3ba494cb)
 2023-03-24 16:08:41 +08:00
Nick Dimiduk 39c4d01c87 HBASE-27741 Fall back to protoc osx-x86_64 on Apple Silicon 
Old protobuf-2.5 doesn't know about Apple Silicon. Fall back to the x86 binary and hope that
rosetta continues to work.

https://cwiki.apache.org/confluence/display/HADOOP/Develop+on+Apple+Silicon+%28M1%29+macOS

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2023-03-22 15:19:18 +01:00
Xiaolin Ha 8b0ae80da9 HBASE-27676 Scan handlers in the RPC executor should match at least one scan queues (#5074) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-22 08:11:30 +08:00
Victor de375bc6c8
HBASE-27684: add client metrics related to user region lock. (#5081) (#5133) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: David Manning <david.manning@salesforce.com>
Signed-off-by: Rushabh Shah <shahrs87@apache.org>
Signed-off-by: Tanuj Khurana <tkhurana@apache.org>
 2023-03-21 16:46:00 -07:00
xuzifu666 4ebf6c8d55 HBASE-27736 HFileSystem.getLocalFs is not used (#5125) 
Co-authored-by: xuyu <11161569@vivo.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit dd3b1630e8)
 2023-03-21 22:57:04 +08:00
Nihal Jain 7fa8f4d309
HBASE-27671 Client should not be able to restore/clone a snapshot after it has TTL expired it's TTL has expired (#5118) 2023-03-20 15:13:31 -07:00
Nick Dimiduk 5b50d70e40 HBASE-27651 hbase-daemon.sh foreground_start should propagate SIGHUP and SIGTERM 
Introduce separate `trap`s for SIGHUP vs. the rest. Treat `SIGINT`, `SIGKILL`, and `EXIT` identically, as before. Use the signal name without `SIG` prefix for increased portability, as per the POSIX man page for `trap`.

`SIGTERM` handler will now honor `HBASE_STOP_TIMEOUT` as described in the file header.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2023-03-20 15:37:31 +01:00
Xiaolin Ha fde0f4b5ee
HBASE-27646 Should not use pread when prefetching in HFilePreadReader (#5063) (#5123) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-03-20 19:26:32 +08:00
chaijunjie0101 7e1f243c4e HBASE-27718 The regionStateNode only need remove once in regionOffline (#5106) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e6977a9597)
 2023-03-19 20:19:55 +08:00
Bryan Beaudreault acda5b7f73 HBASE-27710 ByteBuff ref counting is too expensive for on-heap buffers (#5115) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-17 15:25:24 -04:00
Duo Zhang 5f2f73db80 HBASE-27714 WALEntryStreamTestBase creates a new HBTU in startCluster method which causes all sub classes are testing default configurations (#5101) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
(cherry picked from commit ce7b1d4e4f)
 2023-03-15 10:55:54 +08:00
alan.zhao 52d3824bd8 HBASE-27688 HFile splitting occurs during bulkload, the CREATE_TIME_TS of hfileinfo is 0 (#5097) 
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 6920e72f50)
 2023-03-15 08:21:49 +08:00
Horváth Dóra e2e7968cb1 HBASE-27685 Enable code coverage reporting to SonarQube in HBase (#5076) 
(cherry picked from commit 72d5a46899)
 2023-03-10 21:40:57 +01:00
Rajeshbabu Chintaguntla ad90a7b046 HBASE-27669 chaos-daemon.sh should make use hbase script start/stop chaosagent and chaos monkey runner (#5078) 
Co-authored-by: Rajeshbabu Chintaguntla <rchintag@visa.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc8b13e468)
 2023-03-09 10:58:15 +08:00
alan.zhao 11d3a9d61b HBASE-27670 Improve FSUtils to directly obtain FSDataOutputStream (#5064) 
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 59fdaa28f7)
 2023-03-04 22:39:10 +08:00
Ruanhui 1ea4473cba
HBASE-27458 Use ReadWriteLock for region scanner readpoint map (#5068) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-03-02 11:24:58 +08:00
Yuta Imazu 3fab7b3f29 HBASE-24781 Clean up peer metrics when disabling peer (#4997) 
Co-authored-by: Yuta Imazu <yuta.imazu@linecorp.com>
Signed-off-by: Duo Zhang <zhangduo@apache.or
(cherry picked from commit ef6a1130d0)
 2023-02-28 13:35:21 +08:00
Bryan Beaudreault 4b30d41672 HBASE-27650 Merging empty regions corrupts meta cache (branch-2) (#5038) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-27 21:15:37 -05:00
Duo Zhang 890c89b5c0 HBASE-27668 PB's parseDelimitedFrom can successfully return when there are not enough bytes (#5059) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit d1fede72c3)
 2023-02-28 10:07:32 +08:00
Victor 426425944e
HBASE-15242: add client side metrics for timeout and remote exceptions. (#5023) (#5054) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2023-02-27 10:16:17 -08:00
Duo Zhang 22093cb442 HBASE-27644 Should not return false when WALKey has no following KVs while reading WAL file (#5032) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
(cherry picked from commit 4a9cf99b2f)

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplit.java
 2023-02-26 16:32:44 +08:00
tianhang c49b5e7acc HBASE-27661 Set size of systable queue in UT (#5053) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit bc31e68e85)
 2023-02-25 23:38:34 +08:00
Kerasone 44c4e90b33 HBASE-27636 The "CREATE_TIME_TS" value of the hfile generated by the HFileOutputFormat2 class is 0 (#5034) 
Co-authored-by: selina.yan <selina.yan@huolala.cn>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 5f0dcdd121)
 2023-02-18 10:48:33 +08:00
Bryan Beaudreault 1b8434b232 HBASE-27648 CopyOnWriteArrayMap does not honor contract of ConcurrentMap.putIfAbsent (#5031) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-17 19:19:24 -05:00
tianhang d3c5e1db0c HBASE-27645 [JDK17] Use ReflectionUtils#getModifiersField in UT (#5029) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 3b8d7ad512)
 2023-02-17 21:18:09 +08:00
tianhang 41427cfd74 HBASE-27643 [JDK17] Add-opens java.util.concurrent (#5028) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit a1cf0731e3)
 2023-02-17 21:17:36 +08:00
Xiaolin Ha 2dd582ccc4
HBASE-21521 Expose master startup status via web UI (#4788) (#5021) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-02-14 15:07:47 +08:00
Peter Somogyi 6c5c65a342 HBASE-27590 Change Iterable to List in SnapshotFileCache (#4995) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit d2c5af11ea)
 2023-02-13 14:38:13 +01:00
Peter Somogyi c580835860
HBASE-27629 Let lock wait timeout to improve performance of SnapshotHFileCleaner (#5020) 
Backport of HBASE-27043

Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-13 14:00:14 +01:00
Duo Zhang 8df32127ef HBASE-27621 Also clear the Dictionary when resetting when reading compressed WAL file (#5016) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
(cherry picked from commit 833b10e8ba)
 2023-02-11 20:20:02 +08:00
tianhang af6b63a14a HBASE-27602 Remove the impact of operating env on testHFileCleaning (#5003) 
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit e71253f4d8)
 2023-02-11 19:41:55 +08:00
Nihal Jain 9236242dac HBASE-27626 Suppress noisy logging in client.ConnectionImplementation (#5019) 
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
 2023-02-09 10:31:58 -08:00
Peter Somogyi 1843cefa98
HBASE-27627 Improve efficiency of SnapshotHFileCleaner (#5017) 
Backport of HBASE-25899

Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
 2023-02-09 19:07:56 +01:00
Peter Somogyi 0978630e22 HBASE-27628 Spotless fix in RELEASENOTES.md (#5018) 2023-02-09 17:32:34 +01:00
Bryan Beaudreault 447846dab7 HBASE-27580 Reverse scan over rows with tags throw exceptions when using DataBlockEncoding (#5006) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-04 12:20:31 -05:00
Duo Zhang 2729e148d4 HBASE-27608 Use lowercase image reference name in our docker file (#5005) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
(cherry picked from commit bbc20f3611)
 2023-02-03 11:39:40 +08:00
Duo Zhang b4ad7d0bd5 Preparing development version 2.4.17-SNAPSHOT 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-01 09:36:56 +00:00
Duo Zhang d171471087 Preparing hbase release 2.4.16RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-01 09:36:51 +00:00
Duo Zhang c4eb3e5b8d Preparing development version 2.4.17-SNAPSHOT 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-01 06:22:50 +00:00
Duo Zhang c9c07b3506 Preparing hbase release 2.4.16RC1; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-02-01 06:22:46 +00:00
Duo Zhang 4124bc92d4 Revert "HBASE-27585 Bump up jruby to 9.3.9.0 and related joni and jcodings to 2.1.43 and 1.0.57 respectively (#4992)" 
This reverts commit 2e727a859b.
 2023-02-01 11:41:47 +08:00
tianhang 902f5e2122 HBASE-27581 [JDK17] Fix failure TestHBaseTestingUtil#testResolvePortConflict (#4991) 
Co-authored-by: tianhang.tang <tianhang.tang@shopee.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 8e72cc6ee0)
 2023-01-31 11:20:59 +08:00
Duo Zhang 40c266c53d Preparing development version 2.4.17-SNAPSHOT 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-01-30 07:29:04 +00:00
Duo Zhang b91e903536 Preparing hbase release 2.4.16RC0; tagging and updates to CHANGES.md and RELEASENOTES.md 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-01-30 07:28:58 +00:00
chaijunjie0101 32fe73eea4 HBASE-26967 FilterList with FuzzyRowFilter and SingleColumnValueFilter evaluated with operator MUST_PASS_ONE doesn't work as expected(#4820) 
Close #4820

Co-authored-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 382681e2d6)
 2023-01-29 17:40:07 +08:00
EungsopYoo 93ad9c4114 HBASE-27547 Close store file readers after region warmup (#4942) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
(cherry picked from commit 45fd3f628a)
 2023-01-28 23:40:57 +08:00