Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
19,713 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

19713 Commits

Author SHA1 Message Date
Duo Zhang c01c8e45b4 HBASE-27392 Add a new procedure type for implementing some global operations such as migration (#4803) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
 2023-05-15 22:53:48 +08:00
Duo Zhang 7044150545 HBASE-27215 Add support for sync replication (#4762) 
Signed-off-by: Xiaolin Ha <haxiaolin@apache.org>
 2023-05-15 22:53:48 +08:00
Duo Zhang 6d0311c1d9 HBASE-27214 Implement the new replication hfile/log cleaner (#4722) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
 2023-05-15 22:53:48 +08:00
Duo Zhang f81bdebedb HBASE-27213 Add support for claim queue operation (#4708) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
 2023-05-15 22:53:48 +08:00
Duo Zhang e2d8db6dfc HBASE-27212 Implement a new table based replication queue storage and make the minimum replication system work (#4672) 
Signed-off-by: Xin Sun <ddupgs@gmail.com>
 2023-05-15 22:53:48 +08:00
Duo Zhang 8b8c684bcc
HBASE-27864 Reduce the Cardinality for TestFuzzyRowFilterEndToEndLarge (#5237) 
From 50^3 to 30^3, 125000 -> 27000

Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
 2023-05-15 10:35:40 +08:00
Duo Zhang fd4f984d87
HBASE-27865 TestThriftServerCmdLine fails with org.apache.hadoop.hbase.SystemExitRule (#5238) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Xin Sun <ddupgs@gmail.com>
 2023-05-15 10:35:24 +08:00
Duo Zhang b28feeb989
HBASE-27863 Add hadoop 3.3.5 check in our personality script (#5236) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-05-15 10:34:46 +08:00
Jonathan Albrecht 67612cc264
HBASE-27858 Update surefire version to 3.1.0 and use SurefireForkNodeFactory (#5234) 
Surefire version updated from 3.0.0-M6 -> 3.1.0.

SurefireForkNodeFactory is a new strategy to control how the forked
nodes communicate with the main maven process. It uses a tcp channel
instead of pipes and fixes some corrupted messages seen in the s390x
build.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-05-13 18:52:30 +08:00
Shuhei Yamasaki bee09bbd61
HBASE-27860 Fix build error against Hadoop 3.3.5 (#5233) 
Add packages for hadoop-3.3.5

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-05-13 08:56:37 +08:00
Jonathan Albrecht 220eacf7c5
HBASE-27857 Fix timeout exception handling in HBaseClassTestRule. (#5231) 
HBaseClassTestRule applies a timeout and a system exit rule to tests.
The timeout rule throws an exception if it hits the timeout threshold.
Since the timeout rule is applied after the system exit rule, the
system exit rule does not see the exception and does not re-enable
the system exit behavior which can cause maven to hang on some
tests.

This change applies the timeout rule before the system exit rule so
that normal system exit can be restored before the surefire forked
node is shutdown.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-05-13 08:54:50 +08:00
Kota-SH e343584b50
HBASE-27852: Interrupt BucketCachePersister thread when BucketCache is shutdown (#5230) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-05-12 10:43:27 +01:00
Jonathan Albrecht 55aff4ceef
HBASE-27851 Fix TestListTablesByState which is silently failing due to a surefire bug (#5227) 
surefire version 3.0.0-M6 has a bug where tests end up being removed from
the test results if they fail with a long exception message. See:

https://issues.apache.org/jira/browse/SUREFIRE-2079

TestListTablesByState is currently failing due to an error. However,
it is being missed because of the surefire bug. I found this while testing
the final surfire 3.0.0 version which fixes the bug and the test then
shows up as failing.

Co-authored-by: Jonathan Albrecht <jonathan.albrecht@ibm.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-05-11 23:08:12 +08:00
alan.zhao 5cea8112fd
HBASE-27733 hfile split occurs during bulkload, the new HFile file does not specify favored nodes (#5121) 
Co-authored-by: alanzhao <alanzhao@126.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-05-10 21:47:20 +08:00
bsglz 5d82d4f746
HBASE-27788 Skip family comparing when compare cells inner the store (#5171) 
* HBASE-27788 Skip family comparing when compare cells inner the store
 2023-05-10 10:15:07 +08:00
Ruanhui d49df8b7a9
HBASE-27844 changed type names to avoid conflicts with built-in types (#5223) 
Co-authored-by: huiruan <876107431@qq.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-05-08 21:32:21 +08:00
Kota-SH dca0622b62 HBASE-27752: Update the list of prefetched files upon region movement (#5194) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-05-05 09:55:17 +01:00
Wellington Ramos Chevreuil ab8880d3be Revert "HBASE-27752: Update the list of prefetched files upon region movement (#5194)" 
This reverts commit ece8d014af.
 2023-05-05 09:54:28 +01:00
Jonathan Albrecht 5d2b6956e5
HBASE-27838 Update zstd-jni from version 1.5.4-2 -> 1.5.5-2. (#5220) 
Note: This version includes a fix that prevented zstd-jni from
running on s390x.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-05-05 11:52:30 +08:00
Ray Mattingly bfdf1c049c
HBASE-27799: RpcThrottlingException wait interval message is misleading between 0-1s (#5192) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-05-04 14:12:11 -04:00
Kota-SH ece8d014af
HBASE-27752: Update the list of prefetched files upon region movement (#5194) 
Co-authored-by: Shanmukha Kota <skota@cloudera.com>
 2023-05-04 16:00:32 +01:00
Duo Zhang 78610decaa
HBASE-27824 NPE in MetricsMasterWrapperImpl.isRunning (#5218) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-05-04 20:59:40 +08:00
Duo Zhang 89e80da57f
HBASE-27823 NPE in ClaimReplicationQueuesProcedure when running TestAssignmentManager.testAssignSocketTimeout (#5216) 
Also done some cleanup around the MockMasterServices related classes and tests

Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-05-04 20:59:07 +08:00
Duo Zhang b59eb96407
HBASE-27822 TestFromClientSide5.testAppendWithoutWAL is flaky (#5211) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-05-04 20:58:38 +08:00
Duo Zhang 4e69921a00
HBASE-27821 Split TestFuzzyRowFilterEndToEnd (#5209) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-05-04 20:58:20 +08:00
Nihal Jain 216cdf9f69
Add nihaljain to the developer list (#5219) 2023-05-03 19:57:54 +05:30
Duo Zhang 21d61cfa1c
HBASE-27819 10k RpcServer.MAX_REQUEST_SIZE is not enough in ReplicationDroppedTable related tests (#5208) 
Also modified the tests so we will only start the cluster once instead
of start it in setUpBeforeClass and then restart it when running the
actual test method

Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-05-01 21:14:46 +08:00
Yash Dodeja 1f605cc642
HBASE-27693 Support for Hadoop's LDAP Authentication mechanism (#5144) 2023-04-28 23:58:36 +08:00
Andor Molnár a6e89bf624
HBASE-27810. Check if the executor has already been shut down before submitting new job (#5207) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-28 16:46:22 +02:00
Nick Dimiduk a2cfa6822a
HBASE-27808 Change flatten mode for oss in our pom file (#5201) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-28 11:38:15 +08:00
Duo Zhang 1ced254b8d
HBASE-27818 Split TestReplicationDroppedTables (#5206) 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-04-28 09:58:05 +08:00
Duo Zhang 3593288d60
HBASE-27803 Update ref guide about the changes of the replication storage related concepts (#5199) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-04-25 21:51:51 +08:00
Nihal Jain a1f2b4e1d0
HBASE-27792 Guard Master/RS Dump Servlet behind admin walls (#5176) 2023-04-25 09:42:01 +05:30
Nick Dimiduk 22164147d0 HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (addendum) 
Make use of `%notEmpty` pattern with MDC logging. Will function as expected once we upgrade to
Log4J 2.21.0+.
 2023-04-24 17:55:18 +02:00
haosen chen 95f83cb8e2
HBASE-27807 PressureAwareCompactionThroughputController#tune log the opposite of the actual scenario (#5198) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-23 23:20:47 +08:00
Nihal Jain e86f930894
HBASE-20804 Document and add tests for HBaseConfTool (#5190) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-23 23:20:12 +08:00
Duo Zhang 18ae733b15
HBASE-27806 Support dynamic reinitializing replication peer storage (#5195) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-04-23 22:25:31 +08:00
Ray Mattingly ced4ff1804
HBASE-27535: Separate slowlog thresholds for scans vs other requests (#5188) 
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-04-21 21:16:57 -07:00
chenglei 269586c4cf
HBASE-27785 Encapsulate and centralize totalBufferUsed in Replication… (#5168) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-21 20:59:16 +08:00
Duo Zhang f5ee958ead HBASE-27783 Addendum forward port the test improvement when backporting to branch-2 2023-04-20 15:25:59 +08:00
Duo Zhang 398c5ef313
HBASE-27783 Implement a shell command to disable all peer modification (#5182) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-04-19 22:07:29 +08:00
Bryan Beaudreault 94a8f319bc
HBASE-27787 Downgrade noisy info log in NettyRpcConnection when TLS enabled (#5169) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-18 14:32:41 -04:00
Andrew Purtell d56e7f291f
HBASE-27796 Improve MemcachedBlockCache (#5181) 
Track and log better stats.
Fix use of memcached API such that we are not accidentally immediately expiring keys.
Use a default retention period of 30 days, the max per memcached spec.
Use set instead of add to store keys.
Gracefully handle failures to cache and read timeouts.
Add unit tests using jmemcached as a test dependency.

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2023-04-17 13:20:55 -07:00
Duo Zhang 31c4aea48c
HBASE-27728 Implement a tool to migrate replication peer data between different storage implementation (#5179) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-04-17 22:13:19 +08:00
Nick Dimiduk 63471efa25
HBASE-27762 Include EventType and ProcedureV2 pid in logging via MDC (#5145) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2023-04-17 14:22:04 +02:00
Nihal Jain 24c471a0b3
HBASE-27791 Upgrade vega and its related js libraries (#5173) 
Signed-off-by: Rajeshbabu Chintaguntla <rajeshbabu@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2023-04-17 12:46:07 +02:00
Ray Mattingly 2b098b0819
HBASE-27536: Include more request information in slowlog for Scans (#5155) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Bryan Beaudreault <bbeaudreault@apache.org>
 2023-04-16 10:03:53 -04:00
Andrew Purtell 1e75a2a9a2 HBASE-27797 Update downloads.xml for release 2.5.4 2023-04-14 18:05:21 -07:00
Kota-SH 856fa14537
HBASE-27422: Support replication for hbase:acl (#4827) 
Signed-off-by: Ankit Singhal <ankit@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Tak Lon (Stephen) Wu <taklwu@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2023-04-14 10:19:29 +01:00
Duo Zhang a71105997f
HBASE-27727 Implement filesystem based Replication peer storage (#5165) 
Signed-off-by: Liangjun He <heliangjun@apache.org>
 2023-04-13 18:58:02 +08:00