17725 Commits

Author SHA1 Message Date
gkanade
9785f5d1c9
HBASE-24199 Procedure related metrics is not consumed in the JMX metric ()
Signed-off-by: stack <stack@apache.org>
2020-05-01 11:45:16 -07:00
Michael Stack
3df1e60bb3 HBASE-24294 [Flakey Tests] TestThriftHttpServer BindException ()
Refactor Thrift tests so resilient when launch of ThriftServer runs
into BindException.

hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/TestBindExceptionHandling.java
hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/TestThriftHttpServer.java
hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/TestThriftServerCmdLine.java
hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift2/TestThrift2HttpServer.java
hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift2/TestThrift2ServerCmdLine.java
 Refactor to use new ThriftServerRunner and ThriftServerSupplier

hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/TestThriftServer.java
 Log list of existing tables on assert.

hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/TestThriftSpnegoHttpFallbackServer.java
hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/TestThriftSpnegoHttpServer.java
 Add Ignore for testRunThriftServerWithHeaderBufferLength. Its tested in
 superclass. No need to test again here. Besides, its destructive test
 leaving behind dregs that mess up the retry.

hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/ThriftServerRunner.java
 Utility. Thread to host ThriftServer and exception if one after run
 completes.
2020-05-01 08:40:42 -07:00
Duo Zhang
e8504ba817
HBASE-24277 TestZooKeeper is flaky () 2020-05-01 20:34:42 +08:00
niuyulin
512d00e75d
HBASE-24221 Support bulkLoadHFile by family ()
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-04-30 18:33:37 +08:00
bsglz
b810c9bb91
HBASE-22710 Wrong result in one case of scan that use raw and version… ()
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-30 13:51:37 +05:30
Peter Somogyi
e26a2b5bf3
HBASE-24285 Move to hbase-thirdparty-3.3.0 ()
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-30 10:06:54 +02:00
xincunSong
856e21d199
HBASE-24282 'scanDetail' log message is missing when responseTooSlow happens on the first scan rpc call ()
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-04-29 16:03:24 -07:00
stack
13f36d9db3 HBASE-23956 Use less resources running tests
Addendum to master to remove commit against hbase-rsgroup which does not
exist in master
2020-04-29 15:39:52 -07:00
stack
e3c5527ce5 HBASE-24247 Failed multi-merge because two regions not adjacent (legitimately).
Addendum: Restore old semantic where merge of non-adjacent required
'force'
2020-04-29 14:35:48 -07:00
Nick Dimiduk
a97395d4c0 HBASE-24274 RESTApiClusterManager attempts to deserialize response using serialization API
Use the correct GSON API for deserializing service responses. Add
simple unit test covering a very limited selection of the overall API
surface area, just enough to ensure deserialization works.

Signed-off-by: stack <stack@apache.org>
2020-04-29 13:13:03 -07:00
stack
9cff7a4ff4 HBASE-24215 [Flakey Tests] [ERROR] TestSecureRESTServer java.lang.NoClassDefFoundError: com/sun/jersey/core/spi/factory/AbstractRuntimeDelegate
Addendum: Add jersey-servlet to hadoop3 profile.

Made the hadoop3 profile in top-level pom same as it is for hadoop2
when it comes to exclusions. Then backed out previous attempt mostly.
Made the failing test medium-sized so it ran in its own jvm.
2020-04-29 07:39:59 -07:00
Jan Hentschel
3781ac9dac
HBASE-24171 Removed 2.1.10 from download page ()
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-04-29 22:06:14 +08:00
Duo Zhang
a2e373dc32 HBASE-24281 Remove some stale hadoop.version properties in the pom for sub modules ()
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-29 18:24:52 +08:00
Duo Zhang
a51a1f4d10 Revert "HBASE-24181 Remove some stale hadoop.version properties in the pom for sub modules ()"
This reverts commit af40bff8becacfaa22c85b6e5c4fb83a881b91ad.
2020-04-29 18:24:41 +08:00
Duo Zhang
af40bff8be
HBASE-24181 Remove some stale hadoop.version properties in the pom for sub modules ()
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-29 18:02:07 +08:00
Joseph295
f46dba865f
HBASE-24278 The Java doc for minFilesToCompact is wrong ()
Co-authored-by: Joseph295 <johnhomsea@gmail.com>
SIgned-off-by: stack <stack@apache.org>
2020-04-28 22:09:56 -07:00
Duo Zhang
3cb9d373e3 HBASE-23933 Addendum remove hadoop-2.0 profile in pom 2020-04-29 11:59:08 +08:00
Duo Zhang
9f52e6b725
HBASE-24249 Move code in FSHDFSUtils to FSUtils and mark related clas… ()
Signed-off-by: stack <stack@apache.org>
2020-04-29 10:44:34 +08:00
Duo Zhang
6928674eb8
HBASE-24228 Merge the code in hbase-hadoop2-compat module to hbase-hadoop-compat ()
Signed-off-by: stack <stack@apache.org>
2020-04-29 10:34:53 +08:00
Michael Stack
8fceec8cb1 HBASE-24247 Failed multi-merge because two regions not adjacent (legitimately) ()
hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionInfo.java
 Add new isOverlap method that takes list of RegionInfos checking that
 current RegionInfo is overlapped by the passed in Regions.

    Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
    Signed-off-by: Huaxiang Sun <huaxiangsun@apache.com>
2020-04-28 13:24:04 -07:00
zhu qi
7e9bd3606f
HBASE-24267 add limit support for scan in rest api ()
Co-authored-by: zhuqi <zhuqi1@xiaomi.com>

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2020-04-28 10:06:28 +01:00
Josh Elser
6eb5cafe34 HBASE-24252 Implement proxyuser/doAs mechanism for hbase-http
copy ProxyUserAuthenticationFilter from Hadoop
add hbase.security.authentication.spnego.kerberos.proxyuser.enable parameter (default false)
wire ProxyUserAuthenticationFilter into HttpServer

Closes 

Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2020-04-27 15:07:55 -04:00
Nick Dimiduk
7f6672eb9e
HBASE-24143 [JDK11] Switch default garbage collector from CMS ; Addendum ()
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-04-27 09:24:46 -07:00
Duo Zhang
39a1bc53f8 Revert "HBASE-24212: Create table is slow in large cluster when AccessController is enabled. ()"
Wrong JIRA issue number and also breaks TestAccessController.testAccessControllerUserPermsRegexHandling

This reverts commit e6cc5eb2f0623f02eaa3542308fc3d82fd3abd9f.
2020-04-27 22:45:52 +08:00
Duo Zhang
84f2e95dd5
HBASE-24264 Disable TestNettyIPC.testHedgedAsyncEcho () 2020-04-26 23:36:07 +08:00
bsglz
ec0d9d767e
HBASE-23264 Resolve a TODO of BucketAllocator: "Why we add the extra … ()
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-26 15:15:31 +05:30
Duo Zhang
e96ad0ac1e
HBASE-24263 TestDelegationToken is broken () 2020-04-26 11:43:51 +08:00
Josh Elser
8774614a8c HBASE-23881 Ensure Netty client receives at least one response before considering SASL negotiation complete
The PLAIN mechanism test added in the Shade authentication example has
different semantics than GSSAPI mechanism -- the client reports that the
handshake is done after the original challenge is computed. The javadoc
on SaslClient, however, tells us that we need to wait for a response
from the server before proceeding.

The client, best as I can see, does not receive any data from HBase;
however the application semantics (e.g. throw an exception on auth'n
error) do not work as we intend as a result of this bug.

Extra trace logging was also added to debug this, should a similar error
ever happen again with some other mechanism.

Closes 

Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-04-26 10:24:07 +08:00
Duo Zhang
c1f0634462 Revert "HBASE-23381 Ensure Netty client receives at least one response before considering SASL negotiation complete"
Incorrect jira issue number

This reverts commit 78eecd3a7d291c46432efa4be16a04c2e3e0a027.
2020-04-26 10:23:40 +08:00
Mohammad Arshad
e6cc5eb2f0
HBASE-24211: Create table is slow in large cluster when AccessController is enabled. ()
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
2020-04-25 17:41:43 +05:30
Jan Hentschel
a9c1ca9577
HBASE-24172 Removed release 2.1 from release manager section in documentation ()
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-04-25 09:46:41 +08:00
Peter Somogyi
910b0caaf4
HBASE-24254 Update openjdk-8-jdk version in create-release ()
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-24 18:02:12 +02:00
Duo Zhang
24961c5c34
HBASE-23848 Addendum fix TestSeekOptimizations () 2020-04-24 19:50:30 +08:00
Peter Somogyi
4578533d3a
HBASE-24251 PreCommit build is failing because of can not build docker image; addendum ()
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-04-24 13:40:20 +02:00
Duo Zhang
ec8d582d80
HBASE-24253 HBASE-Find-Flaky-Tests job is failing because of can not build docker image ()
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-24 19:39:19 +08:00
Duo Zhang
023c6fe56b
HBASE-24251 PreCommit build is failing because of can not build docker image ()
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-24 15:39:18 +08:00
niuyulin
6cea5c6462
HBASE-24222 remove FSUtils.checkAccess and replace with FileSystem.access in HBCK ()
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-04-23 23:20:38 +08:00
Viraj Jasani
4ed15e51d9
HBASE-24024 : Reject multi() requests with rows higher than threshold ()
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-04-22 12:46:40 +05:30
Jan Hentschel
75c717d4c2
HBASE-23848 Removed deprecated setStopRow from Scan ()
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-04-22 15:15:17 +08:00
niuyulin
bc9184ee00
HBASE-23933 Separate a hbase-balancer module ()
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-22 14:55:38 +08:00
Beata Sudi
5f45c8293d
HBASE-24139 : Balancer should avoid leaving idle region servers ()
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2020-04-22 09:51:53 +05:30
Duo Zhang
af17b3ccd6
HBASE-24218 Add hadoop 3.2.x in hadoop check ()
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-22 10:51:46 +08:00
stack
e7b5c34d28 HBASE-24226 Address other hard references to '/tmp' found in Configuration 2020-04-21 17:40:35 -07:00
Viraj Jasani
5c53b606a9
HBASE-24175 : createDirAndSetProperty() (ADDENDUM) 2020-04-21 23:09:07 +05:30
stack
7c2f13eb70 HBASE-24175 [Flakey Tests] TestSecureExportSnapshot FileNotFoundException
Addendum ; catch more '/tmp' references by hadoop.
2020-04-21 09:41:24 -07:00
Mark Robert Miller
f48b50964c HBASE-24185: Junit tests do not behave well with System.exit or Runtime.halt or JVM exits in general. ()
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-04-20 22:20:45 -07:00
Michael Stack
63064bfa7e HBASE-24215 [Flakey Tests] [ERROR] TestSecureRESTServer java.lang.NoClassDefFoundError: com/sun/jersey/core/spi/factory/AbstractRuntimeDelegate () 2020-04-20 21:55:01 -07:00
Reid Chan
9cddac01ba
HBASE-24196 [Shell] Add rename rsgroup command in hbase shell ()
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-21 10:22:33 +08:00
stack
2d2e1d965d HBASE-24220 Allow that zk NOTEMPTY multi exception is retryable by running in-series
hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapred/TableRecordReaderImpl.java
hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/TableRecordReaderImpl.java
 Cleanup checkstyle warnings. Don't depend on hbase-client
 ScannerCallable.

hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/snapshot/TestExportSnapshot.java
 Cut down on cluster resource usage.

hbase-server/src/test/java/org/apache/hadoop/hbase/master/AbstractTestDLS.java
 Debug

hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestAccessController3.java
 Debug

hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/TestThriftHttpServer.java
 Debug

hbase-zookeeper/src/main/java/org/apache/hadoop/hbase/zookeeper/MiniZooKeeperCluster.java
 Debug

hbase-zookeeper/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKUtil.java
 Allow that NONEMPTY is retryable by running in series.
2020-04-20 15:51:11 -07:00
Guangxu Cheng
bcacc4ce93
HBASE-23896 Snapshot owner cannot delete snapshot when ACL is enabled and Kerberos is not enabled ()
Signed-off-by: binlijin <binlijin@gmail.com>
2020-04-20 09:59:06 +08:00