Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,049 Commits 95 Branches 866 Tags
Commit Graph

7968 Commits

Author SHA1 Message Date
Viraj Jasani
cb17d70226
Revert "HBASE-24327 : Flaky connection in TestMasterShutdown#testMasterShutdo… (#1690)" 
This reverts commit d9b60d3339ff3818eb0d55f20be6d20fb2f7b118.
 2020-05-13 22:12:58 +05:30
Duo Zhang
dc2146069c
HBASE-24309 Avoid introducing log4j and slf4j-log4j dependencies for … (#1697) 
Signed-off-by: stack <stack@apache.org>
 2020-05-13 17:59:21 +08:00
Viraj Jasani
d9b60d3339
HBASE-24327 : Flaky connection in TestMasterShutdown#testMasterShutdo… (#1690) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-05-13 02:40:36 +05:30
huaxiangsun
b7f7326950
HBASE-24256 When fixOverlap hits the max region limit, it is possible to include the same region in multiple merge request (#1584) (#1694) 
Signed-off-by: stack <stack@apache.org>
 2020-05-12 09:54:12 -07:00
Gkkkk302
a7e3c03541
HBASE-24355 Fix typos in the HStore#compact annotation (#1699) 
Co-authored-by: guo.kangkang <guo.kangkang@immomo.com>

Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-12 21:08:16 +05:30
stack
5c08a8c04b HBASE-24338 [Flakey Tests] NPE in TestRaceBetweenSCPAndDTP Addendum2: make same fix for TestRaceBetweenSCPAndTRSP but in a second place (addendum 1 got first place). 2020-05-11 20:50:05 -07:00
stack
cf786a2dfb HBASE-24338 [Flakey Tests] NPE in TestRaceBetweenSCPAndDTP 
Addendum: make same fix for TestRaceBetweenSCPAndTRSP which does same
thing.
 2020-05-11 14:08:50 -07:00
Viraj Jasani
60035721ca
Revert "HBASE-24327 : Handle shutdown() if master cannot be contacted (#1684)" 
This reverts commit a89967dfe81ccb1841308f6099c7c1d3b35f63a0.
 2020-05-11 16:50:01 +05:30
Geoffrey Jacoby
2993a95ee2
HBASE-24321 - Add writable MinVersions and read-only Scan to coproc S… (#1655) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lars Hofhansl <larsh@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-11 12:55:45 +05:30
Viraj Jasani
a89967dfe8
HBASE-24327 : Handle shutdown() if master cannot be contacted (#1684) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-05-10 17:14:32 +05:30
Duo Zhang
f41c9038e7
HBASE-24333 Backport HBASE-24304 "Separate a hbase-asyncfs module" to branch-2.x (#1664) 
Signed-off-by: stack <stack@apache.org>
 2020-05-09 12:00:45 +08:00
stack
406a3e8178 HBASE-24338 [Flakey Tests] NPE in TestRaceBetweenSCPAndDTP #1669 
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-05-07 13:43:35 -07:00
stack
618dca5782 HBASE-24338 [Flakey Tests] NPE in TestRaceBetweenSCPAndDTP 2020-05-07 13:30:23 -07:00
stack
ba85ea3eff HBASE-24342 [Flakey Tests] Disable TestClusterPortAssignment.testClusterPortAssignment as it can't pass 100% of the time 2020-05-07 13:20:54 -07:00
niuyulin
735aa8bf9f
HBASE-24328 skip duplicate GCMultipleMergedRegionsProcedure while previous finished (#1672) 
Co-authored-by: niuyulin <niuyulin@xiaomi.com>
 2020-05-07 10:25:25 -07:00
huaxiangsun
fca0f3f810
HBASE-24316 GCMulitpleMergedRegionsProcedure is not idempotent (#1660) (#1671) 
It addresses couple issues:
   1. Make sure deleteMergeQualifiers() does not delete the row if there is no columns with "merge" keyword.
   2. GCMulitpleMergedRegionsProcedure now acquire an exclusive lock on the child region.

Signed-off-by: stack <stack@apache.org>
 2020-05-06 16:07:21 -07:00
huaxiangsun
04ac08d49b
HBASE-24273 HBCK's "Orphan Regions on FileSystem" reports regions with referenced HFiles (#1613) (#1661) 
Signed-off-by: stack <stack@apache.org>
 2020-05-06 09:50:52 -07:00
Michael Stack
89ae3c55c8
HBASE-24331 [Flakey Test] TestJMXListener rmi port clash (#1657) 
Add check that we can make jmx connector in setup. If we can't retry.
 2020-05-06 09:27:52 -07:00
Reid Chan
20a7a542ff HBASE-24336 [Metrics] FSDataInputStream's localBytesRead is wrong (#1667) 
Signed-off-by: binlijin <binlijin@gmail.com>
 2020-05-06 19:36:53 +08:00
Mohammad Arshad
edd8829cfc
HBASE-24211: Create table is slow in large cluster when AccessController is enabled. (#1631) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-06 15:17:34 +05:30
Duo Zhang
7f4683bafa HBASE-24265 Remove hedged rpc call support, implement the logic in MaterRegistry … (#1593) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-05-06 16:11:28 +08:00
Nick Dimiduk
e6b8ca9dcf HBASE-23976 Use nio for file manipulation in TestVerifyBucketCacheFile (#1342) 
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
 2020-05-05 22:05:25 -07:00
stack
99e96cca3b HBASE-24118 [Flakey Tests] TestCloseRegionWhileRSCrash 
Addendum; add back bit missing off end of test.
 2020-05-05 21:15:22 -07:00
Michael Stack
528e9d6454
HBASE-24307 [Flakey Tests] krb server for secure thrift tests throws BindException (#1656) 
Move the random free port generate back into hbasecommontestingutility
  from hbasetestingutility.

  Add a create simple kdc server utility that will start a kdc server and
  if a bindexception, create a new one on a new random port in hbase-common.

  Add new BoundSocketMaker helpful when trying to manufacture
  BindExceptions because of port clash.

  Change thrift and http kdc tests to use this new utility (removes
  code duplication around kdc server setup).
 2020-05-05 21:08:09 -07:00
Michael Stack
80561504d2
HBASE-24284 [h3/jdk11] REST server won't start Exclude transitive includes of jax-rs 1.x and then explicitly include jax-rs 2.x glassfish impl for REST context when hadoop3. (#1625) 2020-05-05 15:27:11 -07:00
Duo Zhang
64bfc99f05 HBASE-24314 Some classes still use log4j logger directly (#1637) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-05-05 20:24:58 +08:00
Anoop Sam John
5e5b13cb51
HBASE-24311 Add more details in MultiVersionConcurrencyControl STUCK log message (#1654) 2020-05-05 16:25:40 +05:30
Nick Dimiduk
47dca8eb45 HBASE-24260 Add a ClusterManager that issues commands via coprocessor 
Implements `ClusterManager` that relies on the new
`ShellExecEndpointCoprocessor` for remote shell command execution.

Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-05-04 10:52:28 -07:00
stack
ffae8a570c HBASE-24246 Miscellaneous hbck2 fixMeta bulk merge fixes: better logging around merges/overlap-fixing, 'HBCK Report' overlap listing, and configuration (#1572) 
Addendum to address minor feedback on text
 2020-05-04 08:24:09 -07:00
Michael Stack
1dd4b13e17
HBASE-24246 Miscellaneous hbck2 fixMeta bulk merge fixes: better logging around merges/overlap-fixing, 'HBCK Report' overlap listing, and configuration (#1572) 
hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Fix weird brackets around each region name when logging.

hbase-server/src/main/java/org/apache/hadoop/hbase/master/MetaFixer.java
  Log when we hit the max merge limit. Also up limit to 64.

hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/MergeTableRegionsProcedure.java
 Make logs make more sense to operator.

hbase-server/src/main/resources/hbase-webapps/master/hbck.jsp
 Make RegionName show when you mouseover so long names don't mess up
 display of holes and overlaps.

Address Mingliang Liu liuml07 feedback

Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
 2020-05-04 08:21:52 -07:00
niuyulin
0a428e8b48
HBASE-24221 Support bulkLoadHFile by family (#1627) 
Co-authored-by: niuyulin <niuyulin@xiaomi.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2020-05-03 13:46:53 +01:00
stack
da92a12bf5 HBASE-24199 Procedure related metrics is not consumed in the JMX metric (#1616) 
Addendum; fix failing test
 2020-05-01 17:31:59 -07:00
xincunSong
0d2b959d20 [HBASE-24288]Allow admin user to create table and do bulkLoad (#1612) 
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: binlijin <binlijin@gmail.com>
 2020-05-01 11:58:06 -07:00
gkanade
1df3bee5f6 HBASE-24199 Procedure related metrics is not consumed in the JMX metric (#1616) 
Signed-off-by: stack <stack@apache.org>
 2020-05-01 11:49:32 -07:00
bsglz
a6aea729c5
HBASE-22710 Wrong result in one case of scan that use raw and version… (#767) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-04-30 14:11:04 +05:30
xincunSong
d59af05b0f HBASE-24282 'scanDetail' log message is missing when responseTooSlow happens on the first scan rpc call (#1604) 
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: stack <stack@apache.org>
 2020-04-29 16:04:40 -07:00
stack
93f0d4ce06 HBASE-24247 Failed multi-merge because two regions not adjacent (legitimately). 
Addendum: Restore old semantic where merge of non-adjacent required
'force'
 2020-04-29 14:34:37 -07:00
Duo Zhang
922921ee5f HBASE-24249 Move code in FSHDFSUtils to FSUtils and mark related clas… (#1586) 
Signed-off-by: stack <stack@apache.org>
 2020-04-29 11:31:32 +08:00
stack
3b0812d3e1 HBASE-24215 [Flakey Tests] [ERROR] TestSecureRESTServer java.lang.NoClassDefFoundError: com/sun/jersey/core/spi/factory/AbstractRuntimeDelegate 
Addendum #2: Add jersey-servlet to hadoop3 profile.
 2020-04-28 20:18:31 -07:00
Michael Stack
9e697d0ea6
HBASE-24247 Failed multi-merge because two regions not adjacent (legitimately) (#1570) 
hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionInfo.java
 Add new isOverlap method that takes list of RegionInfos checking that
 current RegionInfo is overlapped by the passed in Regions.

    Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
    Signed-off-by: Huaxiang Sun <huaxiangsun@apache.com>
 2020-04-28 13:22:00 -07:00
Duo Zhang
47348f5887 Revert "HBASE-24211: Create table is slow in large cluster when AccessController is enabled. (#1546)" 
This breaks TestAccessController.testAccessControllerUserPermsRegexHandling

This reverts commit 66e90dece2b95bd2eb322b5a17ae180a735597da.
 2020-04-27 22:50:02 +08:00
Duo Zhang
5af807153a HBASE-24264 Disable TestNettyIPC.testHedgedAsyncEcho (#1589) 2020-04-27 09:43:09 +08:00
bsglz
ee5283ee82
HBASE-23264 Resolve a TODO of BucketAllocator: "Why we add the extra … (#801) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-04-26 16:20:40 +05:30
Mohammad Arshad
66e90dece2
HBASE-24211: Create table is slow in large cluster when AccessController is enabled. (#1546) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
 2020-04-25 17:45:32 +05:30
niuyulin
90d738107f HBASE-24222 remove FSUtils.checkAccess and replace with FileSystem.access in HBCK (#1557) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-04-23 23:59:34 +08:00
Viraj Jasani
b40381857a
HBASE-24024 : Reject multi() requests with rows higher than threshold (#1560) 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2020-04-22 12:51:49 +05:30
Beata Sudi
74c033db83
HBASE-24139 : Balancer should avoid leaving idle region servers (#1511) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2020-04-22 10:11:16 +05:30
stack
f8ce21f096 HBASE-24226 Address other hard references to '/tmp' found in Configuration 2020-04-21 17:39:30 -07:00
stack
3c1725f2f0 HBASE-24175 [Flakey Tests] TestSecureExportSnapshot FileNotFoundException Addendum #3; catch more '/tmp' references by hadoop. Fix broken build. 2020-04-21 17:39:20 -07:00
stack
b262b9a013 HBASE-24175 [Flakey Tests] TestSecureExportSnapshot FileNotFoundException Addendum #3; catch more '/tmp' references by hadoop. 2020-04-21 17:39:04 -07:00