9f69ad4746
HBASE-24408 Introduce a general 'local region' to store data on master ( #1753 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-23 16:40:54 +08:00
950237566b
HBASE-24370 Avoid aggressive MergeRegion and GCMultipleMergedRegionsProcedure ( #1719 ) ( #1762 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-05-22 16:40:38 -07:00
5d0e0fc5fd
HBASE-24376 MergeNormalizer is merging non-adjacent regions and causing region overlaps/holes. ( #1734 ) ( #1759 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-05-22 08:07:43 -07:00
0732d2a484
HBASE-23938 : System table hbase:slowlog to store complete slow/large… ( #1681 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
2020-05-20 15:33:11 +05:30
61e2225151
HBASE-24386 TableSnapshotScanner support scan limit ( #1724 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off by: Viraj Jasani <vjasani@apache.org>
2020-05-19 21:10:37 +05:30
36a8e858db
HBASE-23969 Meta browser should show all `info` columns ( #1710 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-18 12:00:08 -07:00
0f566467ac
HBASE-24365 MetricsTableWrapperAggregateImpl runnable fails due to exception and never runs ( #1729 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off by: Viraj Jasani <vjasani@apache.org>
2020-05-18 15:16:23 +05:30
b4f613d1af
HBASE-24377 MemStoreFlusher throw NullPointerException ( #1721 )
...
Signed-off-by: Ramkrishna <ramkrishna@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-18 10:13:18 +08:00
c42a57970c
HBASE-24381 The Size metrics in Master Webui is wrong if the size is 0 ( #1723 )
2020-05-18 09:32:04 +08:00
20557c0510
HBASE-23702 hbase.hstore.flusher.count setting to 0 breaks HMaster ( #1703 )
...
Co-authored-by: Ctest
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2020-05-15 09:10:23 +08:00
595b8619a6
HBASE-24368 Let HBCKSCP clear 'Unknown Servers', even if RegionStateNode has RegionLocation == null
...
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/GCMultipleMergedRegionsProcedure.java
Edit a log.
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/HBCKServerCrashProcedure.java
Add override of isMatchingRegionLocation. Allow 'null' as a pass in
HBCKSCP.
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/ServerCrashProcedure.java
Add a method for HBCKSCP to override and be less strict filtering
assigns.
hbase-server/src/main/resources/hbase-webapps/master/hbck.jsp
Some doc on what 'Unknown Servers' are.
2020-05-14 13:08:37 -07:00
87b8bdf617
HBASE-24164 Retain the ReadRequests and WriteRequests of region on we… ( #1500 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-13 22:30:54 -07:00
60f6f79e3c
Revert "HBASE-24327 : Flaky connection in TestMasterShutdown#testMasterShutdo… ( #1690 )"
...
This reverts commit 8f245aa8f8
2020-05-13 22:11:15 +05:30
a5aa8d208e
HBASE-24309 Avoid introducing log4j and slf4j-log4j dependencies for … ( #1697 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-13 18:41:27 +08:00
8f245aa8f8
HBASE-24327 : Flaky connection in TestMasterShutdown#testMasterShutdo… ( #1690 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-05-13 02:41:37 +05:30
1414146770
HBASE-24256 When fixOverlap hits the max region limit, it is possible to include the same region in multiple merge request ( #1584 ) ( #1695 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-12 09:53:34 -07:00
197412e23a
HBASE-24355 Fix typos in the HStore#compact annotation ( #1699 )
...
Co-authored-by: guo.kangkang <guo.kangkang@immomo.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-12 21:08:42 +05:30
1799632928
HBASE-24338 [Flakey Tests] NPE in TestRaceBetweenSCPAndDTP Addendum2: make same fix for TestRaceBetweenSCPAndTRSP but in a second place (addendum 1 got first place).
2020-05-11 20:51:02 -07:00
eb805b2f66
HBASE-24338 [Flakey Tests] NPE in TestRaceBetweenSCPAndDTP
...
Addendum: make same fix for TestRaceBetweenSCPAndTRSP which does same
thing.
2020-05-11 14:09:33 -07:00
66c103f5de
Revert "HBASE-24327 : Handle shutdown() if master cannot be contacted ( #1684 )"
...
This reverts commit d155f5363e
2020-05-11 16:51:14 +05:30
e8b110ea15
HBASE-24321 - Add writable MinVersions and read-only Scan to coproc S… ( #1655 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lars Hofhansl <larsh@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-11 12:56:18 +05:30
d155f5363e
HBASE-24327 : Handle shutdown() if master cannot be contacted ( #1684 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-05-10 17:15:03 +05:30
388fae73ff
HBASE-24333 Backport HBASE-24304 "Separate a hbase-asyncfs module" to branch-2.x ( #1664 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-09 12:24:45 +08:00
2b2e6c7789
HBASE-24328 skip duplicate GCMultipleMergedRegionsProcedure while previous finished ( #1672 ) ( #1678 )
...
Signed-off-by: Huaxiang Sun<huaxiangsun@apache.org>
2020-05-07 14:11:44 -07:00
93ca07971c
HBASE-24338 [Flakey Tests] NPE in TestRaceBetweenSCPAndDTP #1669
...
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-07 13:53:43 -07:00
378e6ed127
HBASE-24342 [Flakey Tests] Disable TestClusterPortAssignment.testClusterPortAssignment as it can't pass 100% of the time
2020-05-07 13:21:51 -07:00
f49fc24ecf
HBASE-24316 GCMulitpleMergedRegionsProcedure is not idempotent ( #1660 ) ( #1663 )
...
It addresses couple issues:
1. Make sure deleteMergeQualifiers() does not delete the row if there is no columns with "merge" keyword.
2. GCMulitpleMergedRegionsProcedure now acquire an exclusive lock on the child region.
Signed-off-by: stack <stack@apache.org>
2020-05-06 10:01:25 -07:00
1e8d3524f0
HBASE-24331 [Flakey Test] TestJMXListener rmi port clash ( #1657 )
...
Add check that we can make jmx connector in setup. If we can't retry.
2020-05-06 09:29:21 -07:00
ead9509d31
HBASE-24336 [Metrics] FSDataInputStream's localBytesRead is wrong ( #1667 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
2020-05-06 19:38:37 +08:00
20c2f2898c
HBASE-24211: Create table is slow in large cluster when AccessController is enabled. ( #1631 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-06 15:18:16 +05:30
b2f4e6ecf6
HBASE-24265 Remove hedged rpc call support, implement the logic in MaterRegistry … ( #1593 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-05-06 16:20:03 +08:00
e6fe01a88c
HBASE-24273 HBCK's "Orphan Regions on FileSystem" reports regions with referenced HFiles ( #1613 ) ( #1662 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-05 23:01:29 -07:00
d28b56f111
HBASE-23976 Use nio for file manipulation in TestVerifyBucketCacheFile ( #1342 )
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2020-05-05 22:05:49 -07:00
7c92e145b9
HBASE-24307 [Flakey Tests] krb server for secure thrift tests throws BindException ( #1656 )
...
Move the random free port generate back into hbasecommontestingutility
from hbasetestingutility.
Add a create simple kdc server utility that will start a kdc server and
if a bindexception, create a new one on a new random port in hbase-common.
Add new BoundSocketMaker helpful when trying to manufacture
BindExceptions because of port clash.
Change thrift and http kdc tests to use this new utility (removes
code duplication around kdc server setup).
2020-05-05 21:36:20 -07:00
db3d42bd9a
HBASE-24118 [Flakey Tests] TestCloseRegionWhileRSCrash
...
Addendum; add back bit missing off end of test.
2020-05-05 21:16:09 -07:00
bee66bd22a
HBASE-24284 [h3/jdk11] REST server won't start Exclude transitive includes of jax-rs 1.x and then explicitly include jax-rs 2.x glassfish impl for REST context when hadoop3. ( #1625 )
2020-05-05 15:28:31 -07:00
e38531a70a
HBASE-24314 Some classes still use log4j logger directly ( #1637 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-05-05 20:25:10 +08:00
fa1890c880
HBASE-24260 Add a ClusterManager that issues commands via coprocessor
...
Implements `ClusterManager` that relies on the new
`ShellExecEndpointCoprocessor` for remote shell command execution.
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-05-04 10:50:42 -07:00
5b823cf8bf
HBASE-24246 Miscellaneous hbck2 fixMeta bulk merge fixes: better logging around merges/overlap-fixing, 'HBCK Report' overlap listing, and configuration ( #1572 )
...
Addendum to address minor feedback on text
2020-05-04 08:25:35 -07:00
616f277901
HBASE-24246 Miscellaneous hbck2 fixMeta bulk merge fixes: better logging around merges/overlap-fixing, 'HBCK Report' overlap listing, and configuration ( #1572 )
...
hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
Fix weird brackets around each region name when logging.
hbase-server/src/main/java/org/apache/hadoop/hbase/master/MetaFixer.java
Log when we hit the max merge limit. Also up limit to 64.
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/MergeTableRegionsProcedure.java
Make logs make more sense to operator.
hbase-server/src/main/resources/hbase-webapps/master/hbck.jsp
Make RegionName show when you mouseover so long names don't mess up
display of holes and overlaps.
Address Mingliang Liu liuml07 feedback
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2020-05-04 08:25:35 -07:00
b2f625045a
HBASE-24221 Support bulkLoadHFile by family ( #1627 )
...
Co-authored-by: niuyulin <niuyulin@xiaomi.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(Cherry picked from commit 0a428e8b48
2020-05-04 15:25:30 +01:00
b977d1f1dc
HBASE-24199 Procedure related metrics is not consumed in the JMX metric ( #1616 )
...
Addendum; fix failing test
2020-05-01 17:51:54 -07:00
9d90287b6d
[HBASE-24288]Allow admin user to create table and do bulkLoad ( #1612 )
...
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: binlijin <binlijin@gmail.com>
2020-05-01 11:58:26 -07:00
6147aebd00
HBASE-24199 Procedure related metrics is not consumed in the JMX metric ( #1616 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-01 11:50:16 -07:00
4262c72086
HBASE-22710 Wrong result in one case of scan that use raw and version… ( #767 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-30 14:13:13 +05:30
db49e28f16
HBASE-24282 'scanDetail' log message is missing when responseTooSlow happens on the first scan rpc call ( #1604 )
...
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-04-29 16:06:01 -07:00
595655f190
HBASE-24247 Failed multi-merge because two regions not adjacent (legitimately).
...
Addendum: Restore old semantic where merge of non-adjacent required
'force'
2020-04-29 14:36:52 -07:00
a020e461c5
HBASE-24215 [Flakey Tests] [ERROR] TestSecureRESTServer java.lang.NoClassDefFoundError: com/sun/jersey/core/spi/factory/AbstractRuntimeDelegate
...
Addendum: Add jersey-servlet to hadoop3 profile.
Made the hadoop3 profile in top-level pom same as it is for hadoop2
when it comes to exclusions. Then backed out previous attempt mostly.
Made the failing test medium-sized so it ran in its own jvm.
2020-04-29 07:37:05 -07:00
bf2350e25f
HBASE-24249 Move code in FSHDFSUtils to FSUtils and mark related clas… ( #1586 )
...
Signed-off-by: stack <stack@apache.org>
2020-04-29 11:32:44 +08:00
5d117afc77
HBASE-24247 Failed multi-merge because two regions not adjacent (legitimately) ( #1570 )
...
hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionInfo.java
Add new isOverlap method that takes list of RegionInfos checking that
current RegionInfo is overlapped by the passed in Regions.
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.com>
2020-04-28 13:26:14 -07:00
Duo Zhang
huaxiangsun
Viraj Jasani
niuyulin
Mingliang Liu
ramkrish86
binlijin
Baiqiang Zhao
Guanghao Zhang
stack
bsglz
Gkkkk302
Geoffrey Jacoby
Michael Stack
Reid Chan
Mohammad Arshad
Nick Dimiduk
xincunSong
gkanade