9f69ad4746
HBASE-24408 Introduce a general 'local region' to store data on master ( #1753 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-23 16:40:54 +08:00
950237566b
HBASE-24370 Avoid aggressive MergeRegion and GCMultipleMergedRegionsProcedure ( #1719 ) ( #1762 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-05-22 16:40:38 -07:00
ae4f1b4830
HBASE-24405 : Document hbase:slowlog related operations ( #1747 )
...
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2020-05-22 20:58:52 +05:30
5d0e0fc5fd
HBASE-24376 MergeNormalizer is merging non-adjacent regions and causing region overlaps/holes. ( #1734 ) ( #1759 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-05-22 08:07:43 -07:00
0732d2a484
HBASE-23938 : System table hbase:slowlog to store complete slow/large… ( #1681 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
2020-05-20 15:33:11 +05:30
22e0e32e6b
HBASE-24399 [Flakey Tests] Some UTs about RSGroup should wait RSGroupInfoManager to be online ( #1738 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-05-20 15:10:21 +08:00
cf9e337c0f
HBASE-24361 Make `RESTApiClusterManager` more resilient ( #1701 )
...
* sometimes API calls return with null/empty response bodies. thus,
wrap all API calls in a retry loop.
* calls that submit work in the form of "commands" now retrieve the
commandId from successful command submission, and track completion
of that command before returning control to calling context.
* model CM's process state and use that model to guide state
transitions more intelligently. this guards against, for example,
the start command failing with an error message like "Role must be
stopped".
* improvements to logging levels, avoid spamming logs with the
side-effects of retries at this and higher contexts.
* include references to API documentation, such as it is.
Signed-off-by: stack <stack@apache.org>
2020-05-19 09:43:55 -07:00
61e2225151
HBASE-24386 TableSnapshotScanner support scan limit ( #1724 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off by: Viraj Jasani <vjasani@apache.org>
2020-05-19 21:10:37 +05:30
ce9051ea91
HBASE-24360 RollingBatchRestartRsAction loses track of dead servers
...
`RollingBatchRestartRsAction` doesn't handle failure cases when
tracking its list of dead servers. The original author believed that a
failure to restart would result in a retry. However, by removing the
dead server from the failed list, that state is lost, and retry never
occurs. Because this action doesn't ever look back to the current
state of the cluster, relying only on its local state for the current
action invocation, it never realizes the abandoned server is still
dead. Instead, be more careful to only remove the dead server from the
list when the `startRs` invocation claims to have been successful.
Signed-off-by: stack <stack@apache.org>
2020-05-18 12:08:52 -07:00
36a8e858db
HBASE-23969 Meta browser should show all `info` columns ( #1710 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-18 12:00:08 -07:00
0f566467ac
HBASE-24365 MetricsTableWrapperAggregateImpl runnable fails due to exception and never runs ( #1729 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off by: Viraj Jasani <vjasani@apache.org>
2020-05-18 15:16:23 +05:30
b4f613d1af
HBASE-24377 MemStoreFlusher throw NullPointerException ( #1721 )
...
Signed-off-by: Ramkrishna <ramkrishna@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-18 10:13:18 +08:00
c42a57970c
HBASE-24381 The Size metrics in Master Webui is wrong if the size is 0 ( #1723 )
2020-05-18 09:32:04 +08:00
cc1f2a6087
HBASE-24135 TableStateNotFoundException happends when table creation if rsgroup is enable ( #1550 )
...
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-17 20:44:17 +08:00
9b64ab029c
HBASE-24364 [Chaos Monkey] Invalid data block encoding in ChangeEncodingAction ( #1707 )
...
Signed-off-by: Jan Hentschel <janh@apache.org>
2020-05-15 12:01:21 +08:00
20557c0510
HBASE-23702 hbase.hstore.flusher.count setting to 0 breaks HMaster ( #1703 )
...
Co-authored-by: Ctest
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2020-05-15 09:10:23 +08:00
9f25673bb5
HBASE-24271 Set values in `conf/hbase-site.xml` that enable running on `LocalFileSystem` out of the box
...
Simplify the new user experience shipping a configuration that enables
a fresh checkout or tarball distribution to run in standalone mode
without direct user configuration. This change restores the behavior
we had when running on Hadoop 2.8 and earlier.
Patch for master includes an update to the book. This change will be
omitted when backporting to earlier branches.
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-14 14:09:10 -07:00
888eaa094d
Revert "HBASE-24086 Disable output stream capability enforcement when running on LocalFileSystem"
...
This reverts commit 5de9d71200
2020-05-14 14:09:10 -07:00
595b8619a6
HBASE-24368 Let HBCKSCP clear 'Unknown Servers', even if RegionStateNode has RegionLocation == null
...
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/GCMultipleMergedRegionsProcedure.java
Edit a log.
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/HBCKServerCrashProcedure.java
Add override of isMatchingRegionLocation. Allow 'null' as a pass in
HBCKSCP.
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/ServerCrashProcedure.java
Add a method for HBCKSCP to override and be less strict filtering
assigns.
hbase-server/src/main/resources/hbase-webapps/master/hbck.jsp
Some doc on what 'Unknown Servers' are.
2020-05-14 13:08:37 -07:00
1620e6d958
HBASE-24190 : Make kerberos value of hbase.security.authentication property case insensitive ( #1687 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-14 11:50:10 +05:30
b44cf90220
Revert "Make kerberos value of hbase.security.authentication property case insensitive ( #1687 )"
...
This reverts commit a77829d5b7
2020-05-14 11:49:23 +05:30
87b8bdf617
HBASE-24164 Retain the ReadRequests and WriteRequests of region on we… ( #1500 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-13 22:30:54 -07:00
60f6f79e3c
Revert "HBASE-24327 : Flaky connection in TestMasterShutdown#testMasterShutdo… ( #1690 )"
...
This reverts commit 8f245aa8f8
2020-05-13 22:11:15 +05:30
a5aa8d208e
HBASE-24309 Avoid introducing log4j and slf4j-log4j dependencies for … ( #1697 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-13 18:41:27 +08:00
8f245aa8f8
HBASE-24327 : Flaky connection in TestMasterShutdown#testMasterShutdo… ( #1690 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-05-13 02:41:37 +05:30
ceb55c654d
HBASE-24354 Make it so can make an hbase1 schema and hbase2 schema equate ( #1696 )
2020-05-12 12:35:05 -07:00
3276e95f8d
HBASE-23832 Old config hbase.hstore.compactionThreshold is ignored ( #1698 )
...
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
2020-05-12 23:23:37 +05:30
1414146770
HBASE-24256 When fixOverlap hits the max region limit, it is possible to include the same region in multiple merge request ( #1584 ) ( #1695 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-12 09:53:34 -07:00
197412e23a
HBASE-24355 Fix typos in the HStore#compact annotation ( #1699 )
...
Co-authored-by: guo.kangkang <guo.kangkang@immomo.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-12 21:08:42 +05:30
1799632928
HBASE-24338 [Flakey Tests] NPE in TestRaceBetweenSCPAndDTP Addendum2: make same fix for TestRaceBetweenSCPAndTRSP but in a second place (addendum 1 got first place).
2020-05-11 20:51:02 -07:00
eb805b2f66
HBASE-24338 [Flakey Tests] NPE in TestRaceBetweenSCPAndDTP
...
Addendum: make same fix for TestRaceBetweenSCPAndTRSP which does same
thing.
2020-05-11 14:09:33 -07:00
66c103f5de
Revert "HBASE-24327 : Handle shutdown() if master cannot be contacted ( #1684 )"
...
This reverts commit d155f5363e
2020-05-11 16:51:14 +05:30
e8b110ea15
HBASE-24321 - Add writable MinVersions and read-only Scan to coproc S… ( #1655 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lars Hofhansl <larsh@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-11 12:56:18 +05:30
a77829d5b7
Make kerberos value of hbase.security.authentication property case insensitive ( #1687 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-11 11:11:13 +05:30
d155f5363e
HBASE-24327 : Handle shutdown() if master cannot be contacted ( #1684 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-05-10 17:15:03 +05:30
c7e5923255
HBASE-24345 [ACL] renameRSGroup should require Admin level permission ( #1686 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
2020-05-09 23:36:00 +08:00
388fae73ff
HBASE-24333 Backport HBASE-24304 "Separate a hbase-asyncfs module" to branch-2.x ( #1664 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-09 12:24:45 +08:00
82fde05f65
HBASE-24284 [h3/jdk11] REST server won't start Exclude transitive includes of jax-rs 1.x and then explicitly include jax-rs 2.x glassfish impl for REST context when hadoop3. ( #1625 )
...
Addendum to fix failing MR tests; e.g. TestExportSnapshot.
2020-05-08 13:04:23 -07:00
0f1b9d0811
HBASE-24310 Use Slf4jRequestLog for hbase-http ( #1634 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-08 11:22:24 +08:00
2b2e6c7789
HBASE-24328 skip duplicate GCMultipleMergedRegionsProcedure while previous finished ( #1672 ) ( #1678 )
...
Signed-off-by: Huaxiang Sun<huaxiangsun@apache.org>
2020-05-07 14:11:44 -07:00
93ca07971c
HBASE-24338 [Flakey Tests] NPE in TestRaceBetweenSCPAndDTP #1669
...
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-07 13:53:43 -07:00
6cf140850c
HBASE-24295 [Chaos Monkey] abstract logging through the class hierarchy ; ADDENDUM
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-05-07 13:27:29 -07:00
378e6ed127
HBASE-24342 [Flakey Tests] Disable TestClusterPortAssignment.testClusterPortAssignment as it can't pass 100% of the time
2020-05-07 13:21:51 -07:00
9dd8c9607c
HBASE-24335 Support deleteall with ts but without column in shell mode ( #1668 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 2cafe81e9c
2020-05-07 18:25:43 +01:00
f49fc24ecf
HBASE-24316 GCMulitpleMergedRegionsProcedure is not idempotent ( #1660 ) ( #1663 )
...
It addresses couple issues:
1. Make sure deleteMergeQualifiers() does not delete the row if there is no columns with "merge" keyword.
2. GCMulitpleMergedRegionsProcedure now acquire an exclusive lock on the child region.
Signed-off-by: stack <stack@apache.org>
2020-05-06 10:01:25 -07:00
1e8d3524f0
HBASE-24331 [Flakey Test] TestJMXListener rmi port clash ( #1657 )
...
Add check that we can make jmx connector in setup. If we can't retry.
2020-05-06 09:29:21 -07:00
ead9509d31
HBASE-24336 [Metrics] FSDataInputStream's localBytesRead is wrong ( #1667 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
2020-05-06 19:38:37 +08:00
20c2f2898c
HBASE-24211: Create table is slow in large cluster when AccessController is enabled. ( #1631 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-06 15:18:16 +05:30
b2f4e6ecf6
HBASE-24265 Remove hedged rpc call support, implement the logic in MaterRegistry … ( #1593 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-05-06 16:20:03 +08:00
e6fe01a88c
HBASE-24273 HBCK's "Orphan Regions on FileSystem" reports regions with referenced HFiles ( #1613 ) ( #1662 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-05 23:01:29 -07:00
Duo Zhang
huaxiangsun
Viraj Jasani
XinSun
Nick Dimiduk
niuyulin
Mingliang Liu
ramkrish86
binlijin
Baiqiang Zhao
meiyi
Guanghao Zhang
stack
shahrs87
bsglz
Michael Stack
Sambit Mohapatra
Gkkkk302
Geoffrey Jacoby
Reid Chan
Mohammad Arshad