6f5e5e4828
HBASE-23938 : System table hbase:slowlog to store complete slow/large… ( #1681 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
2020-05-20 15:30:30 +05:30
fbe0da2672
HBASE-24361 Make `RESTApiClusterManager` more resilient ( #1701 )
...
* sometimes API calls return with null/empty response bodies. thus,
wrap all API calls in a retry loop.
* calls that submit work in the form of "commands" now retrieve the
commandId from successful command submission, and track completion
of that command before returning control to calling context.
* model CM's process state and use that model to guide state
transitions more intelligently. this guards against, for example,
the start command failing with an error message like "Role must be
stopped".
* improvements to logging levels, avoid spamming logs with the
side-effects of retries at this and higher contexts.
* include references to API documentation, such as it is.
Signed-off-by: stack <stack@apache.org>
2020-05-19 09:46:37 -07:00
3605db2fa0
HBASE-24386 TableSnapshotScanner support scan limit ( #1724 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off by: Viraj Jasani <vjasani@apache.org>
2020-05-19 21:10:03 +05:30
d0c7458e07
HBASE-24360 RollingBatchRestartRsAction loses track of dead servers
...
`RollingBatchRestartRsAction` doesn't handle failure cases when
tracking its list of dead servers. The original author believed that a
failure to restart would result in a retry. However, by removing the
dead server from the failed list, that state is lost, and retry never
occurs. Because this action doesn't ever look back to the current
state of the cluster, relying only on its local state for the current
action invocation, it never realizes the abandoned server is still
dead. Instead, be more careful to only remove the dead server from the
list when the `startRs` invocation claims to have been successful.
Signed-off-by: stack <stack@apache.org>
2020-05-18 12:55:19 -07:00
5893c4f393
HBASE-23969 Meta browser should show all `info` columns ( #1710 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-18 11:48:36 -07:00
04cd6dc3f8
HBASE-24365 MetricsTableWrapperAggregateImpl runnable fails due to exception and never runs ( #1729 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off by: Viraj Jasani <vjasani@apache.org>
2020-05-18 15:13:41 +05:30
9fd61f4774
HBASE-24377 MemStoreFlusher throw NullPointerException ( #1721 )
...
Signed-off-by: Ramkrishna <ramkrishna@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-18 10:12:15 +08:00
b66d8edbd6
HBASE-24381 The Size metrics in Master Webui is wrong if the size is 0 ( #1723 )
2020-05-18 09:25:40 +08:00
80013ec11d
HBASE-24135 TableStateNotFoundException happends when table creation if rsgroup is enable ( #1550 )
...
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-17 20:50:04 +08:00
692a597b63
HBASE-23702 hbase.hstore.flusher.count setting to 0 breaks HMaster ( #1703 )
...
Co-authored-by: Ctest
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2020-05-15 09:16:22 +08:00
1c32a8ba2e
HBASE-24271 Set values in `conf/hbase-site.xml` that enable running on `LocalFileSystem` out of the box
...
Simplify the new user experience shipping a configuration that enables
a fresh checkout or tarball distribution to run in standalone mode
without direct user configuration. This change restores the behavior
we had when running on Hadoop 2.8 and earlier.
Patch for master includes an update to the book. This change will be
omitted when backporting to earlier branches.
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-14 14:05:40 -07:00
2ab394ddb1
Revert "HBASE-24086 Disable output stream capability enforcement when running on LocalFileSystem"
...
This reverts commit 4e31ada43b
2020-05-14 14:05:40 -07:00
a93d94cad3
Amend HBASE-24350: Extending and Fixing HBaseTable level replication metrics ( #1704 )
...
- Rename WALEntryBatch#getWaEntriesWithSize -> getWalEntriesWithSize
2020-05-14 13:42:35 -07:00
1ff532678d
HBASE-24350: Extending and Fixing HBaseTable level replication metrics ( #1704 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-05-14 13:36:11 -07:00
2e4be3e77d
HBASE-24368 Let HBCKSCP clear 'Unknown Servers', even if RegionStateNode has RegionLocation == null
...
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/GCMultipleMergedRegionsProcedure.java
Edit a log.
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/HBCKServerCrashProcedure.java
Add override of isMatchingRegionLocation. Allow 'null' as a pass in
HBCKSCP.
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/ServerCrashProcedure.java
Add a method for HBCKSCP to override and be less strict filtering
assigns.
hbase-server/src/main/resources/hbase-webapps/master/hbck.jsp
Some doc on what 'Unknown Servers' are.
2020-05-14 13:07:59 -07:00
941cef71c2
HBASE-24190 : Make kerberos value of hbase.security.authentication property case insensitive ( #1687 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-14 11:46:33 +05:30
b78f4367f7
Revert "Make kerberos value of hbase.security.authentication property case insensitive ( #1687 )"
...
This reverts commit c03ec837e7
2020-05-14 11:45:23 +05:30
8d4cb772b8
HBASE-24164 Retain the ReadRequests and WriteRequests of region on we… ( #1500 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-13 22:30:24 -07:00
cb17d70226
Revert "HBASE-24327 : Flaky connection in TestMasterShutdown#testMasterShutdo… ( #1690 )"
...
This reverts commit d9b60d3339
2020-05-13 22:12:58 +05:30
5f8fde1673
HBASE-24309 Addendum fix assembly config file
2020-05-13 18:40:45 +08:00
dc2146069c
HBASE-24309 Avoid introducing log4j and slf4j-log4j dependencies for … ( #1697 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-13 17:59:21 +08:00
d9b60d3339
HBASE-24327 : Flaky connection in TestMasterShutdown#testMasterShutdo… ( #1690 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-05-13 02:40:36 +05:30
231d7f8256
HBASE-24354 Make it so can make an hbase1 schema and hbase2 schema equate ( #1696 )
2020-05-12 12:34:14 -07:00
d85caaa195
HBASE-23832 Old config hbase.hstore.compactionThreshold is ignored ( #1698 )
...
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
2020-05-12 23:20:48 +05:30
b7f7326950
HBASE-24256 When fixOverlap hits the max region limit, it is possible to include the same region in multiple merge request ( #1584 ) ( #1694 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-12 09:54:12 -07:00
a7e3c03541
HBASE-24355 Fix typos in the HStore#compact annotation ( #1699 )
...
Co-authored-by: guo.kangkang <guo.kangkang@immomo.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-12 21:08:16 +05:30
5c08a8c04b
HBASE-24338 [Flakey Tests] NPE in TestRaceBetweenSCPAndDTP Addendum2: make same fix for TestRaceBetweenSCPAndTRSP but in a second place (addendum 1 got first place).
2020-05-11 20:50:05 -07:00
cf786a2dfb
HBASE-24338 [Flakey Tests] NPE in TestRaceBetweenSCPAndDTP
...
Addendum: make same fix for TestRaceBetweenSCPAndTRSP which does same
thing.
2020-05-11 14:08:50 -07:00
60035721ca
Revert "HBASE-24327 : Handle shutdown() if master cannot be contacted ( #1684 )"
...
This reverts commit a89967dfe8
2020-05-11 16:50:01 +05:30
2993a95ee2
HBASE-24321 - Add writable MinVersions and read-only Scan to coproc S… ( #1655 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lars Hofhansl <larsh@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-11 12:55:45 +05:30
c03ec837e7
Make kerberos value of hbase.security.authentication property case insensitive ( #1687 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-11 11:10:29 +05:30
a89967dfe8
HBASE-24327 : Handle shutdown() if master cannot be contacted ( #1684 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-05-10 17:14:32 +05:30
11ef0fd752
HBASE-24345 [ACL] renameRSGroup should require Admin level permission ( #1686 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
2020-05-09 23:33:27 +08:00
f41c9038e7
HBASE-24333 Backport HBASE-24304 "Separate a hbase-asyncfs module" to branch-2.x ( #1664 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-09 12:00:45 +08:00
f7deadc9af
HBASE-24284 [h3/jdk11] REST server won't start Exclude transitive includes of jax-rs 1.x and then explicitly include jax-rs 2.x glassfish impl for REST context when hadoop3. ( #1625 )
...
Addendum to fix failing MR tests; e.g. TestExportSnapshot.
2020-05-08 13:00:07 -07:00
ec333922ce
HBASE-24310 Use Slf4jRequestLog for hbase-http ( #1634 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-08 11:22:18 +08:00
406a3e8178
HBASE-24338 [Flakey Tests] NPE in TestRaceBetweenSCPAndDTP #1669
...
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-07 13:43:35 -07:00
618dca5782
HBASE-24338 [Flakey Tests] NPE in TestRaceBetweenSCPAndDTP
2020-05-07 13:30:23 -07:00
c28555c683
HBASE-24295 [Chaos Monkey] abstract logging through the class hierarchy ; ADDENDUM
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-05-07 13:24:23 -07:00
ba85ea3eff
HBASE-24342 [Flakey Tests] Disable TestClusterPortAssignment.testClusterPortAssignment as it can't pass 100% of the time
2020-05-07 13:20:54 -07:00
735aa8bf9f
HBASE-24328 skip duplicate GCMultipleMergedRegionsProcedure while previous finished ( #1672 )
...
Co-authored-by: niuyulin <niuyulin@xiaomi.com>
2020-05-07 10:25:25 -07:00
f98c0fc4ec
HBASE-24335 Support deleteall with ts but without column in shell mode ( #1668 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
(cherry picked from commit 2cafe81e9c
2020-05-07 18:24:08 +01:00
fca0f3f810
HBASE-24316 GCMulitpleMergedRegionsProcedure is not idempotent ( #1660 ) ( #1671 )
...
It addresses couple issues:
1. Make sure deleteMergeQualifiers() does not delete the row if there is no columns with "merge" keyword.
2. GCMulitpleMergedRegionsProcedure now acquire an exclusive lock on the child region.
Signed-off-by: stack <stack@apache.org>
2020-05-06 16:07:21 -07:00
04ac08d49b
HBASE-24273 HBCK's "Orphan Regions on FileSystem" reports regions with referenced HFiles ( #1613 ) ( #1661 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-06 09:50:52 -07:00
89ae3c55c8
HBASE-24331 [Flakey Test] TestJMXListener rmi port clash ( #1657 )
...
Add check that we can make jmx connector in setup. If we can't retry.
2020-05-06 09:27:52 -07:00
20a7a542ff
HBASE-24336 [Metrics] FSDataInputStream's localBytesRead is wrong ( #1667 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
2020-05-06 19:36:53 +08:00
edd8829cfc
HBASE-24211: Create table is slow in large cluster when AccessController is enabled. ( #1631 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-06 15:17:34 +05:30
7f4683bafa
HBASE-24265 Remove hedged rpc call support, implement the logic in MaterRegistry … ( #1593 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-05-06 16:11:28 +08:00
e6b8ca9dcf
HBASE-23976 Use nio for file manipulation in TestVerifyBucketCacheFile ( #1342 )
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2020-05-05 22:05:25 -07:00
99e96cca3b
HBASE-24118 [Flakey Tests] TestCloseRegionWhileRSCrash
...
Addendum; add back bit missing off end of test.
2020-05-05 21:15:22 -07:00
Viraj Jasani
Nick Dimiduk
niuyulin
Mingliang Liu
ramkrish86
binlijin
Baiqiang Zhao
XinSun
Guanghao Zhang
Andrew Purtell
Sandeep Pal
stack
shahrs87
bsglz
Duo Zhang
Michael Stack
Sambit Mohapatra
huaxiangsun
Gkkkk302
Geoffrey Jacoby
Reid Chan
Mohammad Arshad