f5b90fcc44
HBASE-24479: Deflake TestCompaction#testStopStartCompaction ( #1820 )
...
Polling of active compaction count is racy. Tightened the asserts
to be more reliable.
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-05-31 23:54:17 -07:00
4f49a96258
HBASE-24477: Move ConfigurationObserver and related classes to hbase-common ( #1815 )
...
This utility is useful for any module that wants to detect
dynamic config changes. Having it to hbase-common makes it
accessible to all the other modules.
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-31 11:18:16 -07:00
b4a4debdd9
HBASE-24475 Clean up the master thread name getting in SplitLogManager and AssignmentManager ( #1810 )
2020-05-30 22:23:04 -07:00
c120260bce
HBASE-24454 - Read ioErrorStartTime to local temporary variable to avoid issue when it is set to -1 between greater than zero check and calculation of error duration ( #1816 )
...
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
2020-05-30 21:06:40 -07:00
36a6ef9cf9
HBASE-24471 The way we bootstrap meta table is confusing ( #1806 )
...
Signed-off-by: Michael Stack <stack@apache.org>
2020-05-30 16:03:52 +08:00
f0f9a20cd7
HBASE-23941 : FilterBy operator support in get_slowlog_responses API ( #1793 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-05-30 12:59:59 +05:30
bda2094ae5
HBASE-22287 inifinite retries on failed server in RSProcedureDispatcher ( #1800 )
...
Adds backoff in place of retry every 100ms.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-29 10:04:02 -07:00
da2e03bb3b
HBASE-24470 : Add store file info when log meessages in HStore. ( #1804 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-29 18:58:57 +05:30
bf869def43
HBASE-24428 : Fix for testSplitCompactWithPriority (ADDENDUM)
2020-05-29 18:15:40 +05:30
7b7e25a50b
HBASE-24451 Remove the HasThread because the related bug had been fixed since jdk7 ( #1797 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-29 17:33:18 +05:30
f06248ef84
HBASE-24443 Refactor TestCustomSaslAuthenticationProvider ( #1790 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-05-28 20:44:31 +08:00
48e9835adb
HBASE-24428 : Update compaction priority for recently split daughter regions ( #1784 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-05-27 20:56:41 +05:30
aacb69d098
HBASE-24371 Add more details when print CompactionConfiguration info ( #1711 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2020-05-27 19:41:43 +08:00
476cb16232
HBASE-24437 Addendum just start mini dfs cluster, and make the log roll more robust ( #1787 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-27 11:25:25 +08:00
e39fd6d11b
HBASE-24425 Run hbck_chore_run and catalogjanitor_run on draw of 'HBCK Report' page ( #1771 )
...
Signed-off-by: clarax
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.com>
2020-05-26 19:51:50 -07:00
a9205f8f4d
HBASE-24437 Flaky test, TestLocalRegionOnTwoFileSystems#testFlushAndCompact
...
Force another WAL roll just in case and make the check more loose (its
about whether the files are present, not their count)
2020-05-26 11:57:19 -07:00
e06e1dba10
HBASE-24416 RegionNormalizer spliting region should not be limited by hbase.normalizer.min.region.count ( #1770 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-05-26 17:03:14 +08:00
29c59c0ba8
HBASE-24423 No need to get lock in canSplit because hasReferences will get lock too
2020-05-25 22:52:38 -07:00
285e59af25
HBASE-24427 HStore.add log format error ( #1773 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-25 18:28:12 +05:30
301659dcc7
HBASE-24426 : Provide regionName in warning during failure to move region from CLOSING to CLOSED ( #1772 )
...
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-05-25 17:33:15 +05:30
006e4d5e46
HBASE-24401 Cell size limit check on append should consider 0 or less value to disable the check ( #1742 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-05-25 09:58:01 +08:00
eaa2762a4e
HBASE-24369 Provide more information about merged child regions in Hbck Overlaps section, which cannot be fixed immediately ( #1756 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Clara Xiong
Signed-off-by: stack <stack@apache.org>
2020-05-24 17:21:04 -07:00
c303f9d329
HBASE-24408 Introduce a general 'local region' to store data on master ( #1753 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-23 15:59:51 +08:00
2b894dc100
HBASE-24379 CatalogJanitor misreports region holes when there are actually over laps. ( #1741 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-22 16:55:54 -07:00
0ce85fe63c
HBASE-24407 Correct the comment of clusterRegionLocationMocks in TestStochasticLoadBalancer ( #1750 )
2020-05-22 14:14:59 -07:00
80b64ef4dc
HBASE-24376 MergeNormalizer is merging non-adjacent regions and causing region overlaps/holes. ( #1734 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-05-21 10:08:43 -07:00
a8724e8120
HBASE-24370 Avoid aggressive MergeRegion and GCMultipleMergedRegionsProcedure ( #1719 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-05-20 14:18:58 -07:00
86a2692dc4
HBASE-23938 : System table hbase:slowlog to store complete slow/large… ( #1681 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
2020-05-20 15:10:29 +05:30
8f4c255b38
HBASE-24386 TableSnapshotScanner support scan limit ( #1724 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off by: Viraj Jasani <vjasani@apache.org>
2020-05-19 20:52:28 +05:30
af8398a0ac
HBASE-24365 MetricsTableWrapperAggregateImpl runnable fails due to exception and never runs ( #1729 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off by: Viraj Jasani <vjasani@apache.org>
2020-05-18 15:11:02 +05:30
6ce1e140ee
HBASE-24377 MemStoreFlusher throw NullPointerException ( #1721 )
...
Signed-off-by: Ramkrishna <ramkrishna@apache.org>
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-18 09:58:28 +08:00
61efb6d5ad
HBASE-24381 The Size metrics in Master Webui is wrong if the size is 0 ( #1723 )
2020-05-18 09:14:36 +08:00
15627bb722
HBASE-24327 : Flaky connection in TestMasterShutdown (ADDENDUM)
2020-05-16 12:29:16 +05:30
bab4b1cf8c
HBASE-23702 hbase.hstore.flusher.count setting to 0 breaks HMaster ( #1703 )
...
Co-authored-by: Ctest
Signed-off-by: Anoop Sam John <anoop.hbase@gmail.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2020-05-15 09:21:53 +08:00
94f36fdb8e
Amend HBASE-24350: Extending and Fixing HBaseTable level replication metrics ( #1704 )
...
- Rename WALEntryBatch#getWaEntriesWithSize -> getWalEntriesWithSize
2020-05-14 13:42:48 -07:00
32e2682310
HBASE-24368 Let HBCKSCP clear 'Unknown Servers', even if RegionStateNode has RegionLocation == null
...
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/GCMultipleMergedRegionsProcedure.java
Edit a log.
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/HBCKServerCrashProcedure.java
Add override of isMatchingRegionLocation. Allow 'null' as a pass in
HBCKSCP.
hbase-server/src/main/java/org/apache/hadoop/hbase/master/procedure/ServerCrashProcedure.java
Add a method for HBCKSCP to override and be less strict filtering
assigns.
hbase-server/src/main/resources/hbase-webapps/master/hbck.jsp
Some doc on what 'Unknown Servers' are.
2020-05-14 13:09:03 -07:00
2e5a664233
HBASE-24350: Extending and Fixing HBaseTable level replication metrics ( #1704 )
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2020-05-14 10:34:51 -07:00
5e32e08782
HBASE-24164 Retain the ReadRequests and WriteRequests of region on we… ( #1500 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-13 22:28:45 -07:00
a40a0322a7
HBASE-23969 Meta browser should show all `info` columns ( #1485 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-13 11:50:53 -07:00
a782531633
HBASE-24327 : Flaky connection in TestMasterShutdown#testMasterShutdo… ( #1690 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-05-13 02:38:47 +05:30
9e73244082
HBASE-24355 Fix typos in the HStore#compact annotation ( #1699 )
...
Co-authored-by: guo.kangkang <guo.kangkang@immomo.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-12 21:07:49 +05:30
8601416ee8
HBASE-24309 Avoid introducing log4j and slf4j-log4j dependencies for modules other than hbase-assembly ( #1640 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-12 12:03:30 +08:00
bb3191c563
HBASE-24338 [Flakey Tests] NPE in TestRaceBetweenSCPAndDTP Addendum2: make same fix for TestRaceBetweenSCPAndTRSP but in a second place (addendum 1 got first place).
2020-05-11 20:48:21 -07:00
2c11d5a0a0
HBASE-24338 [Flakey Tests] NPE in TestRaceBetweenSCPAndDTP
...
Addendum: make same fix for TestRaceBetweenSCPAndTRSP which does same
thing.
2020-05-11 14:06:56 -07:00
68229c9c99
HBASE-24341 The region should be removed from ConfigurationManager as a ConfigurationObserver when it is closed ( #1675 )
...
Co-authored-by: Joseph295 <johnhomsea@gmail.com>
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
2020-05-11 17:31:54 +05:30
6729cafa1d
Revert "HBASE-24327 : Handle shutdown() if master cannot be contacted ( #1684 )" ( #1691 )
...
This reverts commit 34a74534fe
2020-05-11 16:43:49 +05:30
ca81283fe5
HBASE-24321 - Add writable MinVersions and read-only Scan to coproc S… ( #1655 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Lars Hofhansl <larsh@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-11 12:54:22 +05:30
34a74534fe
HBASE-24327 : Handle shutdown() if master cannot be contacted ( #1684 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-05-10 17:09:51 +05:30
30f07e8187
HBASE-24256 When fixOverlap hits the max region limit, it is possible to include the same region in multiple merge request ( #1584 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-08 10:16:42 -07:00
0cd70ed89c
HBASE-24345 [ACL] renameRSGroup should require Admin level permission ( #1683 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-08 18:56:05 +08:00
03e5a1402d
HBASE-24305 Removed deprecations in ServerName ( #1666 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-05-08 09:41:55 +02:00
fc283f7a68
HBASE-24338 [Flakey Tests] NPE in TestRaceBetweenSCPAndDTP #1669
...
Signed-off-by: Lijin Bin <binlijin@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-05-07 13:54:45 -07:00
d30268d0ee
HBASE-24342 [Flakey Tests] Disable TestClusterPortAssignment.testClusterPortAssignment as it can't pass 100% of the time
2020-05-07 13:22:35 -07:00
f4a446c3d2
HBASE-24328 skip duplicate GCMultipleMergedRegionsProcedure while previous finished ( #1629 )
...
Signed-off-by: huaxiangsun <huaxiangsun@apache.org>
2020-05-06 10:06:49 -07:00
6f059ecff0
HBASE-24331 [Flakey Test] TestJMXListener rmi port clash ( #1657 )
...
Add check that we can make jmx connector in setup. If we can't retry.
2020-05-06 09:29:57 -07:00
c32d18d4fb
HBASE-24336 [Metrics] FSDataInputStream's localBytesRead is wrong ( #1667 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
2020-05-06 19:24:05 +08:00
294c228c67
HBASE-24211: Create table is slow in large cluster when AccessController is enabled. ( #1631 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-05-06 15:12:20 +05:30
c1cb22f0b3
HBASE-24265 Remove hedged rpc call support, implement the logic in MaterRegistry … ( #1593 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-05-06 15:55:26 +08:00
a9a1b9524d
HBASE-24304 Separate a hbase-asyncfs module ( #1628 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-06 14:40:21 +08:00
045c909bdf
HBASE-24316 GCMulitpleMergedRegionsProcedure is not idempotent ( #1660 )
...
It addresses couple issues:
1. Make sure deleteMergeQualifiers() does not delete the row if there is no columns with "merge" keyword.
2. GCMulitpleMergedRegionsProcedure now acquire an exclusive lock on the child region.
Signed-off-by: stack <stack@apache.org>
2020-05-05 23:04:48 -07:00
07077a3950
HBASE-23976 Use nio for file manipulation in TestVerifyBucketCacheFile ( #1342 )
...
Signed-off-by: Wei-Chiu Chuang <weichiu@apache.org>
2020-05-05 22:04:26 -07:00
33eadb5bb1
HBASE-24307 [Flakey Tests] krb server for secure thrift tests throws BindException ( #1656 )
...
Move the random free port generate back into hbasecommontestingutility
from hbasetestingutility.
Add a create simple kdc server utility that will start a kdc server and
if a bindexception, create a new one on a new random port in hbase-common.
Add new BoundSocketMaker helpful when trying to manufacture
BindExceptions because of port clash.
Change thrift and http kdc tests to use this new utility (removes
code duplication around kdc server setup).
2020-05-05 21:36:59 -07:00
24c995da97
HBASE-24118 [Flakey Tests] TestCloseRegionWhileRSCrash
...
Addendum; add back bit missing off end of test.
2020-05-05 21:16:33 -07:00
3d96007c37
HBASE-24137:The max merge count of metafixer may be remind in hbase-site.xml ( #1478 )
2020-05-05 16:14:14 -07:00
5488124be0
HBASE-24284 [h3/jdk11] REST server won't start Exclude transitive includes of jax-rs 1.x and then explicitly include jax-rs 2.x glassfish impl for REST context when hadoop3. ( #1625 )
2020-05-05 15:36:01 -07:00
a240ba8214
HBASE-24273 HBCK's "Orphan Regions on FileSystem" reports regions with referenced HFiles ( #1613 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-05 11:10:02 -07:00
3340c0024e
HBASE-24314 Some classes still use log4j logger directly ( #1637 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-05-05 20:03:55 +08:00
1b11ea2e1f
HBASE-23968 Periodically check whether a system stop is requested in compaction by time. ( #1274 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-04 14:45:20 -07:00
e37aafcfc2
HBASE-24260 Add a ClusterManager that issues commands via coprocessor
...
Implements `ClusterManager` that relies on the new
`ShellExecEndpointCoprocessor` for remote shell command execution.
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-05-04 10:53:02 -07:00
7313b4f5aa
HBASE-24311 Add more details in MultiVersionConcurrencyControl STUCK log message ( #1636 )
2020-05-04 21:26:29 +05:30
255470a139
HBASE-24246 Miscellaneous hbck2 fixMeta bulk merge fixes: better logging around merges/overlap-fixing, 'HBCK Report' overlap listing, and configuration ( #1572 )
...
Addendum to address minor feedback on text
2020-05-04 08:27:21 -07:00
ef4cc669b9
HBASE-24246 Miscellaneous hbck2 fixMeta bulk merge fixes: better logging around merges/overlap-fixing, 'HBCK Report' overlap listing, and configuration ( #1572 )
...
hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
Fix weird brackets around each region name when logging.
hbase-server/src/main/java/org/apache/hadoop/hbase/master/MetaFixer.java
Log when we hit the max merge limit. Also up limit to 64.
hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/MergeTableRegionsProcedure.java
Make logs make more sense to operator.
hbase-server/src/main/resources/hbase-webapps/master/hbck.jsp
Make RegionName show when you mouseover so long names don't mess up
display of holes and overlaps.
Address Mingliang Liu liuml07 feedback
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
2020-05-04 08:27:10 -07:00
c44bb2e99a
HBASE-24221 Support bulkLoadHFile by family (ADDENDUM)
...
Co-authored-by: niuyulin <niuyulin@xiaomi.com>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2020-05-04 15:21:38 +01:00
b6e81c0e3f
Revert "HBASE-24221 Support bulkLoadHFile by family, fix UT ( #1633 )"
...
This reverts commit 5d41588df6
2020-05-04 15:21:01 +01:00
5d41588df6
HBASE-24221 Support bulkLoadHFile by family, fix UT ( #1633 )
...
Co-authored-by: niuyulin <niuyulin@xiaomi.com>
2020-05-04 15:18:55 +01:00
d67f065594
[HBASE-24288]Allow admin user to create table and do bulkLoad ( #1612 )
...
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: binlijin <binlijin@gmail.com>
2020-05-01 11:57:33 -07:00
9785f5d1c9
HBASE-24199 Procedure related metrics is not consumed in the JMX metric ( #1616 )
...
Signed-off-by: stack <stack@apache.org>
2020-05-01 11:45:16 -07:00
e8504ba817
HBASE-24277 TestZooKeeper is flaky ( #1617 )
2020-05-01 20:34:42 +08:00
512d00e75d
HBASE-24221 Support bulkLoadHFile by family ( #1569 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-04-30 18:33:37 +08:00
b810c9bb91
HBASE-22710 Wrong result in one case of scan that use raw and version… ( #767 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-30 13:51:37 +05:30
856e21d199
HBASE-24282 'scanDetail' log message is missing when responseTooSlow happens on the first scan rpc call ( #1604 )
...
Signed-off-by: Guangxu Cheng <gxcheng@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-04-29 16:03:24 -07:00
e3c5527ce5
HBASE-24247 Failed multi-merge because two regions not adjacent (legitimately).
...
Addendum: Restore old semantic where merge of non-adjacent required
'force'
2020-04-29 14:35:48 -07:00
9cff7a4ff4
HBASE-24215 [Flakey Tests] [ERROR] TestSecureRESTServer java.lang.NoClassDefFoundError: com/sun/jersey/core/spi/factory/AbstractRuntimeDelegate
...
Addendum: Add jersey-servlet to hadoop3 profile.
Made the hadoop3 profile in top-level pom same as it is for hadoop2
when it comes to exclusions. Then backed out previous attempt mostly.
Made the failing test medium-sized so it ran in its own jvm.
2020-04-29 07:39:59 -07:00
f46dba865f
HBASE-24278 The Java doc for minFilesToCompact is wrong ( #1599 )
...
Co-authored-by: Joseph295 <johnhomsea@gmail.com>
SIgned-off-by: stack <stack@apache.org>
2020-04-28 22:09:56 -07:00
9f52e6b725
HBASE-24249 Move code in FSHDFSUtils to FSUtils and mark related clas… ( #1586 )
...
Signed-off-by: stack <stack@apache.org>
2020-04-29 10:44:34 +08:00
6928674eb8
HBASE-24228 Merge the code in hbase-hadoop2-compat module to hbase-hadoop-compat ( #1563 )
...
Signed-off-by: stack <stack@apache.org>
2020-04-29 10:34:53 +08:00
8fceec8cb1
HBASE-24247 Failed multi-merge because two regions not adjacent (legitimately) ( #1570 )
...
hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionInfo.java
Add new isOverlap method that takes list of RegionInfos checking that
current RegionInfo is overlapped by the passed in Regions.
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.com>
2020-04-28 13:24:04 -07:00
39a1bc53f8
Revert "HBASE-24212: Create table is slow in large cluster when AccessController is enabled. ( #1546 )"
...
Wrong JIRA issue number and also breaks TestAccessController.testAccessControllerUserPermsRegexHandling
This reverts commit e6cc5eb2f0
2020-04-27 22:45:52 +08:00
84f2e95dd5
HBASE-24264 Disable TestNettyIPC.testHedgedAsyncEcho ( #1589 )
2020-04-26 23:36:07 +08:00
ec0d9d767e
HBASE-23264 Resolve a TODO of BucketAllocator: "Why we add the extra … ( #801 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-26 15:15:31 +05:30
8774614a8c
HBASE-23881 Ensure Netty client receives at least one response before considering SASL negotiation complete
...
The PLAIN mechanism test added in the Shade authentication example has
different semantics than GSSAPI mechanism -- the client reports that the
handshake is done after the original challenge is computed. The javadoc
on SaslClient, however, tells us that we need to wait for a response
from the server before proceeding.
The client, best as I can see, does not receive any data from HBase;
however the application semantics (e.g. throw an exception on auth'n
error) do not work as we intend as a result of this bug.
Extra trace logging was also added to debug this, should a similar error
ever happen again with some other mechanism.
Closes #1260
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-04-26 10:24:07 +08:00
c1f0634462
Revert "HBASE-23381 Ensure Netty client receives at least one response before considering SASL negotiation complete"
...
Incorrect jira issue number
This reverts commit 78eecd3a7d
2020-04-26 10:23:40 +08:00
e6cc5eb2f0
HBASE-24211: Create table is slow in large cluster when AccessController is enabled. ( #1546 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
2020-04-25 17:41:43 +05:30
24961c5c34
HBASE-23848 Addendum fix TestSeekOptimizations ( #1574 )
2020-04-24 19:50:30 +08:00
6cea5c6462
HBASE-24222 remove FSUtils.checkAccess and replace with FileSystem.access in HBCK ( #1557 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-04-23 23:20:38 +08:00
4ed15e51d9
HBASE-24024 : Reject multi() requests with rows higher than threshold ( #1560 )
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-04-22 12:46:40 +05:30
75c717d4c2
HBASE-23848 Removed deprecated setStopRow from Scan ( #1184 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-04-22 15:15:17 +08:00
bc9184ee00
HBASE-23933 Separate a hbase-balancer module ( #1436 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-22 14:55:38 +08:00
5f45c8293d
HBASE-24139 : Balancer should avoid leaving idle region servers ( #1511 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
2020-04-22 09:51:53 +05:30
e7b5c34d28
HBASE-24226 Address other hard references to '/tmp' found in Configuration
2020-04-21 17:40:35 -07:00
5c53b606a9
HBASE-24175 : createDirAndSetProperty() (ADDENDUM)
2020-04-21 23:09:07 +05:30
7c2f13eb70
HBASE-24175 [Flakey Tests] TestSecureExportSnapshot FileNotFoundException
...
Addendum #3 ; catch more '/tmp' references by hadoop.
2020-04-21 09:41:24 -07:00
2d2e1d965d
HBASE-24220 Allow that zk NOTEMPTY multi exception is retryable by running in-series
...
hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapred/TableRecordReaderImpl.java
hbase-mapreduce/src/main/java/org/apache/hadoop/hbase/mapreduce/TableRecordReaderImpl.java
Cleanup checkstyle warnings. Don't depend on hbase-client
ScannerCallable.
hbase-mapreduce/src/test/java/org/apache/hadoop/hbase/snapshot/TestExportSnapshot.java
Cut down on cluster resource usage.
hbase-server/src/test/java/org/apache/hadoop/hbase/master/AbstractTestDLS.java
Debug
hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestAccessController3.java
Debug
hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/TestThriftHttpServer.java
Debug
hbase-zookeeper/src/main/java/org/apache/hadoop/hbase/zookeeper/MiniZooKeeperCluster.java
Debug
hbase-zookeeper/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKUtil.java
Allow that NONEMPTY is retryable by running in series.
2020-04-20 15:51:11 -07:00
bcacc4ce93
HBASE-23896 Snapshot owner cannot delete snapshot when ACL is enabled and Kerberos is not enabled ( #1211 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
2020-04-20 09:59:06 +08:00
8e5c6da3f0
HBASE-24166 Duplicate implementation for acquireLock between CreateTableProcedure and its parent class ( #1486 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-04-18 10:30:12 +08:00
5ff4376d80
HBASE-24182 log when the region is set to closing status ( #1509 )
...
Signed-off-by: stack <stack@apache.org>
2020-04-17 12:20:12 -07:00
db36cf71c5
HBASE-24174 Fix findbugs warning on ServiceAuthorizationManager for master branch ( #1537 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-18 01:24:31 +08:00
12aad76109
MetricsTable#updateFlushTime is wrong ( #1539 )
...
Authored-by: Gaurav Kanade <gkanade@microsoft.com>
Signed-off-by: Ramkrishna <ramkrishna@apache.org>
2020-04-17 15:40:27 +05:30
d212dc4df0
HBASE-24195 : Admin.getRegionServers() should return live servers exc… ( #1523 )
...
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-16 20:13:14 +05:30
a0ef4cb8a2
HBASE-24186: RegionMover ignores replicationId ( #1512 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-16 19:53:51 +05:30
1f66806c96
HBASE-24170 Remove hadoop-2.0 profile ( #1495 )
...
Signed-off-by: stack <stack@apache.org>
2020-04-16 18:57:40 +08:00
853a72bc46
HBASE-24175 [Flakey Tests] TestSecureExportSnapshot FileNotFoundException
...
Addendum: add test to check for '/tmp' references.
2020-04-15 10:55:40 -07:00
3421423dd6
HBASE-24183 [flakey test] replication.TestAddToSerialReplicationPeer ( #1514 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-04-15 10:07:57 -07:00
38954edb25
HBASE-23994: Add WebUI to Canary ( #1292 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-04-14 15:56:19 -07:00
cb60d23cb3
Revert "HBASE-23994:Add WebUI to Canary ( #1292 )"
...
This reverts commit daf79de329
2020-04-14 15:55:56 -07:00
daf79de329
HBASE-23994:Add WebUI to Canary ( #1292 )
...
HBASE-23994: Add WebUI to Canary
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2020-04-14 15:52:22 -07:00
92b30f2638
HBASE-24181 Add region info when log meessages in HRegion. ( #1506 )
...
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-14 19:36:16 +08:00
5f08311b23
HBASE-24134 Down forked JVM heap size from 2800m to 2200m for jdk8 and jdk11 ( #1451 ) ( #1503 )
...
Down jdk8 forked jvm heap from 2800 to 2200 and the jdk11 heap from
3200 to 2200. Down the mvn size from 4G to 3.6G
Change how many puts done by TestMultiRespectsLimits because made
the test run the forked heap over 2.5G in size.
Signed-off-by: Sean Busbey <busbey@apache.org>
2020-04-13 21:35:43 -07:00
ba34a2ca30
HBASE-24132 Upgrade to Apache ZooKeeper 3.5.7 ( #1453 )
...
* HBASE-24132 Upgrade to Apache ZooKeeper 3.5.7
* HBASE-24132 Upgrade to Apache ZooKeeper 3.5.7
Co-authored-by: 姜建飞 10222269 <jiang.jianfei@zte.com.cn>
Signed-off-by: Mate Szalay-Beko <szalay.beko.mate@gmail.com>
Signed-off-by: Norbert Kalmar <nkalmar@cloudera.com>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangdo@apache.org>
2020-04-13 13:46:37 -07:00
67b2e881ca
HBASE-24158 [Flakey Tests] TestAsyncTableGetMultiThreaded
2020-04-13 11:51:47 -07:00
64c7fc6a52
HBASE-24167 [Flakey Tests] TestHRegionWithInMemoryFlush#testWritesWhileScanning gets stuck MVCC
2020-04-13 11:44:07 -07:00
b00b5270f6
HBASE-24175 [Flakey Tests] TestSecureExportSnapshot FileNotFoundException
...
Overwrite yarn configs that write /tmp dir by default.
2020-04-13 11:29:25 -07:00
22675d8070
HBASE-24112 [RSGroup] Support renaming rsgroup ( #1435 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-04-13 14:04:32 +08:00
72764cf628
HBASE-24153 Revert "Revert "Remove unnecessary super() in MultiVersionConcurrencyControl#MultiVersionConcurrencyControl() ( #1468 )""
...
A revert of a revert; i.e. a reapplication to add missing JIRA number
This reverts commit c4026d1beb
2020-04-12 18:30:38 -07:00
c4026d1beb
Revert "Remove unnecessary super() in MultiVersionConcurrencyControl#MultiVersionConcurrencyControl() ( #1468 )"
...
Forgot to add JIRA number. Reverting to add.
This reverts commit 12a0c1d5fe
2020-04-12 18:30:11 -07:00
b6b8c6973d
HBASE-24140 : Move CandidateGenerator and their implementors out of StochasticLoadBalancer ( #1458 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-12 19:13:47 +05:30
12a0c1d5fe
Remove unnecessary super() in MultiVersionConcurrencyControl#MultiVersionConcurrencyControl() ( #1468 )
...
Signed-off-by: sunlisheng <lisheng.sun08@gmail.com>
Signed-off-by: Mingliang Liu <liuml07@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-10 15:43:10 -07:00
09d20fb4d7
HBASE-24163 MOB compactor implementations should use format specifiers when calling String.format ( #1479 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2020-04-10 11:00:53 -05:00
ac4e94e868
HBASE-24161 [flakey test] locking.TestEntityLocks.testEntityLockTimeout ( #1477 )
...
Signed-off-by: stack <stack@apache.org>
2020-04-09 21:13:06 -07:00
c92dd28a88
HBASE-24074 ConcurrentModificationException occured in ReplicationSourceManager while refreshing the peer ( #1471 )
...
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.com>
Signed-off-by: stack <stack@apache.org>
2020-04-09 16:40:15 -07:00
8aa3304427
HBASE-24159 [flakey test] regionserver.TestRegionMergeTransactionOnCluster ( #1472 )
...
Delete tables after each test cases to avoid polluting states.
Signed-off-by: stack <stack@apache.org>
2020-04-09 16:27:19 -07:00
1fb693b998
HBASE-24121 [Authorization] ServiceAuthorizationManager isn't dynamically updatable. And it should be ( #1439 )
...
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2020-04-09 16:28:22 +08:00
eb7df0498c
HBASE-23723 Ensure MOB compaction works in optimized mode after snapshot clone ( #1446 )
...
* Reorganize MOB compaction tests for more reuse.
* Add tests for mob compaction after snapshot clone operations
* note the original table used to write a given mob hfile and use that to find it later.
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2020-04-08 14:16:43 -05:00
2d78a286b6
HBASE-24138 log more details about balancer decisions for StochasticLoadBalancer ( #1455 )
...
- at DEBUG log messages about RegionCountSkewCostFunction region/server totals
- at DEBUG log messages about the decision to balance or not with total costs
- at TRACE log messages about region count on each server RegionCountSkewCostFunction sees
- at TRACE log message with the individual cost functions used in the decision to balance or not
Signed-off-by: Viraj Jasani <vjasani@apache.org>
2020-04-08 14:03:33 -05:00
ac6060c3f9
HBASE-24099 Use a fair ReentrantReadWriteLock for the region close lock ( #1407 )
...
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
2020-04-08 11:36:48 -07:00
72727ff9be
HBASE-23833. The relocated hadoop-thirdparty protobuf breaks HBase asyncwal ( #1301 )
...
* Use Reflection to access shaded Hadoop protobuf classes.
(cherry picked from commit a321e536989083ca3620bf2c53f12c07740bf5b0)
* Update to improve the code:
1. Added license.
2. Added more comments.
3. Wrap byte array instead of copy to make a ByteString.
4. Moved all reflection instantiation to static class loading time.
* Use LiteralByteString to wrap byte array instead of copying it.
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-04-08 11:31:51 -07:00
ed830222da
HBASE-24120 Flakey Test: TestReplicationAdminWithClusters timeout ( #1441 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2020-04-08 09:28:51 -07:00
d6451a8e2b
HBASE-24114 [Flakey Tests] TestSnapshotScannerHDFSAclController ( #1433 )
...
Signed-off-by: stack <stack@apache.org>
2020-04-07 20:36:11 -07:00
80d4a09ddc
HBASE-24128 [Flakey Tests] Add retry on thrift cmdline if client fails plus misc debug ( #1442 )
...
hbase-server/src/test/java/org/apache/hadoop/hbase/TestClusterPortAssignment.java
Saw case where Master failed startup but it came out as an IOE so we
did not trip the retry logic.
hbase-server/src/test/java/org/apache/hadoop/hbase/TestInfoServers.java
Add some debug and up timeouts. This test fails frequently for me
locally.
hbase-server/src/test/java/org/apache/hadoop/hbase/client/locking/TestEntityLocks.java
Up the wait from 2x 200ms to 10x in case a pause on hardware or GC.
This test fails locally and up on jenkins.
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestClearRegionBlockCache.java
Debug. Have assert say what bad count was.
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestCompactingToCellFlatMapMemStore.java
Fails on occasion. Found count is off by a few. Tricky to debug. HBASE-24129 to reenable.
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMergeTransactionOnCluster.java
Debug. Add wait and check before moving to assert.
hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/TestThriftHttpServer.java
Check for null before shutting; can be null if failed start.
hbase-thrift/src/test/java/org/apache/hadoop/hbase/thrift/TestThriftServerCmdLine.java
Add retry if client messes up connection. Fails for me locally.
2020-04-07 09:29:23 -07:00
f60f0bdbf0
HBASE-24055 Make AsyncFSWAL can run on EC cluster ( #1437 )
...
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: stack <stack@apache.org>
2020-04-07 23:41:35 +08:00
62718cdb28
HBASE-24077 When encounter RowTooBigException, log the row info. ( #1379 )
...
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2020-04-07 10:28:35 +08:00
0e30e00c56
HBASE-24118 [Flakey Tests] TestCloseRegionWhileRSCrash
...
Reapply but as an @Ignore for the flakey test.
2020-04-06 12:38:02 -07:00
0dc2712c90
Revert "HBASE-24118 [Flakey Tests] TestCloseRegionWhileRSCrash"
...
Reverting in favor of adding an @Ignore on this test until
root cause of flakyness HBASE-24117 is addressed.
This reverts commit 9985c06647
2020-04-06 12:35:52 -07:00
da67491a56
HBASE-24105 [Flakey Test] regionserver.TestRegionReplicas ( #1425 )
...
Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
Signed-off-by: stack <stack@apache.org>
2020-04-05 13:20:23 -07:00
9985c06647
HBASE-24118 [Flakey Tests] TestCloseRegionWhileRSCrash
2020-04-04 20:13:18 -07:00
2a95fffb3b
HBASE-24102 : Remove decommissioned RS from target servers while unlo… ( #1417 )
...
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Pankaj <pankajkumar@apache.org>
Signed-off-by: ramkrish86 <ramkrishna@apache.org>
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2020-04-03 18:28:49 +05:30
37aa6690b5
HBASE-24080 [flakey test] TestRegionReplicaFailover.testSecondaryRegionKill fails. ( #1421 )
...
Signed-off-by: stack <stack@apache.org>
2020-04-02 14:55:55 -07:00
b2c9a06dfd
HBASE-24103 [Flakey Tests] TestSnapshotScannerHDFSAclController ( #1416 )
...
Signed-off-by: stack <stack@apache.org>
2020-04-02 09:55:47 -07:00
f00753bacd
HBASE-24073 [flakey test] client.TestAsyncRegionAdminApi messed up compaction state. ( #1414 )
...
Addendum:
For major compaction test, set hbase.hstore.compaction.min to a big number to
avoid kicking in minor compactions, which will pollute compaction state and
sometimes, cause major compaction cannot happen.
Co-authored-by: Huaxiang Sun <huaxiangsun@apache.com>
Signed-off-by: stack <stack@apache.org>
2020-04-02 08:16:27 -07:00
0b3918fe56
HBASE-24021 Fail fast when bulkLoadHFiles method catch some IOException ( #1343 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2020-04-02 23:15:14 +08:00
Bharath Vissapragada
bsglz
jacob-leblanc
Duo Zhang
Viraj Jasani
Michael Stack
xincunSong
binlijin
stack
XinSun
WenFeiYi
wenbang
huaxiangsun
niuyulin
ramkrish86
Baiqiang Zhao
Guanghao Zhang
Andrew Purtell
Sandeep Pal
Mingliang Liu
Gkkkk302
Joseph295
Geoffrey Jacoby
Reid Chan
Jan Hentschel
Mohammad Arshad
Nick Dimiduk
Yu Wang
Minwoo Kang
Anoop Sam John
Wellington Chevreuil
gkanade
Josh Elser
Mohammad Arshad
Beata Sudi
Guangxu Cheng
BukrosSzabolcs
GeorryHuang
Jianfei Jiang
leosunli
Sean Busbey
Pankaj
Wei-Chiu Chuang
meiyi