Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,733 Commits 95 Branches 866 Tags
Commit Graph

8245 Commits

Author SHA1 Message Date
WenFeiYi
3b3bba1b64
HBASE-24444 Should shutdown mini cluster after class in TestMetaAssignmentWithStopMaster (#1802) 
* shutdown mini cluster after class

* fix

Co-authored-by: wen_yi <liu.wenwen@immomo.com>
 2020-06-09 08:14:18 +08:00
Duo Zhang
2dd34b3f01
HBASE-24517 AssignmentManager.start should add meta region to ServerStateNode (#1866) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
 2020-06-09 08:14:00 +08:00
huaxiangsun
71fae116c3
HBASE-23202 ExportSnapshot (import) will fail if copying files to root directory takes longer than cleaner TTL (#1874) 
Co-authored-by: Guangxu Cheng <guangxucheng@gmail.com>

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Zach York <zyork@apache.org>
 2020-06-08 14:57:48 -07:00
huaxiangsun
5042b591f8
Revert "HBASE-23202 ExportSnapshot (import) will fail if copying files to root directory takes longer than cleaner TTL (#1791)" (#1873) 
This reverts commit f862f3d9b53d1c7148ae3e04a339f733b3cfbd96.
 2020-06-08 14:51:59 -07:00
huaxiangsun
f862f3d9b5
HBASE-23202 ExportSnapshot (import) will fail if copying files to root directory takes longer than cleaner TTL (#1791) 
Co-authored-by: Huaxiang Sun <huaxiangsun@apache.org>

Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: Zach York <zyork@apache.org>
 2020-06-08 14:48:21 -07:00
gkanade
920d60f43b
HBASE-24208 Remove RS entry from zk draining servers node after RS been stopped (#1841) 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-08 22:47:00 +05:30
Duo Zhang
754ac1d06d
HBASE-24506 async client deadlock (#1858) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
 2020-06-08 09:38:58 +08:00
Toshihiro Suzuki
022dd9687f
HBASE-24515 batch Increment/Append fails when retrying the RPC (#1864) 
Signed-off-by: Viraj Jasani <virajjasani007@gmail.com>
 2020-06-08 09:51:21 +09:00
bsglz
66452afc09
HBASE-24496 The tag of Base Stats not actived by default in table.jsp (#1837) 
Signed-off-by: clarax
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-06-06 19:15:37 +05:30
Duo Zhang
16116fa35e
HBASE-24510 Remove HBaseTestCase and GenericTestUtils (#1859) 
Signed-off-by: Michael Stack <stack@apache.org>
 2020-06-06 19:06:11 +08:00
Duo Zhang
c91829bb41
HBASE-24491 Remove HRegionInfo (#1830) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-06-05 22:19:01 +08:00
Duo Zhang
2c2b1f0174
HBASE-24500 The behavior of RegionInfoBuilder.newBuilder(RegionInfo) is strange (#1850) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-06-05 15:19:04 +08:00
Duo Zhang
b2ec4c1ea0
HBASE-24505 Reimplement Hbck.setRegionStateInMeta (#1852) 
Signed-off-by: Wellington Ramos Chevreuil <wchevreuil@apache.org>
 2020-06-05 08:48:39 +08:00
Viraj Jasani
61a7468df7
HBASE-24456 : Create ImmutableScan and use it for CustomizedScanInfoBuilder (#1818) 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-06-04 16:25:47 +05:30
XinSun
59031ab661
HBASE-24359 Optionally ignore edits for deleted CFs for replication (#1722) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-06-04 17:52:52 +08:00
Duo Zhang
08c97d3a87 Revert "HBASE-24500 The behavior of RegionInfoBuilder.newBuilder(RegionInfo) is strange (#1840)" 
This reverts commit ee6938abda955776c25c0b5900d4b4c7b3616da3.
 2020-06-04 12:17:03 +08:00
Duo Zhang
ee6938abda
HBASE-24500 The behavior of RegionInfoBuilder.newBuilder(RegionInfo) is strange (#1840) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2020-06-04 11:06:41 +08:00
Bharath Vissapragada
60c9ae58fb
HBASE-21905: [FIFOCompaction] Don't compact already inflight store files (#1829) 
This one surfaced as a flake test but turns out to be a legit bug
in FIFOCompaction code. FifoCompaction does not check if an empty
store file is already being compacted by an in-flight compaction
request and still enqueues. It can potentially race with a running
compaction (as in this test case, see jira for the exact exception).

Fixes the edge case and cleans up the test code a bit.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2020-06-03 16:37:22 -07:00
Viraj Jasani
8de8c44029
HBASE-24492 : Remove infinite loop from ProtobufLogReader#readNext (#1831) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-06-03 13:41:15 +05:30
niuyulin
f71f1cdfa0
HBASE-24412 Canary support check only one column family per RegionTask (#1817) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-06-03 09:15:10 +08:00
XinSun
901187ae2f
HBASE-22738 Fallback to default group to choose RS when there are no RS in current group (#1789) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-06-03 08:26:05 +08:00
Nick Dimiduk
cb5c0d2782 HBASE-24418 Consolidate Normalizer implementations 
Simplify our Normalizer story to have just a single, configurable
implementation.

* fold the features of `MergeNormalizer` into
  `SimpleRegionNormalizer`, removing the intermediate abstract class.
* configuration keys for merge-only features now share a common
  structure.
* add configuration to selectively disable normalizer split/merge
  operations.
* `RegionNormalizer` now extends `Configurable` instead of creating a
  new instance of `HBaseConfiguration` or snooping one off of other
  fields.
* avoid the extra RPCs by using `MasterServices` instead of
  `MasterRpcServices`.
* boost test coverage of all the various flags and feature
  combinations.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: huaxiangsun <huaxiangsun@apache.org>
 2020-06-02 11:38:39 -07:00
Wellington Ramos Chevreuil
e5345b3a7c
HBASE-21406 "status 'replication'" should not show SINK if the cluste… (#1761) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2020-06-02 09:27:16 +01:00
Duo Zhang
bad2d4e409
HBASE-24474 Rename LocalRegion to MasterRegion (#1811) 
Signed-off-by: Michael Stack <stack@apache.org>
 2020-06-02 10:37:43 +08:00
Bharath Vissapragada
f5b90fcc44
HBASE-24479: Deflake TestCompaction#testStopStartCompaction (#1820) 
Polling of active compaction count is racy. Tightened the asserts
to be more reliable.

Signed-off-by: Reid Chan <reidchan@apache.org>
 2020-05-31 23:54:17 -07:00
Bharath Vissapragada
4f49a96258
HBASE-24477: Move ConfigurationObserver and related classes to hbase-common (#1815) 
This utility is useful for any module that wants to detect
dynamic config changes. Having it to hbase-common makes it
accessible to all the other modules.

Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-31 11:18:16 -07:00
bsglz
b4a4debdd9
HBASE-24475 Clean up the master thread name getting in SplitLogManager and AssignmentManager (#1810) 2020-05-30 22:23:04 -07:00
jacob-leblanc
c120260bce
HBASE-24454 - Read ioErrorStartTime to local temporary variable to avoid issue when it is set to -1 between greater than zero check and calculation of error duration (#1816) 
Signed-off-by Anoop Sam John <anoopsamjohn@apache.org>
 2020-05-30 21:06:40 -07:00
Duo Zhang
36a6ef9cf9
HBASE-24471 The way we bootstrap meta table is confusing (#1806) 
Signed-off-by: Michael Stack <stack@apache.org>
 2020-05-30 16:03:52 +08:00
Viraj Jasani
f0f9a20cd7
HBASE-23941 : FilterBy operator support in get_slowlog_responses API (#1793) 
Signed-off-by: Bharath Vissapragada <bharathv@apache.org>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
 2020-05-30 12:59:59 +05:30
Michael Stack
bda2094ae5 HBASE-22287 inifinite retries on failed server in RSProcedureDispatcher (#1800) 
Adds backoff in place of retry every 100ms.

Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2020-05-29 10:04:02 -07:00
xincunSong
da2e03bb3b
HBASE-24470 : Add store file info when log meessages in HStore. (#1804) 
Signed-off-by: binlijin <binlijin@gmail.com>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-29 18:58:57 +05:30
Viraj Jasani
bf869def43
HBASE-24428 : Fix for testSplitCompactWithPriority (ADDENDUM) 2020-05-29 18:15:40 +05:30
bsglz
7b7e25a50b
HBASE-24451 Remove the HasThread because the related bug had been fixed since jdk7 (#1797) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-29 17:33:18 +05:30
Duo Zhang
f06248ef84
HBASE-24443 Refactor TestCustomSaslAuthenticationProvider (#1790) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-05-28 20:44:31 +08:00
Viraj Jasani
48e9835adb
HBASE-24428 : Update compaction priority for recently split daughter regions (#1784) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2020-05-27 20:56:41 +05:30
binlijin
aacb69d098
HBASE-24371 Add more details when print CompactionConfiguration info (#1711) 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
 2020-05-27 19:41:43 +08:00
Duo Zhang
476cb16232
HBASE-24437 Addendum just start mini dfs cluster, and make the log roll more robust (#1787) 
Signed-off-by: stack <stack@apache.org>
 2020-05-27 11:25:25 +08:00
Michael Stack
e39fd6d11b HBASE-24425 Run hbck_chore_run and catalogjanitor_run on draw of 'HBCK Report' page (#1771) 
Signed-off-by: clarax
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Huaxiang Sun <huaxiangsun@apache.com>
 2020-05-26 19:51:50 -07:00
stack
a9205f8f4d HBASE-24437 Flaky test, TestLocalRegionOnTwoFileSystems#testFlushAndCompact 
Force another WAL roll just in case and make the check more loose (its
about whether the files are present, not their count)
 2020-05-26 11:57:19 -07:00
XinSun
e06e1dba10
HBASE-24416 RegionNormalizer spliting region should not be limited by hbase.normalizer.min.region.count (#1770) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-05-26 17:03:14 +08:00
Zheng Wang
29c59c0ba8 HBASE-24423 No need to get lock in canSplit because hasReferences will get lock too 2020-05-25 22:52:38 -07:00
WenFeiYi
285e59af25
HBASE-24427 HStore.add log format error (#1773) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
 2020-05-25 18:28:12 +05:30
Viraj Jasani
301659dcc7
HBASE-24426 : Provide regionName in warning during failure to move region from CLOSING to CLOSED (#1772) 
Signed-off-by: Anoop Sam John <anoopsamjohn@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2020-05-25 17:33:15 +05:30
wenbang
006e4d5e46
HBASE-24401 Cell size limit check on append should consider 0 or less value to disable the check (#1742) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2020-05-25 09:58:01 +08:00
huaxiangsun
eaa2762a4e
HBASE-24369 Provide more information about merged child regions in Hbck Overlaps section, which cannot be fixed immediately (#1756) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Clara Xiong
Signed-off-by: stack <stack@apache.org>
 2020-05-24 17:21:04 -07:00
Duo Zhang
c303f9d329
HBASE-24408 Introduce a general 'local region' to store data on master (#1753) 
Signed-off-by: stack <stack@apache.org>
 2020-05-23 15:59:51 +08:00
huaxiangsun
2b894dc100
HBASE-24379 CatalogJanitor misreports region holes when there are actually over laps. (#1741) 
Signed-off-by: stack <stack@apache.org>
 2020-05-22 16:55:54 -07:00
bsglz
0ce85fe63c
HBASE-24407 Correct the comment of clusterRegionLocationMocks in TestStochasticLoadBalancer (#1750) 2020-05-22 14:14:59 -07:00
huaxiangsun
80b64ef4dc
HBASE-24376 MergeNormalizer is merging non-adjacent regions and causing region overlaps/holes. (#1734) 
Signed-off-by: Viraj Jasani <vjasani@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
Signed-off-by: stack <stack@apache.org>
 2020-05-21 10:08:43 -07:00