Commit Graph

16735 Commits

Author SHA1 Message Date
Jan Hentschel 46a432386e
HBASE-22746 Removed deprecated methods from Delete
Signed-off-by: stack <stack@apache.org>
2019-07-30 08:52:19 +02:00
openinx c286a31590
HBASE-22758 Remove the unneccesary info cf deletion in DeleteTableProcedure#deleteFromMeta (#424) 2019-07-30 14:16:08 +08:00
stack 0c80d5b42b HBASE-22723 Have CatalogJanitor report holes and overlaps; i.e. problems it sees when doing its regular scan of hbase:meta
Refactor of CatalogJanitor so it generates a
Report on the state of hbase:meta when it runs. Also
refactor so CJ runs even if RIT (previous it would
punt on running if RIT) so it can generate a 'Report'
on the interval regardless. If RIT, it just doesn't
go on to do the merge/split GC as it used to.

If report finds an issue, dump as a WARN message
to the master log.

Follow-on is to make the Report actionable/available
for the Master to pull when it goes to draw the hbck
UI page (could also consider shipping the Report as
part of ClusterMetrics?)

Adds new, fatter Visitor to CJ, one that generates
Report on each run keeping around more findings as
it runs.

Moved some methods around so class reads better;
previous methods were randomly ordered in the class.

M hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
 Make a few handy methods public.

M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionInfo.java
 Add utility as defaults on the Inteface; i.e. is this the first region
 in table, is it last, does a passed region come next, or does passed
 region overlap this region (added tests for this new stuff).

M hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
 Bugfix... handle case where buffer passed is null.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
 Lots of change, reorg., but mostly adding consistency checking
 to the visitor used scanning hbase:meta on a period and the
 generation of a Report on what the scan has found traversing
 hbase:meta. Added a main so could try the CatalogJanitor against
 a running cluster.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestCatalogJanitorCluster.java
 Fat ugly test for CatalogJanitor consistency checking.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionInfo.java
 Add tests for new functionality in RI.

M hbase-shell/src/main/ruby/hbase/table.rb
 Bug fix for case where meta has a null regioninfo; scan was aborting.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-07-29 16:00:57 -07:00
stack f68cda32e1 HBASE-22751 table.jsp fails if ugly regions in table 2019-07-29 09:38:46 -07:00
Venkatesh Sridharan 11f30de2cf HBASE-22313 Add method to FsDelegation token to accept token kind (#199)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-29 11:18:19 +02:00
Jan Hentschel 41490e792a HBASE-22754 Removed deprecated methods from Increment (#421)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-29 09:10:51 +02:00
Jan Hentschel c68e2f274a HBASE-22756 Removed deprecated method from SingleColumnValueFilter (#422)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-29 09:10:00 +02:00
Jan Hentschel e273d0bc3a
HBASE-22748 Removed deprecated methods from Put
Signed-off-by: stack <stack@apache.org>
2019-07-29 08:50:16 +02:00
meiyi 7294af8b15
HBASE-22580 Add a table attribute to make user scan snapshot feature configurable for table (#336) 2019-07-29 09:51:26 +08:00
Viraj Jasani 064f5f1394 HBASE-22743 : ClientUtils for Demo Client classes (#413) 2019-07-28 10:01:45 +08:00
Jan Hentschel 3318b4bc6d
HBASE-22745 Removed deprecated methods from Append
Signed-off-by: stack <stack@apache.org>
2019-07-27 15:19:56 +02:00
Guanghao Zhang cf8114a82e
HBASE-22709 Add a chore thread in master to do hbck checking (#404)
Signed-off-by: stack <stack@apache.org>
2019-07-27 18:23:37 +08:00
Guanghao Zhang 1cb37f18aa
HBASE-22742 [HBCK2] Add more log for hbck operations at master side
Signed-off-by: stack <stack@apache.org>
2019-07-27 12:25:11 +08:00
stack fa77c75848 HBASE-22382 Refactor tests in TestFromClientSide; ADDENDUM to fix tests 2019-07-26 13:28:06 -07:00
Wellington Chevreuil 3708198817 HBASE-21773 rowcounter utility should respond to pleas for help
Signed-off-by: stack <stack@apache.org>
2019-07-26 21:19:17 +01:00
linkaline 747d000808 HBASE-22733 TestSplitTransactionOnCluster.testMasterRestartAtRegionSplitPendingCatalogJanitor is flakey (#408)
Signed-off-by: stack <stack@apache.org>
2019-07-25 11:09:07 -07:00
syedmurtazahassan de98fee288 HBASE-22702 [Log] 'Group not found for table' is chatty
Signed-off-by Reid Chan <reidchan@apache.org>
2019-07-25 23:13:40 +08:00
Pankaj b83d0c035f HBASE-22628 [Addendum] Document the custom WAL directory (hbase.wal.dir) usage
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-07-25 15:11:14 +08:00
Jan Hentschel e28afec9ec HBASE-22594 Clean up for backup examples (#315)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-25 13:35:44 +08:00
Jeongdae Kim a65e72d5da
HBASE-22715 All scan requests should be handled by scan handler threads in RWQueueRpcExecutor (#393)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestSimpleRpcScheduler.java
2019-07-24 11:57:04 -07:00
Jan Hentschel 2edbf0b85a HBASE-22692 Rubocop definition is not used in the /bin directory
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-24 11:16:06 +02:00
meiyi a399a1452b HBASE-22578 HFileCleaner should not delete empty ns/table directories used for user san snapshot feature (#337) 2019-07-24 15:14:56 +08:00
Andor Molnár 542ae47797 HBASE-22382 Refactor tests in TestFromClientSide (#385)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-24 14:08:45 +08:00
Pankaj 7ebf80fe1d HBASE-22628 Document the custom WAL directory (hbase.wal.dir) usage
Signed-off-by Reid Chan <reidchan@apache.org>
2019-07-24 10:45:45 +08:00
Duo Zhang 20ee7ab154
HBASE-22722 Upgrade jackson databind dependencies to 2.9.9.1 (#402)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-07-24 10:02:49 +08:00
Guanghao Zhang 6705d4ffdf
HBASE-22721 Refactor HBaseFsck: move the inner class out
Signed-off-by: stack <stack@apache.org>
2019-07-24 08:02:41 +08:00
Balazs Meszaros e74d501df9
HBASE-15666 shaded dependencies for hbase-testing-util
HBASE-15666 shaded dependencies for hbase-testing-util

Added new artifact hbase-shaded-testing-util. It wraps a whole hbase-server
with its testing dependencies. Users should use only the following dependency
in pom:

<dependency>
  <groupId>org.apache.hbase</groupId>
  <artifactId>hbase-shaded-testing-util</artifactId>
  <version>${hbase.version}</version>
  <scope>test</scope>
</dependency>

Added hbase-shaded-testing-util-tester maven module which ensures
that hbase-shaded-testing-util works with a shaded client.

Signed-off-by: Josh Elser <elserj@apache.org>
2019-07-23 15:22:00 +02:00
syedmurtazahassan d9493c539f HBASE-22603 Javadoc Warnings related to @link tag
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-07-23 14:14:12 +02:00
Peter Somogyi b6d4529102 HBASE-22720 Incorrect link for hbase.unittests
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-07-23 13:55:59 +02:00
syedmurtazahassan 06f5c43de3 HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize
Signed-off-by: Reid Chan <reidchan@apache.org>
Co-authored-by: Reid Chan <reidchan@apache.org>
2019-07-23 11:27:02 +08:00
Reid Chan 0e34dcbf4b Revert "HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize"
Reason: Deprecated a wrong parameter.

This reverts commit fe450b50c1.
2019-07-23 11:04:13 +08:00
syedmurtazahassan fe450b50c1 HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize
* HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize.

* HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize. Deprecated old attribute and introduced a new one

* HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize. Removed unnecessary import

* HBASE-22610 added two import configs and removed one

Signed-off-by: Reid Chan <reidchan@apache.org>
2019-07-23 10:40:32 +08:00
Viraj Jasani 9615c644f5 HBASE-22648 Snapshot TTL (#371)
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-07-22 15:03:44 -07:00
Toshihiro Suzuki 7f68591767 HBASE-22690 Deprecate / Remove OfflineMetaRepair in hbase-2+
Signed-off-by: stack <stack@apache.org>
2019-07-22 22:57:33 +09:00
Viraj Jasani aa9679ddbc HBASE-22718 Removal of org.apache.hadoop.hbase.util.Counter (#396)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-22 13:56:08 +02:00
Duo Zhang c9293b0b12 HBASE-22719 Add debug support for github PR pre commit job 2019-07-22 13:49:27 +08:00
openinx 00075ea4fc
HBASE-22663 The HeapAllocationRatio in WebUI is not accurate because all of the heap allocation will happen in another separated allocator named HEAP (#365) 2019-07-20 23:30:08 +08:00
Geoffrey Jacoby 1ad48c1ebc
HBASE-22622 WALKey Extended Attributes (#352)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-07-19 15:30:38 -07:00
Guanghao 48c623c808
HBASE-22673 Avoid to expose protobuf stuff in Hbck interface
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-19 08:03:06 +08:00
sreenivasulureddy ed2d7e4110 HBASE-22537 Split happened Replica region can not be deleted after deleting table successfully and restarting RegionServer
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-07-18 16:16:15 +01:00
Guanghao Zhang 254dbd07fb HBASE-22527 [hbck2] Add a master web ui to show the problematic regions (addendum) 2019-07-18 17:50:44 +08:00
linkaline e08ac5fafb HBASE-21426 TestEncryptionKeyRotation.testCFKeyRotation is flaky (#375)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-07-18 09:02:17 +08:00
Guanghao Zhang f0cbdf8beb HBASE-22527 [hbck2] Add a master web ui to show the problematic regions 2019-07-18 08:23:12 +08:00
Guanghao 2b7e33fe52
HBASE-22704 Avoid NPE when access table.jsp and snapshot.jsp but master not finish initialization (#389) 2019-07-18 08:20:36 +08:00
stack 2afd5d05d4 HBASE-22685 Add to migration doc that meta should be healthy before upgrade 2019-07-17 15:03:26 -07:00
stack 82ea04dbab HBASE-7191 HBCK - Add offline create/fix hbase.version and hbase.id
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-17 07:50:41 -07:00
毛蛤丝 54b514d62a HBASE-22700:incorrect timeout in recommended ZooKeeper configuration
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-07-17 22:08:52 +08:00
linkaline 9d5e5adaf0 HBASE-20368 Fix RIT stuck when a rsgroup has no online servers but AM's pendingAssginQueue is cleared (#354) 2019-07-17 22:05:36 +08:00
Wellington Chevreuil 72e58a8fed HBASE-21462 Add note for CopyTable section explaining it does not perform a diff, but a full write from source to target
Signed-off-by: Josh Elser <elserj@apache.org>
2019-07-16 18:39:01 +01:00
Viraj Jasani cc38de1a39 HBASE-22643 : Delete region without archiving only if regiondir is present
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
2019-07-16 10:25:24 +01:00