16797 Commits

Author SHA1 Message Date
Guanghao Zhang
35acf3cb78
HBASE-22737 Add a new admin method and shell cmd to trigger the hbck chore to run (#425)
Signed-off-by: stack <stack@apache.org>
2019-08-01 08:54:47 +08:00
Peter Somogyi
4829c18251
HBASE-22768 Revert to MPIR 2.9 (#433)
Signed-off-by: stack <stack@apache.org>
2019-07-31 19:39:35 +02:00
Jan Hentschel
24b970ec51
Revert "HBASE-22744 Removed deprecated status and load classes in client module"
This reverts commit 4a61c8b10a912b10ba516b34f1c94aa4aa849aa8.
2019-07-31 12:29:19 +02:00
Sergey Shelukhin
caa05356a1 HBASE-22145 windows hbase-env causes hbase cli/etc to ignore HBASE_OPTS 2019-07-31 09:58:35 +02:00
Biju Nair
9a4a8ef274 HBASE-22363 Remove hardcoded number of read cache block buckets
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-31 09:13:17 +02:00
Jan Hentschel
586e177ded HBASE-22753 Removed deprecated ImmutableHRegionInfo (#420)
Signed-off-by: stack <stack@apache.org>
2019-07-31 08:07:31 +02:00
stack
373c2dc13f HBASE-22741 Show catalogjanitor consistency complaints in new 'HBCK Report' page
Signed-off-by: huzheng <openinx@gmail.com>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-07-30 11:16:45 -07:00
Thanh NM
5ce31dd120 HBASE-22714 - Fix opertationTimeout typo (#392)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-30 21:57:06 +08:00
Jan Hentschel
4a61c8b10a
HBASE-22744 Removed deprecated status and load classes in client module
Signed-off-by: stack <stack@apache.org>
2019-07-30 12:40:42 +02:00
Jan Hentschel
f9fd5b65fa HBASE-22752 Removed the deprecated ImmutableHColumnDescriptor and ImmutableHTableDescriptor (#419)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: stack <stack@apache.org>
2019-07-30 12:32:10 +02:00
Jan Hentschel
e3a54e7035
HBASE-22763 Fixed remaining Checkstyle issue in hbase-procedure
Signed-off-by: stack <stack@apache.org>
2019-07-30 09:54:05 +02:00
Jan Hentschel
124fa3488a
HBASE-22764 Fixed remaining Checkstyle issues in the hbase-rsgroup module
Signed-off-by: stack <stack@apache.org>
2019-07-30 08:55:40 +02:00
Jan Hentschel
46a432386e
HBASE-22746 Removed deprecated methods from Delete
Signed-off-by: stack <stack@apache.org>
2019-07-30 08:52:19 +02:00
openinx
c286a31590
HBASE-22758 Remove the unneccesary info cf deletion in DeleteTableProcedure#deleteFromMeta (#424) 2019-07-30 14:16:08 +08:00
stack
0c80d5b42b HBASE-22723 Have CatalogJanitor report holes and overlaps; i.e. problems it sees when doing its regular scan of hbase:meta
Refactor of CatalogJanitor so it generates a
Report on the state of hbase:meta when it runs. Also
refactor so CJ runs even if RIT (previous it would
punt on running if RIT) so it can generate a 'Report'
on the interval regardless. If RIT, it just doesn't
go on to do the merge/split GC as it used to.

If report finds an issue, dump as a WARN message
to the master log.

Follow-on is to make the Report actionable/available
for the Master to pull when it goes to draw the hbck
UI page (could also consider shipping the Report as
part of ClusterMetrics?)

Adds new, fatter Visitor to CJ, one that generates
Report on each run keeping around more findings as
it runs.

Moved some methods around so class reads better;
previous methods were randomly ordered in the class.

M hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
 Make a few handy methods public.

M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionInfo.java
 Add utility as defaults on the Inteface; i.e. is this the first region
 in table, is it last, does a passed region come next, or does passed
 region overlap this region (added tests for this new stuff).

M hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
 Bugfix... handle case where buffer passed is null.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
 Lots of change, reorg., but mostly adding consistency checking
 to the visitor used scanning hbase:meta on a period and the
 generation of a Report on what the scan has found traversing
 hbase:meta. Added a main so could try the CatalogJanitor against
 a running cluster.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestCatalogJanitorCluster.java
 Fat ugly test for CatalogJanitor consistency checking.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionInfo.java
 Add tests for new functionality in RI.

M hbase-shell/src/main/ruby/hbase/table.rb
 Bug fix for case where meta has a null regioninfo; scan was aborting.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-07-29 16:00:57 -07:00
stack
f68cda32e1 HBASE-22751 table.jsp fails if ugly regions in table 2019-07-29 09:38:46 -07:00
Venkatesh Sridharan
11f30de2cf HBASE-22313 Add method to FsDelegation token to accept token kind (#199)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-29 11:18:19 +02:00
Jan Hentschel
41490e792a HBASE-22754 Removed deprecated methods from Increment (#421)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-29 09:10:51 +02:00
Jan Hentschel
c68e2f274a HBASE-22756 Removed deprecated method from SingleColumnValueFilter (#422)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-29 09:10:00 +02:00
Jan Hentschel
e273d0bc3a
HBASE-22748 Removed deprecated methods from Put
Signed-off-by: stack <stack@apache.org>
2019-07-29 08:50:16 +02:00
meiyi
7294af8b15
HBASE-22580 Add a table attribute to make user scan snapshot feature configurable for table (#336) 2019-07-29 09:51:26 +08:00
Viraj Jasani
064f5f1394 HBASE-22743 : ClientUtils for Demo Client classes (#413) 2019-07-28 10:01:45 +08:00
Jan Hentschel
3318b4bc6d
HBASE-22745 Removed deprecated methods from Append
Signed-off-by: stack <stack@apache.org>
2019-07-27 15:19:56 +02:00
Guanghao Zhang
cf8114a82e
HBASE-22709 Add a chore thread in master to do hbck checking (#404)
Signed-off-by: stack <stack@apache.org>
2019-07-27 18:23:37 +08:00
Guanghao Zhang
1cb37f18aa
HBASE-22742 [HBCK2] Add more log for hbck operations at master side
Signed-off-by: stack <stack@apache.org>
2019-07-27 12:25:11 +08:00
stack
fa77c75848 HBASE-22382 Refactor tests in TestFromClientSide; ADDENDUM to fix tests 2019-07-26 13:28:06 -07:00
Wellington Chevreuil
3708198817 HBASE-21773 rowcounter utility should respond to pleas for help
Signed-off-by: stack <stack@apache.org>
2019-07-26 21:19:17 +01:00
linkaline
747d000808 HBASE-22733 TestSplitTransactionOnCluster.testMasterRestartAtRegionSplitPendingCatalogJanitor is flakey (#408)
Signed-off-by: stack <stack@apache.org>
2019-07-25 11:09:07 -07:00
syedmurtazahassan
de98fee288 HBASE-22702 [Log] 'Group not found for table' is chatty
Signed-off-by Reid Chan <reidchan@apache.org>
2019-07-25 23:13:40 +08:00
Pankaj
b83d0c035f HBASE-22628 [Addendum] Document the custom WAL directory (hbase.wal.dir) usage
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-07-25 15:11:14 +08:00
Jan Hentschel
e28afec9ec HBASE-22594 Clean up for backup examples (#315)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-25 13:35:44 +08:00
Jeongdae Kim
a65e72d5da
HBASE-22715 All scan requests should be handled by scan handler threads in RWQueueRpcExecutor (#393)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestSimpleRpcScheduler.java
2019-07-24 11:57:04 -07:00
Jan Hentschel
2edbf0b85a HBASE-22692 Rubocop definition is not used in the /bin directory
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-24 11:16:06 +02:00
meiyi
a399a1452b HBASE-22578 HFileCleaner should not delete empty ns/table directories used for user san snapshot feature (#337) 2019-07-24 15:14:56 +08:00
Andor Molnár
542ae47797 HBASE-22382 Refactor tests in TestFromClientSide (#385)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-24 14:08:45 +08:00
Pankaj
7ebf80fe1d HBASE-22628 Document the custom WAL directory (hbase.wal.dir) usage
Signed-off-by Reid Chan <reidchan@apache.org>
2019-07-24 10:45:45 +08:00
Duo Zhang
20ee7ab154
HBASE-22722 Upgrade jackson databind dependencies to 2.9.9.1 (#402)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-07-24 10:02:49 +08:00
Guanghao Zhang
6705d4ffdf
HBASE-22721 Refactor HBaseFsck: move the inner class out
Signed-off-by: stack <stack@apache.org>
2019-07-24 08:02:41 +08:00
Balazs Meszaros
e74d501df9
HBASE-15666 shaded dependencies for hbase-testing-util
HBASE-15666 shaded dependencies for hbase-testing-util

Added new artifact hbase-shaded-testing-util. It wraps a whole hbase-server
with its testing dependencies. Users should use only the following dependency
in pom:

<dependency>
  <groupId>org.apache.hbase</groupId>
  <artifactId>hbase-shaded-testing-util</artifactId>
  <version>${hbase.version}</version>
  <scope>test</scope>
</dependency>

Added hbase-shaded-testing-util-tester maven module which ensures
that hbase-shaded-testing-util works with a shaded client.

Signed-off-by: Josh Elser <elserj@apache.org>
2019-07-23 15:22:00 +02:00
syedmurtazahassan
d9493c539f HBASE-22603 Javadoc Warnings related to @link tag
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-07-23 14:14:12 +02:00
Peter Somogyi
b6d4529102 HBASE-22720 Incorrect link for hbase.unittests
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-07-23 13:55:59 +02:00
syedmurtazahassan
06f5c43de3 HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize
Signed-off-by: Reid Chan <reidchan@apache.org>
Co-authored-by: Reid Chan <reidchan@apache.org>
2019-07-23 11:27:02 +08:00
Reid Chan
0e34dcbf4b Revert "HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize"
Reason: Deprecated a wrong parameter.

This reverts commit fe450b50c1c0060773f5e3f3b884da2cf45beadc.
2019-07-23 11:04:13 +08:00
syedmurtazahassan
fe450b50c1 HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize
* HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize.

* HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize. Deprecated old attribute and introduced a new one

* HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize. Removed unnecessary import

* HBASE-22610 added two import configs and removed one

Signed-off-by: Reid Chan <reidchan@apache.org>
2019-07-23 10:40:32 +08:00
Viraj Jasani
9615c644f5 HBASE-22648 Snapshot TTL (#371)
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-07-22 15:03:44 -07:00
Toshihiro Suzuki
7f68591767 HBASE-22690 Deprecate / Remove OfflineMetaRepair in hbase-2+
Signed-off-by: stack <stack@apache.org>
2019-07-22 22:57:33 +09:00
Viraj Jasani
aa9679ddbc HBASE-22718 Removal of org.apache.hadoop.hbase.util.Counter (#396)
Signed-off-by: Sean Busbey <busbey@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-22 13:56:08 +02:00
Duo Zhang
c9293b0b12 HBASE-22719 Add debug support for github PR pre commit job 2019-07-22 13:49:27 +08:00
openinx
00075ea4fc
HBASE-22663 The HeapAllocationRatio in WebUI is not accurate because all of the heap allocation will happen in another separated allocator named HEAP (#365) 2019-07-20 23:30:08 +08:00
Geoffrey Jacoby
1ad48c1ebc
HBASE-22622 WALKey Extended Attributes (#352)
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-07-19 15:30:38 -07:00