Commit Graph

16757 Commits

Author SHA1 Message Date
Duo Zhang 66a2fc5d25
HBASE-22539 WAL corruption due to early DBBs re-use when Durability.ASYNC_WAL is used (#437)
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-08-05 16:19:05 +08:00
Jan Hentschel f6ece8d8e3
HBASE-22790 Added deprecation versions for fields in ByteBuffAllocator
Signed-off-by: stack <stack@apache.org>
2019-08-05 08:59:46 +02:00
Reid Chan a62fdccd3b
HBASE-22609 [Docs] More detail documentation about 'hbase.server.thread.wakefrequency'
Signed-off-by: stack <stack@apache.org>
2019-08-05 14:51:00 +08:00
dingwei-2017 ff96485396 HBASE-22773 when set blockSize option in Performance Evaluation tool, error occurs:ERROR: Unrecognized option/command: --blockSize=131072
Signed-off-by: huzheng <openinx@gmail.com>
2019-08-05 11:34:52 +08:00
Braavos d0e5ea1b87 HBASE-22677 Add unit tests for org.apache.hadoop.hbase.util.ByteRangeUtils and Classes
Co-authored-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-08-05 03:29:51 +02:00
Jan Hentschel abb60faa6c
HBASE-22787 Cleaned up tests in hbase-zookeeper
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-08-04 20:49:11 +02:00
johnhomsea a6f065396a HBASE-22779 fix TestTableShell is broken
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-08-02 12:46:22 +02:00
Sakthi 7e6684b1f4 Add Sakthi in the developers section of POM 2019-08-01 14:06:52 -07:00
Wellington Chevreuil 237229cade HBASE-22707 [HBCK2] MasterRpcServices assigns method should try to reload regions from meta if the passed regions isn't found under AssignmentManager RegionsStateStore
Signed-off-by: stack <stack@apache.org>
2019-08-01 16:49:57 +01:00
Viraj Jasani 8cfc46d8d0
HBASE-22735 list_regions show basic info for region currently in transition with error handling
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2019-07-31 18:48:40 -07:00
Guanghao Zhang 35acf3cb78
HBASE-22737 Add a new admin method and shell cmd to trigger the hbck chore to run (#425)
Signed-off-by: stack <stack@apache.org>
2019-08-01 08:54:47 +08:00
Peter Somogyi 4829c18251
HBASE-22768 Revert to MPIR 2.9 (#433)
Signed-off-by: stack <stack@apache.org>
2019-07-31 19:39:35 +02:00
Jan Hentschel 24b970ec51
Revert "HBASE-22744 Removed deprecated status and load classes in client module"
This reverts commit 4a61c8b10a.
2019-07-31 12:29:19 +02:00
Sergey Shelukhin caa05356a1 HBASE-22145 windows hbase-env causes hbase cli/etc to ignore HBASE_OPTS 2019-07-31 09:58:35 +02:00
Biju Nair 9a4a8ef274 HBASE-22363 Remove hardcoded number of read cache block buckets
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-31 09:13:17 +02:00
Jan Hentschel 586e177ded HBASE-22753 Removed deprecated ImmutableHRegionInfo (#420)
Signed-off-by: stack <stack@apache.org>
2019-07-31 08:07:31 +02:00
stack 373c2dc13f HBASE-22741 Show catalogjanitor consistency complaints in new 'HBCK Report' page
Signed-off-by: huzheng <openinx@gmail.com>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-07-30 11:16:45 -07:00
Thanh NM 5ce31dd120 HBASE-22714 - Fix opertationTimeout typo (#392)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-30 21:57:06 +08:00
Jan Hentschel 4a61c8b10a
HBASE-22744 Removed deprecated status and load classes in client module
Signed-off-by: stack <stack@apache.org>
2019-07-30 12:40:42 +02:00
Jan Hentschel f9fd5b65fa HBASE-22752 Removed the deprecated ImmutableHColumnDescriptor and ImmutableHTableDescriptor (#419)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: stack <stack@apache.org>
2019-07-30 12:32:10 +02:00
Jan Hentschel e3a54e7035
HBASE-22763 Fixed remaining Checkstyle issue in hbase-procedure
Signed-off-by: stack <stack@apache.org>
2019-07-30 09:54:05 +02:00
Jan Hentschel 124fa3488a
HBASE-22764 Fixed remaining Checkstyle issues in the hbase-rsgroup module
Signed-off-by: stack <stack@apache.org>
2019-07-30 08:55:40 +02:00
Jan Hentschel 46a432386e
HBASE-22746 Removed deprecated methods from Delete
Signed-off-by: stack <stack@apache.org>
2019-07-30 08:52:19 +02:00
openinx c286a31590
HBASE-22758 Remove the unneccesary info cf deletion in DeleteTableProcedure#deleteFromMeta (#424) 2019-07-30 14:16:08 +08:00
stack 0c80d5b42b HBASE-22723 Have CatalogJanitor report holes and overlaps; i.e. problems it sees when doing its regular scan of hbase:meta
Refactor of CatalogJanitor so it generates a
Report on the state of hbase:meta when it runs. Also
refactor so CJ runs even if RIT (previous it would
punt on running if RIT) so it can generate a 'Report'
on the interval regardless. If RIT, it just doesn't
go on to do the merge/split GC as it used to.

If report finds an issue, dump as a WARN message
to the master log.

Follow-on is to make the Report actionable/available
for the Master to pull when it goes to draw the hbck
UI page (could also consider shipping the Report as
part of ClusterMetrics?)

Adds new, fatter Visitor to CJ, one that generates
Report on each run keeping around more findings as
it runs.

Moved some methods around so class reads better;
previous methods were randomly ordered in the class.

M hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
 Make a few handy methods public.

M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionInfo.java
 Add utility as defaults on the Inteface; i.e. is this the first region
 in table, is it last, does a passed region come next, or does passed
 region overlap this region (added tests for this new stuff).

M hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
 Bugfix... handle case where buffer passed is null.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
 Lots of change, reorg., but mostly adding consistency checking
 to the visitor used scanning hbase:meta on a period and the
 generation of a Report on what the scan has found traversing
 hbase:meta. Added a main so could try the CatalogJanitor against
 a running cluster.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestCatalogJanitorCluster.java
 Fat ugly test for CatalogJanitor consistency checking.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionInfo.java
 Add tests for new functionality in RI.

M hbase-shell/src/main/ruby/hbase/table.rb
 Bug fix for case where meta has a null regioninfo; scan was aborting.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-07-29 16:00:57 -07:00
stack f68cda32e1 HBASE-22751 table.jsp fails if ugly regions in table 2019-07-29 09:38:46 -07:00
Venkatesh Sridharan 11f30de2cf HBASE-22313 Add method to FsDelegation token to accept token kind (#199)
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-29 11:18:19 +02:00
Jan Hentschel 41490e792a HBASE-22754 Removed deprecated methods from Increment (#421)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-29 09:10:51 +02:00
Jan Hentschel c68e2f274a HBASE-22756 Removed deprecated method from SingleColumnValueFilter (#422)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-29 09:10:00 +02:00
Jan Hentschel e273d0bc3a
HBASE-22748 Removed deprecated methods from Put
Signed-off-by: stack <stack@apache.org>
2019-07-29 08:50:16 +02:00
meiyi 7294af8b15
HBASE-22580 Add a table attribute to make user scan snapshot feature configurable for table (#336) 2019-07-29 09:51:26 +08:00
Viraj Jasani 064f5f1394 HBASE-22743 : ClientUtils for Demo Client classes (#413) 2019-07-28 10:01:45 +08:00
Jan Hentschel 3318b4bc6d
HBASE-22745 Removed deprecated methods from Append
Signed-off-by: stack <stack@apache.org>
2019-07-27 15:19:56 +02:00
Guanghao Zhang cf8114a82e
HBASE-22709 Add a chore thread in master to do hbck checking (#404)
Signed-off-by: stack <stack@apache.org>
2019-07-27 18:23:37 +08:00
Guanghao Zhang 1cb37f18aa
HBASE-22742 [HBCK2] Add more log for hbck operations at master side
Signed-off-by: stack <stack@apache.org>
2019-07-27 12:25:11 +08:00
stack fa77c75848 HBASE-22382 Refactor tests in TestFromClientSide; ADDENDUM to fix tests 2019-07-26 13:28:06 -07:00
Wellington Chevreuil 3708198817 HBASE-21773 rowcounter utility should respond to pleas for help
Signed-off-by: stack <stack@apache.org>
2019-07-26 21:19:17 +01:00
linkaline 747d000808 HBASE-22733 TestSplitTransactionOnCluster.testMasterRestartAtRegionSplitPendingCatalogJanitor is flakey (#408)
Signed-off-by: stack <stack@apache.org>
2019-07-25 11:09:07 -07:00
syedmurtazahassan de98fee288 HBASE-22702 [Log] 'Group not found for table' is chatty
Signed-off-by Reid Chan <reidchan@apache.org>
2019-07-25 23:13:40 +08:00
Pankaj b83d0c035f HBASE-22628 [Addendum] Document the custom WAL directory (hbase.wal.dir) usage
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-07-25 15:11:14 +08:00
Jan Hentschel e28afec9ec HBASE-22594 Clean up for backup examples (#315)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-25 13:35:44 +08:00
Jeongdae Kim a65e72d5da
HBASE-22715 All scan requests should be handled by scan handler threads in RWQueueRpcExecutor (#393)
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestSimpleRpcScheduler.java
2019-07-24 11:57:04 -07:00
Jan Hentschel 2edbf0b85a HBASE-22692 Rubocop definition is not used in the /bin directory
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-24 11:16:06 +02:00
meiyi a399a1452b HBASE-22578 HFileCleaner should not delete empty ns/table directories used for user san snapshot feature (#337) 2019-07-24 15:14:56 +08:00
Andor Molnár 542ae47797 HBASE-22382 Refactor tests in TestFromClientSide (#385)
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-24 14:08:45 +08:00
Pankaj 7ebf80fe1d HBASE-22628 Document the custom WAL directory (hbase.wal.dir) usage
Signed-off-by Reid Chan <reidchan@apache.org>
2019-07-24 10:45:45 +08:00
Duo Zhang 20ee7ab154
HBASE-22722 Upgrade jackson databind dependencies to 2.9.9.1 (#402)
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-07-24 10:02:49 +08:00
Guanghao Zhang 6705d4ffdf
HBASE-22721 Refactor HBaseFsck: move the inner class out
Signed-off-by: stack <stack@apache.org>
2019-07-24 08:02:41 +08:00
Balazs Meszaros e74d501df9
HBASE-15666 shaded dependencies for hbase-testing-util
HBASE-15666 shaded dependencies for hbase-testing-util

Added new artifact hbase-shaded-testing-util. It wraps a whole hbase-server
with its testing dependencies. Users should use only the following dependency
in pom:

<dependency>
  <groupId>org.apache.hbase</groupId>
  <artifactId>hbase-shaded-testing-util</artifactId>
  <version>${hbase.version}</version>
  <scope>test</scope>
</dependency>

Added hbase-shaded-testing-util-tester maven module which ensures
that hbase-shaded-testing-util works with a shaded client.

Signed-off-by: Josh Elser <elserj@apache.org>
2019-07-23 15:22:00 +02:00
syedmurtazahassan d9493c539f HBASE-22603 Javadoc Warnings related to @link tag
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-07-23 14:14:12 +02:00