Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
17,214 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

2260 Commits

Author SHA1 Message Date
Peter Somogyi 1655360951 Revert "HBASE-22700 refactor isMetaClearingException (#501)" 
This reverts commit cb62f73406.
 2019-09-19 13:21:22 +02:00
Guanghao Zhang 20bfb43db6
HBASE-23044 CatalogJanitor#cleanMergeQualifier may clean wrong parent regions (#637) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-09-19 08:08:49 +08:00
johnhomsea cb62f73406 HBASE-22700 refactor isMetaClearingException (#501) 2019-09-17 10:02:37 -07:00
Viraj Jasani 0dbae8f0e1 HBASE-23024 Replace initcause with Constructor arg (#627) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-09-17 13:39:26 +02:00
Viraj Jasani 1dcc8ee50c HBASE-22760 : Pause/Resume/Query Snapshot Auto Cleanup Activity (#617) 2019-09-13 10:34:01 +05:30
Guanghao Zhang a58149827b HBASE-23014 Should not show split parent regions in hbck report UI (#609) 2019-09-11 10:07:25 -07:00
stack e9e6202f9c HBASE-22796 [HBCK2] Add fix of overlaps to fixMeta hbck Service 
Signed-off-by: Sakthi <sakthi@apache.org>
 2019-09-10 17:04:06 -07:00
Duo Zhang 4ca760fe9d Revert "HBASE-22664 Move protobuf stuff in hbase-rsgroup to hbase-protocol-shaded (#362)" 
This reverts commit d36436408e.
 2019-09-10 11:14:37 +08:00
Duo Zhang 936bb82908 Revert "HBASE-22695 Store the rsgroup of a table in table configuration (#426)" 
This reverts commit eab7d3d502.
 2019-09-10 11:14:17 +08:00
Duo Zhang eab7d3d502 HBASE-22695 Store the rsgroup of a table in table configuration (#426) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-09-10 10:47:44 +08:00
Duo Zhang d36436408e HBASE-22664 Move protobuf stuff in hbase-rsgroup to hbase-protocol-shaded (#362) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-09-10 10:47:44 +08:00
Duo Zhang 693f201f3d
HBASE-22963 Netty ByteBuf leak in rpc client implementation (#577) 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-09-08 21:54:09 +08:00
stack 960a5fdc2a HBASE-22970 split parents show as overlaps in the HBCK Report 
Check if overlap is split parent.

Cleaned up the HBCK Report page too with some notes that it is made of
two reports; have the two sections display the same.
 2019-09-03 14:48:04 -07:00
meiyi 1d1813de48
HBASE-22878 Show table throttle quotas in table jsp (#510) 2019-09-03 09:37:49 +08:00
ravowlga123 43e732c177 HBASE-22886 Code Coverage Improvement: Create Unit Tests for class ConnectionId 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-09-02 22:35:47 +02:00
chenxu14 d32bf8daed HBASE-22905 Avoid temp ByteBuffer allocation in (#538) 
BlockingRpcConnection#writeRequest
 2019-09-01 22:01:36 -07:00
meiyi 345c21dbe7 HBASE-22945 Show quota infos in master UI (#560) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-09-01 22:42:47 +08:00
syedmurtazahassan b642ee0418 HBASE-22766 Code Coverage Improvement: Create Unit Tests for ResultStatsUtil (#520) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-08-31 22:24:05 +08:00
Jan Hentschel 5106f2826e
HBASE-22744 Removed deprecated status and load classes in client module 
Signed-off-by: stack <stack@apache.org>
 2019-08-27 19:46:08 +02:00
wuguihu 2d4580106a
HBASE-21400 correct spelling error of 'initilize' in comment 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-08-23 21:31:41 +02:00
Jan Hentschel 808f051b8a
HBASE-22755 Removed deprecated methods from Mutation 
Signed-off-by: stack <stack@apache.org>
 2019-08-23 20:56:19 +02:00
Jan Hentschel 1b50404f34
HBASE-22844 Fixed Checkstyle violations in client snapshot exceptions 
Signed-off-by: stack <stack@apache.org>
 2019-08-21 10:30:26 +02:00
Itsuki Toyota 78f5d8ebb2 HBASE-22833 MultiRowRangeFilter should provide a method for creating… (#493) 
* HBASE-22833: MultiRowRangeFilter should provide a method for creating a filter which is functionally equivalent to multiple prefix filters

* Delete superfluous comments

* Add description for MultiRowRangeFilter constructor

* Add null check for rowKeyPrefixes

* Fix checkstyle

Signed-off-by: huzheng <openinx@gmail.com>
 2019-08-16 09:59:01 +08:00
Sakthi e69af5affe HBASE-22845 Revert MetaTableAccessor#makePutFromTableState access to public (#489) 
HBCK2 is dependent on it
 2019-08-13 11:26:21 -07:00
Duo Zhang 07ab9ed237 Revert "HBASE-22699 refactor isMetaClearingException (#436)" 
This reverts commit 009851d680.
 2019-08-13 16:54:06 +08:00
johnhomsea 009851d680 HBASE-22699 refactor isMetaClearingException (#436) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-08-12 15:57:21 +08:00
Jan Hentschel 3867fae04d
HBASE-22829 Removed deprecated methods from SnapshotDescription 
Signed-off-by: stack <stack@apache.org>
 2019-08-12 08:41:05 +02:00
syedmurtazahassan 15c903b3f8 HBASE-22725 Remove all remaining Javadoc warnings 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-08-11 21:48:08 +02:00
stack 1b168cd6de HBASE-22777 Add a multi-region merge (for fixing overlaps) 
Makes MergeTableRegionsProcedure do more than just two regions at a
time. Compatible as MTRP was done considering one day it'd do more than
two at a time.

Changes hardcoded assumption that merge parent regions are named
mergeA and mergeB in a column on the resultant region. Instead
can have N columns on the merged region, one for each parent
merged. Column qualifiers all being with 'merge'.

Most of code below is undoing the assumption that there are two
parents on a merge only.
 2019-08-07 15:22:07 -07:00
stack 30805be078 HBASE-22771 [HBCK2] fixMeta method and server-side support 
This is a first cut at this patch. Implements hold fixing only
currently.

Add a fixMeta method to Hbck Interface.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
 Bug fix. If hole is on end of last table, I wasn't seeing it.

A hbase-server/src/main/java/org/apache/hadoop/hbase/master/MetaFixer.java
 Add a general meta fixer class. Explains up top why this stuff doesn't
 belong inside MetaTableAccessor.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 Break out the filesystem messing so don't have to copy it nor do more
 than is needed doing fixup for Region holes.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java
 Change behavious slightly. If directory exists, don't fail as we did
 but try and keep going and create .regioninfo file if missing (or
 overwrite if in place). This should make it idempotent. Can rerun
 command. Lets see if any repercussions in test suite.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMetaFixer.java
 Add test.

Signed-off-by: Zheng Hu <openinx@gmail.com>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-08-05 22:08:31 -07:00
Jan Hentschel da114ac727
HBASE-22785 Fixed Checkstyle issues in exceptions and enhanced Javadoc 
Signed-off-by: stack <stack@apache.org>
 2019-08-05 15:05:49 +02:00
Jan Hentschel b021c364fe
HBASE-22786 Fixed Checkstyle issues in tests in hbase-client 
Signed-off-by: stack <stack@apache.org>
 2019-08-05 11:52:53 +02:00
Wellington Chevreuil 237229cade HBASE-22707 [HBCK2] MasterRpcServices assigns method should try to reload regions from meta if the passed regions isn't found under AssignmentManager RegionsStateStore 
Signed-off-by: stack <stack@apache.org>
 2019-08-01 16:49:57 +01:00
Guanghao Zhang 35acf3cb78
HBASE-22737 Add a new admin method and shell cmd to trigger the hbck chore to run (#425) 
Signed-off-by: stack <stack@apache.org>
 2019-08-01 08:54:47 +08:00
Jan Hentschel 24b970ec51
Revert "HBASE-22744 Removed deprecated status and load classes in client module" 
This reverts commit 4a61c8b10a.
 2019-07-31 12:29:19 +02:00
Jan Hentschel 586e177ded HBASE-22753 Removed deprecated ImmutableHRegionInfo (#420) 
Signed-off-by: stack <stack@apache.org>
 2019-07-31 08:07:31 +02:00
Thanh NM 5ce31dd120 HBASE-22714 - Fix opertationTimeout typo (#392) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-07-30 21:57:06 +08:00
Jan Hentschel 4a61c8b10a
HBASE-22744 Removed deprecated status and load classes in client module 
Signed-off-by: stack <stack@apache.org>
 2019-07-30 12:40:42 +02:00
Jan Hentschel f9fd5b65fa HBASE-22752 Removed the deprecated ImmutableHColumnDescriptor and ImmutableHTableDescriptor (#419) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: stack <stack@apache.org>
 2019-07-30 12:32:10 +02:00
Jan Hentschel 46a432386e
HBASE-22746 Removed deprecated methods from Delete 
Signed-off-by: stack <stack@apache.org>
 2019-07-30 08:52:19 +02:00
openinx c286a31590
HBASE-22758 Remove the unneccesary info cf deletion in DeleteTableProcedure#deleteFromMeta (#424) 2019-07-30 14:16:08 +08:00
stack 0c80d5b42b HBASE-22723 Have CatalogJanitor report holes and overlaps; i.e. problems it sees when doing its regular scan of hbase:meta 
Refactor of CatalogJanitor so it generates a
Report on the state of hbase:meta when it runs. Also
refactor so CJ runs even if RIT (previous it would
punt on running if RIT) so it can generate a 'Report'
on the interval regardless. If RIT, it just doesn't
go on to do the merge/split GC as it used to.

If report finds an issue, dump as a WARN message
to the master log.

Follow-on is to make the Report actionable/available
for the Master to pull when it goes to draw the hbck
UI page (could also consider shipping the Report as
part of ClusterMetrics?)

Adds new, fatter Visitor to CJ, one that generates
Report on each run keeping around more findings as
it runs.

Moved some methods around so class reads better;
previous methods were randomly ordered in the class.

M hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
 Make a few handy methods public.

M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionInfo.java
 Add utility as defaults on the Inteface; i.e. is this the first region
 in table, is it last, does a passed region come next, or does passed
 region overlap this region (added tests for this new stuff).

M hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
 Bugfix... handle case where buffer passed is null.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
 Lots of change, reorg., but mostly adding consistency checking
 to the visitor used scanning hbase:meta on a period and the
 generation of a Report on what the scan has found traversing
 hbase:meta. Added a main so could try the CatalogJanitor against
 a running cluster.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestCatalogJanitorCluster.java
 Fat ugly test for CatalogJanitor consistency checking.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionInfo.java
 Add tests for new functionality in RI.

M hbase-shell/src/main/ruby/hbase/table.rb
 Bug fix for case where meta has a null regioninfo; scan was aborting.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2019-07-29 16:00:57 -07:00
Jan Hentschel 41490e792a HBASE-22754 Removed deprecated methods from Increment (#421) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-07-29 09:10:51 +02:00
Jan Hentschel c68e2f274a HBASE-22756 Removed deprecated method from SingleColumnValueFilter (#422) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-07-29 09:10:00 +02:00
Jan Hentschel e273d0bc3a
HBASE-22748 Removed deprecated methods from Put 
Signed-off-by: stack <stack@apache.org>
 2019-07-29 08:50:16 +02:00
Jan Hentschel 3318b4bc6d
HBASE-22745 Removed deprecated methods from Append 
Signed-off-by: stack <stack@apache.org>
 2019-07-27 15:19:56 +02:00
Viraj Jasani 9615c644f5 HBASE-22648 Snapshot TTL (#371) 
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-07-22 15:03:44 -07:00
Guanghao 48c623c808
HBASE-22673 Avoid to expose protobuf stuff in Hbck interface 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-07-19 08:03:06 +08:00
syedmurtazahassan 9f343c2efa HBASE-22571 Javadoc Warnings related to @return tag 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-07-13 13:34:48 +02:00
syedmurtazahassan fabf2b8282 HBASE-22572 Javadoc Warnings: @link reference not found (#306) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
 2019-07-01 21:15:00 -07:00
huzheng 532ebfb7a5 HBASE-21916 Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool 2019-06-24 10:25:31 +08:00
zhangduo ac3d09e7fd HBASE-22577 BufferedMutatorOverAsyncBufferedMutator.tryCompleteFuture consume too much CPU time 2019-06-18 08:43:35 +08:00
zhangduo 6278c98f5d HBASE-22550 Throw exception when creating thread pool if the connection has already been closed 2019-06-18 08:43:35 +08:00
zhangduo 492a105e5d HBASE-22526 RejectedExecutionException could be thrown from TableOverAsyncTable.coprocessor service if the connection has been shutown 2019-06-18 08:43:35 +08:00
Duo Zhang a116e0bab1 HBASE-21723 Remove ConnectionImplementation and related classes 2019-06-18 08:43:35 +08:00
Duo Zhang bd109506f3 HBASE-22223 Implement RegionLocator based on AsyncTableRegionLocator 2019-06-18 08:43:35 +08:00
zhangduo d1487fcfad HBASE-21725 Implement BufferedMutator Based on AsyncBufferedMutator 2019-06-18 08:43:35 +08:00
Duo Zhang d64d015f51 HBASE-21718 Implement Admin based on AsyncAdmin 2019-06-18 08:43:32 +08:00
Duo Zhang 6b87a4ce98 HBASE-21717 Implement Connection based on AsyncConnection 2019-06-18 08:37:51 +08:00
zhangduo b7793d7d1d HBASE-21585 Remove ClusterConnection 2019-06-18 08:37:50 +08:00
Duo Zhang 2182bfb942 HBASE-21779 Reimplement BulkLoadHFilesTool to use AsyncClusterConnection 2019-06-18 08:37:50 +08:00
Duo Zhang 72d9f8747f HBASE-21778 Remove the usage of the locateRegion related methods in ClusterConnection 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-06-18 08:35:59 +08:00
Duo Zhang d005d6f30a HBASE-21671 Rewrite RegionReplicaReplicationEndpoint to use AsyncClusterConnection 2019-06-18 08:35:58 +08:00
Duo Zhang 7593e86c5f HBASE-21538 Rewrite RegionReplicaFlushHandler to use AsyncClusterConnection 2019-06-18 08:35:58 +08:00
zhangduo 04f737d9bd HBASE-21579 Use AsyncClusterConnection for HBaseInterClusterReplicationEndpoint 2019-06-18 08:35:58 +08:00
zhangduo 5d872d3422 HBASE-21526 Use AsyncClusterConnection in ServerManager for getRsAdmin 2019-06-18 08:35:58 +08:00
zhangduo 2446f0026b HBASE-21516 Use AsyncConnection instead of Connection in SecureBulkLoadManager 2019-06-18 08:35:58 +08:00
zhangduo 30c131b5f7 HBASE-21515 Also initialize an AsyncClusterConnection in HRegionServer 2019-06-18 08:35:58 +08:00
Jan Hentschel 5da5deb59d
HBASE-22344 Documented the deprecation of public and limited private APIs (#208) 
Signed-off-by: stack <stack@apache.org>
 2019-06-17 22:02:23 +02:00
Apache9 9b413cf262
HBASE-22590 Remove the deprecated methods in Table interface (#309) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Guanghao <zghao@apache.org>
 2019-06-17 10:18:18 +08:00
Jan Hentschel ed30909d27
HBASE-19303 Removed ReplicationAdmin and all its usages 
Signed-off-by: stack <stack@apache.org>
 2019-06-16 16:20:04 +02:00
Jan Hentschel 47a96444da
HBASE-22275 Removed deprecated getRegionInfo in HRegionLocation 
Signed-off-by: stack <stack@apache.org>
 2019-06-16 16:13:46 +02:00
Andrew Purtell 8e15f4ed61
HBASE-22530 The metrics of store files count of region are returned to clients incorrectly (Eungsop Yoo) 
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-06-13 17:42:26 -07:00
Duo Zhang 04a91f961e HBASE-22569 Should treat null consistency as Consistency.STRONG in ConnectionUtils.timelineConsistentRead 2019-06-13 08:20:19 +08:00
Jan Hentschel f62028593f HBASE-22262 Removed deprecated methods from Filter class 2019-06-10 00:47:15 +02:00
zhangduo 1b3914067e HBASE-22477 Throwing exception when meta region is not in OPEN state in client registry may crash a master 2019-06-08 14:06:38 +08:00
Philippe Laflamme 2ae3b4883b HBASE-21415 Snapshot requests can be done concurrently and the master will simply run them sequentially. 
Co-authored-by: Josh Elser <elserj@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-06-04 12:14:26 -04:00
meiyi 073de44445
HBASE-22513 Admin#getQuota does not work correctly if exceedThrottleQuota is set 2019-06-03 16:55:23 +08:00
Andrew Purtell 98a1552687
HBASE-22459 Expose store reader reference count (#248) 2019-05-30 15:04:16 -07:00
Andrew Purtell a30b186568
HBASE-22449 https everywhere in Maven metadata (#247) 2019-05-21 12:34:25 -07:00
zhangduo b74df9b747 HBASE-22442 Nightly build is failing with hadoop 3.x 2019-05-19 07:54:29 +08:00
Andrew Purtell 81953d3e00
Amend HBASE-22377 Provide API to check the existence of a namespace which does not require ADMIN permissions 
Sync Javadoc updates from branch-1 and branch-2 backports
 2019-05-14 12:59:10 -07:00
Andrew Purtell a9de9f5f28
HBASE-22377 Provide API to check the existence of a namespace which does not require ADMIN permissions (#225) 
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-05-14 11:56:16 -07:00
Duo Zhang 083605df8f HBASE-22399 Change default hadoop-two.version to 2.8.x and remove the 2.7.x hadoop checks 2019-05-14 16:45:20 +08:00
zhangduo 0b8493f886 HBASE-21658 Addendum fix infinite wait when there are no meta locations yet 2019-05-14 08:12:36 +08:00
zhangduo df27820958 HBASE-21658 Should get the meta replica number from zk instead of config at client side 2019-05-11 09:22:00 +08:00
Jan Hentschel 2c7fdb39ce HBASE-22277 Removed deprecated methods from Get 2019-05-01 01:25:53 +02:00
Duo Zhang 3f40df8085 HBASE-22325 AsyncRpcRetryingCaller will not schedule retry if we hit a NotServingRegionException but there is no TableName provided 2019-04-30 15:12:35 +08:00
Duo Zhang f9f6354393 HBASE-22322 Use special pause for CallQueueTooBigException 2019-04-30 10:05:09 +08:00
Sakthi 5b07ee9953 HBASE-22086: Space Quota issue: Deleting snapshot doesn't update the usage of table 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-04-29 14:44:10 +08:00
Duo Zhang 4477dd5de8 HBASE-22317 Support reading from meta replicas 2019-04-28 15:46:59 +08:00
Duo Zhang 0db0491a9e Revert "HBASE-22086: Space Quota issue: Deleting snapshot doesn't update the usage of table" 
This breaks TestQuotaTableUtil.testDeleteSnapshots.

This reverts commit fe7cf10272.
 2019-04-26 10:00:02 +08:00
Sean Busbey bf140acd20 HBASE-22083 move eclipse settings into a profile. 
Signed-off-by: stack <stack@apache.org>
 2019-04-25 14:17:18 -05:00
Duo Zhang ec36372649 HBASE-22307 Addendum deprecated PreemptiveFastFailException 2019-04-25 16:54:35 +08:00
Yu Li ab3d6cf811
HBASE-22283 Print row and table information when failed to get region location 2019-04-24 15:44:13 +08:00
李小保 7617b71f00 HBASE-22250 The same constants used in many places should be placed in constant classes 
Signed-off-by: stack <stack@apache.org>
 2019-04-23 21:24:14 -07:00
Sakthi fe7cf10272 HBASE-22086: Space Quota issue: Deleting snapshot doesn't update the usage of table 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-04-23 19:20:38 -04:00
zouxiangwen 6855143ba9 HBASE-22292 PreemptiveFastFailInterceptor clean repeatedFailuresMap issue 
Signed-off-by: stack <stack@apache.org>
 2019-04-23 07:56:59 -07:00
Jan Hentschel 3dfa98ffc1 HBASE-22258 Removed deprecated methods in VisibilityClient 2019-04-23 16:45:02 +02:00
Michael Stack da286b9087
Merge pull request #158 from hextriclosan/HBASE-22047 
HBASE-22047 LeaseException in Scan should be retried
 2019-04-23 06:18:43 -07:00