07ab9ed237
Revert "HBASE-22699 refactor isMetaClearingException ( #436 )"
...
This reverts commit 009851d680
2019-08-13 16:54:06 +08:00
009851d680
HBASE-22699 refactor isMetaClearingException ( #436 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-08-12 15:57:21 +08:00
3867fae04d
HBASE-22829 Removed deprecated methods from SnapshotDescription
...
Signed-off-by: stack <stack@apache.org>
2019-08-12 08:41:05 +02:00
15c903b3f8
HBASE-22725 Remove all remaining Javadoc warnings
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-08-11 21:48:08 +02:00
1b168cd6de
HBASE-22777 Add a multi-region merge (for fixing overlaps)
...
Makes MergeTableRegionsProcedure do more than just two regions at a
time. Compatible as MTRP was done considering one day it'd do more than
two at a time.
Changes hardcoded assumption that merge parent regions are named
mergeA and mergeB in a column on the resultant region. Instead
can have N columns on the merged region, one for each parent
merged. Column qualifiers all being with 'merge'.
Most of code below is undoing the assumption that there are two
parents on a merge only.
2019-08-07 15:22:07 -07:00
30805be078
HBASE-22771 [HBCK2] fixMeta method and server-side support
...
This is a first cut at this patch. Implements hold fixing only
currently.
Add a fixMeta method to Hbck Interface.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
Bug fix. If hole is on end of last table, I wasn't seeing it.
A hbase-server/src/main/java/org/apache/hadoop/hbase/master/MetaFixer.java
Add a general meta fixer class. Explains up top why this stuff doesn't
belong inside MetaTableAccessor.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
Break out the filesystem messing so don't have to copy it nor do more
than is needed doing fixup for Region holes.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java
Change behavious slightly. If directory exists, don't fail as we did
but try and keep going and create .regioninfo file if missing (or
overwrite if in place). This should make it idempotent. Can rerun
command. Lets see if any repercussions in test suite.
A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMetaFixer.java
Add test.
Signed-off-by: Zheng Hu <openinx@gmail.com>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-08-05 22:08:31 -07:00
da114ac727
HBASE-22785 Fixed Checkstyle issues in exceptions and enhanced Javadoc
...
Signed-off-by: stack <stack@apache.org>
2019-08-05 15:05:49 +02:00
b021c364fe
HBASE-22786 Fixed Checkstyle issues in tests in hbase-client
...
Signed-off-by: stack <stack@apache.org>
2019-08-05 11:52:53 +02:00
237229cade
HBASE-22707 [HBCK2] MasterRpcServices assigns method should try to reload regions from meta if the passed regions isn't found under AssignmentManager RegionsStateStore
...
Signed-off-by: stack <stack@apache.org>
2019-08-01 16:49:57 +01:00
35acf3cb78
HBASE-22737 Add a new admin method and shell cmd to trigger the hbck chore to run ( #425 )
...
Signed-off-by: stack <stack@apache.org>
2019-08-01 08:54:47 +08:00
24b970ec51
Revert "HBASE-22744 Removed deprecated status and load classes in client module"
...
This reverts commit 4a61c8b10a
2019-07-31 12:29:19 +02:00
586e177ded
HBASE-22753 Removed deprecated ImmutableHRegionInfo ( #420 )
...
Signed-off-by: stack <stack@apache.org>
2019-07-31 08:07:31 +02:00
5ce31dd120
HBASE-22714 - Fix opertationTimeout typo ( #392 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-30 21:57:06 +08:00
4a61c8b10a
HBASE-22744 Removed deprecated status and load classes in client module
...
Signed-off-by: stack <stack@apache.org>
2019-07-30 12:40:42 +02:00
f9fd5b65fa
HBASE-22752 Removed the deprecated ImmutableHColumnDescriptor and ImmutableHTableDescriptor ( #419 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: stack <stack@apache.org>
2019-07-30 12:32:10 +02:00
46a432386e
HBASE-22746 Removed deprecated methods from Delete
...
Signed-off-by: stack <stack@apache.org>
2019-07-30 08:52:19 +02:00
c286a31590
HBASE-22758 Remove the unneccesary info cf deletion in DeleteTableProcedure#deleteFromMeta ( #424 )
2019-07-30 14:16:08 +08:00
0c80d5b42b
HBASE-22723 Have CatalogJanitor report holes and overlaps; i.e. problems it sees when doing its regular scan of hbase:meta
...
Refactor of CatalogJanitor so it generates a
Report on the state of hbase:meta when it runs. Also
refactor so CJ runs even if RIT (previous it would
punt on running if RIT) so it can generate a 'Report'
on the interval regardless. If RIT, it just doesn't
go on to do the merge/split GC as it used to.
If report finds an issue, dump as a WARN message
to the master log.
Follow-on is to make the Report actionable/available
for the Master to pull when it goes to draw the hbck
UI page (could also consider shipping the Report as
part of ClusterMetrics?)
Adds new, fatter Visitor to CJ, one that generates
Report on each run keeping around more findings as
it runs.
Moved some methods around so class reads better;
previous methods were randomly ordered in the class.
M hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
Make a few handy methods public.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionInfo.java
Add utility as defaults on the Inteface; i.e. is this the first region
in table, is it last, does a passed region come next, or does passed
region overlap this region (added tests for this new stuff).
M hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
Bugfix... handle case where buffer passed is null.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
Lots of change, reorg., but mostly adding consistency checking
to the visitor used scanning hbase:meta on a period and the
generation of a Report on what the scan has found traversing
hbase:meta. Added a main so could try the CatalogJanitor against
a running cluster.
A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestCatalogJanitorCluster.java
Fat ugly test for CatalogJanitor consistency checking.
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionInfo.java
Add tests for new functionality in RI.
M hbase-shell/src/main/ruby/hbase/table.rb
Bug fix for case where meta has a null regioninfo; scan was aborting.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-07-29 16:00:57 -07:00
41490e792a
HBASE-22754 Removed deprecated methods from Increment ( #421 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-29 09:10:51 +02:00
c68e2f274a
HBASE-22756 Removed deprecated method from SingleColumnValueFilter ( #422 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-29 09:10:00 +02:00
e273d0bc3a
HBASE-22748 Removed deprecated methods from Put
...
Signed-off-by: stack <stack@apache.org>
2019-07-29 08:50:16 +02:00
3318b4bc6d
HBASE-22745 Removed deprecated methods from Append
...
Signed-off-by: stack <stack@apache.org>
2019-07-27 15:19:56 +02:00
9615c644f5
HBASE-22648 Snapshot TTL ( #371 )
...
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-07-22 15:03:44 -07:00
48c623c808
HBASE-22673 Avoid to expose protobuf stuff in Hbck interface
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-19 08:03:06 +08:00
9f343c2efa
HBASE-22571 Javadoc Warnings related to @return tag
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-07-13 13:34:48 +02:00
fabf2b8282
HBASE-22572 Javadoc Warnings: @link reference not found ( #306 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
2019-07-01 21:15:00 -07:00
532ebfb7a5
HBASE-21916 Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool
2019-06-24 10:25:31 +08:00
ac3d09e7fd
HBASE-22577 BufferedMutatorOverAsyncBufferedMutator.tryCompleteFuture consume too much CPU time
2019-06-18 08:43:35 +08:00
6278c98f5d
HBASE-22550 Throw exception when creating thread pool if the connection has already been closed
2019-06-18 08:43:35 +08:00
492a105e5d
HBASE-22526 RejectedExecutionException could be thrown from TableOverAsyncTable.coprocessor service if the connection has been shutown
2019-06-18 08:43:35 +08:00
a116e0bab1
HBASE-21723 Remove ConnectionImplementation and related classes
2019-06-18 08:43:35 +08:00
bd109506f3
HBASE-22223 Implement RegionLocator based on AsyncTableRegionLocator
2019-06-18 08:43:35 +08:00
d1487fcfad
HBASE-21725 Implement BufferedMutator Based on AsyncBufferedMutator
2019-06-18 08:43:35 +08:00
d64d015f51
HBASE-21718 Implement Admin based on AsyncAdmin
2019-06-18 08:43:32 +08:00
6b87a4ce98
HBASE-21717 Implement Connection based on AsyncConnection
2019-06-18 08:37:51 +08:00
b7793d7d1d
HBASE-21585 Remove ClusterConnection
2019-06-18 08:37:50 +08:00
2182bfb942
HBASE-21779 Reimplement BulkLoadHFilesTool to use AsyncClusterConnection
2019-06-18 08:37:50 +08:00
72d9f8747f
HBASE-21778 Remove the usage of the locateRegion related methods in ClusterConnection
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-06-18 08:35:59 +08:00
d005d6f30a
HBASE-21671 Rewrite RegionReplicaReplicationEndpoint to use AsyncClusterConnection
2019-06-18 08:35:58 +08:00
7593e86c5f
HBASE-21538 Rewrite RegionReplicaFlushHandler to use AsyncClusterConnection
2019-06-18 08:35:58 +08:00
04f737d9bd
HBASE-21579 Use AsyncClusterConnection for HBaseInterClusterReplicationEndpoint
2019-06-18 08:35:58 +08:00
5d872d3422
HBASE-21526 Use AsyncClusterConnection in ServerManager for getRsAdmin
2019-06-18 08:35:58 +08:00
2446f0026b
HBASE-21516 Use AsyncConnection instead of Connection in SecureBulkLoadManager
2019-06-18 08:35:58 +08:00
30c131b5f7
HBASE-21515 Also initialize an AsyncClusterConnection in HRegionServer
2019-06-18 08:35:58 +08:00
5da5deb59d
HBASE-22344 Documented the deprecation of public and limited private APIs ( #208 )
...
Signed-off-by: stack <stack@apache.org>
2019-06-17 22:02:23 +02:00
9b413cf262
HBASE-22590 Remove the deprecated methods in Table interface ( #309 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Guanghao <zghao@apache.org>
2019-06-17 10:18:18 +08:00
ed30909d27
HBASE-19303 Removed ReplicationAdmin and all its usages
...
Signed-off-by: stack <stack@apache.org>
2019-06-16 16:20:04 +02:00
47a96444da
HBASE-22275 Removed deprecated getRegionInfo in HRegionLocation
...
Signed-off-by: stack <stack@apache.org>
2019-06-16 16:13:46 +02:00
8e15f4ed61
HBASE-22530 The metrics of store files count of region are returned to clients incorrectly (Eungsop Yoo)
...
Signed-off-by: Xu Cang <xucang@apache.org>
2019-06-13 17:42:26 -07:00
04a91f961e
HBASE-22569 Should treat null consistency as Consistency.STRONG in ConnectionUtils.timelineConsistentRead
2019-06-13 08:20:19 +08:00
f62028593f
HBASE-22262 Removed deprecated methods from Filter class
2019-06-10 00:47:15 +02:00
1b3914067e
HBASE-22477 Throwing exception when meta region is not in OPEN state in client registry may crash a master
2019-06-08 14:06:38 +08:00
2ae3b4883b
HBASE-21415 Snapshot requests can be done concurrently and the master will simply run them sequentially.
...
Co-authored-by: Josh Elser <elserj@apache.org>
Signed-off-by: Josh Elser <elserj@apache.org>
2019-06-04 12:14:26 -04:00
073de44445
HBASE-22513 Admin#getQuota does not work correctly if exceedThrottleQuota is set
2019-06-03 16:55:23 +08:00
98a1552687
HBASE-22459 Expose store reader reference count ( #248 )
2019-05-30 15:04:16 -07:00
a30b186568
HBASE-22449 https everywhere in Maven metadata ( #247 )
2019-05-21 12:34:25 -07:00
b74df9b747
HBASE-22442 Nightly build is failing with hadoop 3.x
2019-05-19 07:54:29 +08:00
81953d3e00
Amend HBASE-22377 Provide API to check the existence of a namespace which does not require ADMIN permissions
...
Sync Javadoc updates from branch-1 and branch-2 backports
2019-05-14 12:59:10 -07:00
a9de9f5f28
HBASE-22377 Provide API to check the existence of a namespace which does not require ADMIN permissions ( #225 )
...
Signed-off-by: Xu Cang <xucang@apache.org>
2019-05-14 11:56:16 -07:00
083605df8f
HBASE-22399 Change default hadoop-two.version to 2.8.x and remove the 2.7.x hadoop checks
2019-05-14 16:45:20 +08:00
0b8493f886
HBASE-21658 Addendum fix infinite wait when there are no meta locations yet
2019-05-14 08:12:36 +08:00
df27820958
HBASE-21658 Should get the meta replica number from zk instead of config at client side
2019-05-11 09:22:00 +08:00
2c7fdb39ce
HBASE-22277 Removed deprecated methods from Get
2019-05-01 01:25:53 +02:00
3f40df8085
HBASE-22325 AsyncRpcRetryingCaller will not schedule retry if we hit a NotServingRegionException but there is no TableName provided
2019-04-30 15:12:35 +08:00
f9f6354393
HBASE-22322 Use special pause for CallQueueTooBigException
2019-04-30 10:05:09 +08:00
5b07ee9953
HBASE-22086: Space Quota issue: Deleting snapshot doesn't update the usage of table
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-04-29 14:44:10 +08:00
4477dd5de8
HBASE-22317 Support reading from meta replicas
2019-04-28 15:46:59 +08:00
0db0491a9e
Revert "HBASE-22086: Space Quota issue: Deleting snapshot doesn't update the usage of table"
...
This breaks TestQuotaTableUtil.testDeleteSnapshots.
This reverts commit fe7cf10272
2019-04-26 10:00:02 +08:00
bf140acd20
HBASE-22083 move eclipse settings into a profile.
...
Signed-off-by: stack <stack@apache.org>
2019-04-25 14:17:18 -05:00
ec36372649
HBASE-22307 Addendum deprecated PreemptiveFastFailException
2019-04-25 16:54:35 +08:00
ab3d6cf811
HBASE-22283 Print row and table information when failed to get region location
2019-04-24 15:44:13 +08:00
7617b71f00
HBASE-22250 The same constants used in many places should be placed in constant classes
...
Signed-off-by: stack <stack@apache.org>
2019-04-23 21:24:14 -07:00
fe7cf10272
HBASE-22086: Space Quota issue: Deleting snapshot doesn't update the usage of table
...
Signed-off-by: Josh Elser <elserj@apache.org>
2019-04-23 19:20:38 -04:00
6855143ba9
HBASE-22292 PreemptiveFastFailInterceptor clean repeatedFailuresMap issue
...
Signed-off-by: stack <stack@apache.org>
2019-04-23 07:56:59 -07:00
3dfa98ffc1
HBASE-22258 Removed deprecated methods in VisibilityClient
2019-04-23 16:45:02 +02:00
da286b9087
Merge pull request #158 from hextriclosan/HBASE-22047
...
HBASE-22047 LeaseException in Scan should be retried
2019-04-23 06:18:43 -07:00
1f0e43a27a
HBASE-22232 Removed deprecated methods in CompareFilter
2019-04-23 13:25:17 +02:00
c3c48f30f7
HBASE-22279 Add a getRegionLocator method in Table/AsyncTable interface
2019-04-22 18:37:23 +08:00
38ff46f88f
HBASE-22282 Should deal with error in the callback of RawAsyncHBaseAdmin.splitRegion methods
2019-04-22 16:44:38 +08:00
b0075a160a
HBASE-22278 RawAsyncHBaseAdmin should not use cached region location
2019-04-21 22:04:01 +08:00
eb912bb1da
HBASE-22261 Make use of ClusterStatusListener for async client
2019-04-21 22:03:43 +08:00
226c90c058
HBASE-22276 Removed deprecated UnmodifyableHRegionInfo
2019-04-21 10:46:58 +02:00
0645d5a033
HBASE-22267 Implement client push back for async client
2019-04-21 16:31:49 +08:00
f30d6c958a
HBASE-22231 Removed unused and '*' imports
2019-04-20 22:03:32 +02:00
353f9226c3
HBASE-22236 AsyncNonMetaRegionLocator should not cache HRegionLocation with null location
2019-04-20 08:56:11 +08:00
a3d2a2df3a
HBASE-22244 Make use of MetricsConnection in async client
2019-04-18 22:13:27 +08:00
f4aaf735e4
HBASE-22259 Removed deprecated method in ReplicationLoadSource
2019-04-18 11:32:55 +02:00
09f484b1a0
HBASE-22260 Removed deprecated methods in ReplicationLoadSink
2019-04-18 08:44:22 +02:00
375ac55d77
HBASE-22047 LeaseException in Scan should be retried
2019-04-16 20:03:29 +03:00
88de644736
HBASE-22243 Removed deprecated method in Result
2019-04-15 16:46:10 +02:00
7d1399caa7
HBASE-22242 Removed deprecated method in RegionLoadStats
2019-04-15 08:45:18 +02:00
9c13dde84b
HBASE-22228 Removed deprecated ThrottlingException
2019-04-13 10:50:10 +02:00
37e93c311a
HBASE-22227 Removed deprecated fields in ServerSideScanMetrics
2019-04-13 10:48:39 +02:00
bc58adac5b
HBASE-22187 Removed remaining usages of ClusterConnection.clearRegionCache
2019-04-12 09:58:20 +02:00
2bae04fb2b
HBASE-22144 Correct MultiRowRangeFilter to work with reverse scans
...
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
2019-04-11 17:49:39 -04:00
387a5da462
HBASE-22155 Move 2.2.0 on to hbase-thirdparty-2.2.0
2019-04-09 09:40:19 -07:00
bd2f04dd54
HBASE-21965 Fix failed split and merge transactions that have failed to roll back
2019-04-09 19:56:18 +08:00
d32f924ef4
HBASE-22117 Move hasPermission/checkPermissions from region server to master
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-04-09 17:01:01 +08:00
11547b79f3
HBASE-22178 Introduce a createTableAsync with TableDescriptor method in Admin
2019-04-07 21:06:00 +08:00
0247466210
HBASE-22179 Fix RawAsyncHBaseAdmin.getCompactionState
2019-04-07 08:31:44 +08:00
Duo Zhang
johnhomsea
Jan Hentschel
syedmurtazahassan
stack
Wellington Chevreuil
Guanghao Zhang
Thanh NM
openinx
Viraj Jasani
Andrew Purtell
Philippe Laflamme
meiyi
Sakthi
Sean Busbey
Yu Li
李小保
zouxiangwen
Michael Stack
Sayed Anisul Hoque
Igor Rudenko
Josh Elser
Jingyun Tian
meiyi