97fbaa658e
HBASE-22962 Fix typo in javadoc description ( #569 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-09-01 20:14:31 +08:00
f6a4c66d13
HBASE-22941 merge operation returns parent regions in random order ( #556 )
...
Minor addendum to address checkstyle issue
2019-08-29 12:29:28 -07:00
56fd3e9007
HBASE-22941 merge operation returns parent regions in random order ( #556 )
...
* HBASE-22941 merge operation returns parent regions in random order
store and return the merge parent regions in ascending order
remove left over check for exactly two merged regions
add unit test
* use SortedMap type to emphasise that the Map is sorted.
* use regionCount consistently and checkstyle fixes
* Delete tests that expect multiregion merges to fail.
Signed-off-by: stack <stack@apache.org>
2019-08-29 12:27:33 -07:00
83e77940c5
HBASE-22943 Various procedures should not cache log trace level ( #557 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-08-29 13:46:10 -05:00
56980fb097
Revert "HBASE-22857 Fix the failed ut TestHRegion and TestHRegionWithInMemoryFlush ( #495 )"
...
This reverts commit 0b3db5099c
2019-08-28 11:21:29 +08:00
64f88906f7
HBASE-22872 Don't try to create normalization plan unnecesarily when split and merge both are disabled
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-08-28 10:50:09 +08:00
f2425c74a9
HBASE-22935 Fix false warn of stuck MonitoredRPCHandler MonitoredTask
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-08-27 17:49:56 -07:00
3e2cfc1140
HBASE-22883 Duplacate codes of method Threads.newDaemonThreadFactory() and class DaemonThreadFactory ( #537 )
...
Signed-off-by: stack <stack@apache.org>
2019-08-27 15:27:22 -07:00
5106f2826e
HBASE-22744 Removed deprecated status and load classes in client module
...
Signed-off-by: stack <stack@apache.org>
2019-08-27 19:46:08 +02:00
c88267202a
HBASE-22922 Lock all regions to be merged in case of multi region merge ( #542 )
...
* HBASE-22922 Lock all regions to be merged in case of multi region merge
* HBASE-22922 Lock all regions to be merged in case of multi region merge
(addendum)
fix off-by-one error in patch
Signed-off-by: stack <stack@apache.org>
2019-08-26 21:09:18 -07:00
1ea5d8be9e
HBASE-22894 Move testOpenRegionFailedMemoryLeak to dedicated class
...
Amending-Author: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-08-25 13:42:23 +08:00
00581ac911
HBASE-22904 NPE occurs when RS send space quota usage report during HMaster init ( #529 )
...
* NPE occurs when RS send space quota usage report during HMaster init
* Added the debug log
Signed-off-by: Sakthi <sakthi@apache.org>
Signed-off-by: stack <stack@apache.org>
2019-08-24 20:56:20 -07:00
ae107bdb96
HBASE-22806 Recreating a deleted column family brings back the deleted cells ( #530 )
...
Signed-off-by: stack <stack@apache.org>
2019-08-24 17:46:16 -07:00
a12545380b
HBASE-22910 Enable TestMultiVersionConcurrencyControl ( #531 )
...
Signed-off-by: Stack <stack@apache.org>
2019-08-24 17:17:52 -07:00
554b2531ca
HBASE-22895 Fix the flakey TestSpaceQuotas ( #526 )
...
Break down TestSpaceQuotas(TSQ) into TSQBasicFunctioning, TSQDropTable, TSQIncrease, TSQOnBulkLoad, TSQOnNonExistingTables, TSQRemoval & TSQSwitchPolicies
Signed-off-by: Stack <stack@apache.org>
2019-08-24 02:42:15 -07:00
ee9d98611b
HBASE-22881 Fix non-daemon threads in hbase server implementation ( #512 )
...
* address checkstyle issue
* change threadPool threads to daemon in server implementation
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: stack <stack@apache.org>
2019-08-23 17:36:58 -07:00
a95ee63a70
HBASE-22781 optimize the test case TestStoreScanner.testScanSameTimestamp ( #446 )
...
Signed-off-by: Duo Zhang zhangduo@apache.org
Signed-off-by: stack stack@apache.org
2019-08-23 17:19:56 -07:00
f4ff480387
HBASE-20509 putting List in HashSet directly without using addAll function to improve performance
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-08-24 00:02:27 +02:00
808f051b8a
HBASE-22755 Removed deprecated methods from Mutation
...
Signed-off-by: stack <stack@apache.org>
2019-08-23 20:56:19 +02:00
4268774de1
HBASE-22867 The ForkJoinPool in CleanerChore will spawn thousands of threads in our cluster with thousands table ( #513 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-08-22 19:42:01 +08:00
b329bf0a57
Revert "HBASE-22013 SpaceQuotas - getNumRegions() returning wrong number of regions due to region replicas"
...
This reverts commit 7af5b30eca
2019-08-21 23:54:25 -07:00
84ee378df1
HBASE-22810 Initialize an separate ThreadPoolExecutor for taking/restoring snapshot (addendum - use the old config key) ( #517 )
2019-08-22 11:33:51 +08:00
b8857ec010
HBASE-22863 Cleanup transitive Jackson1 vulnerable dependencies(forward-port HBASE-22728) ( #505 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-08-21 22:06:05 +08:00
61a3a9ffbb
HBASE-22601 Misconfigured addition of peers leads to cluster shutdown. ( #499 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-08-21 21:52:50 +08:00
7af5b30eca
HBASE-22013 SpaceQuotas - getNumRegions() returning wrong number of regions due to region replicas
...
Signed-off-by: Sakthi <sakthi@apache.org>
2019-08-21 00:44:16 -07:00
ab28f9d8c7
Revert "HBASE-22823 Mark Canary as Public/Evolving"
...
This reverts commit edf6f68cb2
2019-08-20 09:46:37 -07:00
67382809d3
HBASE-22882 TestFlushSnapshotFromClient#testConcurrentSnapshottingAttempts is flakey (was written flakey)
...
Addendum; just remove the test altogether
Signed-off-by: Nick Dimiduk <ndimiduk@apache.org>
2019-08-19 14:28:30 -07:00
8e488ce9ef
HBASE-22882 TestFlushSnapshotFromClient#testConcurrentSnapshottingAttempts is flakey (was written flakey)
2019-08-19 12:59:04 -07:00
0b3db5099c
HBASE-22857 Fix the failed ut TestHRegion and TestHRegionWithInMemoryFlush ( #495 )
...
Signed-off-by: Peter Somogyi psomogyi@apache.org
Signed-off-by: stack stack@apache.org
2019-08-19 12:59:00 -07:00
7697d48cd7
HBASE-22870 reflection fails to access a private nested class
...
Signed-off-by Reid Chan <reidchan@apache.org>
2019-08-18 09:47:06 +08:00
836f26976e
HBASE-22618 added the possibility to load custom cost functions
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-08-17 15:25:52 -03:00
8cb531f207
HBASE-22871 Move the DirScanPool out and do not use static field ( #504 )
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-08-17 23:35:04 +08:00
43a0ec80fa
HBASE-22841 Add more factory functions to TimeRange
...
These functions make it easier to possible to use
`org.apache.hadoop.hbase.client.Table.CheckAndMutateBuilder#timeRange`
with more interesting ranges, without being forced to use the
deprecated constructors.
Signed-off-by: huzheng <openinx@gmail.com>
2019-08-17 09:41:34 +08:00
3eb602c7f7
HBASE-22860 Master's webui returns NPE/HTTP 500 under maintenance mode
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-08-16 10:33:38 +01:00
94af65163b
HBASE-22858 Add HBCK Report to master's header.jsp ( #497 )
...
Signed-off-by: Stack <stack@apache.org>
Signed-off-by: Sakthi <sakthi@apache.org>
2019-08-16 01:34:40 -05:00
78f5d8ebb2
HBASE-22833 MultiRowRangeFilter should provide a method for creating… ( #493 )
...
* HBASE-22833: MultiRowRangeFilter should provide a method for creating a filter which is functionally equivalent to multiple prefix filters
* Delete superfluous comments
* Add description for MultiRowRangeFilter constructor
* Add null check for rowKeyPrefixes
* Fix checkstyle
Signed-off-by: huzheng <openinx@gmail.com>
2019-08-16 09:59:01 +08:00
60971bee66
HBASE-22842 Tmp directory should not be deleted when master restart used for user scan snapshot feature ( #485 )
2019-08-16 09:38:39 +08:00
edf6f68cb2
HBASE-22823 Mark Canary as Public/Evolving
...
Signed-off-by: Xu Cang <xucang@apache.org>
2019-08-15 14:09:06 -07:00
8ffc45ab8b
HBASE-22810 Initialize an separate ThreadPoolExecutor for taking/restoring snapshot ( #486 )
2019-08-15 10:57:42 +08:00
27ed2ac071
HBASE-22828 Log a region close journal ( #471 )
...
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-08-13 15:42:41 -07:00
3867fae04d
HBASE-22829 Removed deprecated methods from SnapshotDescription
...
Signed-off-by: stack <stack@apache.org>
2019-08-12 08:41:05 +02:00
e9382154f3
HBASE-22830 Removed deprecated method from StoreFile
...
Signed-off-by: stack <stack@apache.org>
2019-08-12 01:06:15 +02:00
15c903b3f8
HBASE-22725 Remove all remaining Javadoc warnings
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-08-11 21:48:08 +02:00
c8f57bf678
HBASE-22623 - Add RegionObserver coprocessor hook for preWALAppend ( #390 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-08-09 14:27:32 -07:00
0136b9873f
HBASE-22543 Revisit HBASE-21207 to make all values fully sortable
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-08-09 14:29:30 +01:00
989e09a2d5
HBASE-22824 Show filesystem path for the orphans regions on filesystem ( #469 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-08-09 02:07:14 -05:00
eb92b25652
HBASE-22803 Modify config value range to enable turning off of the hbck chore ( #466 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-08-08 17:33:42 -07:00
9250977681
HBASE-22808 HBCK Report showed the offline regions which belong to disabled table ( #465 )
...
Signed-off-by: Stack <stack@apache.org>
2019-08-08 03:57:17 -05:00
0e5dc6d7ce
HBASE-22776 Rename config names in user scan snapshot feature ( #440 )
2019-08-08 16:01:02 +08:00
547cec4078
HBASE-22807 HBCK Report showed wrong orphans regions on FileSystem ( #461 )
...
Signed-off-by: Sakthi <sakthi@apache.org>
2019-08-07 19:17:26 -05:00
1b168cd6de
HBASE-22777 Add a multi-region merge (for fixing overlaps)
...
Makes MergeTableRegionsProcedure do more than just two regions at a
time. Compatible as MTRP was done considering one day it'd do more than
two at a time.
Changes hardcoded assumption that merge parent regions are named
mergeA and mergeB in a column on the resultant region. Instead
can have N columns on the merged region, one for each parent
merged. Column qualifiers all being with 'merge'.
Most of code below is undoing the assumption that there are two
parents on a merge only.
2019-08-07 15:22:07 -07:00
49839e4075
HBASE-22812 InterfaceAudience annotation in CatalogJanitor uses fully… ( #462 )
...
Signed-off-by: Stack <stack@apache.org>
Signed-off-by: Sakthi <sakthi@apache.org>
2019-08-07 10:38:09 -07:00
a9773ec5e8
HBASE-22417 DeleteTableProcedure.deleteFromMeta method should remove table from Master's table descriptors cache
...
Signed-off-by: stack <stack@apache.org>
2019-08-07 12:06:12 +01:00
07c6bb16e7
HBASE-22759 Add user info to AUDITLOG events when doing grant/revoke
2019-08-07 11:06:30 +02:00
3b0013ded9
HBASE-22731 ReplicationSource and HBaseInterClusterReplicationEndpoint log messages should include a target Peer identifier
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-08-06 16:08:04 +01:00
eef8e140c5
HBASE-22793 RPC server connection is logging user as NULL principal
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Pankaj Kumar <pankaj.kr@huawei.com>
2019-08-06 14:40:21 +02:00
08677143e8
HBASE-22771 [HBCK2] fixMeta method and server-side support
...
This is a first cut at this patch. Implements hold fixing only
currently.
Add a fixMeta method to Hbck Interface.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
Bug fix. If hole is on end of last table, I wasn't seeing it.
A hbase-server/src/main/java/org/apache/hadoop/hbase/master/MetaFixer.java
Add a general meta fixer class. Explains up top why this stuff doesn't
belong inside MetaTableAccessor.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
Break out the filesystem messing so don't have to copy it nor do more
than is needed doing fixup for Region holes.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java
Change behavious slightly. If directory exists, don't fail as we did
but try and keep going and create .regioninfo file if missing (or
overwrite if in place). This should make it idempotent. Can rerun
command. Lets see if any repercussions in test suite.
A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMetaFixer.java
Add test.
Signed-off-by: Zheng Hu <openinx@gmail.com>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-08-05 22:20:29 -07:00
30805be078
HBASE-22771 [HBCK2] fixMeta method and server-side support
...
This is a first cut at this patch. Implements hold fixing only
currently.
Add a fixMeta method to Hbck Interface.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
Bug fix. If hole is on end of last table, I wasn't seeing it.
A hbase-server/src/main/java/org/apache/hadoop/hbase/master/MetaFixer.java
Add a general meta fixer class. Explains up top why this stuff doesn't
belong inside MetaTableAccessor.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
Break out the filesystem messing so don't have to copy it nor do more
than is needed doing fixup for Region holes.
M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java
Change behavious slightly. If directory exists, don't fail as we did
but try and keep going and create .regioninfo file if missing (or
overwrite if in place). This should make it idempotent. Can rerun
command. Lets see if any repercussions in test suite.
A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMetaFixer.java
Add test.
Signed-off-by: Zheng Hu <openinx@gmail.com>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-08-05 22:08:31 -07:00
66a2fc5d25
HBASE-22539 WAL corruption due to early DBBs re-use when Durability.ASYNC_WAL is used ( #437 )
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-08-05 16:19:05 +08:00
237229cade
HBASE-22707 [HBCK2] MasterRpcServices assigns method should try to reload regions from meta if the passed regions isn't found under AssignmentManager RegionsStateStore
...
Signed-off-by: stack <stack@apache.org>
2019-08-01 16:49:57 +01:00
35acf3cb78
HBASE-22737 Add a new admin method and shell cmd to trigger the hbck chore to run ( #425 )
...
Signed-off-by: stack <stack@apache.org>
2019-08-01 08:54:47 +08:00
24b970ec51
Revert "HBASE-22744 Removed deprecated status and load classes in client module"
...
This reverts commit 4a61c8b10a
2019-07-31 12:29:19 +02:00
9a4a8ef274
HBASE-22363 Remove hardcoded number of read cache block buckets
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-31 09:13:17 +02:00
586e177ded
HBASE-22753 Removed deprecated ImmutableHRegionInfo ( #420 )
...
Signed-off-by: stack <stack@apache.org>
2019-07-31 08:07:31 +02:00
373c2dc13f
HBASE-22741 Show catalogjanitor consistency complaints in new 'HBCK Report' page
...
Signed-off-by: huzheng <openinx@gmail.com>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-07-30 11:16:45 -07:00
4a61c8b10a
HBASE-22744 Removed deprecated status and load classes in client module
...
Signed-off-by: stack <stack@apache.org>
2019-07-30 12:40:42 +02:00
f9fd5b65fa
HBASE-22752 Removed the deprecated ImmutableHColumnDescriptor and ImmutableHTableDescriptor ( #419 )
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: stack <stack@apache.org>
2019-07-30 12:32:10 +02:00
46a432386e
HBASE-22746 Removed deprecated methods from Delete
...
Signed-off-by: stack <stack@apache.org>
2019-07-30 08:52:19 +02:00
c286a31590
HBASE-22758 Remove the unneccesary info cf deletion in DeleteTableProcedure#deleteFromMeta ( #424 )
2019-07-30 14:16:08 +08:00
0c80d5b42b
HBASE-22723 Have CatalogJanitor report holes and overlaps; i.e. problems it sees when doing its regular scan of hbase:meta
...
Refactor of CatalogJanitor so it generates a
Report on the state of hbase:meta when it runs. Also
refactor so CJ runs even if RIT (previous it would
punt on running if RIT) so it can generate a 'Report'
on the interval regardless. If RIT, it just doesn't
go on to do the merge/split GC as it used to.
If report finds an issue, dump as a WARN message
to the master log.
Follow-on is to make the Report actionable/available
for the Master to pull when it goes to draw the hbck
UI page (could also consider shipping the Report as
part of ClusterMetrics?)
Adds new, fatter Visitor to CJ, one that generates
Report on each run keeping around more findings as
it runs.
Moved some methods around so class reads better;
previous methods were randomly ordered in the class.
M hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
Make a few handy methods public.
M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionInfo.java
Add utility as defaults on the Inteface; i.e. is this the first region
in table, is it last, does a passed region come next, or does passed
region overlap this region (added tests for this new stuff).
M hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
Bugfix... handle case where buffer passed is null.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
Lots of change, reorg., but mostly adding consistency checking
to the visitor used scanning hbase:meta on a period and the
generation of a Report on what the scan has found traversing
hbase:meta. Added a main so could try the CatalogJanitor against
a running cluster.
A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestCatalogJanitorCluster.java
Fat ugly test for CatalogJanitor consistency checking.
M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionInfo.java
Add tests for new functionality in RI.
M hbase-shell/src/main/ruby/hbase/table.rb
Bug fix for case where meta has a null regioninfo; scan was aborting.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-07-29 16:00:57 -07:00
f68cda32e1
HBASE-22751 table.jsp fails if ugly regions in table
2019-07-29 09:38:46 -07:00
11f30de2cf
HBASE-22313 Add method to FsDelegation token to accept token kind ( #199 )
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-29 11:18:19 +02:00
e273d0bc3a
HBASE-22748 Removed deprecated methods from Put
...
Signed-off-by: stack <stack@apache.org>
2019-07-29 08:50:16 +02:00
7294af8b15
HBASE-22580 Add a table attribute to make user scan snapshot feature configurable for table ( #336 )
2019-07-29 09:51:26 +08:00
cf8114a82e
HBASE-22709 Add a chore thread in master to do hbck checking ( #404 )
...
Signed-off-by: stack <stack@apache.org>
2019-07-27 18:23:37 +08:00
1cb37f18aa
HBASE-22742 [HBCK2] Add more log for hbck operations at master side
...
Signed-off-by: stack <stack@apache.org>
2019-07-27 12:25:11 +08:00
fa77c75848
HBASE-22382 Refactor tests in TestFromClientSide; ADDENDUM to fix tests
2019-07-26 13:28:06 -07:00
747d000808
HBASE-22733 TestSplitTransactionOnCluster.testMasterRestartAtRegionSplitPendingCatalogJanitor is flakey ( #408 )
...
Signed-off-by: stack <stack@apache.org>
2019-07-25 11:09:07 -07:00
e28afec9ec
HBASE-22594 Clean up for backup examples ( #315 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-25 13:35:44 +08:00
a65e72d5da
HBASE-22715 All scan requests should be handled by scan handler threads in RWQueueRpcExecutor ( #393 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
Conflicts:
hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestSimpleRpcScheduler.java
2019-07-24 11:57:04 -07:00
a399a1452b
HBASE-22578 HFileCleaner should not delete empty ns/table directories used for user san snapshot feature ( #337 )
2019-07-24 15:14:56 +08:00
542ae47797
HBASE-22382 Refactor tests in TestFromClientSide ( #385 )
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-24 14:08:45 +08:00
6705d4ffdf
HBASE-22721 Refactor HBaseFsck: move the inner class out
...
Signed-off-by: stack <stack@apache.org>
2019-07-24 08:02:41 +08:00
d9493c539f
HBASE-22603 Javadoc Warnings related to @link tag
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-07-23 14:14:12 +02:00
06f5c43de3
HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize
...
Signed-off-by: Reid Chan <reidchan@apache.org>
Co-authored-by: Reid Chan <reidchan@apache.org>
2019-07-23 11:27:02 +08:00
0e34dcbf4b
Revert "HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize"
...
Reason: Deprecated a wrong parameter.
This reverts commit fe450b50c1
2019-07-23 11:04:13 +08:00
fe450b50c1
HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize
...
* HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize.
* HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize. Deprecated old attribute and introduced a new one
* HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize. Removed unnecessary import
* HBASE-22610 added two import configs and removed one
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-07-23 10:40:32 +08:00
9615c644f5
HBASE-22648 Snapshot TTL ( #371 )
...
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-07-22 15:03:44 -07:00
7f68591767
HBASE-22690 Deprecate / Remove OfflineMetaRepair in hbase-2+
...
Signed-off-by: stack <stack@apache.org>
2019-07-22 22:57:33 +09:00
00075ea4fc
HBASE-22663 The HeapAllocationRatio in WebUI is not accurate because all of the heap allocation will happen in another separated allocator named HEAP ( #365 )
2019-07-20 23:30:08 +08:00
1ad48c1ebc
HBASE-22622 WALKey Extended Attributes ( #352 )
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-07-19 15:30:38 -07:00
48c623c808
HBASE-22673 Avoid to expose protobuf stuff in Hbck interface
...
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-07-19 08:03:06 +08:00
ed2d7e4110
HBASE-22537 Split happened Replica region can not be deleted after deleting table successfully and restarting RegionServer
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
2019-07-18 16:16:15 +01:00
254dbd07fb
HBASE-22527 [hbck2] Add a master web ui to show the problematic regions (addendum)
2019-07-18 17:50:44 +08:00
e08ac5fafb
HBASE-21426 TestEncryptionKeyRotation.testCFKeyRotation is flaky ( #375 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-07-18 09:02:17 +08:00
f0cbdf8beb
HBASE-22527 [hbck2] Add a master web ui to show the problematic regions
2019-07-18 08:23:12 +08:00
2b7e33fe52
HBASE-22704 Avoid NPE when access table.jsp and snapshot.jsp but master not finish initialization ( #389 )
2019-07-18 08:20:36 +08:00
82ea04dbab
HBASE-7191 HBCK - Add offline create/fix hbase.version and hbase.id
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-07-17 07:50:41 -07:00
9d5e5adaf0
HBASE-20368 Fix RIT stuck when a rsgroup has no online servers but AM's pendingAssginQueue is cleared ( #354 )
2019-07-17 22:05:36 +08:00
cc38de1a39
HBASE-22643 : Delete region without archiving only if regiondir is present
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
2019-07-16 10:25:24 +01:00
8f56bee93b
HBASE-22684 The log rolling request maybe canceled immediately in LogRoller due to a race ( #378 )
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-07-15 21:35:06 +08:00
8defea9561
HBASE-22586 Javadoc Warnings related to @param tag
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-07-13 16:46:18 +02:00
032c18fbd0
HBASE-22681 The 'assert highestUnsyncedTxid < entry.getTxid();' in AbstractFWAL.append may fail when using AsyncFSWAL ( #376 )
...
Signed-off-by: Zheng Hu <openinx@gmail.com>
2019-07-13 22:11:39 +08:00
9f343c2efa
HBASE-22571 Javadoc Warnings related to @return tag
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-07-13 13:34:48 +02:00
12d7db7078
HBASE-22686 ZkSplitLogWorkerCoordination doesn't allow a regionserver to pick up all of the split work it is capable of ( #377 )
...
Signed-off-by: Xu Cang <xcang@apache.org>
2019-07-12 18:10:15 -07:00
9ac9505f2a
HBASE-22606 BucketCache additional tests
...
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Sakthi <sakthivel.azhaku@gmail.com>
2019-07-09 12:12:19 +01:00
605f8a15bb
HBASE-22656 [Metrics] Table metrics 'BatchPut' and 'BatchDelete' are never updated
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-07-07 23:21:21 +08:00
ac4e52880b
HBASE-22582 The Compaction writer may access the lastCell whose memory has been released when appending fileInfo in the final ( #341 )
2019-07-04 14:27:21 +08:00
a4738e5184
HBASE-22403 Balance in RSGroup should consider throttling and a failure affects the whole
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-07-04 08:47:48 +08:00
64e732dc8b
HBASE-22624 Should sanity check table configuration when clone snapshot to a new table
2019-07-03 11:54:25 +08:00
62c7e73dc0
HBASE-22637 fix flaky test in TestMetaTableMetrics
...
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Sakthi <sakthivel.azhaku@gmail.com>
2019-07-02 09:35:43 +02:00
fabf2b8282
HBASE-22572 Javadoc Warnings: @link reference not found ( #306 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
2019-07-01 21:15:00 -07:00
52eb893bcc
HBASE-22169 Open region failed cause memory leak
...
Signed-off-by: stack <stack@apache.org>
2019-07-01 13:55:00 -07:00
94d5419efb
HBASE-22632 SplitTableRegionProcedure and MergeTableRegionsProcedure should skip store files for unknown column families ( #344 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-06-27 21:54:53 +08:00
0198868531
HBASE-20060 Add details of off heap memstore into book. ( #334 )
2019-06-26 14:58:34 +08:00
b42614295e
HBASE-22617 Recovered WAL directories not getting cleaned up ( #330 )
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-06-25 16:21:24 +08:00
15ac781057
HBASE-22616 responseTooXXX logging for Multi should characterize the component ops ( #329 )
...
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2019-06-24 18:03:17 -07:00
531d2902cb
HBASE-22612 Address the final overview reviewing comments of HBASE-21879 ( #331 )
2019-06-24 18:04:40 +08:00
c1e5350be7
HBASE-21995 Add a coprocessor to set HDFS ACL for hbase granted user
2019-06-24 10:40:38 +08:00
2e414360bd
HBASE-22547 Align the config keys and add document for offheap read in HBase Book. ( #301 )
2019-06-24 10:25:34 +08:00
ccabbdd40a
HBASE-22531 The HFileReaderImpl#shouldUseHeap return the incorrect true when disabled BlockCache ( #304 )
2019-06-24 10:25:34 +08:00
d64c3a2611
HBASE-22491 Separate the heap HFileBlock and offheap HFileBlock because the heap block won't need refCnt and save into prevBlocks list before shipping ( #268 )
2019-06-24 10:25:33 +08:00
5b363a6140
HBASE-22463 Some paths in HFileScannerImpl did not consider block#release which will exhaust the ByteBuffAllocator ( #257 )
2019-06-24 10:25:33 +08:00
962554d340
HBASE-22422 Retain an ByteBuff with refCnt=0 when getBlock from LRUCache ( #242 )
2019-06-24 10:25:33 +08:00
b1fee0ebdd
HBASE-22435 Add a UT to address the HFileBlock#heapSize() in TestHeapSize
2019-06-24 10:25:33 +08:00
7188a3bd3d
HBASE-22412 Improve the metrics in ByteBuffAllocator
2019-06-24 10:25:33 +08:00
a8f8a4a1c9
HBASE-22090 The HFileBlock#CacheableDeserializer should pass ByteBuffAllocator to the newly created HFileBlock
2019-06-24 10:25:33 +08:00
97476ed2e0
HBASE-21921 Notify users if the ByteBufAllocator is always allocating ByteBuffers from heap which means the increacing GC pressure
2019-06-24 10:25:33 +08:00
ca92378e42
HBASE-22122 Change to release mob hfile's block after rpc server shipped response to client
2019-06-24 10:25:32 +08:00
7dedb5625a
HBASE-21937 Make the Compression#decompress can accept ByteBuff as input
2019-06-24 10:25:32 +08:00
77cef7490b
HBASE-22211 Remove the returnBlock method because we can just call HFileBlock#release directly
2019-06-24 10:25:32 +08:00
48aca4db30
HBASE-21957 Unify refCount of BucketEntry and refCount of hbase.nio.ByteBuff into one
2019-06-24 10:25:32 +08:00
773c0d6635
HBASE-22159 ByteBufferIOEngine should support write off-heap ByteBuff to the bufferArray
2019-06-24 10:25:32 +08:00
d1eb6171f9
HBASE-22127 Ensure that the block cached in the LRUBlockCache offheap is allocated from heap
2019-06-24 10:25:32 +08:00
35b818606f
HBASE-22005 Use ByteBuff's refcnt to track the life cycle of data block
2019-06-24 10:25:31 +08:00
e4fe0b6feb
HBASE-22016 Rewrite the block reading methods by using hbase.nio.ByteBuff
2019-06-24 10:25:31 +08:00
e91cab08b6
HBASE-21917 Make the HFileBlock#validateChecksum can accept ByteBuff as an input. (addendum)
2019-06-24 10:25:31 +08:00
d00a1da976
HBASE-21917 Make the HFileBlock#validateChecksum can accept ByteBuff as an input.
2019-06-24 10:25:31 +08:00
532ebfb7a5
HBASE-21916 Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool
2019-06-24 10:25:31 +08:00
6d08ffcfc6
HBASE-21284 Default limits for PressureAwareCompactionThroughputController are too low
...
This is a forward port HBASE-21000 from branch-1.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-06-20 12:44:01 -07:00
c7c6140396
HBASE-22596 [Chore] Separate the execution period between CompactionChecker and PeriodicMemStoreFlusher
...
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
2019-06-20 10:56:42 +08:00
79ee19b0c7
HBASE-22561 modify HFilePrettyPrinter to accept non-rootdir directories
...
Signed-off-by: huzheng <openinx@gmail.com>
2019-06-19 15:14:36 +08:00
ac3d09e7fd
HBASE-22577 BufferedMutatorOverAsyncBufferedMutator.tryCompleteFuture consume too much CPU time
2019-06-18 08:43:35 +08:00
621dc88c79
HBASE-22553 NPE in RegionReplicaReplicationEndpoint
2019-06-18 08:43:35 +08:00
6278c98f5d
HBASE-22550 Throw exception when creating thread pool if the connection has already been closed
2019-06-18 08:43:35 +08:00
1a5c2a0257
HBASE-22351 Fix creating table timeout for TestProcedurePriority
2019-06-18 08:43:35 +08:00
a116e0bab1
HBASE-21723 Remove ConnectionImplementation and related classes
2019-06-18 08:43:35 +08:00
2e3a3d6776
HBASE-22037 Re-enable TestAvoidCellReferencesIntoShippedBlocks
2019-06-18 08:43:35 +08:00
a95eb6559d
HBASE-22328 NPE in RegionReplicaReplicationEndpoint
2019-06-18 08:43:35 +08:00
6855d58379
HBASE-22036 Rewrite TestScannerHeartbeatMessages
2019-06-18 08:43:35 +08:00
a185be8a13
HBASE-22239 Also catch RemoteException in SyncReplicationTestBase.verifyReplicationRequestRejection
2019-06-18 08:43:35 +08:00
d5bd8417d5
HBASE-22302 Fix TestHbck
2019-06-18 08:43:35 +08:00
c8391809fc
HBASE-22297 Fix TestRegionMergeTransitionOnCluster and TestSplitTransactionOnCluster
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-06-18 08:43:35 +08:00
127bef4d10
HBASE-22295 Fix TestClientOperationTimeout
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-06-18 08:43:35 +08:00
d1487fcfad
HBASE-21725 Implement BufferedMutator Based on AsyncBufferedMutator
2019-06-18 08:43:35 +08:00
d64d015f51
HBASE-21718 Implement Admin based on AsyncAdmin
2019-06-18 08:43:32 +08:00
6b87a4ce98
HBASE-21717 Implement Connection based on AsyncConnection
2019-06-18 08:37:51 +08:00
b7793d7d1d
HBASE-21585 Remove ClusterConnection
2019-06-18 08:37:50 +08:00
2182bfb942
HBASE-21779 Reimplement BulkLoadHFilesTool to use AsyncClusterConnection
2019-06-18 08:37:50 +08:00
72d9f8747f
HBASE-21778 Remove the usage of the locateRegion related methods in ClusterConnection
...
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-06-18 08:35:59 +08:00
88adfa3278
HBASE-21719 Rewrite RegionPlacementMaintainer to use AsyncClusterConnection
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-06-18 08:35:58 +08:00
a5bcf7d6c7
HBASE-21537 Rewrite ServerManager.closeRegionSilentlyAndWait to use AsyncClusterConnection
...
Signed-off-by: Michael Stack <stack@apache.org>
2019-06-18 08:35:58 +08:00
d005d6f30a
HBASE-21671 Rewrite RegionReplicaReplicationEndpoint to use AsyncClusterConnection
2019-06-18 08:35:58 +08:00
7593e86c5f
HBASE-21538 Rewrite RegionReplicaFlushHandler to use AsyncClusterConnection
2019-06-18 08:35:58 +08:00
04f737d9bd
HBASE-21579 Use AsyncClusterConnection for HBaseInterClusterReplicationEndpoint
2019-06-18 08:35:58 +08:00
5d872d3422
HBASE-21526 Use AsyncClusterConnection in ServerManager for getRsAdmin
2019-06-18 08:35:58 +08:00
2446f0026b
HBASE-21516 Use AsyncConnection instead of Connection in SecureBulkLoadManager
2019-06-18 08:35:58 +08:00
30c131b5f7
HBASE-21515 Also initialize an AsyncClusterConnection in HRegionServer
2019-06-18 08:35:58 +08:00
5da5deb59d
HBASE-22344 Documented the deprecation of public and limited private APIs ( #208 )
...
Signed-off-by: stack <stack@apache.org>
2019-06-17 22:02:23 +02:00
9b413cf262
HBASE-22590 Remove the deprecated methods in Table interface ( #309 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Guanghao <zghao@apache.org>
2019-06-17 10:18:18 +08:00
ed30909d27
HBASE-19303 Removed ReplicationAdmin and all its usages
...
Signed-off-by: stack <stack@apache.org>
2019-06-16 16:20:04 +02:00
47a96444da
HBASE-22275 Removed deprecated getRegionInfo in HRegionLocation
...
Signed-off-by: stack <stack@apache.org>
2019-06-16 16:13:46 +02:00
ab4453158a
HBASE-22559 [RPC] set guard against CALL_QUEUE_HANDLER_FACTOR_CONF_KEY
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-06-14 14:38:10 +08:00
8e15f4ed61
HBASE-22530 The metrics of store files count of region are returned to clients incorrectly (Eungsop Yoo)
...
Signed-off-by: Xu Cang <xucang@apache.org>
2019-06-13 17:42:26 -07:00
9ba7651889
HBASE-22565 Javadoc Warnings: @see cannot be used in inline documentation
2019-06-13 23:09:42 +02:00
35d70881c3
HBASE-22562 Remove dead code: skipControl
...
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-06-13 16:04:19 -04:00
ada772a1d3
HBASE-22408 add dead and unknown server open regions metric to AM
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-06-10 16:15:52 -07:00
03436e68bc
HBASE-22552 Rewrite TestEndToEndSplitTransaction.testCanSplitJustAfterASplit
2019-06-10 13:08:05 +08:00
8db9c84cd0
HBASE-22551 TestMasterOperationsForRegionReplicas is flakey
2019-06-10 07:48:39 +08:00
99ea828d1c
HBASE-22373 Moved maven-eclipse-plugin to eclipse profile
2019-06-10 00:51:18 +02:00
f62028593f
HBASE-22262 Removed deprecated methods from Filter class
2019-06-10 00:47:15 +02:00
876d2acf9a
HBASE-22284 optimization StringBuilder.append of AbstractMemStore.toString #182
2019-06-09 14:33:03 -07:00
454edddd77
HBASE-22482 Fix tag Warnings in TestPartitionedMobCompactor ( #255 )
...
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-06-09 14:21:43 -07:00
0838c356d4
HBASE-2284 Javadoc Warnings: Fix warnings coming due to @result tag in TestCoprocessorWhitelistMasterObserver ( #256 )
2019-06-09 14:13:54 -07:00
80281127cb
HBASE-22548 Split TestAdmin1
2019-06-08 20:48:36 +08:00
13c5af38da
HBASE-22520 Avoid possible NPE while performing seekBefore in Hal… ( #281 )
...
HBASE-22520 Avoid possible NPE while performing seekBefore in HalfStoreFileReader
2019-06-06 15:43:36 -07:00
6ea2566ac3
[HBASE-22525] : Return procedures to use bulk operation over iteration for Perf Improvement ( #284 )
2019-06-06 15:37:44 -07:00
a826f41e83
HBASE-22546 TestRegionServerHostname#testRegionServerHostname fails reliably for me
2019-06-05 20:55:16 -07:00
5bc996e1de
HBASE-22160 Add sorting functionality in regionserver web UI for user
...
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
2019-06-05 11:05:41 +09:00
0ad4b4e160
HBASE-22536 TestForeignExceptionSerialization fails when run on JDK11
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-06-04 11:49:56 -05:00
26037854ad
HBASE-22524 Refactor TestReplicationSyncUpTool
2019-06-04 07:46:15 +08:00
51c49a1784
HBASE-22497 Mark HBase 1.2 line as EOM
...
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-06-03 06:55:58 -05:00
073de44445
HBASE-22513 Admin#getQuota does not work correctly if exceedThrottleQuota is set
2019-06-03 16:55:23 +08:00
04e5bf96d8
HBASE-22523 Refactor RegionStates#getAssignmentsByTable to make it easy to understand
2019-06-02 21:21:26 +08:00
b2b7811902
HBASE-22511 Add some more rs-status paths to RS UI links
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-05-31 14:30:08 -04:00
6735cc13c1
HBASE-22502 Purge the logs when we reach the EOF for the last wal file when replication
2019-05-31 15:36:42 +08:00
0fcd7cae55
HBASE-22503 Failed to upgrade to 2.2+ as the global permission which storaged in zk is not right
2019-05-31 09:10:52 +08:00
98a1552687
HBASE-22459 Expose store reader reference count ( #248 )
2019-05-30 15:04:16 -07:00
4657c90991
HBASE-22487 getMostLoadedRegions is unused
...
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-05-30 18:32:25 +02:00
78e4aea3c5
HBASE-22472 The newly split TestReplicationStatus* tests are flaky
2019-05-30 21:49:43 +08:00
康智冬
stack
Istvan Toth
Sean Busbey
Guanghao Zhang
Aman Poonia
David Manning
linkaline
Jan Hentschel
Bing Xiao
Pankaj
Sakthi
bsglz
Tai-Ying Lee
openinx
Viraj Jasani
shahrs87
shardul-cr7
Andrew Purtell
Guanghao Zhang
satanson
Pierre Zemb
Duo Zhang
Huon Wilson
Daisuke Kobayashi
Itsuki Toyota
meiyi
Caroline Zhou
syedmurtazahassan
Geoffrey Jacoby
Wellington Chevreuil
Andor Molnár
sreenivasulureddy
Biju Nair
Venkatesh Sridharan
Jeongdae Kim
Reid Chan
Viraj Jasani
Toshihiro Suzuki
Viraj Jasani
Mate Szalay-Beko
Mingliang Liu
Artem Ervits
Josh Elser
Sergey Shelukhin
WenFeiYi
Sakthi
Clay Baenziger