Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
16,979 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

7793 Commits

Author SHA1 Message Date
openinx 8ffc45ab8b
HBASE-22810 Initialize an separate ThreadPoolExecutor for taking/restoring snapshot (#486) 2019-08-15 10:57:42 +08:00
Andrew Purtell 27ed2ac071
HBASE-22828 Log a region close journal (#471) 
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Reid Chan <reidchan@apache.org>
 2019-08-13 15:42:41 -07:00
Jan Hentschel 3867fae04d
HBASE-22829 Removed deprecated methods from SnapshotDescription 
Signed-off-by: stack <stack@apache.org>
 2019-08-12 08:41:05 +02:00
Jan Hentschel e9382154f3
HBASE-22830 Removed deprecated method from StoreFile 
Signed-off-by: stack <stack@apache.org>
 2019-08-12 01:06:15 +02:00
syedmurtazahassan 15c903b3f8 HBASE-22725 Remove all remaining Javadoc warnings 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-08-11 21:48:08 +02:00
Geoffrey Jacoby c8f57bf678 HBASE-22623 - Add RegionObserver coprocessor hook for preWALAppend (#390) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-08-09 14:27:32 -07:00
Daisuke Kobayashi 0136b9873f HBASE-22543 Revisit HBASE-21207 to make all values fully sortable 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2019-08-09 14:29:30 +01:00
Guanghao Zhang 989e09a2d5
HBASE-22824 Show filesystem path for the orphans regions on filesystem (#469) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-08-09 02:07:14 -05:00
Sakthi eb92b25652
HBASE-22803 Modify config value range to enable turning off of the hbck chore (#466) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-08-08 17:33:42 -07:00
Guanghao Zhang 9250977681
HBASE-22808 HBCK Report showed the offline regions which belong to disabled table (#465) 
Signed-off-by: Stack <stack@apache.org>
 2019-08-08 03:57:17 -05:00
meiyi 0e5dc6d7ce
HBASE-22776 Rename config names in user scan snapshot feature (#440) 2019-08-08 16:01:02 +08:00
Guanghao Zhang 547cec4078
HBASE-22807 HBCK Report showed wrong orphans regions on FileSystem (#461) 
Signed-off-by: Sakthi <sakthi@apache.org>
 2019-08-07 19:17:26 -05:00
stack 1b168cd6de HBASE-22777 Add a multi-region merge (for fixing overlaps) 
Makes MergeTableRegionsProcedure do more than just two regions at a
time. Compatible as MTRP was done considering one day it'd do more than
two at a time.

Changes hardcoded assumption that merge parent regions are named
mergeA and mergeB in a column on the resultant region. Instead
can have N columns on the merged region, one for each parent
merged. Column qualifiers all being with 'merge'.

Most of code below is undoing the assumption that there are two
parents on a merge only.
 2019-08-07 15:22:07 -07:00
syedmurtazahassan 49839e4075 HBASE-22812 InterfaceAudience annotation in CatalogJanitor uses fully… (#462) 
Signed-off-by: Stack <stack@apache.org>
Signed-off-by: Sakthi <sakthi@apache.org>
 2019-08-07 10:38:09 -07:00
Wellington Chevreuil a9773ec5e8 HBASE-22417 DeleteTableProcedure.deleteFromMeta method should remove table from Master's table descriptors cache 
Signed-off-by: stack <stack@apache.org>
 2019-08-07 12:06:12 +01:00
Andor Molnár 07c6bb16e7 HBASE-22759 Add user info to AUDITLOG events when doing grant/revoke 2019-08-07 11:06:30 +02:00
Wellington Chevreuil 3b0013ded9 HBASE-22731 ReplicationSource and HBaseInterClusterReplicationEndpoint log messages should include a target Peer identifier 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-08-06 16:08:04 +01:00
sreenivasulureddy eef8e140c5 HBASE-22793 RPC server connection is logging user as NULL principal 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Pankaj Kumar <pankaj.kr@huawei.com>
 2019-08-06 14:40:21 +02:00
stack 08677143e8 HBASE-22771 [HBCK2] fixMeta method and server-side support 
This is a first cut at this patch. Implements hold fixing only
currently.

Add a fixMeta method to Hbck Interface.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
 Bug fix. If hole is on end of last table, I wasn't seeing it.

A hbase-server/src/main/java/org/apache/hadoop/hbase/master/MetaFixer.java
 Add a general meta fixer class. Explains up top why this stuff doesn't
 belong inside MetaTableAccessor.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 Break out the filesystem messing so don't have to copy it nor do more
 than is needed doing fixup for Region holes.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java
 Change behavious slightly. If directory exists, don't fail as we did
 but try and keep going and create .regioninfo file if missing (or
 overwrite if in place). This should make it idempotent. Can rerun
 command. Lets see if any repercussions in test suite.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMetaFixer.java
 Add test.

Signed-off-by: Zheng Hu <openinx@gmail.com>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-08-05 22:20:29 -07:00
stack 30805be078 HBASE-22771 [HBCK2] fixMeta method and server-side support 
This is a first cut at this patch. Implements hold fixing only
currently.

Add a fixMeta method to Hbck Interface.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
 Bug fix. If hole is on end of last table, I wasn't seeing it.

A hbase-server/src/main/java/org/apache/hadoop/hbase/master/MetaFixer.java
 Add a general meta fixer class. Explains up top why this stuff doesn't
 belong inside MetaTableAccessor.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
 Break out the filesystem messing so don't have to copy it nor do more
 than is needed doing fixup for Region holes.

M hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionFileSystem.java
 Change behavious slightly. If directory exists, don't fail as we did
 but try and keep going and create .regioninfo file if missing (or
 overwrite if in place). This should make it idempotent. Can rerun
 command. Lets see if any repercussions in test suite.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMetaFixer.java
 Add test.

Signed-off-by: Zheng Hu <openinx@gmail.com>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-08-05 22:08:31 -07:00
Duo Zhang 66a2fc5d25
HBASE-22539 WAL corruption due to early DBBs re-use when Durability.ASYNC_WAL is used (#437) 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-08-05 16:19:05 +08:00
Wellington Chevreuil 237229cade HBASE-22707 [HBCK2] MasterRpcServices assigns method should try to reload regions from meta if the passed regions isn't found under AssignmentManager RegionsStateStore 
Signed-off-by: stack <stack@apache.org>
 2019-08-01 16:49:57 +01:00
Guanghao Zhang 35acf3cb78
HBASE-22737 Add a new admin method and shell cmd to trigger the hbck chore to run (#425) 
Signed-off-by: stack <stack@apache.org>
 2019-08-01 08:54:47 +08:00
Jan Hentschel 24b970ec51
Revert "HBASE-22744 Removed deprecated status and load classes in client module" 
This reverts commit 4a61c8b10a.
 2019-07-31 12:29:19 +02:00
Biju Nair 9a4a8ef274 HBASE-22363 Remove hardcoded number of read cache block buckets 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-07-31 09:13:17 +02:00
Jan Hentschel 586e177ded HBASE-22753 Removed deprecated ImmutableHRegionInfo (#420) 
Signed-off-by: stack <stack@apache.org>
 2019-07-31 08:07:31 +02:00
stack 373c2dc13f HBASE-22741 Show catalogjanitor consistency complaints in new 'HBCK Report' page 
Signed-off-by: huzheng <openinx@gmail.com>
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-07-30 11:16:45 -07:00
Jan Hentschel 4a61c8b10a
HBASE-22744 Removed deprecated status and load classes in client module 
Signed-off-by: stack <stack@apache.org>
 2019-07-30 12:40:42 +02:00
Jan Hentschel f9fd5b65fa HBASE-22752 Removed the deprecated ImmutableHColumnDescriptor and ImmutableHTableDescriptor (#419) 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: stack <stack@apache.org>
 2019-07-30 12:32:10 +02:00
Jan Hentschel 46a432386e
HBASE-22746 Removed deprecated methods from Delete 
Signed-off-by: stack <stack@apache.org>
 2019-07-30 08:52:19 +02:00
openinx c286a31590
HBASE-22758 Remove the unneccesary info cf deletion in DeleteTableProcedure#deleteFromMeta (#424) 2019-07-30 14:16:08 +08:00
stack 0c80d5b42b HBASE-22723 Have CatalogJanitor report holes and overlaps; i.e. problems it sees when doing its regular scan of hbase:meta 
Refactor of CatalogJanitor so it generates a
Report on the state of hbase:meta when it runs. Also
refactor so CJ runs even if RIT (previous it would
punt on running if RIT) so it can generate a 'Report'
on the interval regardless. If RIT, it just doesn't
go on to do the merge/split GC as it used to.

If report finds an issue, dump as a WARN message
to the master log.

Follow-on is to make the Report actionable/available
for the Master to pull when it goes to draw the hbck
UI page (could also consider shipping the Report as
part of ClusterMetrics?)

Adds new, fatter Visitor to CJ, one that generates
Report on each run keeping around more findings as
it runs.

Moved some methods around so class reads better;
previous methods were randomly ordered in the class.

M hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
 Make a few handy methods public.

M hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionInfo.java
 Add utility as defaults on the Inteface; i.e. is this the first region
 in table, is it last, does a passed region come next, or does passed
 region overlap this region (added tests for this new stuff).

M hbase-common/src/main/java/org/apache/hadoop/hbase/util/Bytes.java
 Bugfix... handle case where buffer passed is null.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/CatalogJanitor.java
 Lots of change, reorg., but mostly adding consistency checking
 to the visitor used scanning hbase:meta on a period and the
 generation of a Report on what the scan has found traversing
 hbase:meta. Added a main so could try the CatalogJanitor against
 a running cluster.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestCatalogJanitorCluster.java
 Fat ugly test for CatalogJanitor consistency checking.

M hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegionInfo.java
 Add tests for new functionality in RI.

M hbase-shell/src/main/ruby/hbase/table.rb
 Bug fix for case where meta has a null regioninfo; scan was aborting.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2019-07-29 16:00:57 -07:00
stack f68cda32e1 HBASE-22751 table.jsp fails if ugly regions in table 2019-07-29 09:38:46 -07:00
Venkatesh Sridharan 11f30de2cf HBASE-22313 Add method to FsDelegation token to accept token kind (#199) 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-07-29 11:18:19 +02:00
Jan Hentschel e273d0bc3a
HBASE-22748 Removed deprecated methods from Put 
Signed-off-by: stack <stack@apache.org>
 2019-07-29 08:50:16 +02:00
meiyi 7294af8b15
HBASE-22580 Add a table attribute to make user scan snapshot feature configurable for table (#336) 2019-07-29 09:51:26 +08:00
Guanghao Zhang cf8114a82e
HBASE-22709 Add a chore thread in master to do hbck checking (#404) 
Signed-off-by: stack <stack@apache.org>
 2019-07-27 18:23:37 +08:00
Guanghao Zhang 1cb37f18aa
HBASE-22742 [HBCK2] Add more log for hbck operations at master side 
Signed-off-by: stack <stack@apache.org>
 2019-07-27 12:25:11 +08:00
stack fa77c75848 HBASE-22382 Refactor tests in TestFromClientSide; ADDENDUM to fix tests 2019-07-26 13:28:06 -07:00
linkaline 747d000808 HBASE-22733 TestSplitTransactionOnCluster.testMasterRestartAtRegionSplitPendingCatalogJanitor is flakey (#408) 
Signed-off-by: stack <stack@apache.org>
 2019-07-25 11:09:07 -07:00
Jan Hentschel e28afec9ec HBASE-22594 Clean up for backup examples (#315) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-07-25 13:35:44 +08:00
Jeongdae Kim a65e72d5da
HBASE-22715 All scan requests should be handled by scan handler threads in RWQueueRpcExecutor (#393) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/ipc/TestSimpleRpcScheduler.java
 2019-07-24 11:57:04 -07:00
meiyi a399a1452b HBASE-22578 HFileCleaner should not delete empty ns/table directories used for user san snapshot feature (#337) 2019-07-24 15:14:56 +08:00
Andor Molnár 542ae47797 HBASE-22382 Refactor tests in TestFromClientSide (#385) 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-07-24 14:08:45 +08:00
Guanghao Zhang 6705d4ffdf
HBASE-22721 Refactor HBaseFsck: move the inner class out 
Signed-off-by: stack <stack@apache.org>
 2019-07-24 08:02:41 +08:00
syedmurtazahassan d9493c539f HBASE-22603 Javadoc Warnings related to @link tag 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-07-23 14:14:12 +02:00
syedmurtazahassan 06f5c43de3 HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize 
Signed-off-by: Reid Chan <reidchan@apache.org>
Co-authored-by: Reid Chan <reidchan@apache.org>
 2019-07-23 11:27:02 +08:00
Reid Chan 0e34dcbf4b Revert "HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize" 
Reason: Deprecated a wrong parameter.

This reverts commit fe450b50c1.
 2019-07-23 11:04:13 +08:00
syedmurtazahassan fe450b50c1 HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize 
* HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize.

* HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize. Deprecated old attribute and introduced a new one

* HBASE-22610 [BucketCache] Rename hbase.offheapcache.minblocksize. Removed unnecessary import

* HBASE-22610 added two import configs and removed one

Signed-off-by: Reid Chan <reidchan@apache.org>
 2019-07-23 10:40:32 +08:00
Viraj Jasani 9615c644f5 HBASE-22648 Snapshot TTL (#371) 
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-07-22 15:03:44 -07:00
Toshihiro Suzuki 7f68591767 HBASE-22690 Deprecate / Remove OfflineMetaRepair in hbase-2+ 
Signed-off-by: stack <stack@apache.org>
 2019-07-22 22:57:33 +09:00
openinx 00075ea4fc
HBASE-22663 The HeapAllocationRatio in WebUI is not accurate because all of the heap allocation will happen in another separated allocator named HEAP (#365) 2019-07-20 23:30:08 +08:00
Geoffrey Jacoby 1ad48c1ebc
HBASE-22622 WALKey Extended Attributes (#352) 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-07-19 15:30:38 -07:00
Guanghao 48c623c808
HBASE-22673 Avoid to expose protobuf stuff in Hbck interface 
Signed-off-by: stack <stack@apache.org>
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-07-19 08:03:06 +08:00
sreenivasulureddy ed2d7e4110 HBASE-22537 Split happened Replica region can not be deleted after deleting table successfully and restarting RegionServer 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
 2019-07-18 16:16:15 +01:00
Guanghao Zhang 254dbd07fb HBASE-22527 [hbck2] Add a master web ui to show the problematic regions (addendum) 2019-07-18 17:50:44 +08:00
linkaline e08ac5fafb HBASE-21426 TestEncryptionKeyRotation.testCFKeyRotation is flaky (#375) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-07-18 09:02:17 +08:00
Guanghao Zhang f0cbdf8beb HBASE-22527 [hbck2] Add a master web ui to show the problematic regions 2019-07-18 08:23:12 +08:00
Guanghao 2b7e33fe52
HBASE-22704 Avoid NPE when access table.jsp and snapshot.jsp but master not finish initialization (#389) 2019-07-18 08:20:36 +08:00
stack 82ea04dbab HBASE-7191 HBCK - Add offline create/fix hbase.version and hbase.id 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-07-17 07:50:41 -07:00
linkaline 9d5e5adaf0 HBASE-20368 Fix RIT stuck when a rsgroup has no online servers but AM's pendingAssginQueue is cleared (#354) 2019-07-17 22:05:36 +08:00
Viraj Jasani cc38de1a39 HBASE-22643 : Delete region without archiving only if regiondir is present 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-07-16 10:25:24 +01:00
Duo Zhang 8f56bee93b
HBASE-22684 The log rolling request maybe canceled immediately in LogRoller due to a race (#378) 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-07-15 21:35:06 +08:00
syedmurtazahassan 8defea9561 HBASE-22586 Javadoc Warnings related to @param tag 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-07-13 16:46:18 +02:00
Duo Zhang 032c18fbd0
HBASE-22681 The 'assert highestUnsyncedTxid < entry.getTxid();' in AbstractFWAL.append may fail when using AsyncFSWAL (#376) 
Signed-off-by: Zheng Hu <openinx@gmail.com>
 2019-07-13 22:11:39 +08:00
syedmurtazahassan 9f343c2efa HBASE-22571 Javadoc Warnings related to @return tag 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-07-13 13:34:48 +02:00
Andrew Purtell 12d7db7078
HBASE-22686 ZkSplitLogWorkerCoordination doesn't allow a regionserver to pick up all of the split work it is capable of (#377) 
Signed-off-by: Xu Cang <xcang@apache.org>
 2019-07-12 18:10:15 -07:00
Viraj Jasani 9ac9505f2a HBASE-22606 BucketCache additional tests 
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Sakthi <sakthivel.azhaku@gmail.com>
 2019-07-09 12:12:19 +01:00
Reid Chan 605f8a15bb HBASE-22656 [Metrics] Table metrics 'BatchPut' and 'BatchDelete' are never updated 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-07-07 23:21:21 +08:00
openinx ac4e52880b
HBASE-22582 The Compaction writer may access the lastCell whose memory has been released when appending fileInfo in the final (#341) 2019-07-04 14:27:21 +08:00
haxiaolin a4738e5184 HBASE-22403 Balance in RSGroup should consider throttling and a failure affects the whole 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-07-04 08:47:48 +08:00
Guanghao 64e732dc8b
HBASE-22624 Should sanity check table configuration when clone snapshot to a new table 2019-07-03 11:54:25 +08:00
Mate Szalay-Beko 62c7e73dc0 HBASE-22637 fix flaky test in TestMetaTableMetrics 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Sakthi <sakthivel.azhaku@gmail.com>
 2019-07-02 09:35:43 +02:00
syedmurtazahassan fabf2b8282 HBASE-22572 Javadoc Warnings: @link reference not found (#306) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
 2019-07-01 21:15:00 -07:00
Bing Xiao 52eb893bcc HBASE-22169 Open region failed cause memory leak 
Signed-off-by: stack <stack@apache.org>
 2019-07-01 13:55:00 -07:00
Duo Zhang 94d5419efb
HBASE-22632 SplitTableRegionProcedure and MergeTableRegionsProcedure should skip store files for unknown column families (#344) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-06-27 21:54:53 +08:00
openinx 0198868531
HBASE-20060 Add details of off heap memstore into book. (#334) 2019-06-26 14:58:34 +08:00
Duo Zhang b42614295e
HBASE-22617 Recovered WAL directories not getting cleaned up (#330) 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-06-25 16:21:24 +08:00
Andrew Purtell 15ac781057
HBASE-22616 responseTooXXX logging for Multi should characterize the component ops (#329) 
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2019-06-24 18:03:17 -07:00
openinx 531d2902cb
HBASE-22612 Address the final overview reviewing comments of HBASE-21879 (#331) 2019-06-24 18:04:40 +08:00
meiyi c1e5350be7
HBASE-21995 Add a coprocessor to set HDFS ACL for hbase granted user 2019-06-24 10:40:38 +08:00
openinx 2e414360bd HBASE-22547 Align the config keys and add document for offheap read in HBase Book. (#301) 2019-06-24 10:25:34 +08:00
openinx ccabbdd40a HBASE-22531 The HFileReaderImpl#shouldUseHeap return the incorrect true when disabled BlockCache (#304) 2019-06-24 10:25:34 +08:00
openinx d64c3a2611 HBASE-22491 Separate the heap HFileBlock and offheap HFileBlock because the heap block won't need refCnt and save into prevBlocks list before shipping (#268) 2019-06-24 10:25:33 +08:00
openinx 5b363a6140 HBASE-22463 Some paths in HFileScannerImpl did not consider block#release which will exhaust the ByteBuffAllocator (#257) 2019-06-24 10:25:33 +08:00
openinx 962554d340 HBASE-22422 Retain an ByteBuff with refCnt=0 when getBlock from LRUCache (#242) 2019-06-24 10:25:33 +08:00
huzheng b1fee0ebdd HBASE-22435 Add a UT to address the HFileBlock#heapSize() in TestHeapSize 2019-06-24 10:25:33 +08:00
huzheng 7188a3bd3d HBASE-22412 Improve the metrics in ByteBuffAllocator 2019-06-24 10:25:33 +08:00
huzheng a8f8a4a1c9 HBASE-22090 The HFileBlock#CacheableDeserializer should pass ByteBuffAllocator to the newly created HFileBlock 2019-06-24 10:25:33 +08:00
huzheng 97476ed2e0 HBASE-21921 Notify users if the ByteBufAllocator is always allocating ByteBuffers from heap which means the increacing GC pressure 2019-06-24 10:25:33 +08:00
huzheng ca92378e42 HBASE-22122 Change to release mob hfile's block after rpc server shipped response to client 2019-06-24 10:25:32 +08:00
huzheng 7dedb5625a HBASE-21937 Make the Compression#decompress can accept ByteBuff as input 2019-06-24 10:25:32 +08:00
huzheng 77cef7490b HBASE-22211 Remove the returnBlock method because we can just call HFileBlock#release directly 2019-06-24 10:25:32 +08:00
huzheng 48aca4db30 HBASE-21957 Unify refCount of BucketEntry and refCount of hbase.nio.ByteBuff into one 2019-06-24 10:25:32 +08:00
huzheng 773c0d6635 HBASE-22159 ByteBufferIOEngine should support write off-heap ByteBuff to the bufferArray 2019-06-24 10:25:32 +08:00
huzheng d1eb6171f9 HBASE-22127 Ensure that the block cached in the LRUBlockCache offheap is allocated from heap 2019-06-24 10:25:32 +08:00
huzheng 35b818606f HBASE-22005 Use ByteBuff's refcnt to track the life cycle of data block 2019-06-24 10:25:31 +08:00
huzheng e4fe0b6feb HBASE-22016 Rewrite the block reading methods by using hbase.nio.ByteBuff 2019-06-24 10:25:31 +08:00
huzheng e91cab08b6 HBASE-21917 Make the HFileBlock#validateChecksum can accept ByteBuff as an input. (addendum) 2019-06-24 10:25:31 +08:00
huzheng d00a1da976 HBASE-21917 Make the HFileBlock#validateChecksum can accept ByteBuff as an input. 2019-06-24 10:25:31 +08:00
huzheng 532ebfb7a5 HBASE-21916 Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool 2019-06-24 10:25:31 +08:00
Mingliang Liu 6d08ffcfc6
HBASE-21284 Default limits for PressureAwareCompactionThroughputController are too low 
This is a forward port HBASE-21000 from branch-1.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-06-20 12:44:01 -07:00
Reid Chan c7c6140396 HBASE-22596 [Chore] Separate the execution period between CompactionChecker and PeriodicMemStoreFlusher 
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-06-20 10:56:42 +08:00
Artem Ervits 79ee19b0c7 HBASE-22561 modify HFilePrettyPrinter to accept non-rootdir directories 
Signed-off-by: huzheng <openinx@gmail.com>
 2019-06-19 15:14:36 +08:00
zhangduo ac3d09e7fd HBASE-22577 BufferedMutatorOverAsyncBufferedMutator.tryCompleteFuture consume too much CPU time 2019-06-18 08:43:35 +08:00
zhangduo 621dc88c79 HBASE-22553 NPE in RegionReplicaReplicationEndpoint 2019-06-18 08:43:35 +08:00
zhangduo 6278c98f5d HBASE-22550 Throw exception when creating thread pool if the connection has already been closed 2019-06-18 08:43:35 +08:00
zhangduo 1a5c2a0257 HBASE-22351 Fix creating table timeout for TestProcedurePriority 2019-06-18 08:43:35 +08:00
Duo Zhang a116e0bab1 HBASE-21723 Remove ConnectionImplementation and related classes 2019-06-18 08:43:35 +08:00
Duo Zhang 2e3a3d6776 HBASE-22037 Re-enable TestAvoidCellReferencesIntoShippedBlocks 2019-06-18 08:43:35 +08:00
Duo Zhang a95eb6559d HBASE-22328 NPE in RegionReplicaReplicationEndpoint 2019-06-18 08:43:35 +08:00
Duo Zhang 6855d58379 HBASE-22036 Rewrite TestScannerHeartbeatMessages 2019-06-18 08:43:35 +08:00
zhangduo a185be8a13 HBASE-22239 Also catch RemoteException in SyncReplicationTestBase.verifyReplicationRequestRejection 2019-06-18 08:43:35 +08:00
zhangduo d5bd8417d5 HBASE-22302 Fix TestHbck 2019-06-18 08:43:35 +08:00
zhangduo c8391809fc HBASE-22297 Fix TestRegionMergeTransitionOnCluster and TestSplitTransactionOnCluster 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-06-18 08:43:35 +08:00
zhangduo 127bef4d10 HBASE-22295 Fix TestClientOperationTimeout 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-06-18 08:43:35 +08:00
zhangduo d1487fcfad HBASE-21725 Implement BufferedMutator Based on AsyncBufferedMutator 2019-06-18 08:43:35 +08:00
Duo Zhang d64d015f51 HBASE-21718 Implement Admin based on AsyncAdmin 2019-06-18 08:43:32 +08:00
Duo Zhang 6b87a4ce98 HBASE-21717 Implement Connection based on AsyncConnection 2019-06-18 08:37:51 +08:00
zhangduo b7793d7d1d HBASE-21585 Remove ClusterConnection 2019-06-18 08:37:50 +08:00
Duo Zhang 2182bfb942 HBASE-21779 Reimplement BulkLoadHFilesTool to use AsyncClusterConnection 2019-06-18 08:37:50 +08:00
Duo Zhang 72d9f8747f HBASE-21778 Remove the usage of the locateRegion related methods in ClusterConnection 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-06-18 08:35:59 +08:00
Duo Zhang 88adfa3278 HBASE-21719 Rewrite RegionPlacementMaintainer to use AsyncClusterConnection 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-06-18 08:35:58 +08:00
Duo Zhang a5bcf7d6c7 HBASE-21537 Rewrite ServerManager.closeRegionSilentlyAndWait to use AsyncClusterConnection 
Signed-off-by: Michael Stack <stack@apache.org>
 2019-06-18 08:35:58 +08:00
Duo Zhang d005d6f30a HBASE-21671 Rewrite RegionReplicaReplicationEndpoint to use AsyncClusterConnection 2019-06-18 08:35:58 +08:00
Duo Zhang 7593e86c5f HBASE-21538 Rewrite RegionReplicaFlushHandler to use AsyncClusterConnection 2019-06-18 08:35:58 +08:00
zhangduo 04f737d9bd HBASE-21579 Use AsyncClusterConnection for HBaseInterClusterReplicationEndpoint 2019-06-18 08:35:58 +08:00
zhangduo 5d872d3422 HBASE-21526 Use AsyncClusterConnection in ServerManager for getRsAdmin 2019-06-18 08:35:58 +08:00
zhangduo 2446f0026b HBASE-21516 Use AsyncConnection instead of Connection in SecureBulkLoadManager 2019-06-18 08:35:58 +08:00
zhangduo 30c131b5f7 HBASE-21515 Also initialize an AsyncClusterConnection in HRegionServer 2019-06-18 08:35:58 +08:00
Jan Hentschel 5da5deb59d
HBASE-22344 Documented the deprecation of public and limited private APIs (#208) 
Signed-off-by: stack <stack@apache.org>
 2019-06-17 22:02:23 +02:00
Apache9 9b413cf262
HBASE-22590 Remove the deprecated methods in Table interface (#309) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Guanghao <zghao@apache.org>
 2019-06-17 10:18:18 +08:00
Jan Hentschel ed30909d27
HBASE-19303 Removed ReplicationAdmin and all its usages 
Signed-off-by: stack <stack@apache.org>
 2019-06-16 16:20:04 +02:00
Jan Hentschel 47a96444da
HBASE-22275 Removed deprecated getRegionInfo in HRegionLocation 
Signed-off-by: stack <stack@apache.org>
 2019-06-16 16:13:46 +02:00
Reid Chan ab4453158a HBASE-22559 [RPC] set guard against CALL_QUEUE_HANDLER_FACTOR_CONF_KEY 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-06-14 14:38:10 +08:00
Andrew Purtell 8e15f4ed61
HBASE-22530 The metrics of store files count of region are returned to clients incorrectly (Eungsop Yoo) 
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-06-13 17:42:26 -07:00
Murtaza Hassan 9ba7651889 HBASE-22565 Javadoc Warnings: @see cannot be used in inline documentation 2019-06-13 23:09:42 +02:00
Josh Elser 35d70881c3 HBASE-22562 Remove dead code: skipControl 
Signed-off-by: Reid Chan <reidchan@apache.org>
 2019-06-13 16:04:19 -04:00
Sergey Shelukhin ada772a1d3 HBASE-22408 add dead and unknown server open regions metric to AM 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-06-10 16:15:52 -07:00
zhangduo 03436e68bc HBASE-22552 Rewrite TestEndToEndSplitTransaction.testCanSplitJustAfterASplit 2019-06-10 13:08:05 +08:00
zhangduo 8db9c84cd0 HBASE-22551 TestMasterOperationsForRegionReplicas is flakey 2019-06-10 07:48:39 +08:00
Jan Hentschel 99ea828d1c HBASE-22373 Moved maven-eclipse-plugin to eclipse profile 2019-06-10 00:51:18 +02:00
Jan Hentschel f62028593f HBASE-22262 Removed deprecated methods from Filter class 2019-06-10 00:47:15 +02:00
WenFeiYi 876d2acf9a HBASE-22284 optimization StringBuilder.append of AbstractMemStore.toString #182 2019-06-09 14:33:03 -07:00
syedmurtazahassan 454edddd77 HBASE-22482 Fix tag Warnings in TestPartitionedMobCompactor (#255) 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-06-09 14:21:43 -07:00
syedmurtazahassan 0838c356d4 HBASE-2284 Javadoc Warnings: Fix warnings coming due to @result tag in TestCoprocessorWhitelistMasterObserver (#256) 2019-06-09 14:13:54 -07:00
zhangduo 80281127cb HBASE-22548 Split TestAdmin1 2019-06-08 20:48:36 +08:00
virajjasani 13c5af38da HBASE-22520 Avoid possible NPE while performing seekBefore in Hal… (#281) 
HBASE-22520 Avoid possible NPE while performing seekBefore in HalfStoreFileReader
 2019-06-06 15:43:36 -07:00
virajjasani 6ea2566ac3 [HBASE-22525] : Return procedures to use bulk operation over iteration for Perf Improvement (#284) 2019-06-06 15:37:44 -07:00
stack a826f41e83 HBASE-22546 TestRegionServerHostname#testRegionServerHostname fails reliably for me 2019-06-05 20:55:16 -07:00
Daisuke Kobayashi 5bc996e1de HBASE-22160 Add sorting functionality in regionserver web UI for user 
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
 2019-06-05 11:05:41 +09:00
Sakthi 0ad4b4e160 HBASE-22536 TestForeignExceptionSerialization fails when run on JDK11 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-06-04 11:49:56 -05:00
zhangduo 26037854ad HBASE-22524 Refactor TestReplicationSyncUpTool 2019-06-04 07:46:15 +08:00
Sean Busbey 51c49a1784 HBASE-22497 Mark HBase 1.2 line as EOM 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-06-03 06:55:58 -05:00
meiyi 073de44445
HBASE-22513 Admin#getQuota does not work correctly if exceedThrottleQuota is set 2019-06-03 16:55:23 +08:00
Guanghao 04e5bf96d8
HBASE-22523 Refactor RegionStates#getAssignmentsByTable to make it easy to understand 2019-06-02 21:21:26 +08:00
Josh Elser b2b7811902 HBASE-22511 Add some more rs-status paths to RS UI links 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-05-31 14:30:08 -04:00
Duo Zhang 6735cc13c1 HBASE-22502 Purge the logs when we reach the EOF for the last wal file when replication 2019-05-31 15:36:42 +08:00
Guanghao 0fcd7cae55
HBASE-22503 Failed to upgrade to 2.2+ as the global permission which storaged in zk is not right 2019-05-31 09:10:52 +08:00
Andrew Purtell 98a1552687
HBASE-22459 Expose store reader reference count (#248) 2019-05-30 15:04:16 -07:00
Clay Baenziger 4657c90991 HBASE-22487 getMostLoadedRegions is unused 
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-05-30 18:32:25 +02:00
Duo Zhang 78e4aea3c5 HBASE-22472 The newly split TestReplicationStatus* tests are flaky 2019-05-30 21:49:43 +08:00
Guanghao ca00cbeed2
HBASE-22488 Cleanup the explicit timeout value for test methods 2019-05-29 14:09:16 +08:00
Guanghao 896b473812
HBASE-22486 Fix flaky test TestLockManager 2019-05-29 10:58:10 +08:00
Jingyun Tian 325bb00d23 HBASE-22454 refactor WALSplitter 2019-05-29 10:56:40 +08:00
Guanghao c3642b1dda
HBASE-22485 Fix failed ut TestClusterRestartFailover 2019-05-29 10:39:57 +08:00
Josh Elser 858d30dd30 HBASE-22467 UI fixes to enable Knox proxying 
Closes #261

Signed-off-by: Sean Busbey <busbey@apache.org>
 2019-05-28 16:32:41 -04:00
Artem Ervits 3a3857690a HBASE-22469 replace md5 checksum in saveVersion script with sha512 
Signed-off-by: Josh Elser <elserj@apache.org>
 2019-05-28 14:53:56 -04:00
binlijin 5dcfe5f8d8 HBASE-22441 BucketCache NullPointerException in cacheBlock 2019-05-27 17:14:42 +08:00
zhangduo 998b8416ca HBASE-22473 Split TestSCP 2019-05-27 08:01:52 +08:00
Duo Zhang 27c02a0b95 HBASE-22455 Split TestReplicationStatus 2019-05-25 14:42:55 +08:00
Puleya7 f773043f87 HBASE-22440. Override getWalGroupsReplicationStatus to avoid NPE 
Signed-off-by: Duo Zhang <zhangduo@apache.org>
 2019-05-23 13:38:27 +08:00
Duo Zhang f1a8aa4fd7 HBASE-22456 Polish TestSplitTransitionOnCluster 2019-05-23 09:43:10 +08:00
binlijin 8e47c8e739 HBASE-22445 Add file info when throw exceptions in HFileReaderImpl 2019-05-22 20:08:46 +08:00
binlijin 2bf7ad4e4f HBASE-22447 Check refCount before free block in BucketCache 2019-05-22 16:19:08 +08:00
Andrew Purtell a30b186568
HBASE-22449 https everywhere in Maven metadata (#247) 2019-05-21 12:34:25 -07:00
Duo Zhang 930691a846 HBASE-22400 Remove the adapter code in async fs implementation for hadoop-2.7.x 2019-05-18 14:05:47 +08:00
Sakthi cb32f4faf0 HBASE-21991 [Addendum] Mark LossCounting as Private 
Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2019-05-17 14:09:38 +08:00
Guanghao bdd2fc6149
HBASE-22404 Open/Close region request may be executed twice when master restart 2019-05-16 09:10:55 +08:00
Andor Molnár 7878389669 HBASE-13798 TestFromClientSide* don't close the Table 2019-05-15 17:28:41 +02:00
Wellington Chevreuil fab2e15ae4
HBASE-21784 Dump replication queue should show list of wal files ordered chronologically 
Change-Id: I18c372406290e2b1e2b5503e2c87adcb9bf6fe91

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-05-14 14:04:54 -07:00
Andrew Purtell a9de9f5f28
HBASE-22377 Provide API to check the existence of a namespace which does not require ADMIN permissions (#225) 
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-05-14 11:56:16 -07:00
zhangduo 0b8493f886 HBASE-21658 Addendum fix infinite wait when there are no meta locations yet 2019-05-14 08:12:36 +08:00
Caroline Zhou 0797243365
HBASE-22378. HBase Canary fails with TableNotFoundException when table deleted during Canary run 
Signed-off-by: Xu Cang <xucang@apache.org>
 2019-05-13 12:42:43 -07:00
zhangduo 62ad94c2b5 HBASE-22365 Region may be opened on two RegionServers 2019-05-13 14:42:27 +08:00
Puleya7 b8365e5110
HBASE-22392. Remove extra/useless + 
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
 2019-05-12 21:23:56 +02:00
zhangduo df27820958 HBASE-21658 Should get the meta replica number from zk instead of config at client side 2019-05-11 09:22:00 +08:00
Sergey Shelukhin 3641e7a97d HBASE-22376 master can fail to start w/NPE if lastflushedseqids file is empty 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-05-10 15:36:07 -07:00
Artem Ervits 420fbba6ae HBASE-21536 Fix completebulkload usage instructions 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-05-10 09:53:51 +02:00
Xu Cang 987d36879c
HBASE-22274 Cell size limit check on append considers cell's previous size 
change
 2019-05-09 20:34:14 -07:00
chenyang 738ce5f402 HBASE-22324 loss a mass of data when the sequenceId of cells greater than Integer.Max 
Signed-off-by: huzheng <openinx@gmail.com>
 2019-05-09 16:09:12 +08:00
Andrew Purtell 6668098900
HBASE-22375 Promote AccessChecker to LimitedPrivate(Coprocessor) 2019-05-08 18:14:11 -07:00
Yu Li 12bf75bb2a HBASE-21777 Only log compaction pressure throughput when changed or traced (addendum) 
Fix the findbugs warning
 2019-05-09 00:59:10 +08:00
ramkrish86 46fe9833a9
HBASE-22072 High read/write intensive regions may cause long crash (#214) 
* HBASE-22072 High read/write intensive regions may cause long crash
recovery

* Make the 'closing' variable as volatile and move the test case to
standlone class
 2019-05-08 15:30:04 +05:30
Bahram Chehrazy d9491c0b65 HBASE-22360 Abort timer doesn't set when abort is called during graceful shutdown process 
Signed-off-by: Sergey Shelukhin <sershe@apache.org>
 2019-05-07 15:48:59 -07:00
Tak Lon (Stephen) Wu b5b89f7c74 HBASE-21777 Only log compaction pressure throughput when changed or traced 
Signed-off-by: Yu Li <liyu@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2019-05-08 02:37:31 +08:00
z-york 67c937fa92
HBASE-21070 Add Test for SnapshotFileCache for HBase backed by S3 (#209) 
SnapshotFileCache depends on getting the last modified time of the
snapshot directory, however, S3 FileSystem's do not update the
last modified time of the top 'folder' when objects are added/removed.
This commit adds a test for the previously fixed SnapshotFileCache.
 2019-05-06 11:52:08 -07:00
zhangduo e884a25f8d HBASE-22343 Make procedure retry interval configurable in test 2019-05-04 13:04:06 +08:00
Sergey Shelukhin 0c0d59541a HBASE-22354 master never sets abortRequested, and thus abort timeout doesn't work for it 
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
 2019-05-02 18:08:02 -07:00
zhangduo f91768fa6e HBASE-22350 Rewrite TestClientOperationTimeout so we do not timeout when creating table 2019-05-02 17:19:47 +02:00