Commit Graph

7627 Commits

Author SHA1 Message Date
Andrew Purtell 12d7db7078
HBASE-22686 ZkSplitLogWorkerCoordination doesn't allow a regionserver to pick up all of the split work it is capable of (#377)
Signed-off-by: Xu Cang <xcang@apache.org>
2019-07-12 18:10:15 -07:00
Viraj Jasani 9ac9505f2a HBASE-22606 BucketCache additional tests
Signed-off-by: Wellington Chevreuil <wchevreuil@apache.org>
Signed-off-by: Sakthi <sakthivel.azhaku@gmail.com>
2019-07-09 12:12:19 +01:00
Reid Chan 605f8a15bb HBASE-22656 [Metrics] Table metrics 'BatchPut' and 'BatchDelete' are never updated
Signed-off-by: Michael Stack <stack@apache.org>
2019-07-07 23:21:21 +08:00
openinx ac4e52880b
HBASE-22582 The Compaction writer may access the lastCell whose memory has been released when appending fileInfo in the final (#341) 2019-07-04 14:27:21 +08:00
haxiaolin a4738e5184 HBASE-22403 Balance in RSGroup should consider throttling and a failure affects the whole
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-07-04 08:47:48 +08:00
Guanghao 64e732dc8b
HBASE-22624 Should sanity check table configuration when clone snapshot to a new table 2019-07-03 11:54:25 +08:00
Mate Szalay-Beko 62c7e73dc0 HBASE-22637 fix flaky test in TestMetaTableMetrics
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
Signed-off-by: Sakthi <sakthivel.azhaku@gmail.com>
2019-07-02 09:35:43 +02:00
syedmurtazahassan fabf2b8282 HBASE-22572 Javadoc Warnings: @link reference not found (#306)
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: stack <stack@apache.org>
2019-07-01 21:15:00 -07:00
Bing Xiao 52eb893bcc HBASE-22169 Open region failed cause memory leak
Signed-off-by: stack <stack@apache.org>
2019-07-01 13:55:00 -07:00
Duo Zhang 94d5419efb
HBASE-22632 SplitTableRegionProcedure and MergeTableRegionsProcedure should skip store files for unknown column families (#344)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-06-27 21:54:53 +08:00
openinx 0198868531
HBASE-20060 Add details of off heap memstore into book. (#334) 2019-06-26 14:58:34 +08:00
Duo Zhang b42614295e
HBASE-22617 Recovered WAL directories not getting cleaned up (#330)
Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-06-25 16:21:24 +08:00
Andrew Purtell 15ac781057
HBASE-22616 responseTooXXX logging for Multi should characterize the component ops (#329)
Signed-off-by: Reid Chan <reidchan@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
2019-06-24 18:03:17 -07:00
openinx 531d2902cb
HBASE-22612 Address the final overview reviewing comments of HBASE-21879 (#331) 2019-06-24 18:04:40 +08:00
meiyi c1e5350be7
HBASE-21995 Add a coprocessor to set HDFS ACL for hbase granted user 2019-06-24 10:40:38 +08:00
openinx 2e414360bd HBASE-22547 Align the config keys and add document for offheap read in HBase Book. (#301) 2019-06-24 10:25:34 +08:00
openinx ccabbdd40a HBASE-22531 The HFileReaderImpl#shouldUseHeap return the incorrect true when disabled BlockCache (#304) 2019-06-24 10:25:34 +08:00
openinx d64c3a2611 HBASE-22491 Separate the heap HFileBlock and offheap HFileBlock because the heap block won't need refCnt and save into prevBlocks list before shipping (#268) 2019-06-24 10:25:33 +08:00
openinx 5b363a6140 HBASE-22463 Some paths in HFileScannerImpl did not consider block#release which will exhaust the ByteBuffAllocator (#257) 2019-06-24 10:25:33 +08:00
openinx 962554d340 HBASE-22422 Retain an ByteBuff with refCnt=0 when getBlock from LRUCache (#242) 2019-06-24 10:25:33 +08:00
huzheng b1fee0ebdd HBASE-22435 Add a UT to address the HFileBlock#heapSize() in TestHeapSize 2019-06-24 10:25:33 +08:00
huzheng 7188a3bd3d HBASE-22412 Improve the metrics in ByteBuffAllocator 2019-06-24 10:25:33 +08:00
huzheng a8f8a4a1c9 HBASE-22090 The HFileBlock#CacheableDeserializer should pass ByteBuffAllocator to the newly created HFileBlock 2019-06-24 10:25:33 +08:00
huzheng 97476ed2e0 HBASE-21921 Notify users if the ByteBufAllocator is always allocating ByteBuffers from heap which means the increacing GC pressure 2019-06-24 10:25:33 +08:00
huzheng ca92378e42 HBASE-22122 Change to release mob hfile's block after rpc server shipped response to client 2019-06-24 10:25:32 +08:00
huzheng 7dedb5625a HBASE-21937 Make the Compression#decompress can accept ByteBuff as input 2019-06-24 10:25:32 +08:00
huzheng 77cef7490b HBASE-22211 Remove the returnBlock method because we can just call HFileBlock#release directly 2019-06-24 10:25:32 +08:00
huzheng 48aca4db30 HBASE-21957 Unify refCount of BucketEntry and refCount of hbase.nio.ByteBuff into one 2019-06-24 10:25:32 +08:00
huzheng 773c0d6635 HBASE-22159 ByteBufferIOEngine should support write off-heap ByteBuff to the bufferArray 2019-06-24 10:25:32 +08:00
huzheng d1eb6171f9 HBASE-22127 Ensure that the block cached in the LRUBlockCache offheap is allocated from heap 2019-06-24 10:25:32 +08:00
huzheng 35b818606f HBASE-22005 Use ByteBuff's refcnt to track the life cycle of data block 2019-06-24 10:25:31 +08:00
huzheng e4fe0b6feb HBASE-22016 Rewrite the block reading methods by using hbase.nio.ByteBuff 2019-06-24 10:25:31 +08:00
huzheng e91cab08b6 HBASE-21917 Make the HFileBlock#validateChecksum can accept ByteBuff as an input. (addendum) 2019-06-24 10:25:31 +08:00
huzheng d00a1da976 HBASE-21917 Make the HFileBlock#validateChecksum can accept ByteBuff as an input. 2019-06-24 10:25:31 +08:00
huzheng 532ebfb7a5 HBASE-21916 Abstract an ByteBuffAllocator to allocate/free ByteBuffer in ByteBufferPool 2019-06-24 10:25:31 +08:00
Mingliang Liu 6d08ffcfc6
HBASE-21284 Default limits for PressureAwareCompactionThroughputController are too low
This is a forward port HBASE-21000 from branch-1.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-06-20 12:44:01 -07:00
Reid Chan c7c6140396 HBASE-22596 [Chore] Separate the execution period between CompactionChecker and PeriodicMemStoreFlusher
Signed-off-by: Zach York <zyork@apache.org>
Signed-off-by: Xu Cang <xucang@apache.org>
2019-06-20 10:56:42 +08:00
Artem Ervits 79ee19b0c7 HBASE-22561 modify HFilePrettyPrinter to accept non-rootdir directories
Signed-off-by: huzheng <openinx@gmail.com>
2019-06-19 15:14:36 +08:00
zhangduo ac3d09e7fd HBASE-22577 BufferedMutatorOverAsyncBufferedMutator.tryCompleteFuture consume too much CPU time 2019-06-18 08:43:35 +08:00
zhangduo 621dc88c79 HBASE-22553 NPE in RegionReplicaReplicationEndpoint 2019-06-18 08:43:35 +08:00
zhangduo 6278c98f5d HBASE-22550 Throw exception when creating thread pool if the connection has already been closed 2019-06-18 08:43:35 +08:00
zhangduo 1a5c2a0257 HBASE-22351 Fix creating table timeout for TestProcedurePriority 2019-06-18 08:43:35 +08:00
Duo Zhang a116e0bab1 HBASE-21723 Remove ConnectionImplementation and related classes 2019-06-18 08:43:35 +08:00
Duo Zhang 2e3a3d6776 HBASE-22037 Re-enable TestAvoidCellReferencesIntoShippedBlocks 2019-06-18 08:43:35 +08:00
Duo Zhang a95eb6559d HBASE-22328 NPE in RegionReplicaReplicationEndpoint 2019-06-18 08:43:35 +08:00
Duo Zhang 6855d58379 HBASE-22036 Rewrite TestScannerHeartbeatMessages 2019-06-18 08:43:35 +08:00
zhangduo a185be8a13 HBASE-22239 Also catch RemoteException in SyncReplicationTestBase.verifyReplicationRequestRejection 2019-06-18 08:43:35 +08:00
zhangduo d5bd8417d5 HBASE-22302 Fix TestHbck 2019-06-18 08:43:35 +08:00
zhangduo c8391809fc HBASE-22297 Fix TestRegionMergeTransitionOnCluster and TestSplitTransactionOnCluster
Signed-off-by: Michael Stack <stack@apache.org>
2019-06-18 08:43:35 +08:00
zhangduo 127bef4d10 HBASE-22295 Fix TestClientOperationTimeout
Signed-off-by: Michael Stack <stack@apache.org>
2019-06-18 08:43:35 +08:00
zhangduo d1487fcfad HBASE-21725 Implement BufferedMutator Based on AsyncBufferedMutator 2019-06-18 08:43:35 +08:00
Duo Zhang d64d015f51 HBASE-21718 Implement Admin based on AsyncAdmin 2019-06-18 08:43:32 +08:00
Duo Zhang 6b87a4ce98 HBASE-21717 Implement Connection based on AsyncConnection 2019-06-18 08:37:51 +08:00
zhangduo b7793d7d1d HBASE-21585 Remove ClusterConnection 2019-06-18 08:37:50 +08:00
Duo Zhang 2182bfb942 HBASE-21779 Reimplement BulkLoadHFilesTool to use AsyncClusterConnection 2019-06-18 08:37:50 +08:00
Duo Zhang 72d9f8747f HBASE-21778 Remove the usage of the locateRegion related methods in ClusterConnection
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2019-06-18 08:35:59 +08:00
Duo Zhang 88adfa3278 HBASE-21719 Rewrite RegionPlacementMaintainer to use AsyncClusterConnection
Signed-off-by: Michael Stack <stack@apache.org>
2019-06-18 08:35:58 +08:00
Duo Zhang a5bcf7d6c7 HBASE-21537 Rewrite ServerManager.closeRegionSilentlyAndWait to use AsyncClusterConnection
Signed-off-by: Michael Stack <stack@apache.org>
2019-06-18 08:35:58 +08:00
Duo Zhang d005d6f30a HBASE-21671 Rewrite RegionReplicaReplicationEndpoint to use AsyncClusterConnection 2019-06-18 08:35:58 +08:00
Duo Zhang 7593e86c5f HBASE-21538 Rewrite RegionReplicaFlushHandler to use AsyncClusterConnection 2019-06-18 08:35:58 +08:00
zhangduo 04f737d9bd HBASE-21579 Use AsyncClusterConnection for HBaseInterClusterReplicationEndpoint 2019-06-18 08:35:58 +08:00
zhangduo 5d872d3422 HBASE-21526 Use AsyncClusterConnection in ServerManager for getRsAdmin 2019-06-18 08:35:58 +08:00
zhangduo 2446f0026b HBASE-21516 Use AsyncConnection instead of Connection in SecureBulkLoadManager 2019-06-18 08:35:58 +08:00
zhangduo 30c131b5f7 HBASE-21515 Also initialize an AsyncClusterConnection in HRegionServer 2019-06-18 08:35:58 +08:00
Jan Hentschel 5da5deb59d
HBASE-22344 Documented the deprecation of public and limited private APIs (#208)
Signed-off-by: stack <stack@apache.org>
2019-06-17 22:02:23 +02:00
Apache9 9b413cf262
HBASE-22590 Remove the deprecated methods in Table interface (#309)
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
Signed-off-by: Guanghao <zghao@apache.org>
2019-06-17 10:18:18 +08:00
Jan Hentschel ed30909d27
HBASE-19303 Removed ReplicationAdmin and all its usages
Signed-off-by: stack <stack@apache.org>
2019-06-16 16:20:04 +02:00
Jan Hentschel 47a96444da
HBASE-22275 Removed deprecated getRegionInfo in HRegionLocation
Signed-off-by: stack <stack@apache.org>
2019-06-16 16:13:46 +02:00
Reid Chan ab4453158a HBASE-22559 [RPC] set guard against CALL_QUEUE_HANDLER_FACTOR_CONF_KEY
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2019-06-14 14:38:10 +08:00
Andrew Purtell 8e15f4ed61
HBASE-22530 The metrics of store files count of region are returned to clients incorrectly (Eungsop Yoo)
Signed-off-by: Xu Cang <xucang@apache.org>
2019-06-13 17:42:26 -07:00
Murtaza Hassan 9ba7651889 HBASE-22565 Javadoc Warnings: @see cannot be used in inline documentation 2019-06-13 23:09:42 +02:00
Josh Elser 35d70881c3 HBASE-22562 Remove dead code: skipControl
Signed-off-by: Reid Chan <reidchan@apache.org>
2019-06-13 16:04:19 -04:00
Sergey Shelukhin ada772a1d3 HBASE-22408 add dead and unknown server open regions metric to AM
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-06-10 16:15:52 -07:00
zhangduo 03436e68bc HBASE-22552 Rewrite TestEndToEndSplitTransaction.testCanSplitJustAfterASplit 2019-06-10 13:08:05 +08:00
zhangduo 8db9c84cd0 HBASE-22551 TestMasterOperationsForRegionReplicas is flakey 2019-06-10 07:48:39 +08:00
Jan Hentschel 99ea828d1c HBASE-22373 Moved maven-eclipse-plugin to eclipse profile 2019-06-10 00:51:18 +02:00
Jan Hentschel f62028593f HBASE-22262 Removed deprecated methods from Filter class 2019-06-10 00:47:15 +02:00
WenFeiYi 876d2acf9a HBASE-22284 optimization StringBuilder.append of AbstractMemStore.toString #182 2019-06-09 14:33:03 -07:00
syedmurtazahassan 454edddd77 HBASE-22482 Fix tag Warnings in TestPartitionedMobCompactor (#255)
Signed-off-by: Jan Hentschel <jan.hentschel@ultratendency.com>
2019-06-09 14:21:43 -07:00
syedmurtazahassan 0838c356d4 HBASE-2284 Javadoc Warnings: Fix warnings coming due to @result tag in TestCoprocessorWhitelistMasterObserver (#256) 2019-06-09 14:13:54 -07:00
zhangduo 80281127cb HBASE-22548 Split TestAdmin1 2019-06-08 20:48:36 +08:00
virajjasani 13c5af38da HBASE-22520 Avoid possible NPE while performing seekBefore in Hal… (#281)
HBASE-22520 Avoid possible NPE while performing seekBefore in HalfStoreFileReader
2019-06-06 15:43:36 -07:00
virajjasani 6ea2566ac3 [HBASE-22525] : Return procedures to use bulk operation over iteration for Perf Improvement (#284) 2019-06-06 15:37:44 -07:00
stack a826f41e83 HBASE-22546 TestRegionServerHostname#testRegionServerHostname fails reliably for me 2019-06-05 20:55:16 -07:00
Daisuke Kobayashi 5bc996e1de HBASE-22160 Add sorting functionality in regionserver web UI for user
Signed-off-by: Toshihiro Suzuki <brfrn169@gmail.com>
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
2019-06-05 11:05:41 +09:00
Sakthi 0ad4b4e160 HBASE-22536 TestForeignExceptionSerialization fails when run on JDK11
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-06-04 11:49:56 -05:00
zhangduo 26037854ad HBASE-22524 Refactor TestReplicationSyncUpTool 2019-06-04 07:46:15 +08:00
Sean Busbey 51c49a1784 HBASE-22497 Mark HBase 1.2 line as EOM
Signed-off-by: Duo Zhang <zhangduo@apache.org>
2019-06-03 06:55:58 -05:00
meiyi 073de44445
HBASE-22513 Admin#getQuota does not work correctly if exceedThrottleQuota is set 2019-06-03 16:55:23 +08:00
Guanghao 04e5bf96d8
HBASE-22523 Refactor RegionStates#getAssignmentsByTable to make it easy to understand 2019-06-02 21:21:26 +08:00
Josh Elser b2b7811902 HBASE-22511 Add some more rs-status paths to RS UI links
Signed-off-by: Sean Busbey <busbey@apache.org>
2019-05-31 14:30:08 -04:00
Duo Zhang 6735cc13c1 HBASE-22502 Purge the logs when we reach the EOF for the last wal file when replication 2019-05-31 15:36:42 +08:00
Guanghao 0fcd7cae55
HBASE-22503 Failed to upgrade to 2.2+ as the global permission which storaged in zk is not right 2019-05-31 09:10:52 +08:00
Andrew Purtell 98a1552687
HBASE-22459 Expose store reader reference count (#248) 2019-05-30 15:04:16 -07:00
Clay Baenziger 4657c90991 HBASE-22487 getMostLoadedRegions is unused
Signed-off-by: Wellington Chevreuil <wellington.chevreuil@gmail.com>
Signed-off-by: Peter Somogyi <psomogyi@apache.org>
2019-05-30 18:32:25 +02:00
Duo Zhang 78e4aea3c5 HBASE-22472 The newly split TestReplicationStatus* tests are flaky 2019-05-30 21:49:43 +08:00
Guanghao ca00cbeed2
HBASE-22488 Cleanup the explicit timeout value for test methods 2019-05-29 14:09:16 +08:00
Guanghao 896b473812
HBASE-22486 Fix flaky test TestLockManager 2019-05-29 10:58:10 +08:00
Jingyun Tian 325bb00d23 HBASE-22454 refactor WALSplitter 2019-05-29 10:56:40 +08:00
Guanghao c3642b1dda
HBASE-22485 Fix failed ut TestClusterRestartFailover 2019-05-29 10:39:57 +08:00