Commit Graph

5409 Commits

Author SHA1 Message Date
Guanghao Zhang 0e48665641 HBASE-17336 get/update replication peer config requests should be routed through master 2016-12-30 10:12:47 +08:00
tedyu 1c477b2df9 HBASE-17387 Reduce the overhead of exception report in RegionActionResult for multi() 2016-12-29 17:54:02 -08:00
Jan Hentschel 7572e96e3a HBASE-17385 Change usage documentation from bin/hbase to hbase in various tools
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-12-29 15:20:43 -08:00
tedyu 001a26d404 HBASE-17374 ZKPermissionWatcher crashed when grant after region close (Liu Junhong) 2016-12-28 19:54:01 -08:00
zhangduo 05b1d918b0 HBASE-17320 Add inclusive/exclusive support for startRow and endRow of scan 2016-12-29 09:43:31 +08:00
Michael Stack a3e0e0df0d HBASE-17149 Procedure V2 - Fix nonce submission to avoid unnecessary calling coprocessor multiple times; ADDENDUM by Stephen Yuan Jiang 2016-12-28 11:10:19 -08:00
tedyu 79e5efd35c HBASE-17081 Flush the entire CompactingMemStore content to disk - revert due to failure in TestHRegionWithInMemoryFlush 2016-12-28 10:53:07 -08:00
Michael Stack 306ef83c9c HBASE-17068 Procedure v2 - inherit region locks (Matteo Bertozzi) 2016-12-27 16:17:45 -08:00
tedyu e18e9a22da HBASE-17376 ClientAsyncPrefetchScanner may fail due to too many rows (ChiaPing Tsai) 2016-12-26 15:55:22 -08:00
Ramkrishna 463ffa792a HBASE-17081 [Recommit]Flush the entire CompactingMemStore content to disk
(Anastasia)
2016-12-26 22:05:13 +05:30
zhangduo 8fa5b0b946 HBASE-17345 Implement batch 2016-12-25 20:36:52 +08:00
ChiaPing Tsai 8cb55c4080 HBASE-17174 Refactor the AsyncProcess, BufferedMutatorImpl, and HTable
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-12-24 12:02:05 +08:00
Jerry He 992e5717d4 HBASE-16010 Put draining function through Admin API (Matt Warhaftig) 2016-12-23 13:41:36 -08:00
Phil Yang 8fb9a91d44 HBASE-17314 Limit total buffered size for all replication sources 2016-12-23 11:48:06 +08:00
Guanghao Zhang b3f2bec099 HBASE-17335 enable/disable replication peer requests should be routed through master 2016-12-23 09:27:12 +08:00
zhangduo 09bb428763 HBASE-17334 Add locate row before/after support for AsyncRegionLocator 2016-12-22 20:39:01 +08:00
tedyu 66781864aa HBASE-17330 SnapshotFileCache will always refresh the file cache (Jianwei Cui) 2016-12-22 02:29:27 -08:00
binlijin fc93de51af HBASE-17262 Refactor RpcServer so as to make it extendable and/or pluggable 2016-12-22 14:49:56 +08:00
Michael Stack d787155fd2 HBASE-5401 PerformanceEvaluation generates 10x the number of expected mappers (Yi Liang) 2016-12-21 11:55:48 -08:00
Michael Stack a1d2ff4646 Revert "HBASE-17314 Limit total buffered size for all replication sources"
This reverts commit 3826e63967.
2016-12-21 11:17:28 -08:00
tedyu cac0904c16 HBASE-17341 Add a timeout during replication endpoint termination (Vincent Poon) 2016-12-21 08:26:22 -08:00
Guanghao Zhang e1f4aaeacd HBASE-11392 add/remove peer requests should be routed through master 2016-12-21 13:27:13 +08:00
Phil Yang 3826e63967 HBASE-17314 Limit total buffered size for all replication sources 2016-12-21 13:16:17 +08:00
Thiruvel Thirumoolan 3599716dff HBASE-17107: FN info should be cleaned up on region/table cleanup
Signed-off-by: Francis Liu <toffer@apache.org>
2016-12-20 18:52:49 -08:00
Vincent f8474c8d4d HBASE-17328 Properly dispose of looped replication peers
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-12-20 18:03:11 -08:00
tedyu 5ebb25d601 HBASE-17347 ExportSnapshot may write snapshot info file to wrong directory when specifying target name (Jianwei Cui) 2016-12-20 13:02:51 -08:00
tedyu e75dee3a21 HBASE-17344 The regionserver web UIs miss the coprocessors of RegionServerCoprocessorHost (ChiaPing Tsai) 2016-12-20 08:52:45 -08:00
zhangduo a2e967d92f HBASE-17142 Implement multi get 2016-12-20 20:41:55 +08:00
Ramkrishna db5953c6fe HBASE-17333 HBASE-17294 always ensures CompactingMemstore is default (Ram) 2016-12-20 11:01:27 +05:30
binlijin b7bde350a1 HBASE-17332 Replace HashMap to Array for DataBlockEncoding.idToEncoding 2016-12-20 09:32:28 +08:00
zhangduo d53f012bb7 Revert "HBASE-17081 Flush the entire CompactingMemStore content to disk (Anastasia"
Revert to address tests failure.

This reverts commit a2a7618d26.
2016-12-16 18:49:48 +08:00
tedyu 665fe3eef1 HBASE-17331 Avoid busy waiting in ThrottledInputStream (ChiaPing Tsai) 2016-12-18 08:15:15 -08:00
zhangduo f041306cda HBASE-17282 Reduce the redundant requests to meta table 2016-12-18 08:52:06 +08:00
Michael Stack da356069f2 HBASE-17149 Procedure v2 - Fix nonce submission
Signed-off-by: Michael Stack <stack@apache.org>
2016-12-16 21:41:18 -08:00
tedyu 2c107e4d08 HBASE-15432 TableInputFormat - support multi column family scan (Xuesen Liang) 2016-12-16 18:04:55 -08:00
tedyu 49b0bab504 HBASE-17292 Add observer notification before bulk loaded hfile is moved - addendum properly handles copied hfile 2016-12-16 15:31:30 -08:00
Michael Stack c3ce02d592 HBASE-17326 Fix findbugs warning in BufferedMutatorParams Fix above and the other hbase-server findbugs complaint about null-check 2016-12-16 13:47:58 -08:00
binlijin 6acbee179f HBASE-16398 optimize HRegion computeHDFSBlocksDistribution 2016-12-16 11:02:27 +08:00
tedyu 35f0718a41 HBASE-17292 Add observer notification before bulk loaded hfile is moved to region directory 2016-12-15 09:43:22 -08:00
Ramkrishna d1147eeb7e HBASE-15787 Change the flush related heuristics to work with offheap size
configured (Ram)
2016-12-15 22:49:52 +05:30
Ramkrishna a2a7618d26 HBASE-17081 Flush the entire CompactingMemStore content to disk (Anastasia
Braginsky)
2016-12-15 22:02:05 +05:30
tedyu 401e83cee3 HBASE-17318 Increment does not add new column if the increment amount is zero at first time writing (Guangxu Cheng) 2016-12-15 07:06:37 -08:00
anoopsamjohn f9750f2122 HBASE-17298 remove unused code in HRegion#doMiniBatchMutation. (huaxiang sun) 2016-12-15 15:54:49 +05:30
tedyu a5a6036883 HBASE-17309 Fix connection leaks in TestAcidGuarantees (huaxiang sun) 2016-12-14 20:03:44 -08:00
eshcar 691f266fc2 HBASE-17316: Addendum of HBASE-17294
Signed-off-by: Michael Stack <stack@apache.org>
2016-12-14 08:17:57 -08:00
eshcar a9310436d5 HBASE-17294: External configuration for memory compaction
Signed-off-by: Michael Stack <stack@apache.org>
2016-12-13 17:16:00 -08:00
tedyu de98f68408 HBASE-17302 The region flush request disappeared from flushQueue (Guangxu Cheng) 2016-12-13 12:45:09 -08:00
tedyu 2333596279 HBASE-17296 Provide per peer throttling for replication (Guanghao Zhang) 2016-12-13 04:20:20 -08:00
tedyu adb319f5c2 HBASE-17297 Single Filter in parenthesis cannot be parsed correctly (Xuesen Liang) 2016-12-12 12:07:34 -08:00
Jingcheng Du 1615f45b31 HBASE-17237 Override the correct compact method in HMobStore 2016-12-12 11:54:21 +08:00
tedyu 67420fe21d HBASE-16336 Removing peers seems to be leaving spare queues (Guanghao Zhang) 2016-12-10 04:33:40 -08:00
Josh Elser b554e05410 HBASE-17276 Only log stacktraces for exceptions once for updates in a batch
For large batches of updates, repeatedly logging WrongRegionExceptions,
FailedSanityCheckExceptions, and/or NoSuchColumnFamilyExceptions can
easily dominate the contents of a RegionServer log. After the first
occurence of logging the full exception, switch to logging only the
message on the exception.
2016-12-09 14:28:00 -08:00
zhangduo b3ae87bd7d HBASE-17251 Add a timeout parameter when locating region 2016-12-08 09:55:29 +08:00
Thiruvel Thirumoolan c1293cc91e HBASE-16941: FavoredNodes - Split/Merge code paths
Signed-off-by: Francis Liu <toffer@apache.org>
2016-12-07 16:38:48 -08:00
Jerry He 75567f828c HBASE-15437 Response size calculated in RPCServer for warning tooLarge responses does NOT count CellScanner payload 2016-12-07 14:47:10 -08:00
Matteo Bertozzi 1eb24e4e8e HBASE-17260 Procedure v2 - Add setOwner() overload taking a User instance 2016-12-06 10:32:43 -08:00
anoopsamjohn f112427425 HBASE-17207 Arrays.asList() with too few arguments. (John Leach) 2016-12-06 14:42:14 +05:30
Clay Baenziger c7b8b63cd1 HBASE-16700 Allow for coprocessor whitelisting
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-12-05 14:46:15 -08:00
tedyu 3190605801 HBASE-17256 Rpc handler monitoring will be removed when the task queue is full (Guangxu Cheng) 2016-12-05 11:32:17 -08:00
Jerry He 39653862a4 HBASE-17221 Abstract out an interface for RpcServer.Call 2016-12-05 10:21:55 -08:00
Ramkrishna 94302a3d26 HBASE-17239 Add UnsafeByteOperations#wrap(ByteInput, int offset, int len)
API (Ram)
2016-12-05 15:13:04 +05:30
Jingcheng Du 26c2d93f77 HBASE-16841 Data loss in MOB files after cloning a snapshot and deleting that snapshot 2016-12-05 16:22:10 +08:00
anoopsamjohn e10baacd3e HBASE-17245 Replace HTableDescriptor#htd.getColumnFamilies().length with a low-cost implementation. (huaxiang sun) 2016-12-05 13:28:57 +05:30
tedyu 0d6b872d9d HBASE-17241 Avoid compacting already compacted mob files with _del files (huaxiang sun) 2016-12-04 20:23:06 -08:00
John Leach 42ff4a7164 HBASE-17231 Region#getCellCompartor -> Region#getCellComparator
Signed-off-by: Michael Stack <stack@apache.org>
2016-12-03 16:07:42 -08:00
Huaxiang Sun 03423fec6b HBASE-17243 Reuse CompactionPartitionId and avoid creating MobFileName in PartitionedMobCompactor to avoid unnecessary new objects (addendum)
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-12-03 07:19:02 -08:00
Huaxiang Sun efcd15bf67 HBASE-17243 Reuse CompactionPartitionId and avoid creating MobFileName in PartitionedMobCompactor to avoid unnecessary new objects
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-12-03 03:48:23 -08:00
Michael Stack 7775feda05 HBASE-17194 Assign the new region to the idle server after splitting (ChiaPing Tsai) 2016-12-02 11:34:14 -08:00
Michael Stack 4a20361f1a HBASE-17184 Revert "Code cleanup of LruBlockCache"
Revert "Revert "Code cleanup of LruBlockCache""
This is a revert of a revert; i.e. it is putting the change
back only this time we add the missing JIRA number

This reverts commit f3524a06bb.
2016-12-02 11:19:07 -08:00
Michael Stack f3524a06bb Revert "Code cleanup of LruBlockCache"
Missing JIRA number

This reverts commit ad857d1b77.
2016-12-02 11:18:42 -08:00
binlijin 9c13219f0d HBASE-17232 Replace HashSet with ArrayList to accumulate delayed scanners in KVHeap and StoreScanner. 2016-12-02 21:10:37 +08:00
anoopsamjohn 4b3ffffa09 HBASE-17161 MOB : Make ref cell creation more efficient. 2016-12-02 17:30:34 +05:30
Ramkrishna cb5c4c146f HBASE-17235 Improvement in creation of CIS for onheap buffer cases (Ram) 2016-12-02 14:07:16 +05:30
Ramkrishna 3b72b69d0e HBASE-17191 Make use of UnsafeByteOperations#unsafeWrap(ByteBuffer buffer)
in PBUtil#toCell(Cell cell) (Ram)
2016-12-02 12:48:06 +05:30
Stephen Yuan Jiang 0a24077841 HBASE-16119 Procedure v2 - Reimplement Merge region (Stephen Yuan Jiang) 2016-12-01 22:41:15 -08:00
Apekshit Sharma 37b30d93d8 HBASE-17111 Use Apache CLI in SnapshotInfo tool.
Change-Id: Ifd4b0200ba58737c5583dfbcf23f2549c4f233d0
2016-12-01 17:53:01 -08:00
Guanghao Zhang b3d8d06703 HBASE-17205 Add a metric for the duration of region in transition 2016-12-01 10:13:37 -08:00
Jonathan M Hsieh eeaea4aea3 HBASE-17224 Fix lots of spelling errors in HBase logging and exception messages (Grant Sohn) 2016-12-01 08:57:16 -08:00
zhangduo 540ede376b HBASE-16648 [JDK8] Use computeIfAbsent instead of get and putIfAbsent 2016-12-01 21:17:55 +08:00
zhangduo fb789b340c HBASE-17206 FSHLog may roll a new writer successfully with unflushed entries 2016-12-01 14:15:03 +08:00
John Leach 37d7b57128 HBASE-17216 Fields that can safetly be made static 2016-11-30 22:03:35 -08:00
Charlie Qiangeng Xu b2086873a9 HBASE-17110 Improve SimpleLoadBalancer to always take server-level balance into account
Signed-off-by: Yu Li <liyu@apache.org>
2016-12-01 12:12:16 +08:00
Enis Soztutar b6f5d5b85f HBASE-17151 New API to create HFile.Reader without instantiating block cache (Vladimir Rodionov) 2016-11-30 17:04:31 -08:00
Lars Francke ad857d1b77 Code cleanup of LruBlockCache
Signed-off-by: Michael Stack <stack@apache.org>
2016-11-30 12:57:14 -08:00
Guanghao Zhang ea912478e2 HBASE-17178 Add region balance throttling
Signed-off-by: Phil Yang <yangzhe1991@apache.org>
2016-11-30 18:03:15 +08:00
zhangduo 890fcbd0e6 HBASE-17167 Pass mvcc to client when scan 2016-11-30 10:11:04 +08:00
Ramkrishna 7c43a23c07 HBASE-17012 Handle Offheap cells in CompressedKvEncoder (Ram) 2016-11-29 22:27:45 +05:30
Ashu Pachauri 7bcbac91a2 HBASE-16302 age of last shipped op and age of last applied op should be histograms
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2016-11-29 13:51:32 +05:30
Stephen Yuan Jiang d87df9209a HBASE-17189 TestMasterObserver#wasModifyTableActionCalled uses wrong variables (Stephen Yuan Jiang) 2016-11-28 23:09:42 -08:00
Stephen Yuan Jiang b2d3fa1a8a HBASE-17186 MasterProcedureTestingUtility#testRecoveryAndDoubleExecution displays stale procedure state info (Stephen Yuan Jiang) 2016-11-28 23:00:51 -08:00
Ramkrishna 51d9bac42b HBASE-17048 Calcuate suitable ByteBuf size when allocating send buffer in
FanOutOneBlockAsyncDFSOutput (Ram)
2016-11-29 09:12:47 +05:30
Guanghao Zhang cc03f7ad53 HBASE-16561 Add metrics about read/write/scan queue length and active read/write/scan handler count
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-11-29 09:43:30 +08:00
Michael Stack 3d5e686070 HBASE-17072 CPU usage starts to climb up to 90-100% when using G1GC
Removes ThreadLocal. Uses AtomicReference instead (based on patch
posted up in HBASE-10676 "Removing ThreadLocal of PrefetchedHeader in
HFileBlock.FSReaderV2 make higher perforamce of scan")

Signed-off-by: Michael Stack <stack@apache.org>
2016-11-28 09:51:05 -08:00
Jerry He 4771c217cd HBASE-17116 [PerformanceEvaluation] Add option to configure block size (Yi Liang) 2016-11-27 19:04:32 -08:00
anoopsamjohn 030054bcce HBASE-17162 Avoid unconditional call to getXXXArray() in write path. 2016-11-26 12:49:01 +05:30
anoopsamjohn 3f7f1c1353 HBASE-17169 Remove Cell variants with ShareableMemory. 2016-11-26 12:20:06 +05:30
zhangduo 01d3473bf0 HBASE-16984 Implement getScanner 2016-11-25 20:32:35 +08:00
anoopsamjohn 86e17858f7 HBASE-15786 Create DBB backed MSLAB pool. 2016-11-24 20:47:41 +05:30
binlijin a45b3c3533 HBASE-17144 Possible offheap read ByteBuffers leak 2016-11-24 16:12:20 +08:00
tedyu 9f5b8a83b7 HBASE-17158 Avoid deadlock caused by HRegion#doDelta (ChiaPing Tsai) 2016-11-23 07:05:46 -08:00