Commit Graph

5429 Commits

Author SHA1 Message Date
tedyu 471cf13b1a HBASE-17445 Count size of serialized exceptions in checking max result size quota 2017-01-11 07:00:27 -08:00
Yu Li 953416eb34 HBASE-14061 Support CF-level Storage Policy (addendum2)
Resolve TestPartitionedMobCompactor UT failure
2017-01-11 18:23:37 +08:00
Yu Li 36eeb2c569 HBASE-14061 Support CF-level Storage Policy (addendum)
Addendum to resolve compatible issue with Hadoop 2.8.0+ / 3.0.0-alpha1+, meantime added
a util method in ReflectionUtils for invoking method with reflection
2017-01-11 10:14:55 +08:00
Guanghao Zhang ac3b1c9aa9 HBASE-17337 list replication peers request should be routed through master 2017-01-10 08:57:26 +08:00
Michael Stack bd157ffe9a Revert "HBASE-17434 New Synchronization Scheme for Compaction Pipeline (Eshcar Hillel)"
Undo premature commit

This reverts commit 1576269123.
2017-01-09 15:40:01 -08:00
tedyu 8dd35631ca HBASE-17429 HBase bulkload cannot support HDFS viewFs (shenxianqiang) 2017-01-09 14:48:51 -08:00
Michael Stack dd1ae37148 HBASE-12148 Remove TimeRangeTracker as point of contention when many threads writing a Store (Huaxiang Sun) 2017-01-09 13:24:53 -08:00
Michael Stack 1576269123 HBASE-17434 New Synchronization Scheme for Compaction Pipeline (Eshcar Hillel) 2017-01-09 10:46:34 -08:00
tedyu 9cbeba6c3d HBASE-17435 Call to preCommitStoreFile() hook encounters SaslException in secure deployment 2017-01-09 08:51:00 -08:00
Ramkrishna f65a439f01 HBASE-17291 Remove ImmutableSegment#getKeyValueScanner (Ram) 2017-01-09 12:06:25 +05:30
Yu Li f92a14ade6 HBASE-14061 Support CF-level Storage Policy 2017-01-09 09:52:58 +08:00
tedyu b2a9be02ac HBASE-17408 Introduce per request limit by number of mutations (ChiaPing Tsai) 2017-01-06 13:07:15 -08:00
Ashish Singhi 5f631b9653 HBASE-17290 Potential loss of data for replication of bulk loaded hfiles 2017-01-06 16:18:20 +05:30
Yu Li 629b04f44f HBASE-15172 Support setting storage policy in bulkload 2017-01-06 18:35:38 +08:00
Guanghao Zhang e02ae7724d HBASE-17388 Move ReplicationPeer and other replication related PB messages to the replication.proto 2017-01-06 10:01:22 +08:00
rahul gidwani 0f6c79eb12 HBASE-16710 Add ZStandard Codec to Compression.java
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-01-05 10:46:55 -08:00
Jan Hentschel dba103e1b6 HBASE-17390 Added master and backup masters to online update of configuration
Signed-off-by: Jerry He <jerryjch@apache.org>
2017-01-04 22:08:05 -08:00
Josh Elser 20a7ae2865 HBASE-17409 Limit jsonp callback name to prevent xss 2017-01-04 17:05:07 -05:00
tedyu 63bd8be576 HBASE-17403 ClientAsyncPrefetchScanner doesn’t load any data if the MaxResultSize is too small (ChiaPing Tsai) 2017-01-04 08:21:25 -08:00
eshcar 69ce5967fd HBASE-17373: Fixing bug in moving segments from compaction pipeline to snapshot
Signed-off-by: Michael Stack <stack@apache.org>
2017-01-03 19:13:52 -08:00
Guanghao Zhang 0e48665641 HBASE-17336 get/update replication peer config requests should be routed through master 2016-12-30 10:12:47 +08:00
tedyu 1c477b2df9 HBASE-17387 Reduce the overhead of exception report in RegionActionResult for multi() 2016-12-29 17:54:02 -08:00
Jan Hentschel 7572e96e3a HBASE-17385 Change usage documentation from bin/hbase to hbase in various tools
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-12-29 15:20:43 -08:00
tedyu 001a26d404 HBASE-17374 ZKPermissionWatcher crashed when grant after region close (Liu Junhong) 2016-12-28 19:54:01 -08:00
zhangduo 05b1d918b0 HBASE-17320 Add inclusive/exclusive support for startRow and endRow of scan 2016-12-29 09:43:31 +08:00
Michael Stack a3e0e0df0d HBASE-17149 Procedure V2 - Fix nonce submission to avoid unnecessary calling coprocessor multiple times; ADDENDUM by Stephen Yuan Jiang 2016-12-28 11:10:19 -08:00
tedyu 79e5efd35c HBASE-17081 Flush the entire CompactingMemStore content to disk - revert due to failure in TestHRegionWithInMemoryFlush 2016-12-28 10:53:07 -08:00
Michael Stack 306ef83c9c HBASE-17068 Procedure v2 - inherit region locks (Matteo Bertozzi) 2016-12-27 16:17:45 -08:00
tedyu e18e9a22da HBASE-17376 ClientAsyncPrefetchScanner may fail due to too many rows (ChiaPing Tsai) 2016-12-26 15:55:22 -08:00
Ramkrishna 463ffa792a HBASE-17081 [Recommit]Flush the entire CompactingMemStore content to disk
(Anastasia)
2016-12-26 22:05:13 +05:30
zhangduo 8fa5b0b946 HBASE-17345 Implement batch 2016-12-25 20:36:52 +08:00
ChiaPing Tsai 8cb55c4080 HBASE-17174 Refactor the AsyncProcess, BufferedMutatorImpl, and HTable
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-12-24 12:02:05 +08:00
Jerry He 992e5717d4 HBASE-16010 Put draining function through Admin API (Matt Warhaftig) 2016-12-23 13:41:36 -08:00
Phil Yang 8fb9a91d44 HBASE-17314 Limit total buffered size for all replication sources 2016-12-23 11:48:06 +08:00
Guanghao Zhang b3f2bec099 HBASE-17335 enable/disable replication peer requests should be routed through master 2016-12-23 09:27:12 +08:00
zhangduo 09bb428763 HBASE-17334 Add locate row before/after support for AsyncRegionLocator 2016-12-22 20:39:01 +08:00
tedyu 66781864aa HBASE-17330 SnapshotFileCache will always refresh the file cache (Jianwei Cui) 2016-12-22 02:29:27 -08:00
binlijin fc93de51af HBASE-17262 Refactor RpcServer so as to make it extendable and/or pluggable 2016-12-22 14:49:56 +08:00
Michael Stack d787155fd2 HBASE-5401 PerformanceEvaluation generates 10x the number of expected mappers (Yi Liang) 2016-12-21 11:55:48 -08:00
Michael Stack a1d2ff4646 Revert "HBASE-17314 Limit total buffered size for all replication sources"
This reverts commit 3826e63967.
2016-12-21 11:17:28 -08:00
tedyu cac0904c16 HBASE-17341 Add a timeout during replication endpoint termination (Vincent Poon) 2016-12-21 08:26:22 -08:00
Guanghao Zhang e1f4aaeacd HBASE-11392 add/remove peer requests should be routed through master 2016-12-21 13:27:13 +08:00
Phil Yang 3826e63967 HBASE-17314 Limit total buffered size for all replication sources 2016-12-21 13:16:17 +08:00
Thiruvel Thirumoolan 3599716dff HBASE-17107: FN info should be cleaned up on region/table cleanup
Signed-off-by: Francis Liu <toffer@apache.org>
2016-12-20 18:52:49 -08:00
Vincent f8474c8d4d HBASE-17328 Properly dispose of looped replication peers
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2016-12-20 18:03:11 -08:00
tedyu 5ebb25d601 HBASE-17347 ExportSnapshot may write snapshot info file to wrong directory when specifying target name (Jianwei Cui) 2016-12-20 13:02:51 -08:00
tedyu e75dee3a21 HBASE-17344 The regionserver web UIs miss the coprocessors of RegionServerCoprocessorHost (ChiaPing Tsai) 2016-12-20 08:52:45 -08:00
zhangduo a2e967d92f HBASE-17142 Implement multi get 2016-12-20 20:41:55 +08:00
Ramkrishna db5953c6fe HBASE-17333 HBASE-17294 always ensures CompactingMemstore is default (Ram) 2016-12-20 11:01:27 +05:30
binlijin b7bde350a1 HBASE-17332 Replace HashMap to Array for DataBlockEncoding.idToEncoding 2016-12-20 09:32:28 +08:00
zhangduo d53f012bb7 Revert "HBASE-17081 Flush the entire CompactingMemStore content to disk (Anastasia"
Revert to address tests failure.

This reverts commit a2a7618d26.
2016-12-16 18:49:48 +08:00
tedyu 665fe3eef1 HBASE-17331 Avoid busy waiting in ThrottledInputStream (ChiaPing Tsai) 2016-12-18 08:15:15 -08:00
zhangduo f041306cda HBASE-17282 Reduce the redundant requests to meta table 2016-12-18 08:52:06 +08:00
Michael Stack da356069f2 HBASE-17149 Procedure v2 - Fix nonce submission
Signed-off-by: Michael Stack <stack@apache.org>
2016-12-16 21:41:18 -08:00
tedyu 2c107e4d08 HBASE-15432 TableInputFormat - support multi column family scan (Xuesen Liang) 2016-12-16 18:04:55 -08:00
tedyu 49b0bab504 HBASE-17292 Add observer notification before bulk loaded hfile is moved - addendum properly handles copied hfile 2016-12-16 15:31:30 -08:00
Michael Stack c3ce02d592 HBASE-17326 Fix findbugs warning in BufferedMutatorParams Fix above and the other hbase-server findbugs complaint about null-check 2016-12-16 13:47:58 -08:00
binlijin 6acbee179f HBASE-16398 optimize HRegion computeHDFSBlocksDistribution 2016-12-16 11:02:27 +08:00
tedyu 35f0718a41 HBASE-17292 Add observer notification before bulk loaded hfile is moved to region directory 2016-12-15 09:43:22 -08:00
Ramkrishna d1147eeb7e HBASE-15787 Change the flush related heuristics to work with offheap size
configured (Ram)
2016-12-15 22:49:52 +05:30
Ramkrishna a2a7618d26 HBASE-17081 Flush the entire CompactingMemStore content to disk (Anastasia
Braginsky)
2016-12-15 22:02:05 +05:30
tedyu 401e83cee3 HBASE-17318 Increment does not add new column if the increment amount is zero at first time writing (Guangxu Cheng) 2016-12-15 07:06:37 -08:00
anoopsamjohn f9750f2122 HBASE-17298 remove unused code in HRegion#doMiniBatchMutation. (huaxiang sun) 2016-12-15 15:54:49 +05:30
tedyu a5a6036883 HBASE-17309 Fix connection leaks in TestAcidGuarantees (huaxiang sun) 2016-12-14 20:03:44 -08:00
eshcar 691f266fc2 HBASE-17316: Addendum of HBASE-17294
Signed-off-by: Michael Stack <stack@apache.org>
2016-12-14 08:17:57 -08:00
eshcar a9310436d5 HBASE-17294: External configuration for memory compaction
Signed-off-by: Michael Stack <stack@apache.org>
2016-12-13 17:16:00 -08:00
tedyu de98f68408 HBASE-17302 The region flush request disappeared from flushQueue (Guangxu Cheng) 2016-12-13 12:45:09 -08:00
tedyu 2333596279 HBASE-17296 Provide per peer throttling for replication (Guanghao Zhang) 2016-12-13 04:20:20 -08:00
tedyu adb319f5c2 HBASE-17297 Single Filter in parenthesis cannot be parsed correctly (Xuesen Liang) 2016-12-12 12:07:34 -08:00
Jingcheng Du 1615f45b31 HBASE-17237 Override the correct compact method in HMobStore 2016-12-12 11:54:21 +08:00
tedyu 67420fe21d HBASE-16336 Removing peers seems to be leaving spare queues (Guanghao Zhang) 2016-12-10 04:33:40 -08:00
Josh Elser b554e05410 HBASE-17276 Only log stacktraces for exceptions once for updates in a batch
For large batches of updates, repeatedly logging WrongRegionExceptions,
FailedSanityCheckExceptions, and/or NoSuchColumnFamilyExceptions can
easily dominate the contents of a RegionServer log. After the first
occurence of logging the full exception, switch to logging only the
message on the exception.
2016-12-09 14:28:00 -08:00
zhangduo b3ae87bd7d HBASE-17251 Add a timeout parameter when locating region 2016-12-08 09:55:29 +08:00
Thiruvel Thirumoolan c1293cc91e HBASE-16941: FavoredNodes - Split/Merge code paths
Signed-off-by: Francis Liu <toffer@apache.org>
2016-12-07 16:38:48 -08:00
Jerry He 75567f828c HBASE-15437 Response size calculated in RPCServer for warning tooLarge responses does NOT count CellScanner payload 2016-12-07 14:47:10 -08:00
Matteo Bertozzi 1eb24e4e8e HBASE-17260 Procedure v2 - Add setOwner() overload taking a User instance 2016-12-06 10:32:43 -08:00
anoopsamjohn f112427425 HBASE-17207 Arrays.asList() with too few arguments. (John Leach) 2016-12-06 14:42:14 +05:30
Clay Baenziger c7b8b63cd1 HBASE-16700 Allow for coprocessor whitelisting
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-12-05 14:46:15 -08:00
tedyu 3190605801 HBASE-17256 Rpc handler monitoring will be removed when the task queue is full (Guangxu Cheng) 2016-12-05 11:32:17 -08:00
Jerry He 39653862a4 HBASE-17221 Abstract out an interface for RpcServer.Call 2016-12-05 10:21:55 -08:00
Ramkrishna 94302a3d26 HBASE-17239 Add UnsafeByteOperations#wrap(ByteInput, int offset, int len)
API (Ram)
2016-12-05 15:13:04 +05:30
Jingcheng Du 26c2d93f77 HBASE-16841 Data loss in MOB files after cloning a snapshot and deleting that snapshot 2016-12-05 16:22:10 +08:00
anoopsamjohn e10baacd3e HBASE-17245 Replace HTableDescriptor#htd.getColumnFamilies().length with a low-cost implementation. (huaxiang sun) 2016-12-05 13:28:57 +05:30
tedyu 0d6b872d9d HBASE-17241 Avoid compacting already compacted mob files with _del files (huaxiang sun) 2016-12-04 20:23:06 -08:00
John Leach 42ff4a7164 HBASE-17231 Region#getCellCompartor -> Region#getCellComparator
Signed-off-by: Michael Stack <stack@apache.org>
2016-12-03 16:07:42 -08:00
Huaxiang Sun 03423fec6b HBASE-17243 Reuse CompactionPartitionId and avoid creating MobFileName in PartitionedMobCompactor to avoid unnecessary new objects (addendum)
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-12-03 07:19:02 -08:00
Huaxiang Sun efcd15bf67 HBASE-17243 Reuse CompactionPartitionId and avoid creating MobFileName in PartitionedMobCompactor to avoid unnecessary new objects
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-12-03 03:48:23 -08:00
Michael Stack 7775feda05 HBASE-17194 Assign the new region to the idle server after splitting (ChiaPing Tsai) 2016-12-02 11:34:14 -08:00
Michael Stack 4a20361f1a HBASE-17184 Revert "Code cleanup of LruBlockCache"
Revert "Revert "Code cleanup of LruBlockCache""
This is a revert of a revert; i.e. it is putting the change
back only this time we add the missing JIRA number

This reverts commit f3524a06bb.
2016-12-02 11:19:07 -08:00
Michael Stack f3524a06bb Revert "Code cleanup of LruBlockCache"
Missing JIRA number

This reverts commit ad857d1b77.
2016-12-02 11:18:42 -08:00
binlijin 9c13219f0d HBASE-17232 Replace HashSet with ArrayList to accumulate delayed scanners in KVHeap and StoreScanner. 2016-12-02 21:10:37 +08:00
anoopsamjohn 4b3ffffa09 HBASE-17161 MOB : Make ref cell creation more efficient. 2016-12-02 17:30:34 +05:30
Ramkrishna cb5c4c146f HBASE-17235 Improvement in creation of CIS for onheap buffer cases (Ram) 2016-12-02 14:07:16 +05:30
Ramkrishna 3b72b69d0e HBASE-17191 Make use of UnsafeByteOperations#unsafeWrap(ByteBuffer buffer)
in PBUtil#toCell(Cell cell) (Ram)
2016-12-02 12:48:06 +05:30
Stephen Yuan Jiang 0a24077841 HBASE-16119 Procedure v2 - Reimplement Merge region (Stephen Yuan Jiang) 2016-12-01 22:41:15 -08:00
Apekshit Sharma 37b30d93d8 HBASE-17111 Use Apache CLI in SnapshotInfo tool.
Change-Id: Ifd4b0200ba58737c5583dfbcf23f2549c4f233d0
2016-12-01 17:53:01 -08:00
Guanghao Zhang b3d8d06703 HBASE-17205 Add a metric for the duration of region in transition 2016-12-01 10:13:37 -08:00
Jonathan M Hsieh eeaea4aea3 HBASE-17224 Fix lots of spelling errors in HBase logging and exception messages (Grant Sohn) 2016-12-01 08:57:16 -08:00
zhangduo 540ede376b HBASE-16648 [JDK8] Use computeIfAbsent instead of get and putIfAbsent 2016-12-01 21:17:55 +08:00
zhangduo fb789b340c HBASE-17206 FSHLog may roll a new writer successfully with unflushed entries 2016-12-01 14:15:03 +08:00