Commit Graph

4791 Commits

Author SHA1 Message Date
Jerry He f61b840a31 HBASE-15437 Response size calculated in RPCServer for warning tooLarge responses does NOT count CellScanner payload 2017-02-08 17:21:56 -08:00
Zach York 8f6388503b HBASE-17437 Support specifying a WAL directory outside of the root directory (Yishan Yang and Zach York)
HBASE-17588 Remove unused imports brought in by HBASE-17437 (Zach York)

Signed-off-by: Enis Soztutar <enis@apache.org>
2017-02-08 15:01:59 -08:00
Enis Soztutar 753169a3af HBASE-17105 Annotate RegionServerObserver 2017-02-08 13:35:29 -08:00
huzheng 8574934f59 HBASE-17381 ReplicationSourceWorkerThread can die due to unhandled exceptions (huzheng)
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-02-07 17:33:42 -08:00
tedyu a75e5a5435 HBASE-17275 Assign timeout may cause region to be unassigned forever (Allan yang) 2017-02-07 12:57:07 -08:00
tedyu 0553290c6a HBASE-17565 StochasticLoadBalancer may incorrectly skip balancing due to skewed multiplier sum - addendum resets min cost 2017-02-07 12:24:54 -08:00
tedyu 5a0020e867 HBASE-17565 StochasticLoadBalancer may incorrectly skip balancing due to skewed multiplier sum 2017-02-07 06:26:12 -08:00
tedyu 0a0aef345a HBASE-17264 Processing RIT with offline state will always fail to open the first time (Allan Yang) 2017-02-06 19:48:14 -08:00
zhangduo f708d986a0 HBASE-17597 TestMetaWithReplicas.testMetaTableReplicaAssignment is flaky 2017-02-07 09:51:46 +08:00
Enis Soztutar 7cac85b667 HBASE-17187 DoNotRetryExceptions from coprocessors should bubble up to the application 2017-02-06 13:39:09 -08:00
tedyu 35e4eb7a7a HBASE-17601 close() in TableRecordReaderImpl assumes the split has started (Michael Axiak) 2017-02-06 10:33:05 -08:00
zhangduo 4456d22859 HBASE-17508 Unify the implementation of small scan and regular scan for sync client 2017-02-05 08:49:51 +08:00
Zach York cd847e599c HBASE-17587 Do not Rethrow DoNotRetryIOException as UnknownScannerException
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-02 17:09:34 -08:00
tedyu f59cf6f02e HBASE-16621 HBCK should have -fixHFileLinks (Janos Gub) 2017-02-02 07:31:35 -08:00
Sean Busbey fab0b2e603 Addendum HBASE-17522 missed some branch-1 specific direct uses of MemoryMXBean 2017-02-01 11:32:13 -06:00
Sean Busbey 3d4639f34d HBASE-17522 Handle JVM throwing runtime exceptions when we ask for details on heap usage the same as a correctly returned 'undefined'.
Signed-off-by: Michael Stack <stack@apache.org>

 Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/io/util/HeapMemorySizeUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheConfig.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestCacheConfig.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestDefaultMemStore.java
2017-02-01 10:38:29 -06:00
gjacoby 3aac1b6884 HBASE-17543 - Create additional ReplicationEndpoint WALEntryFilters by configuration
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-01-31 16:16:20 -08:00
Sukumar Maddineni c937e97864 HBASE-17540 Change SASL server GSSAPI callback log line from DEBUG to TRACE in RegionServer
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-01-27 15:13:56 -08:00
tedyu 3dc03ccfb7 HBASE-17515 Reduce memory footprint of RegionLoads kept by StochasticLoadBalancer - revert due to pending discussion 2017-01-26 10:46:03 -08:00
tedyu a0fac0894b HBASE-17515 Reduce memory footprint of RegionLoads kept by StochasticLoadBalancer (Tim Brown) 2017-01-25 20:36:48 -08:00
tedyu ed023058d2 HBASE-17519 Rollback the removed cells (ChiaPing Tsai) 2017-01-25 06:29:56 -08:00
tedyu 19f9a1a643 HBASE-17462 Use sliding window for read/write request costs in StochasticLoadBalancer (Tim Brown) 2017-01-23 14:55:40 -08:00
tedyu 50ecbf1c8a HBASE-17510 DefaultMemStore gets the wrong heap size after rollback (ChiaPing Tsai) 2017-01-23 09:30:39 -08:00
tedyu 6e0f3f5bbc HBASE-17504 The passed durability of Increment is ignored when syncing WAL (ChiaPing Tsai) 2017-01-22 08:44:11 -08:00
zhangduo 57409371a0 HBASE-17489 ClientScanner may send a next request to a RegionScanner which has been exhausted 2017-01-22 16:39:14 +08:00
Dave Navarro c64236584b HBASE-17357 FIX PerformanceEvaluation parameters parsing triggers NPE.
check command name is not null, if null print usage and exit

Signed-off-by: Michael Stack <stack@apache.org>
2017-01-20 22:53:23 -08:00
Michael Stack f7d1d25fd7 HBASE-17488 WALEdit should be lazily instantiated (ChiaPing Tsai) 2017-01-20 09:38:55 -08:00
tedyu abc8c5edd3 HBASE-17494 Guard against cloning family of all cells if no data need be replicated (ChiaPing Tsai) 2017-01-19 16:21:17 -08:00
tedyu 0e06ade694 HBASE-17469 Properly handle empty TableName in TablePermission#readFields and #write (Manjunath Anand) 2017-01-17 09:38:50 -08:00
Michael Stack 354e213852 HBASE-17464 Fix HBaseTestingUtility.getNewDataTestDirOnTestFS to always return a unique path 2017-01-13 17:53:48 -08:00
tedyu ee66ab8e29 HBASE-17450 TablePermission#equals throws NPE after namespace support was added (huzheng) 2017-01-13 09:39:06 -08:00
tedyu 49b5a6e803 HBASE-17452 Failed taking snapshot - region Manifest proto-message too large (huaxiang sun) 2017-01-13 09:00:15 -08:00
tedyu 56f963f4a6 HBASE-17445 Count size of serialized exceptions in checking max result size quota 2017-01-11 10:06:40 -08:00
tedyu 2f7ce65b81 HBASE-17429 HBase bulkload cannot support HDFS viewFs (shenxianqiang) 2017-01-09 18:53:39 -08:00
Michael Stack 6130ea4d54 HBASE-12148 Remove TimeRangeTracker as point of contention when many threads writing a Store (Huaxiang Sun) 2017-01-09 13:35:20 -08:00
tedyu 9b26c9ff37 HBASE-17435 Call to preCommitStoreFile() hook encounters SaslException in secure deployment 2017-01-09 08:53:17 -08:00
Ashish Singhi e8e40d8625 HBASE-17290 Potential loss of data for replication of bulk loaded hfiles 2017-01-06 16:57:52 +05:30
rahul gidwani 667c5eb3a0 HBASE-16710 Add ZStandard Codec to Compression.java
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-01-05 10:47:12 -08:00
Jan Hentschel a9bac6a496 HBASE-17390 Added master and backup masters to online update of configuration
Signed-off-by: Jerry He <jerryjch@apache.org>
2017-01-04 22:25:22 -08:00
Josh Elser 4dcb07f996 HBASE-17409 Limit jsonp callback name to prevent xss 2017-01-04 19:36:24 -05:00
tedyu 36f16bbe10 HBASE-17387 Reduce the overhead of exception report in RegionActionResult for multi() 2016-12-29 19:23:44 -08:00
tedyu cec40f941f HBASE-17374 ZKPermissionWatcher crashed when grant after region close (Liu Junhong) 2016-12-29 05:46:40 -08:00
Stephen Yuan Jiang ce33cf2d3d HBASE-17149 Procedure V2 - Fix nonce submission to avoid unnecessary calling coprocessor multiple times (Matteo Bertozzi) 2016-12-28 15:43:50 -08:00
Stephen Yuan Jiang d4b2627916 HBASE-17238 Wrong in-memory hbase:meta location causing SSH failure (Stephen Yuan jiang) 2016-12-28 13:53:22 -08:00
Phil Yang 29e390c808 HBASE-17314 Limit total buffered size for all replication sources 2016-12-23 12:17:39 +08:00
Phil Yang dd0206ff31 Revert "HBASE-17314 Limit total buffered size for all replication sources"
This reverts commit e9444ed077.
2016-12-22 19:08:17 +08:00
tedyu 819d32f951 HBASE-17330 SnapshotFileCache will always refresh the file cache (Jianwei Cui) 2016-12-22 02:30:41 -08:00
tedyu f94180a3e9 HBASE-17341 Add a timeout during replication endpoint termination (Vincent Poon) 2016-12-21 08:27:45 -08:00
Phil Yang e9444ed077 HBASE-17314 Limit total buffered size for all replication sources 2016-12-21 13:10:29 +08:00
Vincent e79afbf0cb HBASE-17328 Properly dispose of looped replication peers
Signed-off-by: Andrew Purtell <apurtell@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMasterReplication.java
2016-12-20 18:01:33 -08:00
tedyu fa975fa382 HBASE-17347 ExportSnapshot may write snapshot info file to wrong directory when specifying target name (Jianwei Cui) 2016-12-20 15:58:28 -08:00
tedyu 0b69f59133 HBASE-17292 Add observer notification before bulk loaded hfile is moved to region directory 2016-12-20 13:23:27 -08:00
tedyu b9689808eb HBASE-17344 The regionserver web UIs miss the coprocessors of RegionServerCoprocessorHost (ChiaPing Tsai) 2016-12-20 08:55:07 -08:00
Guanghao Zhang 97d1ba4015 HBASE-17317 [branch-1] The updatePeerConfig method in ReplicationPeersZKImpl didn't update the table-cfs map 2016-12-20 18:51:26 +08:00
binlijin 4c7f0f2436 HBASE-17332 Replace HashMap to Array for DataBlockEncoding.idToEncoding 2016-12-20 12:28:04 +08:00
binlijin ed39396497 HBASE-16398 optimize HRegion computeHDFSBlocksDistribution 2016-12-16 13:57:43 +08:00
tedyu f3a3069796 HBASE-17319 Truncate table with preserve after split may cause truncation to fail (Allan Yang) 2016-12-15 13:45:11 -08:00
tedyu ffe70158cc HBASE-17318 Increment does not add new column if the increment amount is zero at first time writing (Guangxu Cheng) 2016-12-15 08:45:05 -08:00
Guanghao Zhang 4b3df0f926 HBASE-17296 Provide per peer throttling for replication
Signed-off-by: Phil Yang <yangzhe1991@apache.org>
2016-12-15 16:13:04 +08:00
tedyu e029c554bb HBASE-17302 The region flush request disappeared from flushQueue (Guangxu Cheng) 2016-12-13 12:46:42 -08:00
tedyu 1f9214bee7 HBASE-17297 Single Filter in parenthesis cannot be parsed correctly (Xuesen Liang) 2016-12-12 12:09:22 -08:00
tedyu 30576991bc HBASE-17289 Avoid adding a replication peer named "lock" 2016-12-12 09:38:55 -08:00
Josh Elser f13283bc05 HBASE-17276 Only log stacktraces for exceptions once for updates in a batch
For large batches of updates, repeatedly logging WrongRegionExceptions,
FailedSanityCheckExceptions, and/or NoSuchColumnFamilyExceptions can
easily dominate the contents of a RegionServer log. After the first
occurence of logging the full exception, switch to logging only the
message on the exception.
2016-12-11 15:40:22 -05:00
tedyu d87b05f040 HBASE-16336 Removing peers seems to be leaving spare queues (Guanghao Zhang) 2016-12-11 07:43:10 -08:00
Stephen Yuan Jiang e51584381a HBASE-17023 Region left unassigned due to AM and SSH each thinking others would do the assignment work (Stephen Yuan Jiang) 2016-12-10 15:05:00 -08:00
tedyu c2801a2ea8 HBASE-17256 Rpc handler monitoring will be removed when the task queue is full (Guangxu Cheng) 2016-12-05 12:14:20 -08:00
Ashu Pachauri cbdc9fcb8a Addendum HBASE-16209: Add an ExponentialBackOffPolicy so that we spread out the timing of open region retries in AssignmentManager.
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-12-02 10:30:28 +08:00
Guanghao Zhang 682dd57cd6 HBASE-17205 Add a metric for the duration of region in transition 2016-12-01 10:32:24 -08:00
Jonathan M Hsieh 9da0d5d00e HBASE-17224 Fix lots of spelling errors in HBase logging and exception messages (Grant Sohn) 2016-12-01 09:10:03 -08:00
zhangduo c8ea82299c HBASE-17206 FSHLog may roll a new writer successfully with unflushed entries 2016-12-01 14:20:38 +08:00
Yu Li b3627ef51e HBASE-17212 Should add null checker on table name in HTable and RegionServerCallable constructor (addendum) 2016-12-01 13:32:33 +08:00
Guanghao Zhang f26b3bf5ba HBASE-17178 Add region balance throttling
Signed-off-by: Phil Yang <yangzhe1991@apache.org>
2016-11-30 18:07:02 +08:00
zhangduo af69783128 HBASE-17167 Pass mvcc to client when scan 2016-11-30 10:02:17 +08:00
Ashu Pachauri b8da9f83cb HBASE-16302 age of last shipped op and age of last applied op should be histograms
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2016-11-29 13:54:28 +05:30
Guanghao Zhang 7b2673db12 HBASE-16561 Add metrics about read/write/scan queue length and active read/write/scan handler count
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-11-29 16:09:56 +08:00
zhangduo be042652aa Revert "HBASE-16561 Add metrics about read/write/scan queue length and active read/write/scan handler count"
Forget to add signoff

This reverts commit 5ec218dbc2.
2016-11-29 16:09:22 +08:00
Guanghao Zhang 5ec218dbc2 HBASE-16561 Add metrics about read/write/scan queue length and active read/write/scan handler count 2016-11-29 16:00:37 +08:00
Stephen Yuan Jiang cdf539a8e0 HBASE-17189 TestMasterObserver#wasModifyTableActionCalled uses wrong variables (Stephen Yuan Jiang) 2016-11-28 23:18:42 -08:00
Michael Stack 987205caf9 HBASE-17072 CPU usage starts to climb up to 90-100% when using G1GC
Removes ThreadLocal. Uses AtomicReference instead (based on patch
posted up in HBASE-10676 "Removing ThreadLocal of PrefetchedHeader in
HFileBlock.FSReaderV2 make higher perforamce of scan")

Signed-off-by: Michael Stack <stack@apache.org>
2016-11-28 13:41:17 -08:00
Jerry He 10c070825f HBASE-17116 [PerformanceEvaluation] Add option to configure block size (Yi Liang) 2016-11-27 19:13:08 -08:00
Jingcheng Du fb1ace490c HBASE-17095 The ClientSimpleScanner keeps retrying if the hfile is corrupt or cannot found 2016-11-22 11:26:57 +08:00
binlijin 2da5ed098e HBASE-17118 StoreScanner leaked in KeyValueHeap (addendum) 2016-11-21 20:55:52 +08:00
tedyu e8f056935b HBASE-17131 Avoid livelock caused by HRegion#processRowsWithLocks (ChiaPing Tsai) 2016-11-20 18:17:21 -08:00
Guanghao Zhang 3c45ff08d9 HBASE-17088 Refactor RWQueueRpcExecutor/BalancedQueueRpcExecutor/RpcExecutor
Signed-off-by: zhangduo <zhangduo@apache.org>
2016-11-19 14:18:06 +08:00
Esteban Gutierrez 19441937ea HBASE-17058 Lower epsilon used for jitter verification from HBASE-15324 2016-11-17 12:29:08 -08:00
tedyu c6f1b6e624 HBASE-17112 Prevent setting timestamp of delta operations the same as previous value's (Phil Yang) 2016-11-17 09:04:39 -08:00
tedyu d722b2aab7 HBASE-17118 StoreScanner leaked in KeyValueHeap (binlijin) 2016-11-17 08:46:11 -08:00
Andrew Purtell e54826434e HBASE-17044 Fix merge failed before creating merged region leaves meta inconsistent 2016-11-14 17:14:48 -08:00
tedyu b77bfe9d3b HBASE-17077 Don't copy the replication queue belonging to the peer which has been deleted (Guanghao Zhang) 2016-11-13 07:00:25 -08:00
tedyu 469462c850 HBASE-17062 RegionSplitter throws ClassCastException (Jeongdae Kim) 2016-11-11 07:18:22 -08:00
thiruvel 44ab659b93 HBASE-16962: Add readPoint to preCompactScannerOpen() and preFlushScannerOpen() API
Signed-off-by: anoopsamjohn <anoopsamjohn@gmail.com>
2016-11-11 11:09:55 +05:30
Yu Sun 18b31fdd32 HBASE-17020 keylen in midkey() dont computed correctly
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-11 08:01:00 +08:00
Guanghao Zhang a6397e3b0c HBASE-16938 TableCFsUpdater maybe failed due to no write permission on peerNode
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-11-10 14:07:20 -08:00
binlijin dac73eceb0 HBASE-16570 Compute region locality in parallel at startup (addendum)
Addendum mainly for:
1. Avoid interfering with block location cache in RegionLocationFinder
2. Avoid refreshing block lcoations during HMaster startup (or else the startup could be really slow)

Signed-off-by: Yu Li <liyu@apache.org>
2016-11-10 16:53:39 +08:00
Guanghao Zhang e929156f96 HBASE-16985 TestClusterId failed due to wrong hbase rootdir
Signed-off-by: Michael Stack <stack@apache.org>
2016-11-09 17:19:31 -08:00
tedyu 1e322e68a5 HBASE-17054 Compactor#preCreateCoprocScanner should be passed user 2016-11-09 07:00:19 -08:00
Charlie Qiangeng Xu d248d6b0b3 HBASE-17039 SimpleLoadBalancer schedules large amount of invalid region moves
Signed-off-by: Yu Li <liyu@apache.org>
2016-11-09 17:07:28 +08:00
Enis Soztutar 123d26ed90 HBASE-17017 Remove the current per-region latency histogram metrics 2016-11-08 18:31:12 -08:00
Michael Stack a70f73c1e1 HBASE-16983 TestMultiTableSnapshotInputFormat failing with Unable to create region directory: /tmp/... (Addendum by Guanghao Zhang) 2016-11-08 11:59:49 -08:00
tedyu 97276da9a7 HBASE-17010 Serial replication should handle daughter regions being assigned to another RS (Phil Yang) 2016-11-08 06:35:12 -08:00