4975 Commits

Author SHA1 Message Date
Karan Mehta
5f630935bb HBASE-17716 Formalize Scan Metric names
Signed-off-by: Michael Stack <stack@apache.org>
2017-03-07 07:42:40 -08:00
Phil Yang
f45d261902 HBASE-15484 Correct the semantic of batch and partial - amend to fix bug and revise the JavaDoc for related APIs. 2017-03-07 22:42:58 +08:00
Phil Yang
6afe696e53 HBASE-15484 Correct the semantic of batch and partial 2017-03-07 12:04:09 +08:00
Andrew Purtell
ccf1f17d78 HBASE-17722 Metrics subsystem stop/start messages add a lot of useless bulk to operational logging
Conflicts:
	hbase-spark/src/test/resources/log4j.properties
2017-03-03 12:35:21 -08:00
tedyu
88f909cf1f HBASE-17710 HBase in standalone mode creates directories with 777 permission 2017-03-02 11:33:36 -08:00
dvdreddy
f64a52a0c2 HBASE-16630 Fragmentation in long running Bucket Cache
Bug Fix : Added Memory block type also to the list of
evictions that need to happen when there is a needForExtra

Improvement : Inorder to fix the non availabilty of Buckets and force
the movement of buckets to transformed sizes, whenever we encounter a
situation where an allocation cant be made for a BucketSize, we will
forcefully free the entire buckets that have least occupancy ratio. This
is the same strategy used by MemCached when they encounter a similar
issue going by the name 'Slab Calcification'. Only improvement is that
we use a heuristic to evict from the buckets that are least occupied
and also avoid the BucketSizes where there is a single Bucket

Signed-off-by: Ramkrishna <ramkrishna.s.vasudevan@intel.com>
2017-03-01 18:10:54 +05:30
Ramkrishna
bef27396e5 Revert "HBASE-16630 Handle Fragmentation in bucket cache"
This reverts commit 779f9cb07feab2ad7ba758f2f28ba0f32fffb17e.
2017-03-01 11:41:02 +05:30
dvdreddy
779f9cb07f HBASE-16630 Handle Fragmentation in bucket cache
Currently whenever a compaction/bulkload happen and the
blocks are evicted from theirs buckets the buckets become
fragmented and are not available to be used by other
BucketSizes

Bug Fix : Added Memory block type also to the list of
evictions that need to happen when there is a needForExtra

Improvement : Inorder to fix the non availabilty of Buckets and force
the movement of buckets to transformed sizes, whenever we encounter a
situation where an allocation cant be made for a BucketSize, we will
forcefully free the entire buckets that have least occupancy ratio. This
is the same strategy used by MemCached when they encounter a similar
issue going by the name 'Slab Calcification'. Only improvement is that
we use a heuristic to evict from the buckets that are least occupied
and also avoid the BucketSizes where there is a single Bucket

Change-Id: I9e3b4deb8d893953003ddf5f1e66312ed97ea9cb

Signed-off-by: Ramkrishna <ramkrishna.s.vasudevan@intel.com>
2017-03-01 10:37:22 +05:30
tedyu
7d38e6126a HBASE-17673 Monitored RPC Handler not shown in the WebUI (Allan Yang) 2017-02-28 07:44:35 -08:00
Jingcheng Du
2131c79552 HBASE-17688 MultiRowRangeFilter not working correctly if given same start and stop RowKey 2017-02-28 12:15:38 +08:00
Jan Hentschel
ec84118c97 HBASE-17634 Cleaned up the usage of Result.isPartial
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-02-27 20:45:58 +08:00
tedyu
8528e82875 HBASE-17674 Major compaction may be cancelled in CompactionChecker (Guangxu Cheng) 2017-02-25 16:33:34 -08:00
Ashu Pachauri
4b8195f22c HBASE-17057 Minor compactions should also drop page cache (Ashu Pachauri)
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-02-24 15:31:36 -08:00
Abhishek Singh Chouhan
b0780bdc63 HBASE-17682 Region stuck in merging_new state indefinitely
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-23 15:19:13 -08:00
zhangduo
3e2a6784c7 HBASE-17595 Add partial result support for small/limited scan 2017-02-23 16:10:10 +08:00
Sean Busbey
7917314477 HBASE-17677 Just the new tests from 'ServerName parsing from directory name should be more robust to errors.'
Signed-off-by: Michael Stack <stack@apache.org>
2017-02-22 21:23:11 -06:00
Ashu Pachauri
a373445730 HBASE-17590 Drop cache hint should work on store file write path (Ashu Pachauri)
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-02-22 13:37:12 -08:00
Sean Busbey
a404bfa0c2 HBASE-17561 table status page should escape values that may contain arbitrary characters.
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-02-21 23:22:55 -06:00
Joao Girao
e7efa23d07 HBASE-13718 added columns schema to table description in web view
Summary:
 * added a new table "Table Schema" on the table description page
 * per column, list all the key/values on the column description

Test Plan:
 * mvn test # and wait..
 * create a new table using hbase shell:
   * create 'mytesttable', {NAME=>'CF1'}, {NAME=>'CF2'}
 * open http://localhost:16010/table.jsp?name=mytesttable
 * check the "Table Schema" appears and lists the columns correctly

Reviewers: eclark, vicka.dudin

Differential Revision: https://reviews.facebook.net/D38649

Signed-off-by: Elliott Clark <eclark@apache.org>
2017-02-21 23:22:55 -06:00
Phil Yang
f5ae21ea32 HBASE-17210 Set timeout on trying rowlock according to client's RPC timeout 2017-02-22 11:43:47 +08:00
rgidwani
27a8aa99d9 HBASE-17675 ReplicationEndpoint should choose new sinks if a SaslException occurs
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-21 18:45:15 -08:00
Sean Busbey
cdb38830d7 HBASE-15328 sanity check the redirect used to send master info requests to the embedded regionserver.
Signed-off-by: Esteban Gutierrez <esteban@apache.org>
2017-02-21 09:05:31 -06:00
huzheng
45357c078d HBASE-17472: Correct the semantic of permission grant
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-02-20 20:24:09 +08:00
ChiaPing Tsai
964e17f7b0 HBASE-17661 fix the queue length passed to FastPathBalancedQueueRpcExecutor
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-19 13:26:24 -08:00
Tim Brown
6b96b0ce85 HBASE-17658 Fix bookkeeping error with max regions for a table
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-17 07:42:21 -08:00
Yi Liang
b141603e2e HBASE-17648: HBase Table-level synchronization fails between two secured(kerberized) cluster
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-17 07:04:35 -08:00
Abhishek Singh Chouhan
4038917239 HBASE-17069 RegionServer writes invalid META entries for split daughters in some circumstances
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-02-16 15:36:33 +08:00
zhangduo
f835d1efc2 HBASE-17583 Add inclusive/exclusive support for startRow and endRow of scan for sync client 2017-02-15 10:18:58 +08:00
Phil Yang
0a25bf5b3f HBASE-17639 Do not stop server if ReplicationSourceManager's waitUntilCanBePushed throws InterruptedException 2017-02-14 17:48:49 +08:00
Sean Busbey
d7c304573f HBASE-17558 ZK dumping jsp should escape HTML.
Signed-off-by: Enis Soztutar <enis@apache.org>
2017-02-13 23:49:12 -05:00
rgidwani
4588bdee9f HBASE-17609 Allow for region merging in the UI
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-09 14:06:48 -08:00
tedyu
52c51fc271 HBASE-17265 Region left unassigned in master failover when region failed to open (Allan Yang) 2017-02-09 12:43:37 -08:00
Ajay Jadhav
67fe516ec9 HBASE-17280 Add mechanism to control hbase cleaner behavior
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-02-09 12:18:42 -08:00
zhangduo
e9abe07629 HBASE-17599 Use mayHaveMoreCellsInRow instead of isPartial 2017-02-09 15:38:23 +08:00
Jerry He
f61b840a31 HBASE-15437 Response size calculated in RPCServer for warning tooLarge responses does NOT count CellScanner payload 2017-02-08 17:21:56 -08:00
Zach York
8f6388503b HBASE-17437 Support specifying a WAL directory outside of the root directory (Yishan Yang and Zach York)
HBASE-17588 Remove unused imports brought in by HBASE-17437 (Zach York)

Signed-off-by: Enis Soztutar <enis@apache.org>
2017-02-08 15:01:59 -08:00
Enis Soztutar
753169a3af HBASE-17105 Annotate RegionServerObserver 2017-02-08 13:35:29 -08:00
huzheng
8574934f59 HBASE-17381 ReplicationSourceWorkerThread can die due to unhandled exceptions (huzheng)
Signed-off-by: Gary Helmling <garyh@apache.org>
2017-02-07 17:33:42 -08:00
tedyu
a75e5a5435 HBASE-17275 Assign timeout may cause region to be unassigned forever (Allan yang) 2017-02-07 12:57:07 -08:00
tedyu
0553290c6a HBASE-17565 StochasticLoadBalancer may incorrectly skip balancing due to skewed multiplier sum - addendum resets min cost 2017-02-07 12:24:54 -08:00
tedyu
5a0020e867 HBASE-17565 StochasticLoadBalancer may incorrectly skip balancing due to skewed multiplier sum 2017-02-07 06:26:12 -08:00
tedyu
0a0aef345a HBASE-17264 Processing RIT with offline state will always fail to open the first time (Allan Yang) 2017-02-06 19:48:14 -08:00
zhangduo
f708d986a0 HBASE-17597 TestMetaWithReplicas.testMetaTableReplicaAssignment is flaky 2017-02-07 09:51:46 +08:00
Enis Soztutar
7cac85b667 HBASE-17187 DoNotRetryExceptions from coprocessors should bubble up to the application 2017-02-06 13:39:09 -08:00
tedyu
35e4eb7a7a HBASE-17601 close() in TableRecordReaderImpl assumes the split has started (Michael Axiak) 2017-02-06 10:33:05 -08:00
zhangduo
4456d22859 HBASE-17508 Unify the implementation of small scan and regular scan for sync client 2017-02-05 08:49:51 +08:00
Zach York
cd847e599c HBASE-17587 Do not Rethrow DoNotRetryIOException as UnknownScannerException
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2017-02-02 17:09:34 -08:00
tedyu
f59cf6f02e HBASE-16621 HBCK should have -fixHFileLinks (Janos Gub) 2017-02-02 07:31:35 -08:00
Sean Busbey
fab0b2e603 Addendum HBASE-17522 missed some branch-1 specific direct uses of MemoryMXBean 2017-02-01 11:32:13 -06:00
Sean Busbey
3d4639f34d HBASE-17522 Handle JVM throwing runtime exceptions when we ask for details on heap usage the same as a correctly returned 'undefined'.
Signed-off-by: Michael Stack <stack@apache.org>

 Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/io/util/HeapMemorySizeUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/io/hfile/CacheConfig.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/io/hfile/TestCacheConfig.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestDefaultMemStore.java
2017-02-01 10:38:29 -06:00