Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
15,147 Commits 95 Branches 866 Tags
Commit Graph

15147 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
zhangduo
60b8344cf1 HBASE-20457 Return immediately for a scan rpc call when we want to switch from pread to stream 2018-05-15 21:09:04 +08:00
Zach York
b7def9b690 HBASE-20447 Only fail cacheBlock if block collisions aren't related to next block metadata 
When we pread, we don't force the read to read all of the next block header.
However, when we get into a race condition where two opener threads try to
cache the same block and one thread read all of the next block header and
the other one didn't, it will fail the open process. This is especially important
in a splitting case where it will potentially fail the split process.
Instead, in the caches, we should only fail if the required blocks are different.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-05-14 16:09:14 -07:00
Sean Busbey
4baac1a782 HBASE-20544 ADDENDUM Make HBTU default to random ports. 
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
 2018-05-14 12:52:30 -05:00
Michael Stack
a739f80893 HBASE-20564 Tighter ByteBufferKeyValue Cell Comparator 
Make a purposed comparator for the new ByteBufferKeyValue
base type. Cache deserialized sizes rather than recalc each time.
 2018-05-14 15:18:00 +01:00
huzheng
4b0ac73f51 HBASE-20560 Revisit the TestReplicationDroppedTables ut 2018-05-14 19:33:51 +08:00
huzheng
be3df29cef HBASE-20128 Add new UTs which extends the old replication UTs but set replication scope to SERIAL 2018-05-14 19:32:39 +08:00
Enis Soztutar
aa8ceb8167 HBASE-16191 Add stop_regionserver and stop_master to shell 
Amending-Author: Peter Somogyi <psomogyi@apache.org>
 2018-05-14 09:38:22 +02:00
Michael Stack
5ac7740896
HBASE-20411 Ameliorate MutableSegment synchronize 
Change the MemStore size accounting so we don't synchronize across three
volatiles applying deltas. Instead:

 + Make MemStoreSize, a datastructure of our memstore size longs, immutable.
 + Undo MemStoreSizing being an instance of MemStoreSize; instead it has-a.
 + Make two MemStoreSizing implementations; one thread-safe, the other not.
 + Let all memory sizing longs run independent, untied by
   synchronize (Huaxiang and Anoop suggestion) using atomiclongs.
 + Review all use of MemStoreSizing. Many are single-threaded and do
   not need to be synchronized; use the non-thread safe counter.

TODO: Use this technique accounting at the global level too.
 2018-05-12 02:16:19 +01:00
Thiruvel Thirumoolan
1f10ef553e HBASE-20545 Improve performance of BaseLoadBalancer.retainAssignment 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-05-10 10:45:17 -07:00
Ashish Singhi
32b114e86b HBASE-20004 Client is not able to execute REST queries in a secure cluster 
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
 2018-05-10 22:47:44 +05:30
Sean Busbey
61f96b6ffa HBASE-20544 Make HBTU default to random ports. 
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Josh Elser <elserj@apache.org>

 Conflicts:
	hbase-backup/src/test/resources/hbase-site.xml
	hbase-spark-it/src/test/resources/hbase-site.xml
	hbase-spark/src/test/resources/hbase-site.xml
 2018-05-09 23:45:39 -07:00
Andrew Purtell
c430016cf9 HBASE-20554 "WALs outstanding" message from CleanerChore is noisy 2018-05-09 19:11:50 -07:00
Zach York
cba8d2fb8d HBASE-20204 Add locking to RefreshFileConnections in BucketCache 
This is a follow-up to HBASE-20141 where Anoop suggested adding locking
for refreshing channels.
 2018-05-09 14:23:27 -07:00
Michael Stack
de25f8b209 HBASE-20539 Disable IMC; part 2 
Set default for in-memory compaction to NONE. PE was using
this value creating its table. Add test to ensure expected
default.
 2018-05-09 06:29:56 -07:00
Nihal Jain
55badefa38 HBASE-20485 Copy constructor of Scan doesn't copy the readType and replicaId 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-05-09 16:45:39 +08:00
Mike Drob
421ed6ca51 HBASE-20521 change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests 2018-05-08 22:18:48 -05:00
Mike Drob
d91908b0d4 Revert "change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests" 
This reverts commit 9e68719014a62f37e7559329e44e2df49738ef6c.
 2018-05-08 22:18:42 -05:00
huzheng
8d60a89c34 HBASE-20543 Fix the flaky TestThriftHttpServer 2018-05-09 10:41:08 +08:00
Yechao Chen
75a8e53ce8 HBASE-20500 [rsgroup] should keep at least one server in default group 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-05-08 08:35:17 -07:00
michael.jin
9e68719014 change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests 2018-05-08 10:25:56 -05:00
Andrew Purtell
6f2ec4639b HBASE-20505 PE should support multi column family read and write cases 2018-05-07 18:39:10 -07:00
Guanghao Zhang
d6d209564c HBASE-20536 Make TestRegionServerAccounting stable and it should not use absolute number 2018-05-08 08:21:30 +08:00
Michael Stack
fd0840c3e4 HBASE-20538 TestSaslFanOutOneBlockAsyncDFSOutput failing: UnrecoverableKeyException: Rejected by the jceks.key.serialFilter or jdk.serialFilter property 
Disable test TestSaslFanOutOneBlockAsyncDFSOutput for the moment.
Depends on HDFS-13494
 2018-05-07 09:54:07 -07:00
Vasudevan
db67906cd0 HBASE-20523 PE tool should support configuring client side buffering sizes 
(Ram)
 2018-05-07 12:50:24 +05:30
Mingdao Yang
2373451f94 HBASE-20527 Remove unused code in MetaTableAccessor 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-05-05 22:20:24 +08:00
Andrew Purtell
991d78ca2b HBASE-20513 Collect and emit ScanMetrics in PerformanceEvaluation 2018-05-04 17:59:20 -07:00
Andrew Purtell
7df8e5e4a7 HBASE-20517 Fix PerformanceEvaluation 'column' parameter 2018-05-04 17:24:21 -07:00
huzheng
de71cb5915 HBASE-20481 Replicate entries from same region serially in ReplicationEndpoint for serial replication 2018-05-04 15:52:43 +08:00
jingyuntian
5f260451d5 HBASE-20378 Provide a hbck option to cleanup replication barrier for a table 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-05-04 15:20:17 +08:00
Guanghao Zhang
eaafdff761 HBASE-20524 Need to clear metrics when ReplicationSourceManager refresh replication sources 2018-05-04 14:34:07 +08:00
Michael Stack
e92580e201 HBASE-20507 Do not need to call recoverLease on the broken file when we fail to create a wal writer 2018-05-03 12:26:54 -07:00
tedyu
f89c5b08df HBASE-20414 TestLockProcedure#testMultipleLocks may fail on slow machine 2018-05-03 07:12:11 -07:00
Chia-Ping Tsai
984fb5bd05
HBASE-20169 NPE when calling HBTU.shutdownMiniCluster (TestAssignmentManagerMetrics is flakey); AMENDMENT 2018-05-02 16:14:38 -07:00
Umesh Agashe
b0719ec11b HBASE-20514 On Master restart if table is stuck in DISABLING state, CLOSED regions should not be considered stuck in-transition 
On startup CLOSED regions of DISABLED and DISABLING tables are treated the same way as not in-transition.
 2018-05-02 12:18:04 -07:00
zhangduo
b43cde2ce1 HBASE-20507 Do not need to call recoverLease on the broken file when we fail to create a wal writer 2018-05-02 10:27:00 +08:00
Michael Stack
7c41827559 HBASE-20506 Add doc and test for unused RetryCounter, useful-looking utility 2018-05-01 07:00:51 -07:00
Michael Stack
da3e06afab HBASE-20492 UnassignProcedure is stuck in retry loop on region stuck in OPENING state 
Add backoff when stuck in RegionTransitionProcedure, the subclass of
AssignProcedure and UnassignProcedure. Can happen when we go to
transition but the current Region state is not what we expect.

M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/Procedure.java
 Add doc on being able to suspend and wait on a timeout.

M hbase-protocol-shaded/src/main/protobuf/MasterProcedure.proto
 Add 'attempt' counter so we can do backoff when we get stuck.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignProcedure.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/UnassignProcedure.java
 Add persistence of new 'attempt' counter

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionTransitionProcedure.java
 Doc data members that are persisted by subclasses given this is 'odd'.
 Add a counter for 'attempts' used when 'stuck' to implement backoff.
 Add suspend with timeout when 'stuck'. Add callback when timeout is
 exhausted which does wakeup of this procedure.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/assignment/TestUnexpectedStateException.java
 Test of backoff.
 2018-04-30 17:58:27 -07:00
huzheng
d38a104c4d HBASE-20497 The getRecoveredQueueStartPos always return 0 in RecoveredReplicationSourceShipper 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-04-28 20:50:47 +08:00
huzheng
72093178fb HBASE-20475 Fix the flaky TestReplicationDroppedTables unit test. 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-04-28 18:46:41 +08:00
zhangduo
e8603e1d7c HBASE-20476 Open sequence number could go backwards in AssignProcedure 2018-04-28 16:55:06 +08:00
Nihal Jain
ce08826f0d HBASE-20327 When qualifier is not specified, append and incr operation do not work (shell) 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-04-28 12:47:45 +08:00
Sakthi
31e3ef6792 HBASE-20489 Updated Reference Guide that CLUSTER_KEY value is present on the Master UI info page. 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-04-26 06:46:17 -05:00
Sakthi
20e2ac132e HBASE-20040 Fixed: Master UI should include "Cluster Key" needed to use the cluster as a replication sink 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-04-26 06:46:07 -05:00
Guangxu Cheng
3fc2c3bf34 HBASE-20484 Remove the unnecessary autoboxing in FilterListBase 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-04-26 16:32:14 +08:00
Sakthi
101055e343 HBASE-20270 Turned off command help that follows all errors in shell 
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 152104ae1ba559c580ffaa083209fd2cfee1050b)
 2018-04-25 15:37:32 -05:00
Thoralf Gutierrez
84afd69c63 HBASE-18842 Fix unknown namespace message in clone_snapshot 
Signed-off-by: Jesse Yates <jyates@apache.org>
(cherry picked from commit 0ff4f5fba9cef8b4dea599357d935b47f6151152)
 2018-04-25 11:52:48 -05:00
Rich Fecher
75004408b0 HBASE-20466 Consistently use override mechanism for exempt classes in CoprocessorClassloader 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-04-23 07:48:13 -07:00
Balazs Meszaros
035515d4c2 HBASE-20427 thrift.jsp displays "Framed transport" incorrectly 
Signed-off-by: Sean Busbey <busbey@apache.org>
 2018-04-23 11:06:31 +02:00
Balazs Meszaros
e93cfb52d0 HBASE-20465 Fix TestEnableRSGroup flaky 2018-04-22 15:39:18 -07:00
Michael Stack
45c087d988 HBASE-20470 [2.0.0RC1] has broken unit tests... 
Fix test that depended upon flush being slow and one family only.
Fix MemStoreSize compare to allow passing alternate implementation
(needed when IMC was no longer default everywhere).
 2018-04-22 15:32:56 -07:00