Apache/hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
15,407 Commits 95 Branches 866 Tags
Commit Graph

15407 Commits

This Branch
This Branch
All Branches
Author SHA1 Message Date
Vladimir Rodionov
6d656b7e71 HBASE-20547 Restore from backup will fail if done from a different file system 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-05-16 09:55:19 -07:00
Michael Stack
438af9bf74
HBASE-20564 Tighter ByteBufferKeyValue Cell Comparator; ADDENDUM 
Add method the CellComparator Interface. Add implementation to
meta comparator so we don't fall back to the default comparator.

Includes a nothing change to hbase-server/pom.xml just to provoke
build.
 2018-05-16 09:43:16 -07:00
Michael Stack
060b8aca86
HBASE-20520 Failed effort upping default HDFS blocksize, hbase.regionserver.hlog.blocksize 2018-05-16 09:19:24 -07:00
zhangduo
ab53329cb3 HBASE-20585 Need to clear peer map when clearing MasterProcedureScheduler 2018-05-16 08:46:29 +08:00
zhangduo
26babcf013 HBASE-20457 Return immediately for a scan rpc call when we want to switch from pread to stream 2018-05-15 20:56:20 +08:00
Zach York
d2daada970 HBASE-20447 Only fail cacheBlock if block collisions aren't related to next block metadata 
When we pread, we don't force the read to read all of the next block header.
However, when we get into a race condition where two opener threads try to
cache the same block and one thread read all of the next block header and
the other one didn't, it will fail the open process. This is especially important
in a splitting case where it will potentially fail the split process.
Instead, in the caches, we should only fail if the required blocks are different.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2018-05-14 17:16:54 -07:00
Sean Busbey
92a58016ae HBASE-20544 ADDENDUM Make HBTU default to random ports. 
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
 2018-05-14 10:49:08 -05:00
Michael Stack
db04a9f9d9 HBASE-20564 Tighter ByteBufferKeyValue Cell Comparator 
Make a purposed comparator for the new ByteBufferKeyValue
base type. Cache deserialized sizes rather than recalc each time.
 2018-05-14 15:18:26 +01:00
huzheng
eabe672ebd HBASE-20560 Revisit the TestReplicationDroppedTables ut 2018-05-14 19:12:43 +08:00
Enis Soztutar
91756d7f79 HBASE-16191 Add stop_regionserver and stop_master to shell 
Amending-Author: Peter Somogyi <psomogyi@apache.org>
 2018-05-14 09:36:20 +02:00
Nihal Jain
d1cc92599a HBASE-20566 Creating a system table after enabling rsgroup feature puts region into RIT 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-05-13 10:29:43 -07:00
Michael Stack
021f66d11d
HBASE-20411 Ameliorate MutableSegment synchronize 
Change the MemStore size accounting so we don't synchronize across three
volatiles applying deltas. Instead:

 + Make MemStoreSize, a datastructure of our memstore size longs, immutable.
 + Undo MemStoreSizing being an instance of MemStoreSize; instead it has-a.
 + Make two MemStoreSizing implementations; one thread-safe, the other not.
 + Let all memory sizing longs run independent, untied by
   synchronize (Huaxiang and Anoop suggestion) using atomiclongs.
 + Review all use of MemStoreSizing. Many are single-threaded and do
   not need to be synchronized; use the non-thread safe counter.

TODO: Use this technique accounting at the global level too.
 2018-05-12 02:17:50 +01:00
Ashish Singhi
c60578d982 HBASE-20004 Client is not able to execute REST queries in a secure cluster 
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
 2018-05-10 22:39:43 +05:30
Sean Busbey
8ba2a7eeb9 HBASE-20544 Make HBTU default to random ports. 
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Josh Elser <elserj@apache.org>
 2018-05-09 23:35:20 -07:00
Thiruvel Thirumoolan
a67909d3d6 HBASE-20545 Improve performance of BaseLoadBalancer.retainAssignment 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-05-09 19:48:27 -07:00
Andrew Purtell
32dd633b98 HBASE-20554 "WALs outstanding" message from CleanerChore is noisy 2018-05-09 19:08:35 -07:00
Zach York
9c046c091c HBASE-20204 Add locking to RefreshFileConnections in BucketCache 
This is a follow-up to HBASE-20141 where Anoop suggested adding locking
for refreshing channels.
 2018-05-09 14:01:51 -07:00
Michael Stack
4f2dfd3877 HBASE-20539 Disable IMC; part 2 
Set default for in-memory compaction to NONE. PE was using
this value creating its table. Add test to ensure expected
default.
 2018-05-09 06:30:28 -07:00
Nihal Jain
f8281aa208 HBASE-20485 Copy constructor of Scan doesn't copy the readType and replicaId 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-05-09 16:39:57 +08:00
Mike Drob
c51e9adc78 HBASE-20521 change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests 2018-05-08 22:20:12 -05:00
Mike Drob
82e6fae1de Revert "change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests" 
This reverts commit b748ea3b0d3a074b976fa0ae59fc591303e805a0.
 2018-05-08 22:20:06 -05:00
huzheng
0dcae90eaa HBASE-20543 Fix the flaky TestThriftHttpServer 2018-05-09 10:50:09 +08:00
huzheng
dda8018b0f Revert "Fix the flaky TestThriftHttpServer" 
This reverts commit 4f7aa3b71d2ebfa57f890c5ebaaf166fb7128597.
 2018-05-09 10:44:35 +08:00
huzheng
4f7aa3b71d Fix the flaky TestThriftHttpServer 2018-05-09 09:50:59 +08:00
michael.jin
b748ea3b0d change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests 2018-05-08 10:24:03 -05:00
Yechao Chen
102f0bf9c5 HBASE-20500 [rsgroup] should keep at least one server in default group 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-05-08 07:59:01 -07:00
Andrew Purtell
1825af45b3 HBASE-20505 PE should support multi column family read and write cases 2018-05-07 18:39:02 -07:00
Guanghao Zhang
3a2a76f6f8 HBASE-20536 Make TestRegionServerAccounting stable and it should not use absolute number 2018-05-08 08:20:48 +08:00
Michael Stack
992a5e8e49 HBASE-20537 The download link is not available in the downloads webpage 2018-05-07 10:02:09 -07:00
Michael Stack
bb1a935636 HBASE-20538 TestSaslFanOutOneBlockAsyncDFSOutput failing: UnrecoverableKeyException: Rejected by the jceks.key.serialFilter or jdk.serialFilter property 
Disable test TestSaslFanOutOneBlockAsyncDFSOutput for the moment.
Depends on HDFS-13494
 2018-05-07 09:54:32 -07:00
Vasudevan
8e6ff689e8 HBASE-20523 PE tool should support configuring client side buffering sizes 
(Ram)
 2018-05-07 12:57:20 +05:30
maoling
5e14e125b2 HBASE-20508 TestIncrementalBackupWithBulkLoad doesn't need to be Parameterized test 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-05-07 09:36:44 +08:00
huzheng
971f5350e8 HBASE-20531 RS may throw NPE when close meta regions in shutdown procedure. 2018-05-06 11:18:23 +08:00
Mingdao Yang
acd0d1e446 HBASE-20527 Remove unused code in MetaTableAccessor 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-05-05 22:15:54 +08:00
Andrew Purtell
291dedbf81 HBASE-20513 Collect and emit ScanMetrics in PerformanceEvaluation 2018-05-04 17:59:12 -07:00
Andrew Purtell
78ffd7ace6 HBASE-20517 Fix PerformanceEvaluation 'column' parameter 2018-05-04 17:24:17 -07:00
jingyuntian
87f5b5f341 HBASE-20378 Provide a hbck option to cleanup replication barrier for a table 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-05-04 15:27:33 +08:00
huzheng
6225b4a492 HBASE-20481 Replicate entries from same region serially in ReplicationEndpoint for serial replication 2018-05-04 15:22:02 +08:00
Guanghao Zhang
9b9f851470 HBASE-20524 Need to clear metrics when ReplicationSourceManager refresh replication sources 2018-05-04 14:31:41 +08:00
Michael Stack
09ca619389
HBASE-20507 Do not need to call recoverLease on the broken file when we fail to create a wal writer 2018-05-03 12:30:13 -07:00
Chia-Ping Tsai
4cb444e77b
HBASE-20169 NPE when calling HBTU.shutdownMiniCluster (TestAssignmentManagerMetrics is flakey); AMENDMENT 2018-05-02 16:14:58 -07:00
Umesh Agashe
c4b4023b60 HBASE-20514 On Master restart if table is stuck in DISABLING state, CLOSED regions should not be considered stuck in-transition 
On startup CLOSED regions of DISABLED and DISABLING tables are treated the same way as not in-transition.
 2018-05-02 12:18:24 -07:00
tedyu
2e9b96e4f1 HBASE-20414 TestLockProcedure#testMultipleLocks may fail on slow machine 2018-05-02 06:39:51 -07:00
zhangduo
5bdb52af2f HBASE-20507 Do not need to call recoverLease on the broken file when we fail to create a wal writer 2018-05-02 10:26:55 +08:00
Sean Busbey
b1d6f576aa HBASE-15317 document release announcement template 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-05-01 11:28:06 -05:00
Michael Stack
7790ab156e HBASE-20506 Add doc and test for unused RetryCounter, useful-looking utility 2018-05-01 07:01:16 -07:00
Michael Stack
5a071dbe2b HBASE-20492 UnassignProcedure is stuck in retry loop on region stuck in OPENING state 
Add backoff when stuck in RegionTransitionProcedure, the subclass of
AssignProcedure and UnassignProcedure. Can happen when we go to
transition but the current Region state is not what we expect.

M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/Procedure.java
 Add doc on being able to suspend and wait on a timeout.

M hbase-protocol-shaded/src/main/protobuf/MasterProcedure.proto
 Add 'attempt' counter so we can do backoff when we get stuck.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignProcedure.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/UnassignProcedure.java
 Add persistence of new 'attempt' counter

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionTransitionProcedure.java
 Doc data members that are persisted by subclasses given this is 'odd'.
 Add a counter for 'attempts' used when 'stuck' to implement backoff.
 Add suspend with timeout when 'stuck'. Add callback when timeout is
 exhausted which does wakeup of this procedure.

A hbase-server/src/test/java/org/apache/hadoop/hbase/master/assignment/TestUnexpectedStateException.java
 Test of backoff.
 2018-04-30 20:40:22 -07:00
Michael Stack
7ea7c7bd34 HBASE-20510 Add a downloads page to hbase.apache.org to tie mirrored artifacts to their hash and signature 2018-04-30 16:52:23 -07:00
Nihal Jain
6d080762ef HBASE-20499 Replication/Priority executors can use specific max queue length as default value instead of general maxQueueLength 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2018-04-30 07:42:32 -07:00
huzheng
a136303833 HBASE-20497 The getRecoveredQueueStartPos always return 0 in RecoveredReplicationSourceShipper 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-04-28 20:50:30 +08:00