77eaff0e10
HBASE-20564 Tighter ByteBufferKeyValue Cell Comparator; ADDENDUM
...
Add method the CellComparator Interface. Add implementation to
meta comparator so we don't fall back to the default comparator.
Includes a nothing change to hbase-server/pom.xml just to provoke
build.
2018-05-16 09:42:51 -07:00
5c4685e56e
HBASE-20520 Failed effort upping default HDFS blocksize, hbase.regionserver.hlog.blocksize
2018-05-16 09:18:06 -07:00
82e3011166
HBASE-20585 Need to clear peer map when clearing MasterProcedureScheduler
2018-05-16 08:46:34 +08:00
60b8344cf1
HBASE-20457 Return immediately for a scan rpc call when we want to switch from pread to stream
2018-05-15 21:09:04 +08:00
b7def9b690
HBASE-20447 Only fail cacheBlock if block collisions aren't related to next block metadata
...
When we pread, we don't force the read to read all of the next block header.
However, when we get into a race condition where two opener threads try to
cache the same block and one thread read all of the next block header and
the other one didn't, it will fail the open process. This is especially important
in a splitting case where it will potentially fail the split process.
Instead, in the caches, we should only fail if the required blocks are different.
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2018-05-14 16:09:14 -07:00
4baac1a782
HBASE-20544 ADDENDUM Make HBTU default to random ports.
...
Signed-off-by: Mike Drob <mdrob@apache.org>
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
2018-05-14 12:52:30 -05:00
a739f80893
HBASE-20564 Tighter ByteBufferKeyValue Cell Comparator
...
Make a purposed comparator for the new ByteBufferKeyValue
base type. Cache deserialized sizes rather than recalc each time.
2018-05-14 15:18:00 +01:00
4b0ac73f51
HBASE-20560 Revisit the TestReplicationDroppedTables ut
2018-05-14 19:33:51 +08:00
be3df29cef
HBASE-20128 Add new UTs which extends the old replication UTs but set replication scope to SERIAL
2018-05-14 19:32:39 +08:00
aa8ceb8167
HBASE-16191 Add stop_regionserver and stop_master to shell
...
Amending-Author: Peter Somogyi <psomogyi@apache.org>
2018-05-14 09:38:22 +02:00
5ac7740896
HBASE-20411 Ameliorate MutableSegment synchronize
...
Change the MemStore size accounting so we don't synchronize across three
volatiles applying deltas. Instead:
+ Make MemStoreSize, a datastructure of our memstore size longs, immutable.
+ Undo MemStoreSizing being an instance of MemStoreSize; instead it has-a.
+ Make two MemStoreSizing implementations; one thread-safe, the other not.
+ Let all memory sizing longs run independent, untied by
synchronize (Huaxiang and Anoop suggestion) using atomiclongs.
+ Review all use of MemStoreSizing. Many are single-threaded and do
not need to be synchronized; use the non-thread safe counter.
TODO: Use this technique accounting at the global level too.
2018-05-12 02:16:19 +01:00
1f10ef553e
HBASE-20545 Improve performance of BaseLoadBalancer.retainAssignment
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-10 10:45:17 -07:00
32b114e86b
HBASE-20004 Client is not able to execute REST queries in a secure cluster
...
Signed-off-by: Ashish Singhi <ashishsinghi@apache.org>
2018-05-10 22:47:44 +05:30
61f96b6ffa
HBASE-20544 Make HBTU default to random ports.
...
Signed-off-by: Umesh Agashe <uagashe@cloudera.com>
Signed-off-by: Josh Elser <elserj@apache.org>
Conflicts:
hbase-backup/src/test/resources/hbase-site.xml
hbase-spark-it/src/test/resources/hbase-site.xml
hbase-spark/src/test/resources/hbase-site.xml
2018-05-09 23:45:39 -07:00
c430016cf9
HBASE-20554 "WALs outstanding" message from CleanerChore is noisy
2018-05-09 19:11:50 -07:00
cba8d2fb8d
HBASE-20204 Add locking to RefreshFileConnections in BucketCache
...
This is a follow-up to HBASE-20141 where Anoop suggested adding locking
for refreshing channels.
2018-05-09 14:23:27 -07:00
de25f8b209
HBASE-20539 Disable IMC; part 2
...
Set default for in-memory compaction to NONE. PE was using
this value creating its table. Add test to ensure expected
default.
2018-05-09 06:29:56 -07:00
55badefa38
HBASE-20485 Copy constructor of Scan doesn't copy the readType and replicaId
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-05-09 16:45:39 +08:00
421ed6ca51
HBASE-20521 change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests
2018-05-08 22:18:48 -05:00
d91908b0d4
Revert "change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests"
...
This reverts commit 9e68719014
2018-05-08 22:18:42 -05:00
8d60a89c34
HBASE-20543 Fix the flaky TestThriftHttpServer
2018-05-09 10:41:08 +08:00
75a8e53ce8
HBASE-20500 [rsgroup] should keep at least one server in default group
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-05-08 08:35:17 -07:00
9e68719014
change getConf as first sequence instead of jobContext in TableOutputFormat.checkOutputSpec, add unit tests
2018-05-08 10:25:56 -05:00
6f2ec4639b
HBASE-20505 PE should support multi column family read and write cases
2018-05-07 18:39:10 -07:00
d6d209564c
HBASE-20536 Make TestRegionServerAccounting stable and it should not use absolute number
2018-05-08 08:21:30 +08:00
fd0840c3e4
HBASE-20538 TestSaslFanOutOneBlockAsyncDFSOutput failing: UnrecoverableKeyException: Rejected by the jceks.key.serialFilter or jdk.serialFilter property
...
Disable test TestSaslFanOutOneBlockAsyncDFSOutput for the moment.
Depends on HDFS-13494
2018-05-07 09:54:07 -07:00
db67906cd0
HBASE-20523 PE tool should support configuring client side buffering sizes
...
(Ram)
2018-05-07 12:50:24 +05:30
2373451f94
HBASE-20527 Remove unused code in MetaTableAccessor
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-05-05 22:20:24 +08:00
991d78ca2b
HBASE-20513 Collect and emit ScanMetrics in PerformanceEvaluation
2018-05-04 17:59:20 -07:00
7df8e5e4a7
HBASE-20517 Fix PerformanceEvaluation 'column' parameter
2018-05-04 17:24:21 -07:00
de71cb5915
HBASE-20481 Replicate entries from same region serially in ReplicationEndpoint for serial replication
2018-05-04 15:52:43 +08:00
5f260451d5
HBASE-20378 Provide a hbck option to cleanup replication barrier for a table
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-05-04 15:20:17 +08:00
eaafdff761
HBASE-20524 Need to clear metrics when ReplicationSourceManager refresh replication sources
2018-05-04 14:34:07 +08:00
e92580e201
HBASE-20507 Do not need to call recoverLease on the broken file when we fail to create a wal writer
2018-05-03 12:26:54 -07:00
f89c5b08df
HBASE-20414 TestLockProcedure#testMultipleLocks may fail on slow machine
2018-05-03 07:12:11 -07:00
984fb5bd05
HBASE-20169 NPE when calling HBTU.shutdownMiniCluster (TestAssignmentManagerMetrics is flakey); AMENDMENT
2018-05-02 16:14:38 -07:00
b0719ec11b
HBASE-20514 On Master restart if table is stuck in DISABLING state, CLOSED regions should not be considered stuck in-transition
...
On startup CLOSED regions of DISABLED and DISABLING tables are treated the same way as not in-transition.
2018-05-02 12:18:04 -07:00
b43cde2ce1
HBASE-20507 Do not need to call recoverLease on the broken file when we fail to create a wal writer
2018-05-02 10:27:00 +08:00
7c41827559
HBASE-20506 Add doc and test for unused RetryCounter, useful-looking utility
2018-05-01 07:00:51 -07:00
da3e06afab
HBASE-20492 UnassignProcedure is stuck in retry loop on region stuck in OPENING state
...
Add backoff when stuck in RegionTransitionProcedure, the subclass of
AssignProcedure and UnassignProcedure. Can happen when we go to
transition but the current Region state is not what we expect.
M hbase-procedure/src/main/java/org/apache/hadoop/hbase/procedure2/Procedure.java
Add doc on being able to suspend and wait on a timeout.
M hbase-protocol-shaded/src/main/protobuf/MasterProcedure.proto
Add 'attempt' counter so we can do backoff when we get stuck.
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignProcedure.java
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/UnassignProcedure.java
Add persistence of new 'attempt' counter
M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/RegionTransitionProcedure.java
Doc data members that are persisted by subclasses given this is 'odd'.
Add a counter for 'attempts' used when 'stuck' to implement backoff.
Add suspend with timeout when 'stuck'. Add callback when timeout is
exhausted which does wakeup of this procedure.
A hbase-server/src/test/java/org/apache/hadoop/hbase/master/assignment/TestUnexpectedStateException.java
Test of backoff.
2018-04-30 17:58:27 -07:00
d38a104c4d
HBASE-20497 The getRecoveredQueueStartPos always return 0 in RecoveredReplicationSourceShipper
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-04-28 20:50:47 +08:00
72093178fb
HBASE-20475 Fix the flaky TestReplicationDroppedTables unit test.
...
Signed-off-by: zhangduo <zhangduo@apache.org>
2018-04-28 18:46:41 +08:00
e8603e1d7c
HBASE-20476 Open sequence number could go backwards in AssignProcedure
2018-04-28 16:55:06 +08:00
ce08826f0d
HBASE-20327 When qualifier is not specified, append and incr operation do not work (shell)
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-04-28 12:47:45 +08:00
31e3ef6792
HBASE-20489 Updated Reference Guide that CLUSTER_KEY value is present on the Master UI info page.
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-26 06:46:17 -05:00
20e2ac132e
HBASE-20040 Fixed: Master UI should include "Cluster Key" needed to use the cluster as a replication sink
...
Signed-off-by: Sean Busbey <busbey@apache.org>
2018-04-26 06:46:07 -05:00
3fc2c3bf34
HBASE-20484 Remove the unnecessary autoboxing in FilterListBase
...
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2018-04-26 16:32:14 +08:00
101055e343
HBASE-20270 Turned off command help that follows all errors in shell
...
Signed-off-by: Sean Busbey <busbey@apache.org>
(cherry picked from commit 152104ae1ba559c580ffaa083209fd2cfee1050b)
2018-04-25 15:37:32 -05:00
84afd69c63
HBASE-18842 Fix unknown namespace message in clone_snapshot
...
Signed-off-by: Jesse Yates <jyates@apache.org>
(cherry picked from commit 0ff4f5fba9
2018-04-25 11:52:48 -05:00
75004408b0
HBASE-20466 Consistently use override mechanism for exempt classes in CoprocessorClassloader
...
Signed-off-by: tedyu <yuzhihong@gmail.com>
2018-04-23 07:48:13 -07:00
Michael Stack
zhangduo
Zach York
Sean Busbey
huzheng
Enis Soztutar
Thiruvel Thirumoolan
Ashish Singhi
Andrew Purtell
Nihal Jain
Mike Drob
Yechao Chen
michael.jin
Guanghao Zhang
Vasudevan
Mingdao Yang
jingyuntian
Guanghao Zhang
tedyu
Chia-Ping Tsai
Umesh Agashe
Sakthi
Guangxu Cheng
Thoralf Gutierrez
Rich Fecher