Commit Graph

14505 Commits

Author SHA1 Message Date
Mike Drob e67a67d444 HBASE-18970 fix hbase shell reading interactive input (Amit Virmani) 2017-12-19 19:56:53 -06:00
Michael Stack 3c78ad5215
HBASE-19558 TestRegionsOnMasterOptions hack so it works reliably 2017-12-19 15:59:02 -08:00
Xiang Li 5e7d16a3ce HBASE-15482 Provide an option to skip calculating block locations for SnapshotInputFormat
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-12-19 15:52:16 -08:00
Yi Liang 70608acf28
HBASE-19556: Remove TestAssignmentManager#testGoodSplit, which no longer make sense 2017-12-19 13:55:05 -08:00
Michael Stack 32f6fd41c2
HBASE-19494 Create simple WALKey filter that can be plugged in on the Replication Sink
Implement new WALEntrySinkFilter (as opposed to WALEntryFilter) and
specify the implmentation (with a no-param constructor) in config
using property hbase.replication.sink.walentrysinkfilter

Signed-off-by: wolfgang hoschek whoscheck@cloudera.com
2017-12-19 13:48:59 -08:00
Jan Hentschel df351e4035 HBASE-19480 Enabled Checkstyle to fail on violations in hbase-annotations 2017-12-19 21:35:54 +01:00
Jan Hentschel ec7bf57390 HBASE-19481 Enabled Checkstyle to fail on violations in hbase-error-prone 2017-12-19 21:11:55 +01:00
Jan Hentschel d50ae03716 HBASE-19537 Removed unnecessary semicolons from hbase-backup 2017-12-19 21:03:07 +01:00
Jan Hentschel dd00081c26 HBASE-19538 Removed unnecessary semicolons in hbase-client 2017-12-19 20:50:18 +01:00
Jan Hentschel 0f8ea39a5b HBASE-19539 Removed unnecessary semicolons in hbase-common 2017-12-19 20:22:05 +01:00
Jan Hentschel f46a6d1637 HBASE-19540 Reduced number of unnecessary semicolons 2017-12-19 20:06:59 +01:00
Peter Somogyi dbe409e2c7 HBASE-19555 TestSplitTransactionOnCluster is flaky
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-12-19 09:25:57 -08:00
Guanghao Zhang 03e79b7994 HBASE-19492 Add EXCLUDE_NAMESPACE and EXCLUDE_TABLECFS support to replication peer config 2017-12-19 16:53:43 +08:00
tedyu 7a7e55b601 HBASE-19532 AssignProcedure#COMPARATOR may produce incorrect sort order 2017-12-18 18:32:24 -08:00
Mike Drob 74beb5a3b9 HBASE-18440 ITs and Actions modify immutable TableDescriptors
Signed-off-by: Guanghao Zhang <zghao@apache.org>
2017-12-19 09:59:07 +08:00
Michael Stack e343b0c3e3
HBASE-19122 Suspect methods on Cell to be deprecated; ADDENDUM2 to fix
more compile error
2017-12-18 16:12:21 -08:00
Michael Stack 6a9b1480c1 HBASE-19122 Suspect methods on Cell to be deprecated; ADDENDUM to fix
compile error
2017-12-18 16:02:54 -08:00
Peter Somogyi abae90787f
HBASE-19549 Change path comparison in CommonFSUtils
Also change makeQualified(FileSystem fs)
to makeQualified(URI defaultUri, Path workingDir)

Signed-off-by: Michael Stack <stack@apache.org>
2017-12-18 15:27:39 -08:00
Michael Stack b4056d267a
HBASE-19122 Suspect methods on Cell to be deprecated 2017-12-18 15:20:44 -08:00
Yun Chi-Shih 9d0c7c6dfb HBASE-19531 Remove needless volatile declaration
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-19 00:34:28 +08:00
QilinCao c8bf03f5fb HBASE-19521 HBase mob compaction needs to check hfile version
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-12-18 08:32:18 -08:00
zhangduo 62b591bdc7 HBASE-19546 TestMasterReplication.testCyclicReplication2 uses wrong assertion 2017-12-18 19:59:14 +08:00
Apekshit Sharma 2a5e5e9e2c HBASE-19526 Update hadoop version to 3.0 GA 2017-12-17 19:10:04 -08:00
Jan Hentschel 26b69dc45b HBASE-19474 Brought down the number of Checkstyle errors in hbase-zookeeper 2017-12-17 14:30:09 +01:00
Jan Hentschel 2a468d5421 HBASE-19477 Moved and aligned documentation in hbase-annotations 2017-12-17 14:16:50 +01:00
Jan Hentschel de6f0fbdaa HBASE-19479 Fixed Checkstyle error in hbase-shell 2017-12-17 14:01:09 +01:00
Jan Hentschel 16a851431c HBASE-19482 Fixed remaining Checkstyle errors in hbase-spark-it and enabled Checkstyle to fail on violations 2017-12-17 13:50:46 +01:00
Chia-Ping Tsai 988ea870ed HBASE-18309 (addendum) fix NPE in LogCleaner 2017-12-17 17:33:09 +08:00
Guanghao Zhang 979767824d HBASE-19522 The complete order may be wrong in AsyncBufferedMutatorImpl 2017-12-16 14:00:59 +08:00
Apekshit Sharma a651ab93e3 HBASE-19530 New regions should always be added with state CLOSED 2017-12-15 21:20:58 -08:00
Andrew Purtell d276c3275e HBASE-19509 RSGroupAdminEndpoint#preCreateTable triggers TableNotFoundException 2017-12-15 17:53:54 -08:00
Peter Somogyi f9f869f60a
HBASE-19497 Fix findbugs and error-prone warnings in hbase-common (branch-2)
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-12-15 16:16:34 -08:00
Peter Somogyi 59529a78f0
HBASE-19498 Fix findbugs and error-prone warnings in hbase-client (branch-2)
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-12-15 15:55:51 -08:00
Michael Stack 20b42d2d70 HBASE-18352 Enable TestMasterOperationsForRegionReplicas#testCreateTableWithMultipleReplicas disabled by Proc-V2 AM in HBASE-14614
Reenables the test. Adds facility to HBaseTestingUtility so
you can pass in ports a restarted cluster should use. This
is needed so retention of region placement, on which this
test depends, can come trigger (this is why it was broke
on AMv2 commit... region placement retention is done
different in AMv2).
2017-12-15 12:47:43 -08:00
Michael Stack 89e2869e22 HBASE-19272 Deal with HBCK tests disabled by HBASE-14614 AMv2 when HBCK
works again...

I removed them
2017-12-15 12:19:49 -08:00
Mike Drob 75f512bd71 HBASE-18838 Fix hadoop3 check-shaded-invariants 2017-12-15 11:19:47 -06:00
Michael Stack 010012cbcb HBASE-18946 Stochastic load balancer assigns replica regions to the same RS
Added new bulk assign createRoundRobinAssignProcedure to complement
the existing createAssignProcedure. The former asks the balancer for
target servers to set into the created AssignProcedures. The latter
sets no target server into AssignProcedure. When no target server
is specified, we make effort at assign-time at trying to deploy the
region to its old location if there was one.

The new round robin assign procedure creator does not do this. Use
the new round robin method on table create or reenabling offline
regions. Use the old assign in ServerCrashProcedure or in
EnableTable so there is a chance we retain locality.

Bulk preassigning passing all to-be-assigned to the balancer in one
go is good for ensuring good distribution especially when read
replicas in the mix.

The old assign was single-assign scoped so region replicas could
end up on the same server.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignProcedure.java
 Cleanup around forceNewPlan. Was confusing.
 Added a Comparator to sort AssignProcedures so meta and system tables
 come ahead of user-space tables.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
 Remove the forceNewPlan argument on createAssignProcedure. Didn't make
 sense given we were creating a new AssignProcedure; the arg had no
 effect.

 (createRoundRobinAssignProcedures) Recast to feed all regions to the balancer in
 bulk and to sort the return so meta and system tables take precedence.

Miscellaneous fixes including keeping the Master around until all
RegionServers are down, documentation on how assignment retention
works, etc.
2017-12-15 08:53:41 -08:00
Michael Stack 11e82de8a1 HBASE-15536 Make AsyncFSWAL as our default WAL
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-12-15 20:45:29 +08:00
anoopsamjohn 018a65b947 HBASE-19505 Disable ByteBufferPool by default at HM. 2017-12-15 15:43:10 +05:30
tedyu deba43b156 HBASE-19516 IntegrationTestBulkLoad and IntegrationTestImportTsv run into 'java.lang.RuntimeException: DistributedHBaseCluster@1bb564e2 not an instance of MiniHBaseCluster' (Ankit) 2017-12-14 18:37:09 -08:00
zhangduo 661491b56b HBASE-19513 Fix the wrapped AsyncFSOutput implementation 2017-12-15 09:39:36 +08:00
Michael Stack 6ab8ce9829
Revert "HBASE-18352 Enable TestMasterOperationsForRegionReplicas#testCreateTableWithMultipleReplicas"
Pushed prematurely

This reverts commit 1a173f820b.
2017-12-14 14:17:20 -08:00
Chia-Ping Tsai 70f02dbc7c
HBASE-19462 Deprecate all addImmutable methods in Put
Signed-off-by: Michael Stack <stack@apache.org>
2017-12-14 14:15:54 -08:00
Michael Stack 1a173f820b
HBASE-18352 Enable TestMasterOperationsForRegionReplicas#testCreateTableWithMultipleReplicas
disabled by Proc-V2 AM in HBASE-14614

Reenables the test. Adds facility to HBaseTestingUtility so
you can pass in ports a restarted cluster should use. This
is needed so retention of region placement, on which this
test depends, can come trigger (this is why it was broke
on AMv2 commit... region placement retention is done
different in AMv2).
2017-12-14 14:13:55 -08:00
Josh Elser 4a1c3b4210 HBASE-19267 Remove compiler-plugin mapping executions as it breaks Java8 detection
It seems like the original reason this execution filter was added is no
longer an issue for 2.0. Actually, these entries actually preclude
Eclipse from correctly using the Java8 source/target version that we
have specified (which creates numerous compilation errors in Eclipse)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
2017-12-14 15:11:19 -05:00
Mike Drob 2c9ef8a471 HBASE-19289 Add flag to disable stream capability enforcement
Signed-off-by: Josh Elser <elserj@apache.org>
2017-12-14 12:19:22 -06:00
ramkrish86 d5aefbd2c7 HBASE-19511 Splits causes blocks to be cached again and so such blocks cannot be evicted from bucket cache (Ram)
Signed-off Duo Zhang, Anoop Sam John <palomino219@gmail.com, anoop.hbase@gmail.com>
2017-12-15 00:35:20 +05:30
zhangduo fe316fe7ac HBASE-19512 Move EventType and ExecutorType from hbase-client to hbase-server 2017-12-14 20:15:44 +08:00
zhangduo 7466e64abb HBASE-19510 TestDistributedLogSplitting is flakey for AsyncFSWAL 2017-12-14 15:59:41 +08:00
Michael Stack d1fb987265 HBASE-19287 Revert "Revert "master hangs forever if RecoverMeta
send assign meta region request to target server fail""

This is a revert of a revert; i.e a reapplication with the
log message fixed up and some added javadoc.

This reverts commit 9ef115163b.

Signed-off-by: Yi Liang <yliang@us.ibm.com>
2017-12-13 23:08:28 -08:00