Commit Graph

14410 Commits

Author SHA1 Message Date
QilinCao 07d20b2d18 HBASE-19521 HBase mob compaction needs to check hfile version
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-12-18 08:32:51 -08:00
zhangduo c0740b84ef HBASE-19546 TestMasterReplication.testCyclicReplication2 uses wrong assertion 2017-12-18 19:59:19 +08:00
Yung-An He a9e0ae6dfc HBASE-19068 Change all url of apache.org from HTTP to HTTPS in HBase book
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-18 19:22:57 +08:00
Michael Stack 811b88a877 HBASE-18700 Document the new changes on mapreduce stuffs
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-18 19:15:11 +08:00
zhangduo 73942e37da HBASE-18213 Add documentation about the new async client
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-18 18:52:06 +08:00
sahil aggarwal 67029f93ea HBASE-16390 Fix documentation around setAutoFlush
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-18 18:42:12 +08:00
Yung-An He 929ef42591 HBASE-18922 Fix all dead links in our HBase book
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-18 18:27:11 +08:00
Michael Stack dff298519a HBASE-18302 Protobuf section in the docs needs some clean up (Artem Ervits) 2017-12-18 17:53:46 +08:00
Chia-Ping Tsai b646d7249b HBASE-18750 Cleanup the docs saying "HTable use write buffer" 2017-12-18 17:44:28 +08:00
Chia-Ping Tsai 81f05bd943 HBASE-17967 clean up documentation references to -ROOT- table. 2017-12-18 17:43:44 +08:00
Chia-Ping Tsai 2cfb89c54d HBASE-18787 Fix the "dependencies connecting to an HBase cluster" 2017-12-18 17:26:32 +08:00
Chia-Ping Tsai 6f98b7e4df HBASE-18421 update hadoop prerequisites docs to call out 2.8.1 2017-12-18 17:15:01 +08:00
Chia-Ping Tsai 379f4fe5a0 HBASE-13868 Correct "Disable automatic splitting" section in HBase book 2017-12-18 17:10:30 +08:00
Apekshit Sharma 6616a3fd2d HBASE-19526 Update hadoop version to 3.0 GA 2017-12-17 22:52:54 -08:00
Jan Hentschel 231ec7e836 HBASE-19474 Brought down the number of Checkstyle errors in hbase-zookeeper 2017-12-17 14:35:46 +01:00
Jan Hentschel 371c243a9b HBASE-19477 Moved and aligned documentation in hbase-annotations 2017-12-17 14:22:57 +01:00
Jan Hentschel d35ebafe4c HBASE-19479 Fixed Checkstyle error in hbase-shell 2017-12-17 14:08:31 +01:00
Chia-Ping Tsai 1ca2d10299 HBASE-18309 (addendum) fix NPE in LogCleaner 2017-12-17 17:30:33 +08:00
Guanghao Zhang 8fa08b56f3 HBASE-19522 The complete order may be wrong in AsyncBufferedMutatorImpl 2017-12-16 14:09:35 +08:00
Apekshit Sharma 15a4aa0ce1 HBASE-19530 New regions should always be added with state CLOSED 2017-12-15 21:21:37 -08:00
Andrew Purtell 4db2f51169 HBASE-19509 RSGroupAdminEndpoint#preCreateTable triggers TableNotFoundException 2017-12-15 17:53:53 -08:00
Peter Somogyi 4c2b2b3e6a
HBASE-19497 Fix findbugs and error-prone warnings in hbase-common (branch-2)
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-12-15 16:18:11 -08:00
Peter Somogyi 2043c337d8
HBASE-19498 Fix findbugs and error-prone warnings in hbase-client (branch-2)
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-12-15 15:57:01 -08:00
Michael Stack 85969cfcda HBASE-18352 Enable TestMasterOperationsForRegionReplicas#testCreateTableWithMultipleReplicas disabled by Proc-V2 AM in HBASE-14614
Reenables the test. Adds facility to HBaseTestingUtility so
you can pass in ports a restarted cluster should use. This
is needed so retention of region placement, on which this
test depends, can come trigger (this is why it was broke
on AMv2 commit... region placement retention is done
different in AMv2).
2017-12-15 12:48:19 -08:00
Michael Stack bff4226105 HBASE-19272 Deal with HBCK tests disabled by HBASE-14614 AMv2 when HBCK
works again...

I removed them
2017-12-15 12:20:18 -08:00
Mike Drob 23a9059cb2 HBASE-18838 Fix hadoop3 check-shaded-invariants 2017-12-15 13:20:54 -06:00
Michael Stack 672c440b9f HBASE-18946 Stochastic load balancer assigns replica regions to the same RS
Added new bulk assign createRoundRobinAssignProcedure to complement
the existing createAssignProcedure. The former asks the balancer for
target servers to set into the created AssignProcedures. The latter
sets no target server into AssignProcedure. When no target server
is specified, we make effort at assign-time at trying to deploy the
region to its old location if there was one.

The new round robin assign procedure creator does not do this. Use
the new round robin method on table create or reenabling offline
regions. Use the old assign in ServerCrashProcedure or in
EnableTable so there is a chance we retain locality.

Bulk preassigning passing all to-be-assigned to the balancer in one
go is good for ensuring good distribution especially when read
replicas in the mix.

The old assign was single-assign scoped so region replicas could
end up on the same server.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignProcedure.java
 Cleanup around forceNewPlan. Was confusing.
 Added a Comparator to sort AssignProcedures so meta and system tables
 come ahead of user-space tables.

M hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java b/hbase-server/src/main/java/org/apache/hadoop/hbase/master/assignment/AssignmentManager.java
 Remove the forceNewPlan argument on createAssignProcedure. Didn't make
 sense given we were creating a new AssignProcedure; the arg had no
 effect.

 (createRoundRobinAssignProcedures) Recast to feed all regions to the balancer in
 bulk and to sort the return so meta and system tables take precedence.

Miscellaneous fixes including keeping the Master around until all
RegionServers are down, documentation on how assignment retention
works, etc.
2017-12-15 08:54:35 -08:00
Michael Stack 76057aab62 HBASE-15536 Make AsyncFSWAL as our default WAL
Signed-off-by: zhangduo <zhangduo@apache.org>
2017-12-15 20:45:46 +08:00
anoopsamjohn a2dbb42284 HBASE-19505 Disable ByteBufferPool by default at HM. 2017-12-15 15:44:14 +05:30
tedyu 1d8a601166 HBASE-19516 IntegrationTestBulkLoad and IntegrationTestImportTsv run into 'java.lang.RuntimeException: DistributedHBaseCluster@1bb564e2 not an instance of MiniHBaseCluster' (Ankit) 2017-12-14 18:37:55 -08:00
zhangduo f070c381e2 HBASE-19513 Fix the wrapped AsyncFSOutput implementation 2017-12-15 09:39:42 +08:00
Chia-Ping Tsai 33d48754f5
HBASE-19462 Deprecate all addImmutable methods in Put
Signed-off-by: Michael Stack <stack@apache.org>
2017-12-14 14:18:04 -08:00
Mike Drob 2952cc7dea HBASE-19289 Add flag to disable stream capability enforcement
Signed-off-by: Josh Elser <elserj@apache.org>
2017-12-14 12:19:59 -06:00
ramkrish86 eac13e2315 HBASE-19511 Splits causes blocks to be cached again and so such blocks cannot be evicted from bucket cache (Ram)
Signed-off Duo Zhang, Anoop Sam John <palomino219@gmail.com, anoop.hbase@gmail.com>
2017-12-15 00:39:36 +05:30
zhangduo c2bb63fbf9 HBASE-19512 Move EventType and ExecutorType from hbase-client to hbase-server 2017-12-14 20:15:35 +08:00
zhangduo a1f8821b85 HBASE-19510 TestDistributedLogSplitting is flakey for AsyncFSWAL 2017-12-14 15:59:58 +08:00
Michael Stack cb4bbea0f1 HBASE-19287 Revert "Revert "master hangs forever if RecoverMeta
send assign meta region request to target server fail""

This is a revert of a revert; i.e a reapplication with the
log message fixed up and some added javadoc.

This reverts commit 9ef115163b.

Signed-off-by: Yi Liang <yliang@us.ibm.com>
2017-12-13 23:09:09 -08:00
zhangduo 211f231b4a HBASE-19503 Fix TestWALOpenAfterDNRollingStart for AsyncFSWAL 2017-12-14 09:41:23 +08:00
tedyu b682ea7c8a HBASE-19434 create_namespace command for existing namespace does not throw useful error message 2017-12-13 16:01:38 -08:00
Chia-Ping Tsai d2ffd5d7ed HBASE-19484 (addendum) NPE in ExtendedCell#write 2017-12-14 02:32:28 +08:00
Michael Stack fb6625fdd9
HBASE-19508 ReadOnlyConfiguration throws exception if any Configuration in current context calls addDefautlResource; ADDENDUM -- fix license 2017-12-13 10:29:46 -08:00
Michael Stack b475f15f25
HBASE-19508 ReadOnlyConfiguration throws exception if any Configuration in current context calls addDefautlResource
Signed-off-by: Peter Somogyi <psomogyi@cloudera.com>
2017-12-13 10:29:34 -08:00
Sergey Soldatov 78ff501ad8 HBASE-19456 RegionMover's region server hostname option is no longer case insensitive
Signed-off-by: Josh Elser <elserj@apache.org>
2017-12-13 11:45:11 -05:00
Guangxu Cheng 015b66103a HBASE-19000 Group multiple block cache clear requests per server
Signed-off-by: tedyu <yuzhihong@gmail.com>
2017-12-13 07:47:33 -08:00
Chia-Ping Tsai a489292a83 HBASE-19502 Make sure we have closed all StoreFileScanner if we fail to open any StoreFileScanners 2017-12-13 21:38:45 +08:00
BELUGA BEHR 7c871849de HBASE-19472 Remove ArrayUtil Class
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
2017-12-13 19:08:54 +08:00
Apekshit Sharma 9144452773 HBASE-19489 Adds QUICK_HADOOPCHECK flag to check against only the latest maintenance releases in "hadoopcheck". Updates hadoop version to 3.0.0-beta1. 2017-12-13 00:36:34 -08:00
Chia-Ping Tsai 55eb59e654 HBASE-19427 Add TimeRange support into Append to optimize for counters 2017-12-13 15:40:56 +08:00
Peter Somogyi 941acc5c05 HBASE-19213 Align check and mutate operations in Table and AsyncTable
- Deprecates old checkAnd*() operations in Table
- Adds Table#CheckAndMutateBuilder and implements it in HTable

Commiter note: When committing the patch, noticed redundant {@inheritDoc} being added in HTable.
Removed new and olds ones.

Signed-off-by: Apekshit Sharma <appy@apache.org>
2017-12-12 20:46:39 -08:00
Guanghao Zhang 7755a98227 HBASE-19495 Fix failed ut TestShell
Signed-off-by: Michael Stack <stack@apache.org>
2017-12-12 09:55:39 -08:00