Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
15,097 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

1896 Commits

Author SHA1 Message Date
zhangduo e546034f09 HBASE-19795 Move the tests which only need zookeeper in TestZooKeeper to hbase-zookeeper module 2018-01-15 10:57:51 +08:00
zhangduo d24fddf3ed HBASE-19772 Do not close connection to zk when there are still pending request in ReadOnlyZKClient 2018-01-14 17:08:23 +08:00
Michael Stack a4a4ce8eac
Revert "HBASE-19772 ReadOnlyZKClient improvements" 
Pushed by mistake. Reverting from master.

This reverts commit 70515f5311.
 2018-01-11 14:27:23 -08:00
Duo Zhang 70515f5311 HBASE-19772 ReadOnlyZKClient improvements 2018-01-11 11:37:27 -08:00
Michael Stack a7f9668c33 HBASE-19753 Miscellany of fixes for hbase-zookeeper tests to make them more robust 
First, we add test resources to CLASSPATH when tests run. W/o it, there
was no logging of hbase-zookeeper test output (not sure why I have to
add this here and not over in hbase-server; research turns up nothing
so far).

M hbase-zookeeper/src/main/java/org/apache/hadoop/hbase/zookeeper/ZKMainServer.java
 Improve fail log message.

M hbase-zookeeper/src/test/java/org/apache/hadoop/hbase/zookeeper/TestReadOnlyZKClient.java
M hbase-zookeeper/src/test/java/org/apache/hadoop/hbase/zookeeper/TestZKNodeTracker.java
 Wait until ZK is connected before progressing. On my slow zk, it could
 be a while post construction before zk connected. Using an unconnected
 zk caused test to fail.

M hbase-zookeeper/src/test/java/org/apache/hadoop/hbase/zookeeper/TestZKMainServer.java
 Change session timeout to default 30s from 1s which was way too short.

M hbase-zookeeper/src/test/resources/log4j.properties
 Set zk logs to DEBUG level in this module at least.

Adds a ZooKeeperHelper class that has utility to help interacting w/ ZK.
 2018-01-11 11:23:37 -08:00
tedyu b568cf4ebd HBASE-19740 Repeated error message for NamespaceExistException 2018-01-10 18:25:45 -08:00
Josh Elser 8118d5de4e HBASE-19734 Fix IntegrationTestReplication and related impl changes 
Adds (client-side) validation to ReplicationPeerConfigBuilder and javadoc
to builder methods in addition to the test fix.

Signed-off-by: Guanghao Zhang <zghao@apache.org>
Signed-off-by: Michael Stack <stack@apache.org>
 2018-01-10 13:52:31 -05:00
Guanghao Zhang f458b89c05 HBASE-19139 Create Async Admin methods for Clear Block Cache 2018-01-09 14:43:01 +08:00
Guanghao Zhang 01f1fc8284 HBASE-19636 All rs should already start work with the new peer change when replication peer procedure is finished 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-01-09 13:11:01 +08:00
zhangduo 19707a85dd HBASE-19633 Clean up the replication queues in the postPeerModification stage when removing a peer 2018-01-09 13:11:01 +08:00
huzheng f89920a60f HBASE-19622 Reimplement ReplicationPeers with the new replication storage interface 2018-01-09 13:11:01 +08:00
huzheng 8f5e54a456 HBASE-19525 RS side changes for moving peer modification from zk watcher to procedure 2018-01-09 13:11:01 +08:00
Guanghao Zhang 76a044c5d9 HBASE-19536 Client side changes for moving peer modification from zk watcher to procedure 
Signed-off-by: zhangduo <zhangduo@apache.org>
 2018-01-09 13:11:01 +08:00
Mike Drob 022a348d61
HBASE-19721 Unnecessary stubbings in TestReversedScannerCallable 
Signed-off-by: Michael Stack <stack@apache.org>
 2018-01-06 08:58:17 -06:00
Beluga Behr a30d9fe8d9
HBASE-19651 Remove LimitInputStream 2018-01-05 16:59:29 -06:00
Michael Stack 2bf2b5b2c1
Revert "Revert "Revert "HBASE-19651 Remove LimitInputStream""" 
This reverts commit 032701c96c.
 2018-01-05 16:58:26 -06:00
Michael Stack 032701c96c
Revert "Revert "HBASE-19651 Remove LimitInputStream"" 
This reverts commit e5f7030ded.
 2018-01-05 16:55:59 -06:00
Beluga Behr e5f7030ded
Revert "HBASE-19651 Remove LimitInputStream" 
Revert to put Beluga in place as author.

This reverts commit 032fdc53de.
 2018-01-05 16:55:01 -06:00
Michael Stack 032fdc53de
HBASE-19651 Remove LimitInputStream 
Signed-off-by: Beluga Behr <dam6923@gmail.com>
 2018-01-05 08:31:11 -06:00
Chia-Ping Tsai 8119acfca7 HBASE-19596 RegionMetrics/ServerMetrics/ClusterMetrics should apply to all public classes 2018-01-04 13:13:34 +08:00
BELUGA BEHR 2bd259b445 HBASE-19473 Miscellaneous changes to ClientScanner 
- Remove superfluous logging code guard
- Simplify some of the code
- Use ArrayDeque instead of LinkedList for queue implementation
 2018-01-03 20:25:21 -08:00
zhangduo 1fa3637b4d HBASE-19641 AsyncHBaseAdmin should use exponential backoff when polling the procedure result 2018-01-03 18:32:54 +08:00
BELUGA BEHR 4e9f4abb14 HBASE-19683 Remove Superfluous Methods From String Class (BELUGA BEHR). 
* Remove isEmpty method
* Remove repeat
Use the Apache Commons implementations instead.
 2018-01-02 11:12:38 -08:00
Niels Basjes a6081d30f9 HBASE-19486: Ensure threadsafe WriteBufferPeriodicFlush operations 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2018-01-02 17:26:22 +08:00
Niels Basjes 5a1c36f70a HBASE-19486 Periodically ensure records are not buffered too long by BufferedMutator 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-29 22:23:18 +08:00
Chia-Ping Tsai e23f7afe57 HBASE-19428 Deprecate the compareTo(Row) 2017-12-29 20:03:39 +08:00
Michael Stack 2dae9d16e2
Revert "HBASE-19651 Remove LimitInputStream" 
This reverts commit 28eaf715e8.
 2017-12-28 14:31:44 -08:00
Michael Stack 28eaf715e8 HBASE-19651 Remove LimitInputStream 
Signed-off-by: Beluga Behr <dam6923@gmail.com>
 2017-12-28 13:04:41 -08:00
Mike Drob c3b4f788b1 HBASE-19552 find-and-replace thirdparty offset 2017-12-28 11:52:32 -06:00
Guanghao Zhang 78013a0c1e HBASE-19653 Reduce the default hbase.client.start.log.errors.counter 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-12-28 07:55:57 -08:00
Guanghao Zhang 8580ba7b6f HBASE-19643 Need to update cache location when get error in AsyncBatchRpcRetryingCaller 2017-12-28 14:33:24 +08:00
Chia-Ping Tsai 53233be5a9 HBASE-19626 Rename Cell.DataType to Cell.Type 2017-12-28 13:04:29 +08:00
Michael Stack 1050936ce7 HBASE-19652 Turn down CleanerChore logging; too chatty 2017-12-27 20:49:26 -08:00
Michael Stack 2c65f039ed HBASE-19647 Logging cleanups; emit regionname when RegionTooBusyException inside RetriesExhausted... make netty connect/disconnect TRACE-level; ADDENDUM 2017-12-27 14:14:58 -08:00
Chia-Ping Tsai 01b1f48ccd HBASE-19644 add the checkstyle rule to reject the illegal imports 2017-12-28 04:10:42 +08:00
Michael Stack 16cd916976 HBASE-19647 Logging cleanups; emit regionname when RegionTooBusyException inside RetriesExhausted... make netty connect/disconnect TRACE-level 2017-12-27 11:55:42 -08:00
Chia-Ping Tsai 6b39062e86 HBASE-19628 ByteBufferCell should extend ExtendedCell 2017-12-27 22:26:40 +08:00
Vasudevan 467a4667d8 HBASE-19629 RawCell#getTags should return the Iterator<Tag> in order to avoid iterating through whole tag array at once 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-27 21:33:42 +08:00
Peter Somogyi 7145d98182 HBASE-19545 Replace getBytes(StandardCharsets.UTF_8) with Bytes.toBytes 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-27 20:07:25 +08:00
Chia-Ping Tsai 5a561e0882 HBASE-19496 (addendum) don't store the duplicate cp names in ServerMetrics 2017-12-27 07:05:16 +08:00
Chia-Ping Tsai 7ce1943ef3 HBASE-19550 Wrap the cell passed via Mutation#add(Cell) to be of ExtendedCell 2017-12-26 16:39:51 +08:00
Guanghao Zhang 1556939236 HBASE-19621 Revisit the methods in ReplicationPeerConfigBuilder 2017-12-26 14:40:31 +08:00
Guanghao Zhang 0dadb45ad7 HBASE-19576 Introduce builder for ReplicationPeerConfig and make it immutable 2017-12-23 18:55:29 +08:00
Chia-Ping Tsai 448ba3a78f HBASE-19496 Reusing the ByteBuffer in rpc layer corrupt the ServerLoad and RegionLoad 2017-12-22 18:54:25 +08:00
Guanghao Zhang 001bce54e7 HBASE-19590 Remove the duplicate code in deprecated ReplicationAdmin 2017-12-22 18:32:15 +08:00
Apekshit Sharma 8ec0aa0d70 HBASE-19589 New regions should always be added with state CLOSED (followup of HBASE-19530) 2017-12-21 22:57:53 -08:00
Chia-Ping Tsai 59baf12c03 HBASE-19575 add copy constructor to Mutation 2017-12-22 03:24:43 +08:00
Balazs Meszaros f572c4b80e HBASE-10092 Move up on to log4j2 
Changes:
- replaced commons-logging to slf4j everywhere
- log.XXX(Throwable) calls were replaced with log.XXX(t.toString(), t)
- log.XXX(Object) calls were replaced with log.XXX(Objects.toString(obj))
- log.fatal() calls were replaced with log.error(HBaseMarkers.FATAL, ...)
- programmatic log4j configuration was removed from the unit test

This commit does not affect the current logging configurations, because log4j
is still on the classpath. slf4j-log4j12 binds log4j to slf4j.

Signed-off-by: Michael Stack <stack@apache.org>
 2017-12-20 22:21:33 -08:00
Jan Hentschel dd00081c26 HBASE-19538 Removed unnecessary semicolons in hbase-client 2017-12-19 20:50:18 +01:00
Guanghao Zhang 03e79b7994 HBASE-19492 Add EXCLUDE_NAMESPACE and EXCLUDE_TABLECFS support to replication peer config 2017-12-19 16:53:43 +08:00
Michael Stack 6a9b1480c1 HBASE-19122 Suspect methods on Cell to be deprecated; ADDENDUM to fix 
compile error
 2017-12-18 16:02:54 -08:00
Michael Stack b4056d267a
HBASE-19122 Suspect methods on Cell to be deprecated 2017-12-18 15:20:44 -08:00
Yun Chi-Shih 9d0c7c6dfb HBASE-19531 Remove needless volatile declaration 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-19 00:34:28 +08:00
Guanghao Zhang 979767824d HBASE-19522 The complete order may be wrong in AsyncBufferedMutatorImpl 2017-12-16 14:00:59 +08:00
Apekshit Sharma a651ab93e3 HBASE-19530 New regions should always be added with state CLOSED 2017-12-15 21:20:58 -08:00
Peter Somogyi 59529a78f0
HBASE-19498 Fix findbugs and error-prone warnings in hbase-client (branch-2) 
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Apekshit Sharma <appy@apache.org>
 2017-12-15 15:55:51 -08:00
Mike Drob 75f512bd71 HBASE-18838 Fix hadoop3 check-shaded-invariants 2017-12-15 11:19:47 -06:00
Chia-Ping Tsai 70f02dbc7c
HBASE-19462 Deprecate all addImmutable methods in Put 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-12-14 14:15:54 -08:00
Josh Elser 4a1c3b4210 HBASE-19267 Remove compiler-plugin mapping executions as it breaks Java8 detection 
It seems like the original reason this execution filter was added is no
longer an issue for 2.0. Actually, these entries actually preclude
Eclipse from correctly using the Java8 source/target version that we
have specified (which creates numerous compilation errors in Eclipse)

Signed-off-by: Guanghao Zhang <zghao@apache.org>
 2017-12-14 15:11:19 -05:00
zhangduo fe316fe7ac HBASE-19512 Move EventType and ExecutorType from hbase-client to hbase-server 2017-12-14 20:15:44 +08:00
tedyu 104afd74a6 HBASE-19434 create_namespace command for existing namespace does not throw useful error message 2017-12-13 16:00:33 -08:00
Guangxu Cheng 86043ef629 HBASE-19000 Group multiple block cache clear requests per server 
Signed-off-by: tedyu <yuzhihong@gmail.com>
 2017-12-13 07:47:09 -08:00
BELUGA BEHR 536187446d HBASE-19472 Remove ArrayUtil Class 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-13 19:02:07 +08:00
Chia-Ping Tsai 677c1f2c63 HBASE-19427 Add TimeRange support into Append to optimize for counters 2017-12-13 15:35:49 +08:00
Peter Somogyi 7e5f3a516c HBASE-19213 Align check and mutate operations in Table and AsyncTable 
- Deprecates old checkAnd*() operations in Table
- Adds Table#CheckAndMutateBuilder and implements it in HTable

Commiter note: When committing the patch, noticed redundant {@inheritDoc} being added in HTable.
Removed new and olds ones.
 2017-12-12 20:37:24 -08:00
tedyu 11467ef111 HBASE-19394 Support multi-homing env for the publication of RS status with multicast (hbase.status.published) (Toshihiro Suzuki) 2017-12-12 07:38:15 -08:00
Michael Stack 542060ce40
HBASE-19461 TestRSGroups is broke 2017-12-08 15:09:46 -08:00
Chia-Ping Tsai 464e4e8058 HBASE-12444 Total number of requests overflow because it's int 2017-12-07 18:39:12 +08:00
anoopsamjohn ba4f9f8349 HBASE-19357 Bucket cache no longer L2 for LRU cache. 2017-12-07 15:03:53 +05:30
anoopsamjohn 98a21ef1ba HBASE-19439 Mark ShortCircuitMasterConnection with InterfaceAudience Private. 2017-12-07 11:22:40 +05:30
Michael Stack 4a2e8b852d HBASE-19295 The Configuration returned by CPEnv should be read-only. 
Adds a ReadOnlyConfiguration that delegates gets but throws exception
on sets/adds, etc.
 2017-12-06 15:18:09 -08:00
anoopsamjohn d107e33fcd Revert "HBASE-19357 Bucket cache no longer L2 for LRU cache." 
This reverts commit d34e30cad3.
 2017-12-06 11:37:09 +05:30
anoopsamjohn d34e30cad3 HBASE-19357 Bucket cache no longer L2 for LRU cache. 2017-12-06 11:25:08 +05:30
Michael Stack 8e3714e772
HBASE-19426 Move has() and setTimestamp() to Mutation (Chia-Ping Tsai) 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-05 09:40:55 -08:00
zhangduo 7a5b078306 HBASE-19399 Purge curator dependency from hbase-client 2017-12-03 08:30:30 +08:00
Enis Soztutar bc321a3bdd HBASE-16239 Better logging for RPC related exceptions 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-12-03 00:40:39 +08:00
Chia-Ping Tsai c64546aa31 HBASE-19350 TestMetaWithReplicas is flaky 2017-12-01 03:39:44 +08:00
Apekshit Sharma 81b95afbee HBASE-19367 Refactoring in RegionStates, and RSProcedureDispatcher 
- Adding javadoc comments
- Bug: ServerStateNode#regions is HashSet but there's no synchronization to prevent concurrent addRegion/removeRegion. Let's use concurrent set instead.
- Use getRegionsInTransitionCount() directly to avoid instead of getRegionsInTransition().size() because the latter copies everything into a new array - what a waste for just the size.
- There's mixed use of getRegionNode and getRegionStateNode for same return type - RegionStateNode. Changing everything to getRegionStateNode. Similarly rename other *RegionNode() fns to *RegionStateNode().
- RegionStateNode#transitionState() return value is useless since it always returns it's first param.
- Other minor improvements
 2017-11-29 22:40:11 -08:00
Guanghao Zhang abb535eef6
HBASE-19359 Revisit the default config of hbase client retries number 2017-11-29 10:32:42 -08:00
Jerry He e67a3699c4 HBASE-19096 Add RowMutions batch support in AsyncTable 
Signed-off-by: Jerry He <jerryjch@apache.org>
 2017-11-28 18:42:17 -08:00
Balazs Meszaros f6582400be
HBASE-19242 Add MOB compact support for AsyncAdmin 
Signed-off-by: Michael Stack <stack@apache.org>
Signed-off-by: Guanghao Zhang <zghaobac@gmail.com>
 2017-11-28 15:03:50 -08:00
Peter Somogyi b5a01685f4 HBASE-19351 Deprecated is missing in Table implementations 
Signed-off-by: Michael Stack <stack@apache.org>
 2017-11-28 11:17:35 -08:00
Guanghao Zhang f521000d78 HBASE-19337 AsyncMetaTableAccessor may hang when call ScanController.terminate many times 2017-11-25 19:29:08 +08:00
Vasudevan 73e3af00e9 HBASE-19092 Make Tag IA.LimitedPrivate and expose for CPs (Ram) 2017-11-24 12:21:38 +05:30
Guanghao Zhang 3e2941a49e HBASE-16868 Add a replicate_all flag to avoid misuse the namespaces and table-cfs config of replication peer 2017-11-23 14:54:19 +08:00
wuguoquan 7acf3f9a9c HBASE-19321 ZKAsyncRegistry ctor would hang when zookeeper cluster is not available 2017-11-22 15:41:44 +08:00
anoopsamjohn 984e0ecfc4 HBASE-19301 Provide way for CPs to create short circuited connection with custom configurations. 2017-11-21 19:04:53 +05:30
zhangduo 48cf4c7abe HBASE-19313 Call blockUntilConnected when constructing ZKAsyncRegistry(temporary workaround) 2017-11-21 21:28:54 +08:00
Sergey Soldatov 0e289a851b HBASE-19304 KEEP_DELETED_CELLS should ignore case 
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-11-21 20:40:56 +08:00
Guanghao Zhang e1133d5201 HBASE-19293 Support add a disabled state replication peer directly 2017-11-21 15:26:06 +08:00
Michael Stack 777b653b45
HBASE-19260 Add lock back to avoid parallel accessing meta to locate region 2017-11-17 14:03:56 -08:00
Apekshit Sharma 330b0d05b9 HBASE-19114 Split out o.a.h.h.zookeeper from hbase-server and hbase-client 
- Moved DrainingServerTracker and RegionServerTracker to hbase-server:o.a.h.h.master.
- Moved SplitOrMergeTracker to oahh.master (because it depends on a PB)
- Moving hbase-client:oahh.zookeeper.*  to hbase-zookeeper module.  After HBASE-19200, hbase-client doesn't need them anymore (except 3 classes).
- Renamed some classes to use a consistent naming for classes - ZK instead of mix of ZK, Zk , ZooKeeper. Couldn't rename following public classes: MiniZooKeeperCluster, ZooKeeperConnectionException. Left RecoverableZooKeeper for lack of better name. (suggestions?)
- Sadly, can't move tests out because they depend on HBaseTestingUtility (which defeats part of the purpose - trimming down hbase-server tests. We need to promote more use of mocks in our tests)
 2017-11-17 13:20:18 -08:00
Guanghao Zhang 52273aa8f3 HBASE-18911 Unify Admin and AsyncAdmin's methods name 2017-11-17 09:46:54 +08:00
huzheng d726492838 HBASE-19252 Move the transform logic of FilterList into transformCell() method to avoid extra ref to question cell 2017-11-17 09:26:04 +08:00
zhangduo 54827cf613 HBASE-19251 Merge RawAsyncTable and AsyncTable 2017-11-16 14:36:28 +08:00
Guanghao Zhang 600fdee844 HBASE-19009 implement modifyTable and enable/disableTableReplication for AsyncAdmin 2017-11-16 07:07:20 +08:00
Sean Busbey df98d6848f HBASE-19248 Move tests that need to look at Connection internals to test of said internals. 
Signed-off-by: zhangduo <zhangduo@apache.org>
Signed-off-by: Chia-Ping Tsai <chia7712@gmail.com>
 2017-11-15 08:38:12 -06:00
anoopsamjohn 7d70487442 HBASE-19235 CoprocessorEnvironment should be exposed to CPs. 2017-11-15 14:49:42 +05:30
Lars Hofhansl 0c4fbcc329 HBASE-12091 Optionally ignore edits for dropped tables for replication. 2017-11-14 17:08:14 -08:00
Abhishek Singh Chouhan 9ed6cf5cb8 HBASE-19215 Incorrect exception handling on the client causes incorrect call timeouts and byte buffer allocations on the server 
Signed-off-by: Andrew Purtell <apurtell@apache.org>
 2017-11-13 18:02:22 -08:00