Commit Graph

860 Commits

Author SHA1 Message Date
stack f57dca5e1b HBASE-13198 Remove HConnectionManager (Mikhail Antonov) 2015-03-20 09:41:48 -07:00
Liu Shaohui 602e11cc74 HBASE-13216 Add version info in RPC connection header (Shaohui Liu) 2015-03-19 10:30:55 +08:00
Andrey Stepachev 7a08ad9df8 HBASE-13093 Local mode HBase instance doesn't shut down. 2015-03-17 14:46:30 +00:00
stack a75a2ace4f HBASE-13193 RegionScannerImpl filters should not be reset if a partial Result is returned (Jonathan Lawlor) 2015-03-16 13:26:34 -07:00
stack c5aca1919d HBASE-12586 Task 6 & 7 from HBASE-9117, delete all public HTable constructors and delete ConnectionManager#{delete,get}Connection (Mikhail Antonov) 2015-03-16 11:20:14 -07:00
Josh Elser 72855c584e HBASE-13236 Add addt'l lifecycle-mapping executions.
Adds a number of lifecycle-mapping entries which
prevent errors from showing up in Eclipse on a fresh
import of HBase. For plugins defined in the top-level
pom, the mapping is added there; otherwise, the mapping
is pushed down to the child pom.

Signed-off-by: Sean Busbey <busbey@apache.org>
2015-03-13 22:35:52 -05:00
anoopsjohn 0f69ea409f HBASE-13232 ConnectionManger : Batch pool threads and metaLookup pool threads should use different name pattern. 2015-03-13 22:51:29 +05:30
tedyu 1cc1142379 HBASE-13162 Addendum adds InterfaceAudience annotation to ZkAclReset 2015-03-12 19:10:03 -07:00
Jonathan M Hsieh 3509cc2134 HBASE-13162 Add capability for cleaning hbase acls to hbase cleanup script (Srikanth Srungarapu) 2015-03-12 17:06:27 -07:00
tedyu 7a3ea23704 HBASE-13171 Change AccessControlClient methods to accept connection object to reduce setup time (Srikanth Srungarapu) 2015-03-11 18:24:12 -07:00
Enis Soztutar c938267db3 HBASE-13063 Allow to turn off memstore replication for region replicas - ADDENDUM for turning of primary flush tigger when this is enabled 2015-03-11 14:56:54 -07:00
stack b436db7d70 HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer; ADDENDUM 2015-03-10 22:17:08 -07:00
Matteo Bertozzi cbf03787ea HBASE-13063 Allow to turn off memstore replication for region replicas 2015-03-10 10:02:04 +00:00
zhangduo 9b53a1c214 HBASE-12405 WAL accounting by Store 2015-03-10 13:00:02 +08:00
Enis Soztutar 5025d3aa91 HBASE-13121 Async wal replication for region replicas and dist log replay does not work together 2015-03-09 15:49:09 -07:00
Andrey Stepachev 948746ce4e HBASE-12990 MetaScanner should be replaced by MetaTableAccessor 2015-03-09 10:39:59 +00:00
Enis Soztutar 95fc53f105 HBASE-12706 Support multiple port numbers in ZK quorum string (Stephen Yuan Jiang) 2015-03-06 16:46:17 -08:00
stack 9159c82fbf HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer 2015-03-06 14:35:08 -08:00
tedyu 8449251fb6 HBASE-13122 Improve efficiency for return codes of some filters (Shuaifeng) 2015-03-05 18:42:22 -08:00
stack 74837d9b1f Revert " HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer"
OVERCOMMIT. REVERT.

This reverts commit 55f8f56ad2.
2015-03-04 22:58:02 -08:00
stack 55f8f56ad2 HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer
Rename ByteBufferReservoir as BoundedByteBufferPool
2015-03-04 22:44:20 -08:00
Jonathan Lawlor de9791e91e HBASE-11544: [Ergonomics] hbase.client.scanner.caching is dogged and will try to return batch even if it means OOME
Signed-off-by: stack <stack@apache.org>
2015-03-04 17:34:48 -08:00
Misty Stanley-Jones 39425a8558 HBASE-11670 Generate PDF of Reference Guide 2015-03-05 09:31:11 +10:00
Lars Hofhansl 464e7ce685 HBASE-13109 Make better SEEK vs SKIP decisions during scanning. 2015-03-04 14:03:47 -08:00
Enis Soztutar 9899aab12b HBASE-11580 Failover handling for secondary region replicas 2015-03-03 11:48:12 -08:00
tedyu e0019d99de HBASE-13122 Revert pending answer to Ram's question 2015-03-02 21:00:26 -08:00
Andrew Purtell 0c63eeb511 HBASE-12995 Document that HConnection#getTable methods do not check table existence since 0.98.1 2015-03-02 16:58:45 -08:00
tedyu 7b5c9eabac HBASE-13122 Improve efficiency for return codes of some filters (Shuaifeng Zhou) 2015-03-02 07:47:33 -08:00
tedyu 4980bfe642 HBASE-13134 mutateRow and checkAndMutate apis don't throw region level exceptions (Francis Liu) 2015-03-01 20:22:07 -08:00
Sean Busbey dad2474f08 HBASE-13131 ReplicationAdmin must clean up connections if constructor fails. 2015-03-01 00:20:44 -06:00
zhangduo 21f12ce8e5 HBASE-13097 addendum use default ByteBufAllocator
Signed-off-by: stack <stack@apache.org>
2015-02-27 17:18:59 -08:00
zhangduo d1619bceb3 HBASE-13097 Use same EventLoopGroup for different AsyncRpcClients if possible
Signed-off-by: stack <stack@apache.org>
2015-02-27 08:34:46 -08:00
Nick Dimiduk c651271f57 HBASE-13086 Show ZK root node on Master WebUI 2015-02-24 19:04:12 -08:00
Ashish Singhi 913ea2c222 HBASE-13048 Use hbase.crypto.wal.algorithm in SecureProtobufLogReader while decrypting the data
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-24 18:18:07 -08:00
Devaraj Das 70412d886c HBASE-13067. Fix caching of stubs to allow IP address changes of restarted remote servers. 2015-02-23 22:15:03 -08:00
zhangduo b20675f5af HBASE-12953 RegionServer is not functionally working with AysncRpcClient in secure mode
Signed-off-by: stack <stack@apache.org>
2015-02-23 20:38:19 -08:00
Enis Soztutar e405017a31 HBASE-12561 Replicas of regions can be cached from different instances of the table in MetaCache 2015-02-23 11:06:17 -08:00
tedyu 9a311303a8 HBASE-13057 Provide client utility to easily enable and disable table replication (Ashish Singhi) 2015-02-20 10:18:47 -08:00
Ashish Singhi 31f17b17f0 HBASE-13002 Make encryption cipher configurable
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-18 11:42:20 -08:00
Devaraj Das 14bb352b02 HBASE-13036. Meta scanner should use its own threadpool 2015-02-18 10:23:02 -08:00
zhangduo 20bc74dff0 HBASE-13066 Fix typo in AsyncRpcChannel
Signed-off-by: stack <stack@apache.org>
2015-02-18 09:43:27 -08:00
zhangduo e99091e97c HBASE-13011 TestLoadIncrementalHFiles is flakey when using AsyncRpcClient as client implementation
Added comment to AsyncRpcChannel data members

Signed-off-by: stack <stack@apache.org>
2015-02-16 09:03:31 -08:00
Sean Busbey c96df5e240 HBASE-13027 Ensure extension of TableInputFormatBase works.
* move mapreduce version of TableInputFormat tests out of mapred
* add ability to get runnable job via MR test shims
* correct the javadoc example for current APIs.
* add tests the run a job based on the extending TableInputFormatBase (as given in the javadocs)
* add tests that run jobs based on the javadocs from 0.98
* fall back to our own Connection if ussers of the deprecated table configuration have a managed connection.
2015-02-13 18:41:04 -06:00
stack 3babad30e6 HBASE-13030 [1.0.0 polish] Make ScanMetrics public again and align Put 'add' with Get, Delete, etc., addColumn 2015-02-13 15:24:38 -08:00
Enis Soztutar 3e10e6e1a6 HBASE-11569 Flush / Compaction handling from secondary region replicas 2015-02-13 11:08:24 -08:00
Ashish Singhi 16ed345191 HBASE-9531 a command line (hbase shell) interface to retreive the replication metrics and show replication lag
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-12 14:50:01 -08:00
Andrew Purtell dc522d010c HBASE-12996 Reversed field on Filter should be transient (Ian Friedman) 2015-02-11 12:17:51 -08:00
stack dec0ec2290 HBASE-13016 Clean up remnants of table states stored in table descriptors (Andrey Stepachev) 2015-02-11 11:09:03 -08:00
stack fa852c4ce6 HBASE-12035 Keep table state in META (Andrey Stepachev) 2015-02-10 14:20:47 -08:00
Jeffrey Zhong 3f4427739d HBASE-11567 Write bulk load COMMIT events to WAL (Alex Newman, Jeffrey Zhong) 2015-02-06 18:07:30 -08:00
stack 96cdc7987e HBASE-12958 SSH doing hbase:meta get but hbase:meta not assigned 2015-02-04 22:56:40 -08:00
Victoria Dudin 4f472062a4 HBASE-12961 Fix negative values in read and write region server metrics. 2015-02-04 10:32:09 -08:00
Devaraj Das cf5ad96fcc HBASE-10942. support parallel request cancellation for multi-get (Nicolas Liochon & Devaraj Das) 2015-02-02 23:01:31 -08:00
zhangduo fef78acf65 HBASE-12951 TestHCM.testConnectionClose is flakey when using AsyncRpcClient as client implementation
Signed-off-by: stack <stack@apache.org>
2015-02-02 08:27:57 -08:00
stack 538388c2b5 HBASE-6778 Deprecate Chore; its a thread per task when we should have one thread to do all tasks (Jonathan Lawlor) 2015-01-29 19:26:26 -08:00
Lars Hofhansl 1270e590d1 HBASE-12859 New master API to track major compaction completion. 2015-01-29 13:58:27 -08:00
Devaraj Das 6b20a0f831 HBASE-11574. hbase:meta's regions can be replicated 2015-01-27 16:40:29 -08:00
tedyu aaeafca920 HBASE-7847 Use zookeeper multi to clear znodes (Rakesh R) 2015-01-26 21:40:39 -08:00
Enis Soztutar 2fb19fb951 HBASE-11908 Region replicas should be added to the meta table at the time of table creation 2015-01-26 19:55:47 -08:00
tedyu 26b8b48b42 HBASE-12915 Disallow small scan with batching 2015-01-26 10:58:53 -08:00
stack a4be1b84e4 HBASE-12684 Add new AsyncRpcClient (Jurriaan Mous) -- SMALL AMENDMENT 2015-01-24 18:24:32 -08:00
Jurriaan Mous 854f13afa1 HBASE-12684 Add new AsyncRpcClient (Jurriaan Mous)
Signed-off-by: stack <stack@apache.org>
2015-01-24 18:05:39 -08:00
Nick Dimiduk 588b43b06b HBASE-12728 buffered writes substantially less useful after removal of HTablePool (addendum) 2015-01-23 14:45:21 -08:00
Nick Dimiduk ab18158e60 HBASE-12728 buffered writes substantially less useful after removal of HTablePool (Solomon Duskis and Nick Dimiduk)
In our pre-1.0 API, HTable is considered a light-weight object that consumed by
a single thread at a time. The HTablePool class provided a means of sharing
multiple HTable instances across a number of threads. As an optimization,
HTable managed a "write buffer", accumulating edits and sending a "batch" all
at once. By default the batch was sent as the last step in invocations of
put(Put) and put(List<Put>). The user could disable the automatic flushing of
the write buffer, retaining edits locally and only sending the whole "batch"
once the write buffer has filled or when the flushCommits() method in invoked
explicitly. Explicit or implicit batch writing was controlled by the
setAutoFlushTo(boolean) method. A value of true (the default) had the write
buffer flushed at the completion of a call to put(Put) or put(List<Put>). A
value of false allowed for explicit buffer management. HTable also exposed the
buffer to consumers via getWriteBuffer().

The combination of HTable with setAutoFlushTo(false) and the HTablePool
provided a convenient mechanism by which multiple "Put-producing" threads could
share a common write buffer. Both HTablePool and HTable are deprecated, and
they are officially replaced in The new 1.0 API by Table and BufferedMutator.
Table, which replaces HTable, no longer exposes explicit write-buffer
management. Instead, explicit buffer management is exposed via BufferedMutator.
BufferedMutator is made safe for concurrent use. Where code would previously
retrieve and return HTables from an HTablePool, now that code creates and
shares a single BufferedMutator instance across all threads.
2015-01-23 08:48:31 -08:00
Andrew Purtell 71ab4ddb19 HBASE-12731 Heap occupancy based client pushback 2015-01-22 17:33:21 -08:00
Nick Dimiduk 9824eb7840 HBASE-12810 Update to htrace-incubating 2015-01-22 14:28:20 -08:00
Sean Busbey 418ea93774 HBASE-12898 ensure direct dependencies are declared. 2015-01-22 14:33:25 -06:00
Nick Dimiduk 9bdb81f0a1 HBASE-12887 Cleanup many checkstyle errors in o.a.h.h.client 2015-01-20 12:44:36 -08:00
Andrew Purtell 03e17168c3 HBASE-12840 Improve unit test coverage of the client pushback mechanism 2015-01-17 11:50:26 -08:00
Enis Soztutar 092c91eb0f HBASE-12837 ReplicationAdmin leaks zk connections (stack) 2015-01-16 13:16:12 -08:00
Misty Stanley-Jones 1a21c1684c HBASE-11533 Asciidoc Proof of Concept 2015-01-13 22:32:29 -08:00
tedyu e5f3dd682f HBASE-11144 Filter to support scanning multiple row key ranges (Jiajia Li) 2015-01-13 07:02:06 -08:00
Andrew Purtell c32a2c0b16 HBASE-12839 Remove synchronization in ServerStatisticsTracker 2015-01-12 16:06:51 -08:00
Enis Soztutar 8816fa05c2 HBASE-12832 Describe table from shell no longer shows Table's attributes, only CF attributes (Srikanth Srungarapu) 2015-01-12 14:00:22 -08:00
Nick Dimiduk dde713ee4e HBASE-12071 Separate out thread pool for Master <-> RegionServer communication (Stephen Yuan Jiang) 2015-01-08 14:17:00 -08:00
tedyu 9246af8dac HBASE-12796 Clean up HTable and HBaseAdmin deprecated constructor usage (Jurriaan Mous) 2015-01-08 07:49:28 -08:00
Enis Soztutar c348cd327b HBASE-12788 Promote Abortable to LimitedPrivate 2015-01-05 16:29:27 -08:00
tedyu ac95cc1fbb HBASE-12783 Create efficient RegionLocator implementation (Solomon Duskis) 2015-01-02 19:48:06 -08:00
Jurriaan Mous e5ec14af04 HBASE-12761 On region jump ClientScanners should get next row start key instead of a skip.
Signed-off-by: stack <stack@apache.org>
2014-12-30 14:47:01 -08:00
Esteban Gutierrez b2eea8cac6 HBASE-12695 JDK 1.8 compilation broken
Signed-off-by: stack <stack@apache.org>
2014-12-29 11:02:04 -08:00
stack a8766fd623 HBASE-12641 Grant all permissions of hbase zookeeper node to hbase superuser in a secure cluster (Liu Shaohui) 2014-12-27 21:11:57 -08:00
stack 2b090d6832 HBASE-12739 Avoid too large identifier of ZooKeeperWatcher (Liu Shaohui) 2014-12-23 12:20:30 -08:00
Jurriaan Mous 4880e5d83b HBASE-12736
Signed-off-by: stack <stack@apache.org>
2014-12-23 10:30:25 -08:00
tedyu 700de7d92c HBASE-12750 getRequestsCount() in ClusterStatus returns total number of request (Weichen Ye) 2014-12-23 10:26:16 -08:00
Devaraj Das 1c45d1cd9d HBASE-12012. Improve cancellation for the scan RPCs 2014-12-22 16:22:04 -08:00
stack b004e4ff5b HBASE-11412 Minimize a number of hbase-client transitive dependencies (Sergey Beryozkin) 2014-12-19 07:55:53 -08:00
Enis Soztutar 83e4bfaf73 HBASE-11412 Minimize a number of hbase-client transitive dependencies (Sergey Beryozkin) 2014-12-17 21:53:18 -08:00
Andrew Purtell 99a11390b4 Amend HBASE-5162 Basic client pushback mechanism (Jesse Yates)
Applied hbase-5162-trunk-addendum.patch
2014-12-16 22:15:49 -08:00
Andrew Purtell 6a042c381a Revert "HBASE-5162 Basic client pushback mechanism (Jesse Yates); ADDENDUM"
This reverts commit f7154e1ac9.
2014-12-16 22:14:50 -08:00
stack f7154e1ac9 HBASE-5162 Basic client pushback mechanism (Jesse Yates); ADDENDUM 2014-12-16 21:09:52 -08:00
zhangduo c7fad665f3 HBASE-10201 Port 'Make flush decisions per column family' to trunk
Signed-off-by: stack <stack@apache.org>
2014-12-16 11:49:17 -08:00
Jesse Yates a411227b0e HBASE-5162 Basic client pushback mechanism
Instead of just blocking the client for 90 seconds when the region gets too
busy, it now sends along region load stats to the client so the client can
know how busy the server is. Currently, its just the load on the memstore, but
it can be extended for other stats (e.g. cpu, general memory, etc.).

It is then up to the client to decide if it wants to listen to these stats.
By default, the client ignores the stats, but it can easily be toggled to the
built-in exponential back-off or users can plug in their own back-off
implementations
2014-12-16 11:14:30 -08:00
stack 029768287a HBASE-12422 Use ConnectionFactory in HTable constructors Fix method signature in test 2014-12-14 19:42:15 -08:00
Enis Soztutar 743d16138e HBASE-12679 Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to LimitedPrivate 2014-12-14 17:46:30 -08:00
tedyu 65830b096b HBASE-12659 Replace the method calls to grant and revoke in shell scripts with AccessControlClient (Srikanth Srungarapu) 2014-12-13 10:17:43 -08:00
Jurriaan Mous 3275b964c1 HBASE-12668 Adapt PayloadCarryingRpcController so it can also be used in an async way
Signed-off-by: stack <stack@apache.org>
2014-12-12 07:44:04 -08:00
Misty Stanley-Jones 7d10af1254 HBASE-9763 Scan javadoc doesn't fully capture semantics of start and stop row (Gabriel Reid) 2014-12-12 13:39:16 +10:00
stack da2b5a9627 HBASE-12373 Provide a command to list visibility labels (Jerry He) 2014-12-11 15:18:03 -08:00
stack df22270756 HBASE-12665 When aborting, dump metrics
Add some fixup of checkstyle fails
2014-12-09 21:01:15 -08:00
Nick Dimiduk e720c83557 HBASE-12652 Allow unmanaged connections in MetaTableAccessor (Solomon Duskis) 2014-12-09 11:27:34 -08:00