Commit Graph

747 Commits

Author SHA1 Message Date
Nick Dimiduk ab18158e60 HBASE-12728 buffered writes substantially less useful after removal of HTablePool (Solomon Duskis and Nick Dimiduk)
In our pre-1.0 API, HTable is considered a light-weight object that consumed by
a single thread at a time. The HTablePool class provided a means of sharing
multiple HTable instances across a number of threads. As an optimization,
HTable managed a "write buffer", accumulating edits and sending a "batch" all
at once. By default the batch was sent as the last step in invocations of
put(Put) and put(List<Put>). The user could disable the automatic flushing of
the write buffer, retaining edits locally and only sending the whole "batch"
once the write buffer has filled or when the flushCommits() method in invoked
explicitly. Explicit or implicit batch writing was controlled by the
setAutoFlushTo(boolean) method. A value of true (the default) had the write
buffer flushed at the completion of a call to put(Put) or put(List<Put>). A
value of false allowed for explicit buffer management. HTable also exposed the
buffer to consumers via getWriteBuffer().

The combination of HTable with setAutoFlushTo(false) and the HTablePool
provided a convenient mechanism by which multiple "Put-producing" threads could
share a common write buffer. Both HTablePool and HTable are deprecated, and
they are officially replaced in The new 1.0 API by Table and BufferedMutator.
Table, which replaces HTable, no longer exposes explicit write-buffer
management. Instead, explicit buffer management is exposed via BufferedMutator.
BufferedMutator is made safe for concurrent use. Where code would previously
retrieve and return HTables from an HTablePool, now that code creates and
shares a single BufferedMutator instance across all threads.
2015-01-23 08:48:31 -08:00
Andrew Purtell 71ab4ddb19 HBASE-12731 Heap occupancy based client pushback 2015-01-22 17:33:21 -08:00
Nick Dimiduk 9824eb7840 HBASE-12810 Update to htrace-incubating 2015-01-22 14:28:20 -08:00
Sean Busbey 418ea93774 HBASE-12898 ensure direct dependencies are declared. 2015-01-22 14:33:25 -06:00
Nick Dimiduk 9bdb81f0a1 HBASE-12887 Cleanup many checkstyle errors in o.a.h.h.client 2015-01-20 12:44:36 -08:00
Andrew Purtell 03e17168c3 HBASE-12840 Improve unit test coverage of the client pushback mechanism 2015-01-17 11:50:26 -08:00
Enis Soztutar 092c91eb0f HBASE-12837 ReplicationAdmin leaks zk connections (stack) 2015-01-16 13:16:12 -08:00
Misty Stanley-Jones 1a21c1684c HBASE-11533 Asciidoc Proof of Concept 2015-01-13 22:32:29 -08:00
tedyu e5f3dd682f HBASE-11144 Filter to support scanning multiple row key ranges (Jiajia Li) 2015-01-13 07:02:06 -08:00
Andrew Purtell c32a2c0b16 HBASE-12839 Remove synchronization in ServerStatisticsTracker 2015-01-12 16:06:51 -08:00
Enis Soztutar 8816fa05c2 HBASE-12832 Describe table from shell no longer shows Table's attributes, only CF attributes (Srikanth Srungarapu) 2015-01-12 14:00:22 -08:00
Nick Dimiduk dde713ee4e HBASE-12071 Separate out thread pool for Master <-> RegionServer communication (Stephen Yuan Jiang) 2015-01-08 14:17:00 -08:00
tedyu 9246af8dac HBASE-12796 Clean up HTable and HBaseAdmin deprecated constructor usage (Jurriaan Mous) 2015-01-08 07:49:28 -08:00
Enis Soztutar c348cd327b HBASE-12788 Promote Abortable to LimitedPrivate 2015-01-05 16:29:27 -08:00
tedyu ac95cc1fbb HBASE-12783 Create efficient RegionLocator implementation (Solomon Duskis) 2015-01-02 19:48:06 -08:00
Jurriaan Mous e5ec14af04 HBASE-12761 On region jump ClientScanners should get next row start key instead of a skip.
Signed-off-by: stack <stack@apache.org>
2014-12-30 14:47:01 -08:00
Esteban Gutierrez b2eea8cac6 HBASE-12695 JDK 1.8 compilation broken
Signed-off-by: stack <stack@apache.org>
2014-12-29 11:02:04 -08:00
stack a8766fd623 HBASE-12641 Grant all permissions of hbase zookeeper node to hbase superuser in a secure cluster (Liu Shaohui) 2014-12-27 21:11:57 -08:00
stack 2b090d6832 HBASE-12739 Avoid too large identifier of ZooKeeperWatcher (Liu Shaohui) 2014-12-23 12:20:30 -08:00
Jurriaan Mous 4880e5d83b HBASE-12736
Signed-off-by: stack <stack@apache.org>
2014-12-23 10:30:25 -08:00
tedyu 700de7d92c HBASE-12750 getRequestsCount() in ClusterStatus returns total number of request (Weichen Ye) 2014-12-23 10:26:16 -08:00
Devaraj Das 1c45d1cd9d HBASE-12012. Improve cancellation for the scan RPCs 2014-12-22 16:22:04 -08:00
stack b004e4ff5b HBASE-11412 Minimize a number of hbase-client transitive dependencies (Sergey Beryozkin) 2014-12-19 07:55:53 -08:00
Enis Soztutar 83e4bfaf73 HBASE-11412 Minimize a number of hbase-client transitive dependencies (Sergey Beryozkin) 2014-12-17 21:53:18 -08:00
Andrew Purtell 99a11390b4 Amend HBASE-5162 Basic client pushback mechanism (Jesse Yates)
Applied hbase-5162-trunk-addendum.patch
2014-12-16 22:15:49 -08:00
Andrew Purtell 6a042c381a Revert "HBASE-5162 Basic client pushback mechanism (Jesse Yates); ADDENDUM"
This reverts commit f7154e1ac9.
2014-12-16 22:14:50 -08:00
stack f7154e1ac9 HBASE-5162 Basic client pushback mechanism (Jesse Yates); ADDENDUM 2014-12-16 21:09:52 -08:00
zhangduo c7fad665f3 HBASE-10201 Port 'Make flush decisions per column family' to trunk
Signed-off-by: stack <stack@apache.org>
2014-12-16 11:49:17 -08:00
Jesse Yates a411227b0e HBASE-5162 Basic client pushback mechanism
Instead of just blocking the client for 90 seconds when the region gets too
busy, it now sends along region load stats to the client so the client can
know how busy the server is. Currently, its just the load on the memstore, but
it can be extended for other stats (e.g. cpu, general memory, etc.).

It is then up to the client to decide if it wants to listen to these stats.
By default, the client ignores the stats, but it can easily be toggled to the
built-in exponential back-off or users can plug in their own back-off
implementations
2014-12-16 11:14:30 -08:00
stack 029768287a HBASE-12422 Use ConnectionFactory in HTable constructors Fix method signature in test 2014-12-14 19:42:15 -08:00
Enis Soztutar 743d16138e HBASE-12679 Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to LimitedPrivate 2014-12-14 17:46:30 -08:00
tedyu 65830b096b HBASE-12659 Replace the method calls to grant and revoke in shell scripts with AccessControlClient (Srikanth Srungarapu) 2014-12-13 10:17:43 -08:00
Jurriaan Mous 3275b964c1 HBASE-12668 Adapt PayloadCarryingRpcController so it can also be used in an async way
Signed-off-by: stack <stack@apache.org>
2014-12-12 07:44:04 -08:00
Misty Stanley-Jones 7d10af1254 HBASE-9763 Scan javadoc doesn't fully capture semantics of start and stop row (Gabriel Reid) 2014-12-12 13:39:16 +10:00
stack da2b5a9627 HBASE-12373 Provide a command to list visibility labels (Jerry He) 2014-12-11 15:18:03 -08:00
stack df22270756 HBASE-12665 When aborting, dump metrics
Add some fixup of checkstyle fails
2014-12-09 21:01:15 -08:00
Nick Dimiduk e720c83557 HBASE-12652 Allow unmanaged connections in MetaTableAccessor (Solomon Duskis) 2014-12-09 11:27:34 -08:00
Matteo Bertozzi 8a2c84156a HBASE-12564 consolidate the getTableDescriptors() semantic 2014-12-09 12:06:00 +00:00
Jurriaan Mous a8e6461855 HBASE-12597
Signed-off-by: stack <stack@apache.org>
2014-12-08 15:40:09 -08:00
stack 1a27cb7b0f Revert "HBASE-12597 Add RpcClient interface and enable changing of RpcClient implementation (Jurriaan Mous)"
Revert partial commit of HBASE-12597

This reverts commit 4be2034a26.
2014-12-08 15:35:50 -08:00
stack b8ab1b176c Revert "HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG"
Accidental commit. Reverting.

This reverts commit 2458be08ed.
2014-12-08 15:34:53 -08:00
stack 4be2034a26 HBASE-12597 Add RpcClient interface and enable changing of RpcClient implementation (Jurriaan Mous) 2014-12-08 15:13:50 -08:00
stack 2458be08ed HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG 2014-12-08 15:04:59 -08:00
stack 4b1983c89d HBASE-12611 Create autoCommit() method and remove clearBufferOnFail (Solomon Duskis) 2014-12-08 11:01:28 -08:00
tedyu 9e9be97af7 HBASE-12650 Move ServerName to hbase-common module - check in changed files 2014-12-08 07:08:44 -08:00
tedyu e930510c65 HBASE-12650 Move ServerName to hbase-common module - remove files 2014-12-08 07:01:47 -08:00
Devaraj Das 9fd6db3703 HBASE-11903. Directly invoking split & merge of replica regions should be disallowed 2014-12-07 11:56:53 -08:00
Gary Helmling b7d1790411 HBASE-12493 Addendum - Fix javadoc warnings 2014-12-06 00:33:12 -08:00
Gary Helmling 1ec6609b97 HBASE-12493 Make User and TokenUtil public 2014-12-05 13:04:54 -08:00
Andrew Purtell 09cd3d7bfb HBASE-10560 Per cell TTLs 2014-12-05 11:10:26 -08:00