Commit Graph

886 Commits

Author SHA1 Message Date
stack 8cd3001f81 Revert "HBASE-11544 [Ergonomics] hbase.client.scanner.caching is dogged and will try to return batch even if it means OOME"
References the wrong JIRA above so revert; also an addendum is on the
way.

This reverts commit 26ba621e47.
2015-04-08 09:32:09 -07:00
Jonathan Lawlor 26ba621e47 HBASE-11544 [Ergonomics] hbase.client.scanner.caching is dogged and will try to return batch even if it means OOME
Added in some check-style fixes to bring us back under the limit

Signed-off-by: stack <stack@apache.org>
2015-04-08 08:16:54 -07:00
Ashish Singhi 4d5a11e082 HBASE-13299 Add setReturnResults() to Increment, like Append has
Signed-off-by: stack <stack@apache.org>
2015-04-07 11:46:56 -07:00
Ashish Singhi 8c740f4309 HBASE-13411 Misleading error message when request size quota limit exceeds
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-04-06 22:31:07 +01:00
Andrew Purtell 8c707499ba HBASE-13409 Add categories to uncategorized tests 2015-04-06 11:02:18 -07:00
Jonathan Lawlor 057499474c HBASE-13374 Small scanners (with particular configurations) do not return all rows
Signed-off-by: Enis Soztutar <enis@apache.org>
2015-04-05 14:27:23 -07:00
Mikhail Antonov 578df6dfc0 HBASE-13252 Get rid of managed connections and connection caching
Signed-off-by: stack <stack@apache.org>
2015-04-02 12:00:42 -07:00
Josh Elser ffdcc00952 HBASE-13335 Use serverHasMoreResults context in SmallScanner and SmallReversedScanner.
Use the context passed back via ScanResponse that a RegionServer
fills in to denote whether or not more results existing in the
current Region. Add a simple factory to remove a static method
used across both SmallScanner and SmallReverseScanner. Add new
unit tests for both scanner classes to test scans with and
without the new context (as a quick backward-compatibility test).
2015-03-31 21:32:49 -07:00
Elliott Clark 55a5a3be33 HBASE-13364 Make error prone off by default 2015-03-30 16:03:53 -07:00
stack 3815a33e34 HBASE-13361 Remove or undeprecate {get|set}ScannerCaching in HTable (Lars Francke) 2015-03-30 08:16:23 -07:00
Josh Elser ced0e324a1 HBASE-13262 Observe ScanResponse.moreResults in ClientScanner.
The RS already returns to the client whether or not it has additional
results to be returned in a subsequent call to scan(), but the ClientScanner
did not use or adhere to this value. Subsequently, this can lead to
bugs around moving to the next region too early. A new method was added
to ClientScanner in the name of testability.

Encapsulate server-state into RegionServerCallable to avoid
modifying parameterization of callable impls.

Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-03-28 18:56:52 -07:00
Josh Elser 98b1e72d1c HBASE-13222 Add isBalancerEnabled method to Master and Admin.
Include some basic tests for the method on a testing cluster.
Also update master page to show an alert when balancer is disabled.

Signed-off-by: Enis Soztutar <enis@apache.org>
2015-03-27 14:28:03 -07:00
Sameet Agarwal ba6345f7d1 HBASE-13316 Reduce the downtime on planned moves of regions
Summary:
The current behavior of a region move shuts down a region and then starts is up in another regionserver. This causes increased latency and possibly timeouts till the new region's cache is fully warmed up. We can make a region move less disruptive by warming the cache in the destination region server before shutting dow the old region.

See https://issues.apache.org/jira/browse/HBASE-13316

Test Plan:
1. Unit Tests
2. Added test for concurrent moves and warmups
3. Manually tested reads/writes happening with concurrent moves

Subscribers: tedyu

Differential Revision: https://reviews.facebook.net/D35967

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-03-27 11:48:01 -07:00
Andrey Stepachev e26c4e4e67 HBASE-5238 Add a log4j category for all edits to META/ROOT 2015-03-25 23:03:18 +00:00
Elliott Clark 134b95579c HBASE-13325 Protocol Buffers 2.5 no longer available for download on code.google.com 2015-03-25 14:05:34 -07:00
stack 50daed268e HBASE-13298 Clarify if Table.{set|get}WriteBufferSize() is deprecated or not 2015-03-25 13:10:04 -07:00
stack 04740703e9 HBASE-13248 Make HConnectionImplementation top-level class; ADDENDUM -- missing file 2015-03-25 11:11:38 -07:00
Ashish Singhi b5c4d9a04f HBASE-13305 Get(Get get) is not copying the row key
Signed-off-by: stack <stack@apache.org>
2015-03-25 07:39:05 -07:00
stack 8579c6dd49 HBASE-13248 Make HConnectionImplementation top-level class 2015-03-25 07:25:44 -07:00
Mikhail Antonov 8cb4f89c01 HBASE-13273 Make Result.EMPTY_RESULT read-only; currently it can be modified
Signed-off-by: Sean Busbey <busbey@cloudera.com>
2015-03-24 12:33:02 -07:00
Matteo Bertozzi 80d230e1fb HBASE-13314 Fix NPE in HMaster.getClusterStatus() 2015-03-24 09:28:06 +00:00
Nick Dimiduk 5459008ccd HBASE-13315 BufferedMutator should be @InterfaceAudience.Public (addendum) 2015-03-23 16:38:32 -07:00
zhangduo 6e9ded51fb HBASE-13310 Fix high priority findbugs warnings 2015-03-24 06:50:04 +08:00
Nick Dimiduk 1428a59caf HBASE-13315 BufferedMutator should be @InterfaceAudience.Public (Solomon Duskis) 2015-03-23 12:16:29 -07:00
Nicolas Liochon 6d4460341e HBASE-13286 Minimum timeout for a rpc call could be 1 ms instead of 2 seconds 2015-03-20 19:09:43 +01:00
stack 34347a3639 HBASE-13274 Fix misplaced deprecation in Delete#addXYZ (Mikhail Antonov) 2015-03-20 09:43:56 -07:00
stack f57dca5e1b HBASE-13198 Remove HConnectionManager (Mikhail Antonov) 2015-03-20 09:41:48 -07:00
Liu Shaohui 602e11cc74 HBASE-13216 Add version info in RPC connection header (Shaohui Liu) 2015-03-19 10:30:55 +08:00
Andrey Stepachev 7a08ad9df8 HBASE-13093 Local mode HBase instance doesn't shut down. 2015-03-17 14:46:30 +00:00
stack a75a2ace4f HBASE-13193 RegionScannerImpl filters should not be reset if a partial Result is returned (Jonathan Lawlor) 2015-03-16 13:26:34 -07:00
stack c5aca1919d HBASE-12586 Task 6 & 7 from HBASE-9117, delete all public HTable constructors and delete ConnectionManager#{delete,get}Connection (Mikhail Antonov) 2015-03-16 11:20:14 -07:00
Josh Elser 72855c584e HBASE-13236 Add addt'l lifecycle-mapping executions.
Adds a number of lifecycle-mapping entries which
prevent errors from showing up in Eclipse on a fresh
import of HBase. For plugins defined in the top-level
pom, the mapping is added there; otherwise, the mapping
is pushed down to the child pom.

Signed-off-by: Sean Busbey <busbey@apache.org>
2015-03-13 22:35:52 -05:00
anoopsjohn 0f69ea409f HBASE-13232 ConnectionManger : Batch pool threads and metaLookup pool threads should use different name pattern. 2015-03-13 22:51:29 +05:30
tedyu 1cc1142379 HBASE-13162 Addendum adds InterfaceAudience annotation to ZkAclReset 2015-03-12 19:10:03 -07:00
Jonathan M Hsieh 3509cc2134 HBASE-13162 Add capability for cleaning hbase acls to hbase cleanup script (Srikanth Srungarapu) 2015-03-12 17:06:27 -07:00
tedyu 7a3ea23704 HBASE-13171 Change AccessControlClient methods to accept connection object to reduce setup time (Srikanth Srungarapu) 2015-03-11 18:24:12 -07:00
Enis Soztutar c938267db3 HBASE-13063 Allow to turn off memstore replication for region replicas - ADDENDUM for turning of primary flush tigger when this is enabled 2015-03-11 14:56:54 -07:00
stack b436db7d70 HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer; ADDENDUM 2015-03-10 22:17:08 -07:00
Matteo Bertozzi cbf03787ea HBASE-13063 Allow to turn off memstore replication for region replicas 2015-03-10 10:02:04 +00:00
zhangduo 9b53a1c214 HBASE-12405 WAL accounting by Store 2015-03-10 13:00:02 +08:00
Enis Soztutar 5025d3aa91 HBASE-13121 Async wal replication for region replicas and dist log replay does not work together 2015-03-09 15:49:09 -07:00
Andrey Stepachev 948746ce4e HBASE-12990 MetaScanner should be replaced by MetaTableAccessor 2015-03-09 10:39:59 +00:00
Enis Soztutar 95fc53f105 HBASE-12706 Support multiple port numbers in ZK quorum string (Stephen Yuan Jiang) 2015-03-06 16:46:17 -08:00
stack 9159c82fbf HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer 2015-03-06 14:35:08 -08:00
tedyu 8449251fb6 HBASE-13122 Improve efficiency for return codes of some filters (Shuaifeng) 2015-03-05 18:42:22 -08:00
stack 74837d9b1f Revert " HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer"
OVERCOMMIT. REVERT.

This reverts commit 55f8f56ad2.
2015-03-04 22:58:02 -08:00
stack 55f8f56ad2 HBASE-13142 [PERF] Reuse the IPCUtil#buildCellBlock buffer
Rename ByteBufferReservoir as BoundedByteBufferPool
2015-03-04 22:44:20 -08:00
Jonathan Lawlor de9791e91e HBASE-11544: [Ergonomics] hbase.client.scanner.caching is dogged and will try to return batch even if it means OOME
Signed-off-by: stack <stack@apache.org>
2015-03-04 17:34:48 -08:00
Misty Stanley-Jones 39425a8558 HBASE-11670 Generate PDF of Reference Guide 2015-03-05 09:31:11 +10:00
Lars Hofhansl 464e7ce685 HBASE-13109 Make better SEEK vs SKIP decisions during scanning. 2015-03-04 14:03:47 -08:00
Enis Soztutar 9899aab12b HBASE-11580 Failover handling for secondary region replicas 2015-03-03 11:48:12 -08:00
tedyu e0019d99de HBASE-13122 Revert pending answer to Ram's question 2015-03-02 21:00:26 -08:00
Andrew Purtell 0c63eeb511 HBASE-12995 Document that HConnection#getTable methods do not check table existence since 0.98.1 2015-03-02 16:58:45 -08:00
tedyu 7b5c9eabac HBASE-13122 Improve efficiency for return codes of some filters (Shuaifeng Zhou) 2015-03-02 07:47:33 -08:00
tedyu 4980bfe642 HBASE-13134 mutateRow and checkAndMutate apis don't throw region level exceptions (Francis Liu) 2015-03-01 20:22:07 -08:00
Sean Busbey dad2474f08 HBASE-13131 ReplicationAdmin must clean up connections if constructor fails. 2015-03-01 00:20:44 -06:00
zhangduo 21f12ce8e5 HBASE-13097 addendum use default ByteBufAllocator
Signed-off-by: stack <stack@apache.org>
2015-02-27 17:18:59 -08:00
zhangduo d1619bceb3 HBASE-13097 Use same EventLoopGroup for different AsyncRpcClients if possible
Signed-off-by: stack <stack@apache.org>
2015-02-27 08:34:46 -08:00
Nick Dimiduk c651271f57 HBASE-13086 Show ZK root node on Master WebUI 2015-02-24 19:04:12 -08:00
Ashish Singhi 913ea2c222 HBASE-13048 Use hbase.crypto.wal.algorithm in SecureProtobufLogReader while decrypting the data
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-24 18:18:07 -08:00
Devaraj Das 70412d886c HBASE-13067. Fix caching of stubs to allow IP address changes of restarted remote servers. 2015-02-23 22:15:03 -08:00
zhangduo b20675f5af HBASE-12953 RegionServer is not functionally working with AysncRpcClient in secure mode
Signed-off-by: stack <stack@apache.org>
2015-02-23 20:38:19 -08:00
Enis Soztutar e405017a31 HBASE-12561 Replicas of regions can be cached from different instances of the table in MetaCache 2015-02-23 11:06:17 -08:00
tedyu 9a311303a8 HBASE-13057 Provide client utility to easily enable and disable table replication (Ashish Singhi) 2015-02-20 10:18:47 -08:00
Ashish Singhi 31f17b17f0 HBASE-13002 Make encryption cipher configurable
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-18 11:42:20 -08:00
Devaraj Das 14bb352b02 HBASE-13036. Meta scanner should use its own threadpool 2015-02-18 10:23:02 -08:00
zhangduo 20bc74dff0 HBASE-13066 Fix typo in AsyncRpcChannel
Signed-off-by: stack <stack@apache.org>
2015-02-18 09:43:27 -08:00
zhangduo e99091e97c HBASE-13011 TestLoadIncrementalHFiles is flakey when using AsyncRpcClient as client implementation
Added comment to AsyncRpcChannel data members

Signed-off-by: stack <stack@apache.org>
2015-02-16 09:03:31 -08:00
Sean Busbey c96df5e240 HBASE-13027 Ensure extension of TableInputFormatBase works.
* move mapreduce version of TableInputFormat tests out of mapred
* add ability to get runnable job via MR test shims
* correct the javadoc example for current APIs.
* add tests the run a job based on the extending TableInputFormatBase (as given in the javadocs)
* add tests that run jobs based on the javadocs from 0.98
* fall back to our own Connection if ussers of the deprecated table configuration have a managed connection.
2015-02-13 18:41:04 -06:00
stack 3babad30e6 HBASE-13030 [1.0.0 polish] Make ScanMetrics public again and align Put 'add' with Get, Delete, etc., addColumn 2015-02-13 15:24:38 -08:00
Enis Soztutar 3e10e6e1a6 HBASE-11569 Flush / Compaction handling from secondary region replicas 2015-02-13 11:08:24 -08:00
Ashish Singhi 16ed345191 HBASE-9531 a command line (hbase shell) interface to retreive the replication metrics and show replication lag
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-12 14:50:01 -08:00
Andrew Purtell dc522d010c HBASE-12996 Reversed field on Filter should be transient (Ian Friedman) 2015-02-11 12:17:51 -08:00
stack dec0ec2290 HBASE-13016 Clean up remnants of table states stored in table descriptors (Andrey Stepachev) 2015-02-11 11:09:03 -08:00
stack fa852c4ce6 HBASE-12035 Keep table state in META (Andrey Stepachev) 2015-02-10 14:20:47 -08:00
Jeffrey Zhong 3f4427739d HBASE-11567 Write bulk load COMMIT events to WAL (Alex Newman, Jeffrey Zhong) 2015-02-06 18:07:30 -08:00
stack 96cdc7987e HBASE-12958 SSH doing hbase:meta get but hbase:meta not assigned 2015-02-04 22:56:40 -08:00
Victoria Dudin 4f472062a4 HBASE-12961 Fix negative values in read and write region server metrics. 2015-02-04 10:32:09 -08:00
Devaraj Das cf5ad96fcc HBASE-10942. support parallel request cancellation for multi-get (Nicolas Liochon & Devaraj Das) 2015-02-02 23:01:31 -08:00
zhangduo fef78acf65 HBASE-12951 TestHCM.testConnectionClose is flakey when using AsyncRpcClient as client implementation
Signed-off-by: stack <stack@apache.org>
2015-02-02 08:27:57 -08:00
stack 538388c2b5 HBASE-6778 Deprecate Chore; its a thread per task when we should have one thread to do all tasks (Jonathan Lawlor) 2015-01-29 19:26:26 -08:00
Lars Hofhansl 1270e590d1 HBASE-12859 New master API to track major compaction completion. 2015-01-29 13:58:27 -08:00
Devaraj Das 6b20a0f831 HBASE-11574. hbase:meta's regions can be replicated 2015-01-27 16:40:29 -08:00
tedyu aaeafca920 HBASE-7847 Use zookeeper multi to clear znodes (Rakesh R) 2015-01-26 21:40:39 -08:00
Enis Soztutar 2fb19fb951 HBASE-11908 Region replicas should be added to the meta table at the time of table creation 2015-01-26 19:55:47 -08:00
tedyu 26b8b48b42 HBASE-12915 Disallow small scan with batching 2015-01-26 10:58:53 -08:00
stack a4be1b84e4 HBASE-12684 Add new AsyncRpcClient (Jurriaan Mous) -- SMALL AMENDMENT 2015-01-24 18:24:32 -08:00
Jurriaan Mous 854f13afa1 HBASE-12684 Add new AsyncRpcClient (Jurriaan Mous)
Signed-off-by: stack <stack@apache.org>
2015-01-24 18:05:39 -08:00
Nick Dimiduk 588b43b06b HBASE-12728 buffered writes substantially less useful after removal of HTablePool (addendum) 2015-01-23 14:45:21 -08:00
Nick Dimiduk ab18158e60 HBASE-12728 buffered writes substantially less useful after removal of HTablePool (Solomon Duskis and Nick Dimiduk)
In our pre-1.0 API, HTable is considered a light-weight object that consumed by
a single thread at a time. The HTablePool class provided a means of sharing
multiple HTable instances across a number of threads. As an optimization,
HTable managed a "write buffer", accumulating edits and sending a "batch" all
at once. By default the batch was sent as the last step in invocations of
put(Put) and put(List<Put>). The user could disable the automatic flushing of
the write buffer, retaining edits locally and only sending the whole "batch"
once the write buffer has filled or when the flushCommits() method in invoked
explicitly. Explicit or implicit batch writing was controlled by the
setAutoFlushTo(boolean) method. A value of true (the default) had the write
buffer flushed at the completion of a call to put(Put) or put(List<Put>). A
value of false allowed for explicit buffer management. HTable also exposed the
buffer to consumers via getWriteBuffer().

The combination of HTable with setAutoFlushTo(false) and the HTablePool
provided a convenient mechanism by which multiple "Put-producing" threads could
share a common write buffer. Both HTablePool and HTable are deprecated, and
they are officially replaced in The new 1.0 API by Table and BufferedMutator.
Table, which replaces HTable, no longer exposes explicit write-buffer
management. Instead, explicit buffer management is exposed via BufferedMutator.
BufferedMutator is made safe for concurrent use. Where code would previously
retrieve and return HTables from an HTablePool, now that code creates and
shares a single BufferedMutator instance across all threads.
2015-01-23 08:48:31 -08:00
Andrew Purtell 71ab4ddb19 HBASE-12731 Heap occupancy based client pushback 2015-01-22 17:33:21 -08:00
Nick Dimiduk 9824eb7840 HBASE-12810 Update to htrace-incubating 2015-01-22 14:28:20 -08:00
Sean Busbey 418ea93774 HBASE-12898 ensure direct dependencies are declared. 2015-01-22 14:33:25 -06:00
Nick Dimiduk 9bdb81f0a1 HBASE-12887 Cleanup many checkstyle errors in o.a.h.h.client 2015-01-20 12:44:36 -08:00
Andrew Purtell 03e17168c3 HBASE-12840 Improve unit test coverage of the client pushback mechanism 2015-01-17 11:50:26 -08:00
Enis Soztutar 092c91eb0f HBASE-12837 ReplicationAdmin leaks zk connections (stack) 2015-01-16 13:16:12 -08:00
Misty Stanley-Jones 1a21c1684c HBASE-11533 Asciidoc Proof of Concept 2015-01-13 22:32:29 -08:00
tedyu e5f3dd682f HBASE-11144 Filter to support scanning multiple row key ranges (Jiajia Li) 2015-01-13 07:02:06 -08:00
Andrew Purtell c32a2c0b16 HBASE-12839 Remove synchronization in ServerStatisticsTracker 2015-01-12 16:06:51 -08:00
Enis Soztutar 8816fa05c2 HBASE-12832 Describe table from shell no longer shows Table's attributes, only CF attributes (Srikanth Srungarapu) 2015-01-12 14:00:22 -08:00