988 Commits

Author SHA1 Message Date
Enis Soztutar
02963b202a HBASE-12072 Standardize retry handling for master operations 2014-11-26 12:09:44 -08:00
Enis Soztutar
54627ea6dc HBASE-12128 Cache configuration and RpcController selection for Table in Connection 2014-11-26 12:07:49 -08:00
stack
8df780db88 HBASE-12400 Fix refguide so it does connection#getTable rather than new HTable everywhere 2014-11-26 09:12:16 -08:00
stack
8b8f2026bd HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG 2014-11-25 21:21:50 -08:00
stack
e6b4300756 HBASE-12404 Task 5 from parent: Replace internal HTable constructor use with
HConnection#getTable (0.98, 0.99)

Replaced HTable under hbase-*/src/main/java. Skipped tests. Would take
till end of time to do all and some cases are cryptic. Also skipped
some mapreduce where HTable comes through in API. Can do both of
these stragglers in another issue.
Generally, if a utility class or standalone class, tried to pass in a
Connection rather than have the utility or standalone create its own
connection on each invocation; e.g. the Quota stuff. Where not possible,
noted where invocation comes from... if test or hbck, didn't worry about
it.
Some classes are just standalone and nothing to be done to avoid
a Connection setup per invocation (this is probably how it worked
in the new HTable...days anyways). Some classes are not used:
AggregationClient, FavoredNodes... we should just purge this stuff.
Doc on what short circuit connection does (I can just use it...
I thought it was just for short circuit but no, it switches dependent
on where you are connecting).
Changed HConnection to super Interface ClusterConnection where safe (
internal usage by private classes only).
Doc cleanup in example usage so we do new mode rather than the old
fashion.
Used java7 idiom that allows you avoid writing out finally to call close
on implementations of Closeable.
Added a RegistryFactory.. moved it out from being inner class.
Added a utility createGetClosestRowOrBeforeReverseScan method to Scan
to create a Scan that can ...
Renamed getShortCircuitConnection as getConnection – users don't need
to know what implementation does (that it can short-circuit RPC).
The old name gave pause. I was frightened to use it thinking it only
for short-circuit reading – that it would not do remote too.
Squashed commit of the following:
2014-11-25 08:15:20 -08:00
stack
336c22d581 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) under src/main/java
Move from HConnection to ClusterConnection or Connection
Use unmanaged connections where we use managed previous
(used the jdk7 https://docs.oracle.com/javase/7/docs/technotes/guides/language/try-with-resources.html idiom).

In ZKConfig, synchronize on Configuration rather than make a copy.
Making a copy we were dropping hbase configs in certain test context
(could not find the zk ensemble because default port).

In tests, some move to the new style connection setup but mostly
fixes for premature connection close or adding cleanup where it
was lacking.
2014-11-24 09:46:28 -08:00
Enis Soztutar
882324dbcc HBASE-10671 Add missing InterfaceAudience annotations for classes in hbase-common and hbase-client modules 2014-11-21 11:44:46 -08:00
Matteo Bertozzi
325cdc0987 HBASE-12073 Shell command user_permission fails on the table created by user if he is not global admin (Srikanth Srungarapu) 2014-11-21 10:55:48 +00:00
tedyu
e4a68606f5 HBASE-8572 Enhance delete_snapshot.rb to call snapshot deletion API with regex (Ashish Singhi) 2014-11-20 08:57:42 -08:00
stack
5f391efda1 Revert "HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)"
This reverts commit d3e7c3cfa9cd77607e642e4a776969dd1c8a27d5.
2014-11-18 16:30:52 -08:00
stack
b94e6738d9 HBASE-10378 Refactor write-ahead-log implementation -- ADDEDNUM 2014-11-18 12:12:35 -08:00
Sean Busbey
f5e05eb836 HBASE-10378 Refactor write-ahead-log implementation
Incompatible changes called out in release notes on jira.

* Cleaned up references to HLog
* Deprecates HLogKey but maintains it for compatibility
  - Moves all Writeable from WALKey to HLogKey
* Adds utility code to CoprocessorHost to help with evolving Coprocessor APIs
* RSRpcServices roll WAL call now requests the non-meta LogRoller roll all logs
  - rolls actually happen asynchronously
  - deprecated old api (and noted incompatible behavior change)
  - modified api in new Admin interface to reflect lack of return values.
* Moved WAL user facing API to "WAL"
  - only 1 sync offered
  - WALTrailer removed from API
* make provider used by the WALFactory configurable.
* Move all WAL requests to use opaque ids instead of paths
* WALProvider provides API details for implementers and handles creation of WALs.
* Refactor WALActionsListener to have a basic implementation.
* turn MetricsWAL into a WALActionsListener.
* tests that needs FSHLog implementation details use them directly, others just reference provider + factory
  - Some tests moved from Large to Medium based on run time.
* pull out wal disabling into its own no-op class
* update region open to delegate to WALFactory
* update performance test tool to allow for multiple regions
* Removed references to meta-specific wals within wal code
  - replaced with generic suffixes
  - WALFactory maintains a dedicated WALProvider for meta (and so knows about the distinction)
* maintain backwards compat on HLogPrettyPrinter and mark it deprecated.
  - made WALPrettyPrinter IA.Private in favor of `bin/hbase wal`
* move WALUtil stuff that's implementation specific to said implementation
  - WALUtil now acts as an integration point between the RegionServer and hte WAL code.

Incorporates contributions from v.himanshu.

Signed-off-by: stack <stack@apache.org>
2014-11-18 12:04:41 -08:00
stack
d3e7c3cfa9 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) 2014-11-18 09:48:54 -08:00
Enis Soztutar
f641aada36 HBASE-12445 hbase is removing all remaining cells immediately after the cell marked with marker = KeyValue.Type.DeleteColumn via PUT (Hani Nadra) 2014-11-12 15:50:10 -08:00
stack
fb6c5c7fe8 HBASE-10483 Provide API for retrieving info port when hbase.master.info.port is set to 0 (Liu Shaohui) 2014-11-12 08:56:42 -08:00
Srikanth Srungarapu
6e80af2044 HBASE-12460 Moving Chore to hbase-common module
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2014-11-11 23:15:42 +00:00
stack
e287741388 HBASE-12434 Add a command to compact all the regions in a regionserver (Liu Shaohui) 2014-11-11 09:32:55 -08:00
Nick Dimiduk
fb1af86ee1 HBASE-12432 RpcRetryingCaller should log after fixed number of retries like AsyncProcess
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2014-11-07 12:27:21 -08:00
stack
c71244c02d HBASE-12329 Table create with duplicate column family names quietly succeeds (Jingcheng Du) 2014-11-05 17:32:21 -08:00
stack
b0eaa92f5b HBASE-8707 Add LongComparator for filter (Liu Shaohui) 2014-11-05 16:56:43 -08:00
Lars Hofhansl
ecd708671c HBASE-12363 Improve how KEEP_DELETED_CELLS works with MIN_VERSIONS. 2014-11-04 17:08:39 -08:00
Jeffrey Zhong
371bb39ee6 HBASE-12407: HConnectionKey doesn't contain CUSTOM_CONTROLLER_CONF_KEY in CONNECTION_PROPERTIES 2014-11-03 21:04:22 -08:00
Lars Hofhansl
d4504afdd4 HBASE-12417 Scan copy constructor does not retain small attribute. 2014-11-03 15:06:29 -08:00
Nick Dimiduk
008e990deb HBASE-12416 RegionServerCallable should report what host it was communicating with 2014-11-03 14:21:25 -08:00
Andrew Purtell
a62f543c65 HBASE-12361 Show data locality of region in table page (Liu Shaohui) 2014-10-31 15:41:57 -07:00
Enis Soztutar
2d1cfc14f2 HBASE-12377 HBaseAdmin#deleteTable fails when META region is moved around the same timeframe (Stephen Yuan Jiang) 2014-10-31 12:09:38 -07:00
Ashish Singhi
cacdb89e03 HBASE-10870 Deprecate and replace HCD methods that have a 'should' prefix with a 'is' instead
Signed-off-by: stack <stack@apache.org>
2014-10-31 08:34:00 -07:00
stack
9f4b6ac06c HBASE-11835 Wrong managenement of non expected calls in the client (Nicolas Liochon) 2014-10-30 12:41:54 -07:00
stack
5062edebcf HBASE-12238 A few ugly exceptions on startup 2014-10-29 21:42:29 -07:00
stack
889333a6fd HBASE-12313 Redo the hfile index length optimization so cell-based rather than serialized KV key 2014-10-29 11:33:49 -07:00
manukranthk
ece933fa3e Implement Preemptive Fast Fail
Summary: This diff ports the Preemptive Fast Fail feature to OSS. In multi threaded clients, we use a feature developed on 0.89-fb branch called Preemptive Fast Fail. This allows the client threads which would potentially fail, fail fast. The idea behind this feature is that we allow, among the hundreds of client threads, one thread to try and establish connection with the regionserver and if that succeeds, we mark it as a live node again. Meanwhile, other threads which are trying to establish connection to the same server would ideally go into the timeouts which is effectively unfruitful. We can in those cases return appropriate exceptions to those clients instead of letting them retry.

Test Plan: Unit tests

Differential Revision: https://reviews.facebook.net/D24177

Signed-off-by: stack <stack@apache.org>
2014-10-28 22:47:50 -07:00
Nick Dimiduk
bb81b9fde5 HBASE-12356 Rpc with region replica does not propagate tracing spans 2014-10-28 10:27:59 -07:00
Andrew Purtell
70a312e53f HBASE-11912 Catch some bad practices at compile time with error-prone 2014-10-27 09:29:23 -07:00
stack
1d6c4678bb HBASE-2609 Harmonize the Get and Delete operations 2014-10-25 20:58:24 -07:00
Andrew Purtell
ff5bc351b2 Revert "HBASE-11912 Catch some bad practices at compile time with error-prone"
This reverts commit 7ed0260eff425e7e7a57193a67419fae29aa4f30.
2014-10-25 08:33:43 -07:00
Andrew Purtell
7ed0260eff HBASE-11912 Catch some bad practices at compile time with error-prone 2014-10-24 18:15:12 -07:00
Lars Hofhansl
6c7543c9c7 HBASE-12334 Handling of DeserializationException causes needless retry on failure. 2014-10-24 16:21:33 -07:00
Elliott Clark
c623b04122 HBASE-12283 Clean up some checkstyle errors 2014-10-22 11:58:23 -07:00
Matteo Bertozzi
2908c11371 HBASE-12301 user_permission command does not show global permissions 2014-10-22 10:08:31 +01:00
stack
c450298c44 HBASE-12307 Remove unused Imports in hbase-client and hbase-common 2014-10-21 21:53:04 -07:00
Ted Yu
6c70f4f7f7 HBASE-12302 VisibilityClient getAuths does not propagate remote service exception correctly (Jerry He) 2014-10-21 20:09:46 +00:00
Matteo Bertozzi
49056295ef HBASE-12161 Add support for grant/revoke on namespaces in AccessControlClient (Srikanth Srungarapu) 2014-10-18 21:18:42 +01:00
manukranthk
5c92bded9d Add admin endpoint for updating the configuration on the regionserver
Summary: This is a follow up diff for the jira to add the functionality to update configs in an online fashion.

Test Plan: Unit test. This adds an end point on the regionserver. It just tries to call the end point and make sure the call succeeds.

Differential Revision: https://reviews.facebook.net/D24861

Signed-off-by: stack <stack@apache.org>
2014-10-18 16:16:21 -04:00
stack
904654aa87 HBASE-12147 Porting Online Config Change from 89-fb -- JAVADOC FIX ADDENDUM 2014-10-13 21:25:51 -07:00
Enis Soztutar
6abb883865 HBASE-12083 Deprecate new HBaseAdmin() in favor of Connection.getAdmin() 2014-10-13 13:20:16 -07:00
stack
9a893a9c6a HBASE-12029 Use Table and RegionLocator in HTable.getRegionLocations() (Solomon Duskis) 2014-10-13 12:24:27 -07:00
stack
b30d2f315d HBASE-12242 Fix new javadoc warnings in Admin, etc. 2014-10-13 12:07:50 -07:00
Ted Yu
3851d05a80 HBASE-12237 HBaseZeroCopyByteString#wrap() should not be called in hbase-client code 2014-10-13 17:29:09 +00:00
Andrew Purtell
8ee55fb339 HBASE-12126 Region server coprocessor endpoint (Virag Kothari) 2014-10-10 12:00:51 -07:00
stack
65ae2e5126 HBASE-11394 Replication can have data loss if peer id contains hyphen "-" 2014-10-10 10:28:16 -07:00