798 Commits

Author SHA1 Message Date
stack
4cb5d15b60 HBASE-12739 Avoid too large identifier of ZooKeeperWatcher (Liu Shaohui) 2014-12-23 12:21:05 -08:00
Jurriaan Mous
611ee0eb72 HBASE-12736 Let MetaScanner recycle a given Connection (Jurriaan Mous)
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestRestartCluster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestEndToEndSplitTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsck.java
2014-12-23 10:59:18 -08:00
tedyu
59f93e2384 HBASE-12750 getRequestsCount() in ClusterStatus returns total number of request (Weichen Ye) 2014-12-23 10:26:49 -08:00
Devaraj Das
949982fc6e HBASE-12012. Improve cancellation for the scan RPCs (patch from master; had to resolve some conflicts) 2014-12-22 16:45:41 -08:00
stack
b97ba6fc48 HBASE-11412 Minimize a number of hbase-client transitive dependencies (Sergey Beryozkin) 2014-12-19 07:56:34 -08:00
zhangduo
e55ef7a663 HBASE-10201 Port 'Make flush decisions per column family' to trunk
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MemStoreFlusher.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
2014-12-18 15:58:55 -08:00
Enis Soztutar
d66ae28c07 Update pom.xml version for 1.1.0-SNAPSHOT for branch-1 2014-12-17 23:16:41 -08:00
Enis Soztutar
e5f2033643 HBASE-11412 Minimize a number of hbase-client transitive dependencies (Sergey Beryozkin) 2014-12-17 21:53:43 -08:00
stack
476bd40716 HBASE-12652 Allow unmanaged connections in MetaTableAccessor (Solomon Duskis); REAPPLY 2014-12-17 11:11:35 -08:00
stack
4587a693b0 Revert "HBASE-12652 Allow unmanaged connections in MetaTableAccessor (Solomon Duskis)"
This reverts commit 1c99261f5367bc4221152212068c6dc4fe4bc6f7.
2014-12-16 17:00:37 -08:00
stack
f0afcd2cc2 HBASE-12689 Move version on from 0.99.2 to HBASE-1.0.0-SNAPSHOT 2014-12-14 20:37:59 -08:00
stack
b1c95d50cf HBASE-12422 Use ConnectionFactory in HTable constructors Fix method signature in test
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/coprocessor/SecureBulkLoadClient.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/HBaseFsck.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestHBaseFsck.java
2014-12-14 19:56:20 -08:00
Enis Soztutar
4f22143dfa HBASE-12679 Add HBaseInterfaceAudience.TOOLS and move some of the Public classes to LimitedPrivate 2014-12-14 17:52:05 -08:00
tedyu
b7bb9d9505 HBASE-12659 Replace the method calls to grant and revoke in shell scripts with AccessControlClient (Srikanth Srungarapu) 2014-12-13 10:19:18 -08:00
Jurriaan Mous
54381aab11 HBASE-12668 Adapt PayloadCarryingRpcController so it can also be used in an async way
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/TimeLimitedRpcController.java
2014-12-12 07:54:34 -08:00
stack
e3e9c96f89 HBASE-12373 Provide a command to list visibility labels (Jerry He)
Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsWithDefaultVisLabelService.java
2014-12-11 15:20:40 -08:00
stack
51bbbbaf2b HBASE-12665 When aborting, dump metrics
Add some fixup of checkstyle fails

Conflicts:
	hbase-common/src/main/java/org/apache/hadoop/hbase/CellUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/http/jmx/JMXJsonServlet.java
2014-12-09 21:08:10 -08:00
Nick Dimiduk
1c99261f53 HBASE-12652 Allow unmanaged connections in MetaTableAccessor (Solomon Duskis) 2014-12-09 11:50:47 -08:00
Matteo Bertozzi
09617cc2aa HBASE-12564 consolidate the getTableDescriptors() semantic 2014-12-09 12:06:39 +00:00
stack
1d880e3f60 HBASE-12597 Add RpcClient interface and enable changing of RpcClient implementation (Jurriaan Mous) 2014-12-08 15:23:38 -08:00
stack
823656bf83 HBASE-12611 Create autoCommit() method and remove clearBufferOnFail (Solomon Duskis)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
2014-12-08 11:17:59 -08:00
Nick Dimiduk
081ce3f8de HBASE-12163 Move test annotation classes to the same package as in master 2014-12-08 10:38:58 -08:00
Gary Helmling
6c4863f355 HBASE-12493 Make User and TokenUtil public 2014-12-06 02:10:31 -08:00
Andrew Purtell
004e977ba0 HBASE-10560 Per cell TTLs 2014-12-05 11:11:15 -08:00
tedyu
2e47c37b71 HBASE-12204 Backport HBASE-12016 'Reduce number of versions in Meta table. Make it configurable' to branch-1 2014-12-04 12:18:58 -08:00
stack
bb07de1960 HBASE-12431 Use of getColumnLatestCell(byte[], int, int, byte[], int, int) is Not Thread Safe (Jingcheng Du)
(cherry picked from commit c45772e76a581838ea89ff303d0ff67ceaa82845)
2014-12-03 22:35:14 -08:00
Enis Soztutar
5f150e49f9 Update pom.xml version for 0.99.2 2014-12-02 20:28:29 -08:00
stack
e424d4254e HBASE-12490 Replace uses of setAutoFlush(boolean, boolean) (Solomon Duskis) -- ADDENDUM to fix failing TestAsyncProcess#testHTableFailedPutAndNewPut 2014-12-02 11:48:46 -08:00
stack
2b976c6bd1 HBASE-12490 Replace uses of setAutoFlush(boolean, boolean) (Solomon Duskis) 2014-12-02 09:34:04 -08:00
Sean Busbey
8959828fb5 HBASE-12522 Backport of write-ahead-log refactoring and follow-ons.
Issues incorporated and incompatible changes called out on the jira.

* Cleaned up references to HLog
* Deprecates HLogKey but maintains it for compatibility
  - Moves all Writeable from WALKey to HLogKey
* Adds utility code to CoprocessorHost to help with evolving Coprocessor APIs
* RSRpcServices roll WAL call now requests the non-meta LogRoller roll all logs
  - rolls actually happen asynchronously
  - deprecated old api (and noted incompatible behavior change)
  - modified api in new Admin interface to reflect lack of return values.
* Moved WAL user facing API to "WAL"
  - only 1 sync offered
  - WALTrailer removed from API
* make provider used by the WALFactory configurable.
* Move all WAL requests to use opaque ids instead of paths
* WALProvider provides API details for implementers and handles creation of WALs.
* Refactor WALActionsListener to have a basic implementation.
* turn MetricsWAL into a WALActionsListener.
* tests that needs FSHLog implementation details use them directly, others just reference provider + factory
  - Some tests moved from Large to Medium based on run time.
* pull out wal disabling into its own no-op class
* update region open to delegate to WALFactory
* update performance test tool to allow for multiple regions
* Removed references to meta-specific wals within wal code
  - replaced with generic suffixes
  - WALFactory maintains a dedicated WALProvider for meta (and so knows about the distinction)
* maintain backwards compat on HLogPrettyPrinter and mark it deprecated.
  - made WALPrettyPrinter IA.Private in favor of `bin/hbase wal`
* move WALUtil stuff that's implementation specific to said implementation
  - WALUtil now acts as an integration point between the RegionServer and hte WAL code.

Incorporates contributions from v.himanshu and stack.

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/WALPlayer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/protobuf/ReplicationProtbufUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/LogRoller.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/FSHLog.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/HMerge.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/MetaUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestIOFencing.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin2.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionObserverScannerOpenHook.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestFilter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestInvocationRecordFilter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/fs/TestBlockReorder.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHLogRecordReader.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMergeTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestSplitTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestHLog.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollAbort.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollingNoCluster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMultiSlaveReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationWALEntryFilters.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpointNoMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationSourceManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationWALReaderManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSVisitor.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestMergeTool.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestSecureWAL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALFiltering.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALMethods.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALReaderOnSecureWAL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplit.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplitCompressed.java
	src/main/docbkx/ops_mgt.xml
2014-12-02 11:05:02 -06:00
stack
a5169d422b HBASE-12526 Remove unused imports (Varun Saxena) 2014-12-01 14:30:59 -08:00
Ramkrishna
95de67bd39 HBASE-11639 - [Visibility controller] Replicate the visibility of Cells as
strings (Ram)
2014-12-01 23:24:20 +05:30
stack
b12d57783f HBASE-12519 Remove tabs used as whitespace (Varun Saxena) 2014-11-29 09:24:08 -08:00
Jeffrey Zhong
643de2df04 HBASE-12533: staging directories are not deleted after secure bulk load 2014-11-26 16:32:59 -08:00
Enis Soztutar
898e78661a HBASE-12072 Standardize retry handling for master operations
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HConnection.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RowTooBigException.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/replication/ReplicationAdmin.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/flush/MasterFlushTableProcedureManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestReplicasClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMergeTransactionOnCluster.java
2014-11-26 13:50:24 -08:00
stack
c55d57461c HBASE-12584 Fix branch-1 failing since task 5 HBASE-12404 (HBASE-12404 addendum) 2014-11-26 01:52:41 -08:00
Enis Soztutar
b9dfcd01b8 HBASE-12128 Cache configuration and RpcController selection for Table in Connection 2014-11-25 13:48:09 -08:00
stack
c0cdaf8400 HBASE-12404 Task 5 from parent: Replace internal HTable constructor use with
HConnection#getTable (0.98, 0.99)

    Backport

    Replaced HTable under hbase-*/src/main/java. Skipped tests. Would take
    till end of time to do all and some cases are cryptic. Also skipped
    some mapreduce where HTable comes through in API. Can do both of
    these stragglers in another issue.
    Generally, if a utility class or standalone class, tried to pass in a
    Connection rather than have the utility or standalone create its own
    connection on each invocation; e.g. the Quota stuff. Where not possible,
    noted where invocation comes from... if test or hbck, didn't worry about
    it.
    Some classes are just standalone and nothing to be done to avoid
    a Connection setup per invocation (this is probably how it worked
    in the new HTable...days anyways). Some classes are not used:
    AggregationClient, FavoredNodes... we should just purge this stuff.
    Doc on what short circuit connection does (I can just use it...
    I thought it was just for short circuit but no, it switches dependent
    on where you are connecting).
    Changed HConnection to super Interface ClusterConnection where safe (
    internal usage by private classes only).
    Doc cleanup in example usage so we do new mode rather than the old
    fashion.
    Used java7 idiom that allows you avoid writing out finally to call close
    on implementations of Closeable.
    Added a RegistryFactory.. moved it out from being inner class.
    Added a utility createGetClosestRowOrBeforeReverseScan method to Scan
    to create a Scan that can ...
    Renamed getShortCircuitConnection as getConnection – users don't need
    to know what implementation does (that it can short-circuit RPC).
    The old name gave pause. I was frightened to use it thinking it only
    for short-circuit reading – that it would not do remote too.
    Squashed commit of the following:
2014-11-25 12:26:54 -08:00
stack
f3c5f11718 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) under src/main/java
Move from HConnection to ClusterConnection or Connection
Use unmanaged connections where we use managed previous
(used the jdk7 https://docs.oracle.com/javase/7/docs/technotes/guides/language/try-with-resources.html idiom).

In ZKConfig, synchronize on Configuration rather than make a copy.
Making a copy we were dropping hbase configs in certain test context
(could not find the zk ensemble because default port).

In tests, some move to the new style connection setup but mostly
fixes for premature connection close or adding cleanup where it
was lacking.

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMultiSlaveReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationEndpoint.java
2014-11-24 10:12:27 -08:00
Andrew Purtell
9904252615 HBASE-12479 Backport HBASE-11689 (Track meta in transition) (Virag Kothari) 2014-11-22 12:13:09 -08:00
Enis Soztutar
aa343ebcfe HBASE-10671 Add missing InterfaceAudience annotations for classes in hbase-common and hbase-client modules 2014-11-21 14:09:28 -08:00
tedyu
84ed9f6ba4 HBASE-8572 Enhance delete_snapshot.rb to call snapshot deletion API with regex (Ashish Singhi) 2014-11-20 08:59:42 -08:00
stack
3a3a4b7b6b Revert "HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)"
This reverts commit 4f5cde8a698b4d416694842c2e82114a44fc0471.
2014-11-18 16:32:18 -08:00
stack
4f5cde8a69 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLogSplitter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
2014-11-18 10:19:55 -08:00
Enis Soztutar
b25e5bb890 HBASE-12445 hbase is removing all remaining cells immediately after the cell marked with marker = KeyValue.Type.DeleteColumn via PUT (Hani Nadra) 2014-11-12 15:50:48 -08:00
stack
f3a38dcf16 HBASE-10483 Provide API for retrieving info port when hbase.master.info.port is set to 0 (Liu Shaohui)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/MasterAddressTracker.java
	hbase-protocol/src/main/java/org/apache/hadoop/hbase/protobuf/generated/ZooKeeperProtos.java
2014-11-12 09:09:11 -08:00
Srikanth Srungarapu
133c79a391 HBASE-12460 Moving Chore to hbase-common module
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2014-11-11 23:18:37 +00:00
stack
9bbde31a81 HBASE-12434 Add a command to compact all the regions in a regionserver (Liu Shaohui) 2014-11-11 09:33:27 -08:00
Nick Dimiduk
df3ba6ea4b HBASE-12432 RpcRetryingCaller should log after fixed number of retries like AsyncProcess
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2014-11-07 12:27:36 -08:00
stack
c99d89fd63 HBASE-12427 Change branch-1 version from 0.99.2-SNAPSHOT to 0.99.3-SNAPSHOT --REVERT 2014-11-05 19:15:24 -08:00