Commit Graph

3207 Commits

Author SHA1 Message Date
Sean Busbey d2d6945e89 HBASE-12655 WALPerformanceEvaluation should only add stat gathering listener once per WAL. 2014-12-09 09:53:25 -06:00
tedyu 553c386c8c HBASE-12653 Move TestRegionServerOnlineConfigChange & TestConfigurationManager to Junit4 tests (Ashish) 2014-12-09 07:31:03 -08:00
Rajeshbabu Chintaguntla 08a2559851 HBASE-12583 Allow creating reference files even the split row not lies in the storefile range if required(Rajeshbabu) 2014-12-09 19:00:37 +05:30
Matteo Bertozzi 09617cc2aa HBASE-12564 consolidate the getTableDescriptors() semantic 2014-12-09 12:06:39 +00:00
Andrew Purtell a731ea6304 HBASE-12575 Sanity check table coprocessor classes are loadable 2014-12-08 18:18:50 -08:00
stack 1d880e3f60 HBASE-12597 Add RpcClient interface and enable changing of RpcClient implementation (Jurriaan Mous) 2014-12-08 15:23:38 -08:00
stack 823656bf83 HBASE-12611 Create autoCommit() method and remove clearBufferOnFail (Solomon Duskis)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
2014-12-08 11:17:59 -08:00
Elliott Clark cc1a0d7c36 HBASE-12574 Update replication metrics to not do so many map look ups. 2014-12-08 10:58:21 -08:00
Nick Dimiduk 081ce3f8de HBASE-12163 Move test annotation classes to the same package as in master 2014-12-08 10:38:58 -08:00
Enis Soztutar 9ee9a4bd20 HBASE-12647 Truncate table should work with C as well 2014-12-07 20:58:55 -08:00
Andrew Purtell 7b7b398056 HBASE-12606 Sanity check encryption configuration before opening WAL or onlining regions
Also disables IntegrationTestIngestWithEncryption if distributed
cluster configuration is missing prerequisites.
2014-12-06 22:04:26 -08:00
Gary Helmling 6c4863f355 HBASE-12493 Make User and TokenUtil public 2014-12-06 02:10:31 -08:00
tedyu 2306a7fd96 HBASE-12642 LoadIncrementalHFiles does not throw exception after hitting hbase.bulkload.retries.number setting 2014-12-05 18:40:50 -08:00
Andrew Purtell 004e977ba0 HBASE-10560 Per cell TTLs 2014-12-05 11:11:15 -08:00
Keith Winkler 1bd27bfa24 HBASE-12565 Race condition in HRegion.batchMutate() causes partial data to be written when region closes
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
2014-12-05 10:22:01 -08:00
Matteo Bertozzi 398e4f7ccf HBASE-12622 user_permission should require global admin to display global and ns permissions 2014-12-05 10:46:40 +00:00
Enis Soztutar 1615a4da62 HBASE-12637 Compilation with Hadoop-2.4- is broken 2014-12-04 18:20:58 -08:00
Andrew Purtell b4299ef845 HBASE-12635 Delete acl notify znode of table after the table is deleted (Liu Shaohui) 2014-12-04 16:43:42 -08:00
tedyu 2e47c37b71 HBASE-12204 Backport HBASE-12016 'Reduce number of versions in Meta table. Make it configurable' to branch-1 2014-12-04 12:18:58 -08:00
Ashish Singhi ffbfe01bbe HBASE-12634 Fix the AccessController#requireGlobalPermission(ns) with NS
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2014-12-04 15:35:53 +00:00
stack fe9e7483a3 Add timeout on TestDefaultLoadBalancer#testBalancerCluster to see if we can stop it hanging as a zombie in precommit builds 2014-12-03 22:35:02 -08:00
Ramkrishna 806716e65d HBASE-11639 [Visibility controller] Replicate the visibility of Cells as
strings : Addendum adding break (Ram)
2014-12-04 08:52:11 +05:30
stack e73e741b5c HBASE-12617 Running IntegrationTestBigLinkedList against cluster getting not an instance of org.apache.hadoop.hbase.MiniHBaseCluster
(cherry picked from commit d6b1d8cbf7)
2014-12-03 10:38:00 -08:00
Enis Soztutar 5f150e49f9 Update pom.xml version for 0.99.2 2014-12-02 20:28:29 -08:00
Enis Soztutar a25194a3e4 HBASE-12398 Region isn't assigned in an extreme race condition (Jeffrey Zhong) 2014-12-02 19:50:34 -08:00
tedyu b189b25ab3 HBASE-12614 Potentially unclosed StoreFile(s) in DefaultCompactor#compact() 2014-12-02 19:33:08 -08:00
stack 23382fe625 HBASE-12616 We lost the linked list commands in recent usage refactoring 2014-12-02 14:15:26 -08:00
stack 2b976c6bd1 HBASE-12490 Replace uses of setAutoFlush(boolean, boolean) (Solomon Duskis) 2014-12-02 09:34:04 -08:00
Elliott Clark 091142f47a HBASE-12576 Add metrics for rolling the HLog if there are too few DN's in the write pipeline 2014-12-02 09:30:29 -08:00
stack be29fb4c02 HBASE-12610 Close connection in TableInputFormatBase (Solomon Duskis) 2014-12-02 09:28:28 -08:00
Sean Busbey 8959828fb5 HBASE-12522 Backport of write-ahead-log refactoring and follow-ons.
Issues incorporated and incompatible changes called out on the jira.

* Cleaned up references to HLog
* Deprecates HLogKey but maintains it for compatibility
  - Moves all Writeable from WALKey to HLogKey
* Adds utility code to CoprocessorHost to help with evolving Coprocessor APIs
* RSRpcServices roll WAL call now requests the non-meta LogRoller roll all logs
  - rolls actually happen asynchronously
  - deprecated old api (and noted incompatible behavior change)
  - modified api in new Admin interface to reflect lack of return values.
* Moved WAL user facing API to "WAL"
  - only 1 sync offered
  - WALTrailer removed from API
* make provider used by the WALFactory configurable.
* Move all WAL requests to use opaque ids instead of paths
* WALProvider provides API details for implementers and handles creation of WALs.
* Refactor WALActionsListener to have a basic implementation.
* turn MetricsWAL into a WALActionsListener.
* tests that needs FSHLog implementation details use them directly, others just reference provider + factory
  - Some tests moved from Large to Medium based on run time.
* pull out wal disabling into its own no-op class
* update region open to delegate to WALFactory
* update performance test tool to allow for multiple regions
* Removed references to meta-specific wals within wal code
  - replaced with generic suffixes
  - WALFactory maintains a dedicated WALProvider for meta (and so knows about the distinction)
* maintain backwards compat on HLogPrettyPrinter and mark it deprecated.
  - made WALPrettyPrinter IA.Private in favor of `bin/hbase wal`
* move WALUtil stuff that's implementation specific to said implementation
  - WALUtil now acts as an integration point between the RegionServer and hte WAL code.

Incorporates contributions from v.himanshu and stack.

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/WALPlayer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/protobuf/ReplicationProtbufUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/LogRoller.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/FSHLog.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/HMerge.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/MetaUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestIOFencing.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin2.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionObserverScannerOpenHook.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestFilter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestInvocationRecordFilter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/fs/TestBlockReorder.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHLogRecordReader.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMergeTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestSplitTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestHLog.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollAbort.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollingNoCluster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMultiSlaveReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationWALEntryFilters.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpointNoMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationSourceManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationWALReaderManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSVisitor.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestMergeTool.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestSecureWAL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALFiltering.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALMethods.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALReaderOnSecureWAL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplit.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplitCompressed.java
	src/main/docbkx/ops_mgt.xml
2014-12-02 11:05:02 -06:00
Enis Soztutar e2631ce70c HBASE-12537 HBase should log the remote host on replication error (Stack) 2014-12-01 20:10:52 -08:00
stack a5169d422b HBASE-12526 Remove unused imports (Varun Saxena) 2014-12-01 14:30:59 -08:00
Jeffrey Zhong a184620fb3 HBASE-12600: Remove REPLAY tag dependency in Distributed Replay Mode 2014-12-01 11:30:13 -08:00
stack 86dc3cab96 HBASE-12520 Add protected getters on TableInputFormatBase (Solomon Duskis) 2014-12-01 10:20:57 -08:00
stack 53d775f242 HBASE-12514 Cleanup HFileOutputFormat legacy code (Solomon Duskis)
Signed-off-by: stack <stack@apache.org>
2014-12-01 10:16:35 -08:00
Ramkrishna 95de67bd39 HBASE-11639 - [Visibility controller] Replicate the visibility of Cells as
strings (Ram)
2014-12-01 23:24:20 +05:30
stack 84d9f0ec26 HBASE-12491 TableMapReduceUtil.findContainingJar() NPE 2014-11-29 09:34:25 -08:00
stack b12d57783f HBASE-12519 Remove tabs used as whitespace (Varun Saxena) 2014-11-29 09:24:08 -08:00
stack 7eefa36ac2 HBASE-10536 ImportTsv should fail fast if any of the column family passed to the job is not present in the table (denny joesph) 2014-11-28 20:42:55 -08:00
stack f95728ac7d HBASE-12581 TestCellACLWithMultipleVersions failing since task 5 HBASE-12404 (HBASE-12404 addendum) -- SLEEP ADDENDUM 2014-11-27 05:29:23 -08:00
stack c3b99a5406 HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- DISABLING FAILING TEST 2014-11-26 22:23:14 -08:00
Jeffrey Zhong 643de2df04 HBASE-12533: staging directories are not deleted after secure bulk load 2014-11-26 16:32:59 -08:00
Jeffrey Zhong def45c2185 HBASE-12053: SecurityBulkLoadEndPoint set 777 permission on input data files 2014-11-26 16:32:51 -08:00
Enis Soztutar 898e78661a HBASE-12072 Standardize retry handling for master operations
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HConnection.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RowTooBigException.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/replication/ReplicationAdmin.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/flush/MasterFlushTableProcedureManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestReplicasClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMergeTransactionOnCluster.java
2014-11-26 13:50:24 -08:00
stack 9036c78cf1 HBASE-12587 TestReplicationTrackerZKImpl.testPeerRemovedEvent timedout 2014-11-26 12:54:27 -08:00
stack f376343a17 Revert "HBASE-12563 After Starting up mini hbase cluster, Real Configuration of Cluster never set to HBaseTestingUtility (Talat UYARER)"
Broke the build. TestZooKeeper doesn't pass.

This reverts commit 2e9597ffb7.
2014-11-26 10:35:03 -08:00
stack daff5e8d96 HBASE-12518 Task 4 polish. Remove CM#{get,delete}Connection
Remove deleteConnection from everywhere except the two tests that ensure
it does the right thing and from HCM and CM themselves.

Undoes deleteConnection from tests and from the web ui
2014-11-26 08:12:13 -08:00
stack 2e9597ffb7 HBASE-12563 After Starting up mini hbase cluster, Real Configuration of Cluster never set to HBaseTestingUtility (Talat UYARER) 2014-11-26 08:00:00 -08:00
stack c55d57461c HBASE-12584 Fix branch-1 failing since task 5 HBASE-12404 (HBASE-12404 addendum) 2014-11-26 01:52:41 -08:00