Commit Graph

9512 Commits

Author SHA1 Message Date
tedyu 2306a7fd96 HBASE-12642 LoadIncrementalHFiles does not throw exception after hitting hbase.bulkload.retries.number setting 2014-12-05 18:40:50 -08:00
Andrew Purtell 004e977ba0 HBASE-10560 Per cell TTLs 2014-12-05 11:11:15 -08:00
Keith Winkler 1bd27bfa24 HBASE-12565 Race condition in HRegion.batchMutate() causes partial data to be written when region closes
Signed-off-by: stack <stack@apache.org>

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
2014-12-05 10:22:01 -08:00
tedyu 2560875893 HBASE-12632 ThrottledInputStream/ExportSnapshot does not throttle 2014-12-05 06:52:57 -08:00
Matteo Bertozzi 398e4f7ccf HBASE-12622 user_permission should require global admin to display global and ns permissions 2014-12-05 10:46:40 +00:00
Enis Soztutar 1615a4da62 HBASE-12637 Compilation with Hadoop-2.4- is broken 2014-12-04 18:20:58 -08:00
Andrew Purtell b4299ef845 HBASE-12635 Delete acl notify znode of table after the table is deleted (Liu Shaohui) 2014-12-04 16:43:42 -08:00
tedyu 2e47c37b71 HBASE-12204 Backport HBASE-12016 'Reduce number of versions in Meta table. Make it configurable' to branch-1 2014-12-04 12:18:58 -08:00
Ashish Singhi ffbfe01bbe HBASE-12634 Fix the AccessController#requireGlobalPermission(ns) with NS
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2014-12-04 15:35:53 +00:00
stack bb07de1960 HBASE-12431 Use of getColumnLatestCell(byte[], int, int, byte[], int, int) is Not Thread Safe (Jingcheng Du)
(cherry picked from commit c45772e76a)
2014-12-03 22:35:14 -08:00
stack fe9e7483a3 Add timeout on TestDefaultLoadBalancer#testBalancerCluster to see if we can stop it hanging as a zombie in precommit builds 2014-12-03 22:35:02 -08:00
Ramkrishna 806716e65d HBASE-11639 [Visibility controller] Replicate the visibility of Cells as
strings : Addendum adding break (Ram)
2014-12-04 08:52:11 +05:30
Jonathan M Hsieh ff337f1cb9 HBASE-12624 Remove rename_snapshot.rb from code as there is no equivalent renameSnapshot api in Admin class (Ashish Singhi) 2014-12-03 18:53:25 -08:00
stack e73e741b5c HBASE-12617 Running IntegrationTestBigLinkedList against cluster getting not an instance of org.apache.hadoop.hbase.MiniHBaseCluster
(cherry picked from commit d6b1d8cbf7)
2014-12-03 10:38:00 -08:00
Matteo Bertozzi 6b8a725191 HBASE-12618 Add 'Namespace' to headers while displaying user permissions (Ashish Singhi) 2014-12-03 08:26:52 +00:00
Enis Soztutar 6a0c4f3bae Update CHANGES.txt for 0.99.2 2014-12-02 20:39:44 -08:00
Enis Soztutar 48d9d27d68 Blanket update of src/main/docbkx from master 2014-12-02 20:35:51 -08:00
Enis Soztutar 5f150e49f9 Update pom.xml version for 0.99.2 2014-12-02 20:28:29 -08:00
Enis Soztutar a25194a3e4 HBASE-12398 Region isn't assigned in an extreme race condition (Jeffrey Zhong) 2014-12-02 19:50:34 -08:00
tedyu b189b25ab3 HBASE-12614 Potentially unclosed StoreFile(s) in DefaultCompactor#compact() 2014-12-02 19:33:08 -08:00
stack 23382fe625 HBASE-12616 We lost the linked list commands in recent usage refactoring 2014-12-02 14:15:26 -08:00
stack e424d4254e HBASE-12490 Replace uses of setAutoFlush(boolean, boolean) (Solomon Duskis) -- ADDENDUM to fix failing TestAsyncProcess#testHTableFailedPutAndNewPut 2014-12-02 11:48:46 -08:00
stack 2b976c6bd1 HBASE-12490 Replace uses of setAutoFlush(boolean, boolean) (Solomon Duskis) 2014-12-02 09:34:04 -08:00
Elliott Clark 091142f47a HBASE-12576 Add metrics for rolling the HLog if there are too few DN's in the write pipeline 2014-12-02 09:30:29 -08:00
stack be29fb4c02 HBASE-12610 Close connection in TableInputFormatBase (Solomon Duskis) 2014-12-02 09:28:28 -08:00
Sean Busbey 8959828fb5 HBASE-12522 Backport of write-ahead-log refactoring and follow-ons.
Issues incorporated and incompatible changes called out on the jira.

* Cleaned up references to HLog
* Deprecates HLogKey but maintains it for compatibility
  - Moves all Writeable from WALKey to HLogKey
* Adds utility code to CoprocessorHost to help with evolving Coprocessor APIs
* RSRpcServices roll WAL call now requests the non-meta LogRoller roll all logs
  - rolls actually happen asynchronously
  - deprecated old api (and noted incompatible behavior change)
  - modified api in new Admin interface to reflect lack of return values.
* Moved WAL user facing API to "WAL"
  - only 1 sync offered
  - WALTrailer removed from API
* make provider used by the WALFactory configurable.
* Move all WAL requests to use opaque ids instead of paths
* WALProvider provides API details for implementers and handles creation of WALs.
* Refactor WALActionsListener to have a basic implementation.
* turn MetricsWAL into a WALActionsListener.
* tests that needs FSHLog implementation details use them directly, others just reference provider + factory
  - Some tests moved from Large to Medium based on run time.
* pull out wal disabling into its own no-op class
* update region open to delegate to WALFactory
* update performance test tool to allow for multiple regions
* Removed references to meta-specific wals within wal code
  - replaced with generic suffixes
  - WALFactory maintains a dedicated WALProvider for meta (and so knows about the distinction)
* maintain backwards compat on HLogPrettyPrinter and mark it deprecated.
  - made WALPrettyPrinter IA.Private in favor of `bin/hbase wal`
* move WALUtil stuff that's implementation specific to said implementation
  - WALUtil now acts as an integration point between the RegionServer and hte WAL code.

Incorporates contributions from v.himanshu and stack.

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/WALPlayer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/protobuf/ReplicationProtbufUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/LogRoller.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/FSHLog.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/HMerge.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/MetaUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestIOFencing.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin2.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionObserverScannerOpenHook.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestFilter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestInvocationRecordFilter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/fs/TestBlockReorder.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHLogRecordReader.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMergeTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestSplitTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestHLog.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollAbort.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollingNoCluster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMultiSlaveReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationWALEntryFilters.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpointNoMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationSourceManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationWALReaderManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSVisitor.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestMergeTool.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestSecureWAL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALFiltering.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALMethods.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALReaderOnSecureWAL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplit.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplitCompressed.java
	src/main/docbkx/ops_mgt.xml
2014-12-02 11:05:02 -06:00
Enis Soztutar e2631ce70c HBASE-12537 HBase should log the remote host on replication error (Stack) 2014-12-01 20:10:52 -08:00
stack a5169d422b HBASE-12526 Remove unused imports (Varun Saxena) 2014-12-01 14:30:59 -08:00
Enis Soztutar 5610732173 HBASE-12577 Disable distributed log replay by default (Jeffrey Zhong) 2014-12-01 14:17:30 -08:00
Jeffrey Zhong a184620fb3 HBASE-12600: Remove REPLAY tag dependency in Distributed Replay Mode 2014-12-01 11:30:13 -08:00
stack 86dc3cab96 HBASE-12520 Add protected getters on TableInputFormatBase (Solomon Duskis) 2014-12-01 10:20:57 -08:00
stack 53d775f242 HBASE-12514 Cleanup HFileOutputFormat legacy code (Solomon Duskis)
Signed-off-by: stack <stack@apache.org>
2014-12-01 10:16:35 -08:00
Ramkrishna 95de67bd39 HBASE-11639 - [Visibility controller] Replicate the visibility of Cells as
strings (Ram)
2014-12-01 23:24:20 +05:30
stack c750ada8d6 HBASE-12595 Use Connection.getTable() in table.rb (Solomon Duskis) 2014-11-29 12:53:16 -08:00
stack 84d9f0ec26 HBASE-12491 TableMapReduceUtil.findContainingJar() NPE 2014-11-29 09:34:25 -08:00
stack b12d57783f HBASE-12519 Remove tabs used as whitespace (Varun Saxena) 2014-11-29 09:24:08 -08:00
stack 7eefa36ac2 HBASE-10536 ImportTsv should fail fast if any of the column family passed to the job is not present in the table (denny joesph) 2014-11-28 20:42:55 -08:00
stack f95728ac7d HBASE-12581 TestCellACLWithMultipleVersions failing since task 5 HBASE-12404 (HBASE-12404 addendum) -- SLEEP ADDENDUM 2014-11-27 05:29:23 -08:00
stack c3b99a5406 HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- DISABLING FAILING TEST 2014-11-26 22:23:14 -08:00
Jeffrey Zhong 643de2df04 HBASE-12533: staging directories are not deleted after secure bulk load 2014-11-26 16:32:59 -08:00
Jeffrey Zhong def45c2185 HBASE-12053: SecurityBulkLoadEndPoint set 777 permission on input data files 2014-11-26 16:32:51 -08:00
Enis Soztutar 898e78661a HBASE-12072 Standardize retry handling for master operations
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/MetaTableAccessor.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/Admin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HConnection.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RowTooBigException.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/replication/ReplicationAdmin.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/procedure/flush/MasterFlushTableProcedureManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestReplicasClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMergeTransactionOnCluster.java
2014-11-26 13:50:24 -08:00
stack c0988a3b9a HBASE-12580 Zookeeper instantiated even though we might not need it in the shell (Alex Newman) 2014-11-26 13:01:03 -08:00
stack 9036c78cf1 HBASE-12587 TestReplicationTrackerZKImpl.testPeerRemovedEvent timedout 2014-11-26 12:54:27 -08:00
stack f376343a17 Revert "HBASE-12563 After Starting up mini hbase cluster, Real Configuration of Cluster never set to HBaseTestingUtility (Talat UYARER)"
Broke the build. TestZooKeeper doesn't pass.

This reverts commit 2e9597ffb7.
2014-11-26 10:35:03 -08:00
stack daff5e8d96 HBASE-12518 Task 4 polish. Remove CM#{get,delete}Connection
Remove deleteConnection from everywhere except the two tests that ensure
it does the right thing and from HCM and CM themselves.

Undoes deleteConnection from tests and from the web ui
2014-11-26 08:12:13 -08:00
stack 2e9597ffb7 HBASE-12563 After Starting up mini hbase cluster, Real Configuration of Cluster never set to HBaseTestingUtility (Talat UYARER) 2014-11-26 08:00:00 -08:00
stack c55d57461c HBASE-12584 Fix branch-1 failing since task 5 HBASE-12404 (HBASE-12404 addendum) 2014-11-26 01:52:41 -08:00
stack c9376e6d37 HBASE-12581 TestCellACLWithMultipleVersions failing since task 5 HBASE-12404 (HBASE-12404 addendum) 2014-11-25 16:30:23 -08:00
Enis Soztutar b9dfcd01b8 HBASE-12128 Cache configuration and RpcController selection for Table in Connection 2014-11-25 13:48:09 -08:00