Commit Graph

9856 Commits

Author SHA1 Message Date
tedyu f1bd041113 HBASE-12929 TableMapReduceUtil.initTableMapperJob unnecessarily limits the types of outputKeyClass and outputValueClass (Will Temperley) 2015-01-27 07:58:48 -08:00
Matteo Bertozzi e7bb32c240 HBASE-12925 Use acl cache for doing access control checks in prepare and clean phases of Bulkloading (Srikanth Srungarapu) 2015-01-27 13:15:49 +00:00
tedyu 80dfdc5244 HBASE-7847 Use zookeeper multi to clear znodes (Rakesh R) 2015-01-26 21:44:14 -08:00
rahulgidwani 3bf34993a8 HBASE-12627 Add back snapshot batching facility
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-01-26 18:45:10 -08:00
tedyu 9aadf4c35b HBASE-12927 TestFromClientSide#testScanMetrics() failing due to duplicate createTable commands (Jonathan Lawlor) 2015-01-26 17:39:01 -08:00
Enis Soztutar a84233ae35 HBASE-12745 Visibility Labels: support visibility labels for user groups. (Addendum2 for BC between 0.98 and branch-1) (Anoop Sam John) 2015-01-26 15:58:35 -08:00
tedyu 5cee77a1f1 HBASE-12917 HFilePerformanceEvaluation Scan tests fail with StackOverflowError due to recursive call in createCell function (Vikas Vishwakarma) 2015-01-26 15:26:01 -08:00
stack c057604742 HBASE-7541 Convert all tests that use HBaseTestingUtility.createMultiRegions to HBA.createTable (Jonathan Lawlor) 2015-01-26 14:11:02 -08:00
Enis Soztutar 9aac255509 HBASE-12919 Compilation with Hadoop-2.4- is broken again (Srikanth Srungarapu) 2015-01-26 11:05:32 -08:00
tedyu 87a5ad4aa4 HBASE-12915 Disallow small scan with batching 2015-01-26 10:59:28 -08:00
Enis Soztutar 0a50a7a472 HBASE-12745 Visibility Labels: support visibility labels for user groups. (Addendum for BC between 0.98 and branch-1) 2015-01-25 18:11:40 -08:00
Andrew Purtell bfae8d541c HBASE-12885 Unit test for RAW / VERSIONS scanner specifications (Amit Kabra) 2015-01-25 17:32:35 -08:00
Elliott Clark 8ee4464ef9 HBASE-12892 Add a class to allow taking a snapshot from the command line 2015-01-25 17:22:41 -08:00
Enis Soztutar d0a2a0b145 HBASE-12901 Possible deadlock while onlining a region and get region plan for other region run parallel (Rajeshbabu Chintaguntla) 2015-01-24 18:37:35 -08:00
stack eb9978cc3d HBASE-12684 Add new AsyncRpcClient (Jurriaan Mous) 2015-01-24 18:21:36 -08:00
Enis Soztutar e180f0bdd1 HBASE-12728 buffered writes substantially less useful after removal of HTablePool (addendum for failing test in branch-1.0) 2015-01-24 17:57:34 -08:00
Nick Dimiduk 4b9eaf5851 HBASE-12728 buffered writes substantially less useful after removal of HTablePool (addendum) 2015-01-23 14:45:28 -08:00
tedyu 3a529c04ce HBASE-10499 In write heavy scenario one of the regions does not get flushed causing RegionTooBusyException (Ram and Ted) 2015-01-23 09:44:50 -08:00
Nick Dimiduk 8556e2598e HBASE-12728 buffered writes substantially less useful after removal of HTablePool (Solomon Duskis and Nick Dimiduk)
In our pre-1.0 API, HTable is considered a light-weight object that consumed by
a single thread at a time. The HTablePool class provided a means of sharing
multiple HTable instances across a number of threads. As an optimization,
HTable managed a "write buffer", accumulating edits and sending a "batch" all
at once. By default the batch was sent as the last step in invocations of
put(Put) and put(List<Put>). The user could disable the automatic flushing of
the write buffer, retaining edits locally and only sending the whole "batch"
once the write buffer has filled or when the flushCommits() method in invoked
explicitly. Explicit or implicit batch writing was controlled by the
setAutoFlushTo(boolean) method. A value of true (the default) had the write
buffer flushed at the completion of a call to put(Put) or put(List<Put>). A
value of false allowed for explicit buffer management. HTable also exposed the
buffer to consumers via getWriteBuffer().

The combination of HTable with setAutoFlushTo(false) and the HTablePool
provided a convenient mechanism by which multiple "Put-producing" threads could
share a common write buffer. Both HTablePool and HTable are deprecated, and
they are officially replaced in The new 1.0 API by Table and BufferedMutator.
Table, which replaces HTable, no longer exposes explicit write-buffer
management. Instead, explicit buffer management is exposed via BufferedMutator.
BufferedMutator is made safe for concurrent use. Where code would previously
retrieve and return HTables from an HTablePool, now that code creates and
shares a single BufferedMutator instance across all threads.

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestAsyncProcess.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestBigLinkedList.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestBigLinkedListWithVisibility.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestLoadAndVerify.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/trace/IntegrationTestSendTraceRequests.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/PerformanceEvaluation.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteTable.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/MultiTableOutputFormat.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestMultiVersions.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestClientPushback.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestCloneSnapshotFromClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRestoreSnapshotFromClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRpcControllerFactory.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestFSErrorsExposed.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerMetrics.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestScannerWithBulkload.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRolling.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationChangingPeerRegionservers.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationWithTags.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/SnapshotTestingUtils.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestFlushSnapshotFromClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestRestoreFlushSnapshotFromClient.java
2015-01-23 09:07:55 -08:00
Rajeshbabu Chintaguntla d21ea4e570 HBASE-12791 HBase does not attempt to clean up an aborted split when the regionserver shutting down-addendum(Rajeshbabu) 2015-01-23 12:30:36 +05:30
Enis Soztutar ea566fc1f5 HBASE-12899 HBase should prefix htrace configuration keys with "hbase.htrace" rather than just "hbase." (Colin Patrick McCabe) 2015-01-22 19:06:13 -08:00
Andrew Purtell 7e1f030f2a HBASE-12731 Heap occupancy based client pushback
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerServices.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/MockRegionServer.java
2015-01-22 17:47:59 -08:00
Andrew Purtell 04a003d6a2 HBASE-12730 Backport HBASE-5162 (Basic client pushback mechanism) to branch-1 2015-01-22 14:50:40 -08:00
Nick Dimiduk 05f4e0c715 HBASE-12810 Update to htrace-incubating 2015-01-22 14:32:21 -08:00
Andrew Purtell 44fa36b425 HBASE-12904 Threading issues in region_mover.rb 2015-01-22 13:11:40 -08:00
Sean Busbey 0bec3a7bf4 HBASE-12898 ensure direct dependencies are declared. 2015-01-22 09:30:05 -06:00
anoopsjohn 613efef04b HBASE-12745 Visibility Labels: support visibility labels for user groups. (Jerry He) 2015-01-22 11:39:30 +05:30
Enis Soztutar 54f6cae41c HBASE-12393 The regionserver web will throw exception if we disable block cache (ChiaPing Tsai) 2015-01-21 17:27:37 -08:00
Enis Soztutar ba2d05e148 HBASE-12774 Fix the inconsistent permission checks for bulkloading. (Srikanth Srungarapu) 2015-01-21 17:04:57 -08:00
Enis Soztutar 08cf057c6b HBASE-12864 IntegrationTestTableSnapshotInputFormat fails 2015-01-21 16:22:09 -08:00
tedyu 25b1c2670d HBASE-12886 Correct tag option name in PerformanceEvaluation (Jerry He) 2015-01-21 12:31:18 -08:00
tedyu 6152b2b86f HBASE-12876 TestScannerWithBulkload should pass Table with unmanaged connection to LoadIncrementalHFiles#doBulkLoad() 2015-01-21 11:21:41 -08:00
Nick Dimiduk 8dccea9dd7 HBASE-12881 TestFastFail is not compatible with surefire.rerunFailingTestsCount 2015-01-20 09:29:57 -08:00
rahulgidwani 6a1fcf2b85 HBASE-11195 Potentially improve block locality during major compaction for old regions
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-01-19 17:33:26 -08:00
Andrew Purtell 453f9294b6 HBASE-12878 Incorrect HFile path in TestHFilePerformance print output (Vikas Vishwakarma) 2015-01-19 12:46:54 -08:00
Enis Soztutar 2f90bc5e20 HBASE-12837 ReplicationAdmin leaks zk connections (stack)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/replication/ReplicationAdmin.java
2015-01-16 13:31:16 -08:00
Devaraj Das d0e4fb6ae3 HBASE-12548. Improve debuggability of IntegrationTestTimeBoundedRequestsWithRegionReplicas. 2015-01-16 11:49:49 -08:00
Enis Soztutar e64c400835 HBASE-12833 [shell] table.rb leaks connections (Solomon Duskis)
Conflicts:
	hbase-shell/src/main/ruby/hbase/hbase.rb
2015-01-16 11:40:08 -08:00
Devaraj Das 37a2774c6f HBASE-11903. Directly invoking split & merge of replica regions should be disallowed 2015-01-16 11:23:48 -08:00
Enis Soztutar 0689098092 HBASE-12862 Uppercase wals in RegionServer webUI 2015-01-16 11:12:47 -08:00
zhangduo 5ee40c5516 HBASE-12863 Master info port on RS UI is always 0
Signed-off-by: Enis Soztutar <enis@apache.org>
2015-01-16 11:00:42 -08:00
Devaraj Das 60e7e6aed5 HBASE-11261. Handle splitting/merging of regions that have region_replication greater than one 2015-01-16 10:54:52 -08:00
Devaraj Das 895e9228a0 HBASE-10674. HBCK should be updated to do replica related checks 2015-01-16 10:28:37 -08:00
Andrew Purtell c339e181ae HBASE-8026 HBase Shell docs for scan command does not reference VERSIONS (Amit Kabra) 2015-01-16 09:43:40 -08:00
Matteo Bertozzi 52b4db8607 HBASE-12773 Add warning message when user is trying to bulkload a large HFile (Srikanth Srungarapu) 2015-01-15 23:14:29 +00:00
tedyu 2e08bb3b47 HBASE-12848 Utilize Flash storage for WAL 2015-01-15 08:53:06 -08:00
Ramkrishna da2a3827fa HBASE-12845 - ByteBufferOutputStream should grow as direct buffer if the
initial buffer is also direct BB (Ram)
2015-01-15 13:01:20 +05:30
Enis Soztutar 8ecba131af HBASE-12844 ServerManager.isServerReacable() should sleep between retries
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManagerOnCluster.java
2015-01-14 15:50:43 -08:00
Rajeshbabu Chintaguntla bc5023018e HBASE-12847 TestZKLessSplitOnCluster frequently times out in 0.98 builds(Rajeshbabu) 2015-01-15 00:14:52 +05:30
Virag Kothari 4ff742742b HBASE-12480 Regions in FAILED_OPEN/FAILED_CLOSE should be processed on master failover 2015-01-13 11:06:24 -08:00