Commit Graph

3339 Commits

Author SHA1 Message Date
Elliott Clark 8ee4464ef9 HBASE-12892 Add a class to allow taking a snapshot from the command line 2015-01-25 17:22:41 -08:00
Enis Soztutar d0a2a0b145 HBASE-12901 Possible deadlock while onlining a region and get region plan for other region run parallel (Rajeshbabu Chintaguntla) 2015-01-24 18:37:35 -08:00
stack eb9978cc3d HBASE-12684 Add new AsyncRpcClient (Jurriaan Mous) 2015-01-24 18:21:36 -08:00
Enis Soztutar e180f0bdd1 HBASE-12728 buffered writes substantially less useful after removal of HTablePool (addendum for failing test in branch-1.0) 2015-01-24 17:57:34 -08:00
tedyu 3a529c04ce HBASE-10499 In write heavy scenario one of the regions does not get flushed causing RegionTooBusyException (Ram and Ted) 2015-01-23 09:44:50 -08:00
Nick Dimiduk 8556e2598e HBASE-12728 buffered writes substantially less useful after removal of HTablePool (Solomon Duskis and Nick Dimiduk)
In our pre-1.0 API, HTable is considered a light-weight object that consumed by
a single thread at a time. The HTablePool class provided a means of sharing
multiple HTable instances across a number of threads. As an optimization,
HTable managed a "write buffer", accumulating edits and sending a "batch" all
at once. By default the batch was sent as the last step in invocations of
put(Put) and put(List<Put>). The user could disable the automatic flushing of
the write buffer, retaining edits locally and only sending the whole "batch"
once the write buffer has filled or when the flushCommits() method in invoked
explicitly. Explicit or implicit batch writing was controlled by the
setAutoFlushTo(boolean) method. A value of true (the default) had the write
buffer flushed at the completion of a call to put(Put) or put(List<Put>). A
value of false allowed for explicit buffer management. HTable also exposed the
buffer to consumers via getWriteBuffer().

The combination of HTable with setAutoFlushTo(false) and the HTablePool
provided a convenient mechanism by which multiple "Put-producing" threads could
share a common write buffer. Both HTablePool and HTable are deprecated, and
they are officially replaced in The new 1.0 API by Table and BufferedMutator.
Table, which replaces HTable, no longer exposes explicit write-buffer
management. Instead, explicit buffer management is exposed via BufferedMutator.
BufferedMutator is made safe for concurrent use. Where code would previously
retrieve and return HTables from an HTablePool, now that code creates and
shares a single BufferedMutator instance across all threads.

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestAsyncProcess.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestBigLinkedList.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestBigLinkedListWithVisibility.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestLoadAndVerify.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/trace/IntegrationTestSendTraceRequests.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/PerformanceEvaluation.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteTable.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/MultiTableOutputFormat.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestMultiVersions.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestClientPushback.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestCloneSnapshotFromClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRestoreSnapshotFromClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRpcControllerFactory.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestFSErrorsExposed.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerMetrics.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestScannerWithBulkload.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRolling.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationChangingPeerRegionservers.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationWithTags.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/SnapshotTestingUtils.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestFlushSnapshotFromClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestRestoreFlushSnapshotFromClient.java
2015-01-23 09:07:55 -08:00
Rajeshbabu Chintaguntla d21ea4e570 HBASE-12791 HBase does not attempt to clean up an aborted split when the regionserver shutting down-addendum(Rajeshbabu) 2015-01-23 12:30:36 +05:30
Andrew Purtell 7e1f030f2a HBASE-12731 Heap occupancy based client pushback
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerServices.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/MockRegionServer.java
2015-01-22 17:47:59 -08:00
Andrew Purtell 04a003d6a2 HBASE-12730 Backport HBASE-5162 (Basic client pushback mechanism) to branch-1 2015-01-22 14:50:40 -08:00
Nick Dimiduk 05f4e0c715 HBASE-12810 Update to htrace-incubating 2015-01-22 14:32:21 -08:00
Sean Busbey 0bec3a7bf4 HBASE-12898 ensure direct dependencies are declared. 2015-01-22 09:30:05 -06:00
anoopsjohn 613efef04b HBASE-12745 Visibility Labels: support visibility labels for user groups. (Jerry He) 2015-01-22 11:39:30 +05:30
Enis Soztutar 54f6cae41c HBASE-12393 The regionserver web will throw exception if we disable block cache (ChiaPing Tsai) 2015-01-21 17:27:37 -08:00
Enis Soztutar ba2d05e148 HBASE-12774 Fix the inconsistent permission checks for bulkloading. (Srikanth Srungarapu) 2015-01-21 17:04:57 -08:00
Enis Soztutar 08cf057c6b HBASE-12864 IntegrationTestTableSnapshotInputFormat fails 2015-01-21 16:22:09 -08:00
tedyu 25b1c2670d HBASE-12886 Correct tag option name in PerformanceEvaluation (Jerry He) 2015-01-21 12:31:18 -08:00
tedyu 6152b2b86f HBASE-12876 TestScannerWithBulkload should pass Table with unmanaged connection to LoadIncrementalHFiles#doBulkLoad() 2015-01-21 11:21:41 -08:00
Nick Dimiduk 8dccea9dd7 HBASE-12881 TestFastFail is not compatible with surefire.rerunFailingTestsCount 2015-01-20 09:29:57 -08:00
rahulgidwani 6a1fcf2b85 HBASE-11195 Potentially improve block locality during major compaction for old regions
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-01-19 17:33:26 -08:00
Andrew Purtell 453f9294b6 HBASE-12878 Incorrect HFile path in TestHFilePerformance print output (Vikas Vishwakarma) 2015-01-19 12:46:54 -08:00
Devaraj Das d0e4fb6ae3 HBASE-12548. Improve debuggability of IntegrationTestTimeBoundedRequestsWithRegionReplicas. 2015-01-16 11:49:49 -08:00
Devaraj Das 37a2774c6f HBASE-11903. Directly invoking split & merge of replica regions should be disallowed 2015-01-16 11:23:48 -08:00
Enis Soztutar 0689098092 HBASE-12862 Uppercase wals in RegionServer webUI 2015-01-16 11:12:47 -08:00
zhangduo 5ee40c5516 HBASE-12863 Master info port on RS UI is always 0
Signed-off-by: Enis Soztutar <enis@apache.org>
2015-01-16 11:00:42 -08:00
Devaraj Das 60e7e6aed5 HBASE-11261. Handle splitting/merging of regions that have region_replication greater than one 2015-01-16 10:54:52 -08:00
Devaraj Das 895e9228a0 HBASE-10674. HBCK should be updated to do replica related checks 2015-01-16 10:28:37 -08:00
Matteo Bertozzi 52b4db8607 HBASE-12773 Add warning message when user is trying to bulkload a large HFile (Srikanth Srungarapu) 2015-01-15 23:14:29 +00:00
tedyu 2e08bb3b47 HBASE-12848 Utilize Flash storage for WAL 2015-01-15 08:53:06 -08:00
Enis Soztutar 8ecba131af HBASE-12844 ServerManager.isServerReacable() should sleep between retries
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestAssignmentManagerOnCluster.java
2015-01-14 15:50:43 -08:00
Rajeshbabu Chintaguntla bc5023018e HBASE-12847 TestZKLessSplitOnCluster frequently times out in 0.98 builds(Rajeshbabu) 2015-01-15 00:14:52 +05:30
Virag Kothari 4ff742742b HBASE-12480 Regions in FAILED_OPEN/FAILED_CLOSE should be processed on master failover 2015-01-13 11:06:24 -08:00
tedyu 908779b887 HBASE-12849 LoadIncrementalHFiles should use unmanaged connection in branch-1 2015-01-13 10:55:07 -08:00
tedyu b79dbedad6 HBASE-11144 Filter to support scanning multiple row key ranges (Jiajia Li) 2015-01-13 07:04:49 -08:00
Enis Soztutar 6e45269f2c HBASE-12835 HBASE-12422 changed new HTable(Configuration) to not use managed Connections anymore - ADDENDUM for test failure 2015-01-12 18:52:49 -08:00
Rajeshbabu Chintaguntla f4e0cbc26c HBASE-12791 HBase does not attempt to clean up an aborted split when the regionserver shutting down(Rajeshbabu) 2015-01-12 07:04:26 +05:30
tedyu 9b8f59cdf9 HBASE-12798 Map Reduce jobs should not create Tables in setConf() (Solomon Duskis) 2015-01-11 09:22:12 -08:00
tedyu b421498ce6 HBASE-12834 Promote ScanType to LimitedPrivate 2015-01-09 15:36:58 -08:00
Nick Dimiduk 2ecb4b1b34 HBASE-12825 CallRunner exception messages should include destination host:port 2015-01-08 18:40:28 -08:00
Enis Soztutar 4581d54cf7 HBASE-12824 CompressionTest fails with org.apache.hadoop.hbase.io.hfile.AbstractHFileReader: Not seeked to a key/value 2015-01-08 15:57:14 -08:00
Nick Dimiduk 240ef12358 HBASE-12071 Separate out thread pool for Master <-> RegionServer communication (Stephen Yuan Jiang) 2015-01-08 14:11:32 -08:00
tedyu e0f706999a HBASE-12811 [AccessController] NPE while scanning a table with user not having READ permission on the namespace (Ashish) 2015-01-08 09:05:55 -08:00
tedyu 165bbb9e8d HBASE-12819 ExportSnapshot doesn't close FileSystem instances 2015-01-08 08:52:13 -08:00
tedyu 29ec882a5e HBASE-12817 Data missing while scanning using PREFIX_TREE data block encoding (Duo Zhang) 2015-01-07 19:32:17 -08:00
tedyu 2c4fe03e6a HBASE-12783 Create efficient RegionLocator implementation (Solomon) 2015-01-07 11:10:24 -08:00
Virag Kothari 46f993b19f HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula) 2015-01-07 10:58:32 -08:00
tedyu c951238304 HBASE-10528 Addendum fixes TestRegionStates compilation 2015-01-06 13:35:12 -08:00
tedyu c5b0a1b8a0 HBASE-10528 DefaultBalancer selects plans to move regions onto draining nodes (Churro Morales) 2015-01-06 12:34:07 -08:00
Sean Busbey 59952c006d HBASE-12339 WALPerformanceEvaluation should have a log roller. 2015-01-06 08:37:16 -06:00
stack 6fcc8d7c3e HBASE-12771 TestFailFast#testFastFail failing (Manukranth Kolloju) 2015-01-05 21:17:51 -08:00
Lars Hofhansl e491f337f1 HBASE-12779 SplitTransaction: Add metrics. 2015-01-05 17:14:20 -08:00