Commit Graph

3435 Commits

Author SHA1 Message Date
Elliott Clark 45fdc0e835 HBASE-12892 Add a class to allow taking a snapshot from the command line 2015-01-25 17:18:50 -08:00
Jurriaan Mous 854f13afa1 HBASE-12684 Add new AsyncRpcClient (Jurriaan Mous)
Signed-off-by: stack <stack@apache.org>
2015-01-24 18:05:39 -08:00
Enis Soztutar e05341d01d HBASE-12728 buffered writes substantially less useful after removal of HTablePool (addendum for failing test in branch-1.0) 2015-01-24 17:57:04 -08:00
tedyu 8261d84290 HBASE-8410 Basic quota support for namespaces (Vandana) 2015-01-24 10:36:49 -08:00
tedyu 74adb11f4c HBASE-10499 In write heavy scenario one of the regions does not get flushed causing RegionTooBusyException (Ram and Ted) 2015-01-23 09:43:01 -08:00
Nick Dimiduk ab18158e60 HBASE-12728 buffered writes substantially less useful after removal of HTablePool (Solomon Duskis and Nick Dimiduk)
In our pre-1.0 API, HTable is considered a light-weight object that consumed by
a single thread at a time. The HTablePool class provided a means of sharing
multiple HTable instances across a number of threads. As an optimization,
HTable managed a "write buffer", accumulating edits and sending a "batch" all
at once. By default the batch was sent as the last step in invocations of
put(Put) and put(List<Put>). The user could disable the automatic flushing of
the write buffer, retaining edits locally and only sending the whole "batch"
once the write buffer has filled or when the flushCommits() method in invoked
explicitly. Explicit or implicit batch writing was controlled by the
setAutoFlushTo(boolean) method. A value of true (the default) had the write
buffer flushed at the completion of a call to put(Put) or put(List<Put>). A
value of false allowed for explicit buffer management. HTable also exposed the
buffer to consumers via getWriteBuffer().

The combination of HTable with setAutoFlushTo(false) and the HTablePool
provided a convenient mechanism by which multiple "Put-producing" threads could
share a common write buffer. Both HTablePool and HTable are deprecated, and
they are officially replaced in The new 1.0 API by Table and BufferedMutator.
Table, which replaces HTable, no longer exposes explicit write-buffer
management. Instead, explicit buffer management is exposed via BufferedMutator.
BufferedMutator is made safe for concurrent use. Where code would previously
retrieve and return HTables from an HTablePool, now that code creates and
shares a single BufferedMutator instance across all threads.
2015-01-23 08:48:31 -08:00
Rajeshbabu Chintaguntla e13b9938a1 HBASE-12791 HBase does not attempt to clean up an aborted split when the regionserver shutting down-addendum(Rajeshbabu) 2015-01-23 12:41:45 +05:30
Andrew Purtell 71ab4ddb19 HBASE-12731 Heap occupancy based client pushback 2015-01-22 17:33:21 -08:00
Nick Dimiduk 9824eb7840 HBASE-12810 Update to htrace-incubating 2015-01-22 14:28:20 -08:00
Sean Busbey 418ea93774 HBASE-12898 ensure direct dependencies are declared. 2015-01-22 14:33:25 -06:00
anoopsjohn 833feefbf9 HBASE-12745 Visibility Labels: support visibility labels for user groups. (Jerry He) 2015-01-22 11:36:17 +05:30
Enis Soztutar 8b7a20f4ee HBASE-12393 The regionserver web will throw exception if we disable block cache (ChiaPing Tsai) 2015-01-21 17:22:10 -08:00
Enis Soztutar 8793383b66 HBASE-12774 Fix the inconsistent permission checks for bulkloading. (Srikanth Srungarapu) 2015-01-21 17:03:55 -08:00
Enis Soztutar 735fe20029 HBASE-12864 IntegrationTestTableSnapshotInputFormat fails 2015-01-21 16:21:42 -08:00
tedyu e87a69d9c0 HBASE-12886 Correct tag option name in PerformanceEvaluation (Jerry He) 2015-01-21 12:30:51 -08:00
Nick Dimiduk 9bdb81f0a1 HBASE-12887 Cleanup many checkstyle errors in o.a.h.h.client 2015-01-20 12:44:36 -08:00
Nick Dimiduk 3e777898aa HBASE-12881 TestFastFail is not compatible with surefire.rerunFailingTestsCount 2015-01-20 09:29:42 -08:00
rahulgidwani f71b980d37 HBASE-11195 Potentially improve block locality during major compaction for old regions
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-01-19 17:33:17 -08:00
Andrew Purtell 53815afc10 HBASE-12878 Incorrect HFile path in TestHFilePerformance print output (Vikas Vishwakarma) 2015-01-19 12:46:44 -08:00
Andrew Purtell 03e17168c3 HBASE-12840 Improve unit test coverage of the client pushback mechanism 2015-01-17 11:50:26 -08:00
Enis Soztutar a55bd21340 HBASE-12862 Uppercase wals in RegionServer webUI 2015-01-16 11:12:14 -08:00
zhangduo 7309bb4317 HBASE-12863 Master info port on RS UI is always 0
Signed-off-by: Enis Soztutar <enis@apache.org>
2015-01-16 10:45:38 -08:00
Matteo Bertozzi 621b33f2f9 HBASE-12773 Add warning message when user is trying to bulkload a large HFile (Srikanth Srungarapu) 2015-01-15 23:13:47 +00:00
tedyu eafc07a06d HBASE-12848 Utilize Flash storage for WAL 2015-01-15 08:52:30 -08:00
Enis Soztutar 51575197de HBASE-12844 ServerManager.isServerReacable() should sleep between retries 2015-01-14 15:45:46 -08:00
Rajeshbabu Chintaguntla 7e872a81a9 HBASE-12847 TestZKLessSplitOnCluster frequently times out in 0.98 builds(Rajeshbabu) 2015-01-15 00:00:37 +05:30
Misty Stanley-Jones 1a21c1684c HBASE-11533 Asciidoc Proof of Concept 2015-01-13 22:32:29 -08:00
stack 608025ae67 HBASE-7541 Convert all tests that use HBaseTestingUtility.createMultiRegions to HBA.createTable (Jonathan Lawlor) 2015-01-13 22:10:12 -08:00
Nick Dimiduk 9b7f36b8cf HBASE-11983 HRegion constructors should not create HLog 2015-01-13 15:07:59 -08:00
Virag Kothari 4ac457a7bc HBASE-12480 Regions in FAILED_OPEN/FAILED_CLOSE should be processed on master failover 2015-01-13 11:03:16 -08:00
tedyu 72a6a670ac HBASE-12849 LoadIncrementalHFiles should use unmanaged connection in branch-1 2015-01-13 10:51:56 -08:00
tedyu e5f3dd682f HBASE-11144 Filter to support scanning multiple row key ranges (Jiajia Li) 2015-01-13 07:02:06 -08:00
Andrew Purtell e52d8f85c4 HBASE-12838 After HBASE-5162 RSRpcServices accidentally applies mutations twice 2015-01-12 11:45:36 -08:00
Rajeshbabu Chintaguntla 5b850caa80 HBASE-12791 HBase does not attempt to clean up an aborted split when the regionserver shutting down(Rajeshbabu) 2015-01-12 01:04:26 +05:30
tedyu f6a017ce63 HBASE-12798 Map Reduce jobs should not create Tables in setConf() (Solomon Duskis) 2015-01-10 14:23:03 -08:00
tedyu 988cba762a HBASE-12834 Promote ScanType to LimitedPrivate 2015-01-09 15:35:14 -08:00
Nick Dimiduk 4bfd35aabc HBASE-12825 CallRunner exception messages should include destination host:port 2015-01-08 18:40:01 -08:00
Enis Soztutar 4d7c65ae84 HBASE-12824 CompressionTest fails with org.apache.hadoop.hbase.io.hfile.AbstractHFileReader: Not seeked to a key/value 2015-01-08 15:51:30 -08:00
Nick Dimiduk dde713ee4e HBASE-12071 Separate out thread pool for Master <-> RegionServer communication (Stephen Yuan Jiang) 2015-01-08 14:17:00 -08:00
tedyu 4ea490b63a HBASE-12811 [AccessController] NPE while scanning a table with user not having READ permission on the namespace (Ashish) 2015-01-08 09:06:12 -08:00
tedyu ee32eebeab HBASE-12819 ExportSnapshot doesn't close FileSystem instances 2015-01-08 08:51:25 -08:00
tedyu 9246af8dac HBASE-12796 Clean up HTable and HBaseAdmin deprecated constructor usage (Jurriaan Mous) 2015-01-08 07:49:28 -08:00
tedyu 645fbd7d87 HBASE-12817 Data missing while scanning using PREFIX_TREE data block encoding (Duo Zhang) 2015-01-07 18:45:09 -08:00
Virag Kothari 7dce0d5c45 HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula) 2015-01-07 10:57:47 -08:00
tedyu 45fc2bdd86 HBASE-10528 DefaultBalancer selects plans to move regions onto draining nodes (Churro Morales) 2015-01-06 12:33:28 -08:00
Sean Busbey 26e3e1b300 HBASE-12339 WALPerformanceEvaluation should have a log roller. 2015-01-06 08:22:48 -06:00
Lars Hofhansl 7774f964e6 HBASE-12779 SplitTransaction: Add metrics. 2015-01-05 17:13:58 -08:00
tedyu 2452d3861f HBASE-12802 Remove unnecessary Table.flushCommits() (Solomon Duskis) 2015-01-05 15:45:52 -08:00
tedyu 5b53a187d2 HBASE-12793 [hbck] closeRegionSilentlyAndWait() should log cause of IOException and retry until hbase.hbck.close.timeout expires (Esteban) 2015-01-05 15:05:35 -08:00
tedyu 37e1bb61f4 HBASE-12785 Use FutureTask to timeout the attempt to get the lock for hbck 2015-01-05 14:09:58 -08:00
Enis Soztutar 24bcebdeeb HBASE-12799 ITAG fails with java.lang.RuntimeException if table does not exist 2015-01-05 11:14:40 -08:00
tedyu 2ba6053163 HBASE-12804 ImportTsv fails to delete partition files created by it (Ashish) 2015-01-05 09:29:00 -08:00
tedyu ac95cc1fbb HBASE-12783 Create efficient RegionLocator implementation (Solomon Duskis) 2015-01-02 19:48:06 -08:00
Enis Soztutar 820f629423 HBASE-12028 Abort the RegionServer, when it's handler threads die (Alicia Ying Shu) 2015-01-02 13:07:57 -08:00
Sean Busbey a90e64c637 HBASE-12719 test provider to remove just the hdfs interactions from fshlog.
* Adds a provider that takes a config to determine if we actually do syncs, appends, and file rolls.
  - required relaxing some members of FSHLog from private to protected.
* Fixes DisabledWALProvider so it can be used as hbase.wal.provider in the wal perf eval tool.
2014-12-31 16:01:07 -06:00
Aditya Kishore 8514e2b20e HBASE-12775: CompressionTest ate my HFile 2014-12-30 16:14:59 -08:00
stack 305267b8e2 HBASE-12270 A bug in the bucket cache, with cache blocks on write enabled (Liu Shaohui) 2014-12-30 14:43:19 -08:00
Jurriaan Mous baa2d05374 HBASE-12740 Improve performance of TestHBaseFsck
Signed-off-by: stack <stack@apache.org>
2014-12-30 14:29:46 -08:00
stack 734324e80f Revert "HBASE-12740 Improve performance of TestHBaseFsck"
Undo because Jurriaan Mous did update in meantime.

This reverts commit 042743fff0.
2014-12-30 12:19:57 -08:00
stack c6002ccd38 HBASE-12772 TestPerColumnFamilyFlush failing -- ADDENDUM 2014-12-30 11:37:31 -08:00
Jurriaan Mous 042743fff0 HBASE-12740 Improve performance of TestHBaseFsck
Signed-off-by: stack <stack@apache.org>
2014-12-30 10:37:43 -08:00
tedyu 57b1efaabe HBASE-12607 TestHBaseFsck#testParallelHbck fails running against hadoop 2.6.0 2014-12-30 09:33:54 -08:00
Lars Hofhansl 0513a21dc8 HBASE-12776 SpliTransaction: Log number of files to be split. 2014-12-29 20:38:09 -08:00
xieliang c24810eebe HBASE-12767 Fix a StoreFileScanner NPE in reverse scan flow 2014-12-30 11:55:11 +08:00
stack 02b0332650 HBASE-12772 TestPerColumnFamilyFlush failing 2014-12-29 15:47:20 -08:00
Esteban Gutierrez b2eea8cac6 HBASE-12695 JDK 1.8 compilation broken
Signed-off-by: stack <stack@apache.org>
2014-12-29 11:02:04 -08:00
Elliott Clark e5ca773f78 HBASE-12429 Add port to ClusterManager's actions. 2014-12-29 10:22:52 -08:00
stack 8dac7f9e6c HBASE-12762 Region with no hfiles will have the highest locality cost in LocalityCostFunction (cuijianwei) 2014-12-29 07:44:46 -08:00
tedyu fbdaf62bf8 HBASE-12716 A bug in RegionSplitter.UniformSplit algorithm (Weichen Ye) 2014-12-28 07:48:24 -08:00
tedyu 9abab54d8e HBASE-12764 TestPerColumnFamilyFlush#testCompareStoreFileCount may fail due to new table not available 2014-12-27 21:10:47 -08:00
stack 317d137452 HBASE-12763 Make it so there must be WALs for a server to be marked dead 2014-12-27 13:09:40 -08:00
Elliott Clark 8426f1f53a HBASE-12697 Don't use RegionLocationFinder if localityCost == 0 2014-12-26 11:13:28 -08:00
Jonathan M Hsieh 30424ec73f HBASE-12749 Tighten HFileLink api to enable non-snapshot uses 2014-12-24 04:54:47 -08:00
Jonathan M Hsieh a912a56b38 HBASE-12590 A solution for data skew in HBase-Mapreduce jobs (Weichen Ye) 2014-12-24 04:50:42 -08:00
Jonathan M Hsieh 9a829dc458 HBASE-12735 Refactor TestAcidGuarantees so it can live as unit test and as an integration test 2014-12-23 17:18:58 -08:00
Jurriaan Mous 4880e5d83b HBASE-12736
Signed-off-by: stack <stack@apache.org>
2014-12-23 10:30:25 -08:00
Jurriaan Mous e92a9bf003 HBASE-12742
Signed-off-by: stack <stack@apache.org>
2014-12-23 10:14:16 -08:00
Devaraj Das 1c45d1cd9d HBASE-12012. Improve cancellation for the scan RPCs 2014-12-22 16:22:04 -08:00
stack 4d53fe5dcd HBASE-12734 TestPerColumnFamilyFlush.testCompareStoreFileCount is flakey (zhangduo) 2014-12-22 08:56:33 -08:00
tedyu fbf8b30aa6 HBASE-12741 AccessController contains a javadoc issue (Jurriaan Mous) 2014-12-22 08:32:37 -08:00
tedyu 51334fb951 HBASE-10201 Addendum fixes typo of putIfAbsent (Duo Zhang) 2014-12-21 07:22:41 -08:00
Jesse Yates e267db45ac HBASE-12703 Cleanup TestClientPushback for repeatability 2014-12-19 19:16:43 -08:00
stack feede7abd8 HBASE-12732 Log messages in FileLink#tryOpen are reversed (Tobi Vollebregt) 2014-12-19 17:47:11 -08:00
Enis Soztutar 40fb2e9219 HBASE-12720 Make InternalScan LimitedPrivate (Vladimir Rodionov) 2014-12-19 13:57:51 -08:00
Enis Soztutar d3002c6a8e HBASE-12511 namespace permissions - add support from table creation privilege in a namespace 'C' (Huaiyu Zhu) 2014-12-19 13:04:39 -08:00
Andrew Purtell 9a7adafcdb HBASE-12724 Upgrade the interface audience of RegionScanner from Private to LimitedPrivate 2014-12-19 09:37:03 -08:00
Virag Kothari dceaa2589f Revert "HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula)"
This reverts commit b24991d7a0.
2014-12-19 08:39:52 -08:00
Sean Busbey f1c41e307e HBASE-5699 Adds multiple WALs per Region Server based on groups of regions. 2014-12-19 10:31:41 -06:00
stack 0c7d22439d Fix single javadoc warning in VisibilityController -- removed a '@return' 2014-12-19 08:22:00 -08:00
tedyu cfd7584eef HBASE-12715 getLastSequenceId always returns -1 (Duo Zhang) 2014-12-19 06:58:16 -08:00
Jonathan M Hsieh 33c27f4e03 HBASE-12718 Convert TestAcidGuarantees from a unit test to an integration test 2014-12-18 17:21:23 -08:00
Virag Kothari b24991d7a0 HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula) 2014-12-18 17:00:07 -08:00
Virag Kothari 3caae62390 Revert "HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula)"
This reverts commit 9ae615f82b.
2014-12-18 11:29:39 -08:00
Virag Kothari 9ae615f82b HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula) 2014-12-18 11:24:26 -08:00
tedyu 15cf0a6e7b HBASE-12223 MultiTableInputFormatBase.getSplits is too slow (Yuanbo Peng) 2014-12-18 05:09:01 -08:00
Enis Soztutar 00f4ff420e HBASE-12683 Compilation with hadoop-2.7.0-SNAPSHOT is broken - ADDENDUM 2014-12-17 19:41:56 -08:00
Srikanth Srungarapu 072b2d659c HBASE-12640 Add Thrift-over-HTTPS and doAs support for Thrift Server 2014-12-17 16:12:48 -08:00
Jimmy Xiang d918570c80 Revert "Thrift Http implementation"
This reverts commit 1cf8521191.
2014-12-17 16:11:30 -08:00
Srikanth Srungarapu 1cf8521191 Thrift Http implementation 2014-12-17 16:06:19 -08:00
tedyu 6aa8b3727c HBASE-5162 Addendum to stabilize TestClientPushback 2014-12-17 12:37:40 -08:00