Commit Graph

3475 Commits

Author SHA1 Message Date
Andrew Purtell f9cf565f1d HBASE-9910 TestHFilePerformance and HFilePerformanceEvaluation should be merged in a single HFile performance test class (Vikas Vishwakarma)
Amending-Author: Andrew Purtell <apurtell@apache.org>
2015-02-10 16:11:08 -08:00
stack fa852c4ce6 HBASE-12035 Keep table state in META (Andrey Stepachev) 2015-02-10 14:20:47 -08:00
tedyu a3f495f20d HBASE-13004 Make possible to explain why HBaseTestingUtility.waitFor fails (Andrey Stepachev) 2015-02-10 07:33:52 -08:00
Sean Busbey 3d692cf044 HBASE-12997 print wal pipeline on low replication. 2015-02-09 23:02:16 -06:00
Enis Soztutar f97c00fd99 HBASE-12998 Compilation with Hdfs-2.7.0-SNAPSHOT is broken after HDFS-7647 2015-02-09 18:17:33 -08:00
Andrew Purtell 1e6afa2f3c HBASE-12973 RegionCoprocessorEnvironment should provide HRegionInfo directly 2015-02-09 17:57:40 -08:00
Esteban Gutierrez 1f830bea89 HBASE-12984: SSL cannot be used by the InfoPort in branch-1 2015-02-09 16:43:37 -08:00
stack eea9873cef HBASE-12985 Javadoc warning and findbugs fixes to get us green again 2015-02-07 17:05:11 -08:00
Jeffrey Zhong 3f4427739d HBASE-11567 Write bulk load COMMIT events to WAL (Alex Newman, Jeffrey Zhong) 2015-02-06 18:07:30 -08:00
Andrew Purtell 7f4146bf4d Revert "HBASE-12891 Parallel execution for Hbck checkRegionConsistency"
This reverts commit eddd5739a1.
2015-02-06 16:52:04 -08:00
stack 2f2faa68d1 HBASE-12966 NPE in HMaster while recovering tables in Enabling state; ADDENDUM 2015-02-06 16:01:43 -08:00
rahulgidwani eddd5739a1 HBASE-12891 Parallel execution for Hbck checkRegionConsistency
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-02-06 15:14:18 -08:00
Esteban Gutierrez 3b56d2a0bc HBASE-12956 Binding to 0.0.0.0 is broken after HBASE-10569
Signed-off-by: Enis Soztutar <enis@apache.org>
2015-02-06 14:35:20 -08:00
stack 57319c536a HBASE-12980 Delete of a table may not clean all rows from hbase:meta 2015-02-06 14:06:59 -08:00
Jesse Yates 75148385ee HBASE-12979 Use setters instead of return values for handing back statistics from HRegion methods 2015-02-06 13:24:20 -08:00
stack 96cdc7987e HBASE-12958 SSH doing hbase:meta get but hbase:meta not assigned 2015-02-04 22:56:40 -08:00
tedyu 8aeb3acaf9 HBASE-12966 NPE in HMaster while recovering tables in Enabling state (Andrey Stepachev) 2015-02-04 14:53:55 -08:00
Victoria Dudin 4f472062a4 HBASE-12961 Fix negative values in read and write region server metrics. 2015-02-04 10:32:09 -08:00
Ramkrishna 37ef793fab HBASE-12962 - TestHFileBlockIndex.testBlockIndex() commented out during
HBASE-10531 (Ram)
2015-02-04 11:42:55 +05:30
tedyu fd0bb89fdf HBASE-12957 Revert accidental checkin of unrelated test 2015-02-03 21:20:42 -08:00
tedyu 4388fed830 HBASE-12957 region_mover#isSuccessfulScan may be extremely slow on region with lots of expired data (Hongyu Bi) 2015-02-03 20:06:23 -08:00
stack 7861e518ef HBASE-7332 [webui] HMaster webui should display the number of regions a table has. (Andrey Stepachev) 2015-02-03 09:24:54 -08:00
Devaraj Das cf5ad96fcc HBASE-10942. support parallel request cancellation for multi-get (Nicolas Liochon & Devaraj Das) 2015-02-02 23:01:31 -08:00
zhangduo eb351b9ff8 HBASE-8329 Limit compaction speed
Signed-off-by: stack <stack@apache.org>
2015-02-02 22:19:05 -08:00
stack da30c72b73 HBASE-12951 TestHCM.testConnectionClose is flakey when using AsyncRpcClient as client implementation; ADDENDUM -- Remove flakey marking from TestHCM 2015-02-02 20:51:51 -08:00
stack 825871431e HBASE-12782 ITBLL fails for me if generator does anything but 5M per maptask 2015-01-30 19:12:17 -08:00
stack 538388c2b5 HBASE-6778 Deprecate Chore; its a thread per task when we should have one thread to do all tasks (Jonathan Lawlor) 2015-01-29 19:26:26 -08:00
Lars Hofhansl 9c37d5dab7 HBASE-12859; Addendum 2015-01-29 14:10:59 -08:00
Lars Hofhansl 1270e590d1 HBASE-12859 New master API to track major compaction completion. 2015-01-29 13:58:27 -08:00
tedyu 6bfa8ea977 HBASE-12936 Quota support for namespace should take region merge into account 2015-01-29 09:12:24 -08:00
Devaraj Das 7c8aa2e963 HBASE-11574. Addendum that should fix a unit test (TestMetaWithReplicas#testChangingReplicaCount) that fails once in a while 2015-01-29 00:27:08 -08:00
Ashish Singhi 070e2dd89a HBASE-12831 Changing the set of vis labels a user has access to doesn't generate an audit log event
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-01-28 16:29:45 -06:00
Devaraj Das 6b20a0f831 HBASE-11574. hbase:meta's regions can be replicated 2015-01-27 16:40:29 -08:00
Enis Soztutar 0f6faaf5fc HBASE-12916 No access control for replicating WAL entries (Liu Shaohui) 2015-01-27 15:33:29 -08:00
tedyu f7df0990c2 HBASE-12929 TableMapReduceUtil.initTableMapperJob unnecessarily limits the types of outputKeyClass and outputValueClass (Will Temperley) 2015-01-27 07:58:11 -08:00
Matteo Bertozzi b866e01a98 HBASE-12925 Use acl cache for doing access control checks in prepare and clean phases of Bulkloading (Srikanth Srungarapu) 2015-01-27 12:47:46 +00:00
tedyu aaeafca920 HBASE-7847 Use zookeeper multi to clear znodes (Rakesh R) 2015-01-26 21:40:39 -08:00
Enis Soztutar 2fb19fb951 HBASE-11908 Region replicas should be added to the meta table at the time of table creation 2015-01-26 19:55:47 -08:00
rahulgidwani a85cb0f89a HBASE-12627 Add back snapshot batching facility
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-01-26 18:44:25 -08:00
tedyu 1b9367d465 HBASE-12917 HFilePerformanceEvaluation Scan tests fail with StackOverflowError due to recursive call in createCell function (Vikas Vishwakarma) 2015-01-26 15:25:02 -08:00
Elliott Clark 45fdc0e835 HBASE-12892 Add a class to allow taking a snapshot from the command line 2015-01-25 17:18:50 -08:00
Jurriaan Mous 854f13afa1 HBASE-12684 Add new AsyncRpcClient (Jurriaan Mous)
Signed-off-by: stack <stack@apache.org>
2015-01-24 18:05:39 -08:00
Enis Soztutar e05341d01d HBASE-12728 buffered writes substantially less useful after removal of HTablePool (addendum for failing test in branch-1.0) 2015-01-24 17:57:04 -08:00
tedyu 8261d84290 HBASE-8410 Basic quota support for namespaces (Vandana) 2015-01-24 10:36:49 -08:00
tedyu 74adb11f4c HBASE-10499 In write heavy scenario one of the regions does not get flushed causing RegionTooBusyException (Ram and Ted) 2015-01-23 09:43:01 -08:00
Nick Dimiduk ab18158e60 HBASE-12728 buffered writes substantially less useful after removal of HTablePool (Solomon Duskis and Nick Dimiduk)
In our pre-1.0 API, HTable is considered a light-weight object that consumed by
a single thread at a time. The HTablePool class provided a means of sharing
multiple HTable instances across a number of threads. As an optimization,
HTable managed a "write buffer", accumulating edits and sending a "batch" all
at once. By default the batch was sent as the last step in invocations of
put(Put) and put(List<Put>). The user could disable the automatic flushing of
the write buffer, retaining edits locally and only sending the whole "batch"
once the write buffer has filled or when the flushCommits() method in invoked
explicitly. Explicit or implicit batch writing was controlled by the
setAutoFlushTo(boolean) method. A value of true (the default) had the write
buffer flushed at the completion of a call to put(Put) or put(List<Put>). A
value of false allowed for explicit buffer management. HTable also exposed the
buffer to consumers via getWriteBuffer().

The combination of HTable with setAutoFlushTo(false) and the HTablePool
provided a convenient mechanism by which multiple "Put-producing" threads could
share a common write buffer. Both HTablePool and HTable are deprecated, and
they are officially replaced in The new 1.0 API by Table and BufferedMutator.
Table, which replaces HTable, no longer exposes explicit write-buffer
management. Instead, explicit buffer management is exposed via BufferedMutator.
BufferedMutator is made safe for concurrent use. Where code would previously
retrieve and return HTables from an HTablePool, now that code creates and
shares a single BufferedMutator instance across all threads.
2015-01-23 08:48:31 -08:00
Rajeshbabu Chintaguntla e13b9938a1 HBASE-12791 HBase does not attempt to clean up an aborted split when the regionserver shutting down-addendum(Rajeshbabu) 2015-01-23 12:41:45 +05:30
Andrew Purtell 71ab4ddb19 HBASE-12731 Heap occupancy based client pushback 2015-01-22 17:33:21 -08:00
Nick Dimiduk 9824eb7840 HBASE-12810 Update to htrace-incubating 2015-01-22 14:28:20 -08:00
Sean Busbey 418ea93774 HBASE-12898 ensure direct dependencies are declared. 2015-01-22 14:33:25 -06:00
anoopsjohn 833feefbf9 HBASE-12745 Visibility Labels: support visibility labels for user groups. (Jerry He) 2015-01-22 11:36:17 +05:30
Enis Soztutar 8b7a20f4ee HBASE-12393 The regionserver web will throw exception if we disable block cache (ChiaPing Tsai) 2015-01-21 17:22:10 -08:00
Enis Soztutar 8793383b66 HBASE-12774 Fix the inconsistent permission checks for bulkloading. (Srikanth Srungarapu) 2015-01-21 17:03:55 -08:00
Enis Soztutar 735fe20029 HBASE-12864 IntegrationTestTableSnapshotInputFormat fails 2015-01-21 16:21:42 -08:00
tedyu e87a69d9c0 HBASE-12886 Correct tag option name in PerformanceEvaluation (Jerry He) 2015-01-21 12:30:51 -08:00
Nick Dimiduk 9bdb81f0a1 HBASE-12887 Cleanup many checkstyle errors in o.a.h.h.client 2015-01-20 12:44:36 -08:00
Nick Dimiduk 3e777898aa HBASE-12881 TestFastFail is not compatible with surefire.rerunFailingTestsCount 2015-01-20 09:29:42 -08:00
rahulgidwani f71b980d37 HBASE-11195 Potentially improve block locality during major compaction for old regions
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-01-19 17:33:17 -08:00
Andrew Purtell 53815afc10 HBASE-12878 Incorrect HFile path in TestHFilePerformance print output (Vikas Vishwakarma) 2015-01-19 12:46:44 -08:00
Andrew Purtell 03e17168c3 HBASE-12840 Improve unit test coverage of the client pushback mechanism 2015-01-17 11:50:26 -08:00
Enis Soztutar a55bd21340 HBASE-12862 Uppercase wals in RegionServer webUI 2015-01-16 11:12:14 -08:00
zhangduo 7309bb4317 HBASE-12863 Master info port on RS UI is always 0
Signed-off-by: Enis Soztutar <enis@apache.org>
2015-01-16 10:45:38 -08:00
Matteo Bertozzi 621b33f2f9 HBASE-12773 Add warning message when user is trying to bulkload a large HFile (Srikanth Srungarapu) 2015-01-15 23:13:47 +00:00
tedyu eafc07a06d HBASE-12848 Utilize Flash storage for WAL 2015-01-15 08:52:30 -08:00
Enis Soztutar 51575197de HBASE-12844 ServerManager.isServerReacable() should sleep between retries 2015-01-14 15:45:46 -08:00
Rajeshbabu Chintaguntla 7e872a81a9 HBASE-12847 TestZKLessSplitOnCluster frequently times out in 0.98 builds(Rajeshbabu) 2015-01-15 00:00:37 +05:30
Misty Stanley-Jones 1a21c1684c HBASE-11533 Asciidoc Proof of Concept 2015-01-13 22:32:29 -08:00
stack 608025ae67 HBASE-7541 Convert all tests that use HBaseTestingUtility.createMultiRegions to HBA.createTable (Jonathan Lawlor) 2015-01-13 22:10:12 -08:00
Nick Dimiduk 9b7f36b8cf HBASE-11983 HRegion constructors should not create HLog 2015-01-13 15:07:59 -08:00
Virag Kothari 4ac457a7bc HBASE-12480 Regions in FAILED_OPEN/FAILED_CLOSE should be processed on master failover 2015-01-13 11:03:16 -08:00
tedyu 72a6a670ac HBASE-12849 LoadIncrementalHFiles should use unmanaged connection in branch-1 2015-01-13 10:51:56 -08:00
tedyu e5f3dd682f HBASE-11144 Filter to support scanning multiple row key ranges (Jiajia Li) 2015-01-13 07:02:06 -08:00
Andrew Purtell e52d8f85c4 HBASE-12838 After HBASE-5162 RSRpcServices accidentally applies mutations twice 2015-01-12 11:45:36 -08:00
Rajeshbabu Chintaguntla 5b850caa80 HBASE-12791 HBase does not attempt to clean up an aborted split when the regionserver shutting down(Rajeshbabu) 2015-01-12 01:04:26 +05:30
tedyu f6a017ce63 HBASE-12798 Map Reduce jobs should not create Tables in setConf() (Solomon Duskis) 2015-01-10 14:23:03 -08:00
tedyu 988cba762a HBASE-12834 Promote ScanType to LimitedPrivate 2015-01-09 15:35:14 -08:00
Nick Dimiduk 4bfd35aabc HBASE-12825 CallRunner exception messages should include destination host:port 2015-01-08 18:40:01 -08:00
Enis Soztutar 4d7c65ae84 HBASE-12824 CompressionTest fails with org.apache.hadoop.hbase.io.hfile.AbstractHFileReader: Not seeked to a key/value 2015-01-08 15:51:30 -08:00
Nick Dimiduk dde713ee4e HBASE-12071 Separate out thread pool for Master <-> RegionServer communication (Stephen Yuan Jiang) 2015-01-08 14:17:00 -08:00
tedyu 4ea490b63a HBASE-12811 [AccessController] NPE while scanning a table with user not having READ permission on the namespace (Ashish) 2015-01-08 09:06:12 -08:00
tedyu ee32eebeab HBASE-12819 ExportSnapshot doesn't close FileSystem instances 2015-01-08 08:51:25 -08:00
tedyu 9246af8dac HBASE-12796 Clean up HTable and HBaseAdmin deprecated constructor usage (Jurriaan Mous) 2015-01-08 07:49:28 -08:00
tedyu 645fbd7d87 HBASE-12817 Data missing while scanning using PREFIX_TREE data block encoding (Duo Zhang) 2015-01-07 18:45:09 -08:00
Virag Kothari 7dce0d5c45 HBASE-12694 testTableExistsIfTheSpecifiedTableRegionIsSplitParent in TestSplitTransactionOnCluster class leaves regions in transition (Vandana Ayyalasomayajula) 2015-01-07 10:57:47 -08:00
tedyu 45fc2bdd86 HBASE-10528 DefaultBalancer selects plans to move regions onto draining nodes (Churro Morales) 2015-01-06 12:33:28 -08:00
Sean Busbey 26e3e1b300 HBASE-12339 WALPerformanceEvaluation should have a log roller. 2015-01-06 08:22:48 -06:00
Lars Hofhansl 7774f964e6 HBASE-12779 SplitTransaction: Add metrics. 2015-01-05 17:13:58 -08:00
tedyu 2452d3861f HBASE-12802 Remove unnecessary Table.flushCommits() (Solomon Duskis) 2015-01-05 15:45:52 -08:00
tedyu 5b53a187d2 HBASE-12793 [hbck] closeRegionSilentlyAndWait() should log cause of IOException and retry until hbase.hbck.close.timeout expires (Esteban) 2015-01-05 15:05:35 -08:00
tedyu 37e1bb61f4 HBASE-12785 Use FutureTask to timeout the attempt to get the lock for hbck 2015-01-05 14:09:58 -08:00
Enis Soztutar 24bcebdeeb HBASE-12799 ITAG fails with java.lang.RuntimeException if table does not exist 2015-01-05 11:14:40 -08:00
tedyu 2ba6053163 HBASE-12804 ImportTsv fails to delete partition files created by it (Ashish) 2015-01-05 09:29:00 -08:00
tedyu ac95cc1fbb HBASE-12783 Create efficient RegionLocator implementation (Solomon Duskis) 2015-01-02 19:48:06 -08:00
Enis Soztutar 820f629423 HBASE-12028 Abort the RegionServer, when it's handler threads die (Alicia Ying Shu) 2015-01-02 13:07:57 -08:00
Sean Busbey a90e64c637 HBASE-12719 test provider to remove just the hdfs interactions from fshlog.
* Adds a provider that takes a config to determine if we actually do syncs, appends, and file rolls.
  - required relaxing some members of FSHLog from private to protected.
* Fixes DisabledWALProvider so it can be used as hbase.wal.provider in the wal perf eval tool.
2014-12-31 16:01:07 -06:00
Aditya Kishore 8514e2b20e HBASE-12775: CompressionTest ate my HFile 2014-12-30 16:14:59 -08:00
stack 305267b8e2 HBASE-12270 A bug in the bucket cache, with cache blocks on write enabled (Liu Shaohui) 2014-12-30 14:43:19 -08:00
Jurriaan Mous baa2d05374 HBASE-12740 Improve performance of TestHBaseFsck
Signed-off-by: stack <stack@apache.org>
2014-12-30 14:29:46 -08:00
stack 734324e80f Revert "HBASE-12740 Improve performance of TestHBaseFsck"
Undo because Jurriaan Mous did update in meantime.

This reverts commit 042743fff0.
2014-12-30 12:19:57 -08:00
stack c6002ccd38 HBASE-12772 TestPerColumnFamilyFlush failing -- ADDENDUM 2014-12-30 11:37:31 -08:00