Commit Graph

294 Commits

Author SHA1 Message Date
Jonathan M Hsieh daed00fc98 HBASE-13141 IntegrationTestAcidGuarantees returns incorrect values for getColumnFamilies 2015-03-02 21:26:01 -08:00
Jonathan M Hsieh d2e64032c6 HBASE-13132 Improve RemoveColumn action debug message 2015-03-02 10:31:24 -08:00
Enis Soztutar 21b366afe1 HBASE-11842 Integration test for async wal replication to secondary regions 2015-02-22 21:29:12 -08:00
Jonathan M Hsieh fe335b683c Merge branch 'master' (2/11/15) into hbase-11339
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/HColumnDescriptor.java
	hbase-client/src/test/java/org/apache/hadoop/hbase/TestHColumnDescriptor.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/TagType.java
	hbase-common/src/main/resources/hbase-default.xml
	hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.java
	hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSourceImpl.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestAcidGuarantees.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/io/HFileLink.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/DisabledTableSnapshotHandler.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/DefaultStoreEngine.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/DefaultCompactor.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/StripeCompactor.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/ExportSnapshot.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/RestoreSnapshotHelper.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/SnapshotReferenceUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperStub.java
	pom.xml
	src/main/docbkx/book.xml
	src/main/docbkx/ops_mgt.xml
	src/main/docbkx/schema_design.xml
2015-02-22 12:54:45 -08:00
Dima Spivak ca25a6a870 HBASE-12869 Add a REST API implementation of the ClusterManager interface
Signed-off-by: stack <stack@apache.org>
2015-02-17 12:03:09 -08:00
Andrew Purtell 200ec5b191 HBASE-12747 IntegrationTestMTTR will OOME if launched with mvn verify (Abhishek Singh Chouhan) 2015-02-09 18:54:43 -08:00
stack 825871431e HBASE-12782 ITBLL fails for me if generator does anything but 5M per maptask 2015-01-30 19:12:17 -08:00
Devaraj Das 6b20a0f831 HBASE-11574. hbase:meta's regions can be replicated 2015-01-27 16:40:29 -08:00
Ramkrishna cfb0cf72d4 HBASE-12893 - IntegrationTestBigLinkedListWithVisibility should use
buffered writes (Jingcheng Du)
2015-01-27 10:25:23 +05:30
Nick Dimiduk ab18158e60 HBASE-12728 buffered writes substantially less useful after removal of HTablePool (Solomon Duskis and Nick Dimiduk)
In our pre-1.0 API, HTable is considered a light-weight object that consumed by
a single thread at a time. The HTablePool class provided a means of sharing
multiple HTable instances across a number of threads. As an optimization,
HTable managed a "write buffer", accumulating edits and sending a "batch" all
at once. By default the batch was sent as the last step in invocations of
put(Put) and put(List<Put>). The user could disable the automatic flushing of
the write buffer, retaining edits locally and only sending the whole "batch"
once the write buffer has filled or when the flushCommits() method in invoked
explicitly. Explicit or implicit batch writing was controlled by the
setAutoFlushTo(boolean) method. A value of true (the default) had the write
buffer flushed at the completion of a call to put(Put) or put(List<Put>). A
value of false allowed for explicit buffer management. HTable also exposed the
buffer to consumers via getWriteBuffer().

The combination of HTable with setAutoFlushTo(false) and the HTablePool
provided a convenient mechanism by which multiple "Put-producing" threads could
share a common write buffer. Both HTablePool and HTable are deprecated, and
they are officially replaced in The new 1.0 API by Table and BufferedMutator.
Table, which replaces HTable, no longer exposes explicit write-buffer
management. Instead, explicit buffer management is exposed via BufferedMutator.
BufferedMutator is made safe for concurrent use. Where code would previously
retrieve and return HTables from an HTablePool, now that code creates and
shares a single BufferedMutator instance across all threads.
2015-01-23 08:48:31 -08:00
Nick Dimiduk 9824eb7840 HBASE-12810 Update to htrace-incubating 2015-01-22 14:28:20 -08:00
Sean Busbey 418ea93774 HBASE-12898 ensure direct dependencies are declared. 2015-01-22 14:33:25 -06:00
Misty Stanley-Jones 1a21c1684c HBASE-11533 Asciidoc Proof of Concept 2015-01-13 22:32:29 -08:00
tedyu 9246af8dac HBASE-12796 Clean up HTable and HBaseAdmin deprecated constructor usage (Jurriaan Mous) 2015-01-08 07:49:28 -08:00
tedyu 2452d3861f HBASE-12802 Remove unnecessary Table.flushCommits() (Solomon Duskis) 2015-01-05 15:45:52 -08:00
Enis Soztutar 24bcebdeeb HBASE-12799 ITAG fails with java.lang.RuntimeException if table does not exist 2015-01-05 11:14:40 -08:00
tedyu ac95cc1fbb HBASE-12783 Create efficient RegionLocator implementation (Solomon Duskis) 2015-01-02 19:48:06 -08:00
Esteban Gutierrez b2eea8cac6 HBASE-12695 JDK 1.8 compilation broken
Signed-off-by: stack <stack@apache.org>
2014-12-29 11:02:04 -08:00
Elliott Clark e5ca773f78 HBASE-12429 Add port to ClusterManager's actions. 2014-12-29 10:22:52 -08:00
Jonathan M Hsieh 9a829dc458 HBASE-12735 Refactor TestAcidGuarantees so it can live as unit test and as an integration test 2014-12-23 17:18:58 -08:00
Jonathan M Hsieh 4a6f1d9d6b HBASE-12718 Convert TestAcidGuarantees from a unit test to an integration test 2014-12-18 17:45:08 -08:00
Jonathan M Hsieh 33c27f4e03 HBASE-12718 Convert TestAcidGuarantees from a unit test to an integration test 2014-12-18 17:21:23 -08:00
Yi Deng 555d14ed45 HBASE-12680 Move signal related code from ClusterManager to HBaseClusterManager and change ClusterManager to an interface
Summary: The reason of this change is to make us write implementation of ClusterManager not using ssh/unix signals.

Test Plan: The compilation is OK.

Reviewers: eclark, manukranthk

Differential Revision: https://reviews.facebook.net/D30201

Signed-off-by: Elliott Clark <eclark@apache.org>
2014-12-15 09:09:43 -08:00
Yi Deng fe12ad5066 Fix the ASCII art
Signed-off-by: stack <stack@apache.org>
2014-12-11 17:22:29 -08:00
Andrew Purtell bb15fd5fe0 HBASE-12606 Sanity check encryption configuration before opening WAL or onlining regions
Also disables IntegrationTestIngestWithEncryption if distributed
cluster configuration is missing prerequisites.
2014-12-06 21:46:43 -08:00
Devaraj Das ca0c1774c9 HBASE-12548. Improve debuggability of IntegrationTestTimeBoundedRequestsWithRegionReplicas 2014-12-06 18:18:03 -08:00
stack 54f438cee4 HBASE-12616 We lost the linked list commands in recent usage refactoring 2014-12-02 14:15:04 -08:00
stack 7a3396f0e1 HBASE-12490 Replace uses of setAutoFlush(boolean, boolean) (Solomon Duskis) 2014-12-02 10:06:21 -08:00
stack 1a9b556474 Revert "HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG"
This reverts commit 8b8f2026bd.

Overcommit. Added "HBASE-12490 Replace uses of setAutoFlush(boolean,
boolean)" by mistake

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClusterStatusListener.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
2014-12-02 09:51:19 -08:00
stack 69a437ac0d HBASE-12514 Cleanup HFileOutputFormat legacy code (Solomon Duskis)
Signed-off-by: stack <stack@apache.org>
2014-12-01 10:15:51 -08:00
stack 58b6b24c29 HBASE-12519 Remove tabs used as whitespace (Varun Saxena) 2014-11-28 20:50:02 -08:00
stack 8b8f2026bd HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG 2014-11-25 21:21:50 -08:00
stack 336c22d581 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) under src/main/java
Move from HConnection to ClusterConnection or Connection
Use unmanaged connections where we use managed previous
(used the jdk7 https://docs.oracle.com/javase/7/docs/technotes/guides/language/try-with-resources.html idiom).

In ZKConfig, synchronize on Configuration rather than make a copy.
Making a copy we were dropping hbase configs in certain test context
(could not find the zk ensemble because default port).

In tests, some move to the new style connection setup but mostly
fixes for premature connection close or adding cleanup where it
was lacking.
2014-11-24 09:46:28 -08:00
stack 5f391efda1 Revert "HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)"
This reverts commit d3e7c3cfa9.
2014-11-18 16:30:52 -08:00
stack b94e6738d9 HBASE-10378 Refactor write-ahead-log implementation -- ADDEDNUM 2014-11-18 12:12:35 -08:00
stack d3e7c3cfa9 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) 2014-11-18 09:48:54 -08:00
Nick Dimiduk 42c03460e4 HBASE-12472 Improve debuggability of IntegrationTestBulkLoad 2014-11-17 09:24:06 +01:00
Andrew Purtell 3b8c0769cc HBASE-12450 Unbalance chaos monkey might kill all region servers without starting them back (Virag Kothari) 2014-11-07 17:24:46 -08:00
Nick Dimiduk 3c06b48181 HBASE-12403 IntegrationTestMTTR flaky due to aggressive RS restart timeout 2014-11-01 10:34:59 -07:00
Nick Dimiduk b784f7db99 HBASE-12401 Add some timestamp signposts in IntegrationTestMTTR 2014-10-31 17:21:20 -07:00
Nick Dimiduk f5d6314c87 HBASE-12335 IntegrationTestRegionReplicaPerf is flaky 2014-10-31 17:12:21 -07:00
Enis Soztutar 42ed215c2d HBASE-12367 Integration tests should not restore the cluster if the CM is not destructive 2014-10-28 17:10:50 -07:00
Andrew Purtell 70a312e53f HBASE-11912 Catch some bad practices at compile time with error-prone 2014-10-27 09:29:23 -07:00
Andrew Purtell ff5bc351b2 Revert "HBASE-11912 Catch some bad practices at compile time with error-prone"
This reverts commit 7ed0260eff.
2014-10-25 08:33:43 -07:00
Andrew Purtell 7ed0260eff HBASE-11912 Catch some bad practices at compile time with error-prone 2014-10-24 18:15:12 -07:00
Elliott Clark 11638a8cf2 HBASE-12322 Add Clean command to ITBLL
Signed-off-by: stack <stack@apache.org>
2014-10-23 20:53:43 -07:00
Elliott Clark 84f3549d5e HBASE-12314 Add chaos monkey policy to execute two actions concurrently 2014-10-22 15:19:30 -07:00
Nick Dimiduk ebe8db5869 HBASE-12317 Run IntegrationTestRegionReplicaPerf w.o mapred 2014-10-22 10:18:28 -07:00
Matteo Bertozzi 49056295ef HBASE-12161 Add support for grant/revoke on namespaces in AccessControlClient (Srikanth Srungarapu) 2014-10-18 21:18:42 +01:00
Dima Spivak dc86001523 HBASE-12252 IntegrationTestBulkLoad fails with illegal partition error
Signed-off-by: stack <stack@apache.org>
2014-10-14 14:04:19 -07:00
Jimmy Xiang 408de0fbb3 HBASE-11838 Enable PREFIX_TREE in integration tests 2014-10-07 09:48:21 -07:00
Andrew Purtell 3557a32352 HBASE-12106 Move test annotations to test artifact (Enis Soztutar) 2014-10-06 23:16:22 -07:00
Enis Soztutar 6189b52fb0 HBASE-12042 Replace internal uses of HTable(Configuration, String) with HTable(Configuration, TableName) (Solomon Duskis) 2014-09-29 18:39:44 -07:00
Nick Dimiduk a36ffdaff7 HBASE-12008 Remove IntegrationTestImportTsv#testRunFromOutputCommitter 2014-09-29 13:29:28 -07:00
anoopsjohn 629042f4ce HBASE-12085 mob status should print human readable numbers.(Jingcheng Du) 2014-09-26 13:29:36 +05:30
Jonathan M Hsieh a7f8035ec5 HBASE-12080 Shorten the run time of integration test by default when using mvn failsafe:integration-test (Jingcheng Du) 2014-09-24 06:40:04 -07:00
Elliott Clark 0a28af366b HBASE-12076 Move InterfaceAudience imports to hbase-annotations 2014-09-24 03:57:55 -07:00
Elliott Clark a5bd931682 HBASE-12059 Create hbase-annotations module 2014-09-23 16:44:14 -07:00
Elliott Clark 2635791027 HBASE-12062 Fix usage of Collections.toArray 2014-09-23 09:58:24 -07:00
stack 38dfd9c2aa HBASE-10134 Add Chaos Monkey that doesn't touch the master (Matteo Bertozzi ADDENDUM) 2014-09-18 16:04:38 -07:00
Elliott Clark 50501f8100 HBASE-10314 Add Chaos Monkey that doesn't touch the master 2014-09-18 11:44:03 -07:00
Enis Soztutar f249f242be HBASE-11989 IntegrationTestLoadAndVerify cannot be configured anymore on distributed mode 2014-09-16 12:23:43 -07:00
Enis Soztutar cad76a3431 HBASE-11825 Create Connection and ConnectionManager (Solomon Duskis) 2014-09-16 11:40:29 -07:00
anoopsjohn e5d3850776 HBASE-11647 addendum to fix compile issues. 2014-09-13 19:47:07 +05:30
stack 3c9bd7d296 HBASE-11911 Break up tests into more fine grained categories (Alex Newman) 2014-09-12 21:37:06 -07:00
anoopsjohn 0c86d83e1f HBASE-11647 MOB integration testing. - addendum(Jingcheng Du) 2014-09-09 16:18:38 +05:30
Enis Soztutar 4995ed8a02 HBASE-11679 Replace HTable with HTableInterface where backwards-compatible (Carter) 2014-09-08 23:39:34 -07:00
Enis Soztutar b73dd89fba HBASE-11836 IntegrationTestTimeBoundedMultiGetRequestsWithRegionReplicas tests simple get by default (Nicolas Liochon) 2014-09-08 16:26:18 -07:00
anoopsjohn 3e563c5cc7 HBASE-11647 MOB integration testing. (Jingcheng Du) 2014-09-06 10:06:37 +05:30
Enis Soztutar 1a6eea335f HBASE-11826 Split each tableOrRegionName admin methods into two targetted methods (Carter and Enis) 2014-09-03 14:39:35 -07:00
stack 3bfbd06291 HBASE-11822 Convert EnvironmentEdge#getCurrentTimeMillis to getCurrentTime 2014-08-29 17:14:25 -07:00
stack e91e2659a7 HBASE-11068 Update code to use Admin factory method instead of constructor 2014-08-04 11:42:38 -07:00
Nicolas Liochon d8401c8e44 HBASE-11564 Improve cancellation management in the rpc layer 2014-07-24 15:53:32 +02:00
Ramkrishna fe50c6d366 HBASE-11489 ClassNotFoundException while running IT tests in trunk using
'mvn verify' (Ram)
2014-07-15 22:48:08 +05:30
Ramkrishna e71d69bf00 HBASE-11509 Forward port HBASE-11039 to trunk and branch-1 after
HBASE-11489 (Ram)
2014-07-14 22:52:48 +05:30
Ramkrishna 586c5931a5 HBASE-11506 IntegrationTestWithCellVisibilityLoadAndVerify allow User to
be passed as arg (Ram)
2014-07-14 16:31:43 +05:30
Ted Yu 6c102e22f0 HBASE-11422 Specification of scope is missing for certain Hadoop dependencies (Konstantin Boudnik) 2014-07-04 12:40:13 +00:00
Ramkrishna 80f0a522f9 HBASE-11449 IntegrationTestIngestWithACL fails to use different users
after HBASE-10810 (Ram)
2014-07-03 12:03:59 +05:30
Enis Soztutar 92c52a727a Updated version in master to 2.0.0-SNAPSHOT after 'branch-1' is created for 1.x line of releases 2014-06-30 20:26:47 -07:00
Devaraj Das 8e40fa0c41 HBASE-10818. Addendum to reduce the number of times sleep happens in the coprocessor. Also, puts back code to set consistency that got deleted by accident in the last commit. 2014-06-27 16:39:40 -07:00
Devaraj Das e5ec49b123 HBASE-10818. Add integration test for bulkload with replicas (Nick Dimiduk and Devaraj Das) 2014-06-27 16:39:40 -07:00
Enis Soztutar 25baace0de HBASE-10810 LoadTestTool should share the connection and connection pool
git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/hbase-10070@1595078 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 16:39:40 -07:00
ndimiduk d313103aeb HBASE-10791 Add integration test to demonstrate performance improvement
git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/hbase-10070@1585807 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 16:39:39 -07:00
Devaraj Das 41116848e5 HBASE-10616. Integration test for multi-get calls
git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/hbase-10070@1577372 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 16:39:38 -07:00
Enis Soztutar 759cfb83af HBASE-10572 Create an IntegrationTest for region replicas
git-svn-id: https://svn.apache.org/repos/asf/hbase/branches/hbase-10070@1576465 13f79535-47bb-0310-9956-ffa450edef68
2014-06-27 16:39:38 -07:00
Enis Soztutar 235aaee4fe HBASE-11376 Presplit table in IntegrationTestBigLinkedList's Generator tool 2014-06-24 17:56:48 -07:00
Michael Stack 5764df2974 HBASE-11348 Make frequency and sleep times of chaos monkeys configurable (Vandan Ayyalasomayajula) 2014-06-19 14:50:50 -07:00
Jimmy Xiang 84ed7cf645 HBASE-11345 Add an option not to restore cluster after an IT test 2014-06-13 14:27:18 -07:00
Andrew Purtell 1279ae807c HBASE-11253 IntegrationTestWithCellVisibilityLoadAndVerify failing since HBASE-10326 (Anoop Sam John) 2014-05-26 11:28:07 -07:00
Andrew Purtell 1f14726afb Amend HBASE-11251 Attempt grants during tests only when security is enabled 2014-05-26 11:04:11 -07:00
Andrew Purtell 41691e469a HBASE-10831 IntegrationTestIngestWithACL is not setting up LoadTestTool correctly (Vandana Ayyalasomayajula) 2014-05-22 18:56:20 -07:00
Zhihong Yu 71c1d02f02 HBASE-11104 IntegrationTestImportTsv#testRunFromOutputCommitter misses credential initialization (Vandana)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1596277 13f79535-47bb-0310-9956-ffa450edef68
2014-05-20 14:51:00 +00:00
ndimiduk 4c8510f852 HBASE-11137 Add mapred.TableSnapshotInputFormat
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1594982 13f79535-47bb-0310-9956-ffa450edef68
2014-05-15 17:00:37 +00:00
mbertozzi 788b285e11 HBASE-8332 Add truncate as HMaster method
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1593439 13f79535-47bb-0310-9956-ffa450edef68
2014-05-08 22:25:01 +00:00
Jonathan Hsieh 3e3b9a2f65 HBASE-5697 Audit HBase for usage of deprecated hadoop 0.20.x, 1.x property names (Srikanth Srungarapu)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1591045 13f79535-47bb-0310-9956-ffa450edef68
2014-04-29 18:19:37 +00:00
Michael Stack b2ef1ce01c HBASE-10886 add htrace-zipkin to the runtime dependencies again -- REVERT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1584935 13f79535-47bb-0310-9956-ffa450edef68
2014-04-04 23:19:35 +00:00
Michael Stack 62908378bc HBASE-10886 add htrace-zipkin to the runtime dependencies again (Masatake Iwasaki)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1584455 13f79535-47bb-0310-9956-ffa450edef68
2014-04-03 23:04:10 +00:00
ndimiduk 62327bc08d HBASE-10830 Integration test MR jobs attempt to load htrace jars from the wrong location
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1583826 13f79535-47bb-0310-9956-ffa450edef68
2014-04-01 23:27:56 +00:00
jxiang 7716a3ca94 HBASE-10569 Co-locate meta and master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1581479 13f79535-47bb-0310-9956-ffa450edef68
2014-03-25 19:34:52 +00:00
Michael Stack c4610ecab2 HBASE-10746 Bump the version of HTrace to 3.0
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1580076 13f79535-47bb-0310-9956-ffa450edef68
2014-03-21 22:46:03 +00:00