Commit Graph

351 Commits

Author SHA1 Message Date
Enis Soztutar ed07a38d59 HBASE-16190 IntegrationTestDDLMasterFailover failed with IllegalArgumentException: n must be positive (Romil Choksi and Heng Chen) 2016-07-07 16:34:13 -07:00
Enis Soztutar 74090faafe HBASE-16182 Increase IntegrationTestRpcClient timeout 2016-07-06 11:28:50 -07:00
Sergey Soldatov 7fed7a8f4e HBASE-15957 RpcClientImpl.close never ends in some circumstances
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-06-07 11:38:11 -07:00
Sean Mackrory 878b1ea721 HBASE-15889. String case conversions are locale-sensitive, used without locale
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-06-06 12:14:20 -05:00
Enis Soztutar 5202d3c25b HBASE-15295 MutateTableAccess.multiMutate() does not get high priority causing a deadlock
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/CoprocessorRpcChannel.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/MasterCoprocessorRpcChannel.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/ipc/RegionCoprocessorRpcChannel.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/DistributedHBaseCluster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/HConnectionTestingUtility.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide3.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestScannersFromClientSide.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestClockSkewDetection.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerNoMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/access/TestNamespaceCommands.java
2016-03-28 17:00:21 -07:00
Mikhail Antonov 998e339d6e HBASE-15342 create branch-1.3 and update branch-1 poms to 1.4.0-SNAPSHOT 2016-02-28 16:23:29 -08:00
stack 71d66a6ac7 HBASE-15190 Monkey dies when running on shared cluster (gives up when can't kill the other fellows processes) 2016-01-31 10:52:16 -06:00
Jonathan M Hsieh b3c5f09ee0 HBASE-15104 Occasional failures due to NotServingRegionException in IT tests (Huaxiang Sun) 2016-01-14 09:10:49 -08:00
Samir Ahmic b59f0240e5 HBASE-15034 IntegrationTestDDLMasterFailover does not clean created namespaces.
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-12-24 04:59:13 -08:00
stack f730a375e3 HBASE-14819 hbase-it tests failing with OOME; permgen 2015-12-02 10:15:32 -08:00
stack c4bc1c07bc Revert "HBASE-14223 Meta WALs are not cleared if meta region was closed and RS aborts"
Test TestRegionRebalancing is failing fairly reliably since this went in.

This reverts commit c719e8c456.
2015-12-01 16:02:31 -08:00
Enis Soztutar c719e8c456 HBASE-14223 Meta WALs are not cleared if meta region was closed and RS aborts 2015-11-30 17:07:54 -08:00
stack 5038bb3f3f Revert "HBASE-14819 hbase-it tests failing with OOME; permgen ADDENDUM"
This reverts commit c0bc1e944f.
2015-11-20 12:07:21 -08:00
stack c0bc1e944f HBASE-14819 hbase-it tests failing with OOME; permgen ADDENDUM 2015-11-19 17:06:15 -08:00
stack 447b0b3bfa HBASE-14819 hbase-it tests failing with OOME: permgen 2015-11-19 14:47:16 -08:00
Jonathan M Hsieh f782cab421 HBASE-14780 Integration Test that run with chaos monkey must specify cfs 2015-11-10 15:09:35 -08:00
Elliott Clark 17fd03ea8d HBASE-14781 Turn per cf flushing on for ITBLL by default 2015-11-07 11:50:09 -08:00
Elliott Clark 3578f643c7 HBASE-14723 Fix IT tests split too many times 2015-11-04 11:55:47 -08:00
Enis Soztutar c174a54d87 HBASE-14425 In Secure Zookeeper cluster superuser will not have sufficient permission if multiple values are configured in hbase.superuser (Pankaj Kumar)
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/zookeeper/ZooKeeperWatcher.java
2015-10-27 17:00:46 -07:00
Enis Soztutar 1128c855ad HBASE-14682 CM restore functionality for regionservers is broken 2015-10-26 16:47:21 -07:00
Andrew Purtell 6fbcd0a2e8 HBASE-13318 RpcServer.getListenerAddress should handle when the accept channel is closed 2015-10-26 15:11:08 -07:00
Enis Soztutar 6588ca5654 HBASE-14535 Integration test for rpc connection concurrency / deadlock testing 2015-10-23 11:02:33 -07:00
Elliott Clark d50b775178 HBASE-14658 Addendum; Allow loading a MonkeyFactory by class name 2015-10-22 12:10:15 -07:00
Elliott Clark a11d983bbc HBASE-14658 Allow loading a MonkeyFactory by class name 2015-10-22 08:54:26 -07:00
Elliott Clark 16af8df41f HBASE-14625 Chaos Monkey should shut down faster 2015-10-16 15:23:03 -07:00
tedyu 411683c22b HBASE-14592 BatchRestartRsAction always restarts 0 RS when running SlowDeterministicMonkey (Yu Li) 2015-10-12 14:51:18 -07:00
Elliott Clark 8019009563 HBASE-14211 Add more rigorous integration tests of splits
Summary:
Intgration tests don't currently have a lot of splits going on while there is IO.
This changes that by changing the split aglorithm and the max region hfile size. That should make things split more.

Additionally this allows ITBLL to start with just one region if hbase.test.pre-split-table is False.

Test Plan: Test on a cluster with ITBLL slow determinitic monkey and stress am monkey.

Differential Revision: https://reviews.facebook.net/D44181
2015-10-12 13:25:10 -07:00
Stephen Yuan Jiang 286edd8b55 HBASE-14212 Add IT test for procedure-v2-based namespace DDL (Stephen Yuan Jiang) 2015-09-25 16:41:55 -07:00
Stephen Yuan Jiang 36eeb7917a HBASE-14051 Undo workarounds in IntegrationTestDDLMasterFailover for client double submit (Stephen Yuan jiang) 2015-09-25 15:09:34 -07:00
Srikanth Srungarapu 1717de65a4 HBASE-14261 Enhance Chaos Monkey framework by adding zookeeper and datanode fault injections. 2015-09-03 11:49:40 -07:00
Sean Busbey f622297aa5 HBASE-14243 Correct NOTICE files.
* fix hbase-it's incorrect use of hbase-server's unfiltered NOTICE
* fix printed comment in resource-bundle NOTICE
* add dependency url for non-aggregated works so that we meet Category B requirements
2015-08-19 17:09:59 -05:00
Sean Busbey a45651c2cf HBASE-14085 Update LICENSE and NOTICE files.
* corrects license/notice for source distribution
* adds inception year to correct copyright in generated NOTICE files for jars
* updates project names in poms to use "Apache HBase" instead of "HBase" so jar NOTICE files will be correct
* uses append-resources to include supplemental info on jars with 3rd party works in source
* adds an hbase specific resource bundle for jars that include 3rd party works for binaries
** uses supplemental-model to fill in license gaps
** uses the above and a shade plugin transformation to build proper files for shaded jars.
** uses the above and the assembly plugin to build the proper files for bin assembly
* adds a NOTICE item for things copied out of Hadoop (TODO legal-discuss)

Conflicts:
	NOTICE.txt
	hbase-checkstyle/pom.xml
	hbase-resource-bundle/pom.xml
	hbase-server/pom.xml
	hbase-thrift/pom.xml
	pom.xml
2015-08-05 14:52:33 -07:00
Enis Soztutar 4a041fd837 HBASE-11276 Add back support for running ChaosMonkey as standalone tool (Yu Li) 2015-07-23 18:39:47 -07:00
Sean Busbey 93e26ce550 HBASE-14027 clean up multiple netty jars. 2015-07-15 02:38:15 -05:00
stack 4e84ac7924 HBASE-13561 ITBLL.Verify doesn't actually evaluate counters after job completes (Josh Elser) 2015-07-07 13:06:43 -07:00
tedyu 9e54e195f6 HBASE-13702 ImportTsv: Add dry-run functionality and log bad rows (Apekshit Sharma) 2015-07-04 07:25:00 -07:00
Dima Spivak 67b61005fe HBASE-14002 Add --noReplicationSetup option to IntegrationTestReplication
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-07-03 14:54:37 -07:00
stack 0f17b76796 HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis Soztutar) 2015-07-01 17:30:16 -07:00
Matteo Bertozzi 96f74e0b65 HBASE-13958 RESTApiClusterManager calls kill() instead of suspend() and resume() 2015-06-23 16:29:02 -07:00
Rajeshbabu Chintaguntla be5c1c7a21 HBASE-13940 IntegrationTestBulkLoad needs option to specify output folders used by test(Rajeshbabu) 2015-06-24 01:11:49 +05:30
Enis Soztutar 5bf7945b5b HBASE-13470 High level Integration test for master DDL operations (Sophia Feng) 2015-06-16 22:23:03 -07:00
Sean Busbey f2f19ddb5c HBASE-13909 update branch-1 poms to 1.3.0-SNAPSHOT 2015-06-15 22:30:56 -05:00
Enis Soztutar 10772d3af9 HBASE-13877 Interrupt to flush from TableFlushProcedure causes dataloss in ITBLL 2015-06-14 11:24:48 -07:00
Enis Soztutar 26458b41ce HBASE-13853 ITBLL improvements after HBASE-13811 2015-06-08 12:18:27 -07:00
Andrew Purtell a035baab46 HBASE-13768 ZooKeeper znodes are bootstrapped with insecure ACLs in a secure configuration (Enis Soztutar) 2015-05-27 12:32:45 -07:00
Nick Dimiduk 49fc6c817d HBASE-13711 Provide an API to set min and max versions in HColumnDescriptor (Stephen Yuan Jiang) 2015-05-20 11:41:23 -07:00
Matt Warhaftig 5a87c3910e HBASE-13358 - Update VisibilityClient to accept Connection objects.
Signed-off-by: Srikanth Srungarapu <ssrungarapu@cloudera.com>
2015-04-30 21:21:41 -07:00
Usha Kuchibhotla 0dbbc8b8de HBASE-11677 Making Logger instance modifiers consistent.
* IA.Public accessible logger instances deprecated
* logger instances modified by tests left in place
* all others made private static final

Signed-off-by: Sean Busbey <busbey@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClientIdGenerator.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerImpl.java
	hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestAsyncProcess.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestIngestWithEncryption.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/TestStatusResource.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestTableDescriptor.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestRowCounter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/hbck/TestOfflineMetaRebuildHole.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/hbck/TestOfflineMetaRebuildOverlap.java
2015-04-28 10:10:21 -05:00
stack 51177c48ae Revert "HBASE-13078 Removal of IntegrationTestSendTraceRequests (Josh Elser)"
Put this file back. Overzealous removal.

This reverts commit ddc4a4ab54.
2015-04-27 11:26:16 -07:00
stack ddc4a4ab54 HBASE-13078 Removal of IntegrationTestSendTraceRequests (Josh Elser) 2015-04-21 12:46:45 -07:00
Nick Dimiduk cf45c8d30a Bump pom version to 1.2.0-SNAPSHOT 2015-04-16 17:30:48 -07:00
Rajesh Nishtala 3530f0bf4b HBASE-13413 New integration test for oss => oss replication
Summary: This test subclasses the BigLinkedList test. It takes two hbase clusters as arguments, sets up tables, sets up replication, and runs the BigLinkedList generator. The verification portion of the loop checks that the sink of the replication has the data and it is correct.

Test Plan: ran the test on my laptop and a small live cluster

Reviewers: dimaspivak, eclark

Reviewed By: eclark

Subscribers: srikanth235, asameet

Differential Revision: https://reviews.facebook.net/D36423

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-04-07 12:38:12 -07:00
stack e65f430003 Revert "HBASE-13373 Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc.:"
Revert because breaking migration tests.

This reverts commit 95893ffebd.
2015-04-03 18:57:53 -07:00
stack e3d6cdd072 HBASE-13382 IntegrationTestBigLinkedList should use SecureRandom (Dima Spivak) 2015-04-03 15:32:50 -07:00
stack 95893ffebd HBASE-13373 Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc.:
Reapply after fixing missing JIRA number
2015-04-03 15:30:07 -07:00
stack da61928246 Revert "HBASE-Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc."
Revert because missing JIRA number

This reverts commit 691efc60f7.
2015-04-03 15:26:13 -07:00
stack 691efc60f7 HBASE-Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc. 2015-04-03 14:25:02 -07:00
zhangduo 7314645972 HBASE-13187 Add ITBLL that exercises per CF flush
Signed-off-by: stack <stack@apache.org>
2015-04-01 09:44:49 -07:00
Dima Spivak 04ac18917c HBASE-13223 Add testMoveMeta to IntegrationTestMTTR
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-03-16 19:14:46 -07:00
Josh Elser c3b47f2251 HBASE-13236 Add addt'l lifecycle-mapping executions.
Adds a number of lifecycle-mapping entries which
prevent errors from showing up in Eclipse on a fresh
import of HBase. For plugins defined in the top-level
pom, the mapping is added there; otherwise, the mapping
is pushed down to the child pom.

Signed-off-by: Sean Busbey <busbey@apache.org>
2015-03-14 00:19:44 -05:00
tedyu da9c5ac18c HBASE-13171 Change AccessControlClient methods to accept connection object to reduce setup time (Srikanth Srungarapu) 2015-03-11 21:41:24 -07:00
Enis Soztutar 9e7ad99593 HBASE-11580 Failover handling for secondary region replicas
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionAdminServiceCallable.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
2015-03-03 13:21:01 -08:00
Jonathan M Hsieh e31b9c3d58 HBASE-13141 IntegrationTestAcidGuarantees returns incorrect values for getColumnFamilies 2015-03-02 21:25:47 -08:00
Jonathan M Hsieh b3ebca633a HBASE-13132 Improve RemoveColumn action debug message 2015-03-02 10:31:19 -08:00
Enis Soztutar 5321d4465f HBASE-11842 Integration test for async wal replication to secondary regions
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/RestartMetaTest.java
2015-02-22 21:51:51 -08:00
Dima Spivak a6cd4229a3 HBASE-12869 Add a REST API implementation of the ClusterManager interface
Signed-off-by: stack <stack@apache.org>
2015-02-17 12:03:45 -08:00
Andrew Purtell 1d90fed564 HBASE-12747 IntegrationTestMTTR will OOME if launched with mvn verify (Abhishek Singh Chouhan) 2015-02-09 18:54:39 -08:00
stack e06be2060c HBASE-12782 ITBLL fails for me if generator does anything but 5M per maptask
Conflicts:
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestBigLinkedList.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
2015-01-30 19:21:17 -08:00
Devaraj Das c66fdf1e83 HBASE-11574. hbase:meta's regions can be replicated 2015-01-29 00:32:21 -08:00
Ramkrishna 7b4058a41a HBASE-12893 - IntegrationTestBigLinkedListWithVisibility should use
buffered writes (Jingcheng Du)
2015-01-29 12:41:30 +05:30
Nick Dimiduk 8556e2598e HBASE-12728 buffered writes substantially less useful after removal of HTablePool (Solomon Duskis and Nick Dimiduk)
In our pre-1.0 API, HTable is considered a light-weight object that consumed by
a single thread at a time. The HTablePool class provided a means of sharing
multiple HTable instances across a number of threads. As an optimization,
HTable managed a "write buffer", accumulating edits and sending a "batch" all
at once. By default the batch was sent as the last step in invocations of
put(Put) and put(List<Put>). The user could disable the automatic flushing of
the write buffer, retaining edits locally and only sending the whole "batch"
once the write buffer has filled or when the flushCommits() method in invoked
explicitly. Explicit or implicit batch writing was controlled by the
setAutoFlushTo(boolean) method. A value of true (the default) had the write
buffer flushed at the completion of a call to put(Put) or put(List<Put>). A
value of false allowed for explicit buffer management. HTable also exposed the
buffer to consumers via getWriteBuffer().

The combination of HTable with setAutoFlushTo(false) and the HTablePool
provided a convenient mechanism by which multiple "Put-producing" threads could
share a common write buffer. Both HTablePool and HTable are deprecated, and
they are officially replaced in The new 1.0 API by Table and BufferedMutator.
Table, which replaces HTable, no longer exposes explicit write-buffer
management. Instead, explicit buffer management is exposed via BufferedMutator.
BufferedMutator is made safe for concurrent use. Where code would previously
retrieve and return HTables from an HTablePool, now that code creates and
shares a single BufferedMutator instance across all threads.

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestAsyncProcess.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestBigLinkedList.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestBigLinkedListWithVisibility.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestLoadAndVerify.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/trace/IntegrationTestSendTraceRequests.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/PerformanceEvaluation.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteTable.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/MultiTableOutputFormat.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestMultiVersions.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestClientPushback.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestCloneSnapshotFromClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRestoreSnapshotFromClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRpcControllerFactory.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestFSErrorsExposed.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerMetrics.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestScannerWithBulkload.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRolling.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationChangingPeerRegionservers.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationWithTags.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/SnapshotTestingUtils.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestFlushSnapshotFromClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestRestoreFlushSnapshotFromClient.java
2015-01-23 09:07:55 -08:00
Nick Dimiduk 05f4e0c715 HBASE-12810 Update to htrace-incubating 2015-01-22 14:32:21 -08:00
Sean Busbey 0bec3a7bf4 HBASE-12898 ensure direct dependencies are declared. 2015-01-22 09:30:05 -06:00
Devaraj Das d0e4fb6ae3 HBASE-12548. Improve debuggability of IntegrationTestTimeBoundedRequestsWithRegionReplicas. 2015-01-16 11:49:49 -08:00
tedyu 2c4fe03e6a HBASE-12783 Create efficient RegionLocator implementation (Solomon) 2015-01-07 11:10:24 -08:00
tedyu 0311cc860c HBASE-12802 Remove unnecessary Table.flushCommits() (Solomon Duskis) 2015-01-05 15:55:10 -08:00
Enis Soztutar e7795007b0 HBASE-12799 ITAG fails with java.lang.RuntimeException if table does not exist 2015-01-05 11:18:58 -08:00
tedyu 173eba815b HBASE-12783 Revert - two tests in TestAssignmentManager fail 2015-01-03 06:57:46 -08:00
tedyu 633734a82d HBASE-12783 Create efficient RegionLocator implementation (Solomon Duskis) 2015-01-02 20:00:09 -08:00
Elliott Clark 7527227ab9 HBASE-12429 Add port to ClusterManager's actions. 2014-12-29 10:23:01 -08:00
Jonathan M Hsieh ac7ebdb179 HBASE-12735 Refactor TestAcidGuarantees so it can live as unit test and as an integration test 2014-12-23 17:32:39 -08:00
Jonathan M Hsieh 11d72ff2a4 HBASE-12718 Convert TestAcidGuarantees from a unit test to an integration test 2014-12-18 17:34:43 -08:00
Enis Soztutar d66ae28c07 Update pom.xml version for 1.1.0-SNAPSHOT for branch-1 2014-12-17 23:16:41 -08:00
Yi Deng 80c71e259c HBASE-12680 Move signal related code from ClusterManager to HBaseClusterManager and change ClusterManager to an interface
Summary: The reason of this change is to make us write implementation of ClusterManager not using ssh/unix signals.

Test Plan: The compilation is OK.

Reviewers: eclark, manukranthk

Differential Revision: https://reviews.facebook.net/D30201

Signed-off-by: Elliott Clark <eclark@apache.org>
2014-12-15 09:09:36 -08:00
stack f0afcd2cc2 HBASE-12689 Move version on from 0.99.2 to HBASE-1.0.0-SNAPSHOT 2014-12-14 20:37:59 -08:00
Yi Deng f0541fceed Fix the ASCII art
Signed-off-by: stack <stack@apache.org>
2014-12-11 17:22:55 -08:00
Nick Dimiduk 081ce3f8de HBASE-12163 Move test annotation classes to the same package as in master 2014-12-08 10:38:58 -08:00
Andrew Purtell 7b7b398056 HBASE-12606 Sanity check encryption configuration before opening WAL or onlining regions
Also disables IntegrationTestIngestWithEncryption if distributed
cluster configuration is missing prerequisites.
2014-12-06 22:04:26 -08:00
Enis Soztutar 5f150e49f9 Update pom.xml version for 0.99.2 2014-12-02 20:28:29 -08:00
stack 23382fe625 HBASE-12616 We lost the linked list commands in recent usage refactoring 2014-12-02 14:15:26 -08:00
stack 2b976c6bd1 HBASE-12490 Replace uses of setAutoFlush(boolean, boolean) (Solomon Duskis) 2014-12-02 09:34:04 -08:00
Sean Busbey 8959828fb5 HBASE-12522 Backport of write-ahead-log refactoring and follow-ons.
Issues incorporated and incompatible changes called out on the jira.

* Cleaned up references to HLog
* Deprecates HLogKey but maintains it for compatibility
  - Moves all Writeable from WALKey to HLogKey
* Adds utility code to CoprocessorHost to help with evolving Coprocessor APIs
* RSRpcServices roll WAL call now requests the non-meta LogRoller roll all logs
  - rolls actually happen asynchronously
  - deprecated old api (and noted incompatible behavior change)
  - modified api in new Admin interface to reflect lack of return values.
* Moved WAL user facing API to "WAL"
  - only 1 sync offered
  - WALTrailer removed from API
* make provider used by the WALFactory configurable.
* Move all WAL requests to use opaque ids instead of paths
* WALProvider provides API details for implementers and handles creation of WALs.
* Refactor WALActionsListener to have a basic implementation.
* turn MetricsWAL into a WALActionsListener.
* tests that needs FSHLog implementation details use them directly, others just reference provider + factory
  - Some tests moved from Large to Medium based on run time.
* pull out wal disabling into its own no-op class
* update region open to delegate to WALFactory
* update performance test tool to allow for multiple regions
* Removed references to meta-specific wals within wal code
  - replaced with generic suffixes
  - WALFactory maintains a dedicated WALProvider for meta (and so knows about the distinction)
* maintain backwards compat on HLogPrettyPrinter and mark it deprecated.
  - made WALPrettyPrinter IA.Private in favor of `bin/hbase wal`
* move WALUtil stuff that's implementation specific to said implementation
  - WALUtil now acts as an integration point between the RegionServer and hte WAL code.

Incorporates contributions from v.himanshu and stack.

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/WALPlayer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/migration/NamespaceUpgrade.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/protobuf/ReplicationProtbufUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/LogRoller.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RSRpcServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/RegionServerServices.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/FSHLog.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/HMerge.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/util/MetaUtils.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestIOFencing.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestAdmin2.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/coprocessor/TestRegionObserverScannerOpenHook.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestFilter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/filter/TestInvocationRecordFilter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/fs/TestBlockReorder.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestHLogRecordReader.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestImportExport.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestAtomicOperation.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionMergeTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestSplitTransaction.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestHLog.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollAbort.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRollingNoCluster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMultiSlaveReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationSource.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationWALEntryFilters.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestRegionReplicaReplicationEndpointNoMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationSourceManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/regionserver/TestReplicationWALReaderManager.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestFSVisitor.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/TestMergeTool.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestSecureWAL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALFiltering.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALMethods.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALReaderOnSecureWAL.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplit.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/wal/TestWALSplitCompressed.java
	src/main/docbkx/ops_mgt.xml
2014-12-02 11:05:02 -06:00
stack 53d775f242 HBASE-12514 Cleanup HFileOutputFormat legacy code (Solomon Duskis)
Signed-off-by: stack <stack@apache.org>
2014-12-01 10:16:35 -08:00
stack b12d57783f HBASE-12519 Remove tabs used as whitespace (Varun Saxena) 2014-11-29 09:24:08 -08:00
stack f3c5f11718 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) under src/main/java
Move from HConnection to ClusterConnection or Connection
Use unmanaged connections where we use managed previous
(used the jdk7 https://docs.oracle.com/javase/7/docs/technotes/guides/language/try-with-resources.html idiom).

In ZKConfig, synchronize on Configuration rather than make a copy.
Making a copy we were dropping hbase configs in certain test context
(could not find the zk ensemble because default port).

In tests, some move to the new style connection setup but mostly
fixes for premature connection close or adding cleanup where it
was lacking.

Conflicts:
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestMultiSlaveReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationEndpoint.java
2014-11-24 10:12:27 -08:00
stack 3a3a4b7b6b Revert "HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)"
This reverts commit 4f5cde8a69.
2014-11-18 16:32:18 -08:00
stack 4f5cde8a69 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/wal/HLogSplitter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestLoadIncrementalHFilesSplitRecovery.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestDistributedLogSplitting.java
2014-11-18 10:19:55 -08:00
Nick Dimiduk 390d4acf0d HBASE-12472 Improve debuggability of IntegrationTestBulkLoad 2014-11-17 09:34:54 +01:00
Andrew Purtell 0145650cb0 HBASE-12450 Unbalance chaos monkey might kill all region servers without starting them back (Virag Kothari) 2014-11-07 17:25:10 -08:00
stack c99d89fd63 HBASE-12427 Change branch-1 version from 0.99.2-SNAPSHOT to 0.99.3-SNAPSHOT --REVERT 2014-11-05 19:15:24 -08:00