Commit Graph

272 Commits

Author SHA1 Message Date
Srikanth Srungarapu 1717de65a4 HBASE-14261 Enhance Chaos Monkey framework by adding zookeeper and datanode fault injections. 2015-09-03 11:49:40 -07:00
Sean Busbey f622297aa5 HBASE-14243 Correct NOTICE files.
* fix hbase-it's incorrect use of hbase-server's unfiltered NOTICE
* fix printed comment in resource-bundle NOTICE
* add dependency url for non-aggregated works so that we meet Category B requirements
2015-08-19 17:09:59 -05:00
Sean Busbey a45651c2cf HBASE-14085 Update LICENSE and NOTICE files.
* corrects license/notice for source distribution
* adds inception year to correct copyright in generated NOTICE files for jars
* updates project names in poms to use "Apache HBase" instead of "HBase" so jar NOTICE files will be correct
* uses append-resources to include supplemental info on jars with 3rd party works in source
* adds an hbase specific resource bundle for jars that include 3rd party works for binaries
** uses supplemental-model to fill in license gaps
** uses the above and a shade plugin transformation to build proper files for shaded jars.
** uses the above and the assembly plugin to build the proper files for bin assembly
* adds a NOTICE item for things copied out of Hadoop (TODO legal-discuss)

Conflicts:
	NOTICE.txt
	hbase-checkstyle/pom.xml
	hbase-resource-bundle/pom.xml
	hbase-server/pom.xml
	hbase-thrift/pom.xml
	pom.xml
2015-08-05 14:52:33 -07:00
Enis Soztutar 4a041fd837 HBASE-11276 Add back support for running ChaosMonkey as standalone tool (Yu Li) 2015-07-23 18:39:47 -07:00
Sean Busbey 93e26ce550 HBASE-14027 clean up multiple netty jars. 2015-07-15 02:38:15 -05:00
stack 4e84ac7924 HBASE-13561 ITBLL.Verify doesn't actually evaluate counters after job completes (Josh Elser) 2015-07-07 13:06:43 -07:00
tedyu 9e54e195f6 HBASE-13702 ImportTsv: Add dry-run functionality and log bad rows (Apekshit Sharma) 2015-07-04 07:25:00 -07:00
Dima Spivak 67b61005fe HBASE-14002 Add --noReplicationSetup option to IntegrationTestReplication
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-07-03 14:54:37 -07:00
stack 0f17b76796 HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis Soztutar) 2015-07-01 17:30:16 -07:00
Matteo Bertozzi 96f74e0b65 HBASE-13958 RESTApiClusterManager calls kill() instead of suspend() and resume() 2015-06-23 16:29:02 -07:00
Rajeshbabu Chintaguntla be5c1c7a21 HBASE-13940 IntegrationTestBulkLoad needs option to specify output folders used by test(Rajeshbabu) 2015-06-24 01:11:49 +05:30
Enis Soztutar 5bf7945b5b HBASE-13470 High level Integration test for master DDL operations (Sophia Feng) 2015-06-16 22:23:03 -07:00
Sean Busbey f2f19ddb5c HBASE-13909 update branch-1 poms to 1.3.0-SNAPSHOT 2015-06-15 22:30:56 -05:00
Enis Soztutar 10772d3af9 HBASE-13877 Interrupt to flush from TableFlushProcedure causes dataloss in ITBLL 2015-06-14 11:24:48 -07:00
Enis Soztutar 26458b41ce HBASE-13853 ITBLL improvements after HBASE-13811 2015-06-08 12:18:27 -07:00
Andrew Purtell a035baab46 HBASE-13768 ZooKeeper znodes are bootstrapped with insecure ACLs in a secure configuration (Enis Soztutar) 2015-05-27 12:32:45 -07:00
Nick Dimiduk 49fc6c817d HBASE-13711 Provide an API to set min and max versions in HColumnDescriptor (Stephen Yuan Jiang) 2015-05-20 11:41:23 -07:00
Matt Warhaftig 5a87c3910e HBASE-13358 - Update VisibilityClient to accept Connection objects.
Signed-off-by: Srikanth Srungarapu <ssrungarapu@cloudera.com>
2015-04-30 21:21:41 -07:00
Usha Kuchibhotla 0dbbc8b8de HBASE-11677 Making Logger instance modifiers consistent.
* IA.Public accessible logger instances deprecated
* logger instances modified by tests left in place
* all others made private static final

Signed-off-by: Sean Busbey <busbey@apache.org>

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClientIdGenerator.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ConnectionImplementation.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RpcRetryingCallerImpl.java
	hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestAsyncProcess.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestIngestWithEncryption.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/TestStatusResource.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestTableDescriptor.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/mapreduce/TestRowCounter.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/hbck/TestOfflineMetaRebuildHole.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/hbck/TestOfflineMetaRebuildOverlap.java
2015-04-28 10:10:21 -05:00
stack 51177c48ae Revert "HBASE-13078 Removal of IntegrationTestSendTraceRequests (Josh Elser)"
Put this file back. Overzealous removal.

This reverts commit ddc4a4ab54.
2015-04-27 11:26:16 -07:00
stack ddc4a4ab54 HBASE-13078 Removal of IntegrationTestSendTraceRequests (Josh Elser) 2015-04-21 12:46:45 -07:00
Nick Dimiduk cf45c8d30a Bump pom version to 1.2.0-SNAPSHOT 2015-04-16 17:30:48 -07:00
Rajesh Nishtala 3530f0bf4b HBASE-13413 New integration test for oss => oss replication
Summary: This test subclasses the BigLinkedList test. It takes two hbase clusters as arguments, sets up tables, sets up replication, and runs the BigLinkedList generator. The verification portion of the loop checks that the sink of the replication has the data and it is correct.

Test Plan: ran the test on my laptop and a small live cluster

Reviewers: dimaspivak, eclark

Reviewed By: eclark

Subscribers: srikanth235, asameet

Differential Revision: https://reviews.facebook.net/D36423

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-04-07 12:38:12 -07:00
stack e65f430003 Revert "HBASE-13373 Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc.:"
Revert because breaking migration tests.

This reverts commit 95893ffebd.
2015-04-03 18:57:53 -07:00
stack e3d6cdd072 HBASE-13382 IntegrationTestBigLinkedList should use SecureRandom (Dima Spivak) 2015-04-03 15:32:50 -07:00
stack 95893ffebd HBASE-13373 Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc.:
Reapply after fixing missing JIRA number
2015-04-03 15:30:07 -07:00
stack da61928246 Revert "HBASE-Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc."
Revert because missing JIRA number

This reverts commit 691efc60f7.
2015-04-03 15:26:13 -07:00
stack 691efc60f7 HBASE-Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc. 2015-04-03 14:25:02 -07:00
zhangduo 7314645972 HBASE-13187 Add ITBLL that exercises per CF flush
Signed-off-by: stack <stack@apache.org>
2015-04-01 09:44:49 -07:00
Dima Spivak 04ac18917c HBASE-13223 Add testMoveMeta to IntegrationTestMTTR
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-03-16 19:14:46 -07:00
Josh Elser c3b47f2251 HBASE-13236 Add addt'l lifecycle-mapping executions.
Adds a number of lifecycle-mapping entries which
prevent errors from showing up in Eclipse on a fresh
import of HBase. For plugins defined in the top-level
pom, the mapping is added there; otherwise, the mapping
is pushed down to the child pom.

Signed-off-by: Sean Busbey <busbey@apache.org>
2015-03-14 00:19:44 -05:00
tedyu da9c5ac18c HBASE-13171 Change AccessControlClient methods to accept connection object to reduce setup time (Srikanth Srungarapu) 2015-03-11 21:41:24 -07:00
Enis Soztutar 9e7ad99593 HBASE-11580 Failover handling for secondary region replicas
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/RegionAdminServiceCallable.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegion.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
2015-03-03 13:21:01 -08:00
Jonathan M Hsieh e31b9c3d58 HBASE-13141 IntegrationTestAcidGuarantees returns incorrect values for getColumnFamilies 2015-03-02 21:25:47 -08:00
Jonathan M Hsieh b3ebca633a HBASE-13132 Improve RemoveColumn action debug message 2015-03-02 10:31:19 -08:00
Enis Soztutar 5321d4465f HBASE-11842 Integration test for async wal replication to secondary regions
Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/RegionReplicaReplicationEndpoint.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/RestartMetaTest.java
2015-02-22 21:51:51 -08:00
Dima Spivak a6cd4229a3 HBASE-12869 Add a REST API implementation of the ClusterManager interface
Signed-off-by: stack <stack@apache.org>
2015-02-17 12:03:45 -08:00
Andrew Purtell 1d90fed564 HBASE-12747 IntegrationTestMTTR will OOME if launched with mvn verify (Abhishek Singh Chouhan) 2015-02-09 18:54:39 -08:00
stack e06be2060c HBASE-12782 ITBLL fails for me if generator does anything but 5M per maptask
Conflicts:
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestBigLinkedList.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/wal/WALSplitter.java
2015-01-30 19:21:17 -08:00
Devaraj Das c66fdf1e83 HBASE-11574. hbase:meta's regions can be replicated 2015-01-29 00:32:21 -08:00
Ramkrishna 7b4058a41a HBASE-12893 - IntegrationTestBigLinkedListWithVisibility should use
buffered writes (Jingcheng Du)
2015-01-29 12:41:30 +05:30
Nick Dimiduk 8556e2598e HBASE-12728 buffered writes substantially less useful after removal of HTablePool (Solomon Duskis and Nick Dimiduk)
In our pre-1.0 API, HTable is considered a light-weight object that consumed by
a single thread at a time. The HTablePool class provided a means of sharing
multiple HTable instances across a number of threads. As an optimization,
HTable managed a "write buffer", accumulating edits and sending a "batch" all
at once. By default the batch was sent as the last step in invocations of
put(Put) and put(List<Put>). The user could disable the automatic flushing of
the write buffer, retaining edits locally and only sending the whole "batch"
once the write buffer has filled or when the flushCommits() method in invoked
explicitly. Explicit or implicit batch writing was controlled by the
setAutoFlushTo(boolean) method. A value of true (the default) had the write
buffer flushed at the completion of a call to put(Put) or put(List<Put>). A
value of false allowed for explicit buffer management. HTable also exposed the
buffer to consumers via getWriteBuffer().

The combination of HTable with setAutoFlushTo(false) and the HTablePool
provided a convenient mechanism by which multiple "Put-producing" threads could
share a common write buffer. Both HTablePool and HTable are deprecated, and
they are officially replaced in The new 1.0 API by Table and BufferedMutator.
Table, which replaces HTable, no longer exposes explicit write-buffer
management. Instead, explicit buffer management is exposed via BufferedMutator.
BufferedMutator is made safe for concurrent use. Where code would previously
retrieve and return HTables from an HTablePool, now that code creates and
shares a single BufferedMutator instance across all threads.

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
	hbase-client/src/test/java/org/apache/hadoop/hbase/client/TestAsyncProcess.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestBigLinkedList.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestBigLinkedListWithVisibility.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/test/IntegrationTestLoadAndVerify.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/trace/IntegrationTestSendTraceRequests.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/PerformanceEvaluation.java
	hbase-rest/src/test/java/org/apache/hadoop/hbase/rest/client/TestRemoteTable.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/mapreduce/MultiTableOutputFormat.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/PerformanceEvaluation.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/TestMultiVersions.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestClientPushback.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestCloneSnapshotFromClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestMultiParallel.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRestoreSnapshotFromClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/client/TestRpcControllerFactory.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/master/TestMaster.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestFSErrorsExposed.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestRegionServerMetrics.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/TestScannerWithBulkload.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/wal/TestLogRolling.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationChangingPeerRegionservers.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/replication/TestReplicationWithTags.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/security/visibility/TestVisibilityLabelsReplication.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/SnapshotTestingUtils.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestFlushSnapshotFromClient.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/snapshot/TestRestoreFlushSnapshotFromClient.java
2015-01-23 09:07:55 -08:00
Nick Dimiduk 05f4e0c715 HBASE-12810 Update to htrace-incubating 2015-01-22 14:32:21 -08:00
Sean Busbey 0bec3a7bf4 HBASE-12898 ensure direct dependencies are declared. 2015-01-22 09:30:05 -06:00
Devaraj Das d0e4fb6ae3 HBASE-12548. Improve debuggability of IntegrationTestTimeBoundedRequestsWithRegionReplicas. 2015-01-16 11:49:49 -08:00
tedyu 2c4fe03e6a HBASE-12783 Create efficient RegionLocator implementation (Solomon) 2015-01-07 11:10:24 -08:00
tedyu 0311cc860c HBASE-12802 Remove unnecessary Table.flushCommits() (Solomon Duskis) 2015-01-05 15:55:10 -08:00
Enis Soztutar e7795007b0 HBASE-12799 ITAG fails with java.lang.RuntimeException if table does not exist 2015-01-05 11:18:58 -08:00
tedyu 173eba815b HBASE-12783 Revert - two tests in TestAssignmentManager fail 2015-01-03 06:57:46 -08:00
tedyu 633734a82d HBASE-12783 Create efficient RegionLocator implementation (Solomon Duskis) 2015-01-02 20:00:09 -08:00