e48991970d
HBASE-14261 Enhance Chaos Monkey framework by adding zookeeper and datanode fault injections.
2015-09-03 11:55:36 -07:00
ebd34844ce
HBASE-14243 Correct NOTICE files.
...
* fix hbase-it's incorrect use of hbase-server's unfiltered NOTICE
* fix printed comment in resource-bundle NOTICE
* add dependency url for non-aggregated works so that we meet Category B requirements
2015-08-19 15:45:58 -05:00
1b0b67fb7c
HBASE-14085 Update LICENSE and NOTICE files.
...
* corrects license/notice for source distribution
* adds inception year to correct copyright in generated NOTICE files for jars
* updates project names in poms to use "Apache HBase" instead of "HBase" so jar NOTICE files will be correct
* uses append-resources to include supplemental info on jars with 3rd party works in source
* adds an hbase specific resource bundle for jars that include 3rd party works for binaries
** uses supplemental-model to fill in license gaps
** uses the above and a shade plugin transformation to build proper files for shaded jars.
** uses the above and the assembly plugin to build the proper files for bin assembly
* adds a NOTICE item for things copied out of Hadoop (TODO legal-discuss)
2015-08-04 17:16:56 -05:00
dad4cad30e
HBASE-11276 Add back support for running ChaosMonkey as standalone tool (Yu Li)
2015-07-23 18:39:01 -07:00
493f36c899
HBASE-11339 Merge remote-tracking branch 'apache/hbase-11339' (Jingcheng Du)
2015-07-22 12:51:11 -07:00
25f7e804cd
HBASE-14027 clean up multiple netty jars.
2015-07-15 02:33:28 -05:00
a3d30892b4
HBASE-14047 - Cleanup deprecated APIs from Cell class (Ashish Singhi)
2015-07-13 22:06:16 +05:30
f5ad736282
HBASE-13561 ITBLL.Verify doesn't actually evaluate counters after job completes (Josh Elser)
2015-07-07 13:06:10 -07:00
e640f1e76a
HBASE-14002 Add --noReplicationSetup option to IntegrationTestReplication
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-07-03 14:54:10 -07:00
272b025b25
HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis Soztutar) -- NEW ADDENDUM TO FIX ITBLL on master
2015-07-02 00:40:09 -07:00
20e855f282
HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis Soztutar) -- REAPPLY
2015-07-01 23:16:30 -07:00
f0e29c49a1
Revert "HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis"
...
This reverts commit fca725a899
2015-07-01 20:20:08 -07:00
fca725a899
HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis
...
Soztutar)
2015-07-01 20:07:26 -07:00
b5b5853043
HBASE-13893 Replace HTable with Table in client tests (Jurriaan Mous)
2015-06-25 14:42:33 -07:00
e6ed792199
HBASE-13702 ImportTsv: Add dry-run functionality and log bad rows (Apekshit Sharma)
2015-06-25 13:15:07 -07:00
1927f04077
HBASE-13958 RESTApiClusterManager calls kill() instead of suspend() and resume()
2015-06-23 16:28:32 -07:00
168c1b1b73
HBASE-13940 IntegrationTestBulkLoad needs option to specify output folders used by test(Rajeshbabu)
2015-06-24 01:06:55 +05:30
1b5ad45b85
HBASE-13470 High level Integration test for master DDL operations (Sophia Feng)
2015-06-16 22:22:35 -07:00
c6dd3f965b
HBASE-13877 Interrupt to flush from TableFlushProcedure causes dataloss in ITBLL
2015-06-14 11:22:07 -07:00
fe5712f9b4
HBASE-13853 ITBLL improvements after HBASE-13811
2015-06-08 12:17:50 -07:00
a016b23e85
HBASE-13728 Remove direct use of Hadoop's GenericOptionParser.
...
* In most cases, just shift to proper use of ToolRunner
* Fix timing issue in TestImportExport
** add some diagnostic logs to Import and TestImportExport
** when testing for WAL use under different durability requests, ignore meta edits.
* In the case of TestImportTsv make a local anonymous class so we can get at internals.
2015-05-29 12:38:52 -05:00
b31a6acf4c
HBASE-13763 Handle the rename, annotation and typo stuff in MOB. (Jingcheng)
2015-05-28 13:43:12 +05:30
942e09b71e
HBASE-13768 ZooKeeper znodes are bootstrapped with insecure ACLs in a secure configuration (Enis Soztutar)
2015-05-27 12:23:14 -07:00
77d9719e2b
HBASE-13711 Provide an API to set min and max versions in HColumnDescriptor (Stephen Yuan Jiang)
2015-05-20 11:40:25 -07:00
09a00efc0b
Merge remote-tracking branch 'apache/master' (5/19/15) into hbase-11339
...
Patches that caused deltas:
HBASE-10810 - around HColumnDescriptor 'should' vs 'is' api.
HBASE-11677 - LOG was made private
HBASE-11927 - Checksum constant changed
HBASE-10800 - CellComparator instead of KVComparator
Conflicts:
hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/DefaultStoreEngine.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/DefaultCompactor.java
hbase-server/src/test/java/org/apache/hadoop/hbase/util/LoadTestTool.java
2015-05-19 16:30:21 -07:00
ec51d7b2e6
HBASE-1989 Admin (et al.) not accurate with Column vs. Column-Family
...
usage
Fix check style issues & rename parameter
Incorporate comments
Signed-off-by: stack <stack@apache.org>
2015-05-11 09:46:28 -07:00
b03ff8ccca
Revert "Rename & deprecate everything in Admin"
...
Revert because does not cite associated JIRA in commit message (my
fault)
This reverts commit 2ad4114149
2015-05-11 09:45:33 -07:00
2ad4114149
Rename & deprecate everything in Admin
...
Fix check style issues & rename parameter
Incorporate comments
Signed-off-by: stack <stack@apache.org>
2015-05-10 20:47:12 -07:00
977f867439
HBASE-10800 - Use CellComparator instead of KVComparator (Ram)
2015-05-05 11:38:10 +05:30
0e20bbf6a3
Merge branch 'apache/master' (4/16/15) into hbase-11339
...
API conflicts and test fixes
Update LoadTestTool.COLUMN_FAMILY -> DEFAULT_COLUMN_FAMILY due HBASE-11842
Use new 1.0+ api in some tests
Use updated Scanners internal api
Fix to take into account HBASE-13203 - procedure v2 table delete
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java
2015-05-01 08:18:51 -07:00
d50d6d967d
HBASE-13358 - Update VisibilityClient to accept Connection objects.
...
Signed-off-by: Srikanth Srungarapu <ssrungarapu@cloudera.com>
2015-04-30 21:28:01 -07:00
94a00bea07
HBASE-11677 Making Logger instance modifiers consistent.
...
* IA.Public accessible logger instances deprecated
* logger instances modified by tests left in place
* all others made private static final
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-04-28 09:20:34 -05:00
79db629323
Revert "HBASE-13078 Removal of IntegrationTestSendTraceRequests (Josh Elser)"
...
Put this file back; over-zealous removal.
This reverts commit 91ab1086d6
2015-04-27 11:23:52 -07:00
d5ff2b587c
HBASE-13322 Replace explicit HBaseAdmin creation with connection#getAdmin()
2015-04-27 16:28:53 +01:00
91ab1086d6
HBASE-13078 Removal of IntegrationTestSendTraceRequests (Josh Elser)
2015-04-21 12:45:25 -07:00
d5e81523f7
HBASE-13413 New integration test for oss => oss replication
...
Summary: This test subclasses the BigLinkedList test. It takes two hbase clusters as arguments, sets up tables, sets up replication, and runs the BigLinkedList generator. The verification portion of the loop checks that the sink of the replication has the data and it is correct.
Test Plan: ran the test on my laptop and a small live cluster
Reviewers: dimaspivak, eclark
Reviewed By: eclark
Subscribers: srikanth235, asameet
Differential Revision: https://reviews.facebook.net/D36423
Signed-off-by: Elliott Clark <eclark@apache.org>
2015-04-07 12:37:05 -07:00
f561ef71a5
HBASE-13382 IntegrationTestBigLinkedList should use SecureRandom (Dima Spivak)
2015-04-03 15:33:55 -07:00
3a2a29616c
HBASE-13373 Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc.
...
Reapply after adding in the missing JIRA number
2015-04-03 15:25:19 -07:00
319666ca53
Revert "HBASE-Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc."
...
This reverts commit 5b25a48e7f
2015-04-03 15:16:38 -07:00
5b25a48e7f
HBASE-Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc.
2015-04-03 14:14:00 -07:00
f1b53d71b8
HBASE-13187 Add ITBLL that exercises per CF flush
...
Signed-off-by: stack <stack@apache.org>
2015-04-01 09:44:24 -07:00
55a5a3be33
HBASE-13364 Make error prone off by default
2015-03-30 16:03:53 -07:00
f57dca5e1b
HBASE-13198 Remove HConnectionManager (Mikhail Antonov)
2015-03-20 09:41:48 -07:00
bf9e32d59d
HBASE-13223 Add testMoveMeta to IntegrationTestMTTR
...
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-03-16 18:22:51 -07:00
72855c584e
HBASE-13236 Add addt'l lifecycle-mapping executions.
...
Adds a number of lifecycle-mapping entries which
prevent errors from showing up in Eclipse on a fresh
import of HBase. For plugins defined in the top-level
pom, the mapping is added there; otherwise, the mapping
is pushed down to the child pom.
Signed-off-by: Sean Busbey <busbey@apache.org>
2015-03-13 22:35:52 -05:00
7a3ea23704
HBASE-13171 Change AccessControlClient methods to accept connection object to reduce setup time (Srikanth Srungarapu)
2015-03-11 18:24:12 -07:00
0d6cac9b1e
HBASE-13157 Add Mob compaction actions and monkeys to Chaos Monkey
2015-03-05 11:31:36 -08:00
2124d3df70
HBASE-13154 add support for mob in TestAcidGuarantees and IntegrationTestAcidGuarantees
2015-03-05 00:09:05 -08:00
39425a8558
HBASE-11670 Generate PDF of Reference Guide
2015-03-05 09:31:11 +10:00
9899aab12b
HBASE-11580 Failover handling for secondary region replicas
2015-03-03 11:48:12 -08:00
d66f88134c
HBASE-13132 Improve RemoveColumn action debug message
2015-03-03 04:41:36 -08:00
cf4f4fcbb3
HBASE-13141 IntegrationTestAcidGuarantees returns incorrect values for getColumnFamilies
2015-03-03 04:41:27 -08:00
daed00fc98
HBASE-13141 IntegrationTestAcidGuarantees returns incorrect values for getColumnFamilies
2015-03-02 21:26:01 -08:00
d2e64032c6
HBASE-13132 Improve RemoveColumn action debug message
2015-03-02 10:31:24 -08:00
21b366afe1
HBASE-11842 Integration test for async wal replication to secondary regions
2015-02-22 21:29:12 -08:00
fe335b683c
Merge branch 'master' (2/11/15) into hbase-11339
...
Conflicts:
hbase-client/src/main/java/org/apache/hadoop/hbase/HColumnDescriptor.java
hbase-client/src/test/java/org/apache/hadoop/hbase/TestHColumnDescriptor.java
hbase-common/src/main/java/org/apache/hadoop/hbase/TagType.java
hbase-common/src/main/resources/hbase-default.xml
hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.java
hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSourceImpl.java
hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestAcidGuarantees.java
hbase-server/src/main/java/org/apache/hadoop/hbase/io/HFileLink.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java
hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/DisabledTableSnapshotHandler.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/DefaultStoreEngine.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/DefaultCompactor.java
hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/StripeCompactor.java
hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/ExportSnapshot.java
hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/RestoreSnapshotHelper.java
hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/SnapshotReferenceUtil.java
hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperStub.java
pom.xml
src/main/docbkx/book.xml
src/main/docbkx/ops_mgt.xml
src/main/docbkx/schema_design.xml
2015-02-22 12:54:45 -08:00
ca25a6a870
HBASE-12869 Add a REST API implementation of the ClusterManager interface
...
Signed-off-by: stack <stack@apache.org>
2015-02-17 12:03:09 -08:00
200ec5b191
HBASE-12747 IntegrationTestMTTR will OOME if launched with mvn verify (Abhishek Singh Chouhan)
2015-02-09 18:54:43 -08:00
825871431e
HBASE-12782 ITBLL fails for me if generator does anything but 5M per maptask
2015-01-30 19:12:17 -08:00
6b20a0f831
HBASE-11574. hbase:meta's regions can be replicated
2015-01-27 16:40:29 -08:00
cfb0cf72d4
HBASE-12893 - IntegrationTestBigLinkedListWithVisibility should use
...
buffered writes (Jingcheng Du)
2015-01-27 10:25:23 +05:30
ab18158e60
HBASE-12728 buffered writes substantially less useful after removal of HTablePool (Solomon Duskis and Nick Dimiduk)
...
In our pre-1.0 API, HTable is considered a light-weight object that consumed by
a single thread at a time. The HTablePool class provided a means of sharing
multiple HTable instances across a number of threads. As an optimization,
HTable managed a "write buffer", accumulating edits and sending a "batch" all
at once. By default the batch was sent as the last step in invocations of
put(Put) and put(List<Put>). The user could disable the automatic flushing of
the write buffer, retaining edits locally and only sending the whole "batch"
once the write buffer has filled or when the flushCommits() method in invoked
explicitly. Explicit or implicit batch writing was controlled by the
setAutoFlushTo(boolean) method. A value of true (the default) had the write
buffer flushed at the completion of a call to put(Put) or put(List<Put>). A
value of false allowed for explicit buffer management. HTable also exposed the
buffer to consumers via getWriteBuffer().
The combination of HTable with setAutoFlushTo(false) and the HTablePool
provided a convenient mechanism by which multiple "Put-producing" threads could
share a common write buffer. Both HTablePool and HTable are deprecated, and
they are officially replaced in The new 1.0 API by Table and BufferedMutator.
Table, which replaces HTable, no longer exposes explicit write-buffer
management. Instead, explicit buffer management is exposed via BufferedMutator.
BufferedMutator is made safe for concurrent use. Where code would previously
retrieve and return HTables from an HTablePool, now that code creates and
shares a single BufferedMutator instance across all threads.
2015-01-23 08:48:31 -08:00
9824eb7840
HBASE-12810 Update to htrace-incubating
2015-01-22 14:28:20 -08:00
418ea93774
HBASE-12898 ensure direct dependencies are declared.
2015-01-22 14:33:25 -06:00
1a21c1684c
HBASE-11533 Asciidoc Proof of Concept
2015-01-13 22:32:29 -08:00
9246af8dac
HBASE-12796 Clean up HTable and HBaseAdmin deprecated constructor usage (Jurriaan Mous)
2015-01-08 07:49:28 -08:00
2452d3861f
HBASE-12802 Remove unnecessary Table.flushCommits() (Solomon Duskis)
2015-01-05 15:45:52 -08:00
24bcebdeeb
HBASE-12799 ITAG fails with java.lang.RuntimeException if table does not exist
2015-01-05 11:14:40 -08:00
ac95cc1fbb
HBASE-12783 Create efficient RegionLocator implementation (Solomon Duskis)
2015-01-02 19:48:06 -08:00
b2eea8cac6
HBASE-12695 JDK 1.8 compilation broken
...
Signed-off-by: stack <stack@apache.org>
2014-12-29 11:02:04 -08:00
e5ca773f78
HBASE-12429 Add port to ClusterManager's actions.
2014-12-29 10:22:52 -08:00
9a829dc458
HBASE-12735 Refactor TestAcidGuarantees so it can live as unit test and as an integration test
2014-12-23 17:18:58 -08:00
4a6f1d9d6b
HBASE-12718 Convert TestAcidGuarantees from a unit test to an integration test
2014-12-18 17:45:08 -08:00
33c27f4e03
HBASE-12718 Convert TestAcidGuarantees from a unit test to an integration test
2014-12-18 17:21:23 -08:00
555d14ed45
HBASE-12680 Move signal related code from ClusterManager to HBaseClusterManager and change ClusterManager to an interface
...
Summary: The reason of this change is to make us write implementation of ClusterManager not using ssh/unix signals.
Test Plan: The compilation is OK.
Reviewers: eclark, manukranthk
Differential Revision: https://reviews.facebook.net/D30201
Signed-off-by: Elliott Clark <eclark@apache.org>
2014-12-15 09:09:43 -08:00
fe12ad5066
Fix the ASCII art
...
Signed-off-by: stack <stack@apache.org>
2014-12-11 17:22:29 -08:00
bb15fd5fe0
HBASE-12606 Sanity check encryption configuration before opening WAL or onlining regions
...
Also disables IntegrationTestIngestWithEncryption if distributed
cluster configuration is missing prerequisites.
2014-12-06 21:46:43 -08:00
ca0c1774c9
HBASE-12548. Improve debuggability of IntegrationTestTimeBoundedRequestsWithRegionReplicas
2014-12-06 18:18:03 -08:00
54f438cee4
HBASE-12616 We lost the linked list commands in recent usage refactoring
2014-12-02 14:15:04 -08:00
7a3396f0e1
HBASE-12490 Replace uses of setAutoFlush(boolean, boolean) (Solomon Duskis)
2014-12-02 10:06:21 -08:00
1a9b556474
Revert "HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG"
...
This reverts commit 8b8f2026bd
2014-12-02 09:51:19 -08:00
69a437ac0d
HBASE-12514 Cleanup HFileOutputFormat legacy code (Solomon Duskis)
...
Signed-off-by: stack <stack@apache.org>
2014-12-01 10:15:51 -08:00
58b6b24c29
HBASE-12519 Remove tabs used as whitespace (Varun Saxena)
2014-11-28 20:50:02 -08:00
8b8f2026bd
HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG
2014-11-25 21:21:50 -08:00
336c22d581
HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) under src/main/java
...
Move from HConnection to ClusterConnection or Connection
Use unmanaged connections where we use managed previous
(used the jdk7 https://docs.oracle.com/javase/7/docs/technotes/guides/language/try-with-resources.html idiom).
In ZKConfig, synchronize on Configuration rather than make a copy.
Making a copy we were dropping hbase configs in certain test context
(could not find the zk ensemble because default port).
In tests, some move to the new style connection setup but mostly
fixes for premature connection close or adding cleanup where it
was lacking.
2014-11-24 09:46:28 -08:00
5f391efda1
Revert "HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)"
...
This reverts commit d3e7c3cfa9
2014-11-18 16:30:52 -08:00
b94e6738d9
HBASE-10378 Refactor write-ahead-log implementation -- ADDEDNUM
2014-11-18 12:12:35 -08:00
d3e7c3cfa9
HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)
2014-11-18 09:48:54 -08:00
42c03460e4
HBASE-12472 Improve debuggability of IntegrationTestBulkLoad
2014-11-17 09:24:06 +01:00
3b8c0769cc
HBASE-12450 Unbalance chaos monkey might kill all region servers without starting them back (Virag Kothari)
2014-11-07 17:24:46 -08:00
3c06b48181
HBASE-12403 IntegrationTestMTTR flaky due to aggressive RS restart timeout
2014-11-01 10:34:59 -07:00
b784f7db99
HBASE-12401 Add some timestamp signposts in IntegrationTestMTTR
2014-10-31 17:21:20 -07:00
f5d6314c87
HBASE-12335 IntegrationTestRegionReplicaPerf is flaky
2014-10-31 17:12:21 -07:00
42ed215c2d
HBASE-12367 Integration tests should not restore the cluster if the CM is not destructive
2014-10-28 17:10:50 -07:00
70a312e53f
HBASE-11912 Catch some bad practices at compile time with error-prone
2014-10-27 09:29:23 -07:00
ff5bc351b2
Revert "HBASE-11912 Catch some bad practices at compile time with error-prone"
...
This reverts commit 7ed0260eff
2014-10-25 08:33:43 -07:00
7ed0260eff
HBASE-11912 Catch some bad practices at compile time with error-prone
2014-10-24 18:15:12 -07:00
11638a8cf2
HBASE-12322 Add Clean command to ITBLL
...
Signed-off-by: stack <stack@apache.org>
2014-10-23 20:53:43 -07:00
84f3549d5e
HBASE-12314 Add chaos monkey policy to execute two actions concurrently
2014-10-22 15:19:30 -07:00
ebe8db5869
HBASE-12317 Run IntegrationTestRegionReplicaPerf w.o mapred
2014-10-22 10:18:28 -07:00
Srikanth Srungarapu
Sean Busbey
Sean Busbey
Enis Soztutar
Jonathan M Hsieh
ramkrishna
stack
Dima Spivak
tedyu
Matteo Bertozzi
Rajeshbabu Chintaguntla
anoopsjohn
Andrew Purtell
Nick Dimiduk
Lars Francke
Matt Warhaftig
Usha Kuchibhotla
Andrey Stepachev
Rajesh Nishtala
zhangduo
Elliott Clark
Josh Elser
Jonathan M Hsieh
Misty Stanley-Jones
Devaraj Das
Ramkrishna
Esteban Gutierrez
Elliott Clark
Yi Deng