Commit Graph

460 Commits

Author SHA1 Message Date
Stephen Yuan Jiang d3decaab8e HBASE-16889 Proc-V2: verifyTables in the IntegrationTestDDLMasterFailover test after each table DDL is incorrect (Stephen Yuan Jiang) 2016-10-20 18:21:23 -07:00
zhangduo 3aa4dfa73d HBASE-16690 Move znode path configs to a separated class 2016-10-05 20:12:44 +08:00
stack 95c1dc93fb HBASE-15638 Shade protobuf
Which includes

    HBASE-16742 Add chapter for devs on how we do protobufs going forward

    HBASE-16741 Amend the generate protobufs out-of-band build step
    to include shade, pulling in protobuf source and a hook for patching protobuf

    Removed ByteStringer from hbase-protocol-shaded. Use the protobuf-3.1.0
    trick directly instead. Makes stuff cleaner. All under 'shaded' dir is
    now generated.

    HBASE-16567 Upgrade to protobuf-3.1.x
    Regenerate all protos in this module with protoc3.
    Redo ByteStringer to use new pb3.1.0 unsafebytesutil
    instead of HBaseZeroCopyByteString

    HBASE-16264 Figure how to deal with endpoints and shaded pb Shade our protobufs.
    Do it in a manner that makes it so we can still have in our API references to
    com.google.protobuf (and in REST). The c.g.p in API is for Coprocessor Endpoints (CPEP)

            This patch is Tactic #4 from Shading Doc attached to the referenced issue.
            Figuring an appoach took a while because we have Coprocessor Endpoints
            mixed in with the core of HBase that are tough to untangle (FIX).

            Tactic #4 (the fourth attempt at addressing this issue) is COPY all but
            the CPEP .proto files currently in hbase-protocol to a new module named
            hbase-protocol-shaded. Generate .protos again in the new location and
            then relocate/shade the generated files. Let CPEPs keep on with the
            old references at com.google.protobuf.* and
            org.apache.hadoop.hbase.protobuf.* but change the hbase core so all
            instead refer to the relocated files in their new location at
            org.apache.hadoop.hbase.shaded.com.google.protobuf.*.

            Let the new module also shade protobufs themselves and change hbase
            core to pick up this shaded protobuf rather than directly reference
            com.google.protobuf.

            This approach allows us to explicitly refer to either the shaded or
            non-shaded version of a protobuf class in any particular context (though
            usually context dictates one or the other). Core runs on shaded protobuf.
            CPEPs continue to use whatever is on the classpath with
            com.google.protobuf.* which is pb2.5.0 for the near future at least.

            See above cited doc for follow-ons and downsides. In short, IDEs will complain
            about not being able to find the shaded protobufs since shading happens at package
            time; will fix by checking in all generated classes and relocated protobuf in
            a follow-on. Also, CPEPs currently suffer an extra-copy as marshalled from
            non-shaded to shaded. To fix. Finally, our .protos are duplicated; once
            shaded, and once not. Pain, but how else to reveal our protos to CPEPs or
            C++ client that wants to talk with HBase AND shade protobuf.

            Details:

            Add a new hbase-protocol-shaded module. It is a copy of hbase-protocol
    i       with all relocated offset from o.a.h.h. to o.a.h.h.shaded. The new module
            also includes the relocated pb. It does not include CPEPs. They stay in
            their old location.

            Add another module hbase-endpoint which has in it all the endpoints
            that ship as part of hbase -- at least the ones that are not
            entangled with core such as AccessControl and Auth. Move all protos
            for these CPEPs here as well as their unit tests (mostly moving a
            bunch of stuff out of hbase-server module)

            Much of the change looks like this:

                 -import org.apache.hadoop.hbase.protobuf.ProtobufUtil;
                 -import org.apache.hadoop.hbase.protobuf.generated.ClusterIdProtos;
                 +import org.apache.hadoop.hbase.protobuf.shaded.ProtobufUtil;
                 +import org.apache.hadoop.hbase.shaded.protobuf.generated.ClusterIdProtos;

            In HTable and in HBaseAdmin, regularize the way Callables are used and also hide
            protobuf usage as much as possible moving it up into Callable super classes or out
            to utility classes. Still TODO is adding in of retries, etc., but can wait on
            procedure which will redo all this.

            Also in HTable and HBaseAdmin as well as in HRegionServer and Server, be explicit
            when using non-shaded protobuf. Do the full-path so it is clear. This is around
            endpoint coprocessors registration of services and execution of CPEP methods.

            Shrunk ProtobufUtil by moving methods used by one CPEP only back to the CPEP either
            into Client class or as new Util class; e.g. AccessControlUtil.

            There are actually two versions of ProtobufUtil now; a shaded one and a subset
            that is used by CPEPs doing non-shaded work.

            Made it so hbase-common no longer depends on hbase-protocol (with Matteo's help)

            R*Converter classes got moved down under shaded package -- they are for internal
            use only. There are no non-shaded versions of these classes.

            D hbase-client/src/main/java/org/apache/hadoop/hbase/client/AbstractRegionServerCallable
            D RetryingCallableBase
             Not used anymore and we have too many tiers of Callables so removed/cleaned-up.

            A ClientServicecallable
             Had to add this one. RegionServerCallable was made generic so it could be used
             for a few Interfaces (Client and Admin). Then added ClientServiceCallable to
             implement RegionServerCallable with the Client Interface.
2016-10-03 21:37:32 -07:00
Jerry He 2765b9d9d9 HBASE-16667 Building with JDK 8: ignoring option MaxPermSize=256m (Niels Basjes) 2016-09-24 16:07:25 -07:00
Jonathan M Hsieh a90d433a2c HBASE-12088 Remove unused hadoop-1.0, hadoop-1.1 profiles from non-root poms 2016-09-21 20:45:03 -07:00
zhangduo c04b389181 HBASE-16445 Refactor and reimplement RpcClient 2016-09-08 20:32:56 +08:00
chenheng 7363a76660 HBASE-16562 ITBLL should fail to start if misconfigured, addendum 2016-09-07 15:29:55 +08:00
chenheng 78af20944c HBASE-16562 ITBLL should fail to start if misconfigured 2016-09-07 11:29:54 +08:00
zhangduo e30a66b944 HBASE-16526 Addendum add missing stuffs 2016-09-01 11:48:35 +08:00
zhangduo 45af3831fe HBASE-16526 Add more ipc tests 2016-08-31 20:44:56 +08:00
tedyu d5080e82fb HBASE-16418 Reduce duration of sleep waiting for region reopen in IntegrationTestBulkLoad#installSlowingCoproc() 2016-08-15 17:26:11 -07:00
Reid 3c3457c6c0 HBASE-14345 Consolidate printUsage in IntegrationTestLoadAndVerify (Reid Chan) 2016-08-10 09:38:46 -07:00
Sean Busbey 431c8c9ad0 HBASE-8386 deprecate TableMapReduce.addDependencyJars(Configuration, class<?> ...)
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2016-08-05 10:35:02 -05:00
Enis Soztutar 39db239d4e HBASE-16271 Fix logging and re-run the test in IntegrationTestBulkLoad 2016-08-03 17:02:35 -07:00
Gary Helmling 84b7010a30 HBASE-16231 Support client keytab login for integration tests 2016-07-15 16:30:33 -07:00
Stephen Yuan Jiang f04eeecffc HBASE-14552 Procedure V2: Reimplement DispatchMergingRegionHandler (Stephen Yuan Jiang) 2016-07-15 07:06:53 -07:00
Joseph Hwang cb118c8de6 HBASE-15935 Set up a concurrent walker that walks flushed circular linked lists as a Loop Mode
Signed-off-by: Elliott Clark <eclark@apache.org>
2016-07-08 09:09:02 -07:00
Enis Soztutar 17edca6346 HBASE-16190 IntegrationTestDDLMasterFailover failed with IllegalArgumentException: n must be positive (Romil Choksi and Heng Chen) 2016-07-07 16:34:08 -07:00
Enis Soztutar c137bafe51 HBASE-16182 Increase IntegrationTestRpcClient timeout 2016-07-06 11:23:46 -07:00
chenheng 68c1b34dbc HBASE-16040 Remove configuration "hbase.replication" 2016-06-24 10:41:35 +08:00
Sergey Soldatov da88b48240 HBASE-15957 RpcClientImpl.close never ends in some circumstances
Signed-off-by: Enis Soztutar <enis@apache.org>
2016-06-07 11:33:03 -07:00
Jurriaan Mous cdd532da8a HBASE-15610 Remove deprecated HConnection for 2.0 thus removing all PB references for 2.0
Signed-off-by: stack <stack@apache.org>
2016-05-29 07:50:55 -07:00
Sean Mackrory 3b6e6e6c25 HBASE-15889. String case conversions are locale-sensitive, used without locale
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-28 10:41:31 -07:00
eshcar a27504c701 HBASE-14920: Compacting memstore
Signed-off-by: stack <stack@apache.org>
2016-05-20 03:41:43 -07:00
Alex Moundalexis 0bf065a5d5 HBASE-15768 fix capitalization of ZooKeeper usage
Signed-off-by: Sean Busbey <busbey@apache.org>
2016-05-05 15:35:44 -05:00
Ramkrishna c06a976a98 HBASE-15607 Remove PB references from Admin for 2.0 (Ram) 2016-05-03 10:51:46 +05:30
Enis Soztutar 0520097611 HBASE-15295 MutateTableAccess.multiMutate() does not get high priority causing a deadlock 2016-03-28 17:56:32 -07:00
Enis Soztutar ca816f0780 HBASE-6721 RegionServer Group based Assignment (Francis Liu) 2016-03-14 18:28:50 -07:00
Jonathan M Hsieh f658f3ef83 HBASE-15356 Remove unused imports (Youngjoon Kim) 2016-03-03 11:42:38 -08:00
stack 13a46df181 HBASE-15190 Monkey dies when running on shared cluster (gives up when can't kill the other fellows processes) 2016-01-31 10:51:41 -06:00
Jonathan M Hsieh dc57996ca6 HBASE-15104 Occasional failures due to NotServingRegionException in IT tests (Huaxiang Sun) 2016-01-14 07:59:33 -08:00
tedyu 3d3677932a HBASE-15070 DistributedHBaseCluster#restoreRegionServers() starts new RS process on master server (Samir Ahmic) 2016-01-07 09:14:00 -08:00
Samir Ahmic 0bdd6e487f HBASE-15034 IntegrationTestDDLMasterFailover does not clean created namespaces.
Signed-off-by: Matteo Bertozzi <matteo.bertozzi@cloudera.com>
2015-12-24 04:53:20 -08:00
Mikhail Antonov abe30b52a8 HBASE-14534 Bump yammer/coda/dropwizard metrics dependency version 2015-12-15 12:11:27 -08:00
stack bebcc09fb3 HBASE-14769 Remove unused functions and duplicate javadocs from HBaseAdmin 2015-12-10 15:02:21 -08:00
stack 92e178df28 Revert "HBASE-14769 Removing unused functions from HBaseAdmin. Removing redundant javadocs from HBaseAdmin as they will be automatically inhertited from Admin.java. (Apekshit)"
Reverting. The conversation on issues to do with this patch was not done (Appy brought it to my attention).

This reverts commit 6adce67572.
2015-12-01 11:30:39 -08:00
stack 3534e1ffef HBASE-14819 hbase-it tests failing with OOME; permgen ; ADDENDUM... more heap and permgen for failsafe runs 2015-12-01 09:59:42 -08:00
stack 7979ac46cc HBASE-14819 hbase-it tests failing with OOME; permgen 2015-11-30 21:00:35 -08:00
Apekshit(Appy) Sharma 6adce67572 HBASE-14769 Removing unused functions from HBaseAdmin. Removing redundant javadocs from HBaseAdmin as they will be automatically inhertited from Admin.java. (Apekshit)
Signed-off-by: stack <stack@apache.org>
2015-11-30 20:44:11 -08:00
stack 4a60c25c70 HBASE-14819 hbase-it tests failing with OOME; permgen -- DEBUGGING 2015-11-24 08:56:19 -08:00
stack 97ffb193e0 HBASE-14819 hbase-it tests failing with OOME; permgen; DEBUG 2015-11-21 21:32:49 -08:00
stack 26423e4026 Revert "HBASE-14819 hbase-it tests failing with OOME; permgen ADDENDUM"
This reverts commit ea48ef8651.
2015-11-20 11:37:31 -08:00
stack ea48ef8651 HBASE-14819 hbase-it tests failing with OOME; permgen ADDENDUM 2015-11-19 17:06:38 -08:00
stack 7dc4f12199 HBASE-14819 hbase-it tests failing with OOME: permgen 2015-11-19 14:46:53 -08:00
Jonathan M Hsieh 0207da8cee HBASE-14780 Integration Test that run with chaos monkey must specify cfs 2015-11-10 15:02:23 -08:00
Elliott Clark 1144237765 HBASE-14781 Turn per cf flushing on for ITBLL by default 2015-11-07 11:50:13 -08:00
Elliott Clark ebd2df723f HBASE-14723 Fix IT tests split too many times 2015-11-04 11:55:38 -08:00
Jonathan M Hsieh 7368344585 HBASE-14731 Add -DuseMob option to ITBLL 2015-11-02 05:03:38 -08:00
Jonathan M Hsieh 094d65e6f5 HBASE-14673 Exorcise deprecated Delete#delete* api 2015-10-29 11:15:34 -07:00
Jonathan M Hsieh de9555cec4 HBASE-14675 Exorcise deprecated Put#add(...) and replace with Put#addColumn(...) 2015-10-29 11:15:31 -07:00
Enis Soztutar 0e6dd3257b HBASE-14425 In Secure Zookeeper cluster superuser will not have sufficient permission if multiple values are configured in hbase.superuser (Pankaj Kumar) 2015-10-27 16:56:20 -07:00
Enis Soztutar 2b86002521 HBASE-14682 CM restore functionality for regionservers is broken 2015-10-26 16:47:16 -07:00
Andrew Purtell efb82957da HBASE-13318 RpcServer.getListenerAddress should handle when the accept channel is closed 2015-10-26 15:11:12 -07:00
Enis Soztutar b4ba615c70 HBASE-14535 Integration test for rpc connection concurrency / deadlock testing 2015-10-22 18:35:34 -07:00
Elliott Clark 35660b4f5c HBASE-14658 Addendum; Allow loading a MonkeyFactory by class name 2015-10-22 12:09:58 -07:00
Matteo Bertozzi 36a196722c HBASE-14669 remove unused import and fix javadoc 2015-10-22 09:25:26 -07:00
Elliott Clark 2e2cbd0201 HBASE-14658 Allow loading a MonkeyFactory by class name 2015-10-22 08:54:12 -07:00
Jonathan M Hsieh 5363f371bb HBASE-14666 Remove deprecated HBaseTestingUtility#deleteTable(...) methods 2015-10-21 21:34:23 -07:00
Elliott Clark e874a31d75 HBASE-14625 Chaos Monkey should shut down faster 2015-10-16 15:22:31 -07:00
tedyu bfcec29dd1 HBASE-14592 BatchRestartRsAction always restarts 0 RS when running SlowDeterministicMonkey (Yu Li) 2015-10-12 14:48:27 -07:00
Elliott Clark 6db1134cb7 HBASE-14211 Add more rigorous integration tests of splits
Summary:
Intgration tests don't currently have a lot of splits going on while there is IO.
This changes that by changing the split aglorithm and the max region hfile size. That should make things split more.

Additionally this allows ITBLL to start with just one region if hbase.test.pre-split-table is False.

Test Plan: Test on a cluster with ITBLL slow determinitic monkey and stress am monkey.

Differential Revision: https://reviews.facebook.net/D44181
2015-10-12 13:25:15 -07:00
chenheng 02699fe967 HBASE-14227 Fold special cased MOB APIs into existing APIs
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-09-25 18:28:13 -07:00
Stephen Yuan Jiang daccb1c0c2 HBASE-14212 Add IT test for procedure-v2-based namespace DDL (Stephen Yuan Jiang) 2015-09-25 16:28:29 -07:00
Stephen Yuan Jiang 085fd765aa HBASE-14051 Undo workarounds in IntegrationTestDDLMasterFailover for client double submit (Stephen Yuan jiang) 2015-09-25 14:39:40 -07:00
Srikanth Srungarapu e48991970d HBASE-14261 Enhance Chaos Monkey framework by adding zookeeper and datanode fault injections. 2015-09-03 11:55:36 -07:00
Sean Busbey ebd34844ce HBASE-14243 Correct NOTICE files.
* fix hbase-it's incorrect use of hbase-server's unfiltered NOTICE
* fix printed comment in resource-bundle NOTICE
* add dependency url for non-aggregated works so that we meet Category B requirements
2015-08-19 15:45:58 -05:00
Sean Busbey 1b0b67fb7c HBASE-14085 Update LICENSE and NOTICE files.
* corrects license/notice for source distribution
* adds inception year to correct copyright in generated NOTICE files for jars
* updates project names in poms to use "Apache HBase" instead of "HBase" so jar NOTICE files will be correct
* uses append-resources to include supplemental info on jars with 3rd party works in source
* adds an hbase specific resource bundle for jars that include 3rd party works for binaries
** uses supplemental-model to fill in license gaps
** uses the above and a shade plugin transformation to build proper files for shaded jars.
** uses the above and the assembly plugin to build the proper files for bin assembly
* adds a NOTICE item for things copied out of Hadoop (TODO legal-discuss)
2015-08-04 17:16:56 -05:00
Enis Soztutar dad4cad30e HBASE-11276 Add back support for running ChaosMonkey as standalone tool (Yu Li) 2015-07-23 18:39:01 -07:00
Jonathan M Hsieh 493f36c899 HBASE-11339 Merge remote-tracking branch 'apache/hbase-11339' (Jingcheng Du) 2015-07-22 12:51:11 -07:00
Sean Busbey 25f7e804cd HBASE-14027 clean up multiple netty jars. 2015-07-15 02:33:28 -05:00
ramkrishna a3d30892b4 HBASE-14047 - Cleanup deprecated APIs from Cell class (Ashish Singhi) 2015-07-13 22:06:16 +05:30
stack f5ad736282 HBASE-13561 ITBLL.Verify doesn't actually evaluate counters after job completes (Josh Elser) 2015-07-07 13:06:10 -07:00
Dima Spivak e640f1e76a HBASE-14002 Add --noReplicationSetup option to IntegrationTestReplication
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-07-03 14:54:10 -07:00
stack 272b025b25 HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis Soztutar) -- NEW ADDENDUM TO FIX ITBLL on master 2015-07-02 00:40:09 -07:00
stack 20e855f282 HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis Soztutar) -- REAPPLY 2015-07-01 23:16:30 -07:00
stack f0e29c49a1 Revert "HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis"
This reverts commit fca725a899.
2015-07-01 20:20:08 -07:00
stack fca725a899 HBASE-13895 DATALOSS: Region assigned before WAL replay when abort (Enis
Soztutar)
2015-07-01 20:07:26 -07:00
stack b5b5853043 HBASE-13893 Replace HTable with Table in client tests (Jurriaan Mous) 2015-06-25 14:42:33 -07:00
tedyu e6ed792199 HBASE-13702 ImportTsv: Add dry-run functionality and log bad rows (Apekshit Sharma) 2015-06-25 13:15:07 -07:00
Matteo Bertozzi 1927f04077 HBASE-13958 RESTApiClusterManager calls kill() instead of suspend() and resume() 2015-06-23 16:28:32 -07:00
Rajeshbabu Chintaguntla 168c1b1b73 HBASE-13940 IntegrationTestBulkLoad needs option to specify output folders used by test(Rajeshbabu) 2015-06-24 01:06:55 +05:30
Enis Soztutar 1b5ad45b85 HBASE-13470 High level Integration test for master DDL operations (Sophia Feng) 2015-06-16 22:22:35 -07:00
Enis Soztutar c6dd3f965b HBASE-13877 Interrupt to flush from TableFlushProcedure causes dataloss in ITBLL 2015-06-14 11:22:07 -07:00
Enis Soztutar fe5712f9b4 HBASE-13853 ITBLL improvements after HBASE-13811 2015-06-08 12:17:50 -07:00
Sean Busbey a016b23e85 HBASE-13728 Remove direct use of Hadoop's GenericOptionParser.
* In most cases, just shift to proper use of ToolRunner
* Fix timing issue in TestImportExport
** add some diagnostic logs to Import and TestImportExport
** when testing for WAL use under different durability requests, ignore meta edits.
* In the case of TestImportTsv make a local anonymous class so we can get at internals.
2015-05-29 12:38:52 -05:00
anoopsjohn b31a6acf4c HBASE-13763 Handle the rename, annotation and typo stuff in MOB. (Jingcheng) 2015-05-28 13:43:12 +05:30
Andrew Purtell 942e09b71e HBASE-13768 ZooKeeper znodes are bootstrapped with insecure ACLs in a secure configuration (Enis Soztutar) 2015-05-27 12:23:14 -07:00
Nick Dimiduk 77d9719e2b HBASE-13711 Provide an API to set min and max versions in HColumnDescriptor (Stephen Yuan Jiang) 2015-05-20 11:40:25 -07:00
Jonathan M Hsieh 09a00efc0b Merge remote-tracking branch 'apache/master' (5/19/15) into hbase-11339
Patches that caused deltas:
HBASE-10810 - around HColumnDescriptor 'should' vs 'is' api.
HBASE-11677 - LOG was made private
HBASE-11927 - Checksum constant changed
HBASE-10800 - CellComparator instead of KVComparator

Conflicts:
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/DefaultStoreEngine.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/DefaultCompactor.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/util/LoadTestTool.java
2015-05-19 16:30:21 -07:00
Lars Francke ec51d7b2e6 HBASE-1989 Admin (et al.) not accurate with Column vs. Column-Family
usage

Fix check style issues & rename parameter

Incorporate comments

Signed-off-by: stack <stack@apache.org>
2015-05-11 09:46:28 -07:00
stack b03ff8ccca Revert "Rename & deprecate everything in Admin"
Revert because does not cite associated JIRA in commit message (my
fault)

This reverts commit 2ad4114149.
2015-05-11 09:45:33 -07:00
Lars Francke 2ad4114149 Rename & deprecate everything in Admin
Fix check style issues & rename parameter

Incorporate comments

Signed-off-by: stack <stack@apache.org>
2015-05-10 20:47:12 -07:00
ramkrishna 977f867439 HBASE-10800 - Use CellComparator instead of KVComparator (Ram) 2015-05-05 11:38:10 +05:30
Jonathan M Hsieh 0e20bbf6a3 Merge branch 'apache/master' (4/16/15) into hbase-11339
API conflicts and test fixes
Update LoadTestTool.COLUMN_FAMILY -> DEFAULT_COLUMN_FAMILY due HBASE-11842
Use new 1.0+ api in some tests
Use updated Scanners internal api
Fix to take into account  HBASE-13203 - procedure v2 table delete

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/protobuf/ProtobufUtil.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/HMaster.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/MasterRpcServices.java
2015-05-01 08:18:51 -07:00
Matt Warhaftig d50d6d967d HBASE-13358 - Update VisibilityClient to accept Connection objects.
Signed-off-by: Srikanth Srungarapu <ssrungarapu@cloudera.com>
2015-04-30 21:28:01 -07:00
Usha Kuchibhotla 94a00bea07 HBASE-11677 Making Logger instance modifiers consistent.
* IA.Public accessible logger instances deprecated
* logger instances modified by tests left in place
* all others made private static final

Signed-off-by: Sean Busbey <busbey@apache.org>
2015-04-28 09:20:34 -05:00
stack 79db629323 Revert "HBASE-13078 Removal of IntegrationTestSendTraceRequests (Josh Elser)"
Put this file back; over-zealous removal.

This reverts commit 91ab1086d6.
2015-04-27 11:23:52 -07:00
Andrey Stepachev d5ff2b587c HBASE-13322 Replace explicit HBaseAdmin creation with connection#getAdmin() 2015-04-27 16:28:53 +01:00
stack 91ab1086d6 HBASE-13078 Removal of IntegrationTestSendTraceRequests (Josh Elser) 2015-04-21 12:45:25 -07:00
Rajesh Nishtala d5e81523f7 HBASE-13413 New integration test for oss => oss replication
Summary: This test subclasses the BigLinkedList test. It takes two hbase clusters as arguments, sets up tables, sets up replication, and runs the BigLinkedList generator. The verification portion of the loop checks that the sink of the replication has the data and it is correct.

Test Plan: ran the test on my laptop and a small live cluster

Reviewers: dimaspivak, eclark

Reviewed By: eclark

Subscribers: srikanth235, asameet

Differential Revision: https://reviews.facebook.net/D36423

Signed-off-by: Elliott Clark <eclark@apache.org>
2015-04-07 12:37:05 -07:00
stack f561ef71a5 HBASE-13382 IntegrationTestBigLinkedList should use SecureRandom (Dima Spivak) 2015-04-03 15:33:55 -07:00
stack 3a2a29616c HBASE-13373 Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc.
Reapply after adding in the missing JIRA number
2015-04-03 15:25:19 -07:00
stack 319666ca53 Revert "HBASE-Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc."
This reverts commit 5b25a48e7f.
2015-04-03 15:16:38 -07:00
stack 5b25a48e7f HBASE-Squash HFileReaderV3 together with HFileReaderV2 and AbstractHFileReader; ditto for Scanners and BlockReader, etc. 2015-04-03 14:14:00 -07:00
zhangduo f1b53d71b8 HBASE-13187 Add ITBLL that exercises per CF flush
Signed-off-by: stack <stack@apache.org>
2015-04-01 09:44:24 -07:00
Elliott Clark 55a5a3be33 HBASE-13364 Make error prone off by default 2015-03-30 16:03:53 -07:00
stack f57dca5e1b HBASE-13198 Remove HConnectionManager (Mikhail Antonov) 2015-03-20 09:41:48 -07:00
Dima Spivak bf9e32d59d HBASE-13223 Add testMoveMeta to IntegrationTestMTTR
Signed-off-by: Andrew Purtell <apurtell@apache.org>
2015-03-16 18:22:51 -07:00
Josh Elser 72855c584e HBASE-13236 Add addt'l lifecycle-mapping executions.
Adds a number of lifecycle-mapping entries which
prevent errors from showing up in Eclipse on a fresh
import of HBase. For plugins defined in the top-level
pom, the mapping is added there; otherwise, the mapping
is pushed down to the child pom.

Signed-off-by: Sean Busbey <busbey@apache.org>
2015-03-13 22:35:52 -05:00
tedyu 7a3ea23704 HBASE-13171 Change AccessControlClient methods to accept connection object to reduce setup time (Srikanth Srungarapu) 2015-03-11 18:24:12 -07:00
Jonathan M Hsieh 0d6cac9b1e HBASE-13157 Add Mob compaction actions and monkeys to Chaos Monkey 2015-03-05 11:31:36 -08:00
Jonathan M Hsieh 2124d3df70 HBASE-13154 add support for mob in TestAcidGuarantees and IntegrationTestAcidGuarantees 2015-03-05 00:09:05 -08:00
Misty Stanley-Jones 39425a8558 HBASE-11670 Generate PDF of Reference Guide 2015-03-05 09:31:11 +10:00
Enis Soztutar 9899aab12b HBASE-11580 Failover handling for secondary region replicas 2015-03-03 11:48:12 -08:00
Jonathan M Hsieh d66f88134c HBASE-13132 Improve RemoveColumn action debug message 2015-03-03 04:41:36 -08:00
Jonathan M Hsieh cf4f4fcbb3 HBASE-13141 IntegrationTestAcidGuarantees returns incorrect values for getColumnFamilies 2015-03-03 04:41:27 -08:00
Jonathan M Hsieh daed00fc98 HBASE-13141 IntegrationTestAcidGuarantees returns incorrect values for getColumnFamilies 2015-03-02 21:26:01 -08:00
Jonathan M Hsieh d2e64032c6 HBASE-13132 Improve RemoveColumn action debug message 2015-03-02 10:31:24 -08:00
Enis Soztutar 21b366afe1 HBASE-11842 Integration test for async wal replication to secondary regions 2015-02-22 21:29:12 -08:00
Jonathan M Hsieh fe335b683c Merge branch 'master' (2/11/15) into hbase-11339
Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/HColumnDescriptor.java
	hbase-client/src/test/java/org/apache/hadoop/hbase/TestHColumnDescriptor.java
	hbase-common/src/main/java/org/apache/hadoop/hbase/TagType.java
	hbase-common/src/main/resources/hbase-default.xml
	hbase-hadoop-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapper.java
	hbase-hadoop2-compat/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerSourceImpl.java
	hbase-it/src/test/java/org/apache/hadoop/hbase/IntegrationTestAcidGuarantees.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/io/HFileLink.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/handler/DeleteTableHandler.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/master/snapshot/DisabledTableSnapshotHandler.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/DefaultStoreEngine.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/HStore.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperImpl.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/Compactor.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/DefaultCompactor.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/compactions/StripeCompactor.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/ExportSnapshot.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/RestoreSnapshotHelper.java
	hbase-server/src/main/java/org/apache/hadoop/hbase/snapshot/SnapshotReferenceUtil.java
	hbase-server/src/test/java/org/apache/hadoop/hbase/regionserver/MetricsRegionServerWrapperStub.java
	pom.xml
	src/main/docbkx/book.xml
	src/main/docbkx/ops_mgt.xml
	src/main/docbkx/schema_design.xml
2015-02-22 12:54:45 -08:00
Dima Spivak ca25a6a870 HBASE-12869 Add a REST API implementation of the ClusterManager interface
Signed-off-by: stack <stack@apache.org>
2015-02-17 12:03:09 -08:00
Andrew Purtell 200ec5b191 HBASE-12747 IntegrationTestMTTR will OOME if launched with mvn verify (Abhishek Singh Chouhan) 2015-02-09 18:54:43 -08:00
stack 825871431e HBASE-12782 ITBLL fails for me if generator does anything but 5M per maptask 2015-01-30 19:12:17 -08:00
Devaraj Das 6b20a0f831 HBASE-11574. hbase:meta's regions can be replicated 2015-01-27 16:40:29 -08:00
Ramkrishna cfb0cf72d4 HBASE-12893 - IntegrationTestBigLinkedListWithVisibility should use
buffered writes (Jingcheng Du)
2015-01-27 10:25:23 +05:30
Nick Dimiduk ab18158e60 HBASE-12728 buffered writes substantially less useful after removal of HTablePool (Solomon Duskis and Nick Dimiduk)
In our pre-1.0 API, HTable is considered a light-weight object that consumed by
a single thread at a time. The HTablePool class provided a means of sharing
multiple HTable instances across a number of threads. As an optimization,
HTable managed a "write buffer", accumulating edits and sending a "batch" all
at once. By default the batch was sent as the last step in invocations of
put(Put) and put(List<Put>). The user could disable the automatic flushing of
the write buffer, retaining edits locally and only sending the whole "batch"
once the write buffer has filled or when the flushCommits() method in invoked
explicitly. Explicit or implicit batch writing was controlled by the
setAutoFlushTo(boolean) method. A value of true (the default) had the write
buffer flushed at the completion of a call to put(Put) or put(List<Put>). A
value of false allowed for explicit buffer management. HTable also exposed the
buffer to consumers via getWriteBuffer().

The combination of HTable with setAutoFlushTo(false) and the HTablePool
provided a convenient mechanism by which multiple "Put-producing" threads could
share a common write buffer. Both HTablePool and HTable are deprecated, and
they are officially replaced in The new 1.0 API by Table and BufferedMutator.
Table, which replaces HTable, no longer exposes explicit write-buffer
management. Instead, explicit buffer management is exposed via BufferedMutator.
BufferedMutator is made safe for concurrent use. Where code would previously
retrieve and return HTables from an HTablePool, now that code creates and
shares a single BufferedMutator instance across all threads.
2015-01-23 08:48:31 -08:00
Nick Dimiduk 9824eb7840 HBASE-12810 Update to htrace-incubating 2015-01-22 14:28:20 -08:00
Sean Busbey 418ea93774 HBASE-12898 ensure direct dependencies are declared. 2015-01-22 14:33:25 -06:00
Misty Stanley-Jones 1a21c1684c HBASE-11533 Asciidoc Proof of Concept 2015-01-13 22:32:29 -08:00
tedyu 9246af8dac HBASE-12796 Clean up HTable and HBaseAdmin deprecated constructor usage (Jurriaan Mous) 2015-01-08 07:49:28 -08:00
tedyu 2452d3861f HBASE-12802 Remove unnecessary Table.flushCommits() (Solomon Duskis) 2015-01-05 15:45:52 -08:00
Enis Soztutar 24bcebdeeb HBASE-12799 ITAG fails with java.lang.RuntimeException if table does not exist 2015-01-05 11:14:40 -08:00
tedyu ac95cc1fbb HBASE-12783 Create efficient RegionLocator implementation (Solomon Duskis) 2015-01-02 19:48:06 -08:00
Esteban Gutierrez b2eea8cac6 HBASE-12695 JDK 1.8 compilation broken
Signed-off-by: stack <stack@apache.org>
2014-12-29 11:02:04 -08:00
Elliott Clark e5ca773f78 HBASE-12429 Add port to ClusterManager's actions. 2014-12-29 10:22:52 -08:00
Jonathan M Hsieh 9a829dc458 HBASE-12735 Refactor TestAcidGuarantees so it can live as unit test and as an integration test 2014-12-23 17:18:58 -08:00
Jonathan M Hsieh 4a6f1d9d6b HBASE-12718 Convert TestAcidGuarantees from a unit test to an integration test 2014-12-18 17:45:08 -08:00
Jonathan M Hsieh 33c27f4e03 HBASE-12718 Convert TestAcidGuarantees from a unit test to an integration test 2014-12-18 17:21:23 -08:00
Yi Deng 555d14ed45 HBASE-12680 Move signal related code from ClusterManager to HBaseClusterManager and change ClusterManager to an interface
Summary: The reason of this change is to make us write implementation of ClusterManager not using ssh/unix signals.

Test Plan: The compilation is OK.

Reviewers: eclark, manukranthk

Differential Revision: https://reviews.facebook.net/D30201

Signed-off-by: Elliott Clark <eclark@apache.org>
2014-12-15 09:09:43 -08:00
Yi Deng fe12ad5066 Fix the ASCII art
Signed-off-by: stack <stack@apache.org>
2014-12-11 17:22:29 -08:00
Andrew Purtell bb15fd5fe0 HBASE-12606 Sanity check encryption configuration before opening WAL or onlining regions
Also disables IntegrationTestIngestWithEncryption if distributed
cluster configuration is missing prerequisites.
2014-12-06 21:46:43 -08:00
Devaraj Das ca0c1774c9 HBASE-12548. Improve debuggability of IntegrationTestTimeBoundedRequestsWithRegionReplicas 2014-12-06 18:18:03 -08:00
stack 54f438cee4 HBASE-12616 We lost the linked list commands in recent usage refactoring 2014-12-02 14:15:04 -08:00
stack 7a3396f0e1 HBASE-12490 Replace uses of setAutoFlush(boolean, boolean) (Solomon Duskis) 2014-12-02 10:06:21 -08:00
stack 1a9b556474 Revert "HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG"
This reverts commit 8b8f2026bd.

Overcommit. Added "HBASE-12490 Replace uses of setAutoFlush(boolean,
boolean)" by mistake

Conflicts:
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/ClusterStatusListener.java
	hbase-client/src/main/java/org/apache/hadoop/hbase/client/HTable.java
2014-12-02 09:51:19 -08:00
stack 69a437ac0d HBASE-12514 Cleanup HFileOutputFormat legacy code (Solomon Duskis)
Signed-off-by: stack <stack@apache.org>
2014-12-01 10:15:51 -08:00
stack 58b6b24c29 HBASE-12519 Remove tabs used as whitespace (Varun Saxena) 2014-11-28 20:50:02 -08:00
stack 8b8f2026bd HBASE-12558 TestHCM.testClusterStatus Unexpected exception, expected<org.apache.hadoop.hbase.regionserver.RegionServerStoppedException> but was<junit.framework.AssertionFailedError> -- ADDED DEBUG 2014-11-25 21:21:50 -08:00
stack 336c22d581 HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99) under src/main/java
Move from HConnection to ClusterConnection or Connection
Use unmanaged connections where we use managed previous
(used the jdk7 https://docs.oracle.com/javase/7/docs/technotes/guides/language/try-with-resources.html idiom).

In ZKConfig, synchronize on Configuration rather than make a copy.
Making a copy we were dropping hbase configs in certain test context
(could not find the zk ensemble because default port).

In tests, some move to the new style connection setup but mostly
fixes for premature connection close or adding cleanup where it
was lacking.
2014-11-24 09:46:28 -08:00
stack 5f391efda1 Revert "HBASE-12471 Task 4. replace internal ConnectionManager#{delete,get}Connection use with #close, #createConnection (0.98, 0.99)"
This reverts commit d3e7c3cfa9.
2014-11-18 16:30:52 -08:00