Commit Graph

2646 Commits

Author SHA1 Message Date
Michael Stack aab46757ec HBASE-3081 Log Splitting & Replay: Distinguish between Network IOE and Parsing IOE
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1023186 13f79535-47bb-0310-9956-ffa450edef68
2010-10-16 05:35:27 +00:00
Michael Stack 63ba21eca5 HBASE-2933 Skip EOF Errors during Log Recovery
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1023183 13f79535-47bb-0310-9956-ffa450edef68
2010-10-16 05:27:57 +00:00
Michael Stack 0f27ee880c HBASE-3114 Test up on hudson are leaking zookeeper ensemble
Trying this patch to see if it cures hudson of leakage

M src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
  Add a passedZkCluster flag.  If we didn't start the zk cluster,
  don't shut it down on way out.
M src/test/java/org/apache/hadoop/hbase/TestHBaseTestingUtility.java
  Add a test that starts up three clusters in a vm all sharing single
  zk, each to its own chroot location.  Add to tables in each and
  very the add by doing same as the old TestMultiClusters used)
M src/test/java/org/apache/hadoop/hbase/replication/TestReplication.java
  Reenable shutdown of started clusters.  Hopefully this clears
  the leaking of zk ensembles up on hudson.
M src/main/java/org/apache/hadoop/hbase/zookeeper/ZooKeeperWatcher.java
  Testing, it looks like legitimately the callback for session connected
  can be invoked before construction of zookeeperwatcher finishes.  In
  particular the zookeeper data member can be null.  Hang around for a
  second of so before throwing an exception (Make the exception
  indicate the particular zkw by adding to the error message stack
  trace made at zkw construction -- helps with debugging this stuff)



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1023181 13f79535-47bb-0310-9956-ffa450edef68
2010-10-16 05:14:15 +00:00
Michael Stack dcbcd4f2d4 HBASE-3113 Don't reassign regions if cluster is being shutdown
M src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
  Bit of javadoc.
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
  If bad server, pass in name of bad server when remaking assignment
  plan -- i missed this important part on commit of part 2 of 3113.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1023179 13f79535-47bb-0310-9956-ffa450edef68
2010-10-16 05:07:50 +00:00
Michael Stack 509beae1e2 HBASE-3113 Don't reassign regions if cluster is being shutdown; part 2 -- fix wrongly named exception and let out IOEs when opening regions on RS
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1023115 13f79535-47bb-0310-9956-ffa450edef68
2010-10-15 21:22:38 +00:00
Michael Stack 349b7a74c8 HBASE-3104 Disable TestMultiClusters; it doesn't really test anything and HBaseTestingUtility needs more work for this to pass anyways -- just remove this class altogether
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1023109 13f79535-47bb-0310-9956-ffa450edef68
2010-10-15 20:52:20 +00:00
Michael Stack e20615b917 HBASE-3113 Don't reassign regions if cluster is being shutdown; part 2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1023107 13f79535-47bb-0310-9956-ffa450edef68
2010-10-15 20:46:13 +00:00
Michael Stack ef94177cd9 Remove debugging IOE throw
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1023102 13f79535-47bb-0310-9956-ffa450edef68
2010-10-15 20:36:23 +00:00
Michael Stack 954efa6e76 HBASE-3111 TestTableMapReduce broken up on hudson
M src/main/java/org/apache/hadoop/hbase/zookeeper/ZKUtil.java
  Changed mentions of 'quorum' to 'ensemble'.
M src/main/java/org/apache/hadoop/hbase/mapreduce/IdentityTableReducer.java
M src/main/java/org/apache/hadoop/hbase/mapreduce/TableInputFormat.java
  Minor formatting.
M src/main/java/org/apache/hadoop/hbase/mapreduce/TableInputFormatBase.java
  Removed unused imports and minor formatting.
M src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
  Documented what the quorumAddress parameter is for.
  Removed an unnecessary looking HBaseConfiguration.addHbaseResources(conf);
  (and adjusted documentation of job to say no hbase config set by the
  reduce setup method).
M src/main/java/org/apache/hadoop/hbase/mapreduce/TableOutputFormat.java
  Made this class implment Configurable.  Moved creation of table from
  RecordWrite constructor based off passed TaskAttemptContext instead
  into the new setConf method.  Added table and conf data members.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022825 13f79535-47bb-0310-9956-ffa450edef68
2010-10-15 05:33:11 +00:00
Jean-Daniel Cryans a5a00687ef HBASE-3041 [replication] ReplicationSink shouldn't kill the whole RS when
it fails to replicate
HBASE-3044  [replication] ReplicationSource won't cleanup logs if there's 
            nothing to replicate


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022770 13f79535-47bb-0310-9956-ffa450edef68
2010-10-14 23:52:49 +00:00
Michael Stack bcaa2dea49 HBASE-3113 Don't reassign regions if cluster is being shutdown
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022760 13f79535-47bb-0310-9956-ffa450edef68
2010-10-14 23:10:09 +00:00
Michael Stack da3cc25adb Commenting out the disable/enable/disable swerve in this test for now until we address hbase-3112
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022645 13f79535-47bb-0310-9956-ffa450edef68
2010-10-14 18:47:57 +00:00
Michael Stack cd2bfd5b6a HBASE-3111 TestTableMapReduce broken up on hudson; Attempted fix
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022381 13f79535-47bb-0310-9956-ffa450edef68
2010-10-14 05:58:54 +00:00
Michael Stack 3d75d323e5 HBASE-3110 TestReplicationSink failing in TRUNK up on Hudson; trying to see if this fixes this test
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022372 13f79535-47bb-0310-9956-ffa450edef68
2010-10-14 04:11:55 +00:00
Michael Stack b15d5425b9 Needed to change the zk port elsewhere too to make default 21818 rather than 21810; and still further places
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022300 13f79535-47bb-0310-9956-ffa450edef68
2010-10-13 21:36:51 +00:00
Michael Stack 1973b02b94 Needed to change the zk port elsewhere too to make default 21818 rather than 21810
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022276 13f79535-47bb-0310-9956-ffa450edef68
2010-10-13 20:06:29 +00:00
Michael Stack 7c8411d06a Upping pom memory and changing zk default port to help debug; on first, no harm in letting heap grow and on second, there seems to be errant zk cluster running on hudson ... trying to see if tests generate it when run clean
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022263 13f79535-47bb-0310-9956-ffa450edef68
2010-10-13 19:45:43 +00:00
Michael Stack 0fcd520eb3 HBASE-3100 add timeout to TestMergeTable and try another config to prevent splits
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022189 13f79535-47bb-0310-9956-ffa450edef68
2010-10-13 17:04:53 +00:00
Michael Stack 25ae7a7b20 HBASE-3100 stop splitting in TestMergeTable, and add debug
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022003 13f79535-47bb-0310-9956-ffa450edef68
2010-10-13 05:39:11 +00:00
Michael Stack 8dc8fea2f3 HBASE-3105 Scan.toString fails to escape binary start/stop rows
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021912 13f79535-47bb-0310-9956-ffa450edef68
2010-10-12 20:18:12 +00:00
Michael Stack c189e8e967 Get more detail on undeclared exception thrown...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021911 13f79535-47bb-0310-9956-ffa450edef68
2010-10-12 20:15:50 +00:00
Michael Stack 9c67949638 HBASE-3104 Disable TestMultiClusters; it doesn't really test anything and HBaseTestingUtility needs more work for this to pass anyways
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021860 13f79535-47bb-0310-9956-ffa450edef68
2010-10-12 17:55:11 +00:00
Michael Stack c32f663c07 Change test max run time from 3600 to 900 seconds, up memory for forked tests, also enable assertions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021796 13f79535-47bb-0310-9956-ffa450edef68
2010-10-12 15:18:16 +00:00
Michael Stack e695ef3cd0 More fixup for hbase merge tool -- test for master being offline
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021791 13f79535-47bb-0310-9956-ffa450edef68
2010-10-12 15:06:15 +00:00
Michael Stack d405dbeca6 Add shutdown of clusters -- not shutting down was causing subsequent TestMergeTool to fail because there was running zk
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021789 13f79535-47bb-0310-9956-ffa450edef68
2010-10-12 15:01:48 +00:00
Michael Stack fc32ccdb2b Better message on assertion failure (looking at logs, this test should have passed)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021774 13f79535-47bb-0310-9956-ffa450edef68
2010-10-12 13:47:57 +00:00
Jean-Daniel Cryans 5ccf27683b HBASE-3060 [replication] Reenable replication on trunk with unit tests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021447 13f79535-47bb-0310-9956-ffa450edef68
2010-10-11 18:00:48 +00:00
Michael Stack 999cb8af7c If waiting on a balance, after each unsuccessful attempt, call balancer in case it hasn't been run (Fail on hudson of build #1532 looks to be a postponed balance and then wait on a balance that would never come
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021385 13f79535-47bb-0310-9956-ffa450edef68
2010-10-11 15:30:58 +00:00
Michael Stack 50430b219c Remove mistaken import
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021307 13f79535-47bb-0310-9956-ffa450edef68
2010-10-11 11:18:46 +00:00
Michael Stack fb3e4766d2 Logging to see if can figure why the TestTableInputFormatScan failures up on hudson
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021237 13f79535-47bb-0310-9956-ffa450edef68
2010-10-11 03:38:26 +00:00
Michael Stack c80154014b Temporarily changing rpc version back to 25... TestTableMapReduce is failing because client is 26 but master is version 25?
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021236 13f79535-47bb-0310-9956-ffa450edef68
2010-10-11 03:37:35 +00:00
Michael Stack 83782f16d6 Note some resolved issues
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1006350 13f79535-47bb-0310-9956-ffa450edef68
2010-10-10 21:00:49 +00:00
Michael Stack d3f3ccee7a Fix NPE in TestCatalogTracker up on hudson; removed toString on HConnection
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1006344 13f79535-47bb-0310-9956-ffa450edef68
2010-10-10 19:36:31 +00:00
Michael Stack 9d3bb109db HBASE-3098 TestMetaReaderEditor is broken in TRUNK; hangs; Add cleanup of old tests dir to HBaseClusterTestCase -- we are reading old zk data on occasion
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1006253 13f79535-47bb-0310-9956-ffa450edef68
2010-10-10 06:48:48 +00:00
Michael Stack 924f28e5c3 HBASE-3098 TestMetaReaderEditor is broken in TRUNK; hangs; part2 of the patch
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1006252 13f79535-47bb-0310-9956-ffa450edef68
2010-10-10 06:04:59 +00:00
Michael Stack 52bbd22187 HBASE-3100 TestMergeTable failing in TRUNK
M src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
  Some fixup to support stepped start up of mini cluster; allow
  starting dfs cluster, then later put an hbase mini cluster on top.
  (startMiniHBaseCluster, createRootDir): Added. 
D src/test/java/org/apache/hadoop/hbase/AbstractMergeTestBase.java
  Removed messy subclass of HBaseClusterTestCase used building
  up some specific loaded regions.  Replaced with utility added
  to HBaseTestingUtility and by methods added to specific test.
D src/test/java/org/apache/hadoop/hbase/util/TestMergeMeta.java
  Deleted test that did nothing -- test merging of .META. -- but
  the superclass was making user regions, not multiple instances
  of .META. -- which we don't support anyways currently.
M src/test/java/org/apache/hadoop/hbase/util/TestMergeTable.java
  Rewritten to use HBaseTestingUtility.  Also added assertions that
  it actually did successful merge (Were none previous).
M src/main/java/org/apache/hadoop/hbase/catalog/CatalogTracker.java
  Added a new constructor.  Are the others redundant given I just
  added implementation of Abortable to HConnection interface (the
  implmementation of HConnection used implement it -- I've just
  moved it up into the Interface itself).
M src/main/java/org/apache/hadoop/hbase/util/HMerge.java
  Bit of minor cleanup refactoring.
M src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java
  The HConnection Interface now implements Abortable.
M src/main/java/org/apache/hadoop/hbase/client/HConnection.java
  Extend Abortable (The implementation was implementing Abortable
  anyways).


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1006219 13f79535-47bb-0310-9956-ffa450edef68
2010-10-09 19:23:36 +00:00
Michael Stack 71d6b124dd HBASE-3062 ZooKeeper KeeperException is a recoverable exception; we should retry a while on server startup at least.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1006202 13f79535-47bb-0310-9956-ffa450edef68
2010-10-09 17:55:33 +00:00
Michael Stack b7f3cfbf05 HBASE-3098 TestMetaReaderEditor is broken in TRUNK; hangs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1006107 13f79535-47bb-0310-9956-ffa450edef68
2010-10-09 03:46:52 +00:00
Michael Stack 9b166c9e33 HBASE-3089 REST tests are broken locally and up in hudson; some minor changes that should have been included on last commit
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1006065 13f79535-47bb-0310-9956-ffa450edef68
2010-10-08 22:50:40 +00:00
Michael Stack d46e5634a3 HBASE-3094 Fixes for miscellaneous broken tests
M src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
  Added passing a Configuration to createTable.
M src/test/java/org/apache/hadoop/hbase/HBaseClusterTestCase.java
  Make a new configuration each time we create a cluster else this
  old testing utility fails when we do restart in middle of a test
  suite using this old stuff.
M src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
  Fixed imports.
M src/test/java/org/apache/hadoop/hbase/MiniHBaseCluster.java
  Added catch for other than IOE... shutdown if anything thrown.
M src/test/java/org/apache/hadoop/hbase/master/TestCatalogJanitor.java
  This test was for sure horked.  Fixed it so we were testing
  the javadoc description of how its supposed to work.
M src/test/java/org/apache/hadoop/hbase/master/TestDeadServer.java
  Another test that just wasn't working -- couldn't have worked on
  commit.
M src/test/java/org/apache/hadoop/hbase/master/TestLoadBalancer.java
  Must have resolvable host (How did this test ever work)?
M src/test/java/org/apache/hadoop/hbase/client/TestGetRowVersions.java
   Fixup to make this test pass.  New Configuration after cluster restart.
M src/test/java/org/apache/hadoop/hbase/client/TestScannerTimeout.java
  Fixup to make this test pass.  The low scanner timeout was stopping
  this test from even starting up.
M src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java
  Use new method from HTU.
M src/main/java/org/apache/hadoop/hbase/regionserver/SplitTransaction.java
  If passed server is null, we are in test mode.
M src/main/java/org/apache/hadoop/hbase/catalog/CatalogTracker.java
  Catch other dropped connection exception types when trying to prove
  we have a good root/meta address.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005990 13f79535-47bb-0310-9956-ffa450edef68
2010-10-08 19:45:11 +00:00
Michael Stack 449fd9aa94 HBASE-3092 Replace deprecated 'new HBaseConfiguration(...)' calls
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005936 13f79535-47bb-0310-9956-ffa450edef68
2010-10-08 18:03:03 +00:00
Michael Stack 50b3582e33 HBASE-3074 Zookeeper test failing on hudson; forgot this change
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005715 13f79535-47bb-0310-9956-ffa450edef68
2010-10-08 06:06:17 +00:00
Michael Stack ff2d19229f HBASE-3074 Zookeeper test failing on hudson
HConnections go stale if miniCluster is shutdown on them.  Make it
so we make new HConnections on other side of a new cluster spin up.
Was cause for failing of last few tests.

M src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
  So if you shutdown a cluster and you have HConnections that were
  made using the HTUs Configuration, they'll all be stale --
  session expired -- and won't be of any use connecting to new cluster
  that comes up... now that HConnection is first class dependent on
  its own ZooKeeperWatcher instance.
  So, I went through this class and fixed it up so we use new
  Configurations when could be called either side of a mini cluster
  restart.  Added note to getConfiguration to be careful what you
  do with it because Configuration makes for an HConnection.
M src/test/java/org/apache/hadoop/hbase/TestZooKeeper.java
  Don't use same Configuration everywhere.
M src/test/java/org/apache/hadoop/hbase/master/TestRestartCluster.java
  Make new Configuration when we make new Cluster so we get fresh
  HConnection -- not one w/ stale data, disconnected.
M src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
  Check that new server that comes in on a regionServerReport
  doesn't have same port and host as one we have already registered
  as we do in reportForDuty call (This is preemtive bug fix).
M src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java
  Save of an identifier for HCM and use it in log messages, particularly
  when we close -- helps debugging.
M src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
  getConfiguration added.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005714 13f79535-47bb-0310-9956-ffa450edef68
2010-10-08 06:04:35 +00:00
Michael Stack d65d011907 HBASE-3091 Fix TestKillingServersFromMaster in TRUNK; it just hangs since new master went in
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005713 13f79535-47bb-0310-9956-ffa450edef68
2010-10-08 05:49:01 +00:00
Michael Stack c4d59d99dd HBASE-3074 Zookeeper test failing on hudson
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005691 13f79535-47bb-0310-9956-ffa450edef68
2010-10-08 01:13:55 +00:00
Michael Stack 8570a6af09 HBASE-3089 REST tests are broken locally and up in hudson
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005660 13f79535-47bb-0310-9956-ffa450edef68
2010-10-07 22:54:28 +00:00
Michael Stack 58423039df HBASE-3088 TestAvroServer and TestThriftServer broken because use same table in all tests and tests enable/disable/delete
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005552 13f79535-47bb-0310-9956-ffa450edef68
2010-10-07 18:13:04 +00:00
Andrew Kyle Purtell a6afa7b49f HBASE-2907 [rest/stargate] Improve error response when trying to create a scanner on a nonexistant table
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005279 13f79535-47bb-0310-9956-ffa450edef68
2010-10-06 22:28:58 +00:00
Jonathan Gray b2bff276ab HBASE-3053 Add ability to have multiple Masters LocalHBaseCluster for test writing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005263 13f79535-47bb-0310-9956-ffa450edef68
2010-10-06 21:39:11 +00:00
Ryan Rawson 1e14da3d78 HBASE-3008 Memstore.updateColumnValue passes wrong flag to heapSizeChange (Causes memstore size to go negative)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005261 13f79535-47bb-0310-9956-ffa450edef68
2010-10-06 21:27:16 +00:00