Commit Graph

2202 Commits

Author SHA1 Message Date
Michael Stack dcbcd4f2d4 HBASE-3113 Don't reassign regions if cluster is being shutdown
M src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
  Bit of javadoc.
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
  If bad server, pass in name of bad server when remaking assignment
  plan -- i missed this important part on commit of part 2 of 3113.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1023179 13f79535-47bb-0310-9956-ffa450edef68
2010-10-16 05:07:50 +00:00
Michael Stack 509beae1e2 HBASE-3113 Don't reassign regions if cluster is being shutdown; part 2 -- fix wrongly named exception and let out IOEs when opening regions on RS
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1023115 13f79535-47bb-0310-9956-ffa450edef68
2010-10-15 21:22:38 +00:00
Michael Stack 349b7a74c8 HBASE-3104 Disable TestMultiClusters; it doesn't really test anything and HBaseTestingUtility needs more work for this to pass anyways -- just remove this class altogether
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1023109 13f79535-47bb-0310-9956-ffa450edef68
2010-10-15 20:52:20 +00:00
Michael Stack e20615b917 HBASE-3113 Don't reassign regions if cluster is being shutdown; part 2
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1023107 13f79535-47bb-0310-9956-ffa450edef68
2010-10-15 20:46:13 +00:00
Michael Stack ef94177cd9 Remove debugging IOE throw
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1023102 13f79535-47bb-0310-9956-ffa450edef68
2010-10-15 20:36:23 +00:00
Michael Stack 954efa6e76 HBASE-3111 TestTableMapReduce broken up on hudson
M src/main/java/org/apache/hadoop/hbase/zookeeper/ZKUtil.java
  Changed mentions of 'quorum' to 'ensemble'.
M src/main/java/org/apache/hadoop/hbase/mapreduce/IdentityTableReducer.java
M src/main/java/org/apache/hadoop/hbase/mapreduce/TableInputFormat.java
  Minor formatting.
M src/main/java/org/apache/hadoop/hbase/mapreduce/TableInputFormatBase.java
  Removed unused imports and minor formatting.
M src/main/java/org/apache/hadoop/hbase/mapreduce/TableMapReduceUtil.java
  Documented what the quorumAddress parameter is for.
  Removed an unnecessary looking HBaseConfiguration.addHbaseResources(conf);
  (and adjusted documentation of job to say no hbase config set by the
  reduce setup method).
M src/main/java/org/apache/hadoop/hbase/mapreduce/TableOutputFormat.java
  Made this class implment Configurable.  Moved creation of table from
  RecordWrite constructor based off passed TaskAttemptContext instead
  into the new setConf method.  Added table and conf data members.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022825 13f79535-47bb-0310-9956-ffa450edef68
2010-10-15 05:33:11 +00:00
Jean-Daniel Cryans a5a00687ef HBASE-3041 [replication] ReplicationSink shouldn't kill the whole RS when
it fails to replicate
HBASE-3044  [replication] ReplicationSource won't cleanup logs if there's 
            nothing to replicate


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022770 13f79535-47bb-0310-9956-ffa450edef68
2010-10-14 23:52:49 +00:00
Michael Stack bcaa2dea49 HBASE-3113 Don't reassign regions if cluster is being shutdown
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022760 13f79535-47bb-0310-9956-ffa450edef68
2010-10-14 23:10:09 +00:00
Michael Stack da3cc25adb Commenting out the disable/enable/disable swerve in this test for now until we address hbase-3112
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022645 13f79535-47bb-0310-9956-ffa450edef68
2010-10-14 18:47:57 +00:00
Michael Stack cd2bfd5b6a HBASE-3111 TestTableMapReduce broken up on hudson; Attempted fix
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022381 13f79535-47bb-0310-9956-ffa450edef68
2010-10-14 05:58:54 +00:00
Michael Stack 3d75d323e5 HBASE-3110 TestReplicationSink failing in TRUNK up on Hudson; trying to see if this fixes this test
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022372 13f79535-47bb-0310-9956-ffa450edef68
2010-10-14 04:11:55 +00:00
Michael Stack b15d5425b9 Needed to change the zk port elsewhere too to make default 21818 rather than 21810; and still further places
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022300 13f79535-47bb-0310-9956-ffa450edef68
2010-10-13 21:36:51 +00:00
Michael Stack 1973b02b94 Needed to change the zk port elsewhere too to make default 21818 rather than 21810
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022276 13f79535-47bb-0310-9956-ffa450edef68
2010-10-13 20:06:29 +00:00
Michael Stack 7c8411d06a Upping pom memory and changing zk default port to help debug; on first, no harm in letting heap grow and on second, there seems to be errant zk cluster running on hudson ... trying to see if tests generate it when run clean
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022263 13f79535-47bb-0310-9956-ffa450edef68
2010-10-13 19:45:43 +00:00
Michael Stack 0fcd520eb3 HBASE-3100 add timeout to TestMergeTable and try another config to prevent splits
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022189 13f79535-47bb-0310-9956-ffa450edef68
2010-10-13 17:04:53 +00:00
Michael Stack 25ae7a7b20 HBASE-3100 stop splitting in TestMergeTable, and add debug
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1022003 13f79535-47bb-0310-9956-ffa450edef68
2010-10-13 05:39:11 +00:00
Michael Stack 8dc8fea2f3 HBASE-3105 Scan.toString fails to escape binary start/stop rows
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021912 13f79535-47bb-0310-9956-ffa450edef68
2010-10-12 20:18:12 +00:00
Michael Stack c189e8e967 Get more detail on undeclared exception thrown...
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021911 13f79535-47bb-0310-9956-ffa450edef68
2010-10-12 20:15:50 +00:00
Michael Stack 9c67949638 HBASE-3104 Disable TestMultiClusters; it doesn't really test anything and HBaseTestingUtility needs more work for this to pass anyways
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021860 13f79535-47bb-0310-9956-ffa450edef68
2010-10-12 17:55:11 +00:00
Michael Stack e695ef3cd0 More fixup for hbase merge tool -- test for master being offline
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021791 13f79535-47bb-0310-9956-ffa450edef68
2010-10-12 15:06:15 +00:00
Michael Stack d405dbeca6 Add shutdown of clusters -- not shutting down was causing subsequent TestMergeTool to fail because there was running zk
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021789 13f79535-47bb-0310-9956-ffa450edef68
2010-10-12 15:01:48 +00:00
Michael Stack fc32ccdb2b Better message on assertion failure (looking at logs, this test should have passed)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021774 13f79535-47bb-0310-9956-ffa450edef68
2010-10-12 13:47:57 +00:00
Jean-Daniel Cryans 5ccf27683b HBASE-3060 [replication] Reenable replication on trunk with unit tests
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021447 13f79535-47bb-0310-9956-ffa450edef68
2010-10-11 18:00:48 +00:00
Michael Stack 999cb8af7c If waiting on a balance, after each unsuccessful attempt, call balancer in case it hasn't been run (Fail on hudson of build #1532 looks to be a postponed balance and then wait on a balance that would never come
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021385 13f79535-47bb-0310-9956-ffa450edef68
2010-10-11 15:30:58 +00:00
Michael Stack 50430b219c Remove mistaken import
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021307 13f79535-47bb-0310-9956-ffa450edef68
2010-10-11 11:18:46 +00:00
Michael Stack fb3e4766d2 Logging to see if can figure why the TestTableInputFormatScan failures up on hudson
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021237 13f79535-47bb-0310-9956-ffa450edef68
2010-10-11 03:38:26 +00:00
Michael Stack c80154014b Temporarily changing rpc version back to 25... TestTableMapReduce is failing because client is 26 but master is version 25?
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1021236 13f79535-47bb-0310-9956-ffa450edef68
2010-10-11 03:37:35 +00:00
Michael Stack d3f3ccee7a Fix NPE in TestCatalogTracker up on hudson; removed toString on HConnection
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1006344 13f79535-47bb-0310-9956-ffa450edef68
2010-10-10 19:36:31 +00:00
Michael Stack 9d3bb109db HBASE-3098 TestMetaReaderEditor is broken in TRUNK; hangs; Add cleanup of old tests dir to HBaseClusterTestCase -- we are reading old zk data on occasion
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1006253 13f79535-47bb-0310-9956-ffa450edef68
2010-10-10 06:48:48 +00:00
Michael Stack 924f28e5c3 HBASE-3098 TestMetaReaderEditor is broken in TRUNK; hangs; part2 of the patch
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1006252 13f79535-47bb-0310-9956-ffa450edef68
2010-10-10 06:04:59 +00:00
Michael Stack 52bbd22187 HBASE-3100 TestMergeTable failing in TRUNK
M src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
  Some fixup to support stepped start up of mini cluster; allow
  starting dfs cluster, then later put an hbase mini cluster on top.
  (startMiniHBaseCluster, createRootDir): Added. 
D src/test/java/org/apache/hadoop/hbase/AbstractMergeTestBase.java
  Removed messy subclass of HBaseClusterTestCase used building
  up some specific loaded regions.  Replaced with utility added
  to HBaseTestingUtility and by methods added to specific test.
D src/test/java/org/apache/hadoop/hbase/util/TestMergeMeta.java
  Deleted test that did nothing -- test merging of .META. -- but
  the superclass was making user regions, not multiple instances
  of .META. -- which we don't support anyways currently.
M src/test/java/org/apache/hadoop/hbase/util/TestMergeTable.java
  Rewritten to use HBaseTestingUtility.  Also added assertions that
  it actually did successful merge (Were none previous).
M src/main/java/org/apache/hadoop/hbase/catalog/CatalogTracker.java
  Added a new constructor.  Are the others redundant given I just
  added implementation of Abortable to HConnection interface (the
  implmementation of HConnection used implement it -- I've just
  moved it up into the Interface itself).
M src/main/java/org/apache/hadoop/hbase/util/HMerge.java
  Bit of minor cleanup refactoring.
M src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java
  The HConnection Interface now implements Abortable.
M src/main/java/org/apache/hadoop/hbase/client/HConnection.java
  Extend Abortable (The implementation was implementing Abortable
  anyways).


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1006219 13f79535-47bb-0310-9956-ffa450edef68
2010-10-09 19:23:36 +00:00
Michael Stack 71d6b124dd HBASE-3062 ZooKeeper KeeperException is a recoverable exception; we should retry a while on server startup at least.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1006202 13f79535-47bb-0310-9956-ffa450edef68
2010-10-09 17:55:33 +00:00
Michael Stack b7f3cfbf05 HBASE-3098 TestMetaReaderEditor is broken in TRUNK; hangs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1006107 13f79535-47bb-0310-9956-ffa450edef68
2010-10-09 03:46:52 +00:00
Michael Stack 9b166c9e33 HBASE-3089 REST tests are broken locally and up in hudson; some minor changes that should have been included on last commit
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1006065 13f79535-47bb-0310-9956-ffa450edef68
2010-10-08 22:50:40 +00:00
Michael Stack d46e5634a3 HBASE-3094 Fixes for miscellaneous broken tests
M src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
  Added passing a Configuration to createTable.
M src/test/java/org/apache/hadoop/hbase/HBaseClusterTestCase.java
  Make a new configuration each time we create a cluster else this
  old testing utility fails when we do restart in middle of a test
  suite using this old stuff.
M src/test/java/org/apache/hadoop/hbase/regionserver/TestHRegion.java
  Fixed imports.
M src/test/java/org/apache/hadoop/hbase/MiniHBaseCluster.java
  Added catch for other than IOE... shutdown if anything thrown.
M src/test/java/org/apache/hadoop/hbase/master/TestCatalogJanitor.java
  This test was for sure horked.  Fixed it so we were testing
  the javadoc description of how its supposed to work.
M src/test/java/org/apache/hadoop/hbase/master/TestDeadServer.java
  Another test that just wasn't working -- couldn't have worked on
  commit.
M src/test/java/org/apache/hadoop/hbase/master/TestLoadBalancer.java
  Must have resolvable host (How did this test ever work)?
M src/test/java/org/apache/hadoop/hbase/client/TestGetRowVersions.java
   Fixup to make this test pass.  New Configuration after cluster restart.
M src/test/java/org/apache/hadoop/hbase/client/TestScannerTimeout.java
  Fixup to make this test pass.  The low scanner timeout was stopping
  this test from even starting up.
M src/test/java/org/apache/hadoop/hbase/client/TestFromClientSide.java
  Use new method from HTU.
M src/main/java/org/apache/hadoop/hbase/regionserver/SplitTransaction.java
  If passed server is null, we are in test mode.
M src/main/java/org/apache/hadoop/hbase/catalog/CatalogTracker.java
  Catch other dropped connection exception types when trying to prove
  we have a good root/meta address.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005990 13f79535-47bb-0310-9956-ffa450edef68
2010-10-08 19:45:11 +00:00
Michael Stack 449fd9aa94 HBASE-3092 Replace deprecated 'new HBaseConfiguration(...)' calls
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005936 13f79535-47bb-0310-9956-ffa450edef68
2010-10-08 18:03:03 +00:00
Michael Stack 50b3582e33 HBASE-3074 Zookeeper test failing on hudson; forgot this change
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005715 13f79535-47bb-0310-9956-ffa450edef68
2010-10-08 06:06:17 +00:00
Michael Stack ff2d19229f HBASE-3074 Zookeeper test failing on hudson
HConnections go stale if miniCluster is shutdown on them.  Make it
so we make new HConnections on other side of a new cluster spin up.
Was cause for failing of last few tests.

M src/test/java/org/apache/hadoop/hbase/HBaseTestingUtility.java
  So if you shutdown a cluster and you have HConnections that were
  made using the HTUs Configuration, they'll all be stale --
  session expired -- and won't be of any use connecting to new cluster
  that comes up... now that HConnection is first class dependent on
  its own ZooKeeperWatcher instance.
  So, I went through this class and fixed it up so we use new
  Configurations when could be called either side of a mini cluster
  restart.  Added note to getConfiguration to be careful what you
  do with it because Configuration makes for an HConnection.
M src/test/java/org/apache/hadoop/hbase/TestZooKeeper.java
  Don't use same Configuration everywhere.
M src/test/java/org/apache/hadoop/hbase/master/TestRestartCluster.java
  Make new Configuration when we make new Cluster so we get fresh
  HConnection -- not one w/ stale data, disconnected.
M src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
  Check that new server that comes in on a regionServerReport
  doesn't have same port and host as one we have already registered
  as we do in reportForDuty call (This is preemtive bug fix).
M src/main/java/org/apache/hadoop/hbase/client/HConnectionManager.java
  Save of an identifier for HCM and use it in log messages, particularly
  when we close -- helps debugging.
M src/main/java/org/apache/hadoop/hbase/client/HBaseAdmin.java
  getConfiguration added.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005714 13f79535-47bb-0310-9956-ffa450edef68
2010-10-08 06:04:35 +00:00
Michael Stack d65d011907 HBASE-3091 Fix TestKillingServersFromMaster in TRUNK; it just hangs since new master went in
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005713 13f79535-47bb-0310-9956-ffa450edef68
2010-10-08 05:49:01 +00:00
Michael Stack c4d59d99dd HBASE-3074 Zookeeper test failing on hudson
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005691 13f79535-47bb-0310-9956-ffa450edef68
2010-10-08 01:13:55 +00:00
Michael Stack 8570a6af09 HBASE-3089 REST tests are broken locally and up in hudson
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005660 13f79535-47bb-0310-9956-ffa450edef68
2010-10-07 22:54:28 +00:00
Michael Stack 58423039df HBASE-3088 TestAvroServer and TestThriftServer broken because use same table in all tests and tests enable/disable/delete
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005552 13f79535-47bb-0310-9956-ffa450edef68
2010-10-07 18:13:04 +00:00
Andrew Kyle Purtell a6afa7b49f HBASE-2907 [rest/stargate] Improve error response when trying to create a scanner on a nonexistant table
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005279 13f79535-47bb-0310-9956-ffa450edef68
2010-10-06 22:28:58 +00:00
Jonathan Gray b2bff276ab HBASE-3053 Add ability to have multiple Masters LocalHBaseCluster for test writing
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005263 13f79535-47bb-0310-9956-ffa450edef68
2010-10-06 21:39:11 +00:00
Ryan Rawson 1e14da3d78 HBASE-3008 Memstore.updateColumnValue passes wrong flag to heapSizeChange (Causes memstore size to go negative)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005261 13f79535-47bb-0310-9956-ffa450edef68
2010-10-06 21:27:16 +00:00
Michael Stack 3745672d94 Yet more debug for baffling zk test failure up on hudson
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005238 13f79535-47bb-0310-9956-ffa450edef68
2010-10-06 20:32:30 +00:00
Andrew Kyle Purtell 38641ec196 HBASE-2906 [rest/stargate] URI decoding in RowResource
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1005175 13f79535-47bb-0310-9956-ffa450edef68
2010-10-06 17:21:32 +00:00
Ryan Rawson de39f4328d HBASE-3073 Build fix
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1004890 13f79535-47bb-0310-9956-ffa450edef68
2010-10-06 04:00:33 +00:00
Ryan Rawson 723b6709fa HBASE-3059 TestReadWriteConsistencyControl occasionally hangs (Hairong via Ryan)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1004867 13f79535-47bb-0310-9956-ffa450edef68
2010-10-06 00:59:07 +00:00
Ryan Rawson 1ef046250f HBASE-3073 New APIs for Result, faster implementation for some calls
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1004866 13f79535-47bb-0310-9956-ffa450edef68
2010-10-06 00:44:21 +00:00
Michael Stack 66a4faa7b0 HBASE-3085 TestSchemaResource broken on TRUNK up on HUDSON
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1004860 13f79535-47bb-0310-9956-ffa450edef68
2010-10-06 00:02:22 +00:00
Jean-Daniel Cryans 24a3e3e5ef Updating site for 0.89.20100924
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1004769 13f79535-47bb-0310-9956-ffa450edef68
2010-10-05 19:07:27 +00:00
Michael Stack fc72345b47 Only assign if table is enabled -- fixes TestHFileOutputFormat
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1004699 13f79535-47bb-0310-9956-ffa450edef68
2010-10-05 16:25:01 +00:00
Michael Stack 83470f981a HBASE-3080 TestAdmin hanging on hudson
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1004525 13f79535-47bb-0310-9956-ffa450edef68
2010-10-05 05:03:22 +00:00
Michael Stack a246cbbd6c Adding even more logging to figure why we're reading old root region location though its been updated in zk -- for failing TestZooKeeper
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1004479 13f79535-47bb-0310-9956-ffa450edef68
2010-10-04 23:03:21 +00:00
Michael Stack f363062641 Add wait on disable to complete to TestHFileOutputFormat by watching regions in transition...; seems to fix unit test
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1004474 13f79535-47bb-0310-9956-ffa450edef68
2010-10-04 23:01:16 +00:00
Michael Stack 77dc443fc1 Adding even more logging to figure why we're reading old root region location though its been updated in zk -- for failing TestZooKeeper
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1004464 13f79535-47bb-0310-9956-ffa450edef68
2010-10-04 22:39:33 +00:00
Michael Stack 83802d7f17 Adding even more logging to figure why we're reading old root region location though its been updated in zk -- for failing TestZooKeeper
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1004462 13f79535-47bb-0310-9956-ffa450edef68
2010-10-04 22:27:40 +00:00
Michael Stack ea1268b468 HBASE-2646 Compaction requests should be prioritized to prevent blocking; applied addendum 2464-fix-race-condition-r1004349.txt
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1004371 13f79535-47bb-0310-9956-ffa450edef68
2010-10-04 19:25:42 +00:00
Michael Stack 18d7fff188 HBASE-3043 'hbase-daemon.sh stop regionserver' should kill compactions that are in progress
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1004340 13f79535-47bb-0310-9956-ffa450edef68
2010-10-04 17:59:38 +00:00
Michael Stack 03873bbe19 HBASE-2996 Fix and clean up Maven
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1004093 13f79535-47bb-0310-9956-ffa450edef68
2010-10-04 03:19:26 +00:00
Michael Stack fdecc9dd9b Commit extra logging to help diagnoze zk test failure on hudson
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1004019 13f79535-47bb-0310-9956-ffa450edef68
2010-10-03 18:13:53 +00:00
Michael Stack b70e4b83c1 HBASE-3063 TestThriftServer failing in TRUNK; trying this patch to see if it helps
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003921 13f79535-47bb-0310-9956-ffa450edef68
2010-10-03 05:06:06 +00:00
Michael Stack 8ff999cf9a HBASE-3074 Zookeeper test failing on hudson; xtra debugging to help figure whats happening up on hudson
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003919 13f79535-47bb-0310-9956-ffa450edef68
2010-10-02 23:48:00 +00:00
Ryan Rawson aacffa11d0 HBASE-2753 Remove sorted() methods from Result now that Gets are Scans
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003710 13f79535-47bb-0310-9956-ffa450edef68
2010-10-01 23:48:10 +00:00
Michael Stack d62b494cb5 HBASE-3064 Long sleeping in HConnectionManager after thread is interrupted
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003709 13f79535-47bb-0310-9956-ffa450edef68
2010-10-01 23:43:46 +00:00
Michael Stack 3161a555e1 HBASE-3070 Add to hbaseadmin means of shutting down a regionserver
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003702 13f79535-47bb-0310-9956-ffa450edef68
2010-10-01 23:15:38 +00:00
Michael Stack dd39498ce4 HBASE-3068 IllegalStateException when new server comes online, is given 200 regions to open and 200th region gets timed out of regions in transition
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003699 13f79535-47bb-0310-9956-ffa450edef68
2010-10-01 23:02:18 +00:00
Ryan Rawson e5c4776af9 HBASE-2825 Scans respect row locks
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003698 13f79535-47bb-0310-9956-ffa450edef68
2010-10-01 22:46:15 +00:00
Michael Stack 7bb6f3839c HBASE-3066 We don't put the port for hregionserver up into znode since new master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003644 13f79535-47bb-0310-9956-ffa450edef68
2010-10-01 20:44:36 +00:00
Michael Stack 94682d09d3 HBASE-3019 Make bulk assignment on cluster startup run faster
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003330 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 23:12:56 +00:00
Jonathan Gray 78f75e6c7f HBASE-3060 Disabling test until it gets fixed (part 2)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003318 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 22:09:29 +00:00
Jonathan Gray 2d8fb6f26c HBASE-3060 Disabling test until it gets fixed
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003305 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 21:48:33 +00:00
Jonathan Gray 69d1258e12 HBASE-3058 Fix REST tests on trunk
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003256 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 20:58:07 +00:00
Jonathan Gray 8863ae5a0e HBASE-3057 Race condition when closing regions that causes flakiness in TestRestartCluster
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003204 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 18:53:20 +00:00
Jonathan Gray d2ce2b36e0 HBASE-3056 Fix ordering in ZKWatcher constructor to prevent weird race condition
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003196 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 18:22:28 +00:00
Jonathan Gray 7ce5812dfe Small fix to TestFullLogReconstruction to make it pass
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003182 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 17:53:24 +00:00
Michael Stack f6743a1b75 Small fix for failing TestMasterAddressManager
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002943 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 04:17:42 +00:00
Michael Stack 08fad6672e Disable test failing because its dependent on replication working with new master -- not yet done
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002942 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 04:14:03 +00:00
Michael Stack 7ca978123f HBASE-3054 Remore TestEmptyMetaInfo; it doesn't make sense any more.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002941 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 03:42:58 +00:00
Michael Stack 58c4f2df98 HBASE-3047 If new master crashes, restart is messy
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002880 13f79535-47bb-0310-9956-ffa450edef68
2010-09-29 22:37:50 +00:00
Michael Stack 4d25275040 HBASE-3038 WALReaderFSDataInputStream.getPos() fails if Filesize > MAX_INT; addendum
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002348 13f79535-47bb-0310-9956-ffa450edef68
2010-09-28 20:38:12 +00:00
Michael Stack 1334d5187b HBASE-3040 BlockIndex readIndex too slowly in heavy write scenario; add in fix to address kannan review
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002310 13f79535-47bb-0310-9956-ffa450edef68
2010-09-28 18:29:53 +00:00
Michael Stack d3a8c97ad8 HBASE-3038 WALReaderFSDataInputStream.getPos() fails if Filesize > MAX_INT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002027 13f79535-47bb-0310-9956-ffa450edef68
2010-09-28 05:55:51 +00:00
Michael Stack 8032206236 HBASE-2646 Compaction requests should be prioritized to prevent blocking; remove of hbase-3038 added by mistake
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002020 13f79535-47bb-0310-9956-ffa450edef68
2010-09-28 05:29:29 +00:00
Michael Stack f4ac670a42 HBASE-2646 Compaction requests should be prioritized to prevent blocking
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002019 13f79535-47bb-0310-9956-ffa450edef68
2010-09-28 05:26:22 +00:00
Michael Stack 5affba7171 HBASE-2641 Refactor HLog splitLog, hbase-2437 continued; break out split code as new classes
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001969 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 23:52:46 +00:00
Michael Stack 7faaf57d1b HBASE-3030 The return code of many filesystem operations are not checked
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001954 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 23:02:52 +00:00
Michael Stack b11ac8d6f5 HBASE-3040 BlockIndex readIndex too slowly in heavy write scenario
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001949 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 22:53:26 +00:00
Jonathan Gray 4f545ea09c Attempting to fix TestHeapSize on Hudson (align array heapsize)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001944 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 22:43:59 +00:00
Michael Stack 9069ed1ac6 HBASE-2995 Incorrect dependency on Log class from Jetty
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001936 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 22:18:28 +00:00
Michael Stack aff46efe9e HBASE-3042 Use LO4J in SequenceFileLogReader
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001928 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 22:09:51 +00:00
Michael Stack 823cfeac9c HBASE-2641 Refactor HLog splitLog, hbase-2437 continued; break out split code as new classes
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001924 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 22:02:23 +00:00
Michael Stack 10a84f3b88 HBASE-3039 Stuck in regionsInTransition because rebalance came in at same time as a split
M src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
  Add region name to warning log message (w/o it message is no good).
M src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
  Add src of split message else need to deduce where it came from by looking
  elsewhere.
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
  Updated log messages to include region and where appropritate source
  server name; debug hard w/o
  Changed regionOnline and regionOffline to check for unexpected
  states and log warnings rather than proceed regardless.
  Added in fix for concurrent balance+split; split message now
  updates regionsintransition where previous it did not.
  Remove checkRegion method.  Its a reimplementation of
  what regionOnline and regionOffline do only less comprehensive
  regards what gets updated (this.regions + this.servers rather
  than this.regions, this.servers and regionsInTransition)
  That they were less comprehensive is root of this bug.
M src/main/java/org/apache/hadoop/hbase/master/HMaster.java
  Make the message about why we are not running balancer richer
  (print out how many reigons in transition and more of the
  regionsintrnasition list).
M src/main/java/org/apache/hadoop/hbase/executor/RegionTransitionData.java
  Javadoc and minor formatting.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001911 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 21:02:04 +00:00
Michael Stack 5efa0ba9c9 Added note on hlog tool, that it can be used to look at files in recovered edits file
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001907 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 20:58:26 +00:00
Michael Stack 1339f395d6 HBASE-3037 When new master joins running cluster does "Received report from unknown server -- telling it to STOP_REGIONSERVER..."
M src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
 On regionServerReport, if we get a report from an 'unknown' regionserver,
 we used to tell it stop itself.  Now, if 'unknown' server AND
 this master did not start the cluster, its joining the cluster, then
 treat the report as a regionServerStart and register the incoming
 server rather than tell it shutdown.
M src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Pass the freshClusterStartup flag to ServerManager.
 Add more executors for opening and closing.  On cluster startup a
 master shouldn't be bottleneck clearning the server opens.
 Expose the run-balancer method so can make it available in
 ServeAdmin.
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
 Minor formatting and javadoc
M src/main/java/org/apache/hadoop/hbase/ipc/HBaseRPCProtocolVersion.java
 Upped rpc version number because of new balancer addition (and because
 we didn't do it when we put in new master).
M src/main/java/org/apache/hadoop/hbase/ipc/HMasterInterface.java
 Added balance method.
M src/main/resources/hbase-default.xml
 Change how ofter we check in from every 3 seconds to every 5 seconds.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001140 13f79535-47bb-0310-9956-ffa450edef68
2010-09-25 06:24:42 +00:00
Michael Stack e58ebc4830 HBASE-3036 avro tests failing up on hudson (pass locally) -- trying something, passing Configuration to HBaseImpl
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001062 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 20:40:41 +00:00
Jean-Daniel Cryans d4e9b8f4d9 HBASE-3033 [replication] ReplicationSink.replicateEntries improvements
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001061 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 20:37:44 +00:00
Jean-Daniel Cryans b05d9ac937 HBASE-2992 [replication] MalformedObjectNameException in ReplicationMetrics
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001016 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 18:34:42 +00:00
Jean-Daniel Cryans da611388b4 HBASE-2989 [replication] RSM won't cleanup after locking if 0 peers
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001014 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 18:32:26 +00:00
Michael Stack 4163b90a87 Fix broke TestHLogSplit test
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000966 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 16:59:42 +00:00
Michael Stack d988546130 Fix broke TestHLogSplit test
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000965 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 16:59:17 +00:00
Michael Stack 9ea9cba5b2 HBASE-3028 No basescanner means no GC'ing of split, offlined parent regions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000715 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 05:46:41 +00:00
Todd Lipcon 2ecdd83e0d HBASE-3002. Fix zookeepers.sh to work properly with strange JVM options
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000698 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 04:10:55 +00:00
Michael Stack a85ee11f3b HBASE-2889 Tool to look at HLogs -- parse and tail -f; fix for suppression of EOFEs by Nicolas
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000697 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 04:00:48 +00:00
Ryan Rawson 0f3c62e19b HBASE-2450 For single row reads of specific columns, seek to the first column in HFiles rather than start of (Pranav via Ryan, some Ryan)
HBASE-2916  Reseek directly to next column
HBASE-2959  Scanning always starts at the beginning of a row



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000276 13f79535-47bb-0310-9956-ffa450edef68
2010-09-22 23:51:55 +00:00
Ryan Rawson 2806d60cab HBASE-3003 ClassSize constants dont use 'final'
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000275 13f79535-47bb-0310-9956-ffa450edef68
2010-09-22 23:49:49 +00:00
Michael Stack 17da1d0369 HBASE-3001 Ship dependency jars to the cluster for all jobs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000261 13f79535-47bb-0310-9956-ffa450edef68
2010-09-22 22:16:23 +00:00
Michael Stack a46c74894f HBASE-3026 Fixup of missing daughters on split is too aggressive
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000133 13f79535-47bb-0310-9956-ffa450edef68
2010-09-22 18:42:41 +00:00
Michael Stack 0de40fe1b0 Inserted an email Ryan wrote the list on 'considerations sizing regions'
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000113 13f79535-47bb-0310-9956-ffa450edef68
2010-09-22 18:05:32 +00:00
Michael Stack af3bf8cad0 HBASE-3024 NPE processing server crash in MetaEditor.addDaughter
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999672 13f79535-47bb-0310-9956-ffa450edef68
2010-09-21 22:24:05 +00:00
Michael Stack 5fa3d69f66 HBASE-3023 NPE processing server crash in MetaReader. getServerUserRegions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999664 13f79535-47bb-0310-9956-ffa450edef68
2010-09-21 22:00:12 +00:00
Michael Stack ffedf2c58e HBASE-3022 Change format of enum messages in o.a.h.h.executor package
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999660 13f79535-47bb-0310-9956-ffa450edef68
2010-09-21 21:44:21 +00:00
Michael Stack 14d8fb2ab7 HBASE-3018 Bulk assignment on startup runs serially through the cluster servers assigning in bulk to one at a time
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
  Removed reentrant lock that spanned moving region into
  regionsintransition and the getting of lock on state object.  It
  was a bad idea.  I found it actually deadlocked.  It shouldn't be needed.
  The call to assign will fail if the state instance is not of the right
  'state' type.
  Run a thread per server parcelling out region assignments so we assign
  across the cluster concurrently rather than in series as we were doing.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999237 13f79535-47bb-0310-9956-ffa450edef68
2010-09-21 06:36:22 +00:00
Michael Stack 34f17faa5d HBASE-3017 More log pruning
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999154 13f79535-47bb-0310-9956-ffa450edef68
2010-09-20 22:43:25 +00:00
Michael Stack 4f0d6bc6be HBASE-3017 More log pruning
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999150 13f79535-47bb-0310-9956-ffa450edef68
2010-09-20 22:31:19 +00:00
Michael Stack 0cdd2c5eb7 HBASE-3017 More log pruning
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999143 13f79535-47bb-0310-9956-ffa450edef68
2010-09-20 22:25:54 +00:00
Michael Stack a3856ca945 HBASE-3017 More log pruning
M conf/log4j.properties
  Make ZKW log at INFO-level
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
  Log message cleanup.
M src/main/java/org/apache/hadoop/hbase/master/HMaster.java
  Remove excessive hostname+port qualifier on master for zk messages
M src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java
  Log message cleanup
M src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
  Format the ServerMonitor message.
M src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
  Remove excessive hostname on zk message id; just add port
M src/main/java/org/apache/hadoop/hbase/zookeeper/ZKAssign.java
  Cleanup of messages.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999057 13f79535-47bb-0310-9956-ffa450edef68
2010-09-20 19:04:41 +00:00
Michael Stack 7daffb3a42 HBASE-3015 recovered.edits files not deleted if it only contain edits that have already been flushed; hurts perf for all future opens of the region
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999046 13f79535-47bb-0310-9956-ffa450edef68
2010-09-20 18:43:13 +00:00
Michael Stack 3a6705b08b TestCompaction was hanging because it was blocking... up the multiplier so we don't block any more
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999017 13f79535-47bb-0310-9956-ffa450edef68
2010-09-20 17:35:05 +00:00
Michael Stack 467a0e726d HBASE-3016 Refactor zk logging in trunk; do less and and identifier to log messages to help debugging
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@998555 13f79535-47bb-0310-9956-ffa450edef68
2010-09-18 21:56:37 +00:00
Michael Stack 2dfce22970 Another attempt at fixing avro test -- I had time out for test too short
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@998552 13f79535-47bb-0310-9956-ffa450edef68
2010-09-18 21:32:35 +00:00
Michael Stack 46c53f1460 Fix failing avro test
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@998504 13f79535-47bb-0310-9956-ffa450edef68
2010-09-18 18:06:22 +00:00
Michael Stack d153ec95da HBASE-3010 Can't start/stop/start... cluster using new master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@998380 13f79535-47bb-0310-9956-ffa450edef68
2010-09-18 00:51:05 +00:00
Michael Stack e532293310 HBASE-3006 Reading compressed HFile blocks causes way too many DFS RPC calls severly impacting performance--Now add fix I intended, a spelling mistake in HFile
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997975 13f79535-47bb-0310-9956-ffa450edef68
2010-09-17 04:21:28 +00:00
Michael Stack 96f8cbe9e2 HBASE-3006 Reading compressed HFile blocks causes way too many DFS RPC calls severly impacting performance--Revert mistaken over commit
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997974 13f79535-47bb-0310-9956-ffa450edef68
2010-09-17 04:20:55 +00:00
Michael Stack cac06d4573 HBASE-3006 Reading compressed HFile blocks causes way too many DFS RPC calls severly impacting performance
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997973 13f79535-47bb-0310-9956-ffa450edef68
2010-09-17 04:18:33 +00:00
Michael Stack 763865630c HBASE-3006 Reading compressed HFile blocks causes way too many DFS RPC calls severly impacting performance
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997968 13f79535-47bb-0310-9956-ffa450edef68
2010-09-17 03:56:16 +00:00
Michael Stack eab3e07e39 Fix hanging TestCompaction test -- it was putting up the blocking gate and never moving on
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997589 13f79535-47bb-0310-9956-ffa450edef68
2010-09-16 05:09:10 +00:00
Michael Stack 5145547154 HBASE-2899 hfile.min.blocksize.size ignored/documentation wrong
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997544 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 23:57:15 +00:00
Ryan Rawson 5b600805b5 HBASE-2782 QOS for META table access
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997541 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 23:44:08 +00:00
Michael Stack 191a334487 Rename TestReplicationSink as DISABLEDTestReplicationSink till fixed
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997539 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 23:26:45 +00:00
Ryan Rawson 55633e79f1 HBASE-2997 Performance fixes - profiler driven (build/test fix)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997533 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 22:50:49 +00:00
Ryan Rawson 009f461738 HBASE-2997 Performance fixes - profiler driven
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997519 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 21:48:04 +00:00
Ryan Rawson 5581a249e8 HBASE-2941 port HADOOP-6713 - threading scalability for RPC reads - to HBase
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997512 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 21:26:40 +00:00
Michael Stack eecc426f78 Fix NPE in LoadBalancer that I added with my commit of HBASE-2979
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997510 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 21:24:47 +00:00
Michael Stack fb42084ba9 Fix TestHeapSize broke by HBASE-2988
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997483 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 20:23:31 +00:00
Michael Stack 5d8b73585f HBASE-2979 Fix failing TestMultParrallel in hudson build
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997437 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 18:10:43 +00:00
Michael Stack 787d807b37 HBASE-2986 multi writable can npe causing client hang
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997353 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 14:40:00 +00:00
Andrew Kyle Purtell 762e374861 HBASE-2988 Support alternate compression for major compactions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997168 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 02:01:56 +00:00
Todd Lipcon 02cd4a9b01 HBASE-2980. Refactor region server command line to a new class
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@996633 13f79535-47bb-0310-9956-ffa450edef68
2010-09-13 18:37:11 +00:00
Michael Stack d48a3d0a27 HBASE-2720 TestFromClientSide fails for client region cache prewarm on Hudson
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@996255 13f79535-47bb-0310-9956-ffa450edef68
2010-09-12 05:44:36 +00:00
Michael Stack 1d58b8a3bf HBASE-2870 Add Backup CLI Option to HMaster; repair of damage done to this patch by 2692 master rewrite
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@996204 13f79535-47bb-0310-9956-ffa450edef68
2010-09-11 19:48:02 +00:00
Todd Lipcon 4373f9eeb7 HBASE-2983. TestHLog unit test is mis-comparing an assertion (Alex Newman via Todd Lipcon)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995999 13f79535-47bb-0310-9956-ffa450edef68
2010-09-10 22:09:11 +00:00
Michael Stack 32800d3be6 HBASE-2978 LoadBalancer IndexOutOfBoundsException
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995679 13f79535-47bb-0310-9956-ffa450edef68
2010-09-10 06:01:30 +00:00
Todd Lipcon 94b78b4997 HBASE-2977. Refactor master command line to a new class
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995674 13f79535-47bb-0310-9956-ffa450edef68
2010-09-10 05:48:39 +00:00
Michael Stack 9453a813d0 HBASE-2961 Close zookeeper when done with it (HCM, Master, and RS)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995612 13f79535-47bb-0310-9956-ffa450edef68
2010-09-10 00:03:57 +00:00
Michael Stack 5b31d2cd72 Formatting fixup -- use programlisting rather than code delimiting commands
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995500 13f79535-47bb-0310-9956-ffa450edef68
2010-09-09 17:15:11 +00:00
Todd Lipcon 72f2c22bfc HBASE-2975. DFSClient names in master and RS should be unique
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995495 13f79535-47bb-0310-9956-ffa450edef68
2010-09-09 17:05:36 +00:00
Michael Stack bae69e07c4 Running HFile tool passing fully-qualified filename I get 'IllegalArgumentException: Wrong FS'
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995486 13f79535-47bb-0310-9956-ffa450edef68
2010-09-09 16:41:02 +00:00
Michael Stack 84763cdd0a HBASE-2974 LoadBalancer ArithmeticException: / by zero
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995318 13f79535-47bb-0310-9956-ffa450edef68
2010-09-09 05:43:13 +00:00
Michael Stack 2210cf908b HBASE-2973 NPE in LogCleaner
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995281 13f79535-47bb-0310-9956-ffa450edef68
2010-09-08 23:34:10 +00:00
Michael Stack e144e8f32d HBASE-2969 missing sync in HTablePool.getTable()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995273 13f79535-47bb-0310-9956-ffa450edef68
2010-09-08 22:41:27 +00:00
Michael Stack cf43037b3b HBASE-2967 Failed split: IOE 'File is Corrupt' -- sync length not being written out to SequenceFile
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995256 13f79535-47bb-0310-9956-ffa450edef68
2010-09-08 21:15:22 +00:00
Michael Stack bd7e091b2d HBASE-2889 Tool to look at HLogs -- parse and tail -f; added part 1, some fixup of hlog main; added a bit of documentation on hlog tool
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995233 13f79535-47bb-0310-9956-ffa450edef68
2010-09-08 19:57:16 +00:00
Michael Stack 74066765bb HBASE-2889 Tool to look at HLogs -- parse and tail -f; added part 1, some fixup of hlog main
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995222 13f79535-47bb-0310-9956-ffa450edef68
2010-09-08 19:43:27 +00:00
Andrew Kyle Purtell 6e2d002734 HBASE-2942 Custom filters should not require registration in HBaseObjectWritable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995220 13f79535-47bb-0310-9956-ffa450edef68
2010-09-08 19:42:32 +00:00
Michael Stack 3b16358da3 HBASE-2889 Tool to look at HLogs -- parse and tail -f; added part 1, some fixup of hlog main
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995182 13f79535-47bb-0310-9956-ffa450edef68
2010-09-08 18:33:51 +00:00
Jonathan Gray 4481fafee4 HBASE-1485 Wrong or indeterminate behavior when there are duplicate versions of a column (pranav via jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995163 13f79535-47bb-0310-9956-ffa450edef68
2010-09-08 17:22:31 +00:00
Michael Stack b89eb144d1 HBASE-2964 Deadlock when RS tries to RPC to itself inside SplitTransaction
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995151 13f79535-47bb-0310-9956-ffa450edef68
2010-09-08 16:57:52 +00:00
Michael Stack d98956f9cd HBASE-2962 Add missing methods to HTableInterface (and HTable)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@993548 13f79535-47bb-0310-9956-ffa450edef68
2010-09-07 22:20:40 +00:00
Michael Stack f0f9240de4 HBASE-2925 LRU of HConnectionManager.HBASE_INSTANCES breaks if HBaseConfiguration is changed
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@993078 13f79535-47bb-0310-9956-ffa450edef68
2010-09-06 15:50:46 +00:00
Michael Stack 72ddbced0c HBASE-1845 MultiGet, MultiDelete, and MultiPut - batched to the appropriate region servers; commit again -- was removed by hbase-2692 commit
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@992531 13f79535-47bb-0310-9956-ffa450edef68
2010-09-04 03:57:57 +00:00
Michael Stack 9f12e0d060 HBASE-1845 MultiGet, MultiDelete, and MultiPut - batched to the appropriate region servers; commit again -- was removed by hbase-2692 commit
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@992530 13f79535-47bb-0310-9956-ffa450edef68
2010-09-04 03:57:21 +00:00
Michael Stack 61f9214268 HBASE-2955 hbase-2692 broke replication -- committed HCM change by mistake
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@992426 13f79535-47bb-0310-9956-ffa450edef68
2010-09-03 19:20:09 +00:00
Michael Stack 6f4e9c7117 HBASE-2955 hbase-2692 broke replication -- disabling replication tests till this issue is addressed
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@992425 13f79535-47bb-0310-9956-ffa450edef68
2010-09-03 19:18:39 +00:00
Michael Stack f5521ee5a7 HBASE-2955 hbase-2692 broke replication -- disabling replication tests till this issue is addressed
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@992423 13f79535-47bb-0310-9956-ffa450edef68
2010-09-03 19:07:27 +00:00
Michael Stack 67f2923810 HBASE-2955 hbase-2692 broke replication -- disabling replication tests till this issue is addressed
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@992408 13f79535-47bb-0310-9956-ffa450edef68
2010-09-03 18:35:47 +00:00
Michael Stack 33257e051e Edit of what is done on WAL exceptions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@992324 13f79535-47bb-0310-9956-ffa450edef68
2010-09-03 15:20:19 +00:00
Michael Stack 39e213e62d HBASE-2643 Figure how to deal with eof splitting logs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@992215 13f79535-47bb-0310-9956-ffa450edef68
2010-09-03 05:57:02 +00:00
Michael Stack 95a9c26c77 HBASE-2943 major_compact (and other admin commands) broken for .META. -- Bug spotted by jgray after commit
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@992131 13f79535-47bb-0310-9956-ffa450edef68
2010-09-02 22:18:54 +00:00
Michael Stack e3d0498438 HBASE-2943 major_compact (and other admin commands) broken for .META.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@992110 13f79535-47bb-0310-9956-ffa450edef68
2010-09-02 20:39:41 +00:00
Michael Stack 1574bac2f1 HBASE-2799 'Append not enabled' warning should not show if hbase root dir isn't on DFS
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@992027 13f79535-47bb-0310-9956-ffa450edef68
2010-09-02 17:31:48 +00:00
Michael Stack 081f97077b HBASE-2918 SequenceFileLogWriter doesnt make it clear if there is no append by config or by missing lib/feature
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@991741 13f79535-47bb-0310-9956-ffa450edef68
2010-09-01 22:34:12 +00:00
Michael Stack 1e70bfbb00 HBASE-2857 HBaseAdmin.tableExists() should not require a full meta scan
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@991734 13f79535-47bb-0310-9956-ffa450edef68
2010-09-01 22:14:40 +00:00
Michael Stack 34efa17d46 HBASE-2594 Fix broken build caused by hbase-2692 commit
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@991713 13f79535-47bb-0310-9956-ffa450edef68
2010-09-01 21:40:34 +00:00
Michael Stack 6d747b7f38 HBASE-2953 Edit of hbase-default.xml removing stale configs.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@991700 13f79535-47bb-0310-9956-ffa450edef68
2010-09-01 20:51:50 +00:00
Michael Stack 177abe115f HBASE-2948 bin/hbase shell broken
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@991584 13f79535-47bb-0310-9956-ffa450edef68
2010-09-01 16:10:14 +00:00
Michael Stack 85babe8fe7 HBASE-2692 Master rewrite and cleanup for 0.90 -- added in Jon's documentation ohow region transition works now
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@991435 13f79535-47bb-0310-9956-ffa450edef68
2010-09-01 04:59:39 +00:00
Jonathan Gray 04afcd034c HBASE-2944 cannot alter bloomfilter setting for a column family from hbase shell (kannan via jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@991408 13f79535-47bb-0310-9956-ffa450edef68
2010-09-01 00:31:37 +00:00
Michael Stack f521309532 HBASE-2692 Master rewrite and cleanup for 0.90
Patch brought over from 0.90_master_rewrite branch.

Replication test is broke as are some of the rest tests.
Others should be passing.

Some of the changes made in this fat patch:

+ In HLogKey, we now use encoded region name instead of full region name.
+ On split, daughters are opened on the parent's regionserver; let the new balancer
sort them out later when it cuts in.
+ Added move region from one server to another as well as enable/disable balancer.
+ All .META. and -ROOT- edits go via new *Editor and *Reader classes -- no more
do we have 5 different ways of reading and editing .META.
+ Rather than 3 different listeners to hlog each w/ own way of listening, instead
we only have WALObserver now.
+ New Server Interface that has whats common to HMaster and RegionServer. Also
new Services Interface.  This should make test writing cleaner making it so
less need of full cluster context testing anything -- e.g. the new
Interfaces are good w/ Mockito.
+ New balacner that runs on a period and takes into consideration all load
across cluster.
+ Table online/offline is now a flag in ZK; the offline flag on a region is
just used splitting from here on out.
+ Moved fixup of failed add of daughter edits to .META. into shutdown server
recover code (It used to be in basescanner).
+ The heartbeat now sends master the regionserver load and is used sending
shutdown message from master to regionserver ONLY; all other messages are
via zk (HMsg is pretty bare now).
+ No more Worker in RS and ToDoQueue in master.  Both in master and regionserver
we use handlers instead run out of Executors.
+ Client can not send split, flush, compact direct to RS; no longer does
it go via master.
+ Server shutdown runs differently now. All are watching a flag in zk.
When RS notices its gone, it closes all user-space regions. If thats all
it was carrying, then it goes down.  Otherwise, waits on master to send
the shutdown msg via heartbeat.



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@991397 13f79535-47bb-0310-9956-ffa450edef68
2010-08-31 23:51:44 +00:00
Ryan Rawson 8586a6238a HBASE-1845 MultiGet, MultiDelete, and MultiPut - batched to the
appropriate region servers (Marc Limotte via Ryan)


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@991289 13f79535-47bb-0310-9956-ffa450edef68
2010-08-31 18:53:32 +00:00
Jean-Daniel Cryans 7abfcbc22c HBASE-2920 HTable.checkAndPut/Delete doesn't handle null values
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@989296 13f79535-47bb-0310-9956-ffa450edef68
2010-08-25 18:58:43 +00:00
Jean-Daniel Cryans 6e72b3cef3 HBASE-2897 The test wasn't passing because the family wasn't parsed correctly
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@988746 13f79535-47bb-0310-9956-ffa450edef68
2010-08-24 22:32:29 +00:00
Jean-Daniel Cryans bdc56078d4 HBASE-2915 Deadlock between HRegion.ICV and HRegion.close
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@988343 13f79535-47bb-0310-9956-ffa450edef68
2010-08-23 22:47:36 +00:00
Michael Stack 88eb9c5281 HBASE-2931 Do not throw RuntimeExceptions in RPC/HbaseObjectWritable code, ensure we log and rethrow as IOE
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@987952 13f79535-47bb-0310-9956-ffa450edef68
2010-08-22 22:20:16 +00:00
Jean-Daniel Cryans 461c835fc9 HBASE-2922 HLog preparation and cleanup are done under the updateLock,
major slowdown


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@987675 13f79535-47bb-0310-9956-ffa450edef68
2010-08-20 23:44:23 +00:00
Jean-Daniel Cryans 831afacddf HBASE-2924 TestLogRolling doesn't use the right HLog half the time
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@987310 13f79535-47bb-0310-9956-ffa450edef68
2010-08-19 20:57:05 +00:00
Jonathan Gray 5e9f6d1528 HBASE-2928 Fault in logic in BinaryPrefixComparator leads to ArrayIndexOutOfBoundsException (pranav via jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@986969 13f79535-47bb-0310-9956-ffa450edef68
2010-08-18 22:27:58 +00:00
Jean-Daniel Cryans 0e481c64e8 HBASE-2927 BaseScanner gets stale HRegionInfo in some race cases
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@986887 13f79535-47bb-0310-9956-ffa450edef68
2010-08-18 19:40:49 +00:00
Jean-Daniel Cryans 625a079b73 HBASE-2923 Deadlock between HRegion.internalFlushCache and close
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@986448 13f79535-47bb-0310-9956-ffa450edef68
2010-08-17 18:44:35 +00:00
Michael Stack 4dbf0c9b69 HBASE-2919 initTableReducerJob: Unused method parameter.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@986058 13f79535-47bb-0310-9956-ffa450edef68
2010-08-16 17:21:17 +00:00
Ryan Rawson 81df7e7598 Fix build, damn you hudson for not being unicode compatible!
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@985422 13f79535-47bb-0310-9956-ffa450edef68
2010-08-14 01:38:35 +00:00
Ryan Rawson 4784ec1b57 HBASE-1517 Implement inexpensive seek operations in HFile (Pranav via Ryan)
HBASE-2903  ColumnPrefix filtering (Pranav via Ryan)
HBASE-2904  Smart seeking using filters (Pranav via Ryan)



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@985412 13f79535-47bb-0310-9956-ffa450edef68
2010-08-14 00:30:20 +00:00
Jean-Daniel Cryans d80de85a69 HBASE-2909 SoftValueSortedMap is broken, can generate NPEs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@985383 13f79535-47bb-0310-9956-ffa450edef68
2010-08-13 22:09:42 +00:00
Michael Stack 92ffa8580c HBASE-2868 Do some small cleanups in org.apache.hadoop.hbase.regionserver.wal
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@984433 13f79535-47bb-0310-9956-ffa450edef68
2010-08-11 15:03:21 +00:00
Michael Stack 8b5d7dbb1c HBASE-2908 Wrong order of null-check [in TIF]
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@984423 13f79535-47bb-0310-9956-ffa450edef68
2010-08-11 14:43:15 +00:00
Michael Stack e30ddb01aa HBASE-2870: Add Backup CLI Option to HMaster
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@984116 13f79535-47bb-0310-9956-ffa450edef68
2010-08-10 16:54:40 +00:00
Michael Stack 2569d61c80 Fix downloads page
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@983837 13f79535-47bb-0310-9956-ffa450edef68
2010-08-09 22:51:22 +00:00
Andrew Kyle Purtell a95f1ed4f6 HBASE-2905 NPE when inserting mass data via REST interface
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@983699 13f79535-47bb-0310-9956-ffa450edef68
2010-08-09 15:55:19 +00:00