Commit Graph

2568 Commits

Author SHA1 Message Date
Michael Stack 94682d09d3 HBASE-3019 Make bulk assignment on cluster startup run faster
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003330 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 23:12:56 +00:00
Jonathan Gray 78f75e6c7f HBASE-3060 Disabling test until it gets fixed (part 2)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003318 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 22:09:29 +00:00
Jonathan Gray 2d8fb6f26c HBASE-3060 Disabling test until it gets fixed
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003305 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 21:48:33 +00:00
Jonathan Gray 69d1258e12 HBASE-3058 Fix REST tests on trunk
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003256 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 20:58:07 +00:00
Jonathan Gray 8863ae5a0e HBASE-3057 Race condition when closing regions that causes flakiness in TestRestartCluster
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003204 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 18:53:20 +00:00
Jonathan Gray d2ce2b36e0 HBASE-3056 Fix ordering in ZKWatcher constructor to prevent weird race condition
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003196 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 18:22:28 +00:00
Jonathan Gray 7ce5812dfe Small fix to TestFullLogReconstruction to make it pass
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003182 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 17:53:24 +00:00
Michael Stack f6743a1b75 Small fix for failing TestMasterAddressManager
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002943 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 04:17:42 +00:00
Michael Stack 08fad6672e Disable test failing because its dependent on replication working with new master -- not yet done
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002942 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 04:14:03 +00:00
Michael Stack 7ca978123f HBASE-3054 Remore TestEmptyMetaInfo; it doesn't make sense any more.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002941 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 03:42:58 +00:00
Michael Stack 58c4f2df98 HBASE-3047 If new master crashes, restart is messy
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002880 13f79535-47bb-0310-9956-ffa450edef68
2010-09-29 22:37:50 +00:00
Michael Stack 4d25275040 HBASE-3038 WALReaderFSDataInputStream.getPos() fails if Filesize > MAX_INT; addendum
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002348 13f79535-47bb-0310-9956-ffa450edef68
2010-09-28 20:38:12 +00:00
Michael Stack 1334d5187b HBASE-3040 BlockIndex readIndex too slowly in heavy write scenario; add in fix to address kannan review
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002310 13f79535-47bb-0310-9956-ffa450edef68
2010-09-28 18:29:53 +00:00
Michael Stack d3a8c97ad8 HBASE-3038 WALReaderFSDataInputStream.getPos() fails if Filesize > MAX_INT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002027 13f79535-47bb-0310-9956-ffa450edef68
2010-09-28 05:55:51 +00:00
Michael Stack 8032206236 HBASE-2646 Compaction requests should be prioritized to prevent blocking; remove of hbase-3038 added by mistake
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002020 13f79535-47bb-0310-9956-ffa450edef68
2010-09-28 05:29:29 +00:00
Michael Stack f4ac670a42 HBASE-2646 Compaction requests should be prioritized to prevent blocking
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002019 13f79535-47bb-0310-9956-ffa450edef68
2010-09-28 05:26:22 +00:00
Michael Stack 5affba7171 HBASE-2641 Refactor HLog splitLog, hbase-2437 continued; break out split code as new classes
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001969 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 23:52:46 +00:00
Michael Stack 7faaf57d1b HBASE-3030 The return code of many filesystem operations are not checked
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001954 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 23:02:52 +00:00
Michael Stack b11ac8d6f5 HBASE-3040 BlockIndex readIndex too slowly in heavy write scenario
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001949 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 22:53:26 +00:00
Jonathan Gray 4f545ea09c Attempting to fix TestHeapSize on Hudson (align array heapsize)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001944 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 22:43:59 +00:00
Michael Stack 9069ed1ac6 HBASE-2995 Incorrect dependency on Log class from Jetty
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001936 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 22:18:28 +00:00
Michael Stack aff46efe9e HBASE-3042 Use LO4J in SequenceFileLogReader
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001928 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 22:09:51 +00:00
Michael Stack 823cfeac9c HBASE-2641 Refactor HLog splitLog, hbase-2437 continued; break out split code as new classes
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001924 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 22:02:23 +00:00
Michael Stack 10a84f3b88 HBASE-3039 Stuck in regionsInTransition because rebalance came in at same time as a split
M src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
  Add region name to warning log message (w/o it message is no good).
M src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
  Add src of split message else need to deduce where it came from by looking
  elsewhere.
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
  Updated log messages to include region and where appropritate source
  server name; debug hard w/o
  Changed regionOnline and regionOffline to check for unexpected
  states and log warnings rather than proceed regardless.
  Added in fix for concurrent balance+split; split message now
  updates regionsintransition where previous it did not.
  Remove checkRegion method.  Its a reimplementation of
  what regionOnline and regionOffline do only less comprehensive
  regards what gets updated (this.regions + this.servers rather
  than this.regions, this.servers and regionsInTransition)
  That they were less comprehensive is root of this bug.
M src/main/java/org/apache/hadoop/hbase/master/HMaster.java
  Make the message about why we are not running balancer richer
  (print out how many reigons in transition and more of the
  regionsintrnasition list).
M src/main/java/org/apache/hadoop/hbase/executor/RegionTransitionData.java
  Javadoc and minor formatting.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001911 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 21:02:04 +00:00
Michael Stack 5efa0ba9c9 Added note on hlog tool, that it can be used to look at files in recovered edits file
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001907 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 20:58:26 +00:00
Michael Stack 1339f395d6 HBASE-3037 When new master joins running cluster does "Received report from unknown server -- telling it to STOP_REGIONSERVER..."
M src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
 On regionServerReport, if we get a report from an 'unknown' regionserver,
 we used to tell it stop itself.  Now, if 'unknown' server AND
 this master did not start the cluster, its joining the cluster, then
 treat the report as a regionServerStart and register the incoming
 server rather than tell it shutdown.
M src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Pass the freshClusterStartup flag to ServerManager.
 Add more executors for opening and closing.  On cluster startup a
 master shouldn't be bottleneck clearning the server opens.
 Expose the run-balancer method so can make it available in
 ServeAdmin.
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
 Minor formatting and javadoc
M src/main/java/org/apache/hadoop/hbase/ipc/HBaseRPCProtocolVersion.java
 Upped rpc version number because of new balancer addition (and because
 we didn't do it when we put in new master).
M src/main/java/org/apache/hadoop/hbase/ipc/HMasterInterface.java
 Added balance method.
M src/main/resources/hbase-default.xml
 Change how ofter we check in from every 3 seconds to every 5 seconds.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001140 13f79535-47bb-0310-9956-ffa450edef68
2010-09-25 06:24:42 +00:00
Michael Stack e58ebc4830 HBASE-3036 avro tests failing up on hudson (pass locally) -- trying something, passing Configuration to HBaseImpl
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001062 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 20:40:41 +00:00
Jean-Daniel Cryans d4e9b8f4d9 HBASE-3033 [replication] ReplicationSink.replicateEntries improvements
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001061 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 20:37:44 +00:00
Jean-Daniel Cryans b05d9ac937 HBASE-2992 [replication] MalformedObjectNameException in ReplicationMetrics
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001016 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 18:34:42 +00:00
Jean-Daniel Cryans da611388b4 HBASE-2989 [replication] RSM won't cleanup after locking if 0 peers
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001014 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 18:32:26 +00:00
Michael Stack 4163b90a87 Fix broke TestHLogSplit test
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000966 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 16:59:42 +00:00
Michael Stack d988546130 Fix broke TestHLogSplit test
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000965 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 16:59:17 +00:00
Michael Stack 9ea9cba5b2 HBASE-3028 No basescanner means no GC'ing of split, offlined parent regions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000715 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 05:46:41 +00:00
Todd Lipcon 2ecdd83e0d HBASE-3002. Fix zookeepers.sh to work properly with strange JVM options
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000698 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 04:10:55 +00:00
Michael Stack a85ee11f3b HBASE-2889 Tool to look at HLogs -- parse and tail -f; fix for suppression of EOFEs by Nicolas
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000697 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 04:00:48 +00:00
Ryan Rawson 0f3c62e19b HBASE-2450 For single row reads of specific columns, seek to the first column in HFiles rather than start of (Pranav via Ryan, some Ryan)
HBASE-2916  Reseek directly to next column
HBASE-2959  Scanning always starts at the beginning of a row



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000276 13f79535-47bb-0310-9956-ffa450edef68
2010-09-22 23:51:55 +00:00
Ryan Rawson 2806d60cab HBASE-3003 ClassSize constants dont use 'final'
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000275 13f79535-47bb-0310-9956-ffa450edef68
2010-09-22 23:49:49 +00:00
Michael Stack 17da1d0369 HBASE-3001 Ship dependency jars to the cluster for all jobs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000261 13f79535-47bb-0310-9956-ffa450edef68
2010-09-22 22:16:23 +00:00
Michael Stack a46c74894f HBASE-3026 Fixup of missing daughters on split is too aggressive
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000133 13f79535-47bb-0310-9956-ffa450edef68
2010-09-22 18:42:41 +00:00
Michael Stack 0de40fe1b0 Inserted an email Ryan wrote the list on 'considerations sizing regions'
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000113 13f79535-47bb-0310-9956-ffa450edef68
2010-09-22 18:05:32 +00:00
Michael Stack af3bf8cad0 HBASE-3024 NPE processing server crash in MetaEditor.addDaughter
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999672 13f79535-47bb-0310-9956-ffa450edef68
2010-09-21 22:24:05 +00:00
Michael Stack 5fa3d69f66 HBASE-3023 NPE processing server crash in MetaReader. getServerUserRegions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999664 13f79535-47bb-0310-9956-ffa450edef68
2010-09-21 22:00:12 +00:00
Michael Stack ffedf2c58e HBASE-3022 Change format of enum messages in o.a.h.h.executor package
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999660 13f79535-47bb-0310-9956-ffa450edef68
2010-09-21 21:44:21 +00:00
Michael Stack 14d8fb2ab7 HBASE-3018 Bulk assignment on startup runs serially through the cluster servers assigning in bulk to one at a time
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
  Removed reentrant lock that spanned moving region into
  regionsintransition and the getting of lock on state object.  It
  was a bad idea.  I found it actually deadlocked.  It shouldn't be needed.
  The call to assign will fail if the state instance is not of the right
  'state' type.
  Run a thread per server parcelling out region assignments so we assign
  across the cluster concurrently rather than in series as we were doing.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999237 13f79535-47bb-0310-9956-ffa450edef68
2010-09-21 06:36:22 +00:00
Michael Stack 34f17faa5d HBASE-3017 More log pruning
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999154 13f79535-47bb-0310-9956-ffa450edef68
2010-09-20 22:43:25 +00:00
Michael Stack 4f0d6bc6be HBASE-3017 More log pruning
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999150 13f79535-47bb-0310-9956-ffa450edef68
2010-09-20 22:31:19 +00:00
Michael Stack 0cdd2c5eb7 HBASE-3017 More log pruning
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999143 13f79535-47bb-0310-9956-ffa450edef68
2010-09-20 22:25:54 +00:00
Michael Stack 1456bfff76 HBASE-3000 Add "hbase classpath" command to dump classpath
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999062 13f79535-47bb-0310-9956-ffa450edef68
2010-09-20 19:14:48 +00:00
Michael Stack 98b9448162 HBASE-3000 Add "hbase classpath" command to dump classpath
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999060 13f79535-47bb-0310-9956-ffa450edef68
2010-09-20 19:13:43 +00:00
Michael Stack a3856ca945 HBASE-3017 More log pruning
M conf/log4j.properties
  Make ZKW log at INFO-level
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
  Log message cleanup.
M src/main/java/org/apache/hadoop/hbase/master/HMaster.java
  Remove excessive hostname+port qualifier on master for zk messages
M src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java
  Log message cleanup
M src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
  Format the ServerMonitor message.
M src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
  Remove excessive hostname on zk message id; just add port
M src/main/java/org/apache/hadoop/hbase/zookeeper/ZKAssign.java
  Cleanup of messages.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999057 13f79535-47bb-0310-9956-ffa450edef68
2010-09-20 19:04:41 +00:00