Commit Graph

1818 Commits

Author SHA1 Message Date
Michael Stack dd39498ce4 HBASE-3068 IllegalStateException when new server comes online, is given 200 regions to open and 200th region gets timed out of regions in transition
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003699 13f79535-47bb-0310-9956-ffa450edef68
2010-10-01 23:02:18 +00:00
Ryan Rawson e5c4776af9 HBASE-2825 Scans respect row locks
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003698 13f79535-47bb-0310-9956-ffa450edef68
2010-10-01 22:46:15 +00:00
Michael Stack 7bb6f3839c HBASE-3066 We don't put the port for hregionserver up into znode since new master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003644 13f79535-47bb-0310-9956-ffa450edef68
2010-10-01 20:44:36 +00:00
Michael Stack 94682d09d3 HBASE-3019 Make bulk assignment on cluster startup run faster
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003330 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 23:12:56 +00:00
Jonathan Gray 69d1258e12 HBASE-3058 Fix REST tests on trunk
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003256 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 20:58:07 +00:00
Jonathan Gray 8863ae5a0e HBASE-3057 Race condition when closing regions that causes flakiness in TestRestartCluster
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003204 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 18:53:20 +00:00
Jonathan Gray d2ce2b36e0 HBASE-3056 Fix ordering in ZKWatcher constructor to prevent weird race condition
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1003196 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 18:22:28 +00:00
Michael Stack 7ca978123f HBASE-3054 Remore TestEmptyMetaInfo; it doesn't make sense any more.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002941 13f79535-47bb-0310-9956-ffa450edef68
2010-09-30 03:42:58 +00:00
Michael Stack 58c4f2df98 HBASE-3047 If new master crashes, restart is messy
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002880 13f79535-47bb-0310-9956-ffa450edef68
2010-09-29 22:37:50 +00:00
Michael Stack d3a8c97ad8 HBASE-3038 WALReaderFSDataInputStream.getPos() fails if Filesize > MAX_INT
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002027 13f79535-47bb-0310-9956-ffa450edef68
2010-09-28 05:55:51 +00:00
Michael Stack f4ac670a42 HBASE-2646 Compaction requests should be prioritized to prevent blocking
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1002019 13f79535-47bb-0310-9956-ffa450edef68
2010-09-28 05:26:22 +00:00
Michael Stack 7faaf57d1b HBASE-3030 The return code of many filesystem operations are not checked
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001954 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 23:02:52 +00:00
Michael Stack b11ac8d6f5 HBASE-3040 BlockIndex readIndex too slowly in heavy write scenario
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001949 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 22:53:26 +00:00
Michael Stack 9069ed1ac6 HBASE-2995 Incorrect dependency on Log class from Jetty
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001936 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 22:18:28 +00:00
Michael Stack aff46efe9e HBASE-3042 Use LO4J in SequenceFileLogReader
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001928 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 22:09:51 +00:00
Michael Stack 823cfeac9c HBASE-2641 Refactor HLog splitLog, hbase-2437 continued; break out split code as new classes
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001924 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 22:02:23 +00:00
Michael Stack 10a84f3b88 HBASE-3039 Stuck in regionsInTransition because rebalance came in at same time as a split
M src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
  Add region name to warning log message (w/o it message is no good).
M src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
  Add src of split message else need to deduce where it came from by looking
  elsewhere.
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
  Updated log messages to include region and where appropritate source
  server name; debug hard w/o
  Changed regionOnline and regionOffline to check for unexpected
  states and log warnings rather than proceed regardless.
  Added in fix for concurrent balance+split; split message now
  updates regionsintransition where previous it did not.
  Remove checkRegion method.  Its a reimplementation of
  what regionOnline and regionOffline do only less comprehensive
  regards what gets updated (this.regions + this.servers rather
  than this.regions, this.servers and regionsInTransition)
  That they were less comprehensive is root of this bug.
M src/main/java/org/apache/hadoop/hbase/master/HMaster.java
  Make the message about why we are not running balancer richer
  (print out how many reigons in transition and more of the
  regionsintrnasition list).
M src/main/java/org/apache/hadoop/hbase/executor/RegionTransitionData.java
  Javadoc and minor formatting.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001911 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 21:02:04 +00:00
Michael Stack 1339f395d6 HBASE-3037 When new master joins running cluster does "Received report from unknown server -- telling it to STOP_REGIONSERVER..."
M src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
 On regionServerReport, if we get a report from an 'unknown' regionserver,
 we used to tell it stop itself.  Now, if 'unknown' server AND
 this master did not start the cluster, its joining the cluster, then
 treat the report as a regionServerStart and register the incoming
 server rather than tell it shutdown.
M src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Pass the freshClusterStartup flag to ServerManager.
 Add more executors for opening and closing.  On cluster startup a
 master shouldn't be bottleneck clearning the server opens.
 Expose the run-balancer method so can make it available in
 ServeAdmin.
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
 Minor formatting and javadoc
M src/main/java/org/apache/hadoop/hbase/ipc/HBaseRPCProtocolVersion.java
 Upped rpc version number because of new balancer addition (and because
 we didn't do it when we put in new master).
M src/main/java/org/apache/hadoop/hbase/ipc/HMasterInterface.java
 Added balance method.
M src/main/resources/hbase-default.xml
 Change how ofter we check in from every 3 seconds to every 5 seconds.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001140 13f79535-47bb-0310-9956-ffa450edef68
2010-09-25 06:24:42 +00:00
Jean-Daniel Cryans d4e9b8f4d9 HBASE-3033 [replication] ReplicationSink.replicateEntries improvements
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001061 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 20:37:44 +00:00
Jean-Daniel Cryans b05d9ac937 HBASE-2992 [replication] MalformedObjectNameException in ReplicationMetrics
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001016 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 18:34:42 +00:00
Jean-Daniel Cryans da611388b4 HBASE-2989 [replication] RSM won't cleanup after locking if 0 peers
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001014 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 18:32:26 +00:00
Michael Stack 9ea9cba5b2 HBASE-3028 No basescanner means no GC'ing of split, offlined parent regions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000715 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 05:46:41 +00:00
Todd Lipcon 2ecdd83e0d HBASE-3002. Fix zookeepers.sh to work properly with strange JVM options
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000698 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 04:10:55 +00:00
Ryan Rawson 0f3c62e19b HBASE-2450 For single row reads of specific columns, seek to the first column in HFiles rather than start of (Pranav via Ryan, some Ryan)
HBASE-2916  Reseek directly to next column
HBASE-2959  Scanning always starts at the beginning of a row



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000276 13f79535-47bb-0310-9956-ffa450edef68
2010-09-22 23:51:55 +00:00
Ryan Rawson 2806d60cab HBASE-3003 ClassSize constants dont use 'final'
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000275 13f79535-47bb-0310-9956-ffa450edef68
2010-09-22 23:49:49 +00:00
Michael Stack 17da1d0369 HBASE-3001 Ship dependency jars to the cluster for all jobs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000261 13f79535-47bb-0310-9956-ffa450edef68
2010-09-22 22:16:23 +00:00
Michael Stack a46c74894f HBASE-3026 Fixup of missing daughters on split is too aggressive
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000133 13f79535-47bb-0310-9956-ffa450edef68
2010-09-22 18:42:41 +00:00
Michael Stack af3bf8cad0 HBASE-3024 NPE processing server crash in MetaEditor.addDaughter
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999672 13f79535-47bb-0310-9956-ffa450edef68
2010-09-21 22:24:05 +00:00
Michael Stack 5fa3d69f66 HBASE-3023 NPE processing server crash in MetaReader. getServerUserRegions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999664 13f79535-47bb-0310-9956-ffa450edef68
2010-09-21 22:00:12 +00:00
Michael Stack ffedf2c58e HBASE-3022 Change format of enum messages in o.a.h.h.executor package
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999660 13f79535-47bb-0310-9956-ffa450edef68
2010-09-21 21:44:21 +00:00
Michael Stack 14d8fb2ab7 HBASE-3018 Bulk assignment on startup runs serially through the cluster servers assigning in bulk to one at a time
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
  Removed reentrant lock that spanned moving region into
  regionsintransition and the getting of lock on state object.  It
  was a bad idea.  I found it actually deadlocked.  It shouldn't be needed.
  The call to assign will fail if the state instance is not of the right
  'state' type.
  Run a thread per server parcelling out region assignments so we assign
  across the cluster concurrently rather than in series as we were doing.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999237 13f79535-47bb-0310-9956-ffa450edef68
2010-09-21 06:36:22 +00:00
Michael Stack 98b9448162 HBASE-3000 Add "hbase classpath" command to dump classpath
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999060 13f79535-47bb-0310-9956-ffa450edef68
2010-09-20 19:13:43 +00:00
Michael Stack a3856ca945 HBASE-3017 More log pruning
M conf/log4j.properties
  Make ZKW log at INFO-level
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
  Log message cleanup.
M src/main/java/org/apache/hadoop/hbase/master/HMaster.java
  Remove excessive hostname+port qualifier on master for zk messages
M src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java
  Log message cleanup
M src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
  Format the ServerMonitor message.
M src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
  Remove excessive hostname on zk message id; just add port
M src/main/java/org/apache/hadoop/hbase/zookeeper/ZKAssign.java
  Cleanup of messages.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999057 13f79535-47bb-0310-9956-ffa450edef68
2010-09-20 19:04:41 +00:00
Michael Stack 7daffb3a42 HBASE-3015 recovered.edits files not deleted if it only contain edits that have already been flushed; hurts perf for all future opens of the region
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999046 13f79535-47bb-0310-9956-ffa450edef68
2010-09-20 18:43:13 +00:00
Michael Stack d153ec95da HBASE-3010 Can't start/stop/start... cluster using new master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@998380 13f79535-47bb-0310-9956-ffa450edef68
2010-09-18 00:51:05 +00:00
Michael Stack e532293310 HBASE-3006 Reading compressed HFile blocks causes way too many DFS RPC calls severly impacting performance--Now add fix I intended, a spelling mistake in HFile
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997975 13f79535-47bb-0310-9956-ffa450edef68
2010-09-17 04:21:28 +00:00
Michael Stack 96f8cbe9e2 HBASE-3006 Reading compressed HFile blocks causes way too many DFS RPC calls severly impacting performance--Revert mistaken over commit
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997974 13f79535-47bb-0310-9956-ffa450edef68
2010-09-17 04:20:55 +00:00
Michael Stack 763865630c HBASE-3006 Reading compressed HFile blocks causes way too many DFS RPC calls severly impacting performance
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997968 13f79535-47bb-0310-9956-ffa450edef68
2010-09-17 03:56:16 +00:00
Michael Stack 5145547154 HBASE-2899 hfile.min.blocksize.size ignored/documentation wrong
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997544 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 23:57:15 +00:00
Ryan Rawson 5b600805b5 HBASE-2782 QOS for META table access
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997541 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 23:44:08 +00:00
Ryan Rawson 009f461738 HBASE-2997 Performance fixes - profiler driven
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997519 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 21:48:04 +00:00
Ryan Rawson 5581a249e8 HBASE-2941 port HADOOP-6713 - threading scalability for RPC reads - to HBase
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997512 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 21:26:40 +00:00
Michael Stack 5d8b73585f HBASE-2979 Fix failing TestMultParrallel in hudson build
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997437 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 18:10:43 +00:00
Michael Stack 787d807b37 HBASE-2986 multi writable can npe causing client hang
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997353 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 14:40:00 +00:00
Andrew Kyle Purtell 762e374861 HBASE-2988 Support alternate compression for major compactions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997168 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 02:01:56 +00:00
Todd Lipcon 02cd4a9b01 HBASE-2980. Refactor region server command line to a new class
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@996633 13f79535-47bb-0310-9956-ffa450edef68
2010-09-13 18:37:11 +00:00
Todd Lipcon 4373f9eeb7 HBASE-2983. TestHLog unit test is mis-comparing an assertion (Alex Newman via Todd Lipcon)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995999 13f79535-47bb-0310-9956-ffa450edef68
2010-09-10 22:09:11 +00:00
Michael Stack 32800d3be6 HBASE-2978 LoadBalancer IndexOutOfBoundsException
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995679 13f79535-47bb-0310-9956-ffa450edef68
2010-09-10 06:01:30 +00:00
Todd Lipcon 94b78b4997 HBASE-2977. Refactor master command line to a new class
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995674 13f79535-47bb-0310-9956-ffa450edef68
2010-09-10 05:48:39 +00:00
Michael Stack 9453a813d0 HBASE-2961 Close zookeeper when done with it (HCM, Master, and RS)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995612 13f79535-47bb-0310-9956-ffa450edef68
2010-09-10 00:03:57 +00:00