1852 Commits

Author SHA1 Message Date
Michael Stack
10a84f3b88 HBASE-3039 Stuck in regionsInTransition because rebalance came in at same time as a split
M src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
  Add region name to warning log message (w/o it message is no good).
M src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
  Add src of split message else need to deduce where it came from by looking
  elsewhere.
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
  Updated log messages to include region and where appropritate source
  server name; debug hard w/o
  Changed regionOnline and regionOffline to check for unexpected
  states and log warnings rather than proceed regardless.
  Added in fix for concurrent balance+split; split message now
  updates regionsintransition where previous it did not.
  Remove checkRegion method.  Its a reimplementation of
  what regionOnline and regionOffline do only less comprehensive
  regards what gets updated (this.regions + this.servers rather
  than this.regions, this.servers and regionsInTransition)
  That they were less comprehensive is root of this bug.
M src/main/java/org/apache/hadoop/hbase/master/HMaster.java
  Make the message about why we are not running balancer richer
  (print out how many reigons in transition and more of the
  regionsintrnasition list).
M src/main/java/org/apache/hadoop/hbase/executor/RegionTransitionData.java
  Javadoc and minor formatting.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001911 13f79535-47bb-0310-9956-ffa450edef68
2010-09-27 21:02:04 +00:00
Michael Stack
1339f395d6 HBASE-3037 When new master joins running cluster does "Received report from unknown server -- telling it to STOP_REGIONSERVER..."
M src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
 On regionServerReport, if we get a report from an 'unknown' regionserver,
 we used to tell it stop itself.  Now, if 'unknown' server AND
 this master did not start the cluster, its joining the cluster, then
 treat the report as a regionServerStart and register the incoming
 server rather than tell it shutdown.
M src/main/java/org/apache/hadoop/hbase/master/HMaster.java
 Pass the freshClusterStartup flag to ServerManager.
 Add more executors for opening and closing.  On cluster startup a
 master shouldn't be bottleneck clearning the server opens.
 Expose the run-balancer method so can make it available in
 ServeAdmin.
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
 Minor formatting and javadoc
M src/main/java/org/apache/hadoop/hbase/ipc/HBaseRPCProtocolVersion.java
 Upped rpc version number because of new balancer addition (and because
 we didn't do it when we put in new master).
M src/main/java/org/apache/hadoop/hbase/ipc/HMasterInterface.java
 Added balance method.
M src/main/resources/hbase-default.xml
 Change how ofter we check in from every 3 seconds to every 5 seconds.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001140 13f79535-47bb-0310-9956-ffa450edef68
2010-09-25 06:24:42 +00:00
Jean-Daniel Cryans
d4e9b8f4d9 HBASE-3033 [replication] ReplicationSink.replicateEntries improvements
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001061 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 20:37:44 +00:00
Jean-Daniel Cryans
b05d9ac937 HBASE-2992 [replication] MalformedObjectNameException in ReplicationMetrics
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001016 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 18:34:42 +00:00
Jean-Daniel Cryans
da611388b4 HBASE-2989 [replication] RSM won't cleanup after locking if 0 peers
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1001014 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 18:32:26 +00:00
Michael Stack
9ea9cba5b2 HBASE-3028 No basescanner means no GC'ing of split, offlined parent regions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000715 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 05:46:41 +00:00
Todd Lipcon
2ecdd83e0d HBASE-3002. Fix zookeepers.sh to work properly with strange JVM options
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000698 13f79535-47bb-0310-9956-ffa450edef68
2010-09-24 04:10:55 +00:00
Ryan Rawson
0f3c62e19b HBASE-2450 For single row reads of specific columns, seek to the first column in HFiles rather than start of (Pranav via Ryan, some Ryan)
HBASE-2916  Reseek directly to next column
HBASE-2959  Scanning always starts at the beginning of a row



git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000276 13f79535-47bb-0310-9956-ffa450edef68
2010-09-22 23:51:55 +00:00
Ryan Rawson
2806d60cab HBASE-3003 ClassSize constants dont use 'final'
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000275 13f79535-47bb-0310-9956-ffa450edef68
2010-09-22 23:49:49 +00:00
Michael Stack
17da1d0369 HBASE-3001 Ship dependency jars to the cluster for all jobs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000261 13f79535-47bb-0310-9956-ffa450edef68
2010-09-22 22:16:23 +00:00
Michael Stack
a46c74894f HBASE-3026 Fixup of missing daughters on split is too aggressive
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@1000133 13f79535-47bb-0310-9956-ffa450edef68
2010-09-22 18:42:41 +00:00
Michael Stack
af3bf8cad0 HBASE-3024 NPE processing server crash in MetaEditor.addDaughter
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999672 13f79535-47bb-0310-9956-ffa450edef68
2010-09-21 22:24:05 +00:00
Michael Stack
5fa3d69f66 HBASE-3023 NPE processing server crash in MetaReader. getServerUserRegions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999664 13f79535-47bb-0310-9956-ffa450edef68
2010-09-21 22:00:12 +00:00
Michael Stack
ffedf2c58e HBASE-3022 Change format of enum messages in o.a.h.h.executor package
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999660 13f79535-47bb-0310-9956-ffa450edef68
2010-09-21 21:44:21 +00:00
Michael Stack
14d8fb2ab7 HBASE-3018 Bulk assignment on startup runs serially through the cluster servers assigning in bulk to one at a time
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
  Removed reentrant lock that spanned moving region into
  regionsintransition and the getting of lock on state object.  It
  was a bad idea.  I found it actually deadlocked.  It shouldn't be needed.
  The call to assign will fail if the state instance is not of the right
  'state' type.
  Run a thread per server parcelling out region assignments so we assign
  across the cluster concurrently rather than in series as we were doing.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999237 13f79535-47bb-0310-9956-ffa450edef68
2010-09-21 06:36:22 +00:00
Michael Stack
98b9448162 HBASE-3000 Add "hbase classpath" command to dump classpath
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999060 13f79535-47bb-0310-9956-ffa450edef68
2010-09-20 19:13:43 +00:00
Michael Stack
a3856ca945 HBASE-3017 More log pruning
M conf/log4j.properties
  Make ZKW log at INFO-level
M src/main/java/org/apache/hadoop/hbase/master/AssignmentManager.java
  Log message cleanup.
M src/main/java/org/apache/hadoop/hbase/master/HMaster.java
  Remove excessive hostname+port qualifier on master for zk messages
M src/main/java/org/apache/hadoop/hbase/master/MasterFileSystem.java
  Log message cleanup
M src/main/java/org/apache/hadoop/hbase/master/ServerManager.java
  Format the ServerMonitor message.
M src/main/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
  Remove excessive hostname on zk message id; just add port
M src/main/java/org/apache/hadoop/hbase/zookeeper/ZKAssign.java
  Cleanup of messages.


git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999057 13f79535-47bb-0310-9956-ffa450edef68
2010-09-20 19:04:41 +00:00
Michael Stack
7daffb3a42 HBASE-3015 recovered.edits files not deleted if it only contain edits that have already been flushed; hurts perf for all future opens of the region
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@999046 13f79535-47bb-0310-9956-ffa450edef68
2010-09-20 18:43:13 +00:00
Michael Stack
d153ec95da HBASE-3010 Can't start/stop/start... cluster using new master
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@998380 13f79535-47bb-0310-9956-ffa450edef68
2010-09-18 00:51:05 +00:00
Michael Stack
e532293310 HBASE-3006 Reading compressed HFile blocks causes way too many DFS RPC calls severly impacting performance--Now add fix I intended, a spelling mistake in HFile
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997975 13f79535-47bb-0310-9956-ffa450edef68
2010-09-17 04:21:28 +00:00
Michael Stack
96f8cbe9e2 HBASE-3006 Reading compressed HFile blocks causes way too many DFS RPC calls severly impacting performance--Revert mistaken over commit
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997974 13f79535-47bb-0310-9956-ffa450edef68
2010-09-17 04:20:55 +00:00
Michael Stack
763865630c HBASE-3006 Reading compressed HFile blocks causes way too many DFS RPC calls severly impacting performance
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997968 13f79535-47bb-0310-9956-ffa450edef68
2010-09-17 03:56:16 +00:00
Michael Stack
5145547154 HBASE-2899 hfile.min.blocksize.size ignored/documentation wrong
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997544 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 23:57:15 +00:00
Ryan Rawson
5b600805b5 HBASE-2782 QOS for META table access
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997541 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 23:44:08 +00:00
Ryan Rawson
009f461738 HBASE-2997 Performance fixes - profiler driven
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997519 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 21:48:04 +00:00
Ryan Rawson
5581a249e8 HBASE-2941 port HADOOP-6713 - threading scalability for RPC reads - to HBase
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997512 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 21:26:40 +00:00
Michael Stack
5d8b73585f HBASE-2979 Fix failing TestMultParrallel in hudson build
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997437 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 18:10:43 +00:00
Michael Stack
787d807b37 HBASE-2986 multi writable can npe causing client hang
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997353 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 14:40:00 +00:00
Andrew Kyle Purtell
762e374861 HBASE-2988 Support alternate compression for major compactions
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@997168 13f79535-47bb-0310-9956-ffa450edef68
2010-09-15 02:01:56 +00:00
Todd Lipcon
02cd4a9b01 HBASE-2980. Refactor region server command line to a new class
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@996633 13f79535-47bb-0310-9956-ffa450edef68
2010-09-13 18:37:11 +00:00
Todd Lipcon
4373f9eeb7 HBASE-2983. TestHLog unit test is mis-comparing an assertion (Alex Newman via Todd Lipcon)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995999 13f79535-47bb-0310-9956-ffa450edef68
2010-09-10 22:09:11 +00:00
Michael Stack
32800d3be6 HBASE-2978 LoadBalancer IndexOutOfBoundsException
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995679 13f79535-47bb-0310-9956-ffa450edef68
2010-09-10 06:01:30 +00:00
Todd Lipcon
94b78b4997 HBASE-2977. Refactor master command line to a new class
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995674 13f79535-47bb-0310-9956-ffa450edef68
2010-09-10 05:48:39 +00:00
Michael Stack
9453a813d0 HBASE-2961 Close zookeeper when done with it (HCM, Master, and RS)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995612 13f79535-47bb-0310-9956-ffa450edef68
2010-09-10 00:03:57 +00:00
Todd Lipcon
72f2c22bfc HBASE-2975. DFSClient names in master and RS should be unique
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995495 13f79535-47bb-0310-9956-ffa450edef68
2010-09-09 17:05:36 +00:00
Michael Stack
bae69e07c4 Running HFile tool passing fully-qualified filename I get 'IllegalArgumentException: Wrong FS'
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995486 13f79535-47bb-0310-9956-ffa450edef68
2010-09-09 16:41:02 +00:00
Michael Stack
84763cdd0a HBASE-2974 LoadBalancer ArithmeticException: / by zero
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995318 13f79535-47bb-0310-9956-ffa450edef68
2010-09-09 05:43:13 +00:00
Michael Stack
2210cf908b HBASE-2973 NPE in LogCleaner
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995281 13f79535-47bb-0310-9956-ffa450edef68
2010-09-08 23:34:10 +00:00
Michael Stack
e144e8f32d HBASE-2969 missing sync in HTablePool.getTable()
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995273 13f79535-47bb-0310-9956-ffa450edef68
2010-09-08 22:41:27 +00:00
Michael Stack
cf43037b3b HBASE-2967 Failed split: IOE 'File is Corrupt' -- sync length not being written out to SequenceFile
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995256 13f79535-47bb-0310-9956-ffa450edef68
2010-09-08 21:15:22 +00:00
Andrew Kyle Purtell
6e2d002734 HBASE-2942 Custom filters should not require registration in HBaseObjectWritable
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995220 13f79535-47bb-0310-9956-ffa450edef68
2010-09-08 19:42:32 +00:00
Jonathan Gray
4481fafee4 HBASE-1485 Wrong or indeterminate behavior when there are duplicate versions of a column (pranav via jgray)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995163 13f79535-47bb-0310-9956-ffa450edef68
2010-09-08 17:22:31 +00:00
Michael Stack
b89eb144d1 HBASE-2964 Deadlock when RS tries to RPC to itself inside SplitTransaction
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@995151 13f79535-47bb-0310-9956-ffa450edef68
2010-09-08 16:57:52 +00:00
Michael Stack
d98956f9cd HBASE-2962 Add missing methods to HTableInterface (and HTable)
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@993548 13f79535-47bb-0310-9956-ffa450edef68
2010-09-07 22:20:40 +00:00
Michael Stack
f0f9240de4 HBASE-2925 LRU of HConnectionManager.HBASE_INSTANCES breaks if HBaseConfiguration is changed
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@993078 13f79535-47bb-0310-9956-ffa450edef68
2010-09-06 15:50:46 +00:00
Michael Stack
39e213e62d HBASE-2643 Figure how to deal with eof splitting logs
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@992215 13f79535-47bb-0310-9956-ffa450edef68
2010-09-03 05:57:02 +00:00
Michael Stack
e3d0498438 HBASE-2943 major_compact (and other admin commands) broken for .META.
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@992110 13f79535-47bb-0310-9956-ffa450edef68
2010-09-02 20:39:41 +00:00
Michael Stack
1574bac2f1 HBASE-2799 'Append not enabled' warning should not show if hbase root dir isn't on DFS
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@992027 13f79535-47bb-0310-9956-ffa450edef68
2010-09-02 17:31:48 +00:00
Michael Stack
081f97077b HBASE-2918 SequenceFileLogWriter doesnt make it clear if there is no append by config or by missing lib/feature
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@991741 13f79535-47bb-0310-9956-ffa450edef68
2010-09-01 22:34:12 +00:00
Michael Stack
1e70bfbb00 HBASE-2857 HBaseAdmin.tableExists() should not require a full meta scan
git-svn-id: https://svn.apache.org/repos/asf/hbase/trunk@991734 13f79535-47bb-0310-9956-ffa450edef68
2010-09-01 22:14:40 +00:00