Commit Graph

210 Commits

Author SHA1 Message Date
Michael Stack 4a65f06f71 HBASE-1538 Up zookeeper timeout from 10 seconds to 30 seconds to cut down on hbase-user traffic
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@785843 13f79535-47bb-0310-9956-ffa450edef68
2009-06-17 22:24:52 +00:00
Michael Stack 23e370c7d9 HBASE-1507 iCMS as default JVM
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@784977 13f79535-47bb-0310-9956-ffa450edef68
2009-06-15 21:07:36 +00:00
Michael Stack d841ab681d HBASE-1507 iCMS as default JVM
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@783990 13f79535-47bb-0310-9956-ffa450edef68
2009-06-12 05:59:54 +00:00
Jean-Daniel Cryans 4c05305695 HBASE-1357 If one sets the hbase.master to 0.0.0.0 non local regionservers
can't find the master
HBASE-1445  Add the ability to start a master from any machine



git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@781099 13f79535-47bb-0310-9956-ffa450edef68
2009-06-02 17:52:32 +00:00
Andrew Kyle Purtell 3fbad5236d HBASE-1464 Add hbase.regionserver.logroll.period to hbase-default; fix
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@780532 13f79535-47bb-0310-9956-ffa450edef68
2009-05-31 23:50:35 +00:00
Michael Stack e7afa8643f HBASE-1192 LRU-style map for the block cache
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@780528 13f79535-47bb-0310-9956-ffa450edef68
2009-05-31 23:42:00 +00:00
Michael Stack 2b47c15286 HBASE-1192 LRU-style map for the block cache
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@780527 13f79535-47bb-0310-9956-ffa450edef68
2009-05-31 23:39:39 +00:00
Michael Stack dca4256907 HBASE-1464 Add hbase.regionserver.logroll.period to hbase-default
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@780469 13f79535-47bb-0310-9956-ffa450edef68
2009-05-31 16:45:02 +00:00
Andrew Kyle Purtell 66c6ee2e99 HBASE-1434 Duplicate property in hbase-default.xml
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@776118 13f79535-47bb-0310-9956-ffa450edef68
2009-05-18 22:26:19 +00:00
Michael Stack cff0b8bb04 HBASE-1394 Uploads sometimes fall to 0 requests/second (Binding up on HLog#append?)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@775418 13f79535-47bb-0310-9956-ffa450edef68
2009-05-16 06:10:44 +00:00
Andrew Kyle Purtell e81f7f3484 HBASE-1413 Fall back to filesystem block size default if HLog blocksize is not specified
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@774242 13f79535-47bb-0310-9956-ffa450edef68
2009-05-13 07:06:01 +00:00
Michael Stack f7add789cd HBASE-???? Remove unused sequencefile and mapfile config. from hbase-default.xml -- will fill in issue number when JIRA db comes back
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@772719 13f79535-47bb-0310-9956-ffa450edef68
2009-05-07 17:34:00 +00:00
Michael Stack 7a66721ea6 Mistaken commit of my hbase-env.sh
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@771403 13f79535-47bb-0310-9956-ffa450edef68
2009-05-04 19:04:52 +00:00
Jean-Daniel Cryans 3c35c00cf9 HBASE-1279 Fix the way hostnames and IPs are handled
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@771387 13f79535-47bb-0310-9956-ffa450edef68
2009-05-04 18:30:49 +00:00
Michael Stack f1bc7a2592 HBASE-1318 Thrift server doesnt know about atomicIncrement -- undoing this commit because it mistakenly included hbase-1336 patch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@771087 13f79535-47bb-0310-9956-ffa450edef68
2009-05-03 17:11:58 +00:00
Michael Stack b6ccf3081a HBASE-1271 Allow multiple tests to run on one machine
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@769989 13f79535-47bb-0310-9956-ffa450edef68
2009-04-29 23:14:57 +00:00
Jean-Daniel Cryans 4629b58bd7 HBASE-1331 Lower the default scanner caching value
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@766738 13f79535-47bb-0310-9956-ffa450edef68
2009-04-20 16:04:36 +00:00
Michael Stack 7bf66f9483 HBASE-1289 Remove hbase.fully.distributed option and update docs
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@758615 13f79535-47bb-0310-9956-ffa450edef68
2009-03-26 12:57:45 +00:00
Michael Stack 948e551a16 HBASE-1273 ZooKeeper WARN spits out lots of useless messages
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@756793 13f79535-47bb-0310-9956-ffa450edef68
2009-03-20 22:42:25 +00:00
Michael Stack c3a68eaf4c HBASE-1145 Ensure that there is only 1 Master with Zookeeper
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@755725 13f79535-47bb-0310-9956-ffa450edef68
2009-03-18 20:46:18 +00:00
Michael Stack f073189447 HBASE-61 Create an HBase-specific MapFile implementation
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@747672 13f79535-47bb-0310-9956-ffa450edef68
2009-02-25 05:59:26 +00:00
Michael Stack be84747ad3 HBASE-61 Create an HBase-specific MapFile implementation
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@747666 13f79535-47bb-0310-9956-ffa450edef68
2009-02-25 05:34:29 +00:00
Jean-Daniel Cryans 31823ff1a3 HBASE-1191 ZooKeeper ensureParentExists calls fail
on absolute path (via Nitay Joffe)
HBASE-1187  After disabling/enabling a table, the regions seems to
               be assigned to only 1-2 region servers


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@742137 13f79535-47bb-0310-9956-ffa450edef68
2009-02-08 18:37:00 +00:00
Michael Stack fb8e861bcf HBASE-1144 Store the ROOT region location in Zookeeper
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@739118 13f79535-47bb-0310-9956-ffa450edef68
2009-01-30 01:24:05 +00:00
Michael Stack 2c6c26e139 HBASE-1144 Store the ROOT region location in Zookeeper
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@739115 13f79535-47bb-0310-9956-ffa450edef68
2009-01-30 01:22:05 +00:00
Jean-Daniel Cryans 476da38f1f HBASE-1147 Modify the scripts to use Zookeeper
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@738184 13f79535-47bb-0310-9956-ffa450edef68
2009-01-27 18:20:09 +00:00
Jim Kellerman 542abcf26d HBASE-1121 Cluster confused about where -ROOT- is
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@737213 13f79535-47bb-0310-9956-ffa450edef68
2009-01-23 22:37:01 +00:00
Jim Kellerman 8bd2b4d7bd HBASE-1138 Set default HLog block size.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@736359 13f79535-47bb-0310-9956-ffa450edef68
2009-01-21 18:18:02 +00:00
Michael Stack 1381d23645 HBASE-1127 OOME running randomRead PE
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@735089 13f79535-47bb-0310-9956-ffa450edef68
2009-01-16 19:07:42 +00:00
Andrew Kyle Purtell c4aa758efe HBASE-1062 Compactions at (re)start on a large table can overwhelm DFS
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@729560 13f79535-47bb-0310-9956-ffa450edef68
2008-12-26 23:23:04 +00:00
Michael Stack fc98eacd67 HBASE-1070 Up default index interval in TRUNK and branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@728238 13f79535-47bb-0310-9956-ffa450edef68
2008-12-20 05:32:22 +00:00
Michael Stack 3f80f67db1 HBASE-900 Regionserver memory leak causing OOME during relatively modest bulk importing; part 2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@726153 13f79535-47bb-0310-9956-ffa450edef68
2008-12-13 01:15:39 +00:00
Michael Stack 6c33c1b1b3 HBASE-1027 Make global flusher check work with percentages rather than hard code memory sizes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@723417 13f79535-47bb-0310-9956-ffa450edef68
2008-12-04 20:01:06 +00:00
Michael Stack c370e1cab2 HBASE-1021 hbase metrics FileContext not working
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@720286 13f79535-47bb-0310-9956-ffa450edef68
2008-11-24 20:47:58 +00:00
Michael Stack 16973669dc HBASE-938 major compaction period is not checked periodically
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@714203 13f79535-47bb-0310-9956-ffa450edef68
2008-11-15 00:46:02 +00:00
Michael Stack 67fc6fdb02 HBASE-996 Migration script to up the versions in catalog tables
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@713502 13f79535-47bb-0310-9956-ffa450edef68
2008-11-12 20:44:06 +00:00
Michael Stack e95b049d33 HBASE-625 Metrics support for cluster load history: emissions and graphs
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@709008 13f79535-47bb-0310-9956-ffa450edef68
2008-10-29 21:06:29 +00:00
Michael Stack 7e1d49358d HBASE-953 Enable BLOCKCACHE by default [WAS -> Reevaluate HBASE-288 block caching work....?]
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@708253 13f79535-47bb-0310-9956-ffa450edef68
2008-10-27 18:02:55 +00:00
Jim Kellerman d5e81859e1 HBASE-728 Support for HLog appends
- Passes all unit tests.
- Runs Performance evaluation random write in 8min, 43sec on 4 node cluster. I believe this is a new speed record.
- Eliminates time-based log rolling and cache-flushing (because of append support)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@707247 13f79535-47bb-0310-9956-ffa450edef68
2008-10-23 02:30:35 +00:00
Jean-Daniel Cryans a3b452e9b0 HBASE-748 Add an efficient way to batch update many rows
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@705770 13f79535-47bb-0310-9956-ffa450edef68
2008-10-17 22:03:29 +00:00
Michael Stack db217e6a15 HBASE-920 Make region balancing sloppier
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@704781 13f79535-47bb-0310-9956-ffa450edef68
2008-10-15 05:18:31 +00:00
Michael Stack 4100951aac Fix a few descriptions
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@703629 13f79535-47bb-0310-9956-ffa450edef68
2008-10-11 04:06:10 +00:00
Michael Stack 804155c541 HBASE-875 Use MurmurHash instead of JenkinsHash
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@698265 13f79535-47bb-0310-9956-ffa450edef68
2008-09-23 18:10:06 +00:00
Jean-Daniel Cryans d65e0b2bd6 HBASE-887 Fix a hotspot in scanners
M    conf/hbase-default.xml
Added a new config hbase.client.scanner.caching, fixed triplification
M    src/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
Implements new next(long, int) method for batching
M    src/java/org/apache/hadoop/hbase/ipc/HRegionInterface.java
Defines that new next(long, int) method
M    src/java/org/apache/hadoop/hbase/client/HTable.java
Adds new property that is passed to scanners. ClientScanner now handles caching of rows
M    src/java/org/apache/hadoop/hbase/client/MetaScanner.java
Small changes related to ScannerCallable
M    src/java/org/apache/hadoop/hbase/client/HConnectionManager.java
Same sort of small changes
M    src/java/org/apache/hadoop/hbase/client/ScannerCallable.java
Now modified because of new methods in HRS, will be able to handle caching
M    src/java/org/apache/hadoop/hbase/client/transactional/TransactionalTable.java
Passes caching to its super class


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@698198 13f79535-47bb-0310-9956-ffa450edef68
2008-09-23 14:51:22 +00:00
Michael Stack 19c87a375d HBASE-826 fix xml error in hbase-default.xml
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@690428 13f79535-47bb-0310-9956-ffa450edef68
2008-08-29 23:40:49 +00:00
Michael Stack 99f695beda HBASE-834 'Major' compactions and upper bound on files we compact at any one time
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@690423 13f79535-47bb-0310-9956-ffa450edef68
2008-08-29 23:36:02 +00:00
Michael Stack 1fb69ec11a HBASE-830 Debugging HCM.locateRegionInMeta is painful
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@686308 13f79535-47bb-0310-9956-ffa450edef68
2008-08-15 18:27:37 +00:00
Michael Stack c41834a778 HBASE-821 UnknownScanner happens too often
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@685236 13f79535-47bb-0310-9956-ffa450edef68
2008-08-12 17:30:10 +00:00
Jim Kellerman e4449cfc8f HBASE-511 Do exponential backoff in clients on NSRE, WRE, ISE, etc.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@680902 13f79535-47bb-0310-9956-ffa450edef68
2008-07-30 01:45:44 +00:00
Michael Stack 5af2380bac HBASE-779 Test changing hbase.hregion.memcache.block.multiplier to 2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@680218 13f79535-47bb-0310-9956-ffa450edef68
2008-07-28 01:12:35 +00:00
Michael Stack bc76ab38a5 HBASE-772 Up default lease period from 60 to 120 seconds
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@679559 13f79535-47bb-0310-9956-ffa450edef68
2008-07-24 21:58:50 +00:00
Michael Stack c7ffac7220 Remove mistakenly committed configuration
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@678551 13f79535-47bb-0310-9956-ffa450edef68
2008-07-21 20:24:23 +00:00
Michael Stack 6fe7bfb481 HBASE-706 On OOME, regionserver sticks around and doesn't go down with cluster
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@674958 13f79535-47bb-0310-9956-ffa450edef68
2008-07-08 21:10:33 +00:00
Michael Stack cbb2ba609d Turn off DEBUG logging on dfs -- from Rong-En Fan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@673286 13f79535-47bb-0310-9956-ffa450edef68
2008-07-02 05:32:20 +00:00
Michael Stack bcbcbc79f4 HBASE-714 Showing bytes in log when should be string (2)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@671951 13f79535-47bb-0310-9956-ffa450edef68
2008-06-26 17:06:31 +00:00
Michael Stack 5b5fc0f7d7 Backout unintentional commit of JAVA_HOME
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@668881 13f79535-47bb-0310-9956-ffa450edef68
2008-06-18 00:17:48 +00:00
Michael Stack b58c15a6d7 HBASE-487 Replace hql w/ a hbase-friendly jirb or jython shell
This commit finishes up the DDL
M  src/test/org/apache/hadoop/hbase/TestBloomFilters.java
    Changed name of default constants.
M  src/java/org/apache/hadoop/hbase/HColumnDescriptor.java
    Changed name of default constants.
    (getNameAsString): Added.
M  src/java/org/apache/hadoop/hbase/master/ModifyColumn.java
    toString column family byte array name.
M  bin/HBase.rb
    (alter, hcd): Added.
M  bin/hirb.rb
    More help doc.
    (alter, admin): Added.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@667684 13f79535-47bb-0310-9956-ffa450edef68
2008-06-13 22:42:11 +00:00
Michael Stack 4b2c5ed76d Remove mistakenly committed change to hbase-env.sh
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@663329 13f79535-47bb-0310-9956-ffa450edef68
2008-06-04 17:53:32 +00:00
Michael Stack 3dec8def1c HBASE-533 Region Historian
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@663314 13f79535-47bb-0310-9956-ffa450edef68
2008-06-04 17:18:21 +00:00
Michael Stack 7e0dd33fb7 HBASE-659 HLog#cacheFlushLock not cleared; hangs a region; revert code mistakenly committed
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@662147 13f79535-47bb-0310-9956-ffa450edef68
2008-06-01 05:06:52 +00:00
Michael Stack 359fdf6238 HBASE-659 HLog#cacheFlushLock not cleared; hangs a region
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@662146 13f79535-47bb-0310-9956-ffa450edef68
2008-06-01 04:42:11 +00:00
Michael Stack eb348cb54a Unintentional commit
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@661126 13f79535-47bb-0310-9956-ffa450edef68
2008-05-28 22:21:02 +00:00
Michael Stack cb9d586513 HBASE-487 Replace hql w/ a hbase-friendly jirb or jython shell, Part 1: Purge hql, added raw jirb
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@659445 13f79535-47bb-0310-9956-ffa450edef68
2008-05-23 06:21:16 +00:00
Michael Stack ee2ece88d8 Remove config. committed by mistake
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658899 13f79535-47bb-0310-9956-ffa450edef68
2008-05-21 22:11:37 +00:00
Michael Stack b365b0bf61 Fix broken build -- remove line that should not have been included in the HBASE-623 commit
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658100 13f79535-47bb-0310-9956-ffa450edef68
2008-05-20 05:12:31 +00:00
Michael Stack 9cb0f8bdfb HBASE-630 Default hbase.rootdir is garbage
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658098 13f79535-47bb-0310-9956-ffa450edef68
2008-05-20 04:30:18 +00:00
Michael Stack 8af6a615e2 HBASE-82 Remove mistaken conf commit
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656892 13f79535-47bb-0310-9956-ffa450edef68
2008-05-15 23:13:16 +00:00
Michael Stack 7ddd733236 HBASE-569 DemoClient.php
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656511 13f79535-47bb-0310-9956-ffa450edef68
2008-05-15 05:26:47 +00:00
Michael Stack 0c08836299 HBASE-608 HRegionServer::getThisIP() checks hadoop config var for dns interface name
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@652428 13f79535-47bb-0310-9956-ffa450edef68
2008-05-01 04:22:56 +00:00
Bryan Duxbury 49e0eaf8d9 HBASE-512 Add configuration for global aggregate memcache size
-Refactored Flusher slightly, added reclaimMemcacheMemory method
-HRegionServer calls reclaimMemcacheMemory during batchUpdates
-Added TestGlobalMemcacheLimit to verify new functionality 
-Added new config parameter defaults to hbase-default.xml

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@645740 13f79535-47bb-0310-9956-ffa450edef68
2008-04-08 00:09:20 +00:00
Michael Stack c7e72f6640 HBASE-515 At least double default timeouts between regionserver and master -- minor edit or property description
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@637197 13f79535-47bb-0310-9956-ffa450edef68
2008-03-14 18:14:45 +00:00
Michael Stack 9a40223445 HBASE-515 At least double default timeouts between regionserver and master
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@637179 13f79535-47bb-0310-9956-ffa450edef68
2008-03-14 17:47:49 +00:00
Michael Stack c1f974bbee HBASE-501 Empty region server address in info:server entry and a startcode of -1 in .META.
M conf/hbase-default.xml
Add hbase.hbasemaster.maxregionopen property.
M src/java/org/apache/hadoop/hbase/HStore.java
Change way we log. Do way less. Just emit sums of edits applied
and skipped rather than individual edits.
M src/java/org/apache/hadoop/hbase/HRegionServer.java
Make sleeper instance a local rather than data member.
(reportForDuty): Take a sleeper instance.
(run): Removed redundant wrap of a 'for' by a 'while'.
(constructor): If IOE, do not offline the region. Seen to be
an overreaction.
M src/java/org/apache/hadoop/hbase/HLog.java
Don't output map of all files being cleaned everytime a new
entry is added; instead just log new entry. Remove emission
of every 10k edits.
M src/java/org/apache/hadoop/hbase/HMaster.java
Up default for maxregionopen. Was seeing that playing edits
could take a long time (mostly because we used log every
edit) but no harm in this being longer. On REPORT_CLOSE,
emit region info, not just region so can see the properties
(W/o, made it hard to figure who was responsible for offlining).
Add logging of attempt # in shutdown processing.
Add logging of state flags passed to the close region. Helps
debugging. Also in close offline ONLY if we are NOT reassigning
the region (jimk find).
M src/java/org/apache/hadoop/hbase/util/Sleeper.java
Add logging of extraordinary sleeps or calculated periods
(suspicion is that we're sleeping way longer on loaded machies
and the regionserver appears hung).


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@636849 13f79535-47bb-0310-9956-ffa450edef68
2008-03-13 19:37:21 +00:00
Bryan Duxbury dee0ea4c7a HBASE-466 Move HMasterInterface, HRegionInterface, and HMasterRegionInterface into o.a.h.h.ipc
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630970 13f79535-47bb-0310-9956-ffa450edef68
2008-02-25 19:54:26 +00:00
Bryan Duxbury dcbc0773fc 419 Move RegionServer and related classes into regionserver package
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630550 13f79535-47bb-0310-9956-ffa450edef68
2008-02-24 00:19:34 +00:00
Jim Kellerman 8b2c345d4c HBASE-440 Add optional log roll interval so that log files are garbage collected
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627152 13f79535-47bb-0310-9956-ffa450edef68
2008-02-12 22:19:24 +00:00
Michael Stack 8dafaa567a HBASE-426 hbase can't find remote filesystem
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620058 13f79535-47bb-0310-9956-ffa450edef68
2008-02-09 01:43:59 +00:00
Michael Stack 9dccb4c8b8 HBASE-481 Move HMaster and related classes into master package
Part 4: I committed changes in below configs. unintentionally.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620052 13f79535-47bb-0310-9956-ffa450edef68
2008-02-09 00:37:15 +00:00
Michael Stack 1bc3a436dc HBASE-418 Move HMaster and related classes into master package
Part 3: Missed non-moved file edits.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620024 13f79535-47bb-0310-9956-ffa450edef68
2008-02-08 22:56:57 +00:00
Michael Stack 93a31f6a16 HBASE-2 hlog numbers should wrap around when they reach 999
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619657 13f79535-47bb-0310-9956-ffa450edef68
2008-02-07 21:48:58 +00:00
Michael Stack 56380dab8a HBASE-288 Add in-memory caching of data
(Recommit.  We'd backed it out when it was HADOOP-1398)
This commit includes updating version from 0.1.0-dev to 0.2.0-dev
and an update of the hadoop lib to move it post 0.16.0 branch.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619526 13f79535-47bb-0310-9956-ffa450edef68
2008-02-07 17:49:15 +00:00
Michael Stack 24b065cc91 HADOOP-403 Fix build after move of hbase in svn
Removed mention of all of the HADOOP_* environment variables. Made
HBASE_* equivs.  hbase-env.sh is not near dup of hadoop-env.sh.
Removed options on scripts that used take both hbase and hadoop
conf and home. Now we just work w/ hbase.  Fixed logging (logs
dir now under hbase).


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@618765 13f79535-47bb-0310-9956-ffa450edef68
2008-02-05 20:09:24 +00:00
Michael Stack 6aacbfb18d HBASE-403 Fix build after move of hbase in svn
Make it so scripts basically work again.  Make up a log4j
basic properites file (currently broke).
M    trunk/conf/hbase-env.sh
    Put a JAVA_HOME in here.  Need to set it here now instead of up in hadoop-env
A    trunk/conf/log4j.properties
    Basic log4j for hbase.
M    trunk/bin/hbase
    Made pointers up into hadoop instead point to hbase substitutions.
M    trunk/bin/start-hbase.sh
    Remove wait on dfs for moment.  Need to figure how to do it now
    we're detached (Besides there is talk that we'd acually have the
    servers come up even if they can't talk to dfs).


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@618560 13f79535-47bb-0310-9956-ffa450edef68
2008-02-05 06:15:44 +00:00
Michael Stack c6b29235e7 HBASE-403 Fix build after move of hbase in svn
Part 1: jar and test targets works as do javacc, clean.
TODO: Package needs clean up.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@618453 13f79535-47bb-0310-9956-ffa450edef68
2008-02-04 21:48:13 +00:00
Thomas White 5d2ec2506d HADOOP-1398. Add HBase in-memory block cache. Contributed by Tom White.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@618347 13f79535-47bb-0310-9956-ffa450edef68
2008-02-04 17:54:35 +00:00
Michael Stack 3e351091b6 HADOOP-2731 Under load, regions become extremely large and eventually cause
region servers to become unresponsive


git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@617720 13f79535-47bb-0310-9956-ffa450edef68
2008-02-02 00:36:53 +00:00
Jim Kellerman d3a9d1d745 HADOOP-2525 Same 2 lines repeated 11 million times in HMaster log upon HMaster shutdown
HADOOP-2616 hbase not spliting when the total size of region reaches max region size * 1.5


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@613062 13f79535-47bb-0310-9956-ffa450edef68
2008-01-18 06:11:06 +00:00
Michael Stack 40ed226cf1 HADOOP-2621 Memcache flush flushing every 60 secs with out
considering the max memcache size


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@613010 13f79535-47bb-0310-9956-ffa450edef68
2008-01-17 23:38:09 +00:00
Michael Stack ff4aac71c3 HADOOP-2589 Change an classes/package name from shell to hql
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@612016 13f79535-47bb-0310-9956-ffa450edef68
2008-01-15 05:14:34 +00:00
Michael Stack 0e8bbbf2f7 HADOOP-2495 inor performance improvements: Slim-down BatchOperation, etc.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607602 13f79535-47bb-0310-9956-ffa450edef68
2007-12-30 22:22:16 +00:00
Michael Stack 164bc44b58 HADOOP-2485 Make mapfile index interval configurable
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607131 13f79535-47bb-0310-9956-ffa450edef68
2007-12-27 22:26:27 +00:00
Michael Stack bccf1dc26f HADOOP-2377 Holding open MapFile.Readers is expensive, so use less of them
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602199 13f79535-47bb-0310-9956-ffa450edef68
2007-12-07 19:49:19 +00:00
Jim Kellerman cbe167c981 HADOOP-2139 (phase 2) Make region server more event driven
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@597959 13f79535-47bb-0310-9956-ffa450edef68
2007-11-25 07:17:38 +00:00
Michael Stack 1aeb23aeee HADOOP-2084 Add a LocalHBaseCluster
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@588264 13f79535-47bb-0310-9956-ffa450edef68
2007-10-25 16:12:51 +00:00
Michael Stack 6c9ddf9f37 HADOOP-1957 Web UI with report on cluster state and basic browsing of tables
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@582442 13f79535-47bb-0310-9956-ffa450edef68
2007-10-06 03:09:50 +00:00
Michael Stack d60908dcf9 HADOOP-1868 Make default configuration more responsive
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@574404 13f79535-47bb-0310-9956-ffa450edef68
2007-09-10 23:27:34 +00:00
Michael Stack ea418aebbd HADOOP-1835 Updated Documentation for HBase setup/installation
M    hbase/conf/hbase-env.sh
    Removed JAVA_HOME references.
M    hbase/src/java/org/apache/hadoop/hbase/package.html
    Improved setup instruction


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@572983 13f79535-47bb-0310-9956-ffa450edef68
2007-09-05 16:12:39 +00:00
Michael Stack be33a241ce HADOOP-1644 [hbase] Compactions should not block updates
Disentangles flushes and compactions; flushes can proceed while a
compaction is happening.  Also, don't compact unless we hit
compaction threshold: i.e. don't automatically compact on HRegion
startup so regions can come online the faster.

M src/contrib/hbase/conf/hbase-default.xml
    (hbase.hregion.compactionThreashold): Moved to be a hstore property
    as part of encapsulating compaction decision inside hstore.
M src/contrib/hbase/src/test/org/apache/hadoop/hbase/HBaseTestCase.java
    Refactored.  Moved here generalized content loading code that can
    be shared by tests.  Add to setup and teardown the setup and removal
    of local test dir (if it exists).
M src/contrib/hbase/src/test/org/apache/hadoop/hbase/TestCompare.java
    Added test of HStoreKey compare (It works other than one would at
    first expect).
M src/contrib/hbase/src/test/org/apache/hadoop/hbase/TestSplit.java
    Bulk of content loading code has been moved up into the parent class.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/HConnectionManager.java
    (tableExists): Restore to a check of if the asked-for table is in list of
    tables.  As it was, a check for tableExists would just wait on all timeouts
    and retries to expire and then report table does not exist..  Fixed up
    debug message listing regions of a table.  Added protection against meta
    table not having a COL_REGINFO (Seen in cluster testing -- probably a bug
    in row removal).
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/HStoreFile.java
    Loading store files, even if it was noticed that there was no corresponding
    map file, was still counting file as valid.  Also fix merger -- was
    constructing MapFile.Reader directly rather than asking HStoreFile for
    the reader (HStoreFile knows how to do MapFile references)
    (rename): Added check that move succeeded and logging.  In cluster-testing,
    the hdfs move of compacted file into place has failed on occasion (Need
    more info).
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/HStore.java
    Encapsulate ruling on whether a compaction should take place inside HStore.
    Added reading of the compactionThreshold her.  Compaction threshold is
    currently just number of store files.  Later may include other factors such
    as count of reference files.  Cleaned up debug messages around
    reconstruction log.  Removed compaction if size > 1 from constructor.  Let
    compaction happen after we've been deployed (Compactions that happen while
    we are online can continue to take updates.  Compaction in the constructor
    puts off our being able to take in updates).
    (close): Changed so it now returns set of store files.  This used to be done
    by calls to flush. Since flush and compaction have been disentangled, a
    compaction can come in after flush and the list of files could be off.
    Having it done by close, can be sure list of files is complete.
    (flushCache): No longer returns set of store files.  Added 'merging compaction'
    where we pick an arbitrary store file from disk and merge into it the content
    of memcache (Needs work).
    (getAllMapFiles): Renamed getAllStoreFiles.
    (needsCompaction): Added.
    (compactHelper): Added passing of maximum sequence number if already
    calculated. If compacting one file only, we used skip without rewriting
    the info file.  Fixed.
    Refactored.  Moved guts to new  compact(outFile, listOfStores)  method.
    (compact, CompactionReader): Added overrides and interface  to support
    'merging compaction' that takes files and memcache.  In compaction,
    if we failed the move of the compacted file, all data had already been
    deleted.  Changing, so deletion happens after confirmed move of
    compacted file.
    (getFull): Fixed bug where NPE when read of maps came back null.
    Revealed by our NOT compacting stores on startup.  Meant could be two
    backing stores one of which had no data regards queried key.
    (getNMaps): Renamed countOfStoreFiles.
    (toString): Added.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/HStoreKey.java
    Added comment on 'odd'-looking comparison.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/HRegionServer.java
    Javadoc edit. 
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/HLogEdit.java
    Only return first 128 bytes of value when toStringing (On cluster,
    was returning complete web pages in log).
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/HMaster.java
    Removed confusing debug message (made sense once -- but not now).
    Test rootRegionLocation for null before using it (can be null).
M  src/contrib/hbase/src/java/org/apache/hadoop/hbase/HMemcache.java
    Added comment that delete behavior needs study.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/HRegion.java
    Fixed merge so it doesn't do the incremental based off files
    returned by flush.  Instead all is done in the one go after
    region closes (using files returned by close).
    Moved duplicated code to new filesByFamily method.
    (WriteState): Removed writesOngoing in favor of compacting and
    flushing flags.
    (flushCache): No longer returns list of files.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/util/Writables.java
    Fix javadoc.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@566459 13f79535-47bb-0310-9956-ffa450edef68
2007-08-16 01:07:51 +00:00
Michael Stack 5b1bd1f8f2 HADOOP-1646 RegionServer OOME's under sustained, substantial loading by
10 concurrent clients


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@559993 13f79535-47bb-0310-9956-ffa450edef68
2007-07-26 21:30:55 +00:00
Jim Kellerman c6bf382ebe HADOOP-1600 Update license in HBase code
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@555791 13f79535-47bb-0310-9956-ffa450edef68
2007-07-12 22:08:25 +00:00
Michael Stack 87f5d5dffd HADOOP-1375 a simple parser for hbase
M src/contrib/hbase/NOTICE.txt
    Add notice of udanax contributions.
Msrc/contrib/hbase/conf/hbase-default.xml
    (hbaseshell.jline.bell.enabled): Added.
M src/contrib/hbase/CHANGES.txt
    (hadoop-1375) Added.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/package.html
    Add note on how to start up hbase shell
M src/contrib/hbase/bin/hbase
    Add 'shell'.  Remove 'client' (shell does what it used do and more).
    Removed all reader and logreader until better developed.  Starting
    up a reader or logreader on a running hbase system could do damage).
M src/contrib/hbase/build.xml
    Add a javacc target to generate content of shell/generated subpackage.
A src/contrib/hbase/src/test/org/apache/hadoop/hbase/shell/TestHBaseShell.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/Shell.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/DeleteCommand.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/CreateCommand.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/DropCommand.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/InsertCommand.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/CommandFactory.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/HelpContents.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/ExitCommand.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/ConsoleTable.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/DescCommand.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/SelectCommand.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/Command.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/ShowCommand.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/BasicCommand.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/HelpManager.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/ReturnMsg.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/HelpCommand.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/HBaseShell.jj
    Added.
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/generated/Token.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/generated/TokenMgrError.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/generated/SimpleCharStream.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/generated/ParserTokenManager.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/generated/ParseException.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/generated/ParserConstants.java
A src/contrib/hbase/src/java/org/apache/hadoop/hbase/shell/generated/Parser.java
    Added javacc generated files.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@555415 13f79535-47bb-0310-9956-ffa450edef68
2007-07-11 21:54:15 +00:00
Michael Stack 655728f3bf HADOOP-1523 'Hung region servers waiting on write locks'
On shutdown, region servers and masters were just cancelling leases
without letting 'lease expired' code run -- code to clean up
outstanding locks in region server.  Outstanding read locks were
getting in the way of region server getting necessary write locks
needed for the shutdown process.  Also, cleaned up messaging around
shutdown so its clean -- no timeout messages as region servers try
to talk to a master that has already shutdown -- even when region
servers take their time going down.
M src/contrib/hbase/conf/hbase-default.xml
    Make region server timeout 30 seconds instead of 3 minutes.
    Clients retry anyways. Make so its likely region servers report
    in their shutdown message before their lease expires on master.
M src/contrib/hbase/src/java/org/apache/hadoop/hbase/Leases.java
    (closeAfterLeasesExpire): Added.
* src/contrib/hbase/src/java/org/apache/hadoop/hbase/HRegionServer.java
    Added comments.
    (stop): Converted from public to default access (master shuts
    down regionservers).
    (run): Use leases.closeAfterLeasesExpire instead of leases.close.
    Changed log of main thread exit from DEBUG to INFO.
* src/contrib/hbase/src/java/org/apache/hadoop/hbase/HMaster.java
    (letRegionsServersShutdown): Add better explaination of shutdown
    process to method doc.  Changed timeout waits from
    hbase.regionserver.msginterval to threadWakeFrequency.
    (regionServerReport): If closing, we used to immediately respond
    to region server with a MSG_REGIONSERVER_STOP.  This meant that
    we avoided handling of the region servers MSG_REPORT_EXITING sent
    on shutdown so region servers had no chance to cancel their lease
    in the master.  Reordered.  Moved sending of MSG_REGIONSERVER_STOP
    to after handling of MSG_REPORT_EXITING.  Also, in handling of
    MSG_REGIONSERER_STOP removed cancelling of leases.  Let leases
    expire normally (or get cancelled when the region server comes in
    with MSG_RPORT_EXITING).
* src/contrib/hbase/src/java/org/apache/hadoop/hbase/HMsg.java
    (MSG_REGIONSERVER_STOP_IN_ARRAY): Added.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@552376 13f79535-47bb-0310-9956-ffa450edef68
2007-07-02 00:47:13 +00:00
Jim Kellerman 6455364281 HADOOP-1509 Open HRegionServer/HClient for extension
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@550634 13f79535-47bb-0310-9956-ffa450edef68
2007-06-25 22:54:56 +00:00
Jim Kellerman e78644ed10 HADOOP-1465 Add cluster stop/start scripts for hbase
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@547427 13f79535-47bb-0310-9956-ffa450edef68
2007-06-14 22:08:56 +00:00
Jim Kellerman 09cf0a100f HADOOP-1421 HADOOP-1466 When a region server dies, its log file must be split up on a per region basis
so that region servers are assigned the regions have a log to apply edits from. Enhance fail over 
capabilities. 

For all the files modified, clean up javadoc, class method and field visibility.

git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@546192 13f79535-47bb-0310-9956-ffa450edef68
2007-06-11 16:46:27 +00:00
Jim Kellerman 3509f88c48 HADOOP-1460 On shutdown IOException with complaint 'Cannot cancel lease that is not held'
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@544512 13f79535-47bb-0310-9956-ffa450edef68
2007-06-05 15:11:57 +00:00
Jim Kellerman ac718209e5 HADOOP-1445 Support updates across region splits and compactions
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@544188 13f79535-47bb-0310-9956-ffa450edef68
2007-06-04 17:14:10 +00:00
Jim Kellerman e4194e10e5 HADOOP-1430. HBase shutdown leaves regionservers up.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@541463 13f79535-47bb-0310-9956-ffa450edef68
2007-05-24 22:37:26 +00:00
Doug Cutting add0c0c5a0 HADOOP-1325. First complete, functioning version of HBase. Contributed by Jim Kellerman.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@535970 13f79535-47bb-0310-9956-ffa450edef68
2007-05-07 19:58:53 +00:00
Doug Cutting ec9a568764 HADOOP-1282. Omnibus HBase patch. Improved tests and configuration. Contributed by Jim Kellerman.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@532083 13f79535-47bb-0310-9956-ffa450edef68
2007-04-24 21:13:08 +00:00