Commit Graph

67 Commits

Author SHA1 Message Date
Jean-Daniel Cryans 4629b58bd7 HBASE-1331 Lower the default scanner caching value
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@766738 13f79535-47bb-0310-9956-ffa450edef68
2009-04-20 16:04:36 +00:00
Michael Stack 7bf66f9483 HBASE-1289 Remove hbase.fully.distributed option and update docs
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@758615 13f79535-47bb-0310-9956-ffa450edef68
2009-03-26 12:57:45 +00:00
Michael Stack c3a68eaf4c HBASE-1145 Ensure that there is only 1 Master with Zookeeper
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@755725 13f79535-47bb-0310-9956-ffa450edef68
2009-03-18 20:46:18 +00:00
Michael Stack f073189447 HBASE-61 Create an HBase-specific MapFile implementation
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@747672 13f79535-47bb-0310-9956-ffa450edef68
2009-02-25 05:59:26 +00:00
Michael Stack be84747ad3 HBASE-61 Create an HBase-specific MapFile implementation
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@747666 13f79535-47bb-0310-9956-ffa450edef68
2009-02-25 05:34:29 +00:00
Jean-Daniel Cryans 31823ff1a3 HBASE-1191 ZooKeeper ensureParentExists calls fail
on absolute path (via Nitay Joffe)
HBASE-1187  After disabling/enabling a table, the regions seems to
               be assigned to only 1-2 region servers


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@742137 13f79535-47bb-0310-9956-ffa450edef68
2009-02-08 18:37:00 +00:00
Michael Stack 2c6c26e139 HBASE-1144 Store the ROOT region location in Zookeeper
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@739115 13f79535-47bb-0310-9956-ffa450edef68
2009-01-30 01:22:05 +00:00
Jim Kellerman 542abcf26d HBASE-1121 Cluster confused about where -ROOT- is
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@737213 13f79535-47bb-0310-9956-ffa450edef68
2009-01-23 22:37:01 +00:00
Jim Kellerman 8bd2b4d7bd HBASE-1138 Set default HLog block size.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@736359 13f79535-47bb-0310-9956-ffa450edef68
2009-01-21 18:18:02 +00:00
Michael Stack 1381d23645 HBASE-1127 OOME running randomRead PE
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@735089 13f79535-47bb-0310-9956-ffa450edef68
2009-01-16 19:07:42 +00:00
Andrew Kyle Purtell c4aa758efe HBASE-1062 Compactions at (re)start on a large table can overwhelm DFS
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@729560 13f79535-47bb-0310-9956-ffa450edef68
2008-12-26 23:23:04 +00:00
Michael Stack fc98eacd67 HBASE-1070 Up default index interval in TRUNK and branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@728238 13f79535-47bb-0310-9956-ffa450edef68
2008-12-20 05:32:22 +00:00
Michael Stack 3f80f67db1 HBASE-900 Regionserver memory leak causing OOME during relatively modest bulk importing; part 2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@726153 13f79535-47bb-0310-9956-ffa450edef68
2008-12-13 01:15:39 +00:00
Michael Stack 6c33c1b1b3 HBASE-1027 Make global flusher check work with percentages rather than hard code memory sizes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@723417 13f79535-47bb-0310-9956-ffa450edef68
2008-12-04 20:01:06 +00:00
Michael Stack 7e1d49358d HBASE-953 Enable BLOCKCACHE by default [WAS -> Reevaluate HBASE-288 block caching work....?]
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@708253 13f79535-47bb-0310-9956-ffa450edef68
2008-10-27 18:02:55 +00:00
Jim Kellerman d5e81859e1 HBASE-728 Support for HLog appends
- Passes all unit tests.
- Runs Performance evaluation random write in 8min, 43sec on 4 node cluster. I believe this is a new speed record.
- Eliminates time-based log rolling and cache-flushing (because of append support)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@707247 13f79535-47bb-0310-9956-ffa450edef68
2008-10-23 02:30:35 +00:00
Jean-Daniel Cryans a3b452e9b0 HBASE-748 Add an efficient way to batch update many rows
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@705770 13f79535-47bb-0310-9956-ffa450edef68
2008-10-17 22:03:29 +00:00
Michael Stack db217e6a15 HBASE-920 Make region balancing sloppier
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@704781 13f79535-47bb-0310-9956-ffa450edef68
2008-10-15 05:18:31 +00:00
Michael Stack 4100951aac Fix a few descriptions
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@703629 13f79535-47bb-0310-9956-ffa450edef68
2008-10-11 04:06:10 +00:00
Michael Stack 804155c541 HBASE-875 Use MurmurHash instead of JenkinsHash
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@698265 13f79535-47bb-0310-9956-ffa450edef68
2008-09-23 18:10:06 +00:00
Jean-Daniel Cryans d65e0b2bd6 HBASE-887 Fix a hotspot in scanners
M    conf/hbase-default.xml
Added a new config hbase.client.scanner.caching, fixed triplification
M    src/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
Implements new next(long, int) method for batching
M    src/java/org/apache/hadoop/hbase/ipc/HRegionInterface.java
Defines that new next(long, int) method
M    src/java/org/apache/hadoop/hbase/client/HTable.java
Adds new property that is passed to scanners. ClientScanner now handles caching of rows
M    src/java/org/apache/hadoop/hbase/client/MetaScanner.java
Small changes related to ScannerCallable
M    src/java/org/apache/hadoop/hbase/client/HConnectionManager.java
Same sort of small changes
M    src/java/org/apache/hadoop/hbase/client/ScannerCallable.java
Now modified because of new methods in HRS, will be able to handle caching
M    src/java/org/apache/hadoop/hbase/client/transactional/TransactionalTable.java
Passes caching to its super class


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@698198 13f79535-47bb-0310-9956-ffa450edef68
2008-09-23 14:51:22 +00:00
Michael Stack 19c87a375d HBASE-826 fix xml error in hbase-default.xml
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@690428 13f79535-47bb-0310-9956-ffa450edef68
2008-08-29 23:40:49 +00:00
Michael Stack 99f695beda HBASE-834 'Major' compactions and upper bound on files we compact at any one time
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@690423 13f79535-47bb-0310-9956-ffa450edef68
2008-08-29 23:36:02 +00:00
Michael Stack 1fb69ec11a HBASE-830 Debugging HCM.locateRegionInMeta is painful
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@686308 13f79535-47bb-0310-9956-ffa450edef68
2008-08-15 18:27:37 +00:00
Michael Stack c41834a778 HBASE-821 UnknownScanner happens too often
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@685236 13f79535-47bb-0310-9956-ffa450edef68
2008-08-12 17:30:10 +00:00
Jim Kellerman e4449cfc8f HBASE-511 Do exponential backoff in clients on NSRE, WRE, ISE, etc.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@680902 13f79535-47bb-0310-9956-ffa450edef68
2008-07-30 01:45:44 +00:00
Michael Stack 5af2380bac HBASE-779 Test changing hbase.hregion.memcache.block.multiplier to 2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@680218 13f79535-47bb-0310-9956-ffa450edef68
2008-07-28 01:12:35 +00:00
Michael Stack bc76ab38a5 HBASE-772 Up default lease period from 60 to 120 seconds
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@679559 13f79535-47bb-0310-9956-ffa450edef68
2008-07-24 21:58:50 +00:00
Michael Stack 6fe7bfb481 HBASE-706 On OOME, regionserver sticks around and doesn't go down with cluster
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@674958 13f79535-47bb-0310-9956-ffa450edef68
2008-07-08 21:10:33 +00:00
Michael Stack cb9d586513 HBASE-487 Replace hql w/ a hbase-friendly jirb or jython shell, Part 1: Purge hql, added raw jirb
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@659445 13f79535-47bb-0310-9956-ffa450edef68
2008-05-23 06:21:16 +00:00
Michael Stack 9cb0f8bdfb HBASE-630 Default hbase.rootdir is garbage
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658098 13f79535-47bb-0310-9956-ffa450edef68
2008-05-20 04:30:18 +00:00
Michael Stack 7ddd733236 HBASE-569 DemoClient.php
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656511 13f79535-47bb-0310-9956-ffa450edef68
2008-05-15 05:26:47 +00:00
Michael Stack 0c08836299 HBASE-608 HRegionServer::getThisIP() checks hadoop config var for dns interface name
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@652428 13f79535-47bb-0310-9956-ffa450edef68
2008-05-01 04:22:56 +00:00
Bryan Duxbury 49e0eaf8d9 HBASE-512 Add configuration for global aggregate memcache size
-Refactored Flusher slightly, added reclaimMemcacheMemory method
-HRegionServer calls reclaimMemcacheMemory during batchUpdates
-Added TestGlobalMemcacheLimit to verify new functionality 
-Added new config parameter defaults to hbase-default.xml

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@645740 13f79535-47bb-0310-9956-ffa450edef68
2008-04-08 00:09:20 +00:00
Michael Stack c7e72f6640 HBASE-515 At least double default timeouts between regionserver and master -- minor edit or property description
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@637197 13f79535-47bb-0310-9956-ffa450edef68
2008-03-14 18:14:45 +00:00
Michael Stack 9a40223445 HBASE-515 At least double default timeouts between regionserver and master
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@637179 13f79535-47bb-0310-9956-ffa450edef68
2008-03-14 17:47:49 +00:00
Michael Stack c1f974bbee HBASE-501 Empty region server address in info:server entry and a startcode of -1 in .META.
M conf/hbase-default.xml
Add hbase.hbasemaster.maxregionopen property.
M src/java/org/apache/hadoop/hbase/HStore.java
Change way we log. Do way less. Just emit sums of edits applied
and skipped rather than individual edits.
M src/java/org/apache/hadoop/hbase/HRegionServer.java
Make sleeper instance a local rather than data member.
(reportForDuty): Take a sleeper instance.
(run): Removed redundant wrap of a 'for' by a 'while'.
(constructor): If IOE, do not offline the region. Seen to be
an overreaction.
M src/java/org/apache/hadoop/hbase/HLog.java
Don't output map of all files being cleaned everytime a new
entry is added; instead just log new entry. Remove emission
of every 10k edits.
M src/java/org/apache/hadoop/hbase/HMaster.java
Up default for maxregionopen. Was seeing that playing edits
could take a long time (mostly because we used log every
edit) but no harm in this being longer. On REPORT_CLOSE,
emit region info, not just region so can see the properties
(W/o, made it hard to figure who was responsible for offlining).
Add logging of attempt # in shutdown processing.
Add logging of state flags passed to the close region. Helps
debugging. Also in close offline ONLY if we are NOT reassigning
the region (jimk find).
M src/java/org/apache/hadoop/hbase/util/Sleeper.java
Add logging of extraordinary sleeps or calculated periods
(suspicion is that we're sleeping way longer on loaded machies
and the regionserver appears hung).


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@636849 13f79535-47bb-0310-9956-ffa450edef68
2008-03-13 19:37:21 +00:00
Bryan Duxbury dee0ea4c7a HBASE-466 Move HMasterInterface, HRegionInterface, and HMasterRegionInterface into o.a.h.h.ipc
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630970 13f79535-47bb-0310-9956-ffa450edef68
2008-02-25 19:54:26 +00:00
Bryan Duxbury dcbc0773fc 419 Move RegionServer and related classes into regionserver package
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630550 13f79535-47bb-0310-9956-ffa450edef68
2008-02-24 00:19:34 +00:00
Jim Kellerman 8b2c345d4c HBASE-440 Add optional log roll interval so that log files are garbage collected
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627152 13f79535-47bb-0310-9956-ffa450edef68
2008-02-12 22:19:24 +00:00
Michael Stack 8dafaa567a HBASE-426 hbase can't find remote filesystem
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620058 13f79535-47bb-0310-9956-ffa450edef68
2008-02-09 01:43:59 +00:00
Michael Stack 1bc3a436dc HBASE-418 Move HMaster and related classes into master package
Part 3: Missed non-moved file edits.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620024 13f79535-47bb-0310-9956-ffa450edef68
2008-02-08 22:56:57 +00:00
Michael Stack 56380dab8a HBASE-288 Add in-memory caching of data
(Recommit.  We'd backed it out when it was HADOOP-1398)
This commit includes updating version from 0.1.0-dev to 0.2.0-dev
and an update of the hadoop lib to move it post 0.16.0 branch.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619526 13f79535-47bb-0310-9956-ffa450edef68
2008-02-07 17:49:15 +00:00
Michael Stack c6b29235e7 HBASE-403 Fix build after move of hbase in svn
Part 1: jar and test targets works as do javacc, clean.
TODO: Package needs clean up.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@618453 13f79535-47bb-0310-9956-ffa450edef68
2008-02-04 21:48:13 +00:00
Thomas White 5d2ec2506d HADOOP-1398. Add HBase in-memory block cache. Contributed by Tom White.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@618347 13f79535-47bb-0310-9956-ffa450edef68
2008-02-04 17:54:35 +00:00
Michael Stack 3e351091b6 HADOOP-2731 Under load, regions become extremely large and eventually cause
region servers to become unresponsive


git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@617720 13f79535-47bb-0310-9956-ffa450edef68
2008-02-02 00:36:53 +00:00
Jim Kellerman d3a9d1d745 HADOOP-2525 Same 2 lines repeated 11 million times in HMaster log upon HMaster shutdown
HADOOP-2616 hbase not spliting when the total size of region reaches max region size * 1.5


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@613062 13f79535-47bb-0310-9956-ffa450edef68
2008-01-18 06:11:06 +00:00
Michael Stack 40ed226cf1 HADOOP-2621 Memcache flush flushing every 60 secs with out
considering the max memcache size


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@613010 13f79535-47bb-0310-9956-ffa450edef68
2008-01-17 23:38:09 +00:00
Michael Stack ff4aac71c3 HADOOP-2589 Change an classes/package name from shell to hql
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@612016 13f79535-47bb-0310-9956-ffa450edef68
2008-01-15 05:14:34 +00:00
Michael Stack 0e8bbbf2f7 HADOOP-2495 inor performance improvements: Slim-down BatchOperation, etc.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607602 13f79535-47bb-0310-9956-ffa450edef68
2007-12-30 22:22:16 +00:00