Commit Graph

68 Commits

Author SHA1 Message Date
Michael Stack 804155c541 HBASE-875 Use MurmurHash instead of JenkinsHash
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@698265 13f79535-47bb-0310-9956-ffa450edef68
2008-09-23 18:10:06 +00:00
Jean-Daniel Cryans d65e0b2bd6 HBASE-887 Fix a hotspot in scanners
M    conf/hbase-default.xml
Added a new config hbase.client.scanner.caching, fixed triplification
M    src/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
Implements new next(long, int) method for batching
M    src/java/org/apache/hadoop/hbase/ipc/HRegionInterface.java
Defines that new next(long, int) method
M    src/java/org/apache/hadoop/hbase/client/HTable.java
Adds new property that is passed to scanners. ClientScanner now handles caching of rows
M    src/java/org/apache/hadoop/hbase/client/MetaScanner.java
Small changes related to ScannerCallable
M    src/java/org/apache/hadoop/hbase/client/HConnectionManager.java
Same sort of small changes
M    src/java/org/apache/hadoop/hbase/client/ScannerCallable.java
Now modified because of new methods in HRS, will be able to handle caching
M    src/java/org/apache/hadoop/hbase/client/transactional/TransactionalTable.java
Passes caching to its super class


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@698198 13f79535-47bb-0310-9956-ffa450edef68
2008-09-23 14:51:22 +00:00
Michael Stack 19c87a375d HBASE-826 fix xml error in hbase-default.xml
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@690428 13f79535-47bb-0310-9956-ffa450edef68
2008-08-29 23:40:49 +00:00
Michael Stack 99f695beda HBASE-834 'Major' compactions and upper bound on files we compact at any one time
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@690423 13f79535-47bb-0310-9956-ffa450edef68
2008-08-29 23:36:02 +00:00
Michael Stack 1fb69ec11a HBASE-830 Debugging HCM.locateRegionInMeta is painful
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@686308 13f79535-47bb-0310-9956-ffa450edef68
2008-08-15 18:27:37 +00:00
Michael Stack c41834a778 HBASE-821 UnknownScanner happens too often
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@685236 13f79535-47bb-0310-9956-ffa450edef68
2008-08-12 17:30:10 +00:00
Jim Kellerman e4449cfc8f HBASE-511 Do exponential backoff in clients on NSRE, WRE, ISE, etc.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@680902 13f79535-47bb-0310-9956-ffa450edef68
2008-07-30 01:45:44 +00:00
Michael Stack 5af2380bac HBASE-779 Test changing hbase.hregion.memcache.block.multiplier to 2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@680218 13f79535-47bb-0310-9956-ffa450edef68
2008-07-28 01:12:35 +00:00
Michael Stack bc76ab38a5 HBASE-772 Up default lease period from 60 to 120 seconds
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@679559 13f79535-47bb-0310-9956-ffa450edef68
2008-07-24 21:58:50 +00:00
Michael Stack c7ffac7220 Remove mistakenly committed configuration
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@678551 13f79535-47bb-0310-9956-ffa450edef68
2008-07-21 20:24:23 +00:00
Michael Stack 6fe7bfb481 HBASE-706 On OOME, regionserver sticks around and doesn't go down with cluster
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@674958 13f79535-47bb-0310-9956-ffa450edef68
2008-07-08 21:10:33 +00:00
Michael Stack cbb2ba609d Turn off DEBUG logging on dfs -- from Rong-En Fan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@673286 13f79535-47bb-0310-9956-ffa450edef68
2008-07-02 05:32:20 +00:00
Michael Stack bcbcbc79f4 HBASE-714 Showing bytes in log when should be string (2)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@671951 13f79535-47bb-0310-9956-ffa450edef68
2008-06-26 17:06:31 +00:00
Michael Stack 5b5fc0f7d7 Backout unintentional commit of JAVA_HOME
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@668881 13f79535-47bb-0310-9956-ffa450edef68
2008-06-18 00:17:48 +00:00
Michael Stack b58c15a6d7 HBASE-487 Replace hql w/ a hbase-friendly jirb or jython shell
This commit finishes up the DDL
M  src/test/org/apache/hadoop/hbase/TestBloomFilters.java
    Changed name of default constants.
M  src/java/org/apache/hadoop/hbase/HColumnDescriptor.java
    Changed name of default constants.
    (getNameAsString): Added.
M  src/java/org/apache/hadoop/hbase/master/ModifyColumn.java
    toString column family byte array name.
M  bin/HBase.rb
    (alter, hcd): Added.
M  bin/hirb.rb
    More help doc.
    (alter, admin): Added.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@667684 13f79535-47bb-0310-9956-ffa450edef68
2008-06-13 22:42:11 +00:00
Michael Stack 4b2c5ed76d Remove mistakenly committed change to hbase-env.sh
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@663329 13f79535-47bb-0310-9956-ffa450edef68
2008-06-04 17:53:32 +00:00
Michael Stack 3dec8def1c HBASE-533 Region Historian
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@663314 13f79535-47bb-0310-9956-ffa450edef68
2008-06-04 17:18:21 +00:00
Michael Stack 7e0dd33fb7 HBASE-659 HLog#cacheFlushLock not cleared; hangs a region; revert code mistakenly committed
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@662147 13f79535-47bb-0310-9956-ffa450edef68
2008-06-01 05:06:52 +00:00
Michael Stack 359fdf6238 HBASE-659 HLog#cacheFlushLock not cleared; hangs a region
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@662146 13f79535-47bb-0310-9956-ffa450edef68
2008-06-01 04:42:11 +00:00
Michael Stack eb348cb54a Unintentional commit
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@661126 13f79535-47bb-0310-9956-ffa450edef68
2008-05-28 22:21:02 +00:00
Michael Stack cb9d586513 HBASE-487 Replace hql w/ a hbase-friendly jirb or jython shell, Part 1: Purge hql, added raw jirb
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@659445 13f79535-47bb-0310-9956-ffa450edef68
2008-05-23 06:21:16 +00:00
Michael Stack ee2ece88d8 Remove config. committed by mistake
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658899 13f79535-47bb-0310-9956-ffa450edef68
2008-05-21 22:11:37 +00:00
Michael Stack b365b0bf61 Fix broken build -- remove line that should not have been included in the HBASE-623 commit
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658100 13f79535-47bb-0310-9956-ffa450edef68
2008-05-20 05:12:31 +00:00
Michael Stack 9cb0f8bdfb HBASE-630 Default hbase.rootdir is garbage
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658098 13f79535-47bb-0310-9956-ffa450edef68
2008-05-20 04:30:18 +00:00
Michael Stack 8af6a615e2 HBASE-82 Remove mistaken conf commit
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656892 13f79535-47bb-0310-9956-ffa450edef68
2008-05-15 23:13:16 +00:00
Michael Stack 7ddd733236 HBASE-569 DemoClient.php
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656511 13f79535-47bb-0310-9956-ffa450edef68
2008-05-15 05:26:47 +00:00
Michael Stack 0c08836299 HBASE-608 HRegionServer::getThisIP() checks hadoop config var for dns interface name
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@652428 13f79535-47bb-0310-9956-ffa450edef68
2008-05-01 04:22:56 +00:00
Bryan Duxbury 49e0eaf8d9 HBASE-512 Add configuration for global aggregate memcache size
-Refactored Flusher slightly, added reclaimMemcacheMemory method
-HRegionServer calls reclaimMemcacheMemory during batchUpdates
-Added TestGlobalMemcacheLimit to verify new functionality 
-Added new config parameter defaults to hbase-default.xml

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@645740 13f79535-47bb-0310-9956-ffa450edef68
2008-04-08 00:09:20 +00:00
Michael Stack c7e72f6640 HBASE-515 At least double default timeouts between regionserver and master -- minor edit or property description
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@637197 13f79535-47bb-0310-9956-ffa450edef68
2008-03-14 18:14:45 +00:00
Michael Stack 9a40223445 HBASE-515 At least double default timeouts between regionserver and master
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@637179 13f79535-47bb-0310-9956-ffa450edef68
2008-03-14 17:47:49 +00:00
Michael Stack c1f974bbee HBASE-501 Empty region server address in info:server entry and a startcode of -1 in .META.
M conf/hbase-default.xml
Add hbase.hbasemaster.maxregionopen property.
M src/java/org/apache/hadoop/hbase/HStore.java
Change way we log. Do way less. Just emit sums of edits applied
and skipped rather than individual edits.
M src/java/org/apache/hadoop/hbase/HRegionServer.java
Make sleeper instance a local rather than data member.
(reportForDuty): Take a sleeper instance.
(run): Removed redundant wrap of a 'for' by a 'while'.
(constructor): If IOE, do not offline the region. Seen to be
an overreaction.
M src/java/org/apache/hadoop/hbase/HLog.java
Don't output map of all files being cleaned everytime a new
entry is added; instead just log new entry. Remove emission
of every 10k edits.
M src/java/org/apache/hadoop/hbase/HMaster.java
Up default for maxregionopen. Was seeing that playing edits
could take a long time (mostly because we used log every
edit) but no harm in this being longer. On REPORT_CLOSE,
emit region info, not just region so can see the properties
(W/o, made it hard to figure who was responsible for offlining).
Add logging of attempt # in shutdown processing.
Add logging of state flags passed to the close region. Helps
debugging. Also in close offline ONLY if we are NOT reassigning
the region (jimk find).
M src/java/org/apache/hadoop/hbase/util/Sleeper.java
Add logging of extraordinary sleeps or calculated periods
(suspicion is that we're sleeping way longer on loaded machies
and the regionserver appears hung).


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@636849 13f79535-47bb-0310-9956-ffa450edef68
2008-03-13 19:37:21 +00:00
Bryan Duxbury dee0ea4c7a HBASE-466 Move HMasterInterface, HRegionInterface, and HMasterRegionInterface into o.a.h.h.ipc
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630970 13f79535-47bb-0310-9956-ffa450edef68
2008-02-25 19:54:26 +00:00
Bryan Duxbury dcbc0773fc 419 Move RegionServer and related classes into regionserver package
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630550 13f79535-47bb-0310-9956-ffa450edef68
2008-02-24 00:19:34 +00:00
Jim Kellerman 8b2c345d4c HBASE-440 Add optional log roll interval so that log files are garbage collected
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627152 13f79535-47bb-0310-9956-ffa450edef68
2008-02-12 22:19:24 +00:00
Michael Stack 8dafaa567a HBASE-426 hbase can't find remote filesystem
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620058 13f79535-47bb-0310-9956-ffa450edef68
2008-02-09 01:43:59 +00:00
Michael Stack 9dccb4c8b8 HBASE-481 Move HMaster and related classes into master package
Part 4: I committed changes in below configs. unintentionally.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620052 13f79535-47bb-0310-9956-ffa450edef68
2008-02-09 00:37:15 +00:00
Michael Stack 1bc3a436dc HBASE-418 Move HMaster and related classes into master package
Part 3: Missed non-moved file edits.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620024 13f79535-47bb-0310-9956-ffa450edef68
2008-02-08 22:56:57 +00:00
Michael Stack 93a31f6a16 HBASE-2 hlog numbers should wrap around when they reach 999
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619657 13f79535-47bb-0310-9956-ffa450edef68
2008-02-07 21:48:58 +00:00
Michael Stack 56380dab8a HBASE-288 Add in-memory caching of data
(Recommit.  We'd backed it out when it was HADOOP-1398)
This commit includes updating version from 0.1.0-dev to 0.2.0-dev
and an update of the hadoop lib to move it post 0.16.0 branch.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619526 13f79535-47bb-0310-9956-ffa450edef68
2008-02-07 17:49:15 +00:00
Michael Stack 24b065cc91 HADOOP-403 Fix build after move of hbase in svn
Removed mention of all of the HADOOP_* environment variables. Made
HBASE_* equivs.  hbase-env.sh is not near dup of hadoop-env.sh.
Removed options on scripts that used take both hbase and hadoop
conf and home. Now we just work w/ hbase.  Fixed logging (logs
dir now under hbase).


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@618765 13f79535-47bb-0310-9956-ffa450edef68
2008-02-05 20:09:24 +00:00
Michael Stack 6aacbfb18d HBASE-403 Fix build after move of hbase in svn
Make it so scripts basically work again.  Make up a log4j
basic properites file (currently broke).
M    trunk/conf/hbase-env.sh
    Put a JAVA_HOME in here.  Need to set it here now instead of up in hadoop-env
A    trunk/conf/log4j.properties
    Basic log4j for hbase.
M    trunk/bin/hbase
    Made pointers up into hadoop instead point to hbase substitutions.
M    trunk/bin/start-hbase.sh
    Remove wait on dfs for moment.  Need to figure how to do it now
    we're detached (Besides there is talk that we'd acually have the
    servers come up even if they can't talk to dfs).


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@618560 13f79535-47bb-0310-9956-ffa450edef68
2008-02-05 06:15:44 +00:00
Michael Stack c6b29235e7 HBASE-403 Fix build after move of hbase in svn
Part 1: jar and test targets works as do javacc, clean.
TODO: Package needs clean up.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@618453 13f79535-47bb-0310-9956-ffa450edef68
2008-02-04 21:48:13 +00:00
Thomas White 5d2ec2506d HADOOP-1398. Add HBase in-memory block cache. Contributed by Tom White.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@618347 13f79535-47bb-0310-9956-ffa450edef68
2008-02-04 17:54:35 +00:00
Michael Stack 3e351091b6 HADOOP-2731 Under load, regions become extremely large and eventually cause
region servers to become unresponsive


git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@617720 13f79535-47bb-0310-9956-ffa450edef68
2008-02-02 00:36:53 +00:00
Jim Kellerman d3a9d1d745 HADOOP-2525 Same 2 lines repeated 11 million times in HMaster log upon HMaster shutdown
HADOOP-2616 hbase not spliting when the total size of region reaches max region size * 1.5


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@613062 13f79535-47bb-0310-9956-ffa450edef68
2008-01-18 06:11:06 +00:00
Michael Stack 40ed226cf1 HADOOP-2621 Memcache flush flushing every 60 secs with out
considering the max memcache size


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@613010 13f79535-47bb-0310-9956-ffa450edef68
2008-01-17 23:38:09 +00:00
Michael Stack ff4aac71c3 HADOOP-2589 Change an classes/package name from shell to hql
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@612016 13f79535-47bb-0310-9956-ffa450edef68
2008-01-15 05:14:34 +00:00
Michael Stack 0e8bbbf2f7 HADOOP-2495 inor performance improvements: Slim-down BatchOperation, etc.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607602 13f79535-47bb-0310-9956-ffa450edef68
2007-12-30 22:22:16 +00:00
Michael Stack 164bc44b58 HADOOP-2485 Make mapfile index interval configurable
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607131 13f79535-47bb-0310-9956-ffa450edef68
2007-12-27 22:26:27 +00:00
Michael Stack bccf1dc26f HADOOP-2377 Holding open MapFile.Readers is expensive, so use less of them
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602199 13f79535-47bb-0310-9956-ffa450edef68
2007-12-07 19:49:19 +00:00