Commit Graph

81 Commits

Author SHA1 Message Date
Andrew Kyle Purtell c4aa758efe HBASE-1062 Compactions at (re)start on a large table can overwhelm DFS
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@729560 13f79535-47bb-0310-9956-ffa450edef68
2008-12-26 23:23:04 +00:00
Michael Stack fc98eacd67 HBASE-1070 Up default index interval in TRUNK and branch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@728238 13f79535-47bb-0310-9956-ffa450edef68
2008-12-20 05:32:22 +00:00
Michael Stack 3f80f67db1 HBASE-900 Regionserver memory leak causing OOME during relatively modest bulk importing; part 2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@726153 13f79535-47bb-0310-9956-ffa450edef68
2008-12-13 01:15:39 +00:00
Michael Stack 6c33c1b1b3 HBASE-1027 Make global flusher check work with percentages rather than hard code memory sizes.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@723417 13f79535-47bb-0310-9956-ffa450edef68
2008-12-04 20:01:06 +00:00
Michael Stack c370e1cab2 HBASE-1021 hbase metrics FileContext not working
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@720286 13f79535-47bb-0310-9956-ffa450edef68
2008-11-24 20:47:58 +00:00
Michael Stack 16973669dc HBASE-938 major compaction period is not checked periodically
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@714203 13f79535-47bb-0310-9956-ffa450edef68
2008-11-15 00:46:02 +00:00
Michael Stack 67fc6fdb02 HBASE-996 Migration script to up the versions in catalog tables
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@713502 13f79535-47bb-0310-9956-ffa450edef68
2008-11-12 20:44:06 +00:00
Michael Stack e95b049d33 HBASE-625 Metrics support for cluster load history: emissions and graphs
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@709008 13f79535-47bb-0310-9956-ffa450edef68
2008-10-29 21:06:29 +00:00
Michael Stack 7e1d49358d HBASE-953 Enable BLOCKCACHE by default [WAS -> Reevaluate HBASE-288 block caching work....?]
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@708253 13f79535-47bb-0310-9956-ffa450edef68
2008-10-27 18:02:55 +00:00
Jim Kellerman d5e81859e1 HBASE-728 Support for HLog appends
- Passes all unit tests.
- Runs Performance evaluation random write in 8min, 43sec on 4 node cluster. I believe this is a new speed record.
- Eliminates time-based log rolling and cache-flushing (because of append support)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@707247 13f79535-47bb-0310-9956-ffa450edef68
2008-10-23 02:30:35 +00:00
Jean-Daniel Cryans a3b452e9b0 HBASE-748 Add an efficient way to batch update many rows
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@705770 13f79535-47bb-0310-9956-ffa450edef68
2008-10-17 22:03:29 +00:00
Michael Stack db217e6a15 HBASE-920 Make region balancing sloppier
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@704781 13f79535-47bb-0310-9956-ffa450edef68
2008-10-15 05:18:31 +00:00
Michael Stack 4100951aac Fix a few descriptions
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@703629 13f79535-47bb-0310-9956-ffa450edef68
2008-10-11 04:06:10 +00:00
Michael Stack 804155c541 HBASE-875 Use MurmurHash instead of JenkinsHash
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@698265 13f79535-47bb-0310-9956-ffa450edef68
2008-09-23 18:10:06 +00:00
Jean-Daniel Cryans d65e0b2bd6 HBASE-887 Fix a hotspot in scanners
M    conf/hbase-default.xml
Added a new config hbase.client.scanner.caching, fixed triplification
M    src/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
Implements new next(long, int) method for batching
M    src/java/org/apache/hadoop/hbase/ipc/HRegionInterface.java
Defines that new next(long, int) method
M    src/java/org/apache/hadoop/hbase/client/HTable.java
Adds new property that is passed to scanners. ClientScanner now handles caching of rows
M    src/java/org/apache/hadoop/hbase/client/MetaScanner.java
Small changes related to ScannerCallable
M    src/java/org/apache/hadoop/hbase/client/HConnectionManager.java
Same sort of small changes
M    src/java/org/apache/hadoop/hbase/client/ScannerCallable.java
Now modified because of new methods in HRS, will be able to handle caching
M    src/java/org/apache/hadoop/hbase/client/transactional/TransactionalTable.java
Passes caching to its super class


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@698198 13f79535-47bb-0310-9956-ffa450edef68
2008-09-23 14:51:22 +00:00
Michael Stack 19c87a375d HBASE-826 fix xml error in hbase-default.xml
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@690428 13f79535-47bb-0310-9956-ffa450edef68
2008-08-29 23:40:49 +00:00
Michael Stack 99f695beda HBASE-834 'Major' compactions and upper bound on files we compact at any one time
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@690423 13f79535-47bb-0310-9956-ffa450edef68
2008-08-29 23:36:02 +00:00
Michael Stack 1fb69ec11a HBASE-830 Debugging HCM.locateRegionInMeta is painful
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@686308 13f79535-47bb-0310-9956-ffa450edef68
2008-08-15 18:27:37 +00:00
Michael Stack c41834a778 HBASE-821 UnknownScanner happens too often
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@685236 13f79535-47bb-0310-9956-ffa450edef68
2008-08-12 17:30:10 +00:00
Jim Kellerman e4449cfc8f HBASE-511 Do exponential backoff in clients on NSRE, WRE, ISE, etc.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@680902 13f79535-47bb-0310-9956-ffa450edef68
2008-07-30 01:45:44 +00:00
Michael Stack 5af2380bac HBASE-779 Test changing hbase.hregion.memcache.block.multiplier to 2
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@680218 13f79535-47bb-0310-9956-ffa450edef68
2008-07-28 01:12:35 +00:00
Michael Stack bc76ab38a5 HBASE-772 Up default lease period from 60 to 120 seconds
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@679559 13f79535-47bb-0310-9956-ffa450edef68
2008-07-24 21:58:50 +00:00
Michael Stack c7ffac7220 Remove mistakenly committed configuration
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@678551 13f79535-47bb-0310-9956-ffa450edef68
2008-07-21 20:24:23 +00:00
Michael Stack 6fe7bfb481 HBASE-706 On OOME, regionserver sticks around and doesn't go down with cluster
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@674958 13f79535-47bb-0310-9956-ffa450edef68
2008-07-08 21:10:33 +00:00
Michael Stack cbb2ba609d Turn off DEBUG logging on dfs -- from Rong-En Fan
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@673286 13f79535-47bb-0310-9956-ffa450edef68
2008-07-02 05:32:20 +00:00
Michael Stack bcbcbc79f4 HBASE-714 Showing bytes in log when should be string (2)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@671951 13f79535-47bb-0310-9956-ffa450edef68
2008-06-26 17:06:31 +00:00
Michael Stack 5b5fc0f7d7 Backout unintentional commit of JAVA_HOME
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@668881 13f79535-47bb-0310-9956-ffa450edef68
2008-06-18 00:17:48 +00:00
Michael Stack b58c15a6d7 HBASE-487 Replace hql w/ a hbase-friendly jirb or jython shell
This commit finishes up the DDL
M  src/test/org/apache/hadoop/hbase/TestBloomFilters.java
    Changed name of default constants.
M  src/java/org/apache/hadoop/hbase/HColumnDescriptor.java
    Changed name of default constants.
    (getNameAsString): Added.
M  src/java/org/apache/hadoop/hbase/master/ModifyColumn.java
    toString column family byte array name.
M  bin/HBase.rb
    (alter, hcd): Added.
M  bin/hirb.rb
    More help doc.
    (alter, admin): Added.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@667684 13f79535-47bb-0310-9956-ffa450edef68
2008-06-13 22:42:11 +00:00
Michael Stack 4b2c5ed76d Remove mistakenly committed change to hbase-env.sh
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@663329 13f79535-47bb-0310-9956-ffa450edef68
2008-06-04 17:53:32 +00:00
Michael Stack 3dec8def1c HBASE-533 Region Historian
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@663314 13f79535-47bb-0310-9956-ffa450edef68
2008-06-04 17:18:21 +00:00
Michael Stack 7e0dd33fb7 HBASE-659 HLog#cacheFlushLock not cleared; hangs a region; revert code mistakenly committed
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@662147 13f79535-47bb-0310-9956-ffa450edef68
2008-06-01 05:06:52 +00:00
Michael Stack 359fdf6238 HBASE-659 HLog#cacheFlushLock not cleared; hangs a region
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@662146 13f79535-47bb-0310-9956-ffa450edef68
2008-06-01 04:42:11 +00:00
Michael Stack eb348cb54a Unintentional commit
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@661126 13f79535-47bb-0310-9956-ffa450edef68
2008-05-28 22:21:02 +00:00
Michael Stack cb9d586513 HBASE-487 Replace hql w/ a hbase-friendly jirb or jython shell, Part 1: Purge hql, added raw jirb
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@659445 13f79535-47bb-0310-9956-ffa450edef68
2008-05-23 06:21:16 +00:00
Michael Stack ee2ece88d8 Remove config. committed by mistake
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658899 13f79535-47bb-0310-9956-ffa450edef68
2008-05-21 22:11:37 +00:00
Michael Stack b365b0bf61 Fix broken build -- remove line that should not have been included in the HBASE-623 commit
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658100 13f79535-47bb-0310-9956-ffa450edef68
2008-05-20 05:12:31 +00:00
Michael Stack 9cb0f8bdfb HBASE-630 Default hbase.rootdir is garbage
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658098 13f79535-47bb-0310-9956-ffa450edef68
2008-05-20 04:30:18 +00:00
Michael Stack 8af6a615e2 HBASE-82 Remove mistaken conf commit
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656892 13f79535-47bb-0310-9956-ffa450edef68
2008-05-15 23:13:16 +00:00
Michael Stack 7ddd733236 HBASE-569 DemoClient.php
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656511 13f79535-47bb-0310-9956-ffa450edef68
2008-05-15 05:26:47 +00:00
Michael Stack 0c08836299 HBASE-608 HRegionServer::getThisIP() checks hadoop config var for dns interface name
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@652428 13f79535-47bb-0310-9956-ffa450edef68
2008-05-01 04:22:56 +00:00
Bryan Duxbury 49e0eaf8d9 HBASE-512 Add configuration for global aggregate memcache size
-Refactored Flusher slightly, added reclaimMemcacheMemory method
-HRegionServer calls reclaimMemcacheMemory during batchUpdates
-Added TestGlobalMemcacheLimit to verify new functionality 
-Added new config parameter defaults to hbase-default.xml

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@645740 13f79535-47bb-0310-9956-ffa450edef68
2008-04-08 00:09:20 +00:00
Michael Stack c7e72f6640 HBASE-515 At least double default timeouts between regionserver and master -- minor edit or property description
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@637197 13f79535-47bb-0310-9956-ffa450edef68
2008-03-14 18:14:45 +00:00
Michael Stack 9a40223445 HBASE-515 At least double default timeouts between regionserver and master
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@637179 13f79535-47bb-0310-9956-ffa450edef68
2008-03-14 17:47:49 +00:00
Michael Stack c1f974bbee HBASE-501 Empty region server address in info:server entry and a startcode of -1 in .META.
M conf/hbase-default.xml
Add hbase.hbasemaster.maxregionopen property.
M src/java/org/apache/hadoop/hbase/HStore.java
Change way we log. Do way less. Just emit sums of edits applied
and skipped rather than individual edits.
M src/java/org/apache/hadoop/hbase/HRegionServer.java
Make sleeper instance a local rather than data member.
(reportForDuty): Take a sleeper instance.
(run): Removed redundant wrap of a 'for' by a 'while'.
(constructor): If IOE, do not offline the region. Seen to be
an overreaction.
M src/java/org/apache/hadoop/hbase/HLog.java
Don't output map of all files being cleaned everytime a new
entry is added; instead just log new entry. Remove emission
of every 10k edits.
M src/java/org/apache/hadoop/hbase/HMaster.java
Up default for maxregionopen. Was seeing that playing edits
could take a long time (mostly because we used log every
edit) but no harm in this being longer. On REPORT_CLOSE,
emit region info, not just region so can see the properties
(W/o, made it hard to figure who was responsible for offlining).
Add logging of attempt # in shutdown processing.
Add logging of state flags passed to the close region. Helps
debugging. Also in close offline ONLY if we are NOT reassigning
the region (jimk find).
M src/java/org/apache/hadoop/hbase/util/Sleeper.java
Add logging of extraordinary sleeps or calculated periods
(suspicion is that we're sleeping way longer on loaded machies
and the regionserver appears hung).


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@636849 13f79535-47bb-0310-9956-ffa450edef68
2008-03-13 19:37:21 +00:00
Bryan Duxbury dee0ea4c7a HBASE-466 Move HMasterInterface, HRegionInterface, and HMasterRegionInterface into o.a.h.h.ipc
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630970 13f79535-47bb-0310-9956-ffa450edef68
2008-02-25 19:54:26 +00:00
Bryan Duxbury dcbc0773fc 419 Move RegionServer and related classes into regionserver package
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630550 13f79535-47bb-0310-9956-ffa450edef68
2008-02-24 00:19:34 +00:00
Jim Kellerman 8b2c345d4c HBASE-440 Add optional log roll interval so that log files are garbage collected
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627152 13f79535-47bb-0310-9956-ffa450edef68
2008-02-12 22:19:24 +00:00
Michael Stack 8dafaa567a HBASE-426 hbase can't find remote filesystem
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620058 13f79535-47bb-0310-9956-ffa450edef68
2008-02-09 01:43:59 +00:00
Michael Stack 9dccb4c8b8 HBASE-481 Move HMaster and related classes into master package
Part 4: I committed changes in below configs. unintentionally.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620052 13f79535-47bb-0310-9956-ffa450edef68
2008-02-09 00:37:15 +00:00
Michael Stack 1bc3a436dc HBASE-418 Move HMaster and related classes into master package
Part 3: Missed non-moved file edits.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620024 13f79535-47bb-0310-9956-ffa450edef68
2008-02-08 22:56:57 +00:00