Apache
/
hbase
1
0
Fork 0
Code Issues Pull Requests Packages Projects Releases Wiki Activity
801 Commits 95 Branches 866 Tags 550 MiB
Commit Graph

598 Commits

Author SHA1 Message Date
Jim Kellerman 5a8da86833 HBASE-611 regionserver should do basic health check before reporting alls-well to the master 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@654301 13f79535-47bb-0310-9956-ffa450edef68
 2008-05-07 22:08:21 +00:00
Jim Kellerman 4aa78f4f28 HBASE-453 undeclared throwable exception from HTable.get 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@654256 13f79535-47bb-0310-9956-ffa450edef68
 2008-05-07 20:19:53 +00:00
Jim Kellerman eaa03f245b HBASE-600 Filters have excessive DEBUG logging 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@654229 13f79535-47bb-0310-9956-ffa450edef68
 2008-05-07 19:35:47 +00:00
Jim Kellerman b3f4ddc1bc HBASE-478 offlining of table does not run reliably 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@654193 13f79535-47bb-0310-9956-ffa450edef68
 2008-05-07 17:56:06 +00:00
Michael Stack cfefc60bac HBASE-619 Fix 'logs' link in UI 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@654184 13f79535-47bb-0310-9956-ffa450edef68
 2008-05-07 17:31:29 +00:00
Michael Stack 20ee89aa4c HBASE-618 We always compact if 2 files, regardless of the compaction threshold setting 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@654169 13f79535-47bb-0310-9956-ffa450edef68
 2008-05-07 16:58:10 +00:00
Michael Stack 2eef957d36 HBASE-47 option to set TTL for columns in hbase 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@653986 13f79535-47bb-0310-9956-ffa450edef68
 2008-05-07 04:17:09 +00:00
Jim Kellerman 8df7f79781 HBASE-405 TIF and TOF use log4j directly rather than apache commons-logging 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@653941 13f79535-47bb-0310-9956-ffa450edef68
 2008-05-06 22:18:24 +00:00
Jim Kellerman ab778e22e4 HBASE-607 MultiRegionTable.makeMultiRegionTable is not deterministic enough for regression tests 
M MultiRegionTable

  Make deterministic by creating the regions directly and not rely on
  the asychronous nature of cache flushes, compactions and splits. The
  regions are small, but the point of this class is to generate a
  table with multiple regions so we can test map / reduce, region
  onlining / offlining, etc.

  Removed PUNCTUATION from row keys. Not sure why it was there in the
  first place, other than perhaps to verify that a row key can have
  punctuation in it provided it is not the first character. This will
  become moot when row keys change from Text to byte[] anyways.

  Incorporate repeated code
{code}
    region.close();
    region.getLog().closeAndDelete();
{code}
  into private method closeRegionAndDeleteLog

M TestSplit

  extends HBaseClusterTestCase instead of MultiRegionTable. It didn't
  use the output of MultiRegionTable, so all that work was just wasted
  by this test.

M TestTableIndex, TestTableMapReduce

  The only two tests that currently use MultiRegionTable. Minor
  modifications needed because MultiRegionTable now handles starting
  and stopping of the mini-DFS cluster. With the new MultiRegionTable
  class, if these tests fail now it will be because something they are
  testing has regressed and not because MultiRegionTable failed.



git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@652587 13f79535-47bb-0310-9956-ffa450edef68
 2008-05-01 17:37:24 +00:00
Michael Stack c70e4fa984 HBASE-609 Master doesn't see regionserver edits because of clock skew 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@652436 13f79535-47bb-0310-9956-ffa450edef68
 2008-05-01 06:05:58 +00:00
Michael Stack 0c08836299 HBASE-608 HRegionServer::getThisIP() checks hadoop config var for dns interface name 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@652428 13f79535-47bb-0310-9956-ffa450edef68
 2008-05-01 04:22:56 +00:00
Michael Stack 9cd46728ff HBASE-604 Don't allow CLASSPATH from environment pollute the hbase CLASSPATH 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@652189 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-29 23:29:17 +00:00
Bryan Duxbury 1deedc318a HBASE-603 When an exception bubbles out of getRegionServerWithRetries, wrap the exception with a RetriesExhaustedException 
-Added RetriesExhaustedException to client package
-HTable now throws REE when retries run out

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@652185 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-29 23:03:20 +00:00
Michael Stack 21da84cfea HBASE-601 Just remove deprecated methods in HTable; 0.2 is not backward compatible anyways 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@652054 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-28 04:58:09 +00:00
Michael Stack cecc9e99ff HBASE-581 Allow adding filters to TableInputFormat (At same time, ensure TIF is subclassable) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@651368 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-24 19:48:32 +00:00
Michael Stack fb2db8cdaa HBASE-588 Still a 'hole' in scanners, even after HBASE-532 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@651018 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-23 19:22:15 +00:00
Jim Kellerman 3607d3e0db HBASE-584 Names in the filter interface are confusing (Clint Morgan via Jim Kellerman) (API change for filters) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@650711 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-23 01:03:38 +00:00
Michael Stack 2bf301a4df HBASE-596 DemoClient.py 
Added licenses to examples along w/ committing new Python example.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@650333 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-22 00:39:02 +00:00
Michael Stack cffa3a254e HBASE-586 HRegion runs HStore memcache snapshotting -- fix it so only HStore 
knows about workings of memcache

HStore knows about workings of memcache

This patch moves the running of mecache snapshots out of the control
of HRegion and hides the memcache details in HStore.   This patch also
does a bunch of work on the merge tool fixing a bug in the metautils along
the way.  The merge tool test was failing.  We weren't setting into the
HLog the maximum sequence id after we'd opened a region -- as HRS does --
so were losing edits. On the way, refactored the merge tool test to get
rid of duplicated code.  Finally, cleans up logging in HStore to aid
debugging; e.g. we always refer to the sequence id as the 'sequence id'
in log messages rather than as seqId or 'sequence record' so can sort
log as see state of sequence id transitions.

Version 2 changes the order in which things are run in memcache.  532
made it so flushing did snapshot and then cleared the snapshot.  Now,
we snapshot before we flush a store, then inside in the store flush,
we call getSnapshot and then clearSnapshot.

M  src/test/org/apache/hadoop/hbase/regionserver/TestHMemcache.java
  How snapshotting changed.  Change test in accordance.
M  src/test/org/apache/hadoop/hbase/regionserver/TestHLog.java
  Use accessor to get file number.
M  src/test/org/apache/hadoop/hbase/util/TestMergeTool.java
  Refactored to remove duplicated code so could tell what was going on.
  (mergeAndVerify, verifyMerge): Addd.
M  src/java/org/apache/hadoop/hbase/regionserver/Memcache.java
  (snapshot): Changed so it no longer returns snapshot.
M  src/java/org/apache/hadoop/hbase/regionserver/HStore.java
  Changed log messages removing the useless and adding info to others.
  (this.maxSeqId): We used to add 1 to this in here in HStore.  Let
  HRegion do it.  Its the one that does the machinations w/ sequenceids
  anyways.  Make flushes return the amount flushed.  Use this updating
  the regions memcacheSize accounting.
  (snapshot): Added method for the region to call.
M  src/java/org/apache/hadoop/hbase/regionserver/HLog.java
  Made data members private.
  (getFileNum): Added accessor for tests.
M  src/java/org/apache/hadoop/hbase/regionserver/HRegion.java
  Added info to logs..
  (snapshotMemcaches): removed.
  (internalFlushcache): No longer takes startime.  Internally now does
  some of what used happen in snapshotMemcaches including sending of
  message to stores to snapshot.
  (getEntrySize): Added method for calculating size of an update. Used
  by HRegion and flushing so both come up w/ same answer.
M  src/java/org/apache/hadoop/hbase/util/Merge.java
  Add logging of whats happening during merges and fail earlier than we
  used if stuff is not right.
  Renamed local variables from region1 to r1, etc., so didn't clash
  with data members of same name.
M  src/java/org/apache/hadoop/hbase/util/MetaUtils.java
  Added a TODO



git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@650298 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-21 22:19:30 +00:00
Michael Stack e411d3c61f HBASE-595 RowFilterInterface.rowProcessed() is called *before* fhe final 
filtering decision is made


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@650202 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-21 16:46:31 +00:00
Michael Stack 66e545adf0 HBASE-598 Loggging, no .log file; all goes into .out 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@649938 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-20 15:40:07 +00:00
Jim Kellerman 5af9719de3 HBASE-10 HRegionServer hangs upon exit due to DFSClient Exception 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@649373 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-18 05:32:23 +00:00
Michael Stack 373761483f HBASE-532 Odd interaction between HRegion.get, HRegion.deleteAll and compactions 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@648850 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-16 21:07:32 +00:00
Michael Stack 9ad3122021 HBASE-582 HBase 554 forgot to clear results on each iteration caused by a filter 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@648798 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-16 19:23:41 +00:00
Jim Kellerman baa84cb4a1 HBASE-575 master dies with stack overflow error if rootdir isn't qualified 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@648427 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-15 21:45:28 +00:00
Michael Stack 863ac0c605 HBASE-559 MR example job to count table rows 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@648422 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-15 21:39:20 +00:00
Michael Stack 82901024c9 HBASE-12 when hbase regionserver restarts, it says "impossible state for createLease()" 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@648110 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-15 03:36:39 +00:00
Jim Kellerman 9a80650d97 HBASE-11 Unexpected exits corrupt DFS 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@648030 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-14 22:07:11 +00:00
Michael Stack 73f126dbe9 HBASE-573 HBase does not read hadoop-*.xml for dfs configuration after moving out hadoop/contrib 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@647989 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-14 20:33:03 +00:00
Jim Kellerman bc4b9b2c1c Update CHANGES.txt - bug fix was listed in wrong section 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@647963 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-14 19:36:44 +00:00
Michael Stack 1475f271cf HBASE-574 HBase does not load hadoop native libs 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@647959 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-14 19:34:11 +00:00
Jim Kellerman 278bd7e772 NPE getting scanner 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@647953 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-14 19:27:17 +00:00
Bryan Duxbury fd202765c9 HBASE-523 package-level javadoc should have example client 
-updated docs

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@646105 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-08 22:22:45 +00:00
Bryan Duxbury efce1b3d09 HBASE-521 Improve client scanner interface 
-Removed HScannerInterface and HInternalScannerInterface
-Created new interfaces Scanner for clients and InternalScanner for internal consumers
-Internal and client scanners no longer share common interface
-Client scanner's next() method and iterables are in RowResults
-Updated tests and internal consumers to use Scanner in place of HScannerInterface
-HTable obtainScanner(*) are now renamed getScanner(*)
-Tests have ScannerIncommon to turn Scanners into InternalScanners for some tests
-Fixed a bug in HMaster that was eating TableExistsExceptions (unrelated)
-Updated TableInputFormat to provide RowResults instead of MapWritables
-Updated TableOutputFormat to take BatchUpdates instead of MapWritables
-Updated TableMap, TableReduce, and friends to correctly hook up to new input/output formats

HBASE-567   Reused BatchUpdate instances accumulate BatchOperations
- Fix to BatchUpdate that allows correct reuse of BatchUpdate instances (readFields didn't clear BatchOperation map)
- Update TestSerialization to prove above is fixed


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@646104 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-08 22:17:51 +00:00
Jim Kellerman 53563c5586 HBASE-554 filters generate StackOverflowException - fix typo other commit went to 544 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@646033 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-08 18:59:06 +00:00
Jim Kellerman 6410feb071 HBASE-544 filters generate StackOverflowException 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@646031 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-08 18:56:36 +00:00
Bryan Duxbury 49e0eaf8d9 HBASE-512 Add configuration for global aggregate memcache size 
-Refactored Flusher slightly, added reclaimMemcacheMemory method
-HRegionServer calls reclaimMemcacheMemory during batchUpdates
-Added TestGlobalMemcacheLimit to verify new functionality 
-Added new config parameter defaults to hbase-default.xml

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@645740 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-08 00:09:20 +00:00
Jim Kellerman 7813444a9b HBASE-564 Don't do a cache flush if there are zero entries in the cache. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@645690 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-07 21:08:48 +00:00
Jim Kellerman 2da5e018af HBASE-507 Use Callable pattern to sleep between retries 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@645014 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-05 02:15:34 +00:00
Jim Kellerman 9c3fba564c HBASE-563 TestRowFilterAfterWrite erroneously sets master address to 0.0.0.0:60100 rather than relying on conf 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@644948 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-04 21:55:47 +00:00
Jim Kellerman 1e3705f750 HBASE-541 Update hadoop jars. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@644905 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-04 20:48:46 +00:00
Bryan Duxbury 9ea7aec67d HBASE-452 "region offline" should throw IOException, not IllegalStateException 
-HConnectionManager#locateRegionInMeta no longer throws ISE, instead throws new RegionOfflineException
-Removed duplicated code for catching exceptions for retries

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@644854 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-04 19:44:46 +00:00
Bryan Duxbury bb8dce00f2 HBASE-557 HTable.getRow() should receive RowResult objects 
-Updated HRegionInterface, HRegionServer, HRegion, HStore to provide RowResults as the return of getRow methods
-Updated HTable to expect RowResult objects
-Updated ThriftServer to expect RowResults
-Cleaned up HConnectionManager's interaction with region servers

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@644828 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-04 19:13:56 +00:00
Bryan Duxbury 0c3d5abbc8 HBASE-544 Purge startUpdate from all internal code and test cases 
Removes startUpdate calls from all but a few places. TestBatchUpdate and TestMultipleUpdates both stay the same, but TMU will be removed when startUpdate is. Parts of TBU will also be whacked when we remove the deprecated methods. HTable still has its startUpdate methods.

Changed the Incommon interface to remove the startUpdate, put, delete, and commit methods, and made a new commit(BatchUpdate).

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@644811 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-04 18:22:56 +00:00
Michael Stack 589a407f0c HBASE-561 HBase package does not include LICENSE.txt nor build.xml 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@644536 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-03 22:39:46 +00:00
Bryan Duxbury 228fd03bac HBASE-71 [hbase] Master should rebalance region assignments periodically 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@644441 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-03 19:03:59 +00:00
Jim Kellerman 6e225dd7f1 HBASE-469 Streamline HStore startup and compactions 
HMerge, HRegionServer

- changes that reflect changes to HRegion, CompactSplitThread and Flusher methods

ServerManager

- Return zero length array to region server if it is exiting or quiesced and Master is not yet ready to shut down.

QueueEntry

- removed. no longer used.

CompactSplitThread

- make compactionQueue a queue of HRegion.
- Add Set<HRegion> so we can quickly determine if a region is in the queue. BlockingQueue.contains() does a linear scan of the queue.
- Add a lock and interruptPolitely methods so that compactions/splits in progress are not interrupted.
- Don't add a region to the queue if it is already present.

Flusher

- change queue from DelayQueue to BlockingQueue, with HRegion entries instead of QueueEntry.
- Add Set<HRegion> to quickly determine if a region is already in the queue to avoid linear scan of BlockingQueue.contains().
- Only put regions in the queue for optional cache flush if the last time they were flushed is older than now - optionalFlushInterval.
- Only add regions to the queue if it is not already present.

HRegion

- don't request a cache flush if one has already been requested.
- Add setLastFlushTime so flusher can set it once it has queued an optional flush.
- Replace largestHStore with getLargestHStoreSize: returns long instead of HStoreSize object.
- Add midKey as parameter to splitRegion.
- Reorder start of splitRegion so it doesn't do any work before validating parameters.
- Remove needsSplit and compactIfNeeded - no longer needed.
- compactStores now returns midKey if split is needed.
- snapshotMemcaches now sets flushRequested to false and sets lastFlushTime to now.
- update does not request a cache flush if one has already been requested.
- Override equals and hashCode so HRegions can be stored in a HashSet.

HStore

- loadHStoreFiles now computes max sequence id and the initial size of the store.
- Add getter for family.
- internalCacheFlush updates store size, and logs both size of cache flush and resulting map file size (with debug logging enabled).
- Remove needsCompaction and hasReferences - no longer needed.
- compact() returns midKey if store needs to be split.
- compact() does all checking before actually starting a compaction.
- If store size is greater than desiredMaxFileSize, compact returns the midKey for the store regardless of whether a compaction was actually done.
- Added more synchronization in completeCompaction while iterating over storeFiles.
- completeCompaction computes new store size.
- New method checkSplit replaces method size. Returns midKey if store needs to be split and can be split.

HStoreSize

- removed. No longer needed.

HBaseTestCase

- only set fs if it has not already been set by a subclass.

TestTableIndex, TestTableMapReduce

- call FSUtil.deleteFully to clean up cruft left in local fs, by MapReduce


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@643761 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-02 06:58:26 +00:00
Michael Stack 92a8e04b85 git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@643621 13f79535-47bb-0310-9956-ffa450edef68 2008-04-01 22:12:23 +00:00
Michael Stack 6c124cd285 HBASE-548 Tool to online single region 
M    branches/0.1/src/java/org/apache/hadoop/hbase/util/MetaUtils.java
M    trunk/src/java/org/apache/hadoop/hbase/util/MetaUtils.java
    (changeOnlineStatus): Added.



git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@643486 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-01 17:52:46 +00:00
Michael Stack f15048d4d0 HBASE-505 Region assignments should never time out so long as the region 
server reports that it is processing the open request

This is patch reviewed with Jim but with the number of edits between
reports made into a configurable.

Have the HRegionServer pass down a Progressable implementation down into
Region and then down int Store where edits are replayed. Call progress
after every couple of thousand edits.

M src/java/org/apache/hadoop/hbase/HStore.java
  Take a Progessable in the constructor. Call it when applying edits.
M src/java/org/apache/hadoop/hbase/HMaster.java
  Update commment around MSG_REPORT_PROCESS_OPEN so its expected
  that we can get more than one of these messages during a region open.
M src/java/org/apache/hadoop/hbase/HRegion.java
  New constructor that takes a Progressable. Pass it to Stores on construction.
M src/java/org/apache/hadoop/hbase/HRegionServer.java
  On open of a region, pass in a Progressable that adds a
MSG_REPORT_PROCESS_OPEN every time its called.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@643223 13f79535-47bb-0310-9956-ffa450edef68
 2008-04-01 00:09:25 +00:00
Michael Stack 198a156334 HBASE-551 Master stuck splitting server logs in shutdown loop; 
on eachiteration, edits are aggregated up into the millions
M src/java/org/apache/hadoop/hbase/HLog.java
    (splitLog): If an exception processing a split, catch it.
    In finally, close and delete the split. Don't try retrying.
    While in some circumstance, we might recover, its also
    likely that we just get same exception again. If so, and
    multiple files, we'll just accumulate edits until the
    kingdom comes.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@643142 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-31 20:47:47 +00:00
Michael Stack 1197d65839 HBASE-550 EOF trying to read reconstruction log stops region deployment 
M CHANGES.txt
    Fix mis-committed changelog.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@643113 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-31 19:34:09 +00:00
Michael Stack 53a6abfe6e HBASE-550 EOF trying to read reconstruction log stops region deployment 
M  src/java/org/apache/hadoop/hbase/HStore.java
    (Constructor) If an exception out of reconstructionLog method, log it and
    keep going.  Presumption is that its result of a lack of HADOOP--1700.
    (reconstructionLog): Check for empty log file.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@643110 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-31 19:26:47 +00:00
Michael Stack 46ff7775f6 HBASE-534 Double-assignment at SPLIT-time 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@640625 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-24 22:42:14 +00:00
Bryan Duxbury 65d961ae78 HBASE-536 Remove MiniDFS startup from MiniHBaseCluster 
-Changed MiniHBaseCluster to not start up a MiniDFS
-Changed HBaseClusterTestCase to do the work of starting up a MiniDFS.
-Added pre and post setup method to HBaseClusterTestCase so you can control what happen before MiniHBaseCluster is booted up
-Converted AbstractMergeTestCase to be a HBaseClusterTestCase
-Converted any test that used a raw MIniDFS or MiniHBaseCluster to use HBaseClusterTestCase instead
-Split TestTimestamp into two tests - one for clientside (now in o.a.h.h.client) and one for serverside (o.a.h.h.regionserver)
-Merged in Stack's changes to make bin/hbase have hadoop jars first on the classpath
-Updated PerformanceEvaluation (in --miniCluster mode) to start up a DFS first
-Fixed a bug in BaseScanner that would have allowed NPEs to be generated


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@640526 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-24 19:13:56 +00:00
Jim Kellerman aabe9f09a9 HBASE-476 RegexpRowFilter behaves incorectly when there are multiple store files (Clint Morgan via Jim Kellerman) 
HBASE-527   RegexpRowFilter does not work when there are columns from multiple families (Clint Morgan via Jim Kellerman)


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@640106 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-22 22:35:36 +00:00
Jim Kellerman e7b705a808 HBASE-537 Wait for hdfs to exit safe mode 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@639858 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-21 21:31:23 +00:00
Jim Kellerman a9d8d51663 HBASE-531 Merge tool won't merge two overlapping regions (port HBASE-483 to trunk) (See HBASE-483 for list of changes) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@639775 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-21 19:46:34 +00:00
Michael Stack 9fa72c0177 HBASE-526 Add documentation src and build to the 0.1 branch 
Second part of documentation commit.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@638612 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-18 22:32:14 +00:00
Bryan Duxbury feb4f2d2b6 HBASE-528 table 'does not exist' when it does 
-Changed HStore and Memcache methods for computing closest row at or before
-Added more test cases for verifying this functionality
-Simplified the getClosestRowBefore interface so that it does not take timestamps
-Noted that getClosestRowBefore is assumed to work correctly ONLY on tables where updates are always with ascending timestamps (method is still not a part of HTable interface, so not available to clients)

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@638598 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-18 21:48:22 +00:00
Bryan Duxbury f66e157e5e HBASE-529 RegionServer needs to recover if datanode goes down 
-HLog will now try to reopen the log twice on append failure before taking the region server down

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@638597 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-18 21:44:02 +00:00
Bryan Duxbury ea1ac1f75c HBASE-524 Problems with getFull 
-Added new test case to exercise the problems
-Fixed getFull implementation in HStore and Memcache

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@638525 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-18 19:34:33 +00:00
Bryan Duxbury f8fc7bdd77 HBASE-525 HTable.getRow(Text) does not work 
-Fixed broken set initialization in HRegionServer

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@638150 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-18 00:13:23 +00:00
Bryan Duxbury 37cf8a8cfb HBASE-506 When an exception has to escape ServerCallable due to exhausted retries, show all the exceptions that lead to this situation 
-Updated ServerCallable to track a list of exceptions and report them all when the process runs out of retries

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@637474 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-15 21:15:45 +00:00
Michael Stack 9a40223445 HBASE-515 At least double default timeouts between regionserver and master 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@637179 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-14 17:47:49 +00:00
Jim Kellerman 5d4ed8436d HBASE-516 HStoreFile.finalKey does not update the final key if it is not the top region of a split region 
Modified HStoreFile$HalfMapFileReader.finalKey

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@637002 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-14 05:57:54 +00:00
Michael Stack c1f974bbee HBASE-501 Empty region server address in info:server entry and a startcode of -1 in .META. 
M conf/hbase-default.xml
Add hbase.hbasemaster.maxregionopen property.
M src/java/org/apache/hadoop/hbase/HStore.java
Change way we log. Do way less. Just emit sums of edits applied
and skipped rather than individual edits.
M src/java/org/apache/hadoop/hbase/HRegionServer.java
Make sleeper instance a local rather than data member.
(reportForDuty): Take a sleeper instance.
(run): Removed redundant wrap of a 'for' by a 'while'.
(constructor): If IOE, do not offline the region. Seen to be
an overreaction.
M src/java/org/apache/hadoop/hbase/HLog.java
Don't output map of all files being cleaned everytime a new
entry is added; instead just log new entry. Remove emission
of every 10k edits.
M src/java/org/apache/hadoop/hbase/HMaster.java
Up default for maxregionopen. Was seeing that playing edits
could take a long time (mostly because we used log every
edit) but no harm in this being longer. On REPORT_CLOSE,
emit region info, not just region so can see the properties
(W/o, made it hard to figure who was responsible for offlining).
Add logging of attempt # in shutdown processing.
Add logging of state flags passed to the close region. Helps
debugging. Also in close offline ONLY if we are NOT reassigning
the region (jimk find).
M src/java/org/apache/hadoop/hbase/util/Sleeper.java
Add logging of extraordinary sleeps or calculated periods
(suspicion is that we're sleeping way longer on loaded machies
and the regionserver appears hung).


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@636849 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-13 19:37:21 +00:00
Bryan Duxbury 8c815c72f4 HBASE-443 Move internal classes out of HStore 
-Moved out classes Memcache, StoreFileScanner, MapFileCompactionReader, and HStoreScanner, and interface CompactionReader
-Updated TestHMemcache to use the correct type declaration.

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@636815 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-13 18:06:08 +00:00
Jim Kellerman 9057e559a1 HBASE-27 hregioninfo cell empty in meta table 
Summary of changes:

HMaster:

- When a row has an empty HRegionInfo (info:regioninfo), log it with the row name and and the other keys still in the row.

- Log the number of rows with empty HRegionInfo

- Delete the rows

- Make RowMap inner class static, change methods to have package scope to avoid synthetic accessors.

- Provide row name to getHRegionInfo so it can issue better log messages

- add method deleteEmptyMetaRows to remove rows with empty HRegionInfo

HRegion

- change removeRegionFromMETA to use deleteAll rather than using a BatchUpdate containing deletes for each cell.

TestEmptyMetaInfo

- new test case



git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@636589 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-13 00:33:13 +00:00
Bryan Duxbury 6fb7767fc6 HBASE-40 [hbase] Add a method of getting multiple (but not all) cells for a row at once 
-new override of getRow added to the whole stack
-test for new override added to TestGet2

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@636415 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-12 16:58:10 +00:00
Jim Kellerman 082e0237fd HBASE-433 HBASE-251 Region server should delete restore log after successful restore, Stuck replaying the edits of crashed machine. 
HLog

- don't overwrite oldlogfile in splitLog if it already exists. Rename it and copy it into the new oldlogfile. Then delete it once it has been copied.
- use FileUtil.fullyDelete to delete region server log directory.

HRegion

- delete oldlogfile once it has been successfully processed


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@636396 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-12 16:20:07 +00:00
Michael Stack da6dde97ce HBASE-495 No server address listed in .META. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@634791 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-07 19:55:26 +00:00
Michael Stack 57d1bde0e0 HBASE-476 Passing on edits, we dump all to log 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@634443 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-06 23:00:37 +00:00
Michael Stack 8de1e7de79 HBASE-496 impossible state for createLease writes 400k lines in about 15mins 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@634395 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-06 19:49:54 +00:00
Jim Kellerman a0f73c7efd HBASE-492 hbase TRUNK does not build against hadoop TRUNK 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@634168 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-06 05:09:33 +00:00
Michael Stack 36b5f4791f HBASE-490 Doubly-assigned .META.; master uses one and clients another 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@633597 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-04 19:25:14 +00:00
Michael Stack ab8b5920a9 HBASE-477 Add support for an HBASE_CLASSPATH 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@633240 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-03 19:18:53 +00:00
Michael Stack 4e2efbe801 HBASE-480 Tool to manually merge two regions 
Commit to TRUNK and branch.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@632663 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-01 22:07:12 +00:00
Jim Kellerman 8aa6130bb4 HBASE-479 Speed up TestLogRolling 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@632533 13f79535-47bb-0310-9956-ffa450edef68
 2008-03-01 01:52:59 +00:00
Bryan Duxbury 1dc387a0a6 HBASE-473 When a table is deleted, master sends multiple close messages to the region server 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@632131 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-28 22:08:35 +00:00
Bryan Duxbury dee0ea4c7a HBASE-466 Move HMasterInterface, HRegionInterface, and HMasterRegionInterface into o.a.h.h.ipc 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630970 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-25 19:54:26 +00:00
Bryan Duxbury f48c1d7893 HBASE-442 Move internal classes out of HRegionServer 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630968 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-25 19:50:02 +00:00
Jim Kellerman d280d4d0ec HBASE-468 Move HStoreKey back to o.a.h.h 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630605 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-24 09:22:10 +00:00
Bryan Duxbury 8e6a233085 HBASE-464 HBASE-419 introduced javadoc errors 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630556 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-24 00:36:10 +00:00
Jim Kellerman 30e6c8c070 HBASE-462 Update migration tool 
Other miscellaneous changes included:

IdentityTableReduce
- Added SuppressWarnings("unused") for reporter argument
- Removed unnecessary cast.
AbstractMergeTestBase
- Removed unnecessary compaction
StaticTestEnvironment
- Change logging level for client connections which are too noisy in most cases
TestBloomFilters
- Removed unnecessary config settings
- Modified to use BatchUpdate instead of deprecated startUpdate, etc.
TestScannerAPI
- Modified to use BatchUpdate instead of deprecated startUpdate, etc.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630394 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-23 06:11:44 +00:00
Jim Kellerman c180c47e3f HBASE-461 Simplify leases. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630389 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-23 04:44:11 +00:00
Jim Kellerman f876238940 HBASE-460 TestMigrate broken when HBase moved to subproject 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@630383 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-23 03:18:44 +00:00
Michael Stack 9b37593ad6 HBASE-79 When HBase needs to be migrated, it should display a message on 
stdout, not just in the logs


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@629203 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-19 19:38:37 +00:00
Michael Stack 377fb93ca7 HBASE-428 Under continuous upload of rows, WrongRegionExceptions are thrown 
that reach the client even after retries
Applied to TRUNK and branch.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@629192 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-19 19:03:57 +00:00
Bryan Duxbury e714fed123 HBASE-8 [hbase] Delete table does not remove the table directory in the FS 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@629175 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-19 18:16:00 +00:00
Bryan Duxbury 1f99a440f1 HBASE-448 Add missing name mark 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@628899 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-18 22:33:23 +00:00
Bryan Duxbury 51a7b53e5b 414 Move client classes into client package 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627918 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-15 00:29:04 +00:00
Jim Kellerman 21932c5981 HBASE-446 Fully qualified hbase.rootdir doesn't work 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627837 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-14 18:49:00 +00:00
Bryan Duxbury dd19c18e76 HBASE-438 XMLOutputter state should be initialized. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627592 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-13 21:09:01 +00:00
Bryan Duxbury 6b8c95d8cd HBASE-444 hbase is very slow at determining table is not present 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627585 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-13 20:31:17 +00:00
Bryan Duxbury 3067b43dc2 HBASE-407 Client should cache region locations in an LRU structure 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627573 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-13 19:30:26 +00:00
Jim Kellerman 77886ac7af HBASE-434, HBASE-435 TestTableIndex and TestTableMapReduce failed in Hudson builds 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627197 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-13 00:18:29 +00:00
Jim Kellerman e6c687d159 HBASE-43[45] TestTableIndex and TestTableMapReduce failed in Hudson builds 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627195 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-13 00:09:52 +00:00
Jim Kellerman 8b2c345d4c HBASE-440 Add optional log roll interval so that log files are garbage collected 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@627152 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-12 22:19:24 +00:00
Michael Stack ef9a7c1017 HBASE-417 Factor TableOperation and subclasses into separate files from HMaster 
HBASE-439 Add hbase logs path to svn:ignore list


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620706 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-12 06:19:46 +00:00
Michael Stack c486b1a8aa HBASE-436 website: http://hadoop.apache.org/hbase/ 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620677 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-12 00:18:10 +00:00
Michael Stack fcc06c0fef HBASE-437 Clear Command should use system.out 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620531 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-11 17:25:50 +00:00
Jim Kellerman e1871f874b HBASE-410 Speed up the test suite - Apparently test timeout was too aggressive for Hudson. TestLogRolling timed out even though it was operating properly. Change test timeout to 10 minutes. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620232 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-10 01:52:53 +00:00
Michael Stack 8dafaa567a HBASE-426 hbase can't find remote filesystem 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@620058 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-09 01:43:59 +00:00
Michael Stack 7058eb734d HBASE-418 Move HMaster and related classes into master package 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619989 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-08 20:29:01 +00:00
Michael Stack 2c59895f0b HBASE-406 Remove HTable and HConnection close methods 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619985 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-08 19:59:21 +00:00
Jim Kellerman b2be058d68 HBASE-421 TestRegionServerExit broken 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619768 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-08 04:58:00 +00:00
Michael Stack ea98b03b76 HBASE-3 rest server: configure number of threads for jetty 
HBASE-416 Add apache-style logging to REST server and add setting log level, etc.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619694 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-08 00:10:45 +00:00
Michael Stack 655065bcca HBASE-425 Fix doc. so it accomodates new hbase untethered context 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619689 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-07 23:48:19 +00:00
Michael Stack aa12579a3c HBASE-56 Unnecessary HQLClient Object creation in a shell loop 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619678 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-07 22:49:37 +00:00
Michael Stack 93a31f6a16 HBASE-2 hlog numbers should wrap around when they reach 999 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619657 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-07 21:48:58 +00:00
Michael Stack 1d831be81a HBASE-281 Shell should allow deletions in .META. and -ROOT- tables 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619656 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-07 21:45:44 +00:00
Michael Stack 97f0bea9d0 HBASE-28 thrift put/mutateRow methods need to throw IllegalArgument exceptions 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619638 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-07 21:08:12 +00:00
Jim Kellerman 1bfcf5a813 HBASE-410 Speed up the test suite (make test timeout 5 minutes instead of 15. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619635 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-07 20:57:23 +00:00
Michael Stack 51707644ed HBASE-19 CountingBloomFilter can overflow its storage 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619620 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-07 20:10:40 +00:00
Michael Stack d400b2d941 HBASE-409 Add build path to svn:ignore list 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619617 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-07 20:08:29 +00:00
Michael Stack 5f63bc11eb HBASE-35 Make BatchUpdate public in the API 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619605 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-07 19:51:03 +00:00
Michael Stack 56380dab8a HBASE-288 Add in-memory caching of data 
(Recommit.  We'd backed it out when it was HADOOP-1398)
This commit includes updating version from 0.1.0-dev to 0.2.0-dev
and an update of the hadoop lib to move it post 0.16.0 branch.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619526 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-07 17:49:15 +00:00
Jim Kellerman 0fdd555ace HBASE-415 Rewrite leases to use DelayedBlockingQueue instead of polling 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@619288 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-07 06:35:09 +00:00
Michael Stack bd2275a571 HBASE-403 Fix build after move of hbase in svn 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@618812 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-05 22:46:24 +00:00
Jim Kellerman 9a88155bf0 2008/02/04 HBase is now a subproject of Hadoop. The first HBase release as a subproject will be release 0.1.0 which will be equivalent to the version of HBase included in Hadoop 0.16.0. In order to accomplish this, the HBase portion of HBASE-288 (formerly HADOOP-1398) has been backed out. Once 0.1.0 is frozen (depending mostly on changes to infrastructure due to becoming a sub project instead of a contrib project), this patch will re-appear on HBase trunk. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@618518 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-05 02:36:26 +00:00
Jim Kellerman 678403c4fe HADOOP-2773 Master marks region offline when it is recovering from a region server death 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@617767 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-02 07:19:25 +00:00
Michael Stack e9230096ee HADOOP-2599 Some minor improvements to changes in HADOOP-2443 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@617725 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-02 00:53:48 +00:00
Michael Stack b7d932f4dc HADOOP-2693 NPE in getClosestRowBefore 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@617724 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-02 00:51:38 +00:00
Michael Stack 3e351091b6 HADOOP-2731 Under load, regions become extremely large and eventually cause 
region servers to become unresponsive


git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@617720 13f79535-47bb-0310-9956-ffa450edef68
 2008-02-02 00:36:53 +00:00
Jim Kellerman 956f5ba002 HADOOP-2750 Deprecated methods startBatchUpdate, commitBatch, abortBatch, and renewLease have been removed from HTable (Bryan Duxbury via Jim Kellerman) 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@617246 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-31 21:37:14 +00:00
Jim Kellerman d70a0b0a7c HADOOP-2750 Deprecated methods startBatchUpdate, commitBatch, abortBatch, and renewLease have been removed from HTable 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@617245 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-31 21:33:51 +00:00
Jim Kellerman 5a29fc263d HADOOP-2555 Give credit where credit is due. 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@617204 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-31 19:55:35 +00:00
Jim Kellerman 234d8552cf HADOOP-2555 Refactor the HTable#get and HTable#getRow methods to avoid repetition of retry-on-failure logic 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@617197 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-31 19:36:28 +00:00
Michael Stack 4cb3e64bff HADOOP-2718 Copy Constructor HBaseConfiguration(Configuration) will override hbase 
configurations if argumant is not an instance of HBaseConfiguration (Second version).


git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@617180 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-31 18:28:48 +00:00
Michael Stack d374f82519 HADOOP-2753 Back out 2718; programmatic config works but 
hbase*xml conf is overridden


git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@617025 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-31 07:03:33 +00:00
Jim Kellerman 72eca05e79 Delete empty file: src/contrib/hbase/src/java/org/apache/hadoop/hbase/mapred/TableOutputCollector.java 
per Nigel Daley


git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@616652 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-30 06:31:16 +00:00
Michael Stack de2e8d5028 HADOOP-2631 2443 breaks HTable.getStartKeys when there is more than one table 
or table you are enumerating isn't the first table


git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@616505 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-29 20:06:19 +00:00
Michael Stack f0da1b58aa HADOOP-2718 Copy Constructor HBaseConfiguration(Configuration) will override 
hbase configurations if argumant is not an instance of HBaseConfiguration.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@616492 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-29 19:30:22 +00:00
Jim Kellerman d929e0c34a HADOOP-2722 Prevent unintentional thread exit in region server and master 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@616298 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-29 13:18:18 +00:00
Michael Stack 2f06f08d95 HADOOP-2675 Options not passed to rest/thrift 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@616163 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-29 04:46:34 +00:00
Michael Stack 73d71a09a8 HADOOP-2712 under load, regions won't split 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@615413 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-26 00:38:15 +00:00
Michael Stack a8a0d00a4a HADOOP-2706 HBase Shell crash 
git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@615248 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-25 15:45:04 +00:00
Michael Stack 0d8c1bfdfc HADOOP-2688 IllegalArgumentException processing a shutdown stops server 
going down and results in millions of lines of output


git-svn-id: https://svn.apache.org/repos/asf/hadoop/core/trunk/src/contrib/hbase@614796 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-24 05:13:22 +00:00
Michael Stack 52b268a09c HADOOP-2686 Removed tables stick around in .META. 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@614588 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-23 17:43:22 +00:00
Jim Kellerman af3ca76470 HADOOP-2668 Documentation and improved logging so fact that hbase now requires migration comes as less of a surprise 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@614413 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-23 03:24:32 +00:00
Michael Stack 6487762f94 HADOOP-2650 Remove Writables.clone and use WritableUtils.clone from 
hadoop instead
HADOOP-2584 Web UI displays an IOException instead of the Tables



git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@613923 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-21 16:21:46 +00:00
Jim Kellerman 5ea6853f90 HADOOP-2643 Make migration tool smarter. 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@613446 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-19 20:20:15 +00:00
Jim Kellerman d3a9d1d745 HADOOP-2525 Same 2 lines repeated 11 million times in HMaster log upon HMaster shutdown 
HADOOP-2616 hbase not spliting when the total size of region reaches max region size * 1.5


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@613062 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-18 06:11:06 +00:00
Michael Stack 40ed226cf1 HADOOP-2621 Memcache flush flushing every 60 secs with out 
considering the max memcache size


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@613010 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-17 23:38:09 +00:00
Michael Stack 40b4c04da8 HADOOP-2619 Compaction errors after a region splits 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@612995 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-17 22:35:24 +00:00
Michael Stack 74df13a369 HADOOP-2629 Shell digests garbage without complaint 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@612931 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-17 19:08:08 +00:00
Michael Stack 246d4b80ab HADOOP-2545 hbase rest server should be started with hbase-daemon.sh 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@612913 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-17 18:19:31 +00:00
Michael Stack 5f5472e631 HADOOP-2600 Performance: HStore.getRowKeyAtOrBefore should use 
MapFile.Reader#getClosest (before)


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@612614 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-16 23:04:28 +00:00
Michael Stack f8269a1e47 HADOOP-2493 hbase will split on row when the start and end row 
is the same cause data loss


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@612500 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-16 16:26:24 +00:00
Michael Stack 615fe2bbc7 HADOOP-2592 Scanning, a region can let out a row that its not supposed to have 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@612314 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-15 23:42:31 +00:00
Jim Kellerman b78012df61 HADOOP-2587 Splits blocked by compactions cause region to be offline for duration of compaction. 
Patch verified by Billy Pearson


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@612161 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-15 17:20:06 +00:00
Michael Stack ea6f5071da HADOOP-2579 initializing a new HTable object against a nonexistent table 
throws a NoServerForRegionException instead of a TableNotFoundException
when a different table has been created previously


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@612141 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-15 15:51:29 +00:00
Michael Stack 7d09aec4f8 HADOOP-2598 Remove chatty debug logging from 2443 patch 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@612025 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-15 05:58:57 +00:00
Michael Stack ff4aac71c3 HADOOP-2589 Change an classes/package name from shell to hql 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@612016 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-15 05:14:34 +00:00
Jim Kellerman 7a8ebbcefb HADOOP-2558 modified CHANGES.txt to indicate that this is an incompatible change. 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611970 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-14 23:27:51 +00:00
Jim Kellerman 728cb9c5df HADOOP-2558 org.onelab.filter.BloomFilter class uses 8X the memory it should be using 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611734 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-14 08:09:11 +00:00
Michael Stack 27afba4ead HADOOP-2443 Keep lazy cache of regions in client rather than an 'authoritative' list 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611727 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-14 06:54:28 +00:00
Jim Kellerman fed1075104 HADOOP-2500 Unreadable region kills region servers 
HADOOP-2587 Splits blocked by compactions cause region to be offline for duration of compaction. 
Fix bug in TestCompaction in which two mini dfs clusters were being started for the same test.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611681 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-13 23:39:01 +00:00
Michael Stack f6f56a1d72 HADOOP-2533 Scanning, just creating MapWritable in next consumes >20% CPU 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611629 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-13 20:10:22 +00:00
Michael Stack d7de304808 HADOOP-2557 Shell count function 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611537 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-13 05:24:14 +00:00
Michael Stack 470b3a3200 HADOOP-2389 Provide multiple language bindings for HBase (Thrift) 
Actual code (first commit added thrift lib so this patch would build).


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611535 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-13 04:46:44 +00:00
Jim Kellerman 9c142a76a1 HADOOP-2478 Restructure how HBase lays out files in the file system (phase 2) Includes migration tool org.apache.hadoop.hbase.util.Migrate 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611519 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-13 01:36:08 +00:00
Michael Stack 979da3823a HADOOP-2548 Make TableMap and TableReduce generic 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611488 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-12 21:32:46 +00:00
Michael Stack d004f6e545 HADOOP-2558 fixes for build up on hudson 
Part 5.  Fix NPE in make multiregion.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611005 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-11 01:19:06 +00:00
Michael Stack e3031f035f HADOOP-2558 fixes for build up on hudson 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610978 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-10 23:05:31 +00:00
Michael Stack db34c56319 HADOOP-2389 Provide multiple language bindings for HBase (Thrift) 
Added thrift jar in advance so HADOOP-2389 patch will build on hudson.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610921 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-10 20:34:59 +00:00
Michael Stack df0f5658a5 HADOOP-2553 Don't make Long objects calculating hbase type hash codes 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610698 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-10 06:57:00 +00:00
Michael Stack 765ee86279 HADOOP-2558 fixes for build up on hudson (part 2) 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610696 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-10 06:47:22 +00:00
Jim Kellerman 3817485e03 HADOOP-2478 test input data. 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610603 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-09 22:51:04 +00:00
Michael Stack 3d80b1a498 HADOOP-2558 fixes for build up on hudson (Part 1) 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610280 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-09 06:40:10 +00:00
Michael Stack a22bf5e1e2 HADOOP-2490 Failure in nightly #346 
Add one fix and more logging to help diagnose the failures up on hudson.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610237 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-09 00:07:16 +00:00
Michael Stack 450fe7b100 HADOOP-2472 Range selection using filter 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610092 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-08 18:27:58 +00:00
Michael Stack f5bfeea892 HADOOP-2450 Show version (and svn revision) in hbase web ui 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610087 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-08 18:11:45 +00:00
Michael Stack 5a804bf5f3 HADOOP-2502 Insert/Select timestamp, Timestamp data type in HQL 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@609730 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-07 18:26:08 +00:00
Michael Stack 5893f72c17 HADOOP-2522 Separate MapFile benchmark from PerformanceEvaluation 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@609422 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-06 21:58:16 +00:00
Michael Stack 56fa3392a1 HADOOP-2240 Truncate for hbase 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@609254 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-06 04:43:54 +00:00
Michael Stack 3f4e2cd235 HADOOP-2530 Missing type in new hbase custom RPC serializer 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@609210 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-05 20:39:09 +00:00
Michael Stack 07eb878e5a HADOOP-2507 REST servlet does not properly base64 row keys and column names 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@608762 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-04 06:56:28 +00:00
Michael Stack 13239f413e HADOOP-2504 REST servlet method for deleting a scanner was not properly 
mapped


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@608743 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-04 04:39:02 +00:00
Michael Stack c89219b47b HADOOP-2519 Performance improvements: Customized RPC serialization 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@608738 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-04 03:52:53 +00:00
Michael Stack b0f524f3d7 HADOOP-2506 Remove the algebra package 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@608289 13f79535-47bb-0310-9956-ffa450edef68
 2008-01-03 00:06:38 +00:00
Michael Stack 9ebe18e2b4 HADOOP-2505 formatter classes missing apache license 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607754 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-31 17:01:27 +00:00
Michael Stack 0e8bbbf2f7 HADOOP-2495 inor performance improvements: Slim-down BatchOperation, etc. 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607602 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-30 22:22:16 +00:00
Michael Stack 6b005b4f3f HADOOP-2503 REST Insert / Select encoding issues 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607592 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-30 21:40:50 +00:00
Michael Stack 164bc44b58 HADOOP-2485 Make mapfile index interval configurable 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607131 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-27 22:26:27 +00:00
Michael Stack 87273adb1c HADOOP-2479 Save on number of Text object creations 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@606332 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-21 21:58:25 +00:00
Michael Stack 0465b18a35 HADOOP-2471 Add reading/writing MapFile to PerformanceEvaluation suite 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605976 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-20 16:44:59 +00:00
Michael Stack 3b36d543de HADOOP-2467 scanner truncates resultset when > 1 column families 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605811 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-20 05:35:07 +00:00
Jim Kellerman db809b2145 HADOOP-2468 TestRegionServerExit failed in Hadoop-Nightly #338 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605675 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-19 20:11:17 +00:00
Jim Kellerman 83c09ebccc HADOOP-2458 HStoreFile.writeSplitInfo should just call HStoreFile.Reference.write 
HADOOP-2458 HStoreFile.writeSplitInfo should just call HStoreFile.Reference.write 


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605466 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-19 08:22:33 +00:00
Michael Stack 2630fd3cee HADOOP-2455 Error in Help-string of create command 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605277 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-18 18:06:45 +00:00
Jim Kellerman c55f90590a HADOOP-2451 End key is incorrectly assigned in many region splits 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605102 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-18 06:26:11 +00:00
Jim Kellerman c73ddd1aa8 HADOOP-2441 Fix build failures in TestHBaseCluster 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604999 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-17 20:53:45 +00:00
Jim Kellerman 6da6ebed1e HADOOP-2199 Add tools for going from hregion filename to region name in logs 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604325 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-14 22:57:29 +00:00
Jim Kellerman 9b68f4bf41 HADOOP-2430 Master will not shut down if there are no active region servers 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604309 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-14 21:51:45 +00:00
Jim Kellerman 10bac1971d HADOOP-2414 Fix ArrayIndexOutOfBoundsException in bloom filters. 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604281 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-14 19:58:33 +00:00
Michael Stack b36f712736 HADOOP-2286 Add being able to shutdown regionservers 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604233 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-14 17:12:09 +00:00
Jim Kellerman 438b82450a HADOOP-2418 Fix assertion failures in TestTableMapReduce, TestTableIndex, and TestTableJoinMapReduce 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604034 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-13 21:28:03 +00:00
Jim Kellerman a24a76ca83 HADOOP-2417 Fix critical shutdown problem introduced by HADOOP-2338 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604011 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-13 20:02:30 +00:00
Michael Stack 91de46cac1 HADOOP-2351 If select command returns no result, it doesn't need to show 
the header information


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603940 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-13 15:43:04 +00:00
Michael Stack f8a906f49f HADOOP-2047 Add an '--master=X' and '--html' command-line parameters to shell 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603824 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-13 05:43:59 +00:00
Michael Stack c0000537e7 HADOOP-2407 Keeping MapFile.Reader open is expensive: Part 2 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603652 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-12 16:00:25 +00:00
Jim Kellerman c499da8b7b HADOOP-2392 HADOOP-2324 HADOOP-2396 HADOOP-2397 
HADOOP-2392, HADOOP-2324:

Chore
- initialChore() now returns boolean

HMaster
- rather than retry in root and meta scanners, return if a scan fails. It will get retried on the next scan. This has two effects: 1) scanners exit more quickly during shutdown and 2) they don't keep retrying to connect to a dead server, allowing them to recover from a server going down more quickly.
- initialScan in root and meta scanners return boolean and do not progress to maintenanceScan until the initial scan completes successfully.

HRegionServer
- speed up region server exit by reordering join's so that we join with threads in the order that we told them to stop

TestTableMapReduce
- remove overrides of heartbeat and thread wake intervals

HADOOP-2396:

HMaster
- move check for null HRegionInfo before first attempt to dereference it.

HADOOP-2397:
- HMaster$BaseScanner.checkAssigned: don't try to split dead server's log if initial startup has completed.

HADOOP-2353:

HMsg
- change toString() to only output the region name rather than calling HRegionInfo.toString()

StaticTestEnvironment
- make logging a bit less verbose

TestHLog
- was writing to local file system and failing on Windows


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603428 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-12 00:40:02 +00:00
Michael Stack c70f6c5122 HADOOP-2370 Allow column families with an unlimited number of versions 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603315 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-11 17:56:51 +00:00
Michael Stack 29e68d505c HADOOP-2395 Implement "ALTER TABLE ... CHANGE column" operation 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603304 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-11 17:07:12 +00:00
Michael Stack f9fc02ba8b HADOOP-2283 AlreadyBeingCreatedException (Was: Stuck replay of failed 
regionserver edits)


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603077 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-10 22:36:03 +00:00
Jim Kellerman 6a65a514a8 HADOOP-2392 TestRegionServerExit has new failure mode since HADOOP-2338 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602790 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-10 06:41:24 +00:00
Michael Stack faada59eb7 HADOOP-2384 Delete all members of a column family on a specific row 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602633 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-09 04:49:58 +00:00
Jim Kellerman 870cb3b5cf HADOOP-2350 Scanner api returns null row names, or skips row names if different column families do not have entries for some rows 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602334 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-08 06:54:31 +00:00
Michael Stack 3c80b8c75e HADOOP-1550 No means of deleting a'row' 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602284 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-08 00:39:32 +00:00
Michael Stack 02022f9931 HADOOP-2380 REST servlet throws NPE when any value node has an empty string 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602267 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-07 23:26:30 +00:00
Jim Kellerman 612f446dbd HADOOP-2338 Fix NullPointerException in master server. 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602226 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-07 21:23:54 +00:00
Michael Stack bccf1dc26f HADOOP-2377 Holding open MapFile.Readers is expensive, so use less of them 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602199 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-07 19:49:19 +00:00
Michael Stack 11df017a67 HADOOP-2362 Leaking hdfs file handle on region split 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@601961 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-07 02:34:08 +00:00
Jim Kellerman 6fb4643705 HADOOP-2365 Result of HashFunction.hash() contains all identical values 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@601886 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-06 22:34:38 +00:00
Michael Stack 0ce1829c73 HADOOP-2357 Compaction cleanup; less deleting + prevent possible file leaks 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@601383 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-05 16:06:25 +00:00
Michael Stack afeed7bfc6 HADOOP-2347 REST servlet not thread safe but run in a threaded manner 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@601232 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-05 07:27:59 +00:00
Jim Kellerman 7f52d2e951 HADOOP-2333 Client side retries happen at the wrong level 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@601111 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-04 22:17:21 +00:00
Michael Stack 0d7a01cb8a HADOOP-2299 Support inclusive scans 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@601005 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-04 17:07:22 +00:00
Michael Stack c5eee12d4c HADOOP-2339 Delete command with no WHERE clause 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600771 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-04 02:48:49 +00:00
Michael Stack c7574f8f32 HADOOP-2316 Run REST servlet outside of master 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600707 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-03 22:06:07 +00:00
Michael Stack 30eb660601 HADOOP-2332 Meta table data selection in Hbase Shell 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600627 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-03 18:42:09 +00:00
Michael Stack 79e64fcc4f HADOOP-2315 REST servlet doesn't treat / characters in row key correctly 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600604 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-03 17:20:22 +00:00
Jim Kellerman ffe660105a HADOOP-2321 TestScanner2 does not release resources which sometimes cause the test to time out 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600443 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-03 08:28:32 +00:00
Jim Kellerman 7ac136887a HADOOP-2309 ConcurrentModificationException doing get of all region start keys 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600240 13f79535-47bb-0310-9956-ffa450edef68
 2007-12-02 04:58:03 +00:00
Michael Stack fdff7385a6 HADOOP-2322 getRow(row, TS) client interface not properly connected 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600019 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-30 23:59:56 +00:00
Michael Stack 554146cc64 HADOOP-2320 Committed TestGet2 is managled (breaks build). 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599951 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-30 20:40:31 +00:00
Michael Stack 6b159e940e HADOOP-2068 RESTful interface 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599945 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-30 20:15:48 +00:00
Michael Stack f1f6738e2c HADOOP-2224 Add HTable.getRow(ROW, ts) 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599879 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-30 17:18:01 +00:00
Michael Stack c22dd06d14 HADOOP-2304 Abbreviated symbol parsing error of dir path in jar command 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599878 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-30 17:15:33 +00:00
Michael Stack 7fff3ab5f6 HADOOP-2308 null regioninfo breaks meta scanner 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599875 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-30 17:06:31 +00:00
Michael Stack 05d4458b47 HADOOP-2297 System.exit() Handling in hbase shell jar command 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599713 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-30 07:33:09 +00:00
Michael Stack 5a465ae05b HADOOP-2296 hbase shell: phantom columns show up from select command 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599703 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-30 06:35:47 +00:00
Michael Stack bf176b63f3 HADOOP-2234 TableInputFormat erroneously aggregates map values 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599643 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-30 00:01:25 +00:00
Jim Kellerman b8291d673e HADOOP-2295 Fix assigning a region to multiple servers 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599578 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-29 21:10:03 +00:00
Michael Stack 6f14e60b7f HADOOP-2198 HTable should have method to return table metadata 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599534 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-29 18:25:39 +00:00
Michael Stack 7102265285 HADOOP-2253 getRow can return HBASE::DELETEVAL cells 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599223 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-29 00:37:19 +00:00
Michael Stack 175f44ac81 HADOOP-1608 Relational Algrebra Operators 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599162 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-28 22:10:21 +00:00
Jim Kellerman 72414e6c91 HADOOP-2261 HTable.abort no longer throws exception if there is no active update. 
HADOOP-2287 Make hbase unit tests take less time to complete.
HADOOP-2262 Retry n times instead of n**2 times.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599138 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-28 20:38:00 +00:00
Michael Stack 3bff065d34 HADOOP-2257 Show a total of all requests and regions on the web ui 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@598699 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-27 17:12:52 +00:00
Jim Kellerman 70004192f1 HADOOP-2262 HADOOP-2261 fail fast on non-existing table, change abort to function after commit even if commit was successful 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@598555 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-27 08:35:08 +00:00
Jim Kellerman 3786f399a6 HADOOP-2276 Address regression caused by HADOOP-2274, fix HADOOP-2173 (When the master times out a region servers lease, the region server may not restart) 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@598535 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-27 07:11:00 +00:00
Michael Stack d11960feef HADOOP-2289 Useless efforts of looking for the non-existant table in select command. 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@598524 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-27 06:12:46 +00:00
Michael Stack eb2c941544 HADOOP-2196 Fix how hbase sits in hadoop 'package' product 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@598469 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-27 00:23:37 +00:00
Jim Kellerman c64eb9ebdc HADOOP-2274 Excess synchronization introduced by HADOOP-2139 negatively impacts performance 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@598113 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-26 03:05:37 +00:00
Jim Kellerman cbe167c981 HADOOP-2139 (phase 2) Make region server more event driven 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@597959 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-25 07:17:38 +00:00
Michael Stack 9052780e2d HADOOP-2267 Change the hbase shell prompt's title 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@597725 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-23 19:16:45 +00:00
Jim Kellerman 8a5b3da292 HADOOP-2139 (phase 1) Increase parallelism in region servers 
There are a lot of changes in this patch. The memcache has been changed from a per/region object to a per/column object, and HLocking has been removed since we do not have to maintain any locks across RPC calls.

This necessitated major changes to HRegion and HStore

Additionally there were many changes required to the unit tests since they tend to exploit some private interfaces that weren't designed to be public. Some of those interfaces changed so the test cases did as well.

This patch is the result of extensive analysis of the multiple threads in HBase that contend for shared resources: updates, reads, scanners, cache flushing, compaction and region splitting.

Many of the tests are timing sensitive, and since we tend to make "dormant" intervals as short as possible to speed up the Hudson build, we may go through several iterations of getting them right before Hudson is happy. This is especially true since two test cases failed on my dual cpu windows machine while running the tests under Ant, but ran fine under Eclipse.

However, now that the tests are passing locally, I believe the changes are doing the right thing, but may require some parameter tweaks.

git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@596835 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-20 21:53:30 +00:00
Michael Stack bf4262e220 HADOOP-2040 Hudson hangs AFTER test has finished 
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@594715 13f79535-47bb-0310-9956-ffa450edef68
 2007-11-13 23:38:21 +00:00