Commit Graph

5928 Commits

Author SHA1 Message Date
Michael Stack 6c53f19fd4 PE#format was generating non-printable characters
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658991 13f79535-47bb-0310-9956-ffa450edef68
2008-05-22 03:50:57 +00:00
Michael Stack ee2ece88d8 Remove config. committed by mistake
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658899 13f79535-47bb-0310-9956-ffa450edef68
2008-05-21 22:11:37 +00:00
Michael Stack a000a20845 HBASE-504 Allow HMsg's carry a payload: e.g. exception that happened
over on the remote side.

M  src/test/org/apache/hadoop/hbase/TestSerialization.java
    Add test that HMsg with region and message serializes.
M  src/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
    HMsg types have been enumified.  Also use some of the new
    static messages.  On split and close because of error,
    add message to the HMsg we pass back to the master.
M  src/java/org/apache/hadoop/hbase/HServerInfo.java
    (compareTo): Added.
M  src/java/org/apache/hadoop/hbase/HRegionInfo.java
    Allow null in compareTo.
M src/java/org/apache/hadoop/hbase/master/ServerManager.java
    Use the new HMsg.isType figuring message type.
    Redo message logging.  Use convenience HMsg statics.
M  src/java/org/apache/hadoop/hbase/master/RegionManager.java
    Pass back overloaded message if region shutdown because of balancing.
M  src/java/org/apache/hadoop/hbase/HServerAddress.java
    Make it so that two addresses equate even if one has hostname
    and the other IP.
M  src/java/org/apache/hadoop/hbase/ipc/HMasterRegionInterface.java
    Up the protocol version for regionserver reporting master messages.
M  src/java/org/apache/hadoop/hbase/HMsg.java
    Enumify the messge types.
    Define a few static HMsgs for convenience.
    Allow optional message. Improved toString.
    (isType, equals, hashCode): Added.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658465 13f79535-47bb-0310-9956-ffa450edef68
2008-05-20 22:29:36 +00:00
Michael Stack bf4536f713 HBASE-621 Make MAX_VERSIONS work like TTL: In scans and gets, check MAX_VERSIONs setting and return that many only rather than wait on compaction
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658419 13f79535-47bb-0310-9956-ffa450edef68
2008-05-20 20:40:47 +00:00
Michael Stack 7bbe456b0f HBASE-23 UI listing regions should be sorted by address and show additional region state
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658356 13f79535-47bb-0310-9956-ffa450edef68
2008-05-20 17:29:33 +00:00
Michael Stack fc80b823c4 HBASE-626 Use Visitor pattern in MetaRegion to reduce code clones in HTable and HConnectionManager
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658337 13f79535-47bb-0310-9956-ffa450edef68
2008-05-20 16:54:29 +00:00
Michael Stack b365b0bf61 Fix broken build -- remove line that should not have been included in the HBASE-623 commit
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658100 13f79535-47bb-0310-9956-ffa450edef68
2008-05-20 05:12:31 +00:00
Michael Stack 9cb0f8bdfb HBASE-630 Default hbase.rootdir is garbage
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658098 13f79535-47bb-0310-9956-ffa450edef68
2008-05-20 04:30:18 +00:00
Michael Stack 274ed7384b HBASE-623 migration script for hbase-82
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@658016 13f79535-47bb-0310-9956-ffa450edef68
2008-05-19 22:46:50 +00:00
Jim Kellerman db289cb669 HBASE-629 Split reports incorrect elapsed time
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@657226 13f79535-47bb-0310-9956-ffa450edef68
2008-05-16 21:45:11 +00:00
Michael Stack da3f56a058 HBASE-82 Missed start and end toString in table.jsp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@657130 13f79535-47bb-0310-9956-ffa450edef68
2008-05-16 16:48:59 +00:00
Michael Stack 1eda3c2439 HBASE-82 Fix toString in migation
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@657125 13f79535-47bb-0310-9956-ffa450edef68
2008-05-16 16:25:43 +00:00
Michael Stack 3f3e2c5756 HBASE-82 Fix up client logging strings
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@657090 13f79535-47bb-0310-9956-ffa450edef68
2008-05-16 15:00:31 +00:00
Michael Stack 8af6a615e2 HBASE-82 Remove mistaken conf commit
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656892 13f79535-47bb-0310-9956-ffa450edef68
2008-05-15 23:13:16 +00:00
Michael Stack 680343c2b2 HBASE-82 row keys should be array of bytes
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656868 13f79535-47bb-0310-9956-ffa450edef68
2008-05-15 22:10:47 +00:00
Michael Stack 8fc5cd2b95 HBASE-558 Output hbase+hadoop+jvm version as well as java opts, ulimit, into master/regionserver log on startup
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656798 13f79535-47bb-0310-9956-ffa450edef68
2008-05-15 19:22:54 +00:00
Michael Stack b187c39355 HBASE-593 build on hudson failing compiling jsp -- make it so we do jspc once per invocation
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656794 13f79535-47bb-0310-9956-ffa450edef68
2008-05-15 18:53:12 +00:00
Michael Stack 1f3606e5b0 HBASE-593 build on hudson failing compiling jsp
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656518 13f79535-47bb-0310-9956-ffa450edef68
2008-05-15 06:48:37 +00:00
Michael Stack bcdb066cae Another nothing change to provoke a build
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656514 13f79535-47bb-0310-9956-ffa450edef68
2008-05-15 05:43:28 +00:00
Michael Stack 7ddd733236 HBASE-569 DemoClient.php
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656511 13f79535-47bb-0310-9956-ffa450edef68
2008-05-15 05:26:47 +00:00
Michael Stack 100a1616d4 Nothing change to force build on hudson to see if ant changes will make it build again
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656506 13f79535-47bb-0310-9956-ffa450edef68
2008-05-15 05:02:02 +00:00
Michael Stack 302997693a Add note about the 0.1.2 release
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656500 13f79535-47bb-0310-9956-ffa450edef68
2008-05-15 03:56:43 +00:00
Michael Stack 99fc06705d HBASE-23 Fix bug introduced by my edits of JDC's patch
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656456 13f79535-47bb-0310-9956-ffa450edef68
2008-05-14 22:41:58 +00:00
Michael Stack 822ba8bc3b HBASE-23 UI listing regions should be sorted by address and show additional region state
M  src/java/org/apache/hadoop/hbase/HServerLoad.java
    (toString): Overload that takes interval.
M  src/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
    (getConfiguration): Added
M  src/java/org/apache/hadoop/hbase/master/HMaster.java
    (getAverageLoad): Added
M src/java/org/apache/hadoop/hbase/HServerAddress.java
    (getHostname): Added.
M  src/java/org/apache/hadoop/hbase/client/HTable.java
    (getRegionsInfo): Added.
M  src/webapps/regionserver/regionserver.jsp
M  src/webapps/master/master.jsp
    Output requests as requests per second.
    Fixed up the help comments.  Changed all to use new getHostname
    rather than IPs.  Added encoded name column.
M  src/webapps/master/table.jsp
    Added.
M  src/webapps/master/WEB-INF/web.xml
    Add new tables servlet.
M  bin/hbase
    Put hbase in front of hadoop again.  FIxes not being able to find
    stylesheets -- might break logging again though doesnt seem to in
    tests.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656366 13f79535-47bb-0310-9956-ffa450edef68
2008-05-14 19:06:52 +00:00
Jim Kellerman 595b75b105 HBASE-538 Improve exceptions that come out on client-side
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@656341 13f79535-47bb-0310-9956-ffa450edef68
2008-05-14 18:07:03 +00:00
Jim Kellerman 8d5e1e7025 HBASE-624 Master will shut down if number of active region servers is zero even if shutdown was not requested
M HMaster

- Moved HMaster.quiescedMetaServers to ServerManager.quiescedServers and changed name since only servers serving user regions get quiesced.
- Removed HMaster.tableInCreation - not used

M ServerManager

- Don't check if quiescedServers.get() >= serversToServerInfo.size() unless master.shutdownRequested is true.

M HRegionServer

- Change order of checks in main loop of HRegionServer.run, so that booleans are checked before we check the number of messages to process
- Don't break out of main loop if restart or stop requested - stop is checked at top of loop and we need to continue rather than break out of main loop if restart was requested



git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@655962 13f79535-47bb-0310-9956-ffa450edef68
2008-05-13 18:25:31 +00:00
Jim Kellerman 197cf5c7d7 HBASE-622 Remove StaticTestEnvironment and put a log4j.properties in src/test
Set logging level for Hadoop to WARN

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@655907 13f79535-47bb-0310-9956-ffa450edef68
2008-05-13 15:18:59 +00:00
Jim Kellerman 4e03053213 HBASE-622 Remove StaticTestEnvironment and put a log4j.properties in src/test
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@655650 13f79535-47bb-0310-9956-ffa450edef68
2008-05-12 21:22:38 +00:00
Jim Kellerman 8544e3d1f3 HBASE-614 Retiring regions is not used; exploit or remove
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@654653 13f79535-47bb-0310-9956-ffa450edef68
2008-05-08 23:41:47 +00:00
Michael Stack 7eddf55102 HBASE-620 testmergetool failing in branch and trunk since hbase-618 went in
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@654327 13f79535-47bb-0310-9956-ffa450edef68
2008-05-07 23:33:33 +00:00
Michael Stack a390d36ef5 HBASE-620 testmergetool failing in branch and trunk since hbase-618 went in
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@654326 13f79535-47bb-0310-9956-ffa450edef68
2008-05-07 23:33:18 +00:00
Jim Kellerman 5a8da86833 HBASE-611 regionserver should do basic health check before reporting alls-well to the master
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@654301 13f79535-47bb-0310-9956-ffa450edef68
2008-05-07 22:08:21 +00:00
Jim Kellerman 64842079e0 HBASE-453 undeclared throwable exception from HTable.get
Instead of wrapping UndeclaredThrowableException in a new IOException, wrap UndeclaredThrowableException.getCause

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@654267 13f79535-47bb-0310-9956-ffa450edef68
2008-05-07 20:39:14 +00:00
Jim Kellerman 4aa78f4f28 HBASE-453 undeclared throwable exception from HTable.get
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@654256 13f79535-47bb-0310-9956-ffa450edef68
2008-05-07 20:19:53 +00:00
Jim Kellerman eaa03f245b HBASE-600 Filters have excessive DEBUG logging
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@654229 13f79535-47bb-0310-9956-ffa450edef68
2008-05-07 19:35:47 +00:00
Jim Kellerman b3f4ddc1bc HBASE-478 offlining of table does not run reliably
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@654193 13f79535-47bb-0310-9956-ffa450edef68
2008-05-07 17:56:06 +00:00
Michael Stack cfefc60bac HBASE-619 Fix 'logs' link in UI
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@654184 13f79535-47bb-0310-9956-ffa450edef68
2008-05-07 17:31:29 +00:00
Michael Stack 20ee89aa4c HBASE-618 We always compact if 2 files, regardless of the compaction threshold setting
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@654169 13f79535-47bb-0310-9956-ffa450edef68
2008-05-07 16:58:10 +00:00
Michael Stack 2eef957d36 HBASE-47 option to set TTL for columns in hbase
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@653986 13f79535-47bb-0310-9956-ffa450edef68
2008-05-07 04:17:09 +00:00
Jim Kellerman 8df7f79781 HBASE-405 TIF and TOF use log4j directly rather than apache commons-logging
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@653941 13f79535-47bb-0310-9956-ffa450edef68
2008-05-06 22:18:24 +00:00
Jim Kellerman ab778e22e4 HBASE-607 MultiRegionTable.makeMultiRegionTable is not deterministic enough for regression tests
M MultiRegionTable

  Make deterministic by creating the regions directly and not rely on
  the asychronous nature of cache flushes, compactions and splits. The
  regions are small, but the point of this class is to generate a
  table with multiple regions so we can test map / reduce, region
  onlining / offlining, etc.

  Removed PUNCTUATION from row keys. Not sure why it was there in the
  first place, other than perhaps to verify that a row key can have
  punctuation in it provided it is not the first character. This will
  become moot when row keys change from Text to byte[] anyways.

  Incorporate repeated code
{code}
    region.close();
    region.getLog().closeAndDelete();
{code}
  into private method closeRegionAndDeleteLog

M TestSplit

  extends HBaseClusterTestCase instead of MultiRegionTable. It didn't
  use the output of MultiRegionTable, so all that work was just wasted
  by this test.

M TestTableIndex, TestTableMapReduce

  The only two tests that currently use MultiRegionTable. Minor
  modifications needed because MultiRegionTable now handles starting
  and stopping of the mini-DFS cluster. With the new MultiRegionTable
  class, if these tests fail now it will be because something they are
  testing has regressed and not because MultiRegionTable failed.



git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@652587 13f79535-47bb-0310-9956-ffa450edef68
2008-05-01 17:37:24 +00:00
Michael Stack c70e4fa984 HBASE-609 Master doesn't see regionserver edits because of clock skew
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@652436 13f79535-47bb-0310-9956-ffa450edef68
2008-05-01 06:05:58 +00:00
Michael Stack 0c08836299 HBASE-608 HRegionServer::getThisIP() checks hadoop config var for dns interface name
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@652428 13f79535-47bb-0310-9956-ffa450edef68
2008-05-01 04:22:56 +00:00
Michael Stack 9cd46728ff HBASE-604 Don't allow CLASSPATH from environment pollute the hbase CLASSPATH
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@652189 13f79535-47bb-0310-9956-ffa450edef68
2008-04-29 23:29:17 +00:00
Bryan Duxbury 1deedc318a HBASE-603 When an exception bubbles out of getRegionServerWithRetries, wrap the exception with a RetriesExhaustedException
-Added RetriesExhaustedException to client package
-HTable now throws REE when retries run out

git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@652185 13f79535-47bb-0310-9956-ffa450edef68
2008-04-29 23:03:20 +00:00
Michael Stack 21da84cfea HBASE-601 Just remove deprecated methods in HTable; 0.2 is not backward compatible anyways
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@652054 13f79535-47bb-0310-9956-ffa450edef68
2008-04-28 04:58:09 +00:00
Michael Stack 495467870b Remove useless, annoying DEBUG (previously added by me)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@651740 13f79535-47bb-0310-9956-ffa450edef68
2008-04-25 23:43:49 +00:00
Michael Stack cecc9e99ff HBASE-581 Allow adding filters to TableInputFormat (At same time, ensure TIF is subclassable)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@651368 13f79535-47bb-0310-9956-ffa450edef68
2008-04-24 19:48:32 +00:00
Michael Stack fb2db8cdaa HBASE-588 Still a 'hole' in scanners, even after HBASE-532
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@651018 13f79535-47bb-0310-9956-ffa450edef68
2008-04-23 19:22:15 +00:00
Michael Stack e1da900df8 HBASE-588 Still a 'hole' in scanners, even after HBASE-532
Add a ChangedReadersObserver interface.  HStore notifies registered
observers when list of HStoreFile Readers changes -- at flush time
and at compaction time.  Scanners are only current observers.

Also fix a deadlock flushing by changing lock types and moving flush
request out from under lock.

M  src/test/org/apache/hadoop/hbase/MultiRegionTable.java
    (getCacheFlushListern): Renamed as getFlushRequester
M  src/java/org/apache/hadoop/hbase/regionserver/HStore.java
    Added synchronizations on this.storefiles.
    (activeScanners, newScannerLock): Removed.  We no longer try to
    block out scanners when compacting (Turns out same functionality
    for blocking scanners is up in HRegion used around closing/split).
    (changedReadersObservers): Added.
    (updateReaders): New method that manages the insertion of new
    reader on flush.  Also calls new notifyChangedReadersObservers.
    (notifyChagnedReadersObservers, addChangedReadersObserver,
      deleteChangedReadersObservers): Added.
    (completeCompaction): Previous deleting old store files, we'd
    remove from this.storefiles and delete all in one step; now we
    do the remove first, notify all observers of readers, and then
    do the delete so observers have a chance to clean up any old
    references to files about to be deleted.  Removed all the lockout
    of new scanner creation and wait on old scanners to come int.
    (updateActiveScanners): Removed.
    (getStorefiles): Accessor.  Added.
M  src/java/org/apache/hadoop/hbase/regionserver/StoreFileScanner.java
    Added implementation of new ChangedReadersObserver interface.
    Added a lock that we hold when 'nexting' and when changing the
    set of readers out from under the scanner.
    Changed the constructor moving bulk into new openReaders method
    that we reuse when list of Readers changes.
    (next): Moved head of this method into new getNextViableRow (used
    to be called chosenRow and chosenTimestamp).  New method returns
    simple datastructure of row and timestamp (ViableRow).
    (close): On close, remove ourselves as ChangedReadersObserver (we
    added ourselves in the constructor).
    (updateReaders): Changed the set of Readers out from under the
    Scanner.
A  src/java/org/apache/hadoop/hbase/regionserver/ChangedReadersObserver.java
    Added.
M  src/java/org/apache/hadoop/hbase/regionserver/Flusher.java
    Changed name of the interface we implement from CacheFlushListener to
    FlushRequester.
D  src/java/org/apache/hadoop/hbase/regionserver/CacheFlushListener.java
    Renamed as FlushRequester.
M  src/java/org/apache/hadoop/hbase/regionserver/HStoreScanner.java
    Remove update of activeScanners.
A  src/java/org/apache/hadoop/hbase/regionserver/FlushRequester.java
    Added.  Rename of CacheFlushListener.
M  src/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
    Renamed method getCacheFlushListener as getFlushRequester.
M src/java/org/apache/hadoop/hbase/regionserver/HAbstractScanner.java
    Formatting.
M  src/java/org/apache/hadoop/hbase/regionserver/HRegion.java
    CacheFlushListener was renamed as FlushListener.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@651017 13f79535-47bb-0310-9956-ffa450edef68
2008-04-23 19:21:26 +00:00