Commit Graph

199 Commits

Author SHA1 Message Date
Jim Kellerman a24a76ca83 HADOOP-2417 Fix critical shutdown problem introduced by HADOOP-2338
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604011 13f79535-47bb-0310-9956-ffa450edef68
2007-12-13 20:02:30 +00:00
Michael Stack 91de46cac1 HADOOP-2351 If select command returns no result, it doesn't need to show
the header information


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603940 13f79535-47bb-0310-9956-ffa450edef68
2007-12-13 15:43:04 +00:00
Michael Stack f8a906f49f HADOOP-2047 Add an '--master=X' and '--html' command-line parameters to shell
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603824 13f79535-47bb-0310-9956-ffa450edef68
2007-12-13 05:43:59 +00:00
Michael Stack c0000537e7 HADOOP-2407 Keeping MapFile.Reader open is expensive: Part 2
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603652 13f79535-47bb-0310-9956-ffa450edef68
2007-12-12 16:00:25 +00:00
Jim Kellerman c499da8b7b HADOOP-2392 HADOOP-2324 HADOOP-2396 HADOOP-2397
HADOOP-2392, HADOOP-2324:

Chore
- initialChore() now returns boolean

HMaster
- rather than retry in root and meta scanners, return if a scan fails. It will get retried on the next scan. This has two effects: 1) scanners exit more quickly during shutdown and 2) they don't keep retrying to connect to a dead server, allowing them to recover from a server going down more quickly.
- initialScan in root and meta scanners return boolean and do not progress to maintenanceScan until the initial scan completes successfully.

HRegionServer
- speed up region server exit by reordering join's so that we join with threads in the order that we told them to stop

TestTableMapReduce
- remove overrides of heartbeat and thread wake intervals

HADOOP-2396:

HMaster
- move check for null HRegionInfo before first attempt to dereference it.

HADOOP-2397:
- HMaster$BaseScanner.checkAssigned: don't try to split dead server's log if initial startup has completed.

HADOOP-2353:

HMsg
- change toString() to only output the region name rather than calling HRegionInfo.toString()

StaticTestEnvironment
- make logging a bit less verbose

TestHLog
- was writing to local file system and failing on Windows


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603428 13f79535-47bb-0310-9956-ffa450edef68
2007-12-12 00:40:02 +00:00
Michael Stack c70f6c5122 HADOOP-2370 Allow column families with an unlimited number of versions
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603315 13f79535-47bb-0310-9956-ffa450edef68
2007-12-11 17:56:51 +00:00
Michael Stack 29e68d505c HADOOP-2395 Implement "ALTER TABLE ... CHANGE column" operation
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603304 13f79535-47bb-0310-9956-ffa450edef68
2007-12-11 17:07:12 +00:00
Michael Stack f9fc02ba8b HADOOP-2283 AlreadyBeingCreatedException (Was: Stuck replay of failed
regionserver edits)


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603077 13f79535-47bb-0310-9956-ffa450edef68
2007-12-10 22:36:03 +00:00
Jim Kellerman 6a65a514a8 HADOOP-2392 TestRegionServerExit has new failure mode since HADOOP-2338
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602790 13f79535-47bb-0310-9956-ffa450edef68
2007-12-10 06:41:24 +00:00
Michael Stack faada59eb7 HADOOP-2384 Delete all members of a column family on a specific row
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602633 13f79535-47bb-0310-9956-ffa450edef68
2007-12-09 04:49:58 +00:00
Jim Kellerman 870cb3b5cf HADOOP-2350 Scanner api returns null row names, or skips row names if different column families do not have entries for some rows
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602334 13f79535-47bb-0310-9956-ffa450edef68
2007-12-08 06:54:31 +00:00
Michael Stack 3c80b8c75e HADOOP-1550 No means of deleting a'row'
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602284 13f79535-47bb-0310-9956-ffa450edef68
2007-12-08 00:39:32 +00:00
Michael Stack 02022f9931 HADOOP-2380 REST servlet throws NPE when any value node has an empty string
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602267 13f79535-47bb-0310-9956-ffa450edef68
2007-12-07 23:26:30 +00:00
Jim Kellerman 612f446dbd HADOOP-2338 Fix NullPointerException in master server.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602226 13f79535-47bb-0310-9956-ffa450edef68
2007-12-07 21:23:54 +00:00
Michael Stack bccf1dc26f HADOOP-2377 Holding open MapFile.Readers is expensive, so use less of them
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602199 13f79535-47bb-0310-9956-ffa450edef68
2007-12-07 19:49:19 +00:00
Michael Stack 11df017a67 HADOOP-2362 Leaking hdfs file handle on region split
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@601961 13f79535-47bb-0310-9956-ffa450edef68
2007-12-07 02:34:08 +00:00
Jim Kellerman 6fb4643705 HADOOP-2365 Result of HashFunction.hash() contains all identical values
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@601886 13f79535-47bb-0310-9956-ffa450edef68
2007-12-06 22:34:38 +00:00
Michael Stack 0ce1829c73 HADOOP-2357 Compaction cleanup; less deleting + prevent possible file leaks
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@601383 13f79535-47bb-0310-9956-ffa450edef68
2007-12-05 16:06:25 +00:00
Michael Stack afeed7bfc6 HADOOP-2347 REST servlet not thread safe but run in a threaded manner
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@601232 13f79535-47bb-0310-9956-ffa450edef68
2007-12-05 07:27:59 +00:00
Jim Kellerman 7f52d2e951 HADOOP-2333 Client side retries happen at the wrong level
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@601111 13f79535-47bb-0310-9956-ffa450edef68
2007-12-04 22:17:21 +00:00
Michael Stack 0d7a01cb8a HADOOP-2299 Support inclusive scans
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@601005 13f79535-47bb-0310-9956-ffa450edef68
2007-12-04 17:07:22 +00:00
Michael Stack c5eee12d4c HADOOP-2339 Delete command with no WHERE clause
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600771 13f79535-47bb-0310-9956-ffa450edef68
2007-12-04 02:48:49 +00:00
Michael Stack c7574f8f32 HADOOP-2316 Run REST servlet outside of master
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600707 13f79535-47bb-0310-9956-ffa450edef68
2007-12-03 22:06:07 +00:00
Michael Stack 30eb660601 HADOOP-2332 Meta table data selection in Hbase Shell
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600627 13f79535-47bb-0310-9956-ffa450edef68
2007-12-03 18:42:09 +00:00
Michael Stack 79e64fcc4f HADOOP-2315 REST servlet doesn't treat / characters in row key correctly
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600604 13f79535-47bb-0310-9956-ffa450edef68
2007-12-03 17:20:22 +00:00
Jim Kellerman ffe660105a HADOOP-2321 TestScanner2 does not release resources which sometimes cause the test to time out
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600443 13f79535-47bb-0310-9956-ffa450edef68
2007-12-03 08:28:32 +00:00
Jim Kellerman 7ac136887a HADOOP-2309 ConcurrentModificationException doing get of all region start keys
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600240 13f79535-47bb-0310-9956-ffa450edef68
2007-12-02 04:58:03 +00:00
Michael Stack fdff7385a6 HADOOP-2322 getRow(row, TS) client interface not properly connected
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600019 13f79535-47bb-0310-9956-ffa450edef68
2007-11-30 23:59:56 +00:00
Michael Stack 554146cc64 HADOOP-2320 Committed TestGet2 is managled (breaks build).
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599951 13f79535-47bb-0310-9956-ffa450edef68
2007-11-30 20:40:31 +00:00
Michael Stack 6b159e940e HADOOP-2068 RESTful interface
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599945 13f79535-47bb-0310-9956-ffa450edef68
2007-11-30 20:15:48 +00:00
Michael Stack f1f6738e2c HADOOP-2224 Add HTable.getRow(ROW, ts)
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599879 13f79535-47bb-0310-9956-ffa450edef68
2007-11-30 17:18:01 +00:00
Michael Stack c22dd06d14 HADOOP-2304 Abbreviated symbol parsing error of dir path in jar command
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599878 13f79535-47bb-0310-9956-ffa450edef68
2007-11-30 17:15:33 +00:00
Michael Stack 7fff3ab5f6 HADOOP-2308 null regioninfo breaks meta scanner
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599875 13f79535-47bb-0310-9956-ffa450edef68
2007-11-30 17:06:31 +00:00
Michael Stack 05d4458b47 HADOOP-2297 System.exit() Handling in hbase shell jar command
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599713 13f79535-47bb-0310-9956-ffa450edef68
2007-11-30 07:33:09 +00:00
Michael Stack 5a465ae05b HADOOP-2296 hbase shell: phantom columns show up from select command
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599703 13f79535-47bb-0310-9956-ffa450edef68
2007-11-30 06:35:47 +00:00
Michael Stack bf176b63f3 HADOOP-2234 TableInputFormat erroneously aggregates map values
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599643 13f79535-47bb-0310-9956-ffa450edef68
2007-11-30 00:01:25 +00:00
Jim Kellerman b8291d673e HADOOP-2295 Fix assigning a region to multiple servers
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599578 13f79535-47bb-0310-9956-ffa450edef68
2007-11-29 21:10:03 +00:00
Michael Stack 6f14e60b7f HADOOP-2198 HTable should have method to return table metadata
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599534 13f79535-47bb-0310-9956-ffa450edef68
2007-11-29 18:25:39 +00:00
Michael Stack 7102265285 HADOOP-2253 getRow can return HBASE::DELETEVAL cells
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599223 13f79535-47bb-0310-9956-ffa450edef68
2007-11-29 00:37:19 +00:00
Michael Stack 175f44ac81 HADOOP-1608 Relational Algrebra Operators
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599162 13f79535-47bb-0310-9956-ffa450edef68
2007-11-28 22:10:21 +00:00
Jim Kellerman 72414e6c91 HADOOP-2261 HTable.abort no longer throws exception if there is no active update.
HADOOP-2287 Make hbase unit tests take less time to complete.
HADOOP-2262 Retry n times instead of n**2 times.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599138 13f79535-47bb-0310-9956-ffa450edef68
2007-11-28 20:38:00 +00:00
Michael Stack 3bff065d34 HADOOP-2257 Show a total of all requests and regions on the web ui
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@598699 13f79535-47bb-0310-9956-ffa450edef68
2007-11-27 17:12:52 +00:00
Jim Kellerman 70004192f1 HADOOP-2262 HADOOP-2261 fail fast on non-existing table, change abort to function after commit even if commit was successful
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@598555 13f79535-47bb-0310-9956-ffa450edef68
2007-11-27 08:35:08 +00:00
Jim Kellerman 3786f399a6 HADOOP-2276 Address regression caused by HADOOP-2274, fix HADOOP-2173 (When the master times out a region servers lease, the region server may not restart)
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@598535 13f79535-47bb-0310-9956-ffa450edef68
2007-11-27 07:11:00 +00:00
Michael Stack d11960feef HADOOP-2289 Useless efforts of looking for the non-existant table in select command.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@598524 13f79535-47bb-0310-9956-ffa450edef68
2007-11-27 06:12:46 +00:00
Michael Stack eb2c941544 HADOOP-2196 Fix how hbase sits in hadoop 'package' product
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@598469 13f79535-47bb-0310-9956-ffa450edef68
2007-11-27 00:23:37 +00:00
Jim Kellerman c64eb9ebdc HADOOP-2274 Excess synchronization introduced by HADOOP-2139 negatively impacts performance
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@598113 13f79535-47bb-0310-9956-ffa450edef68
2007-11-26 03:05:37 +00:00
Jim Kellerman cbe167c981 HADOOP-2139 (phase 2) Make region server more event driven
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@597959 13f79535-47bb-0310-9956-ffa450edef68
2007-11-25 07:17:38 +00:00
Michael Stack 9052780e2d HADOOP-2267 Change the hbase shell prompt's title
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@597725 13f79535-47bb-0310-9956-ffa450edef68
2007-11-23 19:16:45 +00:00
Jim Kellerman 8a5b3da292 HADOOP-2139 (phase 1) Increase parallelism in region servers
There are a lot of changes in this patch. The memcache has been changed from a per/region object to a per/column object, and HLocking has been removed since we do not have to maintain any locks across RPC calls.

This necessitated major changes to HRegion and HStore

Additionally there were many changes required to the unit tests since they tend to exploit some private interfaces that weren't designed to be public. Some of those interfaces changed so the test cases did as well.

This patch is the result of extensive analysis of the multiple threads in HBase that contend for shared resources: updates, reads, scanners, cache flushing, compaction and region splitting.

Many of the tests are timing sensitive, and since we tend to make "dormant" intervals as short as possible to speed up the Hudson build, we may go through several iterations of getting them right before Hudson is happy. This is especially true since two test cases failed on my dual cpu windows machine while running the tests under Ant, but ran fine under Eclipse.

However, now that the tests are passing locally, I believe the changes are doing the right thing, but may require some parameter tweaks.

git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@596835 13f79535-47bb-0310-9956-ffa450edef68
2007-11-20 21:53:30 +00:00