Commit Graph

273 Commits

Author SHA1 Message Date
Michael Stack 5893f72c17 HADOOP-2522 Separate MapFile benchmark from PerformanceEvaluation
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@609422 13f79535-47bb-0310-9956-ffa450edef68
2008-01-06 21:58:16 +00:00
Michael Stack 56fa3392a1 HADOOP-2240 Truncate for hbase
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@609254 13f79535-47bb-0310-9956-ffa450edef68
2008-01-06 04:43:54 +00:00
Michael Stack 3f4e2cd235 HADOOP-2530 Missing type in new hbase custom RPC serializer
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@609210 13f79535-47bb-0310-9956-ffa450edef68
2008-01-05 20:39:09 +00:00
Michael Stack 07eb878e5a HADOOP-2507 REST servlet does not properly base64 row keys and column names
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@608762 13f79535-47bb-0310-9956-ffa450edef68
2008-01-04 06:56:28 +00:00
Michael Stack 13239f413e HADOOP-2504 REST servlet method for deleting a scanner was not properly
mapped


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@608743 13f79535-47bb-0310-9956-ffa450edef68
2008-01-04 04:39:02 +00:00
Michael Stack c89219b47b HADOOP-2519 Performance improvements: Customized RPC serialization
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@608738 13f79535-47bb-0310-9956-ffa450edef68
2008-01-04 03:52:53 +00:00
Michael Stack b0f524f3d7 HADOOP-2506 Remove the algebra package
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@608289 13f79535-47bb-0310-9956-ffa450edef68
2008-01-03 00:06:38 +00:00
Michael Stack 9ebe18e2b4 HADOOP-2505 formatter classes missing apache license
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607754 13f79535-47bb-0310-9956-ffa450edef68
2007-12-31 17:01:27 +00:00
Michael Stack 0e8bbbf2f7 HADOOP-2495 inor performance improvements: Slim-down BatchOperation, etc.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607602 13f79535-47bb-0310-9956-ffa450edef68
2007-12-30 22:22:16 +00:00
Michael Stack 6b005b4f3f HADOOP-2503 REST Insert / Select encoding issues
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607592 13f79535-47bb-0310-9956-ffa450edef68
2007-12-30 21:40:50 +00:00
Michael Stack 164bc44b58 HADOOP-2485 Make mapfile index interval configurable
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607131 13f79535-47bb-0310-9956-ffa450edef68
2007-12-27 22:26:27 +00:00
Michael Stack 87273adb1c HADOOP-2479 Save on number of Text object creations
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@606332 13f79535-47bb-0310-9956-ffa450edef68
2007-12-21 21:58:25 +00:00
Michael Stack 0465b18a35 HADOOP-2471 Add reading/writing MapFile to PerformanceEvaluation suite
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605976 13f79535-47bb-0310-9956-ffa450edef68
2007-12-20 16:44:59 +00:00
Michael Stack 3b36d543de HADOOP-2467 scanner truncates resultset when > 1 column families
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605811 13f79535-47bb-0310-9956-ffa450edef68
2007-12-20 05:35:07 +00:00
Jim Kellerman db809b2145 HADOOP-2468 TestRegionServerExit failed in Hadoop-Nightly #338
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605675 13f79535-47bb-0310-9956-ffa450edef68
2007-12-19 20:11:17 +00:00
Jim Kellerman 83c09ebccc HADOOP-2458 HStoreFile.writeSplitInfo should just call HStoreFile.Reference.write
HADOOP-2458 HStoreFile.writeSplitInfo should just call HStoreFile.Reference.write 


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605466 13f79535-47bb-0310-9956-ffa450edef68
2007-12-19 08:22:33 +00:00
Michael Stack 2630fd3cee HADOOP-2455 Error in Help-string of create command
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605277 13f79535-47bb-0310-9956-ffa450edef68
2007-12-18 18:06:45 +00:00
Jim Kellerman c55f90590a HADOOP-2451 End key is incorrectly assigned in many region splits
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605102 13f79535-47bb-0310-9956-ffa450edef68
2007-12-18 06:26:11 +00:00
Jim Kellerman c73ddd1aa8 HADOOP-2441 Fix build failures in TestHBaseCluster
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604999 13f79535-47bb-0310-9956-ffa450edef68
2007-12-17 20:53:45 +00:00
Jim Kellerman 6da6ebed1e HADOOP-2199 Add tools for going from hregion filename to region name in logs
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604325 13f79535-47bb-0310-9956-ffa450edef68
2007-12-14 22:57:29 +00:00
Jim Kellerman 9b68f4bf41 HADOOP-2430 Master will not shut down if there are no active region servers
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604309 13f79535-47bb-0310-9956-ffa450edef68
2007-12-14 21:51:45 +00:00
Jim Kellerman 10bac1971d HADOOP-2414 Fix ArrayIndexOutOfBoundsException in bloom filters.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604281 13f79535-47bb-0310-9956-ffa450edef68
2007-12-14 19:58:33 +00:00
Michael Stack b36f712736 HADOOP-2286 Add being able to shutdown regionservers
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604233 13f79535-47bb-0310-9956-ffa450edef68
2007-12-14 17:12:09 +00:00
Jim Kellerman 438b82450a HADOOP-2418 Fix assertion failures in TestTableMapReduce, TestTableIndex, and TestTableJoinMapReduce
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604034 13f79535-47bb-0310-9956-ffa450edef68
2007-12-13 21:28:03 +00:00
Jim Kellerman a24a76ca83 HADOOP-2417 Fix critical shutdown problem introduced by HADOOP-2338
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604011 13f79535-47bb-0310-9956-ffa450edef68
2007-12-13 20:02:30 +00:00
Michael Stack 91de46cac1 HADOOP-2351 If select command returns no result, it doesn't need to show
the header information


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603940 13f79535-47bb-0310-9956-ffa450edef68
2007-12-13 15:43:04 +00:00
Michael Stack f8a906f49f HADOOP-2047 Add an '--master=X' and '--html' command-line parameters to shell
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603824 13f79535-47bb-0310-9956-ffa450edef68
2007-12-13 05:43:59 +00:00
Michael Stack c0000537e7 HADOOP-2407 Keeping MapFile.Reader open is expensive: Part 2
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603652 13f79535-47bb-0310-9956-ffa450edef68
2007-12-12 16:00:25 +00:00
Jim Kellerman c499da8b7b HADOOP-2392 HADOOP-2324 HADOOP-2396 HADOOP-2397
HADOOP-2392, HADOOP-2324:

Chore
- initialChore() now returns boolean

HMaster
- rather than retry in root and meta scanners, return if a scan fails. It will get retried on the next scan. This has two effects: 1) scanners exit more quickly during shutdown and 2) they don't keep retrying to connect to a dead server, allowing them to recover from a server going down more quickly.
- initialScan in root and meta scanners return boolean and do not progress to maintenanceScan until the initial scan completes successfully.

HRegionServer
- speed up region server exit by reordering join's so that we join with threads in the order that we told them to stop

TestTableMapReduce
- remove overrides of heartbeat and thread wake intervals

HADOOP-2396:

HMaster
- move check for null HRegionInfo before first attempt to dereference it.

HADOOP-2397:
- HMaster$BaseScanner.checkAssigned: don't try to split dead server's log if initial startup has completed.

HADOOP-2353:

HMsg
- change toString() to only output the region name rather than calling HRegionInfo.toString()

StaticTestEnvironment
- make logging a bit less verbose

TestHLog
- was writing to local file system and failing on Windows


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603428 13f79535-47bb-0310-9956-ffa450edef68
2007-12-12 00:40:02 +00:00
Michael Stack c70f6c5122 HADOOP-2370 Allow column families with an unlimited number of versions
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603315 13f79535-47bb-0310-9956-ffa450edef68
2007-12-11 17:56:51 +00:00
Michael Stack 29e68d505c HADOOP-2395 Implement "ALTER TABLE ... CHANGE column" operation
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603304 13f79535-47bb-0310-9956-ffa450edef68
2007-12-11 17:07:12 +00:00
Michael Stack f9fc02ba8b HADOOP-2283 AlreadyBeingCreatedException (Was: Stuck replay of failed
regionserver edits)


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603077 13f79535-47bb-0310-9956-ffa450edef68
2007-12-10 22:36:03 +00:00
Jim Kellerman 6a65a514a8 HADOOP-2392 TestRegionServerExit has new failure mode since HADOOP-2338
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602790 13f79535-47bb-0310-9956-ffa450edef68
2007-12-10 06:41:24 +00:00
Michael Stack faada59eb7 HADOOP-2384 Delete all members of a column family on a specific row
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602633 13f79535-47bb-0310-9956-ffa450edef68
2007-12-09 04:49:58 +00:00
Jim Kellerman 870cb3b5cf HADOOP-2350 Scanner api returns null row names, or skips row names if different column families do not have entries for some rows
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602334 13f79535-47bb-0310-9956-ffa450edef68
2007-12-08 06:54:31 +00:00
Michael Stack 3c80b8c75e HADOOP-1550 No means of deleting a'row'
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602284 13f79535-47bb-0310-9956-ffa450edef68
2007-12-08 00:39:32 +00:00
Michael Stack 02022f9931 HADOOP-2380 REST servlet throws NPE when any value node has an empty string
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602267 13f79535-47bb-0310-9956-ffa450edef68
2007-12-07 23:26:30 +00:00
Jim Kellerman 612f446dbd HADOOP-2338 Fix NullPointerException in master server.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602226 13f79535-47bb-0310-9956-ffa450edef68
2007-12-07 21:23:54 +00:00
Michael Stack bccf1dc26f HADOOP-2377 Holding open MapFile.Readers is expensive, so use less of them
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@602199 13f79535-47bb-0310-9956-ffa450edef68
2007-12-07 19:49:19 +00:00
Michael Stack 11df017a67 HADOOP-2362 Leaking hdfs file handle on region split
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@601961 13f79535-47bb-0310-9956-ffa450edef68
2007-12-07 02:34:08 +00:00
Jim Kellerman 6fb4643705 HADOOP-2365 Result of HashFunction.hash() contains all identical values
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@601886 13f79535-47bb-0310-9956-ffa450edef68
2007-12-06 22:34:38 +00:00
Michael Stack 0ce1829c73 HADOOP-2357 Compaction cleanup; less deleting + prevent possible file leaks
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@601383 13f79535-47bb-0310-9956-ffa450edef68
2007-12-05 16:06:25 +00:00
Michael Stack afeed7bfc6 HADOOP-2347 REST servlet not thread safe but run in a threaded manner
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@601232 13f79535-47bb-0310-9956-ffa450edef68
2007-12-05 07:27:59 +00:00
Jim Kellerman 7f52d2e951 HADOOP-2333 Client side retries happen at the wrong level
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@601111 13f79535-47bb-0310-9956-ffa450edef68
2007-12-04 22:17:21 +00:00
Michael Stack 0d7a01cb8a HADOOP-2299 Support inclusive scans
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@601005 13f79535-47bb-0310-9956-ffa450edef68
2007-12-04 17:07:22 +00:00
Michael Stack c5eee12d4c HADOOP-2339 Delete command with no WHERE clause
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600771 13f79535-47bb-0310-9956-ffa450edef68
2007-12-04 02:48:49 +00:00
Michael Stack c7574f8f32 HADOOP-2316 Run REST servlet outside of master
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600707 13f79535-47bb-0310-9956-ffa450edef68
2007-12-03 22:06:07 +00:00
Michael Stack 30eb660601 HADOOP-2332 Meta table data selection in Hbase Shell
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600627 13f79535-47bb-0310-9956-ffa450edef68
2007-12-03 18:42:09 +00:00
Michael Stack 79e64fcc4f HADOOP-2315 REST servlet doesn't treat / characters in row key correctly
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600604 13f79535-47bb-0310-9956-ffa450edef68
2007-12-03 17:20:22 +00:00
Jim Kellerman ffe660105a HADOOP-2321 TestScanner2 does not release resources which sometimes cause the test to time out
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600443 13f79535-47bb-0310-9956-ffa450edef68
2007-12-03 08:28:32 +00:00
Jim Kellerman 7ac136887a HADOOP-2309 ConcurrentModificationException doing get of all region start keys
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600240 13f79535-47bb-0310-9956-ffa450edef68
2007-12-02 04:58:03 +00:00
Michael Stack fdff7385a6 HADOOP-2322 getRow(row, TS) client interface not properly connected
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@600019 13f79535-47bb-0310-9956-ffa450edef68
2007-11-30 23:59:56 +00:00
Michael Stack 554146cc64 HADOOP-2320 Committed TestGet2 is managled (breaks build).
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599951 13f79535-47bb-0310-9956-ffa450edef68
2007-11-30 20:40:31 +00:00
Michael Stack 6b159e940e HADOOP-2068 RESTful interface
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599945 13f79535-47bb-0310-9956-ffa450edef68
2007-11-30 20:15:48 +00:00
Michael Stack f1f6738e2c HADOOP-2224 Add HTable.getRow(ROW, ts)
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599879 13f79535-47bb-0310-9956-ffa450edef68
2007-11-30 17:18:01 +00:00
Michael Stack c22dd06d14 HADOOP-2304 Abbreviated symbol parsing error of dir path in jar command
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599878 13f79535-47bb-0310-9956-ffa450edef68
2007-11-30 17:15:33 +00:00
Michael Stack 7fff3ab5f6 HADOOP-2308 null regioninfo breaks meta scanner
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599875 13f79535-47bb-0310-9956-ffa450edef68
2007-11-30 17:06:31 +00:00
Michael Stack 05d4458b47 HADOOP-2297 System.exit() Handling in hbase shell jar command
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599713 13f79535-47bb-0310-9956-ffa450edef68
2007-11-30 07:33:09 +00:00
Michael Stack 5a465ae05b HADOOP-2296 hbase shell: phantom columns show up from select command
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599703 13f79535-47bb-0310-9956-ffa450edef68
2007-11-30 06:35:47 +00:00
Michael Stack bf176b63f3 HADOOP-2234 TableInputFormat erroneously aggregates map values
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599643 13f79535-47bb-0310-9956-ffa450edef68
2007-11-30 00:01:25 +00:00
Jim Kellerman b8291d673e HADOOP-2295 Fix assigning a region to multiple servers
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599578 13f79535-47bb-0310-9956-ffa450edef68
2007-11-29 21:10:03 +00:00
Michael Stack 6f14e60b7f HADOOP-2198 HTable should have method to return table metadata
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599534 13f79535-47bb-0310-9956-ffa450edef68
2007-11-29 18:25:39 +00:00
Michael Stack 7102265285 HADOOP-2253 getRow can return HBASE::DELETEVAL cells
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599223 13f79535-47bb-0310-9956-ffa450edef68
2007-11-29 00:37:19 +00:00
Michael Stack 175f44ac81 HADOOP-1608 Relational Algrebra Operators
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599162 13f79535-47bb-0310-9956-ffa450edef68
2007-11-28 22:10:21 +00:00
Jim Kellerman 72414e6c91 HADOOP-2261 HTable.abort no longer throws exception if there is no active update.
HADOOP-2287 Make hbase unit tests take less time to complete.
HADOOP-2262 Retry n times instead of n**2 times.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@599138 13f79535-47bb-0310-9956-ffa450edef68
2007-11-28 20:38:00 +00:00
Michael Stack 3bff065d34 HADOOP-2257 Show a total of all requests and regions on the web ui
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@598699 13f79535-47bb-0310-9956-ffa450edef68
2007-11-27 17:12:52 +00:00
Jim Kellerman 70004192f1 HADOOP-2262 HADOOP-2261 fail fast on non-existing table, change abort to function after commit even if commit was successful
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@598555 13f79535-47bb-0310-9956-ffa450edef68
2007-11-27 08:35:08 +00:00
Jim Kellerman 3786f399a6 HADOOP-2276 Address regression caused by HADOOP-2274, fix HADOOP-2173 (When the master times out a region servers lease, the region server may not restart)
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@598535 13f79535-47bb-0310-9956-ffa450edef68
2007-11-27 07:11:00 +00:00
Michael Stack d11960feef HADOOP-2289 Useless efforts of looking for the non-existant table in select command.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@598524 13f79535-47bb-0310-9956-ffa450edef68
2007-11-27 06:12:46 +00:00
Michael Stack eb2c941544 HADOOP-2196 Fix how hbase sits in hadoop 'package' product
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@598469 13f79535-47bb-0310-9956-ffa450edef68
2007-11-27 00:23:37 +00:00
Jim Kellerman c64eb9ebdc HADOOP-2274 Excess synchronization introduced by HADOOP-2139 negatively impacts performance
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@598113 13f79535-47bb-0310-9956-ffa450edef68
2007-11-26 03:05:37 +00:00
Jim Kellerman cbe167c981 HADOOP-2139 (phase 2) Make region server more event driven
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@597959 13f79535-47bb-0310-9956-ffa450edef68
2007-11-25 07:17:38 +00:00
Michael Stack 9052780e2d HADOOP-2267 Change the hbase shell prompt's title
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@597725 13f79535-47bb-0310-9956-ffa450edef68
2007-11-23 19:16:45 +00:00
Jim Kellerman 8a5b3da292 HADOOP-2139 (phase 1) Increase parallelism in region servers
There are a lot of changes in this patch. The memcache has been changed from a per/region object to a per/column object, and HLocking has been removed since we do not have to maintain any locks across RPC calls.

This necessitated major changes to HRegion and HStore

Additionally there were many changes required to the unit tests since they tend to exploit some private interfaces that weren't designed to be public. Some of those interfaces changed so the test cases did as well.

This patch is the result of extensive analysis of the multiple threads in HBase that contend for shared resources: updates, reads, scanners, cache flushing, compaction and region splitting.

Many of the tests are timing sensitive, and since we tend to make "dormant" intervals as short as possible to speed up the Hudson build, we may go through several iterations of getting them right before Hudson is happy. This is especially true since two test cases failed on my dual cpu windows machine while running the tests under Ant, but ran fine under Eclipse.

However, now that the tests are passing locally, I believe the changes are doing the right thing, but may require some parameter tweaks.

git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@596835 13f79535-47bb-0310-9956-ffa450edef68
2007-11-20 21:53:30 +00:00
Michael Stack bf4262e220 HADOOP-2040 Hudson hangs AFTER test has finished
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@594715 13f79535-47bb-0310-9956-ffa450edef68
2007-11-13 23:38:21 +00:00
Michael Stack 33ab394d4a HADOOP-2176 Htable.deleteAll documentation is ambiguous
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@593708 13f79535-47bb-0310-9956-ffa450edef68
2007-11-10 01:09:33 +00:00
Michael Stack 26b3d9442d HADOOP-2161 getRow() is orders of magnitudes slower than get(), even on
rows with one column


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@593665 13f79535-47bb-0310-9956-ffa450edef68
2007-11-09 21:57:24 +00:00
Michael Stack 5c869d23e9 HADOOP-2074 Simple switch to enable DEBUG level-logging in hbase
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@592603 13f79535-47bb-0310-9956-ffa450edef68
2007-11-07 03:48:13 +00:00
Michael Stack 656cee4138 HADOOP-2156 BufferUnderflowException for un-named HTableDescriptors
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@592551 13f79535-47bb-0310-9956-ffa450edef68
2007-11-06 20:48:27 +00:00
Michael Stack 9be624fc93 HADOOP-2155 Method expecting HBaseConfiguration throw NPE when given Configuration
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@592549 13f79535-47bb-0310-9956-ffa450edef68
2007-11-06 20:47:35 +00:00
Michael Stack cda8c597fc HADOOP-2157 Make Scanners implement Iterable
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@592548 13f79535-47bb-0310-9956-ffa450edef68
2007-11-06 20:45:28 +00:00
Jim Kellerman 334402af58 HADOOP-2109
- Fix another race condition in processing dead servers,
- Fix error online meta regions: was using region name and not startKey as key for map.put.
- Change TestRegionServerExit to always kill the region server for the META region. This makes the test more deterministic and getting META reassigned was problematic.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@591880 13f79535-47bb-0310-9956-ffa450edef68
2007-11-05 05:06:35 +00:00
Jim Kellerman 41c71508db HADOOP-2109 Fix another race condition in processing dead servers, Fix error online meta regions: was using region name and not startKey as key for map.put
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@591722 13f79535-47bb-0310-9956-ffa450edef68
2007-11-04 01:47:24 +00:00
Jim Kellerman ad743978ed HADOOP-2109 Fix another race condition in processing dead servers
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@591549 13f79535-47bb-0310-9956-ffa450edef68
2007-11-03 04:00:12 +00:00
Michael Stack d8f4792f8e HADOOP-2137 hql.jsp : The character 0x19 is not valid
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@591177 13f79535-47bb-0310-9956-ffa450edef68
2007-11-02 00:43:07 +00:00
Jim Kellerman 2bd1e2cac2 HADOOP-2109 Fixed race condition in processing server lease timeout.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@591162 13f79535-47bb-0310-9956-ffa450edef68
2007-11-01 22:49:08 +00:00
Michael Stack e92a4023d5 HADOOP-2083 TestTableIndex failed in patch build #970 and #956
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@591039 13f79535-47bb-0310-9956-ffa450edef68
2007-11-01 15:01:43 +00:00
Jim Kellerman 0c8412cb79 HADOOP-2126 Use Bob Jenkins' hash for bloom filters
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@590875 13f79535-47bb-0310-9956-ffa450edef68
2007-11-01 01:48:46 +00:00
Jim Kellerman e91c531235 HADOOP-2124 Use of `hostname` does not work on Cygwin in some cases
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@590273 13f79535-47bb-0310-9956-ffa450edef68
2007-10-30 19:08:23 +00:00
Michael Stack 00d4ab27f3 HADOOP-2088 Make hbase runnable in $HADOOP_HOME/build(/contrib/hbase)
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@588699 13f79535-47bb-0310-9956-ffa450edef68
2007-10-26 16:16:53 +00:00
Michael Stack 1aeb23aeee HADOOP-2084 Add a LocalHBaseCluster
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@588264 13f79535-47bb-0310-9956-ffa450edef68
2007-10-25 16:12:51 +00:00
Jim Kellerman fa1c77bd3e HADOOP-2079 HADOOP-2056 Fix generated HLog, HRegion names
HLog.splitLog was generating incorrect file names, HRegion was generating file names that could be far too long especially for local file systems, HMaster had a race condition in which an old HLog would get split by two threads simultaneously. 

git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@586680 13f79535-47bb-0310-9956-ffa450edef68
2007-10-20 08:06:52 +00:00
Jim Kellerman cc202c4b74 HADOOP-2056 A table with row keys containing colon fails to split regions
Many modifications required because region names (which contain start key) were used as file or directory names. Now the startKey is encoded in an order preserving Base64 dialect.

git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@586159 13f79535-47bb-0310-9956-ffa450edef68
2007-10-18 22:21:09 +00:00
Michael Stack 0b92e8826a HADOOP-2064 TestSplit assertion and NPE failures (Patch build #952 and #953)
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@585293 13f79535-47bb-0310-9956-ffa450edef68
2007-10-17 00:09:55 +00:00
Jim Kellerman a5701cbbb0 HADOOP-2061 Add new Base64 dialects - updated wrong portion of CHANGES.txt - fixed.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@585225 13f79535-47bb-0310-9956-ffa450edef68
2007-10-16 19:11:07 +00:00
Jim Kellerman ab813c3673 HADOOP-2061 Add new Base64 dialects
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@585219 13f79535-47bb-0310-9956-ffa450edef68
2007-10-16 18:56:28 +00:00
Michael Stack 8a381624d9 HADOOP-2059 In tests, exceptions in min dfs shutdown should not fail test
(e.g. nightly #272)


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@584919 13f79535-47bb-0310-9956-ffa450edef68
2007-10-15 21:05:23 +00:00
Michael Stack f07a9fd89a HADOOP-2401 Add convenience put method that takes writable
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@584844 13f79535-47bb-0310-9956-ffa450edef68
2007-10-15 18:42:28 +00:00
Michael Stack 8faa2ea9c6 HADOOP-2038 TestCleanRegionServerExit failed in patch build #927
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@584212 13f79535-47bb-0310-9956-ffa450edef68
2007-10-12 17:46:37 +00:00
Michael Stack 00f32814d1 HADOOP-2035 Add logo to webapps
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@583946 13f79535-47bb-0310-9956-ffa450edef68
2007-10-11 20:33:53 +00:00