Commit Graph

9835 Commits

Author SHA1 Message Date
Michael Stack 27afba4ead HADOOP-2443 Keep lazy cache of regions in client rather than an 'authoritative' list
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611727 13f79535-47bb-0310-9956-ffa450edef68
2008-01-14 06:54:28 +00:00
Jim Kellerman fed1075104 HADOOP-2500 Unreadable region kills region servers
HADOOP-2587 Splits blocked by compactions cause region to be offline for duration of compaction. 
Fix bug in TestCompaction in which two mini dfs clusters were being started for the same test.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611681 13f79535-47bb-0310-9956-ffa450edef68
2008-01-13 23:39:01 +00:00
Michael Stack f6f56a1d72 HADOOP-2533 Scanning, just creating MapWritable in next consumes >20% CPU
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611629 13f79535-47bb-0310-9956-ffa450edef68
2008-01-13 20:10:22 +00:00
Michael Stack d7de304808 HADOOP-2557 Shell count function
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611537 13f79535-47bb-0310-9956-ffa450edef68
2008-01-13 05:24:14 +00:00
Michael Stack 470b3a3200 HADOOP-2389 Provide multiple language bindings for HBase (Thrift)
Actual code (first commit added thrift lib so this patch would build).


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611535 13f79535-47bb-0310-9956-ffa450edef68
2008-01-13 04:46:44 +00:00
Jim Kellerman 9c142a76a1 HADOOP-2478 Restructure how HBase lays out files in the file system (phase 2) Includes migration tool org.apache.hadoop.hbase.util.Migrate
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611519 13f79535-47bb-0310-9956-ffa450edef68
2008-01-13 01:36:08 +00:00
Michael Stack 979da3823a HADOOP-2548 Make TableMap and TableReduce generic
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611488 13f79535-47bb-0310-9956-ffa450edef68
2008-01-12 21:32:46 +00:00
Michael Stack d004f6e545 HADOOP-2558 fixes for build up on hudson
Part 5.  Fix NPE in make multiregion.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611005 13f79535-47bb-0310-9956-ffa450edef68
2008-01-11 01:19:06 +00:00
Michael Stack e3031f035f HADOOP-2558 fixes for build up on hudson
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610978 13f79535-47bb-0310-9956-ffa450edef68
2008-01-10 23:05:31 +00:00
Michael Stack db34c56319 HADOOP-2389 Provide multiple language bindings for HBase (Thrift)
Added thrift jar in advance so HADOOP-2389 patch will build on hudson.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610921 13f79535-47bb-0310-9956-ffa450edef68
2008-01-10 20:34:59 +00:00
Michael Stack df0f5658a5 HADOOP-2553 Don't make Long objects calculating hbase type hash codes
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610698 13f79535-47bb-0310-9956-ffa450edef68
2008-01-10 06:57:00 +00:00
Michael Stack 765ee86279 HADOOP-2558 fixes for build up on hudson (part 2)
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610696 13f79535-47bb-0310-9956-ffa450edef68
2008-01-10 06:47:22 +00:00
Jim Kellerman 3817485e03 HADOOP-2478 test input data.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610603 13f79535-47bb-0310-9956-ffa450edef68
2008-01-09 22:51:04 +00:00
Michael Stack 3d80b1a498 HADOOP-2558 fixes for build up on hudson (Part 1)
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610280 13f79535-47bb-0310-9956-ffa450edef68
2008-01-09 06:40:10 +00:00
Michael Stack a22bf5e1e2 HADOOP-2490 Failure in nightly #346
Add one fix and more logging to help diagnose the failures up on hudson.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610237 13f79535-47bb-0310-9956-ffa450edef68
2008-01-09 00:07:16 +00:00
Michael Stack 450fe7b100 HADOOP-2472 Range selection using filter
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610092 13f79535-47bb-0310-9956-ffa450edef68
2008-01-08 18:27:58 +00:00
Michael Stack f5bfeea892 HADOOP-2450 Show version (and svn revision) in hbase web ui
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610087 13f79535-47bb-0310-9956-ffa450edef68
2008-01-08 18:11:45 +00:00
Michael Stack 5a804bf5f3 HADOOP-2502 Insert/Select timestamp, Timestamp data type in HQL
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@609730 13f79535-47bb-0310-9956-ffa450edef68
2008-01-07 18:26:08 +00:00
Michael Stack 5893f72c17 HADOOP-2522 Separate MapFile benchmark from PerformanceEvaluation
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@609422 13f79535-47bb-0310-9956-ffa450edef68
2008-01-06 21:58:16 +00:00
Michael Stack 24958ffd44 HADOOP-2240 Truncate for hbase
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@609256 13f79535-47bb-0310-9956-ffa450edef68
2008-01-06 06:11:55 +00:00
Michael Stack 56fa3392a1 HADOOP-2240 Truncate for hbase
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@609254 13f79535-47bb-0310-9956-ffa450edef68
2008-01-06 04:43:54 +00:00
Michael Stack 3f4e2cd235 HADOOP-2530 Missing type in new hbase custom RPC serializer
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@609210 13f79535-47bb-0310-9956-ffa450edef68
2008-01-05 20:39:09 +00:00
Michael Stack 090f130a1b HADOOP-2522 Separate MapFile benchmark from PerformanceEvaluation
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@608941 13f79535-47bb-0310-9956-ffa450edef68
2008-01-04 17:54:16 +00:00
Michael Stack 07eb878e5a HADOOP-2507 REST servlet does not properly base64 row keys and column names
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@608762 13f79535-47bb-0310-9956-ffa450edef68
2008-01-04 06:56:28 +00:00
Michael Stack 13239f413e HADOOP-2504 REST servlet method for deleting a scanner was not properly
mapped


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@608743 13f79535-47bb-0310-9956-ffa450edef68
2008-01-04 04:39:02 +00:00
Michael Stack c89219b47b HADOOP-2519 Performance improvements: Customized RPC serialization
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@608738 13f79535-47bb-0310-9956-ffa450edef68
2008-01-04 03:52:53 +00:00
Michael Stack b0f524f3d7 HADOOP-2506 Remove the algebra package
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@608289 13f79535-47bb-0310-9956-ffa450edef68
2008-01-03 00:06:38 +00:00
Michael Stack 9ebe18e2b4 HADOOP-2505 formatter classes missing apache license
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607754 13f79535-47bb-0310-9956-ffa450edef68
2007-12-31 17:01:27 +00:00
Michael Stack 0e8bbbf2f7 HADOOP-2495 inor performance improvements: Slim-down BatchOperation, etc.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607602 13f79535-47bb-0310-9956-ffa450edef68
2007-12-30 22:22:16 +00:00
Michael Stack 6b005b4f3f HADOOP-2503 REST Insert / Select encoding issues
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607592 13f79535-47bb-0310-9956-ffa450edef68
2007-12-30 21:40:50 +00:00
Michael Stack 164bc44b58 HADOOP-2485 Make mapfile index interval configurable
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607131 13f79535-47bb-0310-9956-ffa450edef68
2007-12-27 22:26:27 +00:00
Michael Stack bbae5a575f HADOOP-2479 Save on number of Text object creations
Add new files.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@606333 13f79535-47bb-0310-9956-ffa450edef68
2007-12-21 22:01:23 +00:00
Michael Stack 87273adb1c HADOOP-2479 Save on number of Text object creations
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@606332 13f79535-47bb-0310-9956-ffa450edef68
2007-12-21 21:58:25 +00:00
Michael Stack 0465b18a35 HADOOP-2471 Add reading/writing MapFile to PerformanceEvaluation suite
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605976 13f79535-47bb-0310-9956-ffa450edef68
2007-12-20 16:44:59 +00:00
Michael Stack 3b36d543de HADOOP-2467 scanner truncates resultset when > 1 column families
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605811 13f79535-47bb-0310-9956-ffa450edef68
2007-12-20 05:35:07 +00:00
Jim Kellerman db809b2145 HADOOP-2468 TestRegionServerExit failed in Hadoop-Nightly #338
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605675 13f79535-47bb-0310-9956-ffa450edef68
2007-12-19 20:11:17 +00:00
Jim Kellerman 83c09ebccc HADOOP-2458 HStoreFile.writeSplitInfo should just call HStoreFile.Reference.write
HADOOP-2458 HStoreFile.writeSplitInfo should just call HStoreFile.Reference.write 


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605466 13f79535-47bb-0310-9956-ffa450edef68
2007-12-19 08:22:33 +00:00
Michael Stack 2630fd3cee HADOOP-2455 Error in Help-string of create command
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605277 13f79535-47bb-0310-9956-ffa450edef68
2007-12-18 18:06:45 +00:00
Jim Kellerman c55f90590a HADOOP-2451 End key is incorrectly assigned in many region splits
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605102 13f79535-47bb-0310-9956-ffa450edef68
2007-12-18 06:26:11 +00:00
Jim Kellerman c73ddd1aa8 HADOOP-2441 Fix build failures in TestHBaseCluster
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604999 13f79535-47bb-0310-9956-ffa450edef68
2007-12-17 20:53:45 +00:00
Jim Kellerman 6da6ebed1e HADOOP-2199 Add tools for going from hregion filename to region name in logs
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604325 13f79535-47bb-0310-9956-ffa450edef68
2007-12-14 22:57:29 +00:00
Jim Kellerman 9b68f4bf41 HADOOP-2430 Master will not shut down if there are no active region servers
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604309 13f79535-47bb-0310-9956-ffa450edef68
2007-12-14 21:51:45 +00:00
Jim Kellerman 10bac1971d HADOOP-2414 Fix ArrayIndexOutOfBoundsException in bloom filters.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604281 13f79535-47bb-0310-9956-ffa450edef68
2007-12-14 19:58:33 +00:00
Michael Stack b36f712736 HADOOP-2286 Add being able to shutdown regionservers
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604233 13f79535-47bb-0310-9956-ffa450edef68
2007-12-14 17:12:09 +00:00
Jim Kellerman 438b82450a HADOOP-2418 Fix assertion failures in TestTableMapReduce, TestTableIndex, and TestTableJoinMapReduce
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604034 13f79535-47bb-0310-9956-ffa450edef68
2007-12-13 21:28:03 +00:00
Jim Kellerman a24a76ca83 HADOOP-2417 Fix critical shutdown problem introduced by HADOOP-2338
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604011 13f79535-47bb-0310-9956-ffa450edef68
2007-12-13 20:02:30 +00:00
Michael Stack 91de46cac1 HADOOP-2351 If select command returns no result, it doesn't need to show
the header information


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603940 13f79535-47bb-0310-9956-ffa450edef68
2007-12-13 15:43:04 +00:00
Michael Stack f8a906f49f HADOOP-2047 Add an '--master=X' and '--html' command-line parameters to shell
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603824 13f79535-47bb-0310-9956-ffa450edef68
2007-12-13 05:43:59 +00:00
Michael Stack c0000537e7 HADOOP-2407 Keeping MapFile.Reader open is expensive: Part 2
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603652 13f79535-47bb-0310-9956-ffa450edef68
2007-12-12 16:00:25 +00:00
Jim Kellerman c499da8b7b HADOOP-2392 HADOOP-2324 HADOOP-2396 HADOOP-2397
HADOOP-2392, HADOOP-2324:

Chore
- initialChore() now returns boolean

HMaster
- rather than retry in root and meta scanners, return if a scan fails. It will get retried on the next scan. This has two effects: 1) scanners exit more quickly during shutdown and 2) they don't keep retrying to connect to a dead server, allowing them to recover from a server going down more quickly.
- initialScan in root and meta scanners return boolean and do not progress to maintenanceScan until the initial scan completes successfully.

HRegionServer
- speed up region server exit by reordering join's so that we join with threads in the order that we told them to stop

TestTableMapReduce
- remove overrides of heartbeat and thread wake intervals

HADOOP-2396:

HMaster
- move check for null HRegionInfo before first attempt to dereference it.

HADOOP-2397:
- HMaster$BaseScanner.checkAssigned: don't try to split dead server's log if initial startup has completed.

HADOOP-2353:

HMsg
- change toString() to only output the region name rather than calling HRegionInfo.toString()

StaticTestEnvironment
- make logging a bit less verbose

TestHLog
- was writing to local file system and failing on Windows


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603428 13f79535-47bb-0310-9956-ffa450edef68
2007-12-12 00:40:02 +00:00