Commit Graph

15833 Commits

Author SHA1 Message Date
Michael Stack f6f56a1d72 HADOOP-2533 Scanning, just creating MapWritable in next consumes >20% CPU
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611629 13f79535-47bb-0310-9956-ffa450edef68
2008-01-13 20:10:22 +00:00
Michael Stack d7de304808 HADOOP-2557 Shell count function
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611537 13f79535-47bb-0310-9956-ffa450edef68
2008-01-13 05:24:14 +00:00
Michael Stack 470b3a3200 HADOOP-2389 Provide multiple language bindings for HBase (Thrift)
Actual code (first commit added thrift lib so this patch would build).


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611535 13f79535-47bb-0310-9956-ffa450edef68
2008-01-13 04:46:44 +00:00
Jim Kellerman 9c142a76a1 HADOOP-2478 Restructure how HBase lays out files in the file system (phase 2) Includes migration tool org.apache.hadoop.hbase.util.Migrate
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611519 13f79535-47bb-0310-9956-ffa450edef68
2008-01-13 01:36:08 +00:00
Michael Stack 979da3823a HADOOP-2548 Make TableMap and TableReduce generic
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611488 13f79535-47bb-0310-9956-ffa450edef68
2008-01-12 21:32:46 +00:00
Michael Stack d004f6e545 HADOOP-2558 fixes for build up on hudson
Part 5.  Fix NPE in make multiregion.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@611005 13f79535-47bb-0310-9956-ffa450edef68
2008-01-11 01:19:06 +00:00
Michael Stack e3031f035f HADOOP-2558 fixes for build up on hudson
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610978 13f79535-47bb-0310-9956-ffa450edef68
2008-01-10 23:05:31 +00:00
Michael Stack db34c56319 HADOOP-2389 Provide multiple language bindings for HBase (Thrift)
Added thrift jar in advance so HADOOP-2389 patch will build on hudson.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610921 13f79535-47bb-0310-9956-ffa450edef68
2008-01-10 20:34:59 +00:00
Michael Stack df0f5658a5 HADOOP-2553 Don't make Long objects calculating hbase type hash codes
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610698 13f79535-47bb-0310-9956-ffa450edef68
2008-01-10 06:57:00 +00:00
Michael Stack 765ee86279 HADOOP-2558 fixes for build up on hudson (part 2)
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610696 13f79535-47bb-0310-9956-ffa450edef68
2008-01-10 06:47:22 +00:00
Jim Kellerman 3817485e03 HADOOP-2478 test input data.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610603 13f79535-47bb-0310-9956-ffa450edef68
2008-01-09 22:51:04 +00:00
Michael Stack 3d80b1a498 HADOOP-2558 fixes for build up on hudson (Part 1)
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610280 13f79535-47bb-0310-9956-ffa450edef68
2008-01-09 06:40:10 +00:00
Michael Stack a22bf5e1e2 HADOOP-2490 Failure in nightly #346
Add one fix and more logging to help diagnose the failures up on hudson.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610237 13f79535-47bb-0310-9956-ffa450edef68
2008-01-09 00:07:16 +00:00
Michael Stack 450fe7b100 HADOOP-2472 Range selection using filter
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610092 13f79535-47bb-0310-9956-ffa450edef68
2008-01-08 18:27:58 +00:00
Michael Stack f5bfeea892 HADOOP-2450 Show version (and svn revision) in hbase web ui
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@610087 13f79535-47bb-0310-9956-ffa450edef68
2008-01-08 18:11:45 +00:00
Michael Stack 5a804bf5f3 HADOOP-2502 Insert/Select timestamp, Timestamp data type in HQL
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@609730 13f79535-47bb-0310-9956-ffa450edef68
2008-01-07 18:26:08 +00:00
Michael Stack 5893f72c17 HADOOP-2522 Separate MapFile benchmark from PerformanceEvaluation
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@609422 13f79535-47bb-0310-9956-ffa450edef68
2008-01-06 21:58:16 +00:00
Michael Stack 24958ffd44 HADOOP-2240 Truncate for hbase
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@609256 13f79535-47bb-0310-9956-ffa450edef68
2008-01-06 06:11:55 +00:00
Michael Stack 56fa3392a1 HADOOP-2240 Truncate for hbase
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@609254 13f79535-47bb-0310-9956-ffa450edef68
2008-01-06 04:43:54 +00:00
Michael Stack 3f4e2cd235 HADOOP-2530 Missing type in new hbase custom RPC serializer
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@609210 13f79535-47bb-0310-9956-ffa450edef68
2008-01-05 20:39:09 +00:00
Michael Stack 090f130a1b HADOOP-2522 Separate MapFile benchmark from PerformanceEvaluation
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@608941 13f79535-47bb-0310-9956-ffa450edef68
2008-01-04 17:54:16 +00:00
Michael Stack 07eb878e5a HADOOP-2507 REST servlet does not properly base64 row keys and column names
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@608762 13f79535-47bb-0310-9956-ffa450edef68
2008-01-04 06:56:28 +00:00
Michael Stack 13239f413e HADOOP-2504 REST servlet method for deleting a scanner was not properly
mapped


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@608743 13f79535-47bb-0310-9956-ffa450edef68
2008-01-04 04:39:02 +00:00
Michael Stack c89219b47b HADOOP-2519 Performance improvements: Customized RPC serialization
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@608738 13f79535-47bb-0310-9956-ffa450edef68
2008-01-04 03:52:53 +00:00
Michael Stack b0f524f3d7 HADOOP-2506 Remove the algebra package
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@608289 13f79535-47bb-0310-9956-ffa450edef68
2008-01-03 00:06:38 +00:00
Michael Stack 9ebe18e2b4 HADOOP-2505 formatter classes missing apache license
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607754 13f79535-47bb-0310-9956-ffa450edef68
2007-12-31 17:01:27 +00:00
Michael Stack 0e8bbbf2f7 HADOOP-2495 inor performance improvements: Slim-down BatchOperation, etc.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607602 13f79535-47bb-0310-9956-ffa450edef68
2007-12-30 22:22:16 +00:00
Michael Stack 6b005b4f3f HADOOP-2503 REST Insert / Select encoding issues
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607592 13f79535-47bb-0310-9956-ffa450edef68
2007-12-30 21:40:50 +00:00
Michael Stack 164bc44b58 HADOOP-2485 Make mapfile index interval configurable
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@607131 13f79535-47bb-0310-9956-ffa450edef68
2007-12-27 22:26:27 +00:00
Michael Stack bbae5a575f HADOOP-2479 Save on number of Text object creations
Add new files.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@606333 13f79535-47bb-0310-9956-ffa450edef68
2007-12-21 22:01:23 +00:00
Michael Stack 87273adb1c HADOOP-2479 Save on number of Text object creations
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@606332 13f79535-47bb-0310-9956-ffa450edef68
2007-12-21 21:58:25 +00:00
Michael Stack 0465b18a35 HADOOP-2471 Add reading/writing MapFile to PerformanceEvaluation suite
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605976 13f79535-47bb-0310-9956-ffa450edef68
2007-12-20 16:44:59 +00:00
Michael Stack 3b36d543de HADOOP-2467 scanner truncates resultset when > 1 column families
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605811 13f79535-47bb-0310-9956-ffa450edef68
2007-12-20 05:35:07 +00:00
Jim Kellerman db809b2145 HADOOP-2468 TestRegionServerExit failed in Hadoop-Nightly #338
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605675 13f79535-47bb-0310-9956-ffa450edef68
2007-12-19 20:11:17 +00:00
Jim Kellerman 83c09ebccc HADOOP-2458 HStoreFile.writeSplitInfo should just call HStoreFile.Reference.write
HADOOP-2458 HStoreFile.writeSplitInfo should just call HStoreFile.Reference.write 


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605466 13f79535-47bb-0310-9956-ffa450edef68
2007-12-19 08:22:33 +00:00
Michael Stack 2630fd3cee HADOOP-2455 Error in Help-string of create command
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605277 13f79535-47bb-0310-9956-ffa450edef68
2007-12-18 18:06:45 +00:00
Jim Kellerman c55f90590a HADOOP-2451 End key is incorrectly assigned in many region splits
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@605102 13f79535-47bb-0310-9956-ffa450edef68
2007-12-18 06:26:11 +00:00
Jim Kellerman c73ddd1aa8 HADOOP-2441 Fix build failures in TestHBaseCluster
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604999 13f79535-47bb-0310-9956-ffa450edef68
2007-12-17 20:53:45 +00:00
Jim Kellerman 6da6ebed1e HADOOP-2199 Add tools for going from hregion filename to region name in logs
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604325 13f79535-47bb-0310-9956-ffa450edef68
2007-12-14 22:57:29 +00:00
Jim Kellerman 9b68f4bf41 HADOOP-2430 Master will not shut down if there are no active region servers
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604309 13f79535-47bb-0310-9956-ffa450edef68
2007-12-14 21:51:45 +00:00
Jim Kellerman 10bac1971d HADOOP-2414 Fix ArrayIndexOutOfBoundsException in bloom filters.
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604281 13f79535-47bb-0310-9956-ffa450edef68
2007-12-14 19:58:33 +00:00
Michael Stack b36f712736 HADOOP-2286 Add being able to shutdown regionservers
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604233 13f79535-47bb-0310-9956-ffa450edef68
2007-12-14 17:12:09 +00:00
Jim Kellerman 438b82450a HADOOP-2418 Fix assertion failures in TestTableMapReduce, TestTableIndex, and TestTableJoinMapReduce
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604034 13f79535-47bb-0310-9956-ffa450edef68
2007-12-13 21:28:03 +00:00
Jim Kellerman a24a76ca83 HADOOP-2417 Fix critical shutdown problem introduced by HADOOP-2338
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@604011 13f79535-47bb-0310-9956-ffa450edef68
2007-12-13 20:02:30 +00:00
Michael Stack 91de46cac1 HADOOP-2351 If select command returns no result, it doesn't need to show
the header information


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603940 13f79535-47bb-0310-9956-ffa450edef68
2007-12-13 15:43:04 +00:00
Michael Stack f8a906f49f HADOOP-2047 Add an '--master=X' and '--html' command-line parameters to shell
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603824 13f79535-47bb-0310-9956-ffa450edef68
2007-12-13 05:43:59 +00:00
Michael Stack c0000537e7 HADOOP-2407 Keeping MapFile.Reader open is expensive: Part 2
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603652 13f79535-47bb-0310-9956-ffa450edef68
2007-12-12 16:00:25 +00:00
Jim Kellerman c499da8b7b HADOOP-2392 HADOOP-2324 HADOOP-2396 HADOOP-2397
HADOOP-2392, HADOOP-2324:

Chore
- initialChore() now returns boolean

HMaster
- rather than retry in root and meta scanners, return if a scan fails. It will get retried on the next scan. This has two effects: 1) scanners exit more quickly during shutdown and 2) they don't keep retrying to connect to a dead server, allowing them to recover from a server going down more quickly.
- initialScan in root and meta scanners return boolean and do not progress to maintenanceScan until the initial scan completes successfully.

HRegionServer
- speed up region server exit by reordering join's so that we join with threads in the order that we told them to stop

TestTableMapReduce
- remove overrides of heartbeat and thread wake intervals

HADOOP-2396:

HMaster
- move check for null HRegionInfo before first attempt to dereference it.

HADOOP-2397:
- HMaster$BaseScanner.checkAssigned: don't try to split dead server's log if initial startup has completed.

HADOOP-2353:

HMsg
- change toString() to only output the region name rather than calling HRegionInfo.toString()

StaticTestEnvironment
- make logging a bit less verbose

TestHLog
- was writing to local file system and failing on Windows


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603428 13f79535-47bb-0310-9956-ffa450edef68
2007-12-12 00:40:02 +00:00
Michael Stack c70f6c5122 HADOOP-2370 Allow column families with an unlimited number of versions
git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603315 13f79535-47bb-0310-9956-ffa450edef68
2007-12-11 17:56:51 +00:00
Michael Stack aa5e98f98d HADOOP-2243 getRow returns empty Map if no-such row.. should return null
Intentionally not added to the CHANGES.txt because way hbase currently works
is correct; this commit just adds a bit of clarifying javadoc.


git-svn-id: https://svn.apache.org/repos/asf/lucene/hadoop/trunk/src/contrib/hbase@603307 13f79535-47bb-0310-9956-ffa450edef68
2007-12-11 17:17:29 +00:00