Commit Graph

1754 Commits

Author SHA1 Message Date
Michael Stack 1cd57207fd HBASE-1215 0.19.0 -> 0.20.0 migration (hfile, HCD changes, HSK changes)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@796894 13f79535-47bb-0310-9956-ffa450edef68
2009-07-22 22:19:24 +00:00
Michael Stack 4d7712c28f HBASE-1215 migration; final part. Adds a MR job to rewrite store files.
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@796890 13f79535-47bb-0310-9956-ffa450edef68
2009-07-22 21:57:37 +00:00
Michael Stack 1bf0e28167 HBASE-1215 migration; metautils scan of meta region was broken; wouldn't see first row
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@796856 13f79535-47bb-0310-9956-ffa450edef68
2009-07-22 19:39:28 +00:00
Michael Stack 9037b2149a HBASE-1215 migration; metautils scan of meta region was broken; wouldn't see first row
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@796850 13f79535-47bb-0310-9956-ffa450edef68
2009-07-22 19:33:04 +00:00
Michael Stack 2fc56ed998 HBASE-1215 migration part 7; javadoc and extra setVersion utility
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@796731 13f79535-47bb-0310-9956-ffa450edef68
2009-07-22 14:06:36 +00:00
Michael Stack cbc87cd00d HBASE-1215 part 6; adding logging
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@796615 13f79535-47bb-0310-9956-ffa450edef68
2009-07-22 05:24:35 +00:00
Michael Stack 26c49c2d32 HBASE-1215 migration part 6 fixes
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@796612 13f79535-47bb-0310-9956-ffa450edef68
2009-07-22 04:23:09 +00:00
Michael Stack 5fea8fba12 Working improvement by nitay
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@796554 13f79535-47bb-0310-9956-ffa450edef68
2009-07-21 21:57:15 +00:00
Michael Stack 2b98e7e256 HBASE-1215 part 5 of migration; adds a migration test to unit suite with verification that migration worked
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@796542 13f79535-47bb-0310-9956-ffa450edef68
2009-07-21 21:18:52 +00:00
Michael Stack c66bdea9bb Adds rewrite of store files. Removed HRS.getServerInfo. Use getHServerInfo instead
M  src/test/org/apache/hadoop/hbase/MiniHBaseCluster.java
  Removed getServerInfo.  Use getHServerInfo instead.
M  src/java/org/apache/hadoop/hbase/migration/package-info.java
  Fixed package.
M src/java/org/apache/hadoop/hbase/migration/nineteen/io/HBaseMapFile.java
  Use the migration HSK explicitly.  Disable getting midky.  Unnecessary
  in a migration.
M src/java/org/apache/hadoop/hbase/migration/nineteen/regionserver/HStoreFile.java
  Pass encoded name of region rather than a HRI. I don't know HRI
  when migrating and all that is wanted anyways is the encoded name.
  Added in static isReference.
M src/java/org/apache/hadoop/hbase/regionserver/HRegionServer.java
  Minor javadoc and formatting.  Improved DEBUG messaging.
  Removed getServerInfo. Use getHServerInfo instead.
M src/java/org/apache/hadoop/hbase/regionserver/HLog.java
  Added logging of writer closes on splits.
M src/java/org/apache/hadoop/hbase/regionserver/StoreFile.java
  Minor formatting.
M src/java/org/apache/hadoop/hbase/HServerInfo.java
  Removed useless qualifiers.
M src/java/org/apache/hadoop/hbase/LocalHBaseCluster.java
  Use getHServerInfo instead of getServerInfo.
M src/java/org/apache/hadoop/hbase/master/ServerManager.java
  Formatting.  More detailed log message.
M src/java/org/apache/hadoop/hbase/master/HMaster.java
  Minor formatting.
M src/java/org/apache/hadoop/hbase/master/RegionManager.java
  Minor formatting.
M src/java/org/apache/hadoop/hbase/HServerAddress.java
  Minor formatting.
M src/java/org/apache/hadoop/hbase/util/MetaUtils.java
  Minor formatting.
M src/java/org/apache/hadoop/hbase/util/Migrate.java
  Added rewrite of store file from old to new format.
M src/webapps/regionserver/regionserver.jsp
  Use getHServerInfo instead of getServerInfo.


git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@796326 13f79535-47bb-0310-9956-ffa450edef68
2009-07-21 14:40:34 +00:00
Jonathan Gray dc82f5d093 HBASE-1677 TestHeapSize failing for me on latest trunk
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@796161 13f79535-47bb-0310-9956-ffa450edef68
2009-07-21 06:43:57 +00:00
Michael Stack 87956cea5b HBASE-1359 After a large truncating table HBase becomes unresponsive
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@796041 13f79535-47bb-0310-9956-ffa450edef68
2009-07-20 22:05:03 +00:00
Michael Stack b740d37d0b HBASE-1573 Holes in master state change; updated startcode and server go into .META. but catalog scanner just got old values
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@795916 13f79535-47bb-0310-9956-ffa450edef68
2009-07-20 16:55:17 +00:00
Michael Stack 8809929dff HBASE-1669 need dynamic extensibility of HBaseRPC code maps and interface lists
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@795290 13f79535-47bb-0310-9956-ffa450edef68
2009-07-18 00:45:27 +00:00
Michael Stack c3921a955d HBASE-1215 Migration. Pull in classes I need to read old file types. Removed old classes no longer needed from io package (e.g. SequenceFile and MapFile) -- revert file version change
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@795282 13f79535-47bb-0310-9956-ffa450edef68
2009-07-18 00:17:17 +00:00
Michael Stack 1f68460276 HBASE-1215 Migration. Pull in classes I need to read old file types. Removed old classes no longer needed from io package (e.g. SequenceFile and MapFile)
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@795230 13f79535-47bb-0310-9956-ffa450edef68
2009-07-17 21:23:11 +00:00
Jonathan Gray 6f242ea63f HBASE-1655 Usability improvements to HTablePool
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@795201 13f79535-47bb-0310-9956-ffa450edef68
2009-07-17 19:25:13 +00:00
Michael Stack cf4d1a8a7d HBASE-1668 hbase-1609 broke TestHRegion.testScanSplitOnRegion unit test
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@795174 13f79535-47bb-0310-9956-ffa450edef68
2009-07-17 18:06:09 +00:00
Michael Stack aa4df127a9 HBASE-1609 We wait on leases to expire before regionserver goes down. Rather, just let client fail
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@794956 13f79535-47bb-0310-9956-ffa450edef68
2009-07-17 04:27:11 +00:00
Michael Stack ef30d39681 HBASE-1583 Start/Stop of large cluster untenable
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@794905 13f79535-47bb-0310-9956-ffa450edef68
2009-07-16 23:24:21 +00:00
Andrew Kyle Purtell 53b3084c85 HBASE-1665 expose more load information to the client side
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@794902 13f79535-47bb-0310-9956-ffa450edef68
2009-07-16 23:13:41 +00:00
Michael Stack 8439231fe7 HBASE-1664 Disable 1058 on catalog tables
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@794867 13f79535-47bb-0310-9956-ffa450edef68
2009-07-16 21:29:05 +00:00
Michael Stack 935eb0fb1c HBASE-1215 migration; putting file system version back to 6 from 7 for time being -- otherwise fellas like ryan will need to run a (non-existent) migration
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@794810 13f79535-47bb-0310-9956-ffa450edef68
2009-07-16 19:45:45 +00:00
Michael Stack 54d3670219 HBASE-1663 Request compaction only once instead of every time 500ms each time we cycle the hstore.getStorefilesCount() > this.blockingStoreFilesNumber loop
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@794788 13f79535-47bb-0310-9956-ffa450edef68
2009-07-16 19:15:22 +00:00
Michael Stack 64311a2922 HBASE-1215 allow that file rewrite may have happened before migration -- likely the case when data is big
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@794535 13f79535-47bb-0310-9956-ffa450edef68
2009-07-16 05:27:25 +00:00
Michael Stack 525d1f985d HBASE-1215 part2; check that all has been major compacted before starting migration
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@794471 13f79535-47bb-0310-9956-ffa450edef68
2009-07-16 00:13:44 +00:00
Michael Stack 797e2316bc HBASE-1662 Tool to run major compaction on catalog regions when hbase is shutdown
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@794448 13f79535-47bb-0310-9956-ffa450edef68
2009-07-15 22:50:11 +00:00
Nitay Joffe 7b2eb07de7 CHANGES.txt for HBASE-1632
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@794334 13f79535-47bb-0310-9956-ffa450edef68
2009-07-15 17:42:25 +00:00
Nitay Joffe 0175729a01 HBASE-1632 Write documentation for configuring/managing ZooKeeper with HBase
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@794331 13f79535-47bb-0310-9956-ffa450edef68
2009-07-15 17:40:39 +00:00
Jonathan Gray 4dee3ff2e4 HBASE-1661 HBASE-1215 partial commit broke trunk, does not compile
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@794282 13f79535-47bb-0310-9956-ffa450edef68
2009-07-15 14:27:10 +00:00
Michael Stack 10c33cc48d HBASE-1215 [migration] 0.19.0 -> 0.20.0 migration (hfile, HCD changes, HSK changes) -- part 1
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@794140 13f79535-47bb-0310-9956-ffa450edef68
2009-07-15 05:38:40 +00:00
Ryan Rawson 3e6fa5f0b8 HBASE-1659, merge tool binary fixes
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@794125 13f79535-47bb-0310-9956-ffa450edef68
2009-07-15 00:36:33 +00:00
Michael Stack 740749bcea HBASE-1658 Remove UI refresh -- its annoying
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@794117 13f79535-47bb-0310-9956-ffa450edef68
2009-07-14 23:48:44 +00:00
Bryan Duxbury 6ac21bbb48 HBASE-1656: loadZooConfig can mask true error
Include the original exception along with the new message.



git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@794059 13f79535-47bb-0310-9956-ffa450edef68
2009-07-14 20:32:31 +00:00
Michael Stack e9c8ea8156 HBASE-1650 HBASE-1551 broke the ability to manage non-regionserver start-up/shut down. ie: you cant start/stop thrift on a cluster anymore
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@794011 13f79535-47bb-0310-9956-ffa450edef68
2009-07-14 18:47:25 +00:00
Michael Stack 6c7ef5bfc7 HBASE-1651 client is broken, it requests ROOT region location from ZK too much
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@793999 13f79535-47bb-0310-9956-ffa450edef68
2009-07-14 18:08:56 +00:00
Michael Stack 503cc3b990 HBASE-1649 ValueFilter may not reset its internal state
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@793642 13f79535-47bb-0310-9956-ffa450edef68
2009-07-13 18:09:55 +00:00
Michael Stack c493cd3bcc HBASE-1646 Scan-s can't set a Filter
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@793431 13f79535-47bb-0310-9956-ffa450edef68
2009-07-12 23:21:26 +00:00
Michael Stack 67f428cc42 HBASE-1470 hbase and HADOOP-4379, dhruba's flush/sync
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@793145 13f79535-47bb-0310-9956-ffa450edef68
2009-07-10 23:18:15 +00:00
Michael Stack 2a21d4759a HBASE-1644 Result.row is cached in getRow; this breaks MapReduce
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@793130 13f79535-47bb-0310-9956-ffa450edef68
2009-07-10 22:45:53 +00:00
Michael Stack f09b21bae2 HBASE-1643 ScanDeleteTracker takes comparator but it unused
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@793125 13f79535-47bb-0310-9956-ffa450edef68
2009-07-10 21:48:53 +00:00
Michael Stack a621d508e9 HBASE-1643 ScanDeleteTracker takes comparator but it unused
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@793124 13f79535-47bb-0310-9956-ffa450edef68
2009-07-10 21:47:08 +00:00
Nitay Joffe 99f1faf30b HBASE-1639 clean checkout with empty hbase-site.xml, zk won't start
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@793123 13f79535-47bb-0310-9956-ffa450edef68
2009-07-10 21:44:43 +00:00
Michael Stack 10c178fcb0 HBASE-1644 Result.row is cached in getRow; this breaks MapReduce
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@793115 13f79535-47bb-0310-9956-ffa450edef68
2009-07-10 21:34:16 +00:00
Michael Stack 6691578821 HBASE-1603 MR failed 'RetriesExhaustedException: Trying to contact region server Some server for region TestTable...'
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@793094 13f79535-47bb-0310-9956-ffa450edef68
2009-07-10 19:52:20 +00:00
Michael Stack f10f85f0ff HBASE-1643 ScanDeleteTracker takes comparator but it unused
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@793084 13f79535-47bb-0310-9956-ffa450edef68
2009-07-10 19:30:39 +00:00
Michael Stack 60e69c6982 HBASE-1627 TableInputFormatBase#nextKeyValue catches the wrong exception
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@793077 13f79535-47bb-0310-9956-ffa450edef68
2009-07-10 19:06:38 +00:00
Michael Stack 09200b7260 HBASE-1641 Stargate build.xml causes error in Eclipse
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@793071 13f79535-47bb-0310-9956-ffa450edef68
2009-07-10 18:37:52 +00:00
Jean-Daniel Cryans 269cc35ad6 HBASE-698 HLog recovery is not performed after master failure
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@792964 13f79535-47bb-0310-9956-ffa450edef68
2009-07-10 14:58:26 +00:00
Michael Stack e2f5f48014 HBASE-1640 Allow passing arguments to jruby script run when run by bin/hbase shell
git-svn-id: https://svn.apache.org/repos/asf/hadoop/hbase/trunk@792802 13f79535-47bb-0310-9956-ffa450edef68
2009-07-10 04:20:48 +00:00